2024-08-20T01:15:09.390 INFO:root:teuthology version: 1.2.0 2024-08-20T01:15:09.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-20T01:15:09.517 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861327 branch: wip-hemanth-testing-2024-08-19-1357 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/blogbench}} email: hyelloji@redhat.com first_in_suite: false job_id: '7861327' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-08-19-1357 ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: ef4275410d8483698016fe484b2a3c664080b4c1 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.dir_split install: ceph: flavor: default sha1: ef4275410d8483698016fe484b2a3c664080b4c1 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-08-19-1357 sha1: ef4275410d8483698016fe484b2a3c664080b4c1 owner: scheduled_hyelloji@teuthology priority: 10 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7244 sha1: ef4275410d8483698016fe484b2a3c664080b4c1 sleep_before_teardown: 0 suite: fs suite_branch: wip-hemanth-testing-2024-08-19-1357 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_ef4275410d8483698016fe484b2a3c664080b4c1/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: ef4275410d8483698016fe484b2a3c664080b4c1 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi022.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCUdIJQXcSCVVTZDlJdM1TN0pwz8v50kZBkfSLDUPoRwrWM/0ZWYz4foIMo+Xab+JI7z8QJ1/PL9BVqLkracLMA= smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFfq8hSdpK4MYNFOhK0JyHm84wtFmDEPBcp/0+oi8aTy53JM0V4Ga8BSwgKrDJP3LKVmogYKGrIefvjfxm25544= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFE417fRmxc24XNuqQ3GRt4AYBGYZTR4phjV58pH+0a8E/mDltTSHtjrWh0Wz2ipquRvYK++eJtAmxBpzClbUFo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-19_19:57:23 tube: smithi user: hyelloji verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-20T01:15:09.518 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_ef4275410d8483698016fe484b2a3c664080b4c1/qa; will attempt to use it 2024-08-20T01:15:09.518 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_ef4275410d8483698016fe484b2a3c664080b4c1/qa/tasks 2024-08-20T01:15:09.519 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-20T01:15:09.520 INFO:teuthology.task.internal:Checking packages... 2024-08-20T01:15:09.541 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ef4275410d8483698016fe484b2a3c664080b4c1' 2024-08-20T01:15:09.542 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-20T01:15:09.542 INFO:teuthology.packaging:ref: None 2024-08-20T01:15:09.542 INFO:teuthology.packaging:tag: None 2024-08-20T01:15:09.542 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-08-19-1357 2024-08-20T01:15:09.542 INFO:teuthology.packaging:sha1: ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:15:09.542 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-08-19-1357 2024-08-20T01:15:09.682 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-5872.gef427541 2024-08-20T01:15:09.684 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-20T01:15:09.690 INFO:teuthology.task.internal:no buildpackages task found 2024-08-20T01:15:09.690 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-20T01:15:09.735 INFO:teuthology.task.internal:Saving configuration 2024-08-20T01:15:09.756 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-20T01:15:09.763 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-20T01:15:09.786 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861327', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-20 01:10:09.833741', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCUdIJQXcSCVVTZDlJdM1TN0pwz8v50kZBkfSLDUPoRwrWM/0ZWYz4foIMo+Xab+JI7z8QJ1/PL9BVqLkracLMA='} 2024-08-20T01:15:09.810 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861327', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-20 01:10:09.830673', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFfq8hSdpK4MYNFOhK0JyHm84wtFmDEPBcp/0+oi8aTy53JM0V4Ga8BSwgKrDJP3LKVmogYKGrIefvjfxm25544='} 2024-08-20T01:15:09.832 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861327', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-20 01:10:09.832282', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFE417fRmxc24XNuqQ3GRt4AYBGYZTR4phjV58pH+0a8E/mDltTSHtjrWh0Wz2ipquRvYK++eJtAmxBpzClbUFo='} 2024-08-20T01:15:09.832 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-20T01:15:09.839 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-08-20T01:15:09.839 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-08-20T01:15:09.839 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-08-20T01:15:09.839 INFO:teuthology.run_tasks:Running task console_log... 2024-08-20T01:15:09.922 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc6591cbbe0>, signals=[15]) 2024-08-20T01:15:09.922 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-20T01:15:09.929 INFO:teuthology.task.internal:Opening connections... 2024-08-20T01:15:09.929 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2024-08-20T01:15:09.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T01:15:10.006 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2024-08-20T01:15:10.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T01:15:10.119 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-08-20T01:15:10.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T01:15:10.195 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-20T01:15:10.202 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2024-08-20T01:15:10.222 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2024-08-20T01:15:10.223 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2024-08-20T01:15:10.281 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2024-08-20T01:15:10.281 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="9" 2024-08-20T01:15:10.281 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2024-08-20T01:15:10.281 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2024-08-20T01:15:10.281 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="9" 2024-08-20T01:15:10.281 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el9" 2024-08-20T01:15:10.282 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-20T01:15:10.282 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2024-08-20T01:15:10.282 INFO:teuthology.orchestra.run.smithi022.stdout:LOGO="fedora-logo-icon" 2024-08-20T01:15:10.282 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-20T01:15:10.282 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2024-08-20T01:15:10.282 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-20T01:15:10.282 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-20T01:15:10.282 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-20T01:15:10.283 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-08-20T01:15:10.301 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2024-08-20T01:15:10.319 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2024-08-20T01:15:10.319 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-08-20T01:15:10.377 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2024-08-20T01:15:10.378 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2024-08-20T01:15:10.378 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2024-08-20T01:15:10.378 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2024-08-20T01:15:10.378 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2024-08-20T01:15:10.378 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2024-08-20T01:15:10.378 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-20T01:15:10.378 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2024-08-20T01:15:10.378 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2024-08-20T01:15:10.378 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-20T01:15:10.378 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2024-08-20T01:15:10.378 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-20T01:15:10.378 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-20T01:15:10.379 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-20T01:15:10.379 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-08-20T01:15:10.401 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-08-20T01:15:10.420 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-08-20T01:15:10.420 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-08-20T01:15:10.478 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-08-20T01:15:10.478 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-08-20T01:15:10.478 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-08-20T01:15:10.478 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-08-20T01:15:10.478 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-08-20T01:15:10.478 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-08-20T01:15:10.478 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-20T01:15:10.478 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-08-20T01:15:10.479 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-08-20T01:15:10.479 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-20T01:15:10.479 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-08-20T01:15:10.479 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-20T01:15:10.479 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-20T01:15:10.479 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-20T01:15:10.479 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-08-20T01:15:10.500 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-20T01:15:10.510 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-20T01:15:10.516 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-20T01:15:10.517 DEBUG:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2024-08-20T01:15:10.519 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2024-08-20T01:15:10.522 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-08-20T01:15:10.539 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-20T01:15:10.545 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-20T01:15:10.545 DEBUG:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2024-08-20T01:15:10.578 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2024-08-20T01:15:10.580 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-08-20T01:15:10.692 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-20T01:15:10.771 INFO:teuthology.run_tasks:Running task kernel... 2024-08-20T01:15:10.787 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-20T01:15:10.787 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-08-20T01:15:10.787 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-08-20T01:15:10.787 DEBUG:teuthology.orchestra.run.smithi022:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-20T01:15:10.805 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T01:15:10.805 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2024-08-20T01:15:10.864 INFO:teuthology.orchestra.run.smithi022.stdout:5.14.0-496.el9.x86_64 2024-08-20T01:15:10.865 INFO:teuthology.task.kernel:Running kernel on smithi022: 5.14.0-496.el9.x86_64 2024-08-20T01:15:10.865 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum install -y kernel 2024-08-20T01:15:19.770 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 1.2 MB/s | 8.2 MB 00:07 2024-08-20T01:15:26.327 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 3.7 MB/s | 20 MB 00:05 2024-08-20T01:15:35.375 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 1.3 MB/s | 6.6 MB 00:05 2024-08-20T01:15:36.883 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 86 kB/s | 18 kB 00:00 2024-08-20T01:15:37.645 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 35 MB/s | 22 MB 00:00 2024-08-20T01:15:43.276 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-08-20T01:15:45.258 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-20T01:15:45.258 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-5.14.0-496.el9.x86_64 is already installed. 2024-08-20T01:15:45.337 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-08-20T01:15:45.338 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-08-20T01:15:45.338 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-08-20T01:15:45.440 DEBUG:teuthology.orchestra.run.smithi022:> echo no | sudo yum reinstall kernel || true 2024-08-20T01:15:46.017 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:03 ago on Tue 20 Aug 2024 01:15:43 AM UTC. 2024-08-20T01:15:46.159 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-08-20T01:15:46.165 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-08-20T01:15:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2024-08-20T01:15:46.165 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-08-20T01:15:46.165 INFO:teuthology.orchestra.run.smithi022.stdout:Reinstalling: 2024-08-20T01:15:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: kernel x86_64 5.14.0-496.el9 baseos 1.8 M 2024-08-20T01:15:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:15:46.165 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-08-20T01:15:46.165 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-08-20T01:15:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:15:46.166 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 1.8 M 2024-08-20T01:15:46.166 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 0 2024-08-20T01:15:46.166 INFO:teuthology.orchestra.run.smithi022.stderr:Operation aborted. 2024-08-20T01:15:46.224 INFO:teuthology.orchestra.run.smithi022.stdout:Is this ok [y/N]: 2024-08-20T01:15:46.224 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum reinstall -y kernel || true 2024-08-20T01:15:46.799 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:03 ago on Tue 20 Aug 2024 01:15:43 AM UTC. 2024-08-20T01:15:46.929 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-08-20T01:15:46.929 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-08-20T01:15:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2024-08-20T01:15:46.929 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-08-20T01:15:46.930 INFO:teuthology.orchestra.run.smithi022.stdout:Reinstalling: 2024-08-20T01:15:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: kernel x86_64 5.14.0-496.el9 baseos 1.8 M 2024-08-20T01:15:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:15:46.930 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-08-20T01:15:46.930 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-08-20T01:15:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:15:46.931 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 1.8 M 2024-08-20T01:15:46.931 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 0 2024-08-20T01:15:46.931 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-08-20T01:15:47.126 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:15:47.187 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 172.65.90.20) 2024-08-20T01:15:47.218 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:15:47.289 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:15:47.325 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:15:47.383 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:15:47.508 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:15:47.669 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 163.114.132.32) 2024-08-20T01:15:47.993 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 163.114.132.32) 2024-08-20T01:15:48.153 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:15:48.484 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:15:48.541 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:15:48.635 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:15:48.678 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:15:48.753 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:15:48.813 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:15:48.918 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:15:49.894 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-5.14.0-496.el9.x86_64.rpm 640 kB/s | 1.8 MB 00:02 2024-08-20T01:15:49.896 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-08-20T01:15:49.897 INFO:teuthology.orchestra.run.smithi022.stdout:Total 618 kB/s | 1.8 MB 00:02 2024-08-20T01:15:49.928 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-08-20T01:15:50.187 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-08-20T01:15:50.188 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-08-20T01:15:50.218 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-08-20T01:15:50.218 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-08-20T01:15:50.372 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-08-20T01:15:50.446 INFO:teuthology.orchestra.run.smithi022.stdout: Reinstalling : kernel-5.14.0-496.el9.x86_64 1/2 2024-08-20T01:15:50.447 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : kernel-5.14.0-496.el9.x86_64 2/2 2024-08-20T01:15:51.150 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-5.14.0-496.el9.x86_64 2/2 2024-08-20T01:15:51.150 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-5.14.0-496.el9.x86_64 1/2 2024-08-20T01:15:51.879 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-5.14.0-496.el9.x86_64 2/2 2024-08-20T01:15:51.879 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:15:51.879 INFO:teuthology.orchestra.run.smithi022.stdout:Reinstalled: 2024-08-20T01:15:51.879 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-5.14.0-496.el9.x86_64 2024-08-20T01:15:51.879 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:15:51.879 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-08-20T01:15:52.066 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q kernel | sort -rV | head -n 1 2024-08-20T01:15:52.126 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-5.14.0-496.el9.x86_64 2024-08-20T01:15:52.127 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-496.el9.x86_64 2024-08-20T01:15:52.127 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-20T01:15:52.127 DEBUG:teuthology.parallel:result is None 2024-08-20T01:15:52.127 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-20T01:15:52.134 INFO:teuthology.task.internal:Creating test directory... 2024-08-20T01:15:52.134 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-20T01:15:52.137 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-20T01:15:52.139 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-20T01:15:52.157 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-20T01:15:52.164 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-20T01:15:52.174 INFO:teuthology.task.internal:Creating archive directory... 2024-08-20T01:15:52.174 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-20T01:15:52.192 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-20T01:15:52.198 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-20T01:15:52.372 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-20T01:15:52.378 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-20T01:15:52.378 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-20T01:15:52.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T01:15:52.396 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-20T01:15:52.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T01:15:52.413 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-20T01:15:52.415 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-20T01:15:52.439 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-20T01:15:52.465 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-20T01:15:52.486 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-20T01:15:52.494 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-20T01:15:52.513 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-20T01:15:52.515 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-20T01:15:52.533 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-20T01:15:52.534 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-20T01:15:52.541 INFO:teuthology.task.internal:Configuring sudo... 2024-08-20T01:15:52.542 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-20T01:15:52.544 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-20T01:15:52.546 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-20T01:15:52.574 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-20T01:15:52.583 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-20T01:15:52.583 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-20T01:15:52.610 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-20T01:15:52.615 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-20T01:15:52.631 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-20T01:15:52.707 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-20T01:15:52.752 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-20T01:15:52.835 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-20T01:15:52.876 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-08-20T01:15:52.877 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-20T01:15:52.942 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-20T01:15:52.985 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-20T01:15:53.038 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-20T01:15:53.124 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-20T01:15:53.167 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-08-20T01:15:53.167 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-20T01:15:53.236 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-20T01:15:53.277 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-20T01:15:53.343 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-20T01:15:53.387 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-20T01:15:53.431 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-08-20T01:15:53.431 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-20T01:15:53.499 DEBUG:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2024-08-20T01:15:53.501 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2024-08-20T01:15:53.504 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-08-20T01:15:53.534 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-20T01:15:53.540 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-20T01:15:53.579 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-20T01:15:53.931 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-20T01:15:53.938 INFO:teuthology.task.internal:Starting timer... 2024-08-20T01:15:53.938 INFO:teuthology.run_tasks:Running task pcp... 2024-08-20T01:15:54.010 INFO:teuthology.run_tasks:Running task selinux... 2024-08-20T01:15:54.018 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-08-20T01:15:54.018 DEBUG:teuthology.orchestra.run.smithi022:> sudo service auditd rotate 2024-08-20T01:15:54.087 INFO:teuthology.orchestra.run.smithi022.stdout:Rotating logs: 2024-08-20T01:15:54.089 DEBUG:teuthology.orchestra.run.smithi077:> sudo service auditd rotate 2024-08-20T01:15:54.156 INFO:teuthology.orchestra.run.smithi077.stdout:Rotating logs: 2024-08-20T01:15:54.157 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-08-20T01:15:54.226 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-08-20T01:15:54.228 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-20T01:15:54.228 DEBUG:teuthology.orchestra.run.smithi022:> /usr/sbin/getenforce 2024-08-20T01:15:54.254 INFO:teuthology.orchestra.run.smithi022.stdout:Permissive 2024-08-20T01:15:54.254 DEBUG:teuthology.orchestra.run.smithi077:> /usr/sbin/getenforce 2024-08-20T01:15:54.281 INFO:teuthology.orchestra.run.smithi077.stdout:Permissive 2024-08-20T01:15:54.281 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-08-20T01:15:54.304 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-08-20T01:15:54.304 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi022.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi077.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi134.front.sepia.ceph.com': 'permissive'} 2024-08-20T01:15:54.305 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-20T01:15:54.331 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T01:15:54.334 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-20T01:15:54.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T01:15:54.361 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-20T01:15:54.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T01:15:54.389 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-20T01:15:54.389 DEBUG:teuthology.orchestra.run.smithi022:> sudo /usr/sbin/setenforce permissive 2024-08-20T01:15:54.432 DEBUG:teuthology.orchestra.run.smithi077:> sudo /usr/sbin/setenforce permissive 2024-08-20T01:15:54.460 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-08-20T01:15:54.486 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-20T01:15:54.495 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-08-20T01:15:54.498 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-08-20T01:15:54.641 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-20T01:15:54.651 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-20T01:15:54.652 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi022.front.sepia.ceph.com,smithi077.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-20T01:18:13.757 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi022.front.sepia.ceph.com'), Remote(name='ubuntu@smithi077.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2024-08-20T01:18:13.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-08-20T01:18:13.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T01:18:13.837 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-08-20T01:18:13.919 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-08-20T01:18:13.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-08-20T01:18:13.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T01:18:13.994 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-08-20T01:18:14.070 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-08-20T01:18:14.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-08-20T01:18:14.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T01:18:14.148 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-08-20T01:18:14.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-08-20T01:18:14.231 INFO:teuthology.run_tasks:Running task clock... 2024-08-20T01:18:14.241 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-20T01:18:14.241 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-20T01:18:14.242 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-20T01:18:14.244 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-20T01:18:14.245 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-20T01:18:14.247 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-20T01:18:14.247 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-20T01:18:14.274 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-20T01:18:14.275 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-20T01:18:14.289 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-20T01:18:14.291 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-20T01:18:14.303 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-20T01:18:14.313 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: ntpd: command not found 2024-08-20T01:18:14.317 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: ntpd: command not found 2024-08-20T01:18:14.318 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-20T01:18:14.324 INFO:teuthology.orchestra.run.smithi077.stdout:506 Cannot talk to daemon 2024-08-20T01:18:14.329 INFO:teuthology.orchestra.run.smithi022.stdout:506 Cannot talk to daemon 2024-08-20T01:18:14.338 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-20T01:18:14.344 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-08-20T01:18:14.345 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-20T01:18:14.352 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-20T01:18:14.356 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-08-20T01:18:14.360 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-20T01:18:14.370 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-20T01:18:14.385 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-20T01:18:14.406 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-08-20T01:18:14.409 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-20T01:18:14.409 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-08-20T01:18:14.409 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:18:14.409 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:18:14.409 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:18:14.409 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:18:14.417 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2024-08-20T01:18:14.420 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-20T01:18:14.420 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-08-20T01:18:14.421 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:18:14.421 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:18:14.421 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:18:14.421 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:18:14.447 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-08-20T01:18:14.450 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-20T01:18:14.450 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-08-20T01:18:14.450 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:18:14.450 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:18:14.451 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:18:14.451 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:18:14.451 INFO:teuthology.run_tasks:Running task install... 2024-08-20T01:18:14.459 DEBUG:teuthology.task.install:project ceph 2024-08-20T01:18:14.459 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1'}} 2024-08-20T01:18:14.459 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1'} 2024-08-20T01:18:14.459 INFO:teuthology.task.install:Using flavor: default 2024-08-20T01:18:14.465 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-20T01:18:14.465 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-20T01:18:14.465 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1', 'tag': None, 'wait_for_package': False} 2024-08-20T01:18:14.466 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:18:14.468 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1', 'tag': None, 'wait_for_package': False} 2024-08-20T01:18:14.468 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:18:14.469 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1', 'tag': None, 'wait_for_package': False} 2024-08-20T01:18:14.469 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:18:14.612 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/ 2024-08-20T01:18:14.612 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5872.gef427541 2024-08-20T01:18:14.617 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/ 2024-08-20T01:18:14.617 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5872.gef427541 2024-08-20T01:18:14.623 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/ 2024-08-20T01:18:14.623 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5872.gef427541 2024-08-20T01:18:14.723 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-20T01:18:14.724 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-08-20T01:18:14.724 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-20T01:18:14.728 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-20T01:18:14.729 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-08-20T01:18:14.729 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-20T01:18:14.735 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-20T01:18:14.735 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-08-20T01:18:14.735 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-20T01:18:14.751 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-20T01:18:14.752 DEBUG:teuthology.orchestra.run.smithi022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ef4275410d8483698016fe484b2a3c664080b4c1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-20T01:18:14.755 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-20T01:18:14.755 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ef4275410d8483698016fe484b2a3c664080b4c1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-20T01:18:14.761 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-20T01:18:14.761 DEBUG:teuthology.orchestra.run.smithi077:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ef4275410d8483698016fe484b2a3c664080b4c1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-20T01:18:14.819 DEBUG:teuthology.orchestra.run.smithi022:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-20T01:18:14.820 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-20T01:18:14.826 DEBUG:teuthology.orchestra.run.smithi077:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-20T01:18:14.898 DEBUG:teuthology.orchestra.run.smithi022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-20T01:18:14.899 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-20T01:18:14.901 DEBUG:teuthology.orchestra.run.smithi077:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-20T01:18:14.963 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-08-20T01:18:14.963 INFO:teuthology.orchestra.run.smithi022.stdout:check_obsoletes = 1 2024-08-20T01:18:14.964 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-08-20T01:18:14.965 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum clean all 2024-08-20T01:18:14.966 INFO:teuthology.orchestra.run.smithi077.stdout:check_obsoletes = 1 2024-08-20T01:18:14.967 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum clean all 2024-08-20T01:18:15.188 INFO:teuthology.orchestra.run.smithi134.stdout:45 files removed 2024-08-20T01:18:15.191 INFO:teuthology.orchestra.run.smithi077.stdout:45 files removed 2024-08-20T01:18:15.199 INFO:teuthology.orchestra.run.smithi022.stdout:45 files removed 2024-08-20T01:18:15.215 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-20T01:18:15.218 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-20T01:18:15.226 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-20T01:18:15.763 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 311 kB/s | 84 kB 00:00 2024-08-20T01:18:15.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph packages for x86_64 301 kB/s | 84 kB 00:00 2024-08-20T01:18:15.776 INFO:teuthology.orchestra.run.smithi022.stdout:ceph packages for x86_64 320 kB/s | 84 kB 00:00 2024-08-20T01:18:16.047 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-08-20T01:18:16.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-08-20T01:18:16.085 INFO:teuthology.orchestra.run.smithi022.stdout:ceph noarch packages 91 kB/s | 24 kB 00:00 2024-08-20T01:18:16.331 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-08-20T01:18:16.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-08-20T01:18:16.361 INFO:teuthology.orchestra.run.smithi022.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-08-20T01:18:19.932 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 2.3 MB/s | 8.2 MB 00:03 2024-08-20T01:18:22.443 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 1.4 MB/s | 8.2 MB 00:06 2024-08-20T01:18:22.763 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 1.3 MB/s | 8.2 MB 00:06 2024-08-20T01:18:23.869 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 7.2 MB/s | 20 MB 00:02 2024-08-20T01:18:29.711 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 3.3 MB/s | 20 MB 00:06 2024-08-20T01:18:30.155 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 3.2 MB/s | 20 MB 00:06 2024-08-20T01:18:33.576 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 1.1 MB/s | 6.6 MB 00:05 2024-08-20T01:18:35.335 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 18 kB 00:00 2024-08-20T01:18:36.473 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 22 MB/s | 22 MB 00:01 2024-08-20T01:18:38.692 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 1.4 MB/s | 6.6 MB 00:04 2024-08-20T01:18:39.608 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 1.1 MB/s | 6.6 MB 00:06 2024-08-20T01:18:40.392 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 18 kB 00:00 2024-08-20T01:18:41.100 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 18 kB 00:00 2024-08-20T01:18:41.464 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 24 MB/s | 22 MB 00:00 2024-08-20T01:18:41.820 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-08-20T01:18:41.912 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 32 MB/s | 22 MB 00:00 2024-08-20T01:18:43.988 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-20T01:18:43.989 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-20T01:18:44.000 INFO:teuthology.orchestra.run.smithi134.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-20T01:18:44.001 INFO:teuthology.orchestra.run.smithi134.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-20T01:18:44.002 INFO:teuthology.orchestra.run.smithi134.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-20T01:18:44.003 INFO:teuthology.orchestra.run.smithi134.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-20T01:18:44.004 INFO:teuthology.orchestra.run.smithi134.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-20T01:18:44.007 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-20T01:18:44.007 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-20T01:18:44.068 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-08-20T01:18:44.096 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-08-20T01:18:44.096 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-08-20T01:18:44.096 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-08-20T01:18:44.096 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-08-20T01:18:44.097 INFO:teuthology.orchestra.run.smithi134.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-20T01:18:44.097 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:19.0.0-5872.gef427541.el9 ceph 6.6 k 2024-08-20T01:18:44.097 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:19.0.0-5872.gef427541.el9 ceph 5.5 M 2024-08-20T01:18:44.097 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:19.0.0-5872.gef427541.el9 ceph 901 k 2024-08-20T01:18:44.097 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5872.gef427541.el9 ceph 145 k 2024-08-20T01:18:44.097 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:19.0.0-5872.gef427541.el9 ceph 1.5 M 2024-08-20T01:18:44.097 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 150 k 2024-08-20T01:18:44.097 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 14 M 2024-08-20T01:18:44.097 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 7.4 M 2024-08-20T01:18:44.097 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 49 k 2024-08-20T01:18:44.097 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:19.0.0-5872.gef427541.el9 ceph 11 M 2024-08-20T01:18:44.097 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:19.0.0-5872.gef427541.el9 ceph 50 M 2024-08-20T01:18:44.097 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 285 k 2024-08-20T01:18:44.098 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 772 k 2024-08-20T01:18:44.098 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror x86_64 2:19.0.0-5872.gef427541.el9 ceph 225 k 2024-08-20T01:18:44.098 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell x86_64 2:19.0.0-5872.gef427541.el9 ceph 27 k 2024-08-20T01:18:44.098 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 18 k 2024-08-20T01:18:44.098 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-20T01:18:44.098 INFO:teuthology.orchestra.run.smithi134.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-20T01:18:44.098 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-20T01:18:44.098 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:19.0.0-5872.gef427541.el9 ceph 32 k 2024-08-20T01:18:44.098 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 755 k 2024-08-20T01:18:44.098 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:19.0.0-5872.gef427541.el9 ceph 126 k 2024-08-20T01:18:44.098 INFO:teuthology.orchestra.run.smithi134.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-20T01:18:44.098 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-20T01:18:44.098 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-20T01:18:44.099 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-20T01:18:44.099 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-20T01:18:44.099 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-20T01:18:44.099 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:19.0.0-5872.gef427541.el9 ceph 188 k 2024-08-20T01:18:44.099 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:19.0.0-5872.gef427541.el9 ceph 371 k 2024-08-20T01:18:44.099 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:19.0.0-5872.gef427541.el9 ceph 355 k 2024-08-20T01:18:44.099 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:19.0.0-5872.gef427541.el9 ceph 116 k 2024-08-20T01:18:44.099 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:19.0.0-5872.gef427541.el9 ceph 85 k 2024-08-20T01:18:44.099 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.2 M 2024-08-20T01:18:44.099 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:19.0.0-5872.gef427541.el9 ceph 170 k 2024-08-20T01:18:44.099 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-20T01:18:44.099 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-08-20T01:18:44.099 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.5 M 2024-08-20T01:18:44.100 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.2 M 2024-08-20T01:18:44.100 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-08-20T01:18:44.100 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-20T01:18:44.100 INFO:teuthology.orchestra.run.smithi134.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-20T01:18:44.100 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-20T01:18:44.100 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:19.0.0-5872.gef427541.el9 ceph 22 M 2024-08-20T01:18:44.100 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 34 k 2024-08-20T01:18:44.100 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:19.0.0-5872.gef427541.el9 ceph 2.4 M 2024-08-20T01:18:44.100 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 284 k 2024-08-20T01:18:44.100 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:19.0.0-5872.gef427541.el9 ceph 4.8 M 2024-08-20T01:18:44.100 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:19.0.0-5872.gef427541.el9 ceph 17 M 2024-08-20T01:18:44.100 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 16 k 2024-08-20T01:18:44.101 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:19.0.0-5872.gef427541.el9 ceph 25 k 2024-08-20T01:18:44.101 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-20T01:18:44.101 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-20T01:18:44.101 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-20T01:18:44.101 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-20T01:18:44.101 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-20T01:18:44.101 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-20T01:18:44.101 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-20T01:18:44.101 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-20T01:18:44.101 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:19.0.0-5872.gef427541.el9 ceph 163 k 2024-08-20T01:18:44.101 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-20T01:18:44.101 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-20T01:18:44.101 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-20T01:18:44.101 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-20T01:18:44.102 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-20T01:18:44.102 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:19.0.0-5872.gef427541.el9 ceph 508 k 2024-08-20T01:18:44.102 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-20T01:18:44.102 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 5.5 M 2024-08-20T01:18:44.102 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-20T01:18:44.102 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-20T01:18:44.102 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-20T01:18:44.102 INFO:teuthology.orchestra.run.smithi134.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-20T01:18:44.102 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-20T01:18:44.102 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-20T01:18:44.102 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.26-1.el9 appstream 38 k 2024-08-20T01:18:44.102 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp x86_64 0.3.26-1.el9 appstream 4.9 M 2024-08-20T01:18:44.102 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-20T01:18:44.103 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-20T01:18:44.103 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-20T01:18:44.103 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-20T01:18:44.103 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-20T01:18:44.103 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-20T01:18:44.103 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-20T01:18:44.103 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-20T01:18:44.103 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-20T01:18:44.103 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:19.0.0-5872.gef427541.el9 ceph 45 k 2024-08-20T01:18:44.103 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:19.0.0-5872.gef427541.el9 ceph 138 k 2024-08-20T01:18:44.103 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-20T01:18:44.103 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-20T01:18:44.103 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-20T01:18:44.104 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-20T01:18:44.104 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-20T01:18:44.104 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-20T01:18:44.104 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-20T01:18:44.104 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-20T01:18:44.104 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-20T01:18:44.104 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-20T01:18:44.104 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-20T01:18:44.104 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-20T01:18:44.104 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-20T01:18:44.104 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-20T01:18:44.104 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-20T01:18:44.104 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-20T01:18:44.104 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-20T01:18:44.105 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-20T01:18:44.105 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-20T01:18:44.105 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-20T01:18:44.105 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-20T01:18:44.105 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-20T01:18:44.105 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-20T01:18:44.105 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-20T01:18:44.105 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-20T01:18:44.105 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-20T01:18:44.105 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-20T01:18:44.105 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-20T01:18:44.105 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-20T01:18:44.105 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-20T01:18:44.105 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-20T01:18:44.106 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-20T01:18:44.106 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-20T01:18:44.106 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-20T01:18:44.106 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-20T01:18:44.106 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-20T01:18:44.106 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-20T01:18:44.106 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-20T01:18:44.106 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-20T01:18:44.106 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-20T01:18:44.106 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-20T01:18:44.106 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-20T01:18:44.106 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-20T01:18:44.106 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-20T01:18:44.107 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-20T01:18:44.107 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-20T01:18:44.107 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-20T01:18:44.107 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-20T01:18:44.107 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-20T01:18:44.107 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-20T01:18:44.107 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-20T01:18:44.107 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-20T01:18:44.107 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-20T01:18:44.107 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-20T01:18:44.107 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-20T01:18:44.107 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-20T01:18:44.107 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-20T01:18:44.108 INFO:teuthology.orchestra.run.smithi134.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-20T01:18:44.108 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-20T01:18:44.108 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-20T01:18:44.108 INFO:teuthology.orchestra.run.smithi134.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-20T01:18:44.108 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-20T01:18:44.108 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-20T01:18:44.108 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-08-20T01:18:44.108 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-20T01:18:44.108 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:18:44.108 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-08-20T01:18:44.108 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-08-20T01:18:44.108 INFO:teuthology.orchestra.run.smithi134.stdout:Install 148 Packages 2024-08-20T01:18:44.108 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 2 Packages 2024-08-20T01:18:44.108 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:18:44.109 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 232 M 2024-08-20T01:18:44.109 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-08-20T01:18:44.638 INFO:teuthology.orchestra.run.smithi134.stdout:(1/150): ceph-19.0.0-5872.gef427541.el9.x86_64. 36 kB/s | 6.6 kB 00:00 2024-08-20T01:18:45.396 INFO:teuthology.orchestra.run.smithi134.stdout:(2/150): ceph-fuse-19.0.0-5872.gef427541.el9.x8 1.2 MB/s | 901 kB 00:00 2024-08-20T01:18:45.555 INFO:teuthology.orchestra.run.smithi134.stdout:(3/150): ceph-immutable-object-cache-19.0.0-587 916 kB/s | 145 kB 00:00 2024-08-20T01:18:46.771 INFO:teuthology.orchestra.run.smithi134.stdout:(4/150): ceph-mds-19.0.0-5872.gef427541.el9.x86 1.9 MB/s | 2.4 MB 00:01 2024-08-20T01:18:47.111 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-08-20T01:18:47.268 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-08-20T01:18:47.355 INFO:teuthology.orchestra.run.smithi134.stdout:(5/150): ceph-mgr-19.0.0-5872.gef427541.el9.x86 2.6 MB/s | 1.5 MB 00:00 2024-08-20T01:18:47.663 INFO:teuthology.orchestra.run.smithi134.stdout:(6/150): ceph-base-19.0.0-5872.gef427541.el9.x8 1.7 MB/s | 5.5 MB 00:03 2024-08-20T01:18:48.605 INFO:teuthology.orchestra.run.smithi134.stdout:(7/150): ceph-mon-19.0.0-5872.gef427541.el9.x86 3.8 MB/s | 4.8 MB 00:01 2024-08-20T01:18:49.372 INFO:teuthology.orchestra.run.smithi022.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-20T01:18:49.373 INFO:teuthology.orchestra.run.smithi022.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-20T01:18:49.384 INFO:teuthology.orchestra.run.smithi022.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-20T01:18:49.385 INFO:teuthology.orchestra.run.smithi022.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-20T01:18:49.386 INFO:teuthology.orchestra.run.smithi022.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-20T01:18:49.387 INFO:teuthology.orchestra.run.smithi022.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-20T01:18:49.389 INFO:teuthology.orchestra.run.smithi022.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-20T01:18:49.391 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-20T01:18:49.392 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-20T01:18:49.411 INFO:teuthology.orchestra.run.smithi077.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-20T01:18:49.412 INFO:teuthology.orchestra.run.smithi077.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-20T01:18:49.423 INFO:teuthology.orchestra.run.smithi077.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-20T01:18:49.424 INFO:teuthology.orchestra.run.smithi077.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-20T01:18:49.425 INFO:teuthology.orchestra.run.smithi077.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-20T01:18:49.426 INFO:teuthology.orchestra.run.smithi077.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-20T01:18:49.427 INFO:teuthology.orchestra.run.smithi077.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-20T01:18:49.429 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-20T01:18:49.430 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-20T01:18:49.458 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-08-20T01:18:49.467 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2024-08-20T01:18:49.467 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-08-20T01:18:49.468 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2024-08-20T01:18:49.468 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-08-20T01:18:49.468 INFO:teuthology.orchestra.run.smithi022.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-20T01:18:49.468 INFO:teuthology.orchestra.run.smithi022.stdout: ceph x86_64 2:19.0.0-5872.gef427541.el9 ceph 6.6 k 2024-08-20T01:18:49.468 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base x86_64 2:19.0.0-5872.gef427541.el9 ceph 5.5 M 2024-08-20T01:18:49.468 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse x86_64 2:19.0.0-5872.gef427541.el9 ceph 901 k 2024-08-20T01:18:49.468 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5872.gef427541.el9 ceph 145 k 2024-08-20T01:18:49.468 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr x86_64 2:19.0.0-5872.gef427541.el9 ceph 1.5 M 2024-08-20T01:18:49.468 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 150 k 2024-08-20T01:18:49.468 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 14 M 2024-08-20T01:18:49.468 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 7.4 M 2024-08-20T01:18:49.468 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 49 k 2024-08-20T01:18:49.469 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw x86_64 2:19.0.0-5872.gef427541.el9 ceph 11 M 2024-08-20T01:18:49.469 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test x86_64 2:19.0.0-5872.gef427541.el9 ceph 50 M 2024-08-20T01:18:49.469 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 285 k 2024-08-20T01:18:49.469 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 772 k 2024-08-20T01:18:49.469 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror x86_64 2:19.0.0-5872.gef427541.el9 ceph 225 k 2024-08-20T01:18:49.469 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-shell x86_64 2:19.0.0-5872.gef427541.el9 ceph 27 k 2024-08-20T01:18:49.469 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 18 k 2024-08-20T01:18:49.469 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-20T01:18:49.469 INFO:teuthology.orchestra.run.smithi022.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-20T01:18:49.469 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-20T01:18:49.469 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel x86_64 2:19.0.0-5872.gef427541.el9 ceph 32 k 2024-08-20T01:18:49.469 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 755 k 2024-08-20T01:18:49.469 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel x86_64 2:19.0.0-5872.gef427541.el9 ceph 126 k 2024-08-20T01:18:49.470 INFO:teuthology.orchestra.run.smithi022.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-20T01:18:49.470 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-20T01:18:49.470 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-20T01:18:49.470 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-20T01:18:49.470 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-20T01:18:49.470 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-20T01:18:49.470 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs x86_64 2:19.0.0-5872.gef427541.el9 ceph 188 k 2024-08-20T01:18:49.470 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados x86_64 2:19.0.0-5872.gef427541.el9 ceph 371 k 2024-08-20T01:18:49.470 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd x86_64 2:19.0.0-5872.gef427541.el9 ceph 355 k 2024-08-20T01:18:49.470 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw x86_64 2:19.0.0-5872.gef427541.el9 ceph 116 k 2024-08-20T01:18:49.470 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse x86_64 2:19.0.0-5872.gef427541.el9 ceph 85 k 2024-08-20T01:18:49.470 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.2 M 2024-08-20T01:18:49.470 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd x86_64 2:19.0.0-5872.gef427541.el9 ceph 170 k 2024-08-20T01:18:49.471 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-20T01:18:49.471 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2024-08-20T01:18:49.471 INFO:teuthology.orchestra.run.smithi022.stdout: librados2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.5 M 2024-08-20T01:18:49.471 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1 x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.2 M 2024-08-20T01:18:49.471 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-08-20T01:18:49.471 INFO:teuthology.orchestra.run.smithi022.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-20T01:18:49.471 INFO:teuthology.orchestra.run.smithi022.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-20T01:18:49.471 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-20T01:18:49.471 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common x86_64 2:19.0.0-5872.gef427541.el9 ceph 22 M 2024-08-20T01:18:49.471 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 34 k 2024-08-20T01:18:49.471 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds x86_64 2:19.0.0-5872.gef427541.el9 ceph 2.4 M 2024-08-20T01:18:49.471 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 284 k 2024-08-20T01:18:49.472 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon x86_64 2:19.0.0-5872.gef427541.el9 ceph 4.8 M 2024-08-20T01:18:49.472 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd x86_64 2:19.0.0-5872.gef427541.el9 ceph 17 M 2024-08-20T01:18:49.472 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 16 k 2024-08-20T01:18:49.472 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux x86_64 2:19.0.0-5872.gef427541.el9 ceph 25 k 2024-08-20T01:18:49.472 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-20T01:18:49.472 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-20T01:18:49.472 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-20T01:18:49.472 INFO:teuthology.orchestra.run.smithi022.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-20T01:18:49.472 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-20T01:18:49.472 INFO:teuthology.orchestra.run.smithi022.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-20T01:18:49.472 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-20T01:18:49.472 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-20T01:18:49.472 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite x86_64 2:19.0.0-5872.gef427541.el9 ceph 163 k 2024-08-20T01:18:49.473 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-20T01:18:49.473 INFO:teuthology.orchestra.run.smithi022.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-20T01:18:49.473 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-20T01:18:49.473 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-20T01:18:49.473 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-20T01:18:49.473 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1 x86_64 2:19.0.0-5872.gef427541.el9 ceph 508 k 2024-08-20T01:18:49.473 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-20T01:18:49.473 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 5.5 M 2024-08-20T01:18:49.473 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-20T01:18:49.473 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-20T01:18:49.473 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-20T01:18:49.473 INFO:teuthology.orchestra.run.smithi022.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-20T01:18:49.473 INFO:teuthology.orchestra.run.smithi022.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-20T01:18:49.474 INFO:teuthology.orchestra.run.smithi022.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-20T01:18:49.474 INFO:teuthology.orchestra.run.smithi022.stdout: openblas x86_64 0.3.26-1.el9 appstream 38 k 2024-08-20T01:18:49.474 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp x86_64 0.3.26-1.el9 appstream 4.9 M 2024-08-20T01:18:49.474 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-20T01:18:49.474 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-20T01:18:49.474 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-20T01:18:49.474 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-20T01:18:49.474 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-20T01:18:49.474 INFO:teuthology.orchestra.run.smithi022.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-20T01:18:49.474 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-20T01:18:49.474 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-20T01:18:49.474 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-20T01:18:49.475 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse x86_64 2:19.0.0-5872.gef427541.el9 ceph 45 k 2024-08-20T01:18:49.475 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common x86_64 2:19.0.0-5872.gef427541.el9 ceph 138 k 2024-08-20T01:18:49.475 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-20T01:18:49.475 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-20T01:18:49.475 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-20T01:18:49.475 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-20T01:18:49.475 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-20T01:18:49.475 INFO:teuthology.orchestra.run.smithi022.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-20T01:18:49.475 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-20T01:18:49.475 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-20T01:18:49.475 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-20T01:18:49.475 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-20T01:18:49.475 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-20T01:18:49.476 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-20T01:18:49.476 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-20T01:18:49.476 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-20T01:18:49.476 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-20T01:18:49.476 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-20T01:18:49.476 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-20T01:18:49.476 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-20T01:18:49.476 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-20T01:18:49.476 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-20T01:18:49.476 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-20T01:18:49.476 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-20T01:18:49.476 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-20T01:18:49.476 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-20T01:18:49.477 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-20T01:18:49.477 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-20T01:18:49.477 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-20T01:18:49.477 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-20T01:18:49.477 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-20T01:18:49.477 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-20T01:18:49.477 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-20T01:18:49.477 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-20T01:18:49.477 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-20T01:18:49.477 INFO:teuthology.orchestra.run.smithi022.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-20T01:18:49.477 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-20T01:18:49.477 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-20T01:18:49.477 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-20T01:18:49.478 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-20T01:18:49.478 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-20T01:18:49.478 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-20T01:18:49.478 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-20T01:18:49.478 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-20T01:18:49.478 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-20T01:18:49.478 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-20T01:18:49.478 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-20T01:18:49.478 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-20T01:18:49.478 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-20T01:18:49.478 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-20T01:18:49.478 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-20T01:18:49.478 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-20T01:18:49.479 INFO:teuthology.orchestra.run.smithi022.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-20T01:18:49.479 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-20T01:18:49.479 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-20T01:18:49.479 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-20T01:18:49.479 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-20T01:18:49.479 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-20T01:18:49.479 INFO:teuthology.orchestra.run.smithi022.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-20T01:18:49.479 INFO:teuthology.orchestra.run.smithi022.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-20T01:18:49.479 INFO:teuthology.orchestra.run.smithi022.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-20T01:18:49.479 INFO:teuthology.orchestra.run.smithi022.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-20T01:18:49.479 INFO:teuthology.orchestra.run.smithi022.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-20T01:18:49.479 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-20T01:18:49.479 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-20T01:18:49.480 INFO:teuthology.orchestra.run.smithi022.stdout:Installing weak dependencies: 2024-08-20T01:18:49.480 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-20T01:18:49.480 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:18:49.480 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-08-20T01:18:49.480 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2024-08-20T01:18:49.480 INFO:teuthology.orchestra.run.smithi022.stdout:Install 148 Packages 2024-08-20T01:18:49.480 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 2 Packages 2024-08-20T01:18:49.480 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:18:49.481 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 232 M 2024-08-20T01:18:49.481 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-08-20T01:18:49.490 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-08-20T01:18:49.506 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-08-20T01:18:49.506 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-08-20T01:18:49.507 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-08-20T01:18:49.507 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-08-20T01:18:49.507 INFO:teuthology.orchestra.run.smithi077.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-20T01:18:49.507 INFO:teuthology.orchestra.run.smithi077.stdout: ceph x86_64 2:19.0.0-5872.gef427541.el9 ceph 6.6 k 2024-08-20T01:18:49.507 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base x86_64 2:19.0.0-5872.gef427541.el9 ceph 5.5 M 2024-08-20T01:18:49.507 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse x86_64 2:19.0.0-5872.gef427541.el9 ceph 901 k 2024-08-20T01:18:49.507 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5872.gef427541.el9 ceph 145 k 2024-08-20T01:18:49.507 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr x86_64 2:19.0.0-5872.gef427541.el9 ceph 1.5 M 2024-08-20T01:18:49.507 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 150 k 2024-08-20T01:18:49.507 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 14 M 2024-08-20T01:18:49.507 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 7.4 M 2024-08-20T01:18:49.508 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 49 k 2024-08-20T01:18:49.508 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw x86_64 2:19.0.0-5872.gef427541.el9 ceph 11 M 2024-08-20T01:18:49.508 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test x86_64 2:19.0.0-5872.gef427541.el9 ceph 50 M 2024-08-20T01:18:49.508 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 285 k 2024-08-20T01:18:49.508 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 772 k 2024-08-20T01:18:49.508 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror x86_64 2:19.0.0-5872.gef427541.el9 ceph 225 k 2024-08-20T01:18:49.508 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-shell x86_64 2:19.0.0-5872.gef427541.el9 ceph 27 k 2024-08-20T01:18:49.508 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 18 k 2024-08-20T01:18:49.508 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-20T01:18:49.508 INFO:teuthology.orchestra.run.smithi077.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-20T01:18:49.508 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-20T01:18:49.508 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel x86_64 2:19.0.0-5872.gef427541.el9 ceph 32 k 2024-08-20T01:18:49.509 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 755 k 2024-08-20T01:18:49.509 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel x86_64 2:19.0.0-5872.gef427541.el9 ceph 126 k 2024-08-20T01:18:49.509 INFO:teuthology.orchestra.run.smithi077.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-20T01:18:49.509 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-20T01:18:49.509 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-20T01:18:49.509 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-20T01:18:49.509 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-20T01:18:49.509 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-20T01:18:49.509 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs x86_64 2:19.0.0-5872.gef427541.el9 ceph 188 k 2024-08-20T01:18:49.509 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados x86_64 2:19.0.0-5872.gef427541.el9 ceph 371 k 2024-08-20T01:18:49.510 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd x86_64 2:19.0.0-5872.gef427541.el9 ceph 355 k 2024-08-20T01:18:49.510 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw x86_64 2:19.0.0-5872.gef427541.el9 ceph 116 k 2024-08-20T01:18:49.510 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse x86_64 2:19.0.0-5872.gef427541.el9 ceph 85 k 2024-08-20T01:18:49.510 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.2 M 2024-08-20T01:18:49.510 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd x86_64 2:19.0.0-5872.gef427541.el9 ceph 170 k 2024-08-20T01:18:49.510 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-20T01:18:49.510 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrading: 2024-08-20T01:18:49.510 INFO:teuthology.orchestra.run.smithi077.stdout: librados2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.5 M 2024-08-20T01:18:49.510 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1 x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.2 M 2024-08-20T01:18:49.510 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-08-20T01:18:49.510 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-20T01:18:49.510 INFO:teuthology.orchestra.run.smithi077.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-20T01:18:49.511 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-20T01:18:49.511 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common x86_64 2:19.0.0-5872.gef427541.el9 ceph 22 M 2024-08-20T01:18:49.511 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 34 k 2024-08-20T01:18:49.511 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds x86_64 2:19.0.0-5872.gef427541.el9 ceph 2.4 M 2024-08-20T01:18:49.511 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 284 k 2024-08-20T01:18:49.511 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon x86_64 2:19.0.0-5872.gef427541.el9 ceph 4.8 M 2024-08-20T01:18:49.512 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd x86_64 2:19.0.0-5872.gef427541.el9 ceph 17 M 2024-08-20T01:18:49.512 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 16 k 2024-08-20T01:18:49.512 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux x86_64 2:19.0.0-5872.gef427541.el9 ceph 25 k 2024-08-20T01:18:49.512 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-20T01:18:49.512 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-20T01:18:49.512 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-20T01:18:49.512 INFO:teuthology.orchestra.run.smithi077.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-20T01:18:49.512 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-20T01:18:49.512 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-20T01:18:49.512 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-20T01:18:49.512 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-20T01:18:49.513 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite x86_64 2:19.0.0-5872.gef427541.el9 ceph 163 k 2024-08-20T01:18:49.513 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-20T01:18:49.513 INFO:teuthology.orchestra.run.smithi077.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-20T01:18:49.513 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-20T01:18:49.513 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-20T01:18:49.513 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-20T01:18:49.513 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 x86_64 2:19.0.0-5872.gef427541.el9 ceph 508 k 2024-08-20T01:18:49.513 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-20T01:18:49.513 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 5.5 M 2024-08-20T01:18:49.513 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-20T01:18:49.513 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-20T01:18:49.513 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-20T01:18:49.514 INFO:teuthology.orchestra.run.smithi077.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-20T01:18:49.514 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-20T01:18:49.514 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-20T01:18:49.514 INFO:teuthology.orchestra.run.smithi077.stdout: openblas x86_64 0.3.26-1.el9 appstream 38 k 2024-08-20T01:18:49.514 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp x86_64 0.3.26-1.el9 appstream 4.9 M 2024-08-20T01:18:49.514 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-20T01:18:49.514 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-20T01:18:49.514 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-20T01:18:49.514 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-20T01:18:49.514 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-20T01:18:49.514 INFO:teuthology.orchestra.run.smithi077.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-20T01:18:49.515 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-20T01:18:49.515 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-20T01:18:49.515 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-20T01:18:49.515 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse x86_64 2:19.0.0-5872.gef427541.el9 ceph 45 k 2024-08-20T01:18:49.515 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common x86_64 2:19.0.0-5872.gef427541.el9 ceph 138 k 2024-08-20T01:18:49.515 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-20T01:18:49.515 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-20T01:18:49.515 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-20T01:18:49.515 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-20T01:18:49.515 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-20T01:18:49.515 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-20T01:18:49.516 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-20T01:18:49.516 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-20T01:18:49.516 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-20T01:18:49.516 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-20T01:18:49.516 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-20T01:18:49.516 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-20T01:18:49.516 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-20T01:18:49.516 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-20T01:18:49.516 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-20T01:18:49.516 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-20T01:18:49.516 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-20T01:18:49.516 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-20T01:18:49.517 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-20T01:18:49.517 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-20T01:18:49.517 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-20T01:18:49.517 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-20T01:18:49.517 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-20T01:18:49.517 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-20T01:18:49.517 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-20T01:18:49.517 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-20T01:18:49.517 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-20T01:18:49.517 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-20T01:18:49.517 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-20T01:18:49.517 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-20T01:18:49.518 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-20T01:18:49.518 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-20T01:18:49.518 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-20T01:18:49.518 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-20T01:18:49.518 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-20T01:18:49.518 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-20T01:18:49.518 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-20T01:18:49.518 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-20T01:18:49.518 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-20T01:18:49.518 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-20T01:18:49.519 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-20T01:18:49.519 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-20T01:18:49.519 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-20T01:18:49.519 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-20T01:18:49.519 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-20T01:18:49.519 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-20T01:18:49.519 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-20T01:18:49.519 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-20T01:18:49.519 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-20T01:18:49.519 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-20T01:18:49.519 INFO:teuthology.orchestra.run.smithi077.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-20T01:18:49.519 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-20T01:18:49.520 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-20T01:18:49.520 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-20T01:18:49.520 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-20T01:18:49.520 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-20T01:18:49.520 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-20T01:18:49.520 INFO:teuthology.orchestra.run.smithi077.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-20T01:18:49.520 INFO:teuthology.orchestra.run.smithi077.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-20T01:18:49.520 INFO:teuthology.orchestra.run.smithi077.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-20T01:18:49.520 INFO:teuthology.orchestra.run.smithi077.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-20T01:18:49.520 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-20T01:18:49.520 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-20T01:18:49.520 INFO:teuthology.orchestra.run.smithi077.stdout:Installing weak dependencies: 2024-08-20T01:18:49.521 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-20T01:18:49.521 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-08-20T01:18:49.521 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-08-20T01:18:49.521 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-08-20T01:18:49.521 INFO:teuthology.orchestra.run.smithi077.stdout:Install 148 Packages 2024-08-20T01:18:49.521 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrade 2 Packages 2024-08-20T01:18:49.521 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-08-20T01:18:49.522 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 232 M 2024-08-20T01:18:49.522 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-08-20T01:18:50.179 INFO:teuthology.orchestra.run.smithi022.stdout:(1/150): ceph-19.0.0-5872.gef427541.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-08-20T01:18:50.197 INFO:teuthology.orchestra.run.smithi134.stdout:(8/150): ceph-radosgw-19.0.0-5872.gef427541.el9 6.9 MB/s | 11 MB 00:01 2024-08-20T01:18:50.239 INFO:teuthology.orchestra.run.smithi134.stdout:(9/150): ceph-selinux-19.0.0-5872.gef427541.el9 610 kB/s | 25 kB 00:00 2024-08-20T01:18:50.320 INFO:teuthology.orchestra.run.smithi077.stdout:(1/150): ceph-19.0.0-5872.gef427541.el9.x86_64. 52 kB/s | 6.6 kB 00:00 2024-08-20T01:18:50.421 INFO:teuthology.orchestra.run.smithi022.stdout:(2/150): ceph-fuse-19.0.0-5872.gef427541.el9.x8 3.6 MB/s | 901 kB 00:00 2024-08-20T01:18:50.504 INFO:teuthology.orchestra.run.smithi022.stdout:(3/150): ceph-immutable-object-cache-19.0.0-587 1.7 MB/s | 145 kB 00:00 2024-08-20T01:18:50.588 INFO:teuthology.orchestra.run.smithi022.stdout:(4/150): ceph-base-19.0.0-5872.gef427541.el9.x8 10 MB/s | 5.5 MB 00:00 2024-08-20T01:18:50.738 INFO:teuthology.orchestra.run.smithi022.stdout:(5/150): ceph-mgr-19.0.0-5872.gef427541.el9.x86 10 MB/s | 1.5 MB 00:00 2024-08-20T01:18:50.787 INFO:teuthology.orchestra.run.smithi077.stdout:(2/150): ceph-fuse-19.0.0-5872.gef427541.el9.x8 1.9 MB/s | 901 kB 00:00 2024-08-20T01:18:50.913 INFO:teuthology.orchestra.run.smithi022.stdout:(6/150): ceph-mds-19.0.0-5872.gef427541.el9.x86 5.8 MB/s | 2.4 MB 00:00 2024-08-20T01:18:50.923 INFO:teuthology.orchestra.run.smithi134.stdout:(10/150): ceph-common-19.0.0-5872.gef427541.el9 3.3 MB/s | 22 MB 00:06 2024-08-20T01:18:50.937 INFO:teuthology.orchestra.run.smithi077.stdout:(3/150): ceph-immutable-object-cache-19.0.0-587 966 kB/s | 145 kB 00:00 2024-08-20T01:18:51.055 INFO:teuthology.orchestra.run.smithi022.stdout:(7/150): ceph-mon-19.0.0-5872.gef427541.el9.x86 15 MB/s | 4.8 MB 00:00 2024-08-20T01:18:51.231 INFO:teuthology.orchestra.run.smithi134.stdout:(11/150): ceph-osd-19.0.0-5872.gef427541.el9.x8 4.8 MB/s | 17 MB 00:03 2024-08-20T01:18:51.257 INFO:teuthology.orchestra.run.smithi134.stdout:(12/150): cephfs-mirror-19.0.0-5872.gef427541.e 674 kB/s | 225 kB 00:00 2024-08-20T01:18:51.307 INFO:teuthology.orchestra.run.smithi134.stdout:(13/150): cephfs-shell-19.0.0-5872.gef427541.el 361 kB/s | 27 kB 00:00 2024-08-20T01:18:51.332 INFO:teuthology.orchestra.run.smithi134.stdout:(14/150): libcephfs-devel-19.0.0-5872.gef427541 422 kB/s | 32 kB 00:00 2024-08-20T01:18:51.381 INFO:teuthology.orchestra.run.smithi022.stdout:(8/150): ceph-common-19.0.0-5872.gef427541.el9. 16 MB/s | 22 MB 00:01 2024-08-20T01:18:51.382 INFO:teuthology.orchestra.run.smithi134.stdout:(15/150): libcephsqlite-19.0.0-5872.gef427541.e 3.2 MB/s | 163 kB 00:00 2024-08-20T01:18:51.422 INFO:teuthology.orchestra.run.smithi022.stdout:(9/150): ceph-selinux-19.0.0-5872.gef427541.el9 609 kB/s | 25 kB 00:00 2024-08-20T01:18:51.441 INFO:teuthology.orchestra.run.smithi134.stdout:(16/150): libcephfs2-19.0.0-5872.gef427541.el9. 5.5 MB/s | 755 kB 00:00 2024-08-20T01:18:51.466 INFO:teuthology.orchestra.run.smithi134.stdout:(17/150): librados-devel-19.0.0-5872.gef427541. 1.5 MB/s | 126 kB 00:00 2024-08-20T01:18:51.604 INFO:teuthology.orchestra.run.smithi077.stdout:(4/150): ceph-base-19.0.0-5872.gef427541.el9.x8 3.9 MB/s | 5.5 MB 00:01 2024-08-20T01:18:51.725 INFO:teuthology.orchestra.run.smithi134.stdout:(18/150): libradosstriper1-19.0.0-5872.gef42754 1.8 MB/s | 508 kB 00:00 2024-08-20T01:18:51.754 INFO:teuthology.orchestra.run.smithi077.stdout:(5/150): ceph-mds-19.0.0-5872.gef427541.el9.x86 2.9 MB/s | 2.4 MB 00:00 2024-08-20T01:18:51.772 INFO:teuthology.orchestra.run.smithi022.stdout:(10/150): ceph-radosgw-19.0.0-5872.gef427541.el 15 MB/s | 11 MB 00:00 2024-08-20T01:18:51.775 INFO:teuthology.orchestra.run.smithi134.stdout:(19/150): python3-ceph-argparse-19.0.0-5872.gef 906 kB/s | 45 kB 00:00 2024-08-20T01:18:51.813 INFO:teuthology.orchestra.run.smithi077.stdout:(6/150): ceph-mgr-19.0.0-5872.gef427541.el9.x86 7.3 MB/s | 1.5 MB 00:00 2024-08-20T01:18:51.873 INFO:teuthology.orchestra.run.smithi022.stdout:(11/150): cephfs-mirror-19.0.0-5872.gef427541.e 2.2 MB/s | 225 kB 00:00 2024-08-20T01:18:51.875 INFO:teuthology.orchestra.run.smithi134.stdout:(20/150): python3-ceph-common-19.0.0-5872.gef42 1.4 MB/s | 138 kB 00:00 2024-08-20T01:18:51.940 INFO:teuthology.orchestra.run.smithi022.stdout:(12/150): cephfs-shell-19.0.0-5872.gef427541.el 406 kB/s | 27 kB 00:00 2024-08-20T01:18:51.992 INFO:teuthology.orchestra.run.smithi134.stdout:(21/150): python3-cephfs-19.0.0-5872.gef427541. 1.6 MB/s | 188 kB 00:00 2024-08-20T01:18:52.023 INFO:teuthology.orchestra.run.smithi022.stdout:(13/150): libcephfs-devel-19.0.0-5872.gef427541 381 kB/s | 32 kB 00:00 2024-08-20T01:18:52.182 INFO:teuthology.orchestra.run.smithi022.stdout:(14/150): libcephfs2-19.0.0-5872.gef427541.el9. 4.7 MB/s | 755 kB 00:00 2024-08-20T01:18:52.184 INFO:teuthology.orchestra.run.smithi134.stdout:(22/150): python3-rados-19.0.0-5872.gef427541.e 1.9 MB/s | 371 kB 00:00 2024-08-20T01:18:52.257 INFO:teuthology.orchestra.run.smithi022.stdout:(15/150): libcephsqlite-19.0.0-5872.gef427541.e 2.1 MB/s | 163 kB 00:00 2024-08-20T01:18:52.350 INFO:teuthology.orchestra.run.smithi022.stdout:(16/150): librados-devel-19.0.0-5872.gef427541. 1.3 MB/s | 126 kB 00:00 2024-08-20T01:18:52.384 INFO:teuthology.orchestra.run.smithi134.stdout:(23/150): python3-rbd-19.0.0-5872.gef427541.el9 1.7 MB/s | 355 kB 00:00 2024-08-20T01:18:52.476 INFO:teuthology.orchestra.run.smithi134.stdout:(24/150): python3-rgw-19.0.0-5872.gef427541.el9 1.2 MB/s | 116 kB 00:00 2024-08-20T01:18:52.516 INFO:teuthology.orchestra.run.smithi022.stdout:(17/150): libradosstriper1-19.0.0-5872.gef42754 3.0 MB/s | 508 kB 00:00 2024-08-20T01:18:52.560 INFO:teuthology.orchestra.run.smithi134.stdout:(25/150): rbd-fuse-19.0.0-5872.gef427541.el9.x8 1.0 MB/s | 85 kB 00:00 2024-08-20T01:18:53.318 INFO:teuthology.orchestra.run.smithi134.stdout:(26/150): librgw2-19.0.0-5872.gef427541.el9.x86 3.0 MB/s | 5.5 MB 00:01 2024-08-20T01:18:53.367 INFO:teuthology.orchestra.run.smithi022.stdout:(18/150): librgw2-19.0.0-5872.gef427541.el9.x86 6.5 MB/s | 5.5 MB 00:00 2024-08-20T01:18:53.368 INFO:teuthology.orchestra.run.smithi134.stdout:(27/150): rbd-nbd-19.0.0-5872.gef427541.el9.x86 3.3 MB/s | 170 kB 00:00 2024-08-20T01:18:53.379 INFO:teuthology.orchestra.run.smithi077.stdout:(7/150): ceph-osd-19.0.0-5872.gef427541.el9.x86 11 MB/s | 17 MB 00:01 2024-08-20T01:18:53.417 INFO:teuthology.orchestra.run.smithi022.stdout:(19/150): python3-ceph-argparse-19.0.0-5872.gef 907 kB/s | 45 kB 00:00 2024-08-20T01:18:53.427 INFO:teuthology.orchestra.run.smithi134.stdout:(28/150): ceph-grafana-dashboards-19.0.0-5872.g 587 kB/s | 34 kB 00:00 2024-08-20T01:18:53.492 INFO:teuthology.orchestra.run.smithi022.stdout:(20/150): python3-ceph-common-19.0.0-5872.gef42 1.8 MB/s | 138 kB 00:00 2024-08-20T01:18:53.511 INFO:teuthology.orchestra.run.smithi134.stdout:(29/150): ceph-mgr-cephadm-19.0.0-5872.gef42754 1.8 MB/s | 150 kB 00:00 2024-08-20T01:18:53.576 INFO:teuthology.orchestra.run.smithi022.stdout:(21/150): python3-cephfs-19.0.0-5872.gef427541. 2.2 MB/s | 188 kB 00:00 2024-08-20T01:18:53.671 INFO:teuthology.orchestra.run.smithi077.stdout:(8/150): ceph-mon-19.0.0-5872.gef427541.el9.x86 2.5 MB/s | 4.8 MB 00:01 2024-08-20T01:18:53.730 INFO:teuthology.orchestra.run.smithi077.stdout:(9/150): ceph-selinux-19.0.0-5872.gef427541.el9 432 kB/s | 25 kB 00:00 2024-08-20T01:18:53.759 INFO:teuthology.orchestra.run.smithi022.stdout:(22/150): ceph-osd-19.0.0-5872.gef427541.el9.x8 6.0 MB/s | 17 MB 00:02 2024-08-20T01:18:53.784 INFO:teuthology.orchestra.run.smithi022.stdout:(23/150): python3-rados-19.0.0-5872.gef427541.e 1.7 MB/s | 371 kB 00:00 2024-08-20T01:18:53.786 INFO:teuthology.orchestra.run.smithi134.stdout:(30/150): rbd-mirror-19.0.0-5872.gef427541.el9. 2.6 MB/s | 3.2 MB 00:01 2024-08-20T01:18:53.843 INFO:teuthology.orchestra.run.smithi022.stdout:(24/150): python3-rbd-19.0.0-5872.gef427541.el9 4.2 MB/s | 355 kB 00:00 2024-08-20T01:18:53.868 INFO:teuthology.orchestra.run.smithi022.stdout:(25/150): python3-rgw-19.0.0-5872.gef427541.el9 1.4 MB/s | 116 kB 00:00 2024-08-20T01:18:53.919 INFO:teuthology.orchestra.run.smithi022.stdout:(26/150): rbd-fuse-19.0.0-5872.gef427541.el9.x8 1.1 MB/s | 85 kB 00:00 2024-08-20T01:18:54.011 INFO:teuthology.orchestra.run.smithi022.stdout:(27/150): rbd-nbd-19.0.0-5872.gef427541.el9.x86 1.8 MB/s | 170 kB 00:00 2024-08-20T01:18:54.094 INFO:teuthology.orchestra.run.smithi022.stdout:(28/150): ceph-grafana-dashboards-19.0.0-5872.g 412 kB/s | 34 kB 00:00 2024-08-20T01:18:54.178 INFO:teuthology.orchestra.run.smithi022.stdout:(29/150): ceph-mgr-cephadm-19.0.0-5872.gef42754 1.8 MB/s | 150 kB 00:00 2024-08-20T01:18:54.230 INFO:teuthology.orchestra.run.smithi077.stdout:(10/150): ceph-common-19.0.0-5872.gef427541.el9 5.4 MB/s | 22 MB 00:04 2024-08-20T01:18:54.347 INFO:teuthology.orchestra.run.smithi077.stdout:(11/150): ceph-radosgw-19.0.0-5872.gef427541.el 11 MB/s | 11 MB 00:00 2024-08-20T01:18:54.372 INFO:teuthology.orchestra.run.smithi077.stdout:(12/150): cephfs-mirror-19.0.0-5872.gef427541.e 1.5 MB/s | 225 kB 00:00 2024-08-20T01:18:54.389 INFO:teuthology.orchestra.run.smithi077.stdout:(13/150): cephfs-shell-19.0.0-5872.gef427541.el 648 kB/s | 27 kB 00:00 2024-08-20T01:18:54.415 INFO:teuthology.orchestra.run.smithi077.stdout:(14/150): libcephfs-devel-19.0.0-5872.gef427541 757 kB/s | 32 kB 00:00 2024-08-20T01:18:54.448 INFO:teuthology.orchestra.run.smithi077.stdout:(15/150): libcephfs2-19.0.0-5872.gef427541.el9. 13 MB/s | 755 kB 00:00 2024-08-20T01:18:54.473 INFO:teuthology.orchestra.run.smithi077.stdout:(16/150): libcephsqlite-19.0.0-5872.gef427541.e 2.7 MB/s | 163 kB 00:00 2024-08-20T01:18:54.490 INFO:teuthology.orchestra.run.smithi077.stdout:(17/150): librados-devel-19.0.0-5872.gef427541. 3.0 MB/s | 126 kB 00:00 2024-08-20T01:18:54.549 INFO:teuthology.orchestra.run.smithi077.stdout:(18/150): libradosstriper1-19.0.0-5872.gef42754 6.6 MB/s | 508 kB 00:00 2024-08-20T01:18:54.608 INFO:teuthology.orchestra.run.smithi077.stdout:(19/150): python3-ceph-argparse-19.0.0-5872.gef 775 kB/s | 45 kB 00:00 2024-08-20T01:18:54.667 INFO:teuthology.orchestra.run.smithi077.stdout:(20/150): python3-ceph-common-19.0.0-5872.gef42 2.3 MB/s | 138 kB 00:00 2024-08-20T01:18:54.670 INFO:teuthology.orchestra.run.smithi022.stdout:(30/150): ceph-test-19.0.0-5872.gef427541.el9.x 15 MB/s | 50 MB 00:03 2024-08-20T01:18:54.729 INFO:teuthology.orchestra.run.smithi022.stdout:(31/150): rbd-mirror-19.0.0-5872.gef427541.el9. 3.7 MB/s | 3.2 MB 00:00 2024-08-20T01:18:54.733 INFO:teuthology.orchestra.run.smithi077.stdout:(21/150): python3-cephfs-19.0.0-5872.gef427541. 2.8 MB/s | 188 kB 00:00 2024-08-20T01:18:54.821 INFO:teuthology.orchestra.run.smithi077.stdout:(22/150): librgw2-19.0.0-5872.gef427541.el9.x86 17 MB/s | 5.5 MB 00:00 2024-08-20T01:18:54.838 INFO:teuthology.orchestra.run.smithi022.stdout:(32/150): ceph-mgr-modules-core-19.0.0-5872.gef 2.8 MB/s | 284 kB 00:00 2024-08-20T01:18:54.843 INFO:teuthology.orchestra.run.smithi077.stdout:(23/150): python3-rados-19.0.0-5872.gef427541.e 3.3 MB/s | 371 kB 00:00 2024-08-20T01:18:54.893 INFO:teuthology.orchestra.run.smithi077.stdout:(24/150): python3-rbd-19.0.0-5872.gef427541.el9 4.6 MB/s | 355 kB 00:00 2024-08-20T01:18:54.896 INFO:teuthology.orchestra.run.smithi022.stdout:(33/150): ceph-mgr-rook-19.0.0-5872.gef427541.e 742 kB/s | 49 kB 00:00 2024-08-20T01:18:54.919 INFO:teuthology.orchestra.run.smithi077.stdout:(25/150): python3-rgw-19.0.0-5872.gef427541.el9 1.5 MB/s | 116 kB 00:00 2024-08-20T01:18:54.952 INFO:teuthology.orchestra.run.smithi077.stdout:(26/150): rbd-fuse-19.0.0-5872.gef427541.el9.x8 1.4 MB/s | 85 kB 00:00 2024-08-20T01:18:54.955 INFO:teuthology.orchestra.run.smithi022.stdout:(34/150): ceph-prometheus-alerts-19.0.0-5872.ge 282 kB/s | 16 kB 00:00 2024-08-20T01:18:55.011 INFO:teuthology.orchestra.run.smithi077.stdout:(27/150): rbd-nbd-19.0.0-5872.gef427541.el9.x86 2.8 MB/s | 170 kB 00:00 2024-08-20T01:18:55.038 INFO:teuthology.orchestra.run.smithi022.stdout:(35/150): ceph-volume-19.0.0-5872.gef427541.el9 3.3 MB/s | 285 kB 00:00 2024-08-20T01:18:55.086 INFO:teuthology.orchestra.run.smithi077.stdout:(28/150): ceph-grafana-dashboards-19.0.0-5872.g 458 kB/s | 34 kB 00:00 2024-08-20T01:18:55.153 INFO:teuthology.orchestra.run.smithi077.stdout:(29/150): ceph-mgr-cephadm-19.0.0-5872.gef42754 2.2 MB/s | 150 kB 00:00 2024-08-20T01:18:55.188 INFO:teuthology.orchestra.run.smithi022.stdout:(36/150): ceph-mgr-diskprediction-local-19.0.0- 14 MB/s | 7.4 MB 00:00 2024-08-20T01:18:55.230 INFO:teuthology.orchestra.run.smithi022.stdout:(37/150): cephadm-19.0.0-5872.gef427541.el9.noa 3.9 MB/s | 772 kB 00:00 2024-08-20T01:18:55.247 INFO:teuthology.orchestra.run.smithi022.stdout:(38/150): cephfs-top-19.0.0-5872.gef427541.el9. 313 kB/s | 18 kB 00:00 2024-08-20T01:18:55.261 INFO:teuthology.orchestra.run.smithi077.stdout:(30/150): rbd-mirror-19.0.0-5872.gef427541.el9. 9.2 MB/s | 3.2 MB 00:00 2024-08-20T01:18:55.305 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:18:55.345 INFO:teuthology.orchestra.run.smithi134.stdout:(31/150): ceph-mgr-diskprediction-local-19.0.0- 4.7 MB/s | 7.4 MB 00:01 2024-08-20T01:18:55.397 INFO:teuthology.orchestra.run.smithi022.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-08-20T01:18:55.427 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:18:55.431 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:18:55.466 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:18:55.470 INFO:teuthology.orchestra.run.smithi134.stdout:(32/150): ceph-mgr-modules-core-19.0.0-5872.gef 2.2 MB/s | 284 kB 00:00 2024-08-20T01:18:55.498 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:18:55.537 INFO:teuthology.orchestra.run.smithi134.stdout:(33/150): ceph-mgr-rook-19.0.0-5872.gef427541.e 741 kB/s | 49 kB 00:00 2024-08-20T01:18:55.552 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:18:55.569 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:18:55.571 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:18:55.585 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:18:55.600 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:18:55.603 INFO:teuthology.orchestra.run.smithi134.stdout:(34/150): ceph-prometheus-alerts-19.0.0-5872.ge 246 kB/s | 16 kB 00:00 2024-08-20T01:18:55.627 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:18:55.665 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:18:55.721 INFO:teuthology.orchestra.run.smithi134.stdout:(35/150): ceph-volume-19.0.0-5872.gef427541.el9 2.4 MB/s | 285 kB 00:00 2024-08-20T01:18:55.731 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:18:55.758 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:18:55.784 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-20T01:18:55.810 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-20T01:18:55.869 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-20T01:18:55.963 INFO:teuthology.orchestra.run.smithi134.stdout:(36/150): cephadm-19.0.0-5872.gef427541.el9.noa 3.1 MB/s | 772 kB 00:00 2024-08-20T01:18:56.020 INFO:teuthology.orchestra.run.smithi077.stdout:(31/150): ceph-mgr-dashboard-19.0.0-5872.gef427 16 MB/s | 14 MB 00:00 2024-08-20T01:18:56.031 INFO:teuthology.orchestra.run.smithi022.stdout:(40/150): ceph-mgr-dashboard-19.0.0-5872.gef427 7.6 MB/s | 14 MB 00:01 2024-08-20T01:18:56.033 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-20T01:18:56.053 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:18:56.085 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:18:56.096 INFO:teuthology.orchestra.run.smithi134.stdout:(37/150): ceph-mgr-dashboard-19.0.0-5872.gef427 5.5 MB/s | 14 MB 00:02 2024-08-20T01:18:56.104 INFO:teuthology.orchestra.run.smithi077.stdout:(32/150): ceph-mgr-diskprediction-local-19.0.0- 8.8 MB/s | 7.4 MB 00:00 2024-08-20T01:18:56.121 INFO:teuthology.orchestra.run.smithi134.stdout:(38/150): cephfs-top-19.0.0-5872.gef427541.el9. 115 kB/s | 18 kB 00:00 2024-08-20T01:18:56.129 INFO:teuthology.orchestra.run.smithi077.stdout:(33/150): ceph-mgr-modules-core-19.0.0-5872.gef 2.6 MB/s | 284 kB 00:00 2024-08-20T01:18:56.136 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:18:56.154 INFO:teuthology.orchestra.run.smithi077.stdout:(34/150): ceph-mgr-rook-19.0.0-5872.gef427541.e 986 kB/s | 49 kB 00:00 2024-08-20T01:18:56.159 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:18:56.162 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-20T01:18:56.179 INFO:teuthology.orchestra.run.smithi077.stdout:(35/150): ceph-prometheus-alerts-19.0.0-5872.ge 328 kB/s | 16 kB 00:00 2024-08-20T01:18:56.181 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-20T01:18:56.181 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:18:56.205 INFO:teuthology.orchestra.run.smithi077.stdout:(36/150): ceph-volume-19.0.0-5872.gef427541.el9 5.5 MB/s | 285 kB 00:00 2024-08-20T01:18:56.231 INFO:teuthology.orchestra.run.smithi022.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-08-20T01:18:56.234 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-20T01:18:56.238 INFO:teuthology.orchestra.run.smithi077.stdout:(37/150): cephadm-19.0.0-5872.gef427541.el9.noa 13 MB/s | 772 kB 00:00 2024-08-20T01:18:56.262 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-20T01:18:56.263 INFO:teuthology.orchestra.run.smithi077.stdout:(38/150): cephfs-top-19.0.0-5872.gef427541.el9. 312 kB/s | 18 kB 00:00 2024-08-20T01:18:56.264 INFO:teuthology.orchestra.run.smithi134.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-08-20T01:18:56.294 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:18:56.295 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:18:56.325 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:18:56.337 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:18:56.367 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:18:56.417 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:18:56.441 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:18:56.449 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:18:56.474 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:18:56.528 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:18:56.544 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:18:56.584 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:18:56.600 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:18:56.676 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:18:56.691 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:18:56.736 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:18:56.750 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:18:56.798 INFO:teuthology.orchestra.run.smithi022.stdout:(42/150): python3-cryptography-36.0.1-4.el9.x86 2.2 MB/s | 1.2 MB 00:00 2024-08-20T01:18:56.861 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:18:56.882 INFO:teuthology.orchestra.run.smithi022.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-08-20T01:18:56.883 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:18:56.989 INFO:teuthology.orchestra.run.smithi077.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 106 kB/s | 80 kB 00:00 2024-08-20T01:18:56.990 INFO:teuthology.orchestra.run.smithi022.stdout:(44/150): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-08-20T01:18:57.024 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:18:57.043 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:18:57.073 INFO:teuthology.orchestra.run.smithi022.stdout:(45/150): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-08-20T01:18:57.124 INFO:teuthology.orchestra.run.smithi022.stdout:(46/150): libquadmath-11.5.0-2.el9.x86_64.rpm 111 kB/s | 191 kB 00:01 2024-08-20T01:18:57.216 INFO:teuthology.orchestra.run.smithi022.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 1.5 MB/s | 215 kB 00:00 2024-08-20T01:18:57.250 INFO:teuthology.orchestra.run.smithi022.stdout:(48/150): libgfortran-11.5.0-2.el9.x86_64.rpm 400 kB/s | 801 kB 00:02 2024-08-20T01:18:57.333 INFO:teuthology.orchestra.run.smithi022.stdout:(49/150): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-08-20T01:18:57.353 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:18:57.372 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:18:57.375 INFO:teuthology.orchestra.run.smithi022.stdout:(50/150): elfutils-libelf-devel-0.191-4.el9.x86 522 kB/s | 22 kB 00:00 2024-08-20T01:18:57.400 INFO:teuthology.orchestra.run.smithi022.stdout:(51/150): boost-program-options-1.75.0-8.el9.x8 711 kB/s | 107 kB 00:00 2024-08-20T01:18:57.425 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:18:57.436 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:18:57.476 INFO:teuthology.orchestra.run.smithi022.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 313 kB 00:00 2024-08-20T01:18:57.501 INFO:teuthology.orchestra.run.smithi022.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 327 kB/s | 33 kB 00:00 2024-08-20T01:18:57.520 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:18:57.534 INFO:teuthology.orchestra.run.smithi022.stdout:(54/150): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 943 kB 00:00 2024-08-20T01:18:57.540 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:18:57.560 INFO:teuthology.orchestra.run.smithi022.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-08-20T01:18:57.585 INFO:teuthology.orchestra.run.smithi022.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-08-20T01:18:57.602 INFO:teuthology.orchestra.run.smithi022.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-08-20T01:18:57.656 INFO:teuthology.orchestra.run.smithi077.stdout:(40/150): libgfortran-11.5.0-2.el9.x86_64.rpm 576 kB/s | 801 kB 00:01 2024-08-20T01:18:57.661 INFO:teuthology.orchestra.run.smithi022.stdout:(58/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-08-20T01:18:57.686 INFO:teuthology.orchestra.run.smithi022.stdout:(59/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 452 kB/s | 45 kB 00:00 2024-08-20T01:18:57.706 INFO:teuthology.orchestra.run.smithi077.stdout:(41/150): libquadmath-11.5.0-2.el9.x86_64.rpm 267 kB/s | 191 kB 00:00 2024-08-20T01:18:57.720 INFO:teuthology.orchestra.run.smithi022.stdout:(60/150): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-08-20T01:18:57.745 INFO:teuthology.orchestra.run.smithi022.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 436 kB/s | 25 kB 00:00 2024-08-20T01:18:57.770 INFO:teuthology.orchestra.run.smithi022.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 950 kB/s | 47 kB 00:00 2024-08-20T01:18:57.795 INFO:teuthology.orchestra.run.smithi022.stdout:(63/150): libtool-2.4.6-46.el9.x86_64.rpm 5.2 MB/s | 581 kB 00:00 2024-08-20T01:18:57.821 INFO:teuthology.orchestra.run.smithi022.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-08-20T01:18:57.821 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:18:57.854 INFO:teuthology.orchestra.run.smithi022.stdout:(65/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-08-20T01:18:57.855 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:18:57.855 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:18:57.876 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:18:57.971 INFO:teuthology.orchestra.run.smithi022.stdout:(66/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-08-20T01:18:57.992 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:18:58.014 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:18:58.051 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:18:58.051 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:18:58.081 INFO:teuthology.orchestra.run.smithi134.stdout:(40/150): ceph-test-19.0.0-5872.gef427541.el9.x 6.4 MB/s | 50 MB 00:07 2024-08-20T01:18:58.176 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:18:58.348 INFO:teuthology.orchestra.run.smithi134.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 954 kB/s | 253 kB 00:00 2024-08-20T01:18:58.381 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:18:58.391 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:18:58.442 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:18:58.447 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:18:58.481 INFO:teuthology.orchestra.run.smithi134.stdout:(42/150): python3-cryptography-36.0.1-4.el9.x86 9.2 MB/s | 1.2 MB 00:00 2024-08-20T01:18:58.503 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:18:58.531 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:18:58.535 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:18:58.539 INFO:teuthology.orchestra.run.smithi134.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-08-20T01:18:58.542 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:18:58.560 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:18:58.573 INFO:teuthology.orchestra.run.smithi077.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 276 kB/s | 253 kB 00:00 2024-08-20T01:18:58.595 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:18:58.598 INFO:teuthology.orchestra.run.smithi134.stdout:(44/150): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-08-20T01:18:58.602 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:18:58.620 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:18:58.657 INFO:teuthology.orchestra.run.smithi134.stdout:(45/150): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-08-20T01:18:58.700 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:18:58.708 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:18:58.715 INFO:teuthology.orchestra.run.smithi134.stdout:(46/150): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-08-20T01:18:58.722 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:18:58.735 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:18:58.742 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:18:58.749 INFO:teuthology.orchestra.run.smithi134.stdout:(47/150): libquadmath-11.5.0-2.el9.x86_64.rpm 77 kB/s | 191 kB 00:02 2024-08-20T01:18:58.758 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:18:58.795 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:18:58.800 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:18:58.816 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:18:58.874 INFO:teuthology.orchestra.run.smithi134.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 4.2 MB/s | 689 kB 00:00 2024-08-20T01:18:58.908 INFO:teuthology.orchestra.run.smithi134.stdout:(49/150): libgfortran-11.5.0-2.el9.x86_64.rpm 288 kB/s | 801 kB 00:02 2024-08-20T01:18:58.921 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:18:58.930 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:18:58.933 INFO:teuthology.orchestra.run.smithi134.stdout:(50/150): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-08-20T01:18:58.943 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:18:58.966 INFO:teuthology.orchestra.run.smithi134.stdout:(51/150): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-08-20T01:18:58.983 INFO:teuthology.orchestra.run.smithi134.stdout:(52/150): elfutils-libelf-devel-0.191-4.el9.x86 288 kB/s | 22 kB 00:00 2024-08-20T01:18:59.031 INFO:teuthology.orchestra.run.smithi134.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 513 kB/s | 33 kB 00:00 2024-08-20T01:18:59.031 INFO:teuthology.orchestra.run.smithi077.stdout:(43/150): python3-cryptography-36.0.1-4.el9.x86 947 kB/s | 1.2 MB 00:01 2024-08-20T01:18:59.059 INFO:teuthology.orchestra.run.smithi134.stdout:(54/150): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-08-20T01:18:59.076 INFO:teuthology.orchestra.run.smithi134.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 405 kB/s | 18 kB 00:00 2024-08-20T01:18:59.101 INFO:teuthology.orchestra.run.smithi134.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-08-20T01:18:59.127 INFO:teuthology.orchestra.run.smithi134.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-08-20T01:18:59.143 INFO:teuthology.orchestra.run.smithi134.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-08-20T01:18:59.177 INFO:teuthology.orchestra.run.smithi134.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-08-20T01:18:59.219 INFO:teuthology.orchestra.run.smithi134.stdout:(60/150): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-08-20T01:18:59.244 INFO:teuthology.orchestra.run.smithi134.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 379 kB/s | 25 kB 00:00 2024-08-20T01:18:59.265 INFO:teuthology.orchestra.run.smithi077.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 154 kB/s | 106 kB 00:00 2024-08-20T01:18:59.276 INFO:teuthology.orchestra.run.smithi134.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 830 kB/s | 47 kB 00:00 2024-08-20T01:18:59.301 INFO:teuthology.orchestra.run.smithi134.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.0 MB/s | 292 kB 00:00 2024-08-20T01:18:59.327 INFO:teuthology.orchestra.run.smithi134.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-08-20T01:18:59.327 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:18:59.386 INFO:teuthology.orchestra.run.smithi134.stdout:(65/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.4 MB/s | 3.0 MB 00:00 2024-08-20T01:18:59.394 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:18:59.488 INFO:teuthology.orchestra.run.smithi022.stdout:(67/150): openblas-0.3.26-1.el9.x86_64.rpm 23 kB/s | 38 kB 00:01 2024-08-20T01:18:59.519 INFO:teuthology.orchestra.run.smithi134.stdout:(66/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-08-20T01:18:59.520 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:18:59.532 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:18:59.536 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:18:59.536 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:18:59.552 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:18:59.607 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:18:59.679 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:18:59.698 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:18:59.714 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:18:59.782 INFO:teuthology.orchestra.run.smithi077.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 180 kB/s | 135 kB 00:00 2024-08-20T01:18:59.936 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:19:00.010 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:19:00.026 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:19:00.044 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:19:00.077 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:19:00.096 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:19:00.099 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:19:00.117 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:19:00.163 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:19:00.173 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:19:00.185 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:19:00.189 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:19:00.221 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:19:00.231 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:19:00.232 INFO:teuthology.orchestra.run.smithi077.stdout:(46/150): ceph-test-19.0.0-5872.gef427541.el9.x 7.7 MB/s | 50 MB 00:06 2024-08-20T01:19:00.245 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:19:00.246 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:19:00.258 INFO:teuthology.orchestra.run.smithi077.stdout:(47/150): python3-requests-2.25.1-8.el9.noarch. 127 kB/s | 125 kB 00:00 2024-08-20T01:19:00.305 INFO:teuthology.orchestra.run.smithi022.stdout:(68/150): postgresql-13.16-1.el9.x86_64.rpm 696 kB/s | 1.6 MB 00:02 2024-08-20T01:19:00.335 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-private-libs-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-private-libs-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:19:00.347 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:19:00.357 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:19:00.369 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:19:00.377 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:00.402 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:19:00.413 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:19:00.426 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:19:00.439 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:00.439 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-private-libs-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-private-libs-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:00.474 INFO:teuthology.orchestra.run.smithi077.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2024-08-20T01:19:00.498 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:19:00.499 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:19:00.500 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-private-libs-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-private-libs-13.16-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:19:00.505 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:19:00.518 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:19:00.525 INFO:teuthology.orchestra.run.smithi077.stdout:(49/150): bison-3.7.4-5.el9.x86_64.rpm 3.5 MB/s | 943 kB 00:00 2024-08-20T01:19:00.537 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:19:00.537 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-private-libs-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-private-libs-13.16-1.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:19:00.550 INFO:teuthology.orchestra.run.smithi077.stdout:(50/150): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-08-20T01:19:00.558 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:00.566 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:00.575 INFO:teuthology.orchestra.run.smithi077.stdout:(51/150): elfutils-libelf-devel-0.191-4.el9.x86 430 kB/s | 22 kB 00:00 2024-08-20T01:19:00.579 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:00.609 INFO:teuthology.orchestra.run.smithi077.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-08-20T01:19:00.635 INFO:teuthology.orchestra.run.smithi077.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 557 kB/s | 33 kB 00:00 2024-08-20T01:19:00.661 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:00.668 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:00.681 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:00.685 INFO:teuthology.orchestra.run.smithi077.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-08-20T01:19:00.704 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:19:00.712 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:19:00.724 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:19:00.743 INFO:teuthology.orchestra.run.smithi077.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-08-20T01:19:00.779 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:19:00.784 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:19:00.796 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:19:00.802 INFO:teuthology.orchestra.run.smithi077.stdout:(56/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-08-20T01:19:00.808 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-20T01:19:00.817 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-20T01:19:00.827 INFO:teuthology.orchestra.run.smithi077.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-08-20T01:19:00.853 INFO:teuthology.orchestra.run.smithi077.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-08-20T01:19:00.879 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-20T01:19:00.894 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-20T01:19:00.895 INFO:teuthology.orchestra.run.smithi077.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-08-20T01:19:00.916 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-20T01:19:00.928 INFO:teuthology.orchestra.run.smithi077.stdout:(60/150): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-08-20T01:19:00.950 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-20T01:19:00.953 INFO:teuthology.orchestra.run.smithi077.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 435 kB/s | 25 kB 00:00 2024-08-20T01:19:00.980 INFO:teuthology.orchestra.run.smithi022.stdout:(69/150): openblas-openmp-0.3.26-1.el9.x86_64.r 1.6 MB/s | 4.9 MB 00:03 2024-08-20T01:19:00.987 INFO:teuthology.orchestra.run.smithi077.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-08-20T01:19:01.002 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] postgresql-server-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-server-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:19:01.046 INFO:teuthology.orchestra.run.smithi077.stdout:(63/150): python3-urllib3-1.26.5-6.el9.noarch.r 170 kB/s | 215 kB 00:01 2024-08-20T01:19:01.071 INFO:teuthology.orchestra.run.smithi077.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-08-20T01:19:01.096 INFO:teuthology.orchestra.run.smithi077.stdout:(65/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-08-20T01:19:01.102 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:01.126 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:01.272 INFO:teuthology.orchestra.run.smithi077.stdout:(66/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2024-08-20T01:19:01.272 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:01.272 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:01.302 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:01.331 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:19:01.332 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:19:01.332 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:01.362 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:19:01.363 INFO:teuthology.orchestra.run.smithi022.stdout:(70/150): postgresql-private-libs-13.16-1.el9.x 131 kB/s | 137 kB 00:01 2024-08-20T01:19:01.459 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:19:01.471 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:19:01.499 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-20T01:19:01.501 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:19:01.506 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-20T01:19:01.511 INFO:teuthology.orchestra.run.smithi134.stdout:(67/150): openblas-0.3.26-1.el9.x86_64.rpm 17 kB/s | 38 kB 00:02 2024-08-20T01:19:01.517 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-20T01:19:01.525 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-20T01:19:01.536 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-20T01:19:01.542 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:19:01.552 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:19:01.554 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-20T01:19:01.555 INFO:teuthology.orchestra.run.smithi022.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 5.3 MB/s | 1.0 MB 00:00 2024-08-20T01:19:01.559 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:19:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:19:01.597 INFO:teuthology.orchestra.run.smithi022.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-08-20T01:19:01.609 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:19:01.615 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:19:01.616 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:19:01.627 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:19:01.701 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:19:01.709 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:19:01.720 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:19:01.756 INFO:teuthology.orchestra.run.smithi022.stdout:(73/150): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 6.0 MB 00:00 2024-08-20T01:19:01.798 INFO:teuthology.orchestra.run.smithi022.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-08-20T01:19:01.819 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] python3-devel-3.9.19-7.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-devel-3.9.19-7.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:19:01.946 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:19:02.106 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:19:02.188 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:19:02.258 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:19:02.272 INFO:teuthology.orchestra.run.smithi077.stdout:(67/150): openblas-0.3.26-1.el9.x86_64.rpm 31 kB/s | 38 kB 00:01 2024-08-20T01:19:02.290 INFO:teuthology.orchestra.run.smithi022.stdout:(75/150): postgresql-contrib-13.16-1.el9.x86_64 325 kB/s | 910 kB 00:02 2024-08-20T01:19:02.334 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:02.340 INFO:teuthology.orchestra.run.smithi022.stdout:(76/150): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-08-20T01:19:02.374 INFO:teuthology.orchestra.run.smithi022.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 767 kB/s | 26 kB 00:00 2024-08-20T01:19:02.384 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:19:02.407 INFO:teuthology.orchestra.run.smithi022.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 573 kB/s | 19 kB 00:00 2024-08-20T01:19:02.436 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:02.444 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:19:02.458 INFO:teuthology.orchestra.run.smithi022.stdout:(79/150): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-08-20T01:19:02.500 INFO:teuthology.orchestra.run.smithi022.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 838 kB/s | 35 kB 00:00 2024-08-20T01:19:02.538 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:19:02.562 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:19:02.594 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:19:02.617 INFO:teuthology.orchestra.run.smithi022.stdout:(81/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 44 MB/s | 5.1 MB 00:00 2024-08-20T01:19:02.621 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:19:02.639 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-20T01:19:02.667 INFO:teuthology.orchestra.run.smithi022.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-08-20T01:19:02.675 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-20T01:19:02.696 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:02.703 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:19:02.717 INFO:teuthology.orchestra.run.smithi022.stdout:(83/150): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-08-20T01:19:02.737 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:19:02.758 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:02.759 INFO:teuthology.orchestra.run.smithi022.stdout:(84/150): python3-devel-3.9.19-7.el9.x86_64.rpm 254 kB/s | 245 kB 00:00 2024-08-20T01:19:02.784 INFO:teuthology.orchestra.run.smithi022.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-08-20T01:19:02.832 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:19:02.835 INFO:teuthology.orchestra.run.smithi022.stdout:(86/150): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-08-20T01:19:02.868 INFO:teuthology.orchestra.run.smithi022.stdout:(87/150): python3-prettytable-0.7.2-27.el9.noar 390 kB/s | 42 kB 00:00 2024-08-20T01:19:02.875 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:19:02.894 INFO:teuthology.orchestra.run.smithi022.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-08-20T01:19:02.934 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-20T01:19:02.936 INFO:teuthology.orchestra.run.smithi022.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-08-20T01:19:02.956 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-20T01:19:02.977 INFO:teuthology.orchestra.run.smithi022.stdout:(90/150): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-08-20T01:19:03.003 INFO:teuthology.orchestra.run.smithi022.stdout:(91/150): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-08-20T01:19:03.053 INFO:teuthology.orchestra.run.smithi022.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-08-20T01:19:03.103 INFO:teuthology.orchestra.run.smithi022.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 886 kB/s | 44 kB 00:00 2024-08-20T01:19:03.162 INFO:teuthology.orchestra.run.smithi022.stdout:(94/150): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-08-20T01:19:03.297 INFO:teuthology.orchestra.run.smithi077.stdout:(68/150): openblas-openmp-0.3.26-1.el9.x86_64.r 2.2 MB/s | 4.9 MB 00:02 2024-08-20T01:19:03.328 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] postgresql-private-libs-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-private-libs-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:03.337 INFO:teuthology.orchestra.run.smithi022.stdout:(95/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-08-20T01:19:03.363 INFO:teuthology.orchestra.run.smithi022.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 179 kB/s | 36 kB 00:00 2024-08-20T01:19:03.386 INFO:teuthology.orchestra.run.smithi134.stdout:(68/150): postgresql-13.16-1.el9.x86_64.rpm 420 kB/s | 1.6 MB 00:03 2024-08-20T01:19:03.388 INFO:teuthology.orchestra.run.smithi022.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 950 kB/s | 47 kB 00:00 2024-08-20T01:19:03.419 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-private-libs-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-private-libs-13.16-1.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:19:03.422 INFO:teuthology.orchestra.run.smithi022.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-08-20T01:19:03.447 INFO:teuthology.orchestra.run.smithi022.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 989 kB/s | 58 kB 00:00 2024-08-20T01:19:03.447 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] xfsprogs-devel-6.4.0-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/xfsprogs-devel-6.4.0-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:19:03.497 INFO:teuthology.orchestra.run.smithi022.stdout:(100/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-08-20T01:19:03.539 INFO:teuthology.orchestra.run.smithi022.stdout:(101/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-08-20T01:19:03.623 INFO:teuthology.orchestra.run.smithi022.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-08-20T01:19:03.807 INFO:teuthology.orchestra.run.smithi022.stdout:(103/150): postgresql-server-13.16-1.el9.x86_64 2.0 MB/s | 5.8 MB 00:02 2024-08-20T01:19:03.857 INFO:teuthology.orchestra.run.smithi022.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-08-20T01:19:03.891 INFO:teuthology.orchestra.run.smithi022.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-08-20T01:19:03.932 INFO:teuthology.orchestra.run.smithi022.stdout:(106/150): protobuf-compiler-3.14.0-13.el9.x86_ 2.7 MB/s | 863 kB 00:00 2024-08-20T01:19:03.958 INFO:teuthology.orchestra.run.smithi022.stdout:(107/150): grpc-data-1.46.7-10.el9.noarch.rpm 290 kB/s | 19 kB 00:00 2024-08-20T01:19:04.000 INFO:teuthology.orchestra.run.smithi022.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 770 kB/s | 26 kB 00:00 2024-08-20T01:19:04.025 INFO:teuthology.orchestra.run.smithi022.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-08-20T01:19:04.050 INFO:teuthology.orchestra.run.smithi022.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-20T01:19:04.055 INFO:teuthology.orchestra.run.smithi077.stdout:(69/150): postgresql-private-libs-13.16-1.el9.x 181 kB/s | 137 kB 00:00 2024-08-20T01:19:04.076 INFO:teuthology.orchestra.run.smithi022.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-08-20T01:19:04.086 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] postgresql-server-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-server-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:04.134 INFO:teuthology.orchestra.run.smithi022.stdout:(112/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-08-20T01:19:04.136 INFO:teuthology.orchestra.run.smithi134.stdout:(69/150): postgresql-private-libs-13.16-1.el9.x 183 kB/s | 137 kB 00:00 2024-08-20T01:19:04.152 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] postgresql-server-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-server-13.16-1.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:19:04.176 INFO:teuthology.orchestra.run.smithi022.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-08-20T01:19:04.189 INFO:teuthology.orchestra.run.smithi077.stdout:(70/150): postgresql-13.16-1.el9.x86_64.rpm 557 kB/s | 1.6 MB 00:02 2024-08-20T01:19:04.201 INFO:teuthology.orchestra.run.smithi022.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-20T01:19:04.227 INFO:teuthology.orchestra.run.smithi022.stdout:(115/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 119 kB/s | 96 kB 00:00 2024-08-20T01:19:04.252 INFO:teuthology.orchestra.run.smithi022.stdout:(116/150): python3-cachetools-4.2.4-1.el9.noarc 661 kB/s | 32 kB 00:00 2024-08-20T01:19:04.286 INFO:teuthology.orchestra.run.smithi022.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-08-20T01:19:04.311 INFO:teuthology.orchestra.run.smithi022.stdout:(118/150): python3-certifi-2023.05.07-4.el9.noa 168 kB/s | 14 kB 00:00 2024-08-20T01:19:04.344 INFO:teuthology.orchestra.run.smithi022.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.2 MB/s | 358 kB 00:00 2024-08-20T01:19:04.370 INFO:teuthology.orchestra.run.smithi022.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-08-20T01:19:04.395 INFO:teuthology.orchestra.run.smithi022.stdout:(121/150): python3-google-auth-2.33.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-08-20T01:19:04.428 INFO:teuthology.orchestra.run.smithi022.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-08-20T01:19:04.439 INFO:teuthology.orchestra.run.smithi077.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 4.0 MB/s | 1.0 MB 00:00 2024-08-20T01:19:04.454 INFO:teuthology.orchestra.run.smithi022.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-08-20T01:19:04.498 INFO:teuthology.orchestra.run.smithi077.stdout:(72/150): postgresql-contrib-13.16-1.el9.x86_64 409 kB/s | 910 kB 00:02 2024-08-20T01:19:04.521 INFO:teuthology.orchestra.run.smithi022.stdout:(124/150): libarrow-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 4.4 MB 00:00 2024-08-20T01:19:04.523 INFO:teuthology.orchestra.run.smithi077.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-08-20T01:19:04.546 INFO:teuthology.orchestra.run.smithi022.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-08-20T01:19:04.571 INFO:teuthology.orchestra.run.smithi022.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-08-20T01:19:04.582 INFO:teuthology.orchestra.run.smithi077.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-08-20T01:19:04.586 INFO:teuthology.orchestra.run.smithi134.stdout:(70/150): postgresql-contrib-13.16-1.el9.x86_64 296 kB/s | 910 kB 00:03 2024-08-20T01:19:04.597 INFO:teuthology.orchestra.run.smithi022.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-08-20T01:19:04.612 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] python3-devel-3.9.19-7.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-devel-3.9.19-7.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:04.622 INFO:teuthology.orchestra.run.smithi022.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-08-20T01:19:04.647 INFO:teuthology.orchestra.run.smithi022.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-20T01:19:04.673 INFO:teuthology.orchestra.run.smithi022.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-20T01:19:04.698 INFO:teuthology.orchestra.run.smithi022.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-20T01:19:04.711 INFO:teuthology.orchestra.run.smithi134.stdout:(71/150): openblas-openmp-0.3.26-1.el9.x86_64.r 941 kB/s | 4.9 MB 00:05 2024-08-20T01:19:04.731 INFO:teuthology.orchestra.run.smithi022.stdout:(132/150): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-20T01:19:04.765 INFO:teuthology.orchestra.run.smithi022.stdout:(133/150): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-08-20T01:19:04.770 INFO:teuthology.orchestra.run.smithi134.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-08-20T01:19:04.782 INFO:teuthology.orchestra.run.smithi022.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-08-20T01:19:04.799 INFO:teuthology.orchestra.run.smithi022.stdout:(135/150): python3-pyperclip-1.8.2-2.el9.noarch 1.6 MB/s | 28 kB 00:00 2024-08-20T01:19:04.820 INFO:teuthology.orchestra.run.smithi134.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 812 kB/s | 87 kB 00:00 2024-08-20T01:19:04.824 INFO:teuthology.orchestra.run.smithi022.stdout:(136/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-08-20T01:19:04.850 INFO:teuthology.orchestra.run.smithi022.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-08-20T01:19:04.870 INFO:teuthology.orchestra.run.smithi134.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-08-20T01:19:04.875 INFO:teuthology.orchestra.run.smithi022.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-20T01:19:04.900 INFO:teuthology.orchestra.run.smithi022.stdout:(139/150): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-08-20T01:19:04.924 INFO:teuthology.orchestra.run.smithi077.stdout:(75/150): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-08-20T01:19:04.925 INFO:teuthology.orchestra.run.smithi022.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-08-20T01:19:04.951 INFO:teuthology.orchestra.run.smithi022.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-08-20T01:19:04.963 INFO:teuthology.orchestra.run.smithi134.stdout:(75/150): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 6.0 MB 00:00 2024-08-20T01:19:04.963 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] python3-devel-3.9.19-7.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-devel-3.9.19-7.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:19:04.982 INFO:teuthology.orchestra.run.smithi077.stdout:(76/150): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-08-20T01:19:04.993 INFO:teuthology.orchestra.run.smithi022.stdout:(142/150): python3-grpcio-1.46.7-10.el9.x86_64. 3.3 MB/s | 2.0 MB 00:00 2024-08-20T01:19:05.004 INFO:teuthology.orchestra.run.smithi134.stdout:(76/150): python3-jinja2-2.11.3-6.el9.noarch.rp 5.9 MB/s | 248 kB 00:00 2024-08-20T01:19:05.018 INFO:teuthology.orchestra.run.smithi022.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-08-20T01:19:05.042 INFO:teuthology.orchestra.run.smithi077.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-08-20T01:19:05.043 INFO:teuthology.orchestra.run.smithi022.stdout:(144/150): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-08-20T01:19:05.047 INFO:teuthology.orchestra.run.smithi134.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 611 kB/s | 26 kB 00:00 2024-08-20T01:19:05.069 INFO:teuthology.orchestra.run.smithi022.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-08-20T01:19:05.089 INFO:teuthology.orchestra.run.smithi134.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 461 kB/s | 19 kB 00:00 2024-08-20T01:19:05.094 INFO:teuthology.orchestra.run.smithi022.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-08-20T01:19:05.100 INFO:teuthology.orchestra.run.smithi077.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 330 kB/s | 19 kB 00:00 2024-08-20T01:19:05.128 INFO:teuthology.orchestra.run.smithi022.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-08-20T01:19:05.130 INFO:teuthology.orchestra.run.smithi134.stdout:(79/150): python3-mako-1.1.4-6.el9.noarch.rpm 4.1 MB/s | 172 kB 00:00 2024-08-20T01:19:05.159 INFO:teuthology.orchestra.run.smithi077.stdout:(79/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-08-20T01:19:05.172 INFO:teuthology.orchestra.run.smithi134.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 838 kB/s | 35 kB 00:00 2024-08-20T01:19:05.186 INFO:teuthology.orchestra.run.smithi022.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-08-20T01:19:05.234 INFO:teuthology.orchestra.run.smithi077.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 462 kB/s | 35 kB 00:00 2024-08-20T01:19:05.306 INFO:teuthology.orchestra.run.smithi134.stdout:(81/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 5.1 MB 00:00 2024-08-20T01:19:05.348 INFO:teuthology.orchestra.run.smithi134.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 6.0 MB/s | 250 kB 00:00 2024-08-20T01:19:05.390 INFO:teuthology.orchestra.run.smithi134.stdout:(83/150): python3-oauthlib-3.1.1-5.el9.noarch.r 5.2 MB/s | 222 kB 00:00 2024-08-20T01:19:05.432 INFO:teuthology.orchestra.run.smithi134.stdout:(84/150): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-08-20T01:19:05.474 INFO:teuthology.orchestra.run.smithi134.stdout:(85/150): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-08-20T01:19:05.478 INFO:teuthology.orchestra.run.smithi022.stdout:(149/150): librados2-19.0.0-5872.gef427541.el9. 9.0 MB/s | 3.5 MB 00:00 2024-08-20T01:19:05.501 INFO:teuthology.orchestra.run.smithi077.stdout:(81/150): python3-devel-3.9.19-7.el9.x86_64.rpm 266 kB/s | 245 kB 00:00 2024-08-20T01:19:05.516 INFO:teuthology.orchestra.run.smithi134.stdout:(86/150): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-08-20T01:19:05.545 INFO:teuthology.orchestra.run.smithi022.stdout:(150/150): librbd1-19.0.0-5872.gef427541.el9.x8 7.9 MB/s | 3.2 MB 00:00 2024-08-20T01:19:05.552 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-08-20T01:19:05.552 INFO:teuthology.orchestra.run.smithi022.stdout:Total 14 MB/s | 232 MB 00:16 2024-08-20T01:19:05.558 INFO:teuthology.orchestra.run.smithi134.stdout:(87/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.7 MB/s | 159 kB 00:00 2024-08-20T01:19:05.559 INFO:teuthology.orchestra.run.smithi077.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-08-20T01:19:05.603 INFO:teuthology.orchestra.run.smithi134.stdout:(88/150): python3-pyasn1-modules-0.4.8-6.el9.no 6.6 MB/s | 279 kB 00:00 2024-08-20T01:19:05.635 INFO:teuthology.orchestra.run.smithi077.stdout:(83/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-08-20T01:19:05.641 INFO:teuthology.orchestra.run.smithi134.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-08-20T01:19:05.660 INFO:teuthology.orchestra.run.smithi077.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-08-20T01:19:05.684 INFO:teuthology.orchestra.run.smithi134.stdout:(90/150): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-08-20T01:19:05.693 INFO:teuthology.orchestra.run.smithi077.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-08-20T01:19:05.719 INFO:teuthology.orchestra.run.smithi077.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 722 kB/s | 42 kB 00:00 2024-08-20T01:19:05.759 INFO:teuthology.orchestra.run.smithi134.stdout:(91/150): postgresql-server-13.16-1.el9.x86_64. 3.6 MB/s | 5.8 MB 00:01 2024-08-20T01:19:05.761 INFO:teuthology.orchestra.run.smithi077.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-08-20T01:19:05.786 INFO:teuthology.orchestra.run.smithi077.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-08-20T01:19:05.826 INFO:teuthology.orchestra.run.smithi134.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 631 kB/s | 42 kB 00:00 2024-08-20T01:19:05.836 INFO:teuthology.orchestra.run.smithi077.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-08-20T01:19:05.862 INFO:teuthology.orchestra.run.smithi077.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-08-20T01:19:05.893 INFO:teuthology.orchestra.run.smithi134.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 662 kB/s | 44 kB 00:00 2024-08-20T01:19:05.918 INFO:teuthology.orchestra.run.smithi134.stdout:(94/150): python3-devel-3.9.19-7.el9.x86_64.rpm 234 kB/s | 245 kB 00:01 2024-08-20T01:19:05.920 INFO:teuthology.orchestra.run.smithi077.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 642 kB/s | 54 kB 00:00 2024-08-20T01:19:05.960 INFO:teuthology.orchestra.run.smithi134.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-08-20T01:19:05.996 INFO:teuthology.orchestra.run.smithi077.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 555 kB/s | 42 kB 00:00 2024-08-20T01:19:06.088 INFO:teuthology.orchestra.run.smithi077.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 482 kB/s | 44 kB 00:00 2024-08-20T01:19:06.178 INFO:teuthology.orchestra.run.smithi134.stdout:(96/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-08-20T01:19:06.202 INFO:teuthology.orchestra.run.smithi134.stdout:(97/150): qatlib-service-24.02.0-1.el9.x86_64.r 127 kB/s | 36 kB 00:00 2024-08-20T01:19:06.227 INFO:teuthology.orchestra.run.smithi134.stdout:(98/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 178 kB/s | 47 kB 00:00 2024-08-20T01:19:06.254 INFO:teuthology.orchestra.run.smithi077.stdout:(94/150): qatlib-24.02.0-1.el9.x86_64.rpm 1.3 MB/s | 221 kB 00:00 2024-08-20T01:19:06.269 INFO:teuthology.orchestra.run.smithi134.stdout:(99/150): socat-1.7.4.1-6.el9.x86_64.rpm 3.3 MB/s | 304 kB 00:00 2024-08-20T01:19:06.271 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] xfsprogs-devel-6.4.0-4.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/xfsprogs-devel-6.4.0-4.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:19:06.303 INFO:teuthology.orchestra.run.smithi134.stdout:(100/150): uuid-1.6.2-55.el9.x86_64.rpm 768 kB/s | 58 kB 00:00 2024-08-20T01:19:06.336 INFO:teuthology.orchestra.run.smithi134.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 952 kB/s | 64 kB 00:00 2024-08-20T01:19:06.338 INFO:teuthology.orchestra.run.smithi077.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 431 kB/s | 36 kB 00:00 2024-08-20T01:19:06.387 INFO:teuthology.orchestra.run.smithi134.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 536 kB/s | 45 kB 00:00 2024-08-20T01:19:06.412 INFO:teuthology.orchestra.run.smithi134.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-08-20T01:19:06.422 INFO:teuthology.orchestra.run.smithi077.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 570 kB/s | 47 kB 00:00 2024-08-20T01:19:06.462 INFO:teuthology.orchestra.run.smithi134.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-08-20T01:19:06.496 INFO:teuthology.orchestra.run.smithi134.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 9.2 MB/s | 309 kB 00:00 2024-08-20T01:19:06.529 INFO:teuthology.orchestra.run.smithi134.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 764 kB/s | 19 kB 00:00 2024-08-20T01:19:06.588 INFO:teuthology.orchestra.run.smithi134.stdout:(107/150): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-08-20T01:19:06.589 INFO:teuthology.orchestra.run.smithi077.stdout:(97/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-08-20T01:19:06.622 INFO:teuthology.orchestra.run.smithi077.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-08-20T01:19:06.630 INFO:teuthology.orchestra.run.smithi134.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 632 kB/s | 26 kB 00:00 2024-08-20T01:19:06.648 INFO:teuthology.orchestra.run.smithi077.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 990 kB/s | 58 kB 00:00 2024-08-20T01:19:06.653 INFO:teuthology.orchestra.run.smithi077.stdout:[MIRROR] xfsprogs-devel-6.4.0-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/xfsprogs-devel-6.4.0-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:19:06.655 INFO:teuthology.orchestra.run.smithi134.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-20T01:19:06.680 INFO:teuthology.orchestra.run.smithi134.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-20T01:19:06.701 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-08-20T01:19:06.706 INFO:teuthology.orchestra.run.smithi134.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-08-20T01:19:06.706 INFO:teuthology.orchestra.run.smithi077.stdout:(100/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-08-20T01:19:06.757 INFO:teuthology.orchestra.run.smithi077.stdout:(101/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-08-20T01:19:06.773 INFO:teuthology.orchestra.run.smithi134.stdout:(112/150): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-08-20T01:19:06.834 INFO:teuthology.orchestra.run.smithi134.stdout:(113/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.4 MB/s | 839 kB 00:00 2024-08-20T01:19:06.843 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-08-20T01:19:06.843 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-08-20T01:19:06.865 INFO:teuthology.orchestra.run.smithi134.stdout:(114/150): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-08-20T01:19:06.882 INFO:teuthology.orchestra.run.smithi134.stdout:(115/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 907 kB/s | 43 kB 00:00 2024-08-20T01:19:06.899 INFO:teuthology.orchestra.run.smithi134.stdout:(116/150): python3-cachetools-4.2.4-1.el9.noarc 963 kB/s | 32 kB 00:00 2024-08-20T01:19:06.916 INFO:teuthology.orchestra.run.smithi134.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 420 kB/s | 14 kB 00:00 2024-08-20T01:19:06.949 INFO:teuthology.orchestra.run.smithi134.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-08-20T01:19:06.983 INFO:teuthology.orchestra.run.smithi134.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-08-20T01:19:07.000 INFO:teuthology.orchestra.run.smithi134.stdout:(120/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 124 kB/s | 96 kB 00:00 2024-08-20T01:19:07.032 INFO:teuthology.orchestra.run.smithi077.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 81 kB/s | 22 kB 00:00 2024-08-20T01:19:07.033 INFO:teuthology.orchestra.run.smithi134.stdout:(121/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-08-20T01:19:07.059 INFO:teuthology.orchestra.run.smithi134.stdout:(122/150): python3-google-auth-2.33.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-08-20T01:19:07.076 INFO:teuthology.orchestra.run.smithi134.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 3.5 MB/s | 144 kB 00:00 2024-08-20T01:19:07.101 INFO:teuthology.orchestra.run.smithi134.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 257 kB/s | 11 kB 00:00 2024-08-20T01:19:07.126 INFO:teuthology.orchestra.run.smithi134.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 714 kB/s | 18 kB 00:00 2024-08-20T01:19:07.151 INFO:teuthology.orchestra.run.smithi134.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-08-20T01:19:07.177 INFO:teuthology.orchestra.run.smithi134.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-08-20T01:19:07.202 INFO:teuthology.orchestra.run.smithi134.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-08-20T01:19:07.227 INFO:teuthology.orchestra.run.smithi134.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-20T01:19:07.252 INFO:teuthology.orchestra.run.smithi134.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-20T01:19:07.278 INFO:teuthology.orchestra.run.smithi134.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-20T01:19:07.311 INFO:teuthology.orchestra.run.smithi134.stdout:(132/150): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-20T01:19:07.345 INFO:teuthology.orchestra.run.smithi134.stdout:(133/150): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-08-20T01:19:07.349 INFO:teuthology.orchestra.run.smithi077.stdout:(103/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 132 kB/s | 96 kB 00:00 2024-08-20T01:19:07.370 INFO:teuthology.orchestra.run.smithi134.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-08-20T01:19:07.396 INFO:teuthology.orchestra.run.smithi134.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-08-20T01:19:07.399 INFO:teuthology.orchestra.run.smithi077.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-08-20T01:19:07.421 INFO:teuthology.orchestra.run.smithi134.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-08-20T01:19:07.424 INFO:teuthology.orchestra.run.smithi077.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-08-20T01:19:07.446 INFO:teuthology.orchestra.run.smithi134.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-08-20T01:19:07.450 INFO:teuthology.orchestra.run.smithi077.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-08-20T01:19:07.471 INFO:teuthology.orchestra.run.smithi134.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-20T01:19:07.499 INFO:teuthology.orchestra.run.smithi134.stdout:(139/150): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-08-20T01:19:07.524 INFO:teuthology.orchestra.run.smithi134.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 680 kB/s | 36 kB 00:00 2024-08-20T01:19:07.549 INFO:teuthology.orchestra.run.smithi134.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-20T01:19:07.567 INFO:teuthology.orchestra.run.smithi077.stdout:(107/150): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-08-20T01:19:07.575 INFO:teuthology.orchestra.run.smithi134.stdout:(142/150): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-20T01:19:07.584 INFO:teuthology.orchestra.run.smithi077.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-08-20T01:19:07.617 INFO:teuthology.orchestra.run.smithi134.stdout:(143/150): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-08-20T01:19:07.642 INFO:teuthology.orchestra.run.smithi134.stdout:(144/150): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-08-20T01:19:07.667 INFO:teuthology.orchestra.run.smithi134.stdout:(145/150): re2-20211101-3.el9.x86_64.rpm 7.5 MB/s | 192 kB 00:00 2024-08-20T01:19:07.709 INFO:teuthology.orchestra.run.smithi134.stdout:(146/150): python3-grpcio-1.46.7-10.el9.x86_64. 2.9 MB/s | 2.0 MB 00:00 2024-08-20T01:19:07.713 INFO:teuthology.orchestra.run.smithi077.stdout:(109/150): postgresql-server-13.16-1.el9.x86_64 1.6 MB/s | 5.8 MB 00:03 2024-08-20T01:19:07.734 INFO:teuthology.orchestra.run.smithi134.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-08-20T01:19:07.768 INFO:teuthology.orchestra.run.smithi077.stdout:(110/150): liboath-2.6.7-2.el9.x86_64.rpm 264 kB/s | 49 kB 00:00 2024-08-20T01:19:07.793 INFO:teuthology.orchestra.run.smithi134.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-08-20T01:19:07.810 INFO:teuthology.orchestra.run.smithi077.stdout:(111/150): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-08-20T01:19:07.843 INFO:teuthology.orchestra.run.smithi077.stdout:(112/150): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-08-20T01:19:07.869 INFO:teuthology.orchestra.run.smithi077.stdout:(113/150): libunwind-1.6.2-1.el9.x86_64.rpm 433 kB/s | 67 kB 00:00 2024-08-20T01:19:07.894 INFO:teuthology.orchestra.run.smithi077.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-20T01:19:07.919 INFO:teuthology.orchestra.run.smithi077.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-20T01:19:07.944 INFO:teuthology.orchestra.run.smithi077.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 571 kB/s | 14 kB 00:00 2024-08-20T01:19:07.978 INFO:teuthology.orchestra.run.smithi077.stdout:(117/150): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-08-20T01:19:08.003 INFO:teuthology.orchestra.run.smithi077.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-08-20T01:19:08.037 INFO:teuthology.orchestra.run.smithi077.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-08-20T01:19:08.071 INFO:teuthology.orchestra.run.smithi077.stdout:(120/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.2 MB/s | 839 kB 00:00 2024-08-20T01:19:08.093 INFO:teuthology.orchestra.run.smithi134.stdout:(149/150): librados2-19.0.0-5872.gef427541.el9. 9.0 MB/s | 3.5 MB 00:00 2024-08-20T01:19:08.096 INFO:teuthology.orchestra.run.smithi077.stdout:(121/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-08-20T01:19:08.121 INFO:teuthology.orchestra.run.smithi077.stdout:(122/150): python3-google-auth-2.33.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-08-20T01:19:08.146 INFO:teuthology.orchestra.run.smithi077.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-08-20T01:19:08.152 INFO:teuthology.orchestra.run.smithi134.stdout:(150/150): librbd1-19.0.0-5872.gef427541.el9.x8 7.9 MB/s | 3.2 MB 00:00 2024-08-20T01:19:08.159 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-08-20T01:19:08.159 INFO:teuthology.orchestra.run.smithi134.stdout:Total 9.6 MB/s | 232 MB 00:24 2024-08-20T01:19:08.172 INFO:teuthology.orchestra.run.smithi077.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-08-20T01:19:08.197 INFO:teuthology.orchestra.run.smithi077.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-08-20T01:19:08.222 INFO:teuthology.orchestra.run.smithi077.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-08-20T01:19:08.248 INFO:teuthology.orchestra.run.smithi077.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-08-20T01:19:08.273 INFO:teuthology.orchestra.run.smithi077.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-08-20T01:19:08.299 INFO:teuthology.orchestra.run.smithi077.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-20T01:19:08.323 INFO:teuthology.orchestra.run.smithi077.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-20T01:19:08.349 INFO:teuthology.orchestra.run.smithi077.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-08-20T01:19:08.382 INFO:teuthology.orchestra.run.smithi077.stdout:(132/150): python3-pecan-1.4.2-3.el9.noarch.rpm 8.3 MB/s | 272 kB 00:00 2024-08-20T01:19:08.408 INFO:teuthology.orchestra.run.smithi077.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-08-20T01:19:08.441 INFO:teuthology.orchestra.run.smithi077.stdout:(134/150): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-08-20T01:19:08.475 INFO:teuthology.orchestra.run.smithi077.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-08-20T01:19:08.500 INFO:teuthology.orchestra.run.smithi077.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 480 kB/s | 28 kB 00:00 2024-08-20T01:19:08.526 INFO:teuthology.orchestra.run.smithi077.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-08-20T01:19:08.551 INFO:teuthology.orchestra.run.smithi077.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-20T01:19:08.576 INFO:teuthology.orchestra.run.smithi077.stdout:(139/150): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-08-20T01:19:08.593 INFO:teuthology.orchestra.run.smithi077.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 854 kB/s | 36 kB 00:00 2024-08-20T01:19:08.619 INFO:teuthology.orchestra.run.smithi077.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-08-20T01:19:08.644 INFO:teuthology.orchestra.run.smithi077.stdout:(142/150): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-20T01:19:08.669 INFO:teuthology.orchestra.run.smithi077.stdout:(143/150): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-20T01:19:08.736 INFO:teuthology.orchestra.run.smithi077.stdout:(144/150): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-08-20T01:19:08.753 INFO:teuthology.orchestra.run.smithi077.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 239 kB/s | 20 kB 00:00 2024-08-20T01:19:08.757 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-08-20T01:19:08.757 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-08-20T01:19:08.787 INFO:teuthology.orchestra.run.smithi077.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-08-20T01:19:08.812 INFO:teuthology.orchestra.run.smithi077.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 2.5 MB/s | 427 kB 00:00 2024-08-20T01:19:08.862 INFO:teuthology.orchestra.run.smithi077.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-20T01:19:09.171 INFO:teuthology.orchestra.run.smithi077.stdout:(149/150): librados2-19.0.0-5872.gef427541.el9. 9.0 MB/s | 3.5 MB 00:00 2024-08-20T01:19:09.230 INFO:teuthology.orchestra.run.smithi077.stdout:(150/150): librbd1-19.0.0-5872.gef427541.el9.x8 7.9 MB/s | 3.2 MB 00:00 2024-08-20T01:19:09.237 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-08-20T01:19:09.237 INFO:teuthology.orchestra.run.smithi077.stdout:Total 12 MB/s | 232 MB 00:19 2024-08-20T01:19:09.251 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-08-20T01:19:09.382 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-08-20T01:19:09.382 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-08-20T01:19:10.307 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-08-20T01:19:10.432 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-08-20T01:19:10.432 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-08-20T01:19:11.193 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-08-20T01:19:11.194 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-08-20T01:19:12.238 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-08-20T01:19:12.238 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-08-20T01:19:14.747 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-08-20T01:19:14.831 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-20T01:19:14.856 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-20T01:19:14.908 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-20T01:19:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-20T01:19:15.384 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librados2-2:19.0.0-5872.gef427541.el9.x86_64 5/152 2024-08-20T01:19:15.490 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:19.0.0-5872.gef427541.el9.x86_64 5/152 2024-08-20T01:19:15.524 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T01:19:15.604 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T01:19:15.651 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 7/152 2024-08-20T01:19:15.679 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-20T01:19:15.705 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-20T01:19:15.871 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-20T01:19:15.927 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-20T01:19:15.955 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T01:19:16.044 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T01:19:16.073 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 13/152 2024-08-20T01:19:16.136 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 13/152 2024-08-20T01:19:16.157 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-20T01:19:16.182 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-20T01:19:16.477 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-20T01:19:16.515 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-20T01:19:16.628 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-08-20T01:19:16.673 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-20T01:19:16.716 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-20T01:19:16.792 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-20T01:19:16.843 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-20T01:19:16.882 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-20T01:19:16.925 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-20T01:19:16.958 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-20T01:19:16.994 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-20T01:19:17.067 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-20T01:19:17.126 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-20T01:19:17.154 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-20T01:19:17.191 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-20T01:19:17.250 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-08-20T01:19:17.271 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-20T01:19:17.309 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-common-2:19.0.0-5872.gef427541.el9. 30/152 2024-08-20T01:19:17.321 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-20T01:19:17.355 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-argparse-2:19.0.0-5872.gef427541.el 31/152 2024-08-20T01:19:17.381 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_6 32/152 2024-08-20T01:19:17.400 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-20T01:19:17.458 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-20T01:19:17.490 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-20T01:19:17.505 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-20T01:19:17.584 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-20T01:19:17.734 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-20T01:19:17.787 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-20T01:19:17.833 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-20T01:19:17.956 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:19.0.0-5872.gef427541.el9.x86_64 5/152 2024-08-20T01:19:18.084 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:19.0.0-5872.gef427541.el9.x86_64 5/152 2024-08-20T01:19:18.107 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T01:19:18.125 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-08-20T01:19:18.186 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T01:19:18.232 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 7/152 2024-08-20T01:19:18.270 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-20T01:19:18.287 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-20T01:19:18.295 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-20T01:19:18.307 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-20T01:19:18.350 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-20T01:19:18.362 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-20T01:19:18.451 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-20T01:19:18.468 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-20T01:19:18.501 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-20T01:19:18.501 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-20T01:19:18.544 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-20T01:19:18.554 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T01:19:18.582 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librados-devel-2:19.0.0-5872.gef427541.el9.x86_6 42/152 2024-08-20T01:19:18.640 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-20T01:19:18.658 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T01:19:18.687 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-20T01:19:18.688 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 13/152 2024-08-20T01:19:18.735 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 13/152 2024-08-20T01:19:18.737 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-20T01:19:18.756 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-20T01:19:18.782 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-20T01:19:18.807 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-20T01:19:18.809 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librados2-2:19.0.0-5872.gef427541.el9.x86_64 5/152 2024-08-20T01:19:18.881 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-20T01:19:18.915 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:19.0.0-5872.gef427541.el9.x86_64 5/152 2024-08-20T01:19:18.918 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-20T01:19:18.953 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-20T01:19:18.960 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T01:19:19.001 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-20T01:19:19.026 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-20T01:19:19.035 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-20T01:19:19.054 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T01:19:19.056 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-20T01:19:19.080 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-20T01:19:19.093 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 7/152 2024-08-20T01:19:19.122 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-20T01:19:19.122 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-20T01:19:19.148 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-20T01:19:19.163 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-08-20T01:19:19.195 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-20T01:19:19.239 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-20T01:19:19.268 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-20T01:19:19.308 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-20T01:19:19.314 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-20T01:19:19.330 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-20T01:19:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-20T01:19:19.356 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-20T01:19:19.382 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T01:19:19.390 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-20T01:19:19.422 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-20T01:19:19.464 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-20T01:19:19.465 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-20T01:19:19.485 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T01:19:19.497 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 57/152 2024-08-20T01:19:19.498 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-20T01:19:19.508 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 13/152 2024-08-20T01:19:19.535 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-20T01:19:19.537 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-20T01:19:19.562 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-20T01:19:19.562 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 13/152 2024-08-20T01:19:19.584 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-20T01:19:19.587 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-20T01:19:19.605 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-20T01:19:19.605 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-20T01:19:19.666 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-20T01:19:19.667 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-20T01:19:19.696 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-20T01:19:19.731 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-20T01:19:19.809 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-20T01:19:19.812 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-20T01:19:19.850 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:19.0.0-5872.gef427541.el9. 30/152 2024-08-20T01:19:19.852 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-20T01:19:19.856 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-20T01:19:19.881 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-20T01:19:19.892 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-20T01:19:19.895 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:19.0.0-5872.gef427541.el 31/152 2024-08-20T01:19:19.915 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-20T01:19:19.922 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_6 32/152 2024-08-20T01:19:19.995 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-20T01:19:19.998 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-08-20T01:19:20.007 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-20T01:19:20.041 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-20T01:19:20.054 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-20T01:19:20.075 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-20T01:19:20.138 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-20T01:19:20.150 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-20T01:19:20.191 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-20T01:19:20.201 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-20T01:19:20.242 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-20T01:19:20.286 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-20T01:19:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-20T01:19:20.321 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-20T01:19:20.340 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-20T01:19:20.346 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-20T01:19:20.366 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-20T01:19:20.418 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-20T01:19:20.469 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-20T01:19:20.500 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-20T01:19:20.510 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-20T01:19:20.543 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-20T01:19:20.577 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-20T01:19:20.618 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-20T01:19:20.629 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-20T01:19:20.661 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-20T01:19:20.662 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-common-2:19.0.0-5872.gef427541.el9. 30/152 2024-08-20T01:19:20.694 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-20T01:19:20.708 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-argparse-2:19.0.0-5872.gef427541.el 31/152 2024-08-20T01:19:20.735 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_6 32/152 2024-08-20T01:19:20.791 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-20T01:19:20.807 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-20T01:19:20.842 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-20T01:19:20.849 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-20T01:19:20.880 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-20T01:19:20.909 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-20T01:19:20.924 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-20T01:19:20.991 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-20T01:19:21.004 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-20T01:19:21.031 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-20T01:19:21.049 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-20T01:19:21.060 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-20T01:19:21.074 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-20T01:19:21.113 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:19.0.0-5872.gef427541.el9.x86_6 42/152 2024-08-20T01:19:21.128 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-20T01:19:21.146 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-20T01:19:21.239 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-20T01:19:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-20T01:19:21.377 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-20T01:19:21.415 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-20T01:19:21.451 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-20T01:19:21.498 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-20T01:19:21.534 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-20T01:19:21.577 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-20T01:19:21.628 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-20T01:19:21.677 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-20T01:19:21.758 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-20T01:19:21.767 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-20T01:19:21.794 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-20T01:19:21.821 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-20T01:19:21.844 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-20T01:19:21.845 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-20T01:19:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-20T01:19:21.883 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librados-devel-2:19.0.0-5872.gef427541.el9.x86_6 42/152 2024-08-20T01:19:21.895 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-20T01:19:21.925 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-20T01:19:21.928 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-20T01:19:21.967 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-20T01:19:22.005 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 57/152 2024-08-20T01:19:22.019 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-20T01:19:22.036 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-20T01:19:22.045 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-20T01:19:22.070 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-20T01:19:22.081 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-20T01:19:22.084 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 83/152 2024-08-20T01:19:22.095 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-20T01:19:22.137 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-20T01:19:22.156 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-20T01:19:22.171 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-20T01:19:22.194 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-20T01:19:22.229 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-20T01:19:22.239 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-20T01:19:22.272 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-20T01:19:22.294 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-20T01:19:22.298 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-20T01:19:22.330 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-20T01:19:22.336 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-20T01:19:22.364 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-20T01:19:22.373 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-20T01:19:22.398 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-20T01:19:22.416 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-20T01:19:22.464 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-0.3.26-1.el9.x86_64 87/152 2024-08-20T01:19:22.467 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-20T01:19:22.494 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-openmp-0.3.26-1.el9.x86_64 88/152 2024-08-20T01:19:22.505 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-20T01:19:22.537 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-20T01:19:22.555 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-20T01:19:22.566 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-20T01:19:22.583 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-20T01:19:22.594 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-20T01:19:22.601 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-20T01:19:22.634 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-20T01:19:22.635 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-20T01:19:22.684 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-20T01:19:22.719 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-20T01:19:22.740 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-20T01:19:22.769 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 57/152 2024-08-20T01:19:22.807 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-20T01:19:22.817 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-20T01:19:22.851 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-20T01:19:22.858 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-20T01:19:22.876 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-20T01:19:22.889 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-20T01:19:22.951 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-20T01:19:22.994 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-20T01:19:23.048 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-20T01:19:23.078 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-20T01:19:23.108 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-20T01:19:23.136 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-20T01:19:23.170 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-20T01:19:23.214 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-20T01:19:23.260 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-20T01:19:23.287 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-20T01:19:23.301 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-20T01:19:23.330 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-20T01:19:23.364 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-20T01:19:23.398 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-20T01:19:23.399 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-20T01:19:23.439 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-20T01:19:23.474 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-20T01:19:23.565 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-20T01:19:23.613 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-20T01:19:23.661 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-20T01:19:23.766 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-20T01:19:23.797 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-20T01:19:23.821 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-20T01:19:23.846 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-20T01:19:23.879 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-20T01:19:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-20T01:19:24.043 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 83/152 2024-08-20T01:19:24.088 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-20T01:19:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-20T01:19:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-20T01:19:24.416 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.26-1.el9.x86_64 87/152 2024-08-20T01:19:24.446 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-openmp-0.3.26-1.el9.x86_64 88/152 2024-08-20T01:19:24.524 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-20T01:19:24.559 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-20T01:19:24.609 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-20T01:19:24.651 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-20T01:19:24.752 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-20T01:19:24.769 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-20T01:19:24.822 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 83/152 2024-08-20T01:19:24.831 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-20T01:19:24.859 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-20T01:19:24.867 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-20T01:19:24.892 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-20T01:19:24.956 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-20T01:19:25.012 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-20T01:19:25.196 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-0.3.26-1.el9.x86_64 87/152 2024-08-20T01:19:25.204 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-20T01:19:25.230 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-20T01:19:25.234 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-openmp-0.3.26-1.el9.x86_64 88/152 2024-08-20T01:19:25.271 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librbd1-2:19.0.0-5872.gef427541.el9.x86_64 97/152 2024-08-20T01:19:25.313 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-20T01:19:25.315 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-20T01:19:25.351 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:19.0.0-5872.gef427541.el9.x86_64 97/152 2024-08-20T01:19:25.376 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 98/152 2024-08-20T01:19:25.413 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-20T01:19:25.932 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-20T01:19:25.965 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librgw2-2:19.0.0-5872.gef427541.el9.x86_64 101/152 2024-08-20T01:19:25.971 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-20T01:19:26.021 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librgw2-2:19.0.0-5872.gef427541.el9.x86_64 101/152 2024-08-20T01:19:26.050 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 102/152 2024-08-20T01:19:26.084 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-20T01:19:26.593 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-20T01:19:26.702 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-20T01:19:26.730 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-20T01:19:26.763 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-20T01:19:27.086 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-20T01:19:27.134 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:19.0.0-5872.gef427541.el9.x86_64 97/152 2024-08-20T01:19:27.229 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:19.0.0-5872.gef427541.el9.x86_64 97/152 2024-08-20T01:19:27.256 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 98/152 2024-08-20T01:19:27.301 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-20T01:19:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-20T01:19:27.429 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-20T01:19:27.457 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-20T01:19:27.490 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-20T01:19:27.794 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-20T01:19:27.810 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-20T01:19:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:19.0.0-5872.gef427541.el9.x86_64 101/152 2024-08-20T01:19:27.853 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librbd1-2:19.0.0-5872.gef427541.el9.x86_64 97/152 2024-08-20T01:19:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:19.0.0-5872.gef427541.el9.x86_64 101/152 2024-08-20T01:19:27.930 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 102/152 2024-08-20T01:19:27.948 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:19.0.0-5872.gef427541.el9.x86_64 97/152 2024-08-20T01:19:27.974 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 98/152 2024-08-20T01:19:28.010 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-20T01:19:28.500 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-20T01:19:28.523 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T01:19:28.556 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librgw2-2:19.0.0-5872.gef427541.el9.x86_64 101/152 2024-08-20T01:19:28.563 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T01:19:28.628 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librgw2-2:19.0.0-5872.gef427541.el9.x86_64 101/152 2024-08-20T01:19:28.657 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 102/152 2024-08-20T01:19:29.147 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T01:19:29.191 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 104/152 2024-08-20T01:19:29.286 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 104/152 2024-08-20T01:19:29.286 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-20T01:19:29.286 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-20T01:19:29.286 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:19:29.318 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 105/152 2024-08-20T01:19:30.220 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T01:19:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T01:19:30.844 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T01:19:30.889 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 104/152 2024-08-20T01:19:30.973 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T01:19:30.980 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 104/152 2024-08-20T01:19:30.980 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-20T01:19:30.980 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-20T01:19:30.980 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:19:31.004 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T01:19:31.016 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 105/152 2024-08-20T01:19:31.551 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T01:19:31.591 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 104/152 2024-08-20T01:19:31.683 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 104/152 2024-08-20T01:19:31.683 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-20T01:19:31.683 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-20T01:19:31.684 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-08-20T01:19:31.717 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 105/152 2024-08-20T01:19:41.091 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 105/152 2024-08-20T01:19:41.092 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /sys 2024-08-20T01:19:41.092 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /proc 2024-08-20T01:19:41.092 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /mnt 2024-08-20T01:19:41.092 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /var/tmp 2024-08-20T01:19:41.092 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /home 2024-08-20T01:19:41.092 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /root 2024-08-20T01:19:41.092 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /tmp 2024-08-20T01:19:41.092 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:19:41.270 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 106/152 2024-08-20T01:19:41.288 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 106/152 2024-08-20T01:19:41.288 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:41.288 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-20T01:19:41.288 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:19:42.360 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 105/152 2024-08-20T01:19:42.360 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-08-20T01:19:42.360 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-08-20T01:19:42.360 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-08-20T01:19:42.360 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-08-20T01:19:42.360 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-08-20T01:19:42.360 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /root 2024-08-20T01:19:42.360 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-08-20T01:19:42.360 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:19:42.545 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 106/152 2024-08-20T01:19:42.563 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 106/152 2024-08-20T01:19:42.563 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:42.563 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-20T01:19:42.563 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:19:42.839 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 107/152 2024-08-20T01:19:42.868 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 107/152 2024-08-20T01:19:42.868 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:42.868 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-20T01:19:42.868 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-20T01:19:42.868 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-20T01:19:42.868 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:19:43.106 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 108/152 2024-08-20T01:19:43.132 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 108/152 2024-08-20T01:19:43.132 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:43.132 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-20T01:19:43.132 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-20T01:19:43.132 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-20T01:19:43.132 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:19:43.136 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 105/152 2024-08-20T01:19:43.136 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /sys 2024-08-20T01:19:43.136 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /proc 2024-08-20T01:19:43.136 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /mnt 2024-08-20T01:19:43.136 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /var/tmp 2024-08-20T01:19:43.136 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /home 2024-08-20T01:19:43.136 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /root 2024-08-20T01:19:43.137 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /tmp 2024-08-20T01:19:43.137 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-08-20T01:19:43.309 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 106/152 2024-08-20T01:19:43.324 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 106/152 2024-08-20T01:19:43.324 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:43.324 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-20T01:19:43.324 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-08-20T01:19:43.599 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 109/152 2024-08-20T01:19:43.624 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 109/152 2024-08-20T01:19:43.624 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:43.624 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-20T01:19:43.624 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-20T01:19:43.625 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-20T01:19:43.625 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:19:43.738 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-20T01:19:43.796 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-20T01:19:43.860 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-20T01:19:44.065 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 107/152 2024-08-20T01:19:44.066 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-20T01:19:44.092 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 107/152 2024-08-20T01:19:44.092 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:44.092 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-20T01:19:44.092 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-20T01:19:44.092 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-20T01:19:44.092 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:19:44.117 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-20T01:19:44.198 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-20T01:19:44.288 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-20T01:19:44.324 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 108/152 2024-08-20T01:19:44.347 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 108/152 2024-08-20T01:19:44.348 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:44.348 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-20T01:19:44.348 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-20T01:19:44.348 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-20T01:19:44.348 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:19:44.431 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-20T01:19:44.475 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-20T01:19:44.506 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-20T01:19:44.534 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-20T01:19:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 109/152 2024-08-20T01:19:44.815 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 109/152 2024-08-20T01:19:44.815 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:44.815 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-20T01:19:44.815 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-20T01:19:44.815 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-20T01:19:44.815 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:19:44.820 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 107/152 2024-08-20T01:19:44.846 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 107/152 2024-08-20T01:19:44.846 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:44.846 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-20T01:19:44.847 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-20T01:19:44.847 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-20T01:19:44.847 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-08-20T01:19:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephadm-2:19.0.0-5872.gef427541.el9.noarch 121/152 2024-08-20T01:19:44.930 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-20T01:19:44.950 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephadm-2:19.0.0-5872.gef427541.el9.noarch 121/152 2024-08-20T01:19:44.983 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5872.gef427541.e 122/152 2024-08-20T01:19:44.987 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-20T01:19:45.043 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-20T01:19:45.051 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5872.gef427541. 123/152 2024-08-20T01:19:45.080 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 108/152 2024-08-20T01:19:45.082 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 124/152 2024-08-20T01:19:45.103 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 108/152 2024-08-20T01:19:45.103 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:45.103 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-20T01:19:45.103 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-20T01:19:45.104 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-20T01:19:45.104 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-08-20T01:19:45.230 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-20T01:19:45.276 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-20T01:19:45.354 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-20T01:19:45.443 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-20T01:19:45.539 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 109/152 2024-08-20T01:19:45.562 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 109/152 2024-08-20T01:19:45.562 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:45.562 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-20T01:19:45.562 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-20T01:19:45.563 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-20T01:19:45.563 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-08-20T01:19:45.584 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-20T01:19:45.635 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-20T01:19:45.660 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-20T01:19:45.675 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-20T01:19:45.702 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-20T01:19:45.709 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-20T01:19:45.764 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-20T01:19:45.947 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-20T01:19:45.998 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-20T01:19:46.067 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-20T01:19:46.108 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.0.0-5872.gef427541.el9.noarch 121/152 2024-08-20T01:19:46.135 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:19.0.0-5872.gef427541.el9.noarch 121/152 2024-08-20T01:19:46.155 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-20T01:19:46.167 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5872.gef427541.e 122/152 2024-08-20T01:19:46.232 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5872.gef427541. 123/152 2024-08-20T01:19:46.267 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 124/152 2024-08-20T01:19:46.286 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-20T01:19:46.332 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-20T01:19:46.364 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-20T01:19:46.393 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-20T01:19:46.864 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:19.0.0-5872.gef427541.el9.noarch 121/152 2024-08-20T01:19:46.892 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephadm-2:19.0.0-5872.gef427541.el9.noarch 121/152 2024-08-20T01:19:46.924 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5872.gef427541.e 122/152 2024-08-20T01:19:46.988 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5872.gef427541. 123/152 2024-08-20T01:19:47.032 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 124/152 2024-08-20T01:19:48.496 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 124/152 2024-08-20T01:19:48.766 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 125/152 2024-08-20T01:19:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 124/152 2024-08-20T01:19:49.542 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 125/152 2024-08-20T01:19:49.571 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 125/152 2024-08-20T01:19:49.605 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 126/152 2024-08-20T01:19:49.725 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 126/152 2024-08-20T01:19:49.900 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el 127/152 2024-08-20T01:19:49.932 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 128/152 2024-08-20T01:19:49.958 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 128/152 2024-08-20T01:19:49.958 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:49.958 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-20T01:19:49.958 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-20T01:19:49.958 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-20T01:19:49.958 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:19:50.008 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 129/152 2024-08-20T01:19:50.020 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 129/152 2024-08-20T01:19:50.122 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-2:19.0.0-5872.gef427541.el9.x86_64 130/152 2024-08-20T01:19:50.175 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 131/152 2024-08-20T01:19:50.196 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 124/152 2024-08-20T01:19:50.264 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 125/152 2024-08-20T01:19:50.500 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 125/152 2024-08-20T01:19:50.534 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 126/152 2024-08-20T01:19:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 126/152 2024-08-20T01:19:50.812 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el 127/152 2024-08-20T01:19:50.844 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 128/152 2024-08-20T01:19:50.868 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 128/152 2024-08-20T01:19:50.868 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:50.868 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-20T01:19:50.868 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-20T01:19:50.869 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-20T01:19:50.869 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:19:50.920 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 129/152 2024-08-20T01:19:50.932 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 129/152 2024-08-20T01:19:51.030 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:19.0.0-5872.gef427541.el9.x86_64 130/152 2024-08-20T01:19:51.085 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 131/152 2024-08-20T01:19:51.183 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-20T01:19:51.211 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 133/152 2024-08-20T01:19:51.231 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 125/152 2024-08-20T01:19:51.236 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 133/152 2024-08-20T01:19:51.236 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:51.236 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-20T01:19:51.236 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-20T01:19:51.236 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-20T01:19:51.236 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:19:51.255 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 126/152 2024-08-20T01:19:51.278 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5872.gef427 134/152 2024-08-20T01:19:51.303 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5872.gef427 134/152 2024-08-20T01:19:51.303 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:51.303 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-20T01:19:51.303 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:19:51.353 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 135/152 2024-08-20T01:19:51.367 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 126/152 2024-08-20T01:19:51.379 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 135/152 2024-08-20T01:19:51.379 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:51.379 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-20T01:19:51.379 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-20T01:19:51.379 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-20T01:19:51.379 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:19:51.551 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el 127/152 2024-08-20T01:19:51.582 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 128/152 2024-08-20T01:19:51.606 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 128/152 2024-08-20T01:19:51.606 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:51.606 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-20T01:19:51.606 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-20T01:19:51.606 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-20T01:19:51.606 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-08-20T01:19:51.658 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 129/152 2024-08-20T01:19:51.669 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 129/152 2024-08-20T01:19:51.721 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 136/152 2024-08-20T01:19:51.746 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 136/152 2024-08-20T01:19:51.746 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:51.746 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-20T01:19:51.746 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-20T01:19:51.747 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-20T01:19:51.747 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:19:51.767 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-2:19.0.0-5872.gef427541.el9.x86_64 130/152 2024-08-20T01:19:51.813 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 131/152 2024-08-20T01:19:52.034 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-20T01:19:52.065 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 133/152 2024-08-20T01:19:52.088 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 133/152 2024-08-20T01:19:52.088 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:52.088 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-20T01:19:52.089 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-20T01:19:52.089 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-20T01:19:52.089 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:19:52.133 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5872.gef427 134/152 2024-08-20T01:19:52.156 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5872.gef427 134/152 2024-08-20T01:19:52.156 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:52.156 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-20T01:19:52.156 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:19:52.208 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 135/152 2024-08-20T01:19:52.232 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 135/152 2024-08-20T01:19:52.232 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:52.232 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-20T01:19:52.232 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-20T01:19:52.232 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-20T01:19:52.232 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:19:52.551 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 136/152 2024-08-20T01:19:52.574 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 136/152 2024-08-20T01:19:52.574 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:52.574 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-20T01:19:52.574 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-20T01:19:52.574 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-20T01:19:52.575 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:19:52.763 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-20T01:19:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 133/152 2024-08-20T01:19:52.816 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 133/152 2024-08-20T01:19:52.816 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:52.816 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-20T01:19:52.817 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-20T01:19:52.817 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-20T01:19:52.817 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-08-20T01:19:52.869 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5872.gef427 134/152 2024-08-20T01:19:52.892 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5872.gef427 134/152 2024-08-20T01:19:52.892 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:52.892 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-20T01:19:52.892 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-08-20T01:19:52.936 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 135/152 2024-08-20T01:19:52.959 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 135/152 2024-08-20T01:19:52.959 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:52.959 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-20T01:19:52.959 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-20T01:19:52.959 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-20T01:19:52.959 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-08-20T01:19:53.271 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 136/152 2024-08-20T01:19:53.293 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 136/152 2024-08-20T01:19:53.294 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:19:53.294 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-20T01:19:53.294 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-20T01:19:53.294 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-20T01:19:53.294 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-08-20T01:19:56.725 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 137/152 2024-08-20T01:19:56.766 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 138/152 2024-08-20T01:19:56.808 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 139/152 2024-08-20T01:19:56.839 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-20T01:19:56.866 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-20T01:19:57.067 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 142/152 2024-08-20T01:19:57.112 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-20T01:19:57.150 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_ 144/152 2024-08-20T01:19:57.262 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 137/152 2024-08-20T01:19:57.303 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 138/152 2024-08-20T01:19:57.353 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 139/152 2024-08-20T01:19:57.385 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-20T01:19:57.412 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-20T01:19:57.601 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 142/152 2024-08-20T01:19:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-20T01:19:57.689 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_ 144/152 2024-08-20T01:19:57.771 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T01:19:57.806 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T01:19:57.827 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T01:19:57.999 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 137/152 2024-08-20T01:19:58.040 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 138/152 2024-08-20T01:19:58.081 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 139/152 2024-08-20T01:19:58.113 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-20T01:19:58.141 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-20T01:19:58.268 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T01:19:58.306 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T01:19:58.322 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 142/152 2024-08-20T01:19:58.325 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T01:19:58.387 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-20T01:19:58.417 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_ 144/152 2024-08-20T01:19:58.738 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 146/152 2024-08-20T01:19:58.844 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-20T01:19:58.887 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-20T01:19:58.981 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-20T01:19:59.015 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-20T01:19:59.015 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-20T01:19:59.030 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T01:19:59.081 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T01:19:59.099 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-20T01:19:59.099 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T01:19:59.101 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T01:19:59.156 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 146/152 2024-08-20T01:19:59.243 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-20T01:19:59.284 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-20T01:19:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-20T01:19:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-20T01:19:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-20T01:19:59.473 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-20T01:19:59.473 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T01:19:59.929 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 146/152 2024-08-20T01:20:00.019 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-20T01:20:00.059 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-20T01:20:00.139 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-20T01:20:00.173 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-20T01:20:00.173 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-20T01:20:00.257 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-20T01:20:00.257 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T01:20:05.590 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T01:20:05.590 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-2:19.0.0-5872.gef427541.el9.x86_64 1/152 2024-08-20T01:20:05.591 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 2/152 2024-08-20T01:20:05.591 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 3/152 2024-08-20T01:20:05.591 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 4/152 2024-08-20T01:20:05.591 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5872.gef427 5/152 2024-08-20T01:20:05.591 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T01:20:05.591 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 7/152 2024-08-20T01:20:05.591 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 8/152 2024-08-20T01:20:05.591 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 9/152 2024-08-20T01:20:05.591 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 10/152 2024-08-20T01:20:05.591 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 11/152 2024-08-20T01:20:05.591 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T01:20:05.591 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 13/152 2024-08-20T01:20:05.591 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 14/152 2024-08-20T01:20:05.592 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_ 15/152 2024-08-20T01:20:05.592 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 16/152 2024-08-20T01:20:05.592 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 17/152 2024-08-20T01:20:05.592 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados-devel-2:19.0.0-5872.gef427541.el9.x86_6 18/152 2024-08-20T01:20:05.592 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 19/152 2024-08-20T01:20:05.592 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librgw2-2:19.0.0-5872.gef427541.el9.x86_64 20/152 2024-08-20T01:20:05.592 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5872.gef427541.el 21/152 2024-08-20T01:20:05.592 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-common-2:19.0.0-5872.gef427541.el9. 22/152 2024-08-20T01:20:05.592 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_6 23/152 2024-08-20T01:20:05.592 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 24/152 2024-08-20T01:20:05.592 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 25/152 2024-08-20T01:20:05.592 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 26/152 2024-08-20T01:20:05.592 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 27/152 2024-08-20T01:20:05.592 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 28/152 2024-08-20T01:20:05.593 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 29/152 2024-08-20T01:20:05.593 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5872.gef427541. 30/152 2024-08-20T01:20:05.593 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 31/152 2024-08-20T01:20:05.593 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 32/152 2024-08-20T01:20:05.593 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 33/152 2024-08-20T01:20:05.593 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el 34/152 2024-08-20T01:20:05.593 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 35/152 2024-08-20T01:20:05.593 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5872.gef427541.e 36/152 2024-08-20T01:20:05.593 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 37/152 2024-08-20T01:20:05.593 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephadm-2:19.0.0-5872.gef427541.el9.noarch 38/152 2024-08-20T01:20:05.593 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 39/152 2024-08-20T01:20:05.593 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-20T01:20:05.593 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-20T01:20:05.593 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-20T01:20:05.593 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-20T01:20:05.594 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-20T01:20:05.594 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-20T01:20:05.594 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-20T01:20:05.594 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-20T01:20:05.594 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-20T01:20:05.594 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-20T01:20:05.594 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-20T01:20:05.594 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-20T01:20:05.594 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-20T01:20:05.594 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-20T01:20:05.594 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-20T01:20:05.594 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-20T01:20:05.594 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-20T01:20:05.595 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-20T01:20:05.595 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-20T01:20:05.595 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-20T01:20:05.595 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-20T01:20:05.595 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-20T01:20:05.595 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-20T01:20:05.595 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-20T01:20:05.595 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-20T01:20:05.595 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-20T01:20:05.595 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-0.3.26-1.el9.x86_64 66/152 2024-08-20T01:20:05.595 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-openmp-0.3.26-1.el9.x86_64 67/152 2024-08-20T01:20:05.595 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-20T01:20:05.595 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-20T01:20:05.595 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-20T01:20:05.596 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-20T01:20:05.596 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-20T01:20:05.596 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-20T01:20:05.596 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-20T01:20:05.596 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-20T01:20:05.596 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-20T01:20:05.596 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 77/152 2024-08-20T01:20:05.596 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-20T01:20:05.596 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-20T01:20:05.596 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-20T01:20:05.596 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-20T01:20:05.596 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-20T01:20:05.596 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-20T01:20:05.596 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-20T01:20:05.596 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-20T01:20:05.597 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-20T01:20:05.597 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-20T01:20:05.597 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-20T01:20:05.597 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-20T01:20:05.597 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-20T01:20:05.597 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-20T01:20:05.597 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-20T01:20:05.597 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-20T01:20:05.597 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-20T01:20:05.597 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-20T01:20:05.597 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-20T01:20:05.597 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-20T01:20:05.597 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-20T01:20:05.598 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-20T01:20:05.598 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-20T01:20:05.598 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-20T01:20:05.598 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-20T01:20:05.598 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-20T01:20:05.598 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-20T01:20:05.598 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-20T01:20:05.598 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-20T01:20:05.598 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-20T01:20:05.598 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-20T01:20:05.598 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-20T01:20:05.599 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-20T01:20:05.599 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-20T01:20:05.599 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-20T01:20:05.599 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-20T01:20:05.599 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-20T01:20:05.599 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-20T01:20:05.599 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-20T01:20:05.599 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-20T01:20:05.599 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-20T01:20:05.599 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-20T01:20:05.599 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-20T01:20:05.599 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-20T01:20:05.599 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 122/152 2024-08-20T01:20:05.600 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-20T01:20:05.600 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-20T01:20:05.600 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-20T01:20:05.600 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-20T01:20:05.600 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-20T01:20:05.600 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-20T01:20:05.600 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-20T01:20:05.600 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-20T01:20:05.600 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-20T01:20:05.600 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-20T01:20:05.600 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-20T01:20:05.600 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-20T01:20:05.600 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-20T01:20:05.600 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-20T01:20:05.601 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-20T01:20:05.601 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-20T01:20:05.601 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-20T01:20:05.601 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-20T01:20:05.601 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-20T01:20:05.601 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-20T01:20:05.601 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-20T01:20:05.601 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-20T01:20:05.601 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-20T01:20:05.601 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-20T01:20:05.601 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-08-20T01:20:05.601 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-20T01:20:05.601 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:19.0.0-5872.gef427541.el9.x86_64 149/152 2024-08-20T01:20:05.601 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-20T01:20:05.602 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:19.0.0-5872.gef427541.el9.x86_64 151/152 2024-08-20T01:20:06.393 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T01:20:06.393 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:19.0.0-5872.gef427541.el9.x86_64 1/152 2024-08-20T01:20:06.393 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 2/152 2024-08-20T01:20:06.393 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 3/152 2024-08-20T01:20:06.393 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 4/152 2024-08-20T01:20:06.393 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5872.gef427 5/152 2024-08-20T01:20:06.393 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T01:20:06.394 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 7/152 2024-08-20T01:20:06.394 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 8/152 2024-08-20T01:20:06.394 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 9/152 2024-08-20T01:20:06.394 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 10/152 2024-08-20T01:20:06.394 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 11/152 2024-08-20T01:20:06.394 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T01:20:06.394 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 13/152 2024-08-20T01:20:06.394 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 14/152 2024-08-20T01:20:06.394 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_ 15/152 2024-08-20T01:20:06.394 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 16/152 2024-08-20T01:20:06.394 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 17/152 2024-08-20T01:20:06.394 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:19.0.0-5872.gef427541.el9.x86_6 18/152 2024-08-20T01:20:06.395 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 19/152 2024-08-20T01:20:06.395 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:19.0.0-5872.gef427541.el9.x86_64 20/152 2024-08-20T01:20:06.395 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5872.gef427541.el 21/152 2024-08-20T01:20:06.395 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:19.0.0-5872.gef427541.el9. 22/152 2024-08-20T01:20:06.395 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_6 23/152 2024-08-20T01:20:06.395 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 24/152 2024-08-20T01:20:06.395 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 25/152 2024-08-20T01:20:06.395 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 26/152 2024-08-20T01:20:06.395 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 27/152 2024-08-20T01:20:06.395 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 28/152 2024-08-20T01:20:06.395 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 29/152 2024-08-20T01:20:06.395 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5872.gef427541. 30/152 2024-08-20T01:20:06.396 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 31/152 2024-08-20T01:20:06.396 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 32/152 2024-08-20T01:20:06.396 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 33/152 2024-08-20T01:20:06.396 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el 34/152 2024-08-20T01:20:06.396 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 35/152 2024-08-20T01:20:06.396 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5872.gef427541.e 36/152 2024-08-20T01:20:06.396 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 37/152 2024-08-20T01:20:06.396 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:19.0.0-5872.gef427541.el9.noarch 38/152 2024-08-20T01:20:06.396 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 39/152 2024-08-20T01:20:06.396 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-20T01:20:06.396 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-20T01:20:06.396 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-20T01:20:06.396 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-20T01:20:06.396 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-20T01:20:06.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-20T01:20:06.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-20T01:20:06.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-20T01:20:06.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-20T01:20:06.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-20T01:20:06.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-20T01:20:06.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-20T01:20:06.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-20T01:20:06.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-20T01:20:06.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-20T01:20:06.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-20T01:20:06.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-20T01:20:06.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-20T01:20:06.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-20T01:20:06.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-20T01:20:06.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-20T01:20:06.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-20T01:20:06.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-20T01:20:06.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-20T01:20:06.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-20T01:20:06.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-20T01:20:06.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.26-1.el9.x86_64 66/152 2024-08-20T01:20:06.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-openmp-0.3.26-1.el9.x86_64 67/152 2024-08-20T01:20:06.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-20T01:20:06.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-20T01:20:06.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-20T01:20:06.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-20T01:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-20T01:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-20T01:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-20T01:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-20T01:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-20T01:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 77/152 2024-08-20T01:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-20T01:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-20T01:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-20T01:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-20T01:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-20T01:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-20T01:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-20T01:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-20T01:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-20T01:20:06.400 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-20T01:20:06.400 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-20T01:20:06.400 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-20T01:20:06.400 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-20T01:20:06.400 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-20T01:20:06.400 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-20T01:20:06.400 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-20T01:20:06.400 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-20T01:20:06.400 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-20T01:20:06.400 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-20T01:20:06.400 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-20T01:20:06.400 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-20T01:20:06.400 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-20T01:20:06.400 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-20T01:20:06.401 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-20T01:20:06.401 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-20T01:20:06.401 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-20T01:20:06.401 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-20T01:20:06.401 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-20T01:20:06.401 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-20T01:20:06.401 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-20T01:20:06.401 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-20T01:20:06.401 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-20T01:20:06.401 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-20T01:20:06.401 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-20T01:20:06.401 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-20T01:20:06.401 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-20T01:20:06.401 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-20T01:20:06.402 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-20T01:20:06.402 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-20T01:20:06.402 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-20T01:20:06.402 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-20T01:20:06.402 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-20T01:20:06.402 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-20T01:20:06.402 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-20T01:20:06.402 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 122/152 2024-08-20T01:20:06.402 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-20T01:20:06.402 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-20T01:20:06.402 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-20T01:20:06.402 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-20T01:20:06.402 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-20T01:20:06.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-20T01:20:06.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-20T01:20:06.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-20T01:20:06.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-20T01:20:06.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-20T01:20:06.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-20T01:20:06.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-20T01:20:06.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-20T01:20:06.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-20T01:20:06.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-20T01:20:06.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-20T01:20:06.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-20T01:20:06.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-20T01:20:06.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-20T01:20:06.404 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-20T01:20:06.404 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-20T01:20:06.404 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-20T01:20:06.404 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-20T01:20:06.404 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-20T01:20:06.404 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-08-20T01:20:06.404 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-20T01:20:06.404 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:19.0.0-5872.gef427541.el9.x86_64 149/152 2024-08-20T01:20:06.404 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-20T01:20:06.404 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:19.0.0-5872.gef427541.el9.x86_64 151/152 2024-08-20T01:20:07.176 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T01:20:07.177 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-2:19.0.0-5872.gef427541.el9.x86_64 1/152 2024-08-20T01:20:07.177 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 2/152 2024-08-20T01:20:07.177 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 3/152 2024-08-20T01:20:07.177 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 4/152 2024-08-20T01:20:07.177 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5872.gef427 5/152 2024-08-20T01:20:07.177 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T01:20:07.177 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 7/152 2024-08-20T01:20:07.177 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 8/152 2024-08-20T01:20:07.177 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 9/152 2024-08-20T01:20:07.177 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 10/152 2024-08-20T01:20:07.177 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 11/152 2024-08-20T01:20:07.177 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T01:20:07.178 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 13/152 2024-08-20T01:20:07.178 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 14/152 2024-08-20T01:20:07.178 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_ 15/152 2024-08-20T01:20:07.178 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 16/152 2024-08-20T01:20:07.178 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 17/152 2024-08-20T01:20:07.178 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados-devel-2:19.0.0-5872.gef427541.el9.x86_6 18/152 2024-08-20T01:20:07.178 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 19/152 2024-08-20T01:20:07.178 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librgw2-2:19.0.0-5872.gef427541.el9.x86_64 20/152 2024-08-20T01:20:07.178 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5872.gef427541.el 21/152 2024-08-20T01:20:07.178 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-common-2:19.0.0-5872.gef427541.el9. 22/152 2024-08-20T01:20:07.178 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_6 23/152 2024-08-20T01:20:07.178 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 24/152 2024-08-20T01:20:07.178 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 25/152 2024-08-20T01:20:07.179 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 26/152 2024-08-20T01:20:07.179 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 27/152 2024-08-20T01:20:07.189 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 28/152 2024-08-20T01:20:07.190 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 29/152 2024-08-20T01:20:07.190 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5872.gef427541. 30/152 2024-08-20T01:20:07.190 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 31/152 2024-08-20T01:20:07.190 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 32/152 2024-08-20T01:20:07.190 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 33/152 2024-08-20T01:20:07.190 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el 34/152 2024-08-20T01:20:07.190 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 35/152 2024-08-20T01:20:07.190 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5872.gef427541.e 36/152 2024-08-20T01:20:07.190 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 37/152 2024-08-20T01:20:07.190 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephadm-2:19.0.0-5872.gef427541.el9.noarch 38/152 2024-08-20T01:20:07.190 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 39/152 2024-08-20T01:20:07.190 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-20T01:20:07.191 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-20T01:20:07.191 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-20T01:20:07.191 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-20T01:20:07.191 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-20T01:20:07.191 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-20T01:20:07.191 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-20T01:20:07.191 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-20T01:20:07.191 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-20T01:20:07.191 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-20T01:20:07.191 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-20T01:20:07.191 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-20T01:20:07.191 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-20T01:20:07.191 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-20T01:20:07.191 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-20T01:20:07.192 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-20T01:20:07.192 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-20T01:20:07.192 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-20T01:20:07.192 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-20T01:20:07.192 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-20T01:20:07.192 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-20T01:20:07.192 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-20T01:20:07.192 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-20T01:20:07.192 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-20T01:20:07.192 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-20T01:20:07.192 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-20T01:20:07.192 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-0.3.26-1.el9.x86_64 66/152 2024-08-20T01:20:07.192 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-openmp-0.3.26-1.el9.x86_64 67/152 2024-08-20T01:20:07.193 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-20T01:20:07.193 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-20T01:20:07.193 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-20T01:20:07.193 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-20T01:20:07.193 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-20T01:20:07.193 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-20T01:20:07.193 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-20T01:20:07.193 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-20T01:20:07.193 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-20T01:20:07.193 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 77/152 2024-08-20T01:20:07.193 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-20T01:20:07.193 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-20T01:20:07.193 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-20T01:20:07.193 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-20T01:20:07.194 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-20T01:20:07.194 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-20T01:20:07.194 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-20T01:20:07.194 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-20T01:20:07.194 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-20T01:20:07.194 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-20T01:20:07.194 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-20T01:20:07.194 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-20T01:20:07.194 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-20T01:20:07.194 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-20T01:20:07.194 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-20T01:20:07.194 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-20T01:20:07.195 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-20T01:20:07.195 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-20T01:20:07.195 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-20T01:20:07.195 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-20T01:20:07.195 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-20T01:20:07.195 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-20T01:20:07.195 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-20T01:20:07.195 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-20T01:20:07.195 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-20T01:20:07.195 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-20T01:20:07.195 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-20T01:20:07.195 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-20T01:20:07.195 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-20T01:20:07.195 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-20T01:20:07.196 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-20T01:20:07.196 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-20T01:20:07.196 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-20T01:20:07.196 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-20T01:20:07.196 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-20T01:20:07.196 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-20T01:20:07.196 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-20T01:20:07.196 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-20T01:20:07.196 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-20T01:20:07.196 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-20T01:20:07.196 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-20T01:20:07.196 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-20T01:20:07.196 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-20T01:20:07.197 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-20T01:20:07.197 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 122/152 2024-08-20T01:20:07.197 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-20T01:20:07.197 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-20T01:20:07.197 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-20T01:20:07.197 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-20T01:20:07.197 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-20T01:20:07.197 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-20T01:20:07.197 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-20T01:20:07.197 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-20T01:20:07.197 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-20T01:20:07.197 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-20T01:20:07.197 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-20T01:20:07.197 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-20T01:20:07.198 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-20T01:20:07.198 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-20T01:20:07.198 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-20T01:20:07.198 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-20T01:20:07.198 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-20T01:20:07.198 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-20T01:20:07.198 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-20T01:20:07.198 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-20T01:20:07.198 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-20T01:20:07.198 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-20T01:20:07.198 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-20T01:20:07.198 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-20T01:20:07.198 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-08-20T01:20:07.199 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-20T01:20:07.199 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:19.0.0-5872.gef427541.el9.x86_64 149/152 2024-08-20T01:20:07.199 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-20T01:20:07.199 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:19.0.0-5872.gef427541.el9.x86_64 151/152 2024-08-20T01:20:07.715 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T01:20:07.715 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:20:07.715 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2024-08-20T01:20:07.715 INFO:teuthology.orchestra.run.smithi022.stdout: librados2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.716 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.716 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-08-20T01:20:07.716 INFO:teuthology.orchestra.run.smithi022.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-20T01:20:07.716 INFO:teuthology.orchestra.run.smithi022.stdout: automake-1.16.2-8.el9.noarch 2024-08-20T01:20:07.716 INFO:teuthology.orchestra.run.smithi022.stdout: bison-3.7.4-5.el9.x86_64 2024-08-20T01:20:07.716 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-20T01:20:07.716 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.716 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.716 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.716 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.716 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:07.716 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.716 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.717 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.717 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:07.717 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:07.717 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:07.717 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:07.717 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:07.717 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.717 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.717 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:07.717 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.717 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.717 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.717 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:07.718 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:07.718 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.718 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.718 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:07.718 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-20T01:20:07.718 INFO:teuthology.orchestra.run.smithi022.stdout: flex-2.6.4-9.el9.x86_64 2024-08-20T01:20:07.718 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-20T01:20:07.718 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-20T01:20:07.718 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-20T01:20:07.718 INFO:teuthology.orchestra.run.smithi022.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-20T01:20:07.718 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-20T01:20:07.718 INFO:teuthology.orchestra.run.smithi022.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-20T01:20:07.719 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-20T01:20:07.719 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-20T01:20:07.719 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-20T01:20:07.719 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.719 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.719 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.719 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-20T01:20:07.719 INFO:teuthology.orchestra.run.smithi022.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-20T01:20:07.719 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-20T01:20:07.719 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-20T01:20:07.719 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-20T01:20:07.719 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.720 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.720 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-20T01:20:07.720 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.720 INFO:teuthology.orchestra.run.smithi022.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-20T01:20:07.720 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-20T01:20:07.720 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-20T01:20:07.720 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-20T01:20:07.720 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-20T01:20:07.720 INFO:teuthology.orchestra.run.smithi022.stdout: lua-5.4.4-4.el9.x86_64 2024-08-20T01:20:07.720 INFO:teuthology.orchestra.run.smithi022.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-20T01:20:07.720 INFO:teuthology.orchestra.run.smithi022.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-20T01:20:07.720 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-0.3.26-1.el9.x86_64 2024-08-20T01:20:07.720 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp-0.3.26-1.el9.x86_64 2024-08-20T01:20:07.721 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-20T01:20:07.721 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-20T01:20:07.721 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-13.16-1.el9.x86_64 2024-08-20T01:20:07.721 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-20T01:20:07.721 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-20T01:20:07.721 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-20T01:20:07.721 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-20T01:20:07.721 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-20T01:20:07.721 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-20T01:20:07.721 INFO:teuthology.orchestra.run.smithi022.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-20T01:20:07.721 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-20T01:20:07.721 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-20T01:20:07.721 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-20T01:20:07.722 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.722 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.722 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.722 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-20T01:20:07.722 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-20T01:20:07.722 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-20T01:20:07.722 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-20T01:20:07.722 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-20T01:20:07.722 INFO:teuthology.orchestra.run.smithi022.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-20T01:20:07.722 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-20T01:20:07.722 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-20T01:20:07.722 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-20T01:20:07.722 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-20T01:20:07.723 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-20T01:20:07.723 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-20T01:20:07.723 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-20T01:20:07.723 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-20T01:20:07.723 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-20T01:20:07.723 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-20T01:20:07.723 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-20T01:20:07.723 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-20T01:20:07.723 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-20T01:20:07.723 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-20T01:20:07.723 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-20T01:20:07.723 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-20T01:20:07.724 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-20T01:20:07.724 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-20T01:20:07.724 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-20T01:20:07.724 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-20T01:20:07.724 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-20T01:20:07.724 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-20T01:20:07.724 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-20T01:20:07.724 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-20T01:20:07.724 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply-3.11-14.el9.noarch 2024-08-20T01:20:07.724 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-20T01:20:07.724 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-20T01:20:07.724 INFO:teuthology.orchestra.run.smithi022.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-20T01:20:07.724 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-20T01:20:07.725 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-20T01:20:07.725 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-20T01:20:07.725 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-20T01:20:07.725 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-20T01:20:07.725 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-20T01:20:07.725 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.725 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.725 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-20T01:20:07.725 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-20T01:20:07.725 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-20T01:20:07.725 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.725 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-20T01:20:07.725 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-20T01:20:07.725 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-20T01:20:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-20T01:20:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-20T01:20:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-20T01:20:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-20T01:20:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-20T01:20:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-20T01:20:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-20T01:20:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-20T01:20:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-20T01:20:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-20T01:20:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-20T01:20:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-20T01:20:07.727 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.727 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.727 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:07.727 INFO:teuthology.orchestra.run.smithi022.stdout: re2-1:20211101-3.el9.x86_64 2024-08-20T01:20:07.727 INFO:teuthology.orchestra.run.smithi022.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-20T01:20:07.727 INFO:teuthology.orchestra.run.smithi022.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-20T01:20:07.727 INFO:teuthology.orchestra.run.smithi022.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-20T01:20:07.727 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-20T01:20:07.727 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-20T01:20:07.727 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-20T01:20:07.728 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:20:07.728 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-08-20T01:20:08.103 DEBUG:teuthology.parallel:result is None 2024-08-20T01:20:08.668 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T01:20:08.669 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:20:08.669 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-08-20T01:20:08.669 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.669 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.669 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-08-20T01:20:08.669 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-20T01:20:08.669 INFO:teuthology.orchestra.run.smithi134.stdout: automake-1.16.2-8.el9.noarch 2024-08-20T01:20:08.670 INFO:teuthology.orchestra.run.smithi134.stdout: bison-3.7.4-5.el9.x86_64 2024-08-20T01:20:08.670 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-20T01:20:08.670 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.670 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.670 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.670 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.670 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:08.670 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.670 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.670 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.670 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:08.670 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:08.671 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:08.671 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:08.671 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:08.671 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.671 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.671 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:08.671 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.671 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.671 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.671 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:08.671 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:08.672 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.672 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.672 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:08.672 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-20T01:20:08.672 INFO:teuthology.orchestra.run.smithi134.stdout: flex-2.6.4-9.el9.x86_64 2024-08-20T01:20:08.672 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-20T01:20:08.672 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-20T01:20:08.672 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-20T01:20:08.672 INFO:teuthology.orchestra.run.smithi134.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-20T01:20:08.672 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-20T01:20:08.673 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-20T01:20:08.673 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-20T01:20:08.673 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-20T01:20:08.673 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-20T01:20:08.673 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.673 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.673 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.673 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-20T01:20:08.673 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-20T01:20:08.673 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-20T01:20:08.674 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-20T01:20:08.674 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-20T01:20:08.674 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.674 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.674 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-20T01:20:08.674 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.674 INFO:teuthology.orchestra.run.smithi134.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-20T01:20:08.674 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-20T01:20:08.674 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-20T01:20:08.674 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-20T01:20:08.675 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-20T01:20:08.675 INFO:teuthology.orchestra.run.smithi134.stdout: lua-5.4.4-4.el9.x86_64 2024-08-20T01:20:08.675 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-20T01:20:08.675 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-20T01:20:08.675 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.26-1.el9.x86_64 2024-08-20T01:20:08.675 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp-0.3.26-1.el9.x86_64 2024-08-20T01:20:08.675 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-20T01:20:08.675 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-20T01:20:08.675 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-13.16-1.el9.x86_64 2024-08-20T01:20:08.675 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-20T01:20:08.676 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-20T01:20:08.676 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-20T01:20:08.676 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-20T01:20:08.676 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-20T01:20:08.676 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-20T01:20:08.676 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-20T01:20:08.676 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-20T01:20:08.676 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-20T01:20:08.676 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-20T01:20:08.676 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.676 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.676 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.677 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-20T01:20:08.677 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-20T01:20:08.677 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-20T01:20:08.677 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-20T01:20:08.677 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-20T01:20:08.677 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-20T01:20:08.677 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-20T01:20:08.677 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-20T01:20:08.677 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-20T01:20:08.677 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-20T01:20:08.677 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-20T01:20:08.677 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-20T01:20:08.677 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-20T01:20:08.678 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-20T01:20:08.678 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-20T01:20:08.678 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-20T01:20:08.678 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-20T01:20:08.678 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-20T01:20:08.678 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-20T01:20:08.678 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-20T01:20:08.678 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-20T01:20:08.678 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-20T01:20:08.678 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-20T01:20:08.678 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-20T01:20:08.679 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-20T01:20:08.679 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-20T01:20:08.679 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-20T01:20:08.679 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-20T01:20:08.679 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-20T01:20:08.679 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-20T01:20:08.679 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply-3.11-14.el9.noarch 2024-08-20T01:20:08.679 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-20T01:20:08.679 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-20T01:20:08.679 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-20T01:20:08.679 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-20T01:20:08.679 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-20T01:20:08.679 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-20T01:20:08.680 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-20T01:20:08.680 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-20T01:20:08.680 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-20T01:20:08.680 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.680 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.680 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-20T01:20:08.680 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-20T01:20:08.680 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-20T01:20:08.680 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.680 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-20T01:20:08.681 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-20T01:20:08.681 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-20T01:20:08.681 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-20T01:20:08.681 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-20T01:20:08.681 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-20T01:20:08.681 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-20T01:20:08.681 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-20T01:20:08.681 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-20T01:20:08.681 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-20T01:20:08.681 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-20T01:20:08.682 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-20T01:20:08.682 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-20T01:20:08.682 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-20T01:20:08.682 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-20T01:20:08.682 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.682 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.682 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:08.682 INFO:teuthology.orchestra.run.smithi134.stdout: re2-1:20211101-3.el9.x86_64 2024-08-20T01:20:08.682 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-20T01:20:08.683 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-20T01:20:08.683 INFO:teuthology.orchestra.run.smithi134.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-20T01:20:08.683 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-20T01:20:08.683 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-20T01:20:08.683 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-20T01:20:08.684 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:20:08.684 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-08-20T01:20:09.023 DEBUG:teuthology.parallel:result is None 2024-08-20T01:20:09.496 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T01:20:09.497 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-08-20T01:20:09.497 INFO:teuthology.orchestra.run.smithi077.stdout:Upgraded: 2024-08-20T01:20:09.497 INFO:teuthology.orchestra.run.smithi077.stdout: librados2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.497 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.497 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-08-20T01:20:09.497 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-20T01:20:09.497 INFO:teuthology.orchestra.run.smithi077.stdout: automake-1.16.2-8.el9.noarch 2024-08-20T01:20:09.497 INFO:teuthology.orchestra.run.smithi077.stdout: bison-3.7.4-5.el9.x86_64 2024-08-20T01:20:09.497 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-20T01:20:09.497 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:20:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-20T01:20:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: flex-2.6.4-9.el9.x86_64 2024-08-20T01:20:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-20T01:20:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-20T01:20:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-20T01:20:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-20T01:20:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-20T01:20:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-20T01:20:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-20T01:20:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-20T01:20:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-20T01:20:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-20T01:20:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-20T01:20:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-20T01:20:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-20T01:20:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-20T01:20:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-20T01:20:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-20T01:20:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-20T01:20:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-20T01:20:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-20T01:20:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-20T01:20:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: lua-5.4.4-4.el9.x86_64 2024-08-20T01:20:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-20T01:20:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-20T01:20:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-0.3.26-1.el9.x86_64 2024-08-20T01:20:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp-0.3.26-1.el9.x86_64 2024-08-20T01:20:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-20T01:20:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-20T01:20:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-13.16-1.el9.x86_64 2024-08-20T01:20:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-20T01:20:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-20T01:20:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-20T01:20:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-20T01:20:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-20T01:20:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-20T01:20:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-20T01:20:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-20T01:20:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-20T01:20:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-20T01:20:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-20T01:20:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-20T01:20:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-20T01:20:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-20T01:20:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-20T01:20:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-20T01:20:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-20T01:20:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-20T01:20:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-20T01:20:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-20T01:20:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-20T01:20:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-20T01:20:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-20T01:20:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-20T01:20:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-20T01:20:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-20T01:20:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-20T01:20:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-20T01:20:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-20T01:20:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-20T01:20:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-20T01:20:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-20T01:20:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-20T01:20:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-20T01:20:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-20T01:20:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-20T01:20:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-20T01:20:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-20T01:20:09.506 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-20T01:20:09.506 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-20T01:20:09.506 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply-3.11-14.el9.noarch 2024-08-20T01:20:09.506 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-20T01:20:09.506 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-20T01:20:09.506 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-20T01:20:09.506 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-20T01:20:09.506 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-20T01:20:09.506 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-20T01:20:09.506 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-20T01:20:09.506 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-20T01:20:09.506 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-20T01:20:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-20T01:20:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-20T01:20:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-20T01:20:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-20T01:20:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-20T01:20:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-20T01:20:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-20T01:20:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-20T01:20:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-20T01:20:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-20T01:20:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-20T01:20:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-20T01:20:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-20T01:20:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-20T01:20:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-20T01:20:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-20T01:20:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-20T01:20:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-20T01:20:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:20:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: re2-1:20211101-3.el9.x86_64 2024-08-20T01:20:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-20T01:20:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-20T01:20:09.509 INFO:teuthology.orchestra.run.smithi077.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-20T01:20:09.509 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-20T01:20:09.509 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-20T01:20:09.509 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-20T01:20:09.509 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-08-20T01:20:09.509 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-08-20T01:20:09.870 DEBUG:teuthology.parallel:result is None 2024-08-20T01:20:09.871 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:20:10.016 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-20T01:20:10.040 INFO:teuthology.orchestra.run.smithi022.stdout:19.0.0-5872.gef427541.el9 2024-08-20T01:20:10.040 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5872.gef427541.el9 2024-08-20T01:20:10.040 INFO:teuthology.task.install:The correct ceph version 19.0.0-5872.gef427541 is installed. 2024-08-20T01:20:10.042 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:20:10.189 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-20T01:20:10.210 INFO:teuthology.orchestra.run.smithi077.stdout:19.0.0-5872.gef427541.el9 2024-08-20T01:20:10.211 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5872.gef427541.el9 2024-08-20T01:20:10.211 INFO:teuthology.task.install:The correct ceph version 19.0.0-5872.gef427541 is installed. 2024-08-20T01:20:10.213 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:20:10.352 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-20T01:20:10.373 INFO:teuthology.orchestra.run.smithi134.stdout:19.0.0-5872.gef427541.el9 2024-08-20T01:20:10.373 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5872.gef427541.el9 2024-08-20T01:20:10.373 INFO:teuthology.task.install:The correct ceph version 19.0.0-5872.gef427541 is installed. 2024-08-20T01:20:10.375 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-20T01:20:10.376 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-08-20T01:20:10.376 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-20T01:20:10.406 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-08-20T01:20:10.406 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-20T01:20:10.433 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-08-20T01:20:10.433 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-20T01:20:10.460 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-20T01:20:10.460 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-08-20T01:20:10.460 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/daemon-helper 2024-08-20T01:20:10.487 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-20T01:20:10.554 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-08-20T01:20:10.554 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2024-08-20T01:20:10.580 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-20T01:20:10.645 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-08-20T01:20:10.646 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-08-20T01:20:10.671 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-20T01:20:10.735 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-20T01:20:10.736 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-08-20T01:20:10.736 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-20T01:20:10.762 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-20T01:20:10.828 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-08-20T01:20:10.828 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-20T01:20:10.852 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-20T01:20:10.917 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-08-20T01:20:10.917 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-20T01:20:10.942 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-20T01:20:11.006 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-20T01:20:11.007 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-08-20T01:20:11.007 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/stdin-killer 2024-08-20T01:20:11.032 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-20T01:20:11.097 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-08-20T01:20:11.098 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2024-08-20T01:20:11.122 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-20T01:20:11.187 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-08-20T01:20:11.187 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-08-20T01:20:11.212 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-20T01:20:11.276 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-20T01:20:11.372 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-08-20T01:20:11.372 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:20:11.373 INFO:tasks.cephadm:Cluster fsid is 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:20:11.373 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-20T01:20:11.373 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.22', 'mon.b': '172.21.15.77', 'mon.c': '172.21.15.134'} 2024-08-20T01:20:11.373 INFO:tasks.cephadm:First mon is mon.a on smithi022 2024-08-20T01:20:11.374 INFO:tasks.cephadm:First mgr is x 2024-08-20T01:20:11.374 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-20T01:20:11.374 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname $(hostname -s) 2024-08-20T01:20:11.400 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname $(hostname -s) 2024-08-20T01:20:11.427 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname $(hostname -s) 2024-08-20T01:20:11.455 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-08-20T01:20:11.455 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:20:11.596 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82210/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-5872-gef427541', 'node_name': '172.21.2.6+braggi06', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-5872.gef427541'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-08-19 17:15:28.176472', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-hemanth-testing-2024-08-19-1357', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-08-20T01:20:11.743 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-hemanth-testing-2024-08-19-1357, sha1 ef4275410d8483698016fe484b2a3c664080b4c1 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:20:11.744 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/x86_64/flavors/default/cephadm 2024-08-20T01:20:11.745 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/x86_64/flavors/default/cephadm 2024-08-20T01:20:11.745 DEBUG:teuthology.orchestra.run.smithi022:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-20T01:20:12.100 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-r--r--. 1 ubuntu ubuntu 792014 Aug 20 01:20 /home/ubuntu/cephtest/cephadm 2024-08-20T01:20:12.101 DEBUG:teuthology.orchestra.run.smithi077:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-20T01:20:12.495 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r--. 1 ubuntu ubuntu 792014 Aug 20 01:20 /home/ubuntu/cephtest/cephadm 2024-08-20T01:20:12.495 DEBUG:teuthology.orchestra.run.smithi134:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-20T01:20:12.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r--. 1 ubuntu ubuntu 792014 Aug 20 01:20 /home/ubuntu/cephtest/cephadm 2024-08-20T01:20:12.878 DEBUG:teuthology.orchestra.run.smithi022:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-20T01:20:12.898 DEBUG:teuthology.orchestra.run.smithi077:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-20T01:20:12.917 DEBUG:teuthology.orchestra.run.smithi134:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-20T01:20:12.952 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 on all hosts... 2024-08-20T01:20:12.952 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 pull 2024-08-20T01:20:12.955 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 pull 2024-08-20T01:20:12.960 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 pull 2024-08-20T01:20:14.555 INFO:teuthology.orchestra.run.smithi022.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1... 2024-08-20T01:20:14.591 INFO:teuthology.orchestra.run.smithi077.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1... 2024-08-20T01:20:14.671 INFO:teuthology.orchestra.run.smithi134.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1... 2024-08-20T01:20:42.860 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-08-20T01:20:42.860 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_version": "ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev)", 2024-08-20T01:20:42.860 INFO:teuthology.orchestra.run.smithi134.stdout: "image_id": "9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a", 2024-08-20T01:20:42.860 INFO:teuthology.orchestra.run.smithi134.stdout: "repo_digests": [ 2024-08-20T01:20:42.860 INFO:teuthology.orchestra.run.smithi134.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8" 2024-08-20T01:20:42.860 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-08-20T01:20:42.860 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-08-20T01:20:44.913 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-08-20T01:20:44.913 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev)", 2024-08-20T01:20:44.913 INFO:teuthology.orchestra.run.smithi077.stdout: "image_id": "9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a", 2024-08-20T01:20:44.913 INFO:teuthology.orchestra.run.smithi077.stdout: "repo_digests": [ 2024-08-20T01:20:44.914 INFO:teuthology.orchestra.run.smithi077.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8" 2024-08-20T01:20:44.914 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-08-20T01:20:44.914 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-08-20T01:20:46.012 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:20:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_version": "ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev)", 2024-08-20T01:20:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "image_id": "9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a", 2024-08-20T01:20:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "repo_digests": [ 2024-08-20T01:20:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8" 2024-08-20T01:20:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-08-20T01:20:46.013 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:20:46.041 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /etc/ceph 2024-08-20T01:20:46.093 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph 2024-08-20T01:20:46.126 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph 2024-08-20T01:20:46.157 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 777 /etc/ceph 2024-08-20T01:20:46.183 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /etc/ceph 2024-08-20T01:20:46.212 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /etc/ceph 2024-08-20T01:20:46.237 INFO:tasks.cephadm:Writing seed config... 2024-08-20T01:20:46.238 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-08-20T01:20:46.239 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-08-20T01:20:46.239 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-08-20T01:20:46.239 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-08-20T01:20:46.239 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-20T01:20:46.239 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-20T01:20:46.239 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-20T01:20:46.239 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-20T01:20:46.239 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-20T01:20:46.239 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-08-20T01:20:46.239 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-08-20T01:20:46.239 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-08-20T01:20:46.239 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-08-20T01:20:46.240 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-08-20T01:20:46.240 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-08-20T01:20:46.240 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-20T01:20:46.240 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-20T01:20:46.240 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-08-20T01:20:46.240 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-08-20T01:20:46.240 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-08-20T01:20:46.240 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-08-20T01:20:46.240 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-08-20T01:20:46.240 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-08-20T01:20:46.240 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-08-20T01:20:46.240 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-08-20T01:20:46.241 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-08-20T01:20:46.241 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-20T01:20:46.257 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 586fd06c-5e92-11ef-bccf-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2024-08-20T01:20:46.257 DEBUG:teuthology.orchestra.run.smithi022:mon.a> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mon.a.service 2024-08-20T01:20:46.300 DEBUG:teuthology.orchestra.run.smithi022:mgr.x> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mgr.x.service 2024-08-20T01:20:46.343 INFO:tasks.cephadm:Bootstrapping... 2024-08-20T01:20:46.343 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 -v bootstrap --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.22 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-20T01:20:46.553 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-08-20T01:20:46.553 INFO:teuthology.orchestra.run.smithi022.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', '-v', 'bootstrap', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.22', '--skip-admin-label'] 2024-08-20T01:20:46.553 INFO:teuthology.orchestra.run.smithi022.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-20T01:20:46.553 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying podman|docker is present... 2024-08-20T01:20:46.578 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stdout 5.2.1 2024-08-20T01:20:46.578 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying lvm2 is present... 2024-08-20T01:20:46.578 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying time synchronization is in place... 2024-08-20T01:20:46.586 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-20T01:20:46.586 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-20T01:20:46.592 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-20T01:20:46.592 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-08-20T01:20:46.599 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout enabled 2024-08-20T01:20:46.605 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout active 2024-08-20T01:20:46.605 INFO:teuthology.orchestra.run.smithi022.stdout:Unit chronyd.service is enabled and running 2024-08-20T01:20:46.605 INFO:teuthology.orchestra.run.smithi022.stdout:Repeating the final host check... 2024-08-20T01:20:46.628 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stdout 5.2.1 2024-08-20T01:20:46.628 INFO:teuthology.orchestra.run.smithi022.stdout:podman (/bin/podman) version 5.2.1 is present 2024-08-20T01:20:46.628 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl is present 2024-08-20T01:20:46.628 INFO:teuthology.orchestra.run.smithi022.stdout:lvcreate is present 2024-08-20T01:20:46.635 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-20T01:20:46.635 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-20T01:20:46.641 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-20T01:20:46.641 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-08-20T01:20:46.648 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout enabled 2024-08-20T01:20:46.655 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout active 2024-08-20T01:20:46.655 INFO:teuthology.orchestra.run.smithi022.stdout:Unit chronyd.service is enabled and running 2024-08-20T01:20:46.655 INFO:teuthology.orchestra.run.smithi022.stdout:Host looks OK 2024-08-20T01:20:46.655 INFO:teuthology.orchestra.run.smithi022.stdout:Cluster fsid: 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:20:46.655 INFO:teuthology.orchestra.run.smithi022.stdout:Acquiring lock 139831646265200 on /run/cephadm/586fd06c-5e92-11ef-bccf-c7b262605968.lock 2024-08-20T01:20:46.655 INFO:teuthology.orchestra.run.smithi022.stdout:Lock 139831646265200 acquired on /run/cephadm/586fd06c-5e92-11ef-bccf-c7b262605968.lock 2024-08-20T01:20:46.656 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying IP 172.21.15.22 port 3300 ... 2024-08-20T01:20:46.656 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying IP 172.21.15.22 port 6789 ... 2024-08-20T01:20:46.656 INFO:teuthology.orchestra.run.smithi022.stdout:Base mon IP(s) is [172.21.15.22:3300, 172.21.15.22:6789], mon addrv is [v2:172.21.15.22:3300,v1:172.21.15.22:6789] 2024-08-20T01:20:46.659 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.22 metric 100 2024-08-20T01:20:46.659 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.22 metric 100 2024-08-20T01:20:46.662 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-20T01:20:46.662 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-08-20T01:20:46.662 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-08-20T01:20:46.664 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-20T01:20:46.664 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-20T01:20:46.664 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-20T01:20:46.664 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-08-20T01:20:46.665 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe59:5de4/64 scope link noprefixroute 2024-08-20T01:20:46.665 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-20T01:20:46.665 INFO:teuthology.orchestra.run.smithi022.stdout:Mon IP `172.21.15.22` is in CIDR network `172.21.0.0/20` 2024-08-20T01:20:46.665 INFO:teuthology.orchestra.run.smithi022.stdout:Mon IP `172.21.15.22` is in CIDR network `172.21.0.0/20` 2024-08-20T01:20:46.665 INFO:teuthology.orchestra.run.smithi022.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-20T01:20:46.666 INFO:teuthology.orchestra.run.smithi022.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-20T01:20:46.666 INFO:teuthology.orchestra.run.smithi022.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1... 2024-08-20T01:20:47.148 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stdout 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a 2024-08-20T01:20:47.148 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1... 2024-08-20T01:20:47.148 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Getting image source signatures 2024-08-20T01:20:47.148 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Copying blob sha256:0beb2e0cf0f87d34a70e3776822a6ff39fafdc5a4d91bc4481cb39d566d52b0d 2024-08-20T01:20:47.148 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-08-20T01:20:47.148 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Copying config sha256:9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a 2024-08-20T01:20:47.148 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Writing manifest to image destination 2024-08-20T01:20:48.062 INFO:teuthology.orchestra.run.smithi022.stdout:ceph: stdout ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev) 2024-08-20T01:20:48.062 INFO:teuthology.orchestra.run.smithi022.stdout:Ceph version: ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev) 2024-08-20T01:20:48.062 INFO:teuthology.orchestra.run.smithi022.stdout:Extracting ceph user uid/gid from container image... 2024-08-20T01:20:49.025 INFO:teuthology.orchestra.run.smithi022.stdout:stat: stdout 167 167 2024-08-20T01:20:49.026 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial keys... 2024-08-20T01:20:49.939 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQBx78Nm9zgoFhAARuHQoVACg3W0qiP/mPr3DQ== 2024-08-20T01:20:50.895 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQBy78Nm2q7oEBAAhu8Eo0nYzJmyiNIpxs9KOw== 2024-08-20T01:20:51.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQBz78NmN8G4DBAAoN4bTMvJ9WILnA8rYXwsuw== 2024-08-20T01:20:51.793 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial monmap... 2024-08-20T01:20:52.648 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-20T01:20:52.648 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-08-20T01:20:52.649 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:20:52.649 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-20T01:20:52.649 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool for a [v2:172.21.15.22:3300,v1:172.21.15.22:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-20T01:20:52.649 INFO:teuthology.orchestra.run.smithi022.stdout:setting min_mon_release = quincy 2024-08-20T01:20:52.649 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: set fsid to 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:20:52.649 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-20T01:20:52.649 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:20:52.649 INFO:teuthology.orchestra.run.smithi022.stdout:Creating mon... 2024-08-20T01:20:53.554 INFO:teuthology.orchestra.run.smithi022.stdout:create mon.a on 2024-08-20T01:20:53.772 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-08-20T01:20:53.919 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-08-20T01:20:54.091 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-586fd06c-5e92-11ef-bccf-c7b262605968.target → /etc/systemd/system/ceph-586fd06c-5e92-11ef-bccf-c7b262605968.target. 2024-08-20T01:20:54.092 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-586fd06c-5e92-11ef-bccf-c7b262605968.target → /etc/systemd/system/ceph-586fd06c-5e92-11ef-bccf-c7b262605968.target. 2024-08-20T01:20:54.352 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mon.a 2024-08-20T01:20:54.352 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to reset failed state of unit ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mon.a.service: Unit ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mon.a.service not loaded. 2024-08-20T01:20:54.535 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-586fd06c-5e92-11ef-bccf-c7b262605968.target.wants/ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mon.a.service → /etc/systemd/system/ceph-586fd06c-5e92-11ef-bccf-c7b262605968@.service. 2024-08-20T01:20:54.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:20:54 smithi022 podman[18318]: 2024-08-20 01:20:54.805473859 +0000 UTC m=+0.134799846 container create af386affcf243dfe99d44234eef2910266e422a1aece1d22147b6d272fce2a15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-a, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-20T01:20:55.105 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-20T01:20:55.105 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-08-20T01:20:55.114 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-20T01:20:55.114 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-08-20T01:20:55.114 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-08-20T01:20:55.114 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to enable service . firewalld.service is not available 2024-08-20T01:20:55.115 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mon to start... 2024-08-20T01:20:55.115 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mon... 2024-08-20T01:20:55.232 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:20:55 smithi022 podman[18318]: 2024-08-20 01:20:55.02425723 +0000 UTC m=+0.353583217 container init af386affcf243dfe99d44234eef2910266e422a1aece1d22147b6d272fce2a15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-a, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux ) 2024-08-20T01:20:55.232 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:20:55 smithi022 podman[18318]: 2024-08-20 01:20:55.027848788 +0000 UTC m=+0.357174776 container start af386affcf243dfe99d44234eef2910266e422a1aece1d22147b6d272fce2a15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-a, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-08-20T01:20:55.232 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:20:55 smithi022 ceph-mon[18338]: mkfs 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:20:55.232 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:20:55 smithi022 ceph-mon[18338]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-20T01:20:55.232 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:20:55 smithi022 bash[18318]: af386affcf243dfe99d44234eef2910266e422a1aece1d22147b6d272fce2a15 2024-08-20T01:20:55.232 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:20:55 smithi022 systemd[1]: Started Ceph mon.a for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:20:56.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:20:56 smithi022 ceph-mon[18338]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-20T01:20:56.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:20:56 smithi022 ceph-mon[18338]: monmap epoch 1 2024-08-20T01:20:56.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:20:56 smithi022 ceph-mon[18338]: fsid 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:20:56.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:20:56 smithi022 ceph-mon[18338]: last_changed 2024-08-20T01:20:52.092445+0000 2024-08-20T01:20:56.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:20:56 smithi022 ceph-mon[18338]: created 2024-08-20T01:20:52.092445+0000 2024-08-20T01:20:56.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:20:56 smithi022 ceph-mon[18338]: min_mon_release 19 (squid) 2024-08-20T01:20:56.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:20:56 smithi022 ceph-mon[18338]: election_strategy: 1 2024-08-20T01:20:56.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:20:56 smithi022 ceph-mon[18338]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-08-20T01:20:56.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:20:56 smithi022 ceph-mon[18338]: fsmap 2024-08-20T01:20:56.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:20:56 smithi022 ceph-mon[18338]: osdmap e1: 0 total, 0 up, 0 in 2024-08-20T01:20:56.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:20:56 smithi022 ceph-mon[18338]: mgrmap e1: no daemons active 2024-08-20T01:20:56.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:20:56 smithi022 ceph-mon[18338]: from='client.? 172.21.15.22:0/1757983214' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-08-20T01:21:00.586 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout cluster: 2024-08-20T01:21:00.586 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout id: 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:21:00.586 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-20T01:21:00.586 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-08-20T01:21:00.586 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout services: 2024-08-20T01:21:00.586 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.565485s) 2024-08-20T01:21:00.587 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-20T01:21:00.587 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-20T01:21:00.587 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-08-20T01:21:00.587 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout data: 2024-08-20T01:21:00.587 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-20T01:21:00.587 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-20T01:21:00.587 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-20T01:21:00.587 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout pgs: 2024-08-20T01:21:00.587 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-08-20T01:21:00.587 INFO:teuthology.orchestra.run.smithi022.stdout:mon is available 2024-08-20T01:21:00.587 INFO:teuthology.orchestra.run.smithi022.stdout:Assimilating anything we can from ceph.conf... 2024-08-20T01:21:03.884 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:03 smithi022 ceph-mon[18338]: from='client.? 172.21.15.22:0/2283613766' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-20T01:21:03.884 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:03 smithi022 ceph-mon[18338]: from='client.? 172.21.15.22:0/2283613766' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-20T01:21:07.776 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-08-20T01:21:07.776 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [global] 2024-08-20T01:21:07.776 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout fsid = 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:21:07.776 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-20T01:21:07.776 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.22:3300,v1:172.21.15.22:6789] 2024-08-20T01:21:07.776 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-20T01:21:07.776 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-20T01:21:07.776 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-20T01:21:07.776 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-20T01:21:07.777 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-08-20T01:21:07.777 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-20T01:21:07.777 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-20T01:21:07.777 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-08-20T01:21:07.777 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [osd] 2024-08-20T01:21:07.777 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-20T01:21:07.777 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-20T01:21:07.777 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-20T01:21:07.777 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-20T01:21:07.777 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-20T01:21:07.777 INFO:teuthology.orchestra.run.smithi022.stdout:Generating new minimal ceph.conf... 2024-08-20T01:21:08.634 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:08 smithi022 ceph-mon[18338]: from='client.? 172.21.15.22:0/1541699389' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:21:08.831 INFO:teuthology.orchestra.run.smithi022.stdout:Restarting the monitor... 2024-08-20T01:21:09.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:08 smithi022 systemd[1]: Stopping Ceph mon.a for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:21:09.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:09 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-a[18334]: 2024-08-20T01:21:09.107+0000 7fa17cd22640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:21:09.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:09 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-a[18334]: 2024-08-20T01:21:09.107+0000 7fa17cd22640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-08-20T01:21:09.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:09 smithi022 podman[18584]: 2024-08-20 01:21:09.1995384 +0000 UTC m=+0.196862432 container died af386affcf243dfe99d44234eef2910266e422a1aece1d22147b6d272fce2a15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-20T01:21:09.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:09 smithi022 podman[18584]: 2024-08-20 01:21:09.515579719 +0000 UTC m=+0.512903744 container cleanup af386affcf243dfe99d44234eef2910266e422a1aece1d22147b6d272fce2a15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:21:09.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:09 smithi022 bash[18584]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-a 2024-08-20T01:21:09.961 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:09 smithi022 podman[18596]: 2024-08-20 01:21:09.691599503 +0000 UTC m=+0.490863945 container remove af386affcf243dfe99d44234eef2910266e422a1aece1d22147b6d272fce2a15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-08-20T01:21:09.962 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:09 smithi022 systemd[1]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mon.a.service: Deactivated successfully. 2024-08-20T01:21:09.962 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:09 smithi022 systemd[1]: Stopped Ceph mon.a for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:21:09.962 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:09 smithi022 systemd[1]: Starting Ceph mon.a for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:21:10.239 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 podman[18690]: 2024-08-20 01:21:10.14264433 +0000 UTC m=+0.109951384 container create 932e0d46c08c5d2aca2b6a5170f889ff3a99242fac979419a1abe6294e8eb3fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0) 2024-08-20T01:21:10.239 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 podman[18690]: 2024-08-20 01:21:10.060773169 +0000 UTC m=+0.028080191 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:21:10.430 INFO:teuthology.orchestra.run.smithi022.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-20T01:21:10.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 podman[18690]: 2024-08-20 01:21:10.3365666 +0000 UTC m=+0.303873612 container init 932e0d46c08c5d2aca2b6a5170f889ff3a99242fac979419a1abe6294e8eb3fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-a, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-08-20T01:21:10.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 podman[18690]: 2024-08-20 01:21:10.33973391 +0000 UTC m=+0.307040923 container start 932e0d46c08c5d2aca2b6a5170f889ff3a99242fac979419a1abe6294e8eb3fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.36.0) 2024-08-20T01:21:10.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: set uid:gid to 167:167 (ceph:ceph) 2024-08-20T01:21:10.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev), process ceph-mon, pid 2 2024-08-20T01:21:10.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: pidfile_write: ignore empty --pid-file 2024-08-20T01:21:10.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: load: jerasure load: lrc 2024-08-20T01:21:10.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: RocksDB version: 7.9.2 2024-08-20T01:21:10.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Git sha 0 2024-08-20T01:21:10.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Compile date 2024-08-19 15:50:59 2024-08-20T01:21:10.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: DB SUMMARY 2024-08-20T01:21:10.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: DB Session ID: J6PMRLA4YR1R5746CR0E 2024-08-20T01:21:10.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: CURRENT file: CURRENT 2024-08-20T01:21:10.554 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: IDENTITY file: IDENTITY 2024-08-20T01:21:10.554 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-08-20T01:21:10.554 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-08-20T01:21:10.554 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94967 ; 2024-08-20T01:21:10.554 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.error_if_exists: 0 2024-08-20T01:21:10.554 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.create_if_missing: 0 2024-08-20T01:21:10.554 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.paranoid_checks: 1 2024-08-20T01:21:10.554 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-20T01:21:10.554 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-20T01:21:10.554 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-20T01:21:10.554 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.env: 0x562ccdbbfbe0 2024-08-20T01:21:10.554 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.fs: PosixFileSystem 2024-08-20T01:21:10.554 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.info_log: 0x562cd01f5700 2024-08-20T01:21:10.554 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_file_opening_threads: 16 2024-08-20T01:21:10.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.statistics: (nil) 2024-08-20T01:21:10.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.use_fsync: 0 2024-08-20T01:21:10.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_log_file_size: 0 2024-08-20T01:21:10.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-20T01:21:10.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-20T01:21:10.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.keep_log_file_num: 1000 2024-08-20T01:21:10.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.recycle_log_file_num: 0 2024-08-20T01:21:10.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.allow_fallocate: 1 2024-08-20T01:21:10.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.allow_mmap_reads: 0 2024-08-20T01:21:10.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.allow_mmap_writes: 0 2024-08-20T01:21:10.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.use_direct_reads: 0 2024-08-20T01:21:10.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-20T01:21:10.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.create_missing_column_families: 0 2024-08-20T01:21:10.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.db_log_dir: 2024-08-20T01:21:10.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.wal_dir: 2024-08-20T01:21:10.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-20T01:21:10.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-20T01:21:10.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-20T01:21:10.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-20T01:21:10.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-20T01:21:10.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-20T01:21:10.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.advise_random_on_open: 1 2024-08-20T01:21:10.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.db_write_buffer_size: 0 2024-08-20T01:21:10.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.write_buffer_manager: 0x562cd01f8e60 2024-08-20T01:21:10.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-20T01:21:10.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-20T01:21:10.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-20T01:21:10.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.rate_limiter: (nil) 2024-08-20T01:21:10.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-20T01:21:10.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.wal_recovery_mode: 2 2024-08-20T01:21:10.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.enable_thread_tracking: 0 2024-08-20T01:21:10.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.enable_pipelined_write: 0 2024-08-20T01:21:10.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.unordered_write: 0 2024-08-20T01:21:10.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-20T01:21:10.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-20T01:21:10.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-20T01:21:10.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-20T01:21:10.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.row_cache: None 2024-08-20T01:21:10.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.wal_filter: None 2024-08-20T01:21:10.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-20T01:21:10.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.allow_ingest_behind: 0 2024-08-20T01:21:10.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.two_write_queues: 0 2024-08-20T01:21:10.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.manual_wal_flush: 0 2024-08-20T01:21:10.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.wal_compression: 0 2024-08-20T01:21:10.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.atomic_flush: 0 2024-08-20T01:21:10.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-20T01:21:10.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-20T01:21:10.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-20T01:21:10.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.log_readahead_size: 0 2024-08-20T01:21:10.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-20T01:21:10.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.best_efforts_recovery: 0 2024-08-20T01:21:10.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-20T01:21:10.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-20T01:21:10.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.allow_data_in_errors: 0 2024-08-20T01:21:10.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.db_host_id: __hostname__ 2024-08-20T01:21:10.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-20T01:21:10.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_background_jobs: 2 2024-08-20T01:21:10.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_background_compactions: -1 2024-08-20T01:21:10.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_subcompactions: 1 2024-08-20T01:21:10.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-20T01:21:10.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-20T01:21:10.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-20T01:21:10.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_total_wal_size: 0 2024-08-20T01:21:10.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-20T01:21:10.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-20T01:21:10.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-20T01:21:10.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-20T01:21:10.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_open_files: -1 2024-08-20T01:21:10.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.bytes_per_sync: 0 2024-08-20T01:21:10.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-20T01:21:10.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-20T01:21:10.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compaction_readahead_size: 0 2024-08-20T01:21:10.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_background_flushes: -1 2024-08-20T01:21:10.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Compression algorithms supported: 2024-08-20T01:21:10.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: kZSTD supported: 0 2024-08-20T01:21:10.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: kXpressCompression supported: 0 2024-08-20T01:21:10.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: kBZip2Compression supported: 0 2024-08-20T01:21:10.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-20T01:21:10.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: kLZ4Compression supported: 1 2024-08-20T01:21:10.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: kZlibCompression supported: 1 2024-08-20T01:21:10.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: kLZ4HCCompression supported: 1 2024-08-20T01:21:10.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: kSnappyCompression supported: 1 2024-08-20T01:21:10.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-20T01:21:10.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-20T01:21:10.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-08-20T01:21:10.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-20T01:21:10.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-20T01:21:10.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.merge_operator: 2024-08-20T01:21:10.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compaction_filter: None 2024-08-20T01:21:10.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compaction_filter_factory: None 2024-08-20T01:21:10.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.sst_partitioner_factory: None 2024-08-20T01:21:10.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-20T01:21:10.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-20T01:21:10.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562cd01f5380) 2024-08-20T01:21:10.563 INFO:journalctl@ceph.mon.a.smithi022.stdout: cache_index_and_filter_blocks: 1 2024-08-20T01:21:10.563 INFO:journalctl@ceph.mon.a.smithi022.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-20T01:21:10.563 INFO:journalctl@ceph.mon.a.smithi022.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-20T01:21:10.563 INFO:journalctl@ceph.mon.a.smithi022.stdout: pin_top_level_index_and_filter: 1 2024-08-20T01:21:10.563 INFO:journalctl@ceph.mon.a.smithi022.stdout: index_type: 0 2024-08-20T01:21:10.563 INFO:journalctl@ceph.mon.a.smithi022.stdout: data_block_index_type: 0 2024-08-20T01:21:10.563 INFO:journalctl@ceph.mon.a.smithi022.stdout: index_shortening: 1 2024-08-20T01:21:10.563 INFO:journalctl@ceph.mon.a.smithi022.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-20T01:21:10.563 INFO:journalctl@ceph.mon.a.smithi022.stdout: checksum: 4 2024-08-20T01:21:10.564 INFO:journalctl@ceph.mon.a.smithi022.stdout: no_block_cache: 0 2024-08-20T01:21:10.564 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache: 0x562cd01e9610 2024-08-20T01:21:10.564 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache_name: BinnedLRUCache 2024-08-20T01:21:10.564 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache_options: 2024-08-20T01:21:10.564 INFO:journalctl@ceph.mon.a.smithi022.stdout: capacity : 536870912 2024-08-20T01:21:10.564 INFO:journalctl@ceph.mon.a.smithi022.stdout: num_shard_bits : 4 2024-08-20T01:21:10.564 INFO:journalctl@ceph.mon.a.smithi022.stdout: strict_capacity_limit : 0 2024-08-20T01:21:10.564 INFO:journalctl@ceph.mon.a.smithi022.stdout: high_pri_pool_ratio: 0.000 2024-08-20T01:21:10.564 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache_compressed: (nil) 2024-08-20T01:21:10.564 INFO:journalctl@ceph.mon.a.smithi022.stdout: persistent_cache: (nil) 2024-08-20T01:21:10.564 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_size: 4096 2024-08-20T01:21:10.564 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_size_deviation: 10 2024-08-20T01:21:10.564 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_restart_interval: 16 2024-08-20T01:21:10.564 INFO:journalctl@ceph.mon.a.smithi022.stdout: index_block_restart_interval: 1 2024-08-20T01:21:10.565 INFO:journalctl@ceph.mon.a.smithi022.stdout: metadata_block_size: 4096 2024-08-20T01:21:10.565 INFO:journalctl@ceph.mon.a.smithi022.stdout: partition_filters: 0 2024-08-20T01:21:10.565 INFO:journalctl@ceph.mon.a.smithi022.stdout: use_delta_encoding: 1 2024-08-20T01:21:10.565 INFO:journalctl@ceph.mon.a.smithi022.stdout: filter_policy: bloomfilter 2024-08-20T01:21:10.565 INFO:journalctl@ceph.mon.a.smithi022.stdout: whole_key_filtering: 1 2024-08-20T01:21:10.565 INFO:journalctl@ceph.mon.a.smithi022.stdout: verify_compression: 0 2024-08-20T01:21:10.565 INFO:journalctl@ceph.mon.a.smithi022.stdout: read_amp_bytes_per_bit: 0 2024-08-20T01:21:10.565 INFO:journalctl@ceph.mon.a.smithi022.stdout: format_version: 5 2024-08-20T01:21:10.565 INFO:journalctl@ceph.mon.a.smithi022.stdout: enable_index_compression: 1 2024-08-20T01:21:10.565 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_align: 0 2024-08-20T01:21:10.565 INFO:journalctl@ceph.mon.a.smithi022.stdout: max_auto_readahead_size: 262144 2024-08-20T01:21:10.565 INFO:journalctl@ceph.mon.a.smithi022.stdout: prepopulate_block_cache: 0 2024-08-20T01:21:10.565 INFO:journalctl@ceph.mon.a.smithi022.stdout: initial_auto_readahead_size: 8192 2024-08-20T01:21:10.565 INFO:journalctl@ceph.mon.a.smithi022.stdout: num_file_reads_for_auto_readahead: 2 2024-08-20T01:21:10.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.write_buffer_size: 33554432 2024-08-20T01:21:10.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_write_buffer_number: 2 2024-08-20T01:21:10.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compression: NoCompression 2024-08-20T01:21:10.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.bottommost_compression: Disabled 2024-08-20T01:21:10.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.prefix_extractor: nullptr 2024-08-20T01:21:10.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-20T01:21:10.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.num_levels: 7 2024-08-20T01:21:10.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-20T01:21:10.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-20T01:21:10.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-20T01:21:10.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-20T01:21:10.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-20T01:21:10.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-20T01:21:10.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-20T01:21:10.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-20T01:21:10.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-20T01:21:10.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-20T01:21:10.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-20T01:21:10.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-20T01:21:10.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-20T01:21:10.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compression_opts.level: 32767 2024-08-20T01:21:10.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compression_opts.strategy: 0 2024-08-20T01:21:10.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-20T01:21:10.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-20T01:21:10.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-20T01:21:10.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-20T01:21:10.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compression_opts.enabled: false 2024-08-20T01:21:10.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-20T01:21:10.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-20T01:21:10.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-20T01:21:10.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-20T01:21:10.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.target_file_size_base: 67108864 2024-08-20T01:21:10.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-20T01:21:10.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-20T01:21:10.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-20T01:21:10.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-20T01:21:10.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-20T01:21:10.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-20T01:21:10.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-20T01:21:10.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-20T01:21:10.569 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-20T01:21:10.569 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-20T01:21:10.569 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-20T01:21:10.569 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-20T01:21:10.569 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-20T01:21:10.569 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-20T01:21:10.569 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.arena_block_size: 1048576 2024-08-20T01:21:10.569 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-20T01:21:10.569 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-20T01:21:10.569 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.disable_auto_compactions: 0 2024-08-20T01:21:10.569 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-20T01:21:10.569 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-20T01:21:10.569 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-20T01:21:10.569 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-20T01:21:10.569 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-20T01:21:10.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-20T01:21:10.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-20T01:21:10.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-20T01:21:10.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-20T01:21:10.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-20T01:21:10.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-20T01:21:10.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.inplace_update_support: 0 2024-08-20T01:21:10.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-20T01:21:10.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-20T01:21:10.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-20T01:21:10.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-20T01:21:10.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.bloom_locality: 0 2024-08-20T01:21:10.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.max_successive_merges: 0 2024-08-20T01:21:10.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-20T01:21:10.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.paranoid_file_checks: 0 2024-08-20T01:21:10.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.force_consistency_checks: 1 2024-08-20T01:21:10.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.report_bg_io_stats: 0 2024-08-20T01:21:10.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.ttl: 2592000 2024-08-20T01:21:10.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-20T01:21:10.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-20T01:21:10.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-20T01:21:10.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.enable_blob_files: false 2024-08-20T01:21:10.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.min_blob_size: 0 2024-08-20T01:21:10.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.blob_file_size: 268435456 2024-08-20T01:21:10.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-20T01:21:10.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-20T01:21:10.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-20T01:21:10.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-20T01:21:10.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-20T01:21:10.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.blob_file_starting_level: 0 2024-08-20T01:21:10.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-20T01:21:10.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-08-20T01:21:10.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-08-20T01:21:10.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 63ae4008-6552-4afc-93cc-746b36adae34 2024-08-20T01:21:10.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724116870366830, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-08-20T01:21:10.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-08-20T01:21:10.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724116870367787, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91118, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 282, "table_properties": {"data_size": 89166, "index_size": 272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11619, "raw_average_key_size": 48, "raw_value_size": 82640, "raw_average_value_size": 342, "num_data_blocks": 12, "num_entries": 241, "num_filter_entries": 241, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724116870, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "63ae4008-6552-4afc-93cc-746b36adae34", "db_session_id": "J6PMRLA4YR1R5746CR0E", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-08-20T01:21:10.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724116870367896, "job": 1, "event": "recovery_finished"} 2024-08-20T01:21:10.573 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-08-20T01:21:10.573 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-20T01:21:10.573 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562cd0218e00 2024-08-20T01:21:10.573 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: DB pointer 0x562cd0316000 2024-08-20T01:21:10.573 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-20T01:21:10.573 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-20T01:21:10.573 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** DB Stats ** 2024-08-20T01:21:10.573 INFO:journalctl@ceph.mon.a.smithi022.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-20T01:21:10.573 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-20T01:21:10.573 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-20T01:21:10.573 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-20T01:21:10.573 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-20T01:21:10.573 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-20T01:21:10.574 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-20T01:21:10.574 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-08-20T01:21:10.574 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** Compaction Stats [default] ** 2024-08-20T01:21:10.574 INFO:journalctl@ceph.mon.a.smithi022.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-20T01:21:10.574 INFO:journalctl@ceph.mon.a.smithi022.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-20T01:21:10.574 INFO:journalctl@ceph.mon.a.smithi022.stdout: L0 2/0 90.84 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-20T01:21:10.574 INFO:journalctl@ceph.mon.a.smithi022.stdout: Sum 2/0 90.84 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-20T01:21:10.574 INFO:journalctl@ceph.mon.a.smithi022.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-20T01:21:10.574 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-08-20T01:21:10.574 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** Compaction Stats [default] ** 2024-08-20T01:21:10.574 INFO:journalctl@ceph.mon.a.smithi022.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-20T01:21:10.574 INFO:journalctl@ceph.mon.a.smithi022.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-20T01:21:10.574 INFO:journalctl@ceph.mon.a.smithi022.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 147.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-20T01:21:10.575 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-08-20T01:21:10.575 INFO:journalctl@ceph.mon.a.smithi022.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-20T01:21:10.575 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-08-20T01:21:10.575 INFO:journalctl@ceph.mon.a.smithi022.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-20T01:21:10.575 INFO:journalctl@ceph.mon.a.smithi022.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-20T01:21:10.575 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-20T01:21:10.575 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-20T01:21:10.575 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-20T01:21:10.575 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-20T01:21:10.575 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative compaction: 0.00 GB write, 27.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-20T01:21:10.575 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval compaction: 0.00 GB write, 27.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-20T01:21:10.575 INFO:journalctl@ceph.mon.a.smithi022.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-20T01:21:10.575 INFO:journalctl@ceph.mon.a.smithi022.stdout: Block cache BinnedLRUCache@0x562cd01e9610#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-20T01:21:10.575 INFO:journalctl@ceph.mon.a.smithi022.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-08-20T01:21:10.576 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-08-20T01:21:10.576 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-20T01:21:10.576 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: starting mon.a rank 0 at public addrs [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] at bind addrs [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:21:10.576 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: mon.a@-1(???) e1 preinit fsid 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:21:10.576 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: mon.a@-1(???).mds e1 new map 2024-08-20T01:21:10.576 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: mon.a@-1(???).mds e1 print_map 2024-08-20T01:21:10.576 INFO:journalctl@ceph.mon.a.smithi022.stdout: e1 2024-08-20T01:21:10.576 INFO:journalctl@ceph.mon.a.smithi022.stdout: btime 2024-08-20T01:20:55:065563+0000 2024-08-20T01:21:10.576 INFO:journalctl@ceph.mon.a.smithi022.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-20T01:21:10.576 INFO:journalctl@ceph.mon.a.smithi022.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-20T01:21:10.576 INFO:journalctl@ceph.mon.a.smithi022.stdout: legacy client fscid: -1 2024-08-20T01:21:10.576 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-08-20T01:21:10.577 INFO:journalctl@ceph.mon.a.smithi022.stdout: No filesystems configured 2024-08-20T01:21:10.577 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-20T01:21:10.577 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T01:21:10.577 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T01:21:10.577 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T01:21:10.577 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-20T01:21:10.577 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-20T01:21:10.577 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: monmap epoch 1 2024-08-20T01:21:10.577 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: fsid 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:21:10.577 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: last_changed 2024-08-20T01:20:52.092445+0000 2024-08-20T01:21:10.577 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: created 2024-08-20T01:20:52.092445+0000 2024-08-20T01:21:10.577 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: min_mon_release 19 (squid) 2024-08-20T01:21:10.577 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: election_strategy: 1 2024-08-20T01:21:10.577 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-08-20T01:21:10.578 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: fsmap 2024-08-20T01:21:10.578 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: osdmap e1: 0 total, 0 up, 0 in 2024-08-20T01:21:10.578 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 ceph-mon[18709]: mgrmap e1: no daemons active 2024-08-20T01:21:10.578 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 bash[18690]: 932e0d46c08c5d2aca2b6a5170f889ff3a99242fac979419a1abe6294e8eb3fc 2024-08-20T01:21:10.578 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:10 smithi022 systemd[1]: Started Ceph mon.a for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:21:11.436 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-20T01:21:11.457 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-20T01:21:11.458 INFO:teuthology.orchestra.run.smithi022.stdout:Creating mgr... 2024-08-20T01:21:11.458 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-20T01:21:11.459 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-20T01:21:11.721 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mgr.x 2024-08-20T01:21:11.721 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to reset failed state of unit ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mgr.x.service: Unit ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mgr.x.service not loaded. 2024-08-20T01:21:11.873 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-586fd06c-5e92-11ef-bccf-c7b262605968.target.wants/ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-586fd06c-5e92-11ef-bccf-c7b262605968@.service. 2024-08-20T01:21:12.232 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:11 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3431576094' entity='client.admin' 2024-08-20T01:21:12.401 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-20T01:21:12.401 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-08-20T01:21:12.409 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-20T01:21:12.409 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-08-20T01:21:12.409 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-08-20T01:21:12.409 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to enable service . firewalld.service is not available 2024-08-20T01:21:12.419 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-20T01:21:12.419 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-08-20T01:21:12.427 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-20T01:21:12.427 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-08-20T01:21:12.428 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-08-20T01:21:12.428 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-08-20T01:21:12.428 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr to start... 2024-08-20T01:21:12.428 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr... 2024-08-20T01:21:12.539 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:12 smithi022 systemd[1]: Started Ceph mgr.x for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:21:14.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:14 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1231500487' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-20T01:21:15.668 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-08-20T01:21:15.668 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-08-20T01:21:15.668 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "586fd06c-5e92-11ef-bccf-c7b262605968", 2024-08-20T01:21:15.668 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2024-08-20T01:21:15.668 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-20T01:21:15.668 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-20T01:21:15.668 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-20T01:21:15.668 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:15.668 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-20T01:21:15.668 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-20T01:21:15.668 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2024-08-20T01:21:15.669 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-08-20T01:21:15.669 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-20T01:21:15.669 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2024-08-20T01:21:15.669 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-08-20T01:21:15.669 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-08-20T01:21:15.669 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-20T01:21:15.669 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:21:15.669 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-20T01:21:15.669 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-20T01:21:15.669 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:15.669 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-20T01:21:15.669 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:21:15.669 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-20T01:21:15.669 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-20T01:21:15.670 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-20T01:21:15.670 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-20T01:21:15.670 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-20T01:21:15.670 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-20T01:21:15.670 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:15.670 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-20T01:21:15.670 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-20T01:21:15.670 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-20T01:21:15.670 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-20T01:21:15.670 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-20T01:21:15.670 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-20T01:21:15.670 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-20T01:21:15.670 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-20T01:21:15.670 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-20T01:21:15.671 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:15.671 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-20T01:21:15.671 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:21:15.671 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "btime": "2024-08-20T01:20:55:065563+0000", 2024-08-20T01:21:15.671 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-20T01:21:15.671 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-20T01:21:15.671 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:15.671 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-20T01:21:15.671 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-20T01:21:15.671 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-20T01:21:15.671 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-20T01:21:15.671 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-20T01:21:15.671 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-20T01:21:15.671 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2024-08-20T01:21:15.672 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-08-20T01:21:15.672 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-20T01:21:15.672 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:15.672 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-20T01:21:15.672 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:21:15.672 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2024-08-20T01:20:55.066225+0000", 2024-08-20T01:21:15.672 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-20T01:21:15.672 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:15.672 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-20T01:21:15.672 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-08-20T01:21:15.672 INFO:teuthology.orchestra.run.smithi022.stdout:mgr not available, waiting (1/15)... 2024-08-20T01:21:17.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:17 smithi022 ceph-mon[18709]: Activating manager daemon x 2024-08-20T01:21:17.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:17 smithi022 ceph-mon[18709]: mgrmap e2: x(active, starting, since 0.00328946s) 2024-08-20T01:21:17.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:17 smithi022 ceph-mon[18709]: from='mgr.14100 172.21.15.22:0/888330402' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-20T01:21:17.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:17 smithi022 ceph-mon[18709]: from='mgr.14100 172.21.15.22:0/888330402' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-20T01:21:17.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:17 smithi022 ceph-mon[18709]: from='mgr.14100 172.21.15.22:0/888330402' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-20T01:21:17.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:17 smithi022 ceph-mon[18709]: from='mgr.14100 172.21.15.22:0/888330402' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:21:17.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:17 smithi022 ceph-mon[18709]: from='mgr.14100 172.21.15.22:0/888330402' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-20T01:21:17.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:17 smithi022 ceph-mon[18709]: Manager daemon x is now available 2024-08-20T01:21:17.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:17 smithi022 ceph-mon[18709]: from='mgr.14100 172.21.15.22:0/888330402' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-20T01:21:17.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:17 smithi022 ceph-mon[18709]: from='mgr.14100 172.21.15.22:0/888330402' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-20T01:21:17.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:17 smithi022 ceph-mon[18709]: from='mgr.14100 172.21.15.22:0/888330402' entity='mgr.x' 2024-08-20T01:21:17.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:17 smithi022 ceph-mon[18709]: from='mgr.14100 172.21.15.22:0/888330402' entity='mgr.x' 2024-08-20T01:21:17.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:17 smithi022 ceph-mon[18709]: from='mgr.14100 172.21.15.22:0/888330402' entity='mgr.x' 2024-08-20T01:21:18.711 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-08-20T01:21:18.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-08-20T01:21:18.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "586fd06c-5e92-11ef-bccf-c7b262605968", 2024-08-20T01:21:18.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2024-08-20T01:21:18.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-20T01:21:18.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-20T01:21:18.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-20T01:21:18.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:18.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-20T01:21:18.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-20T01:21:18.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2024-08-20T01:21:18.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-08-20T01:21:18.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-20T01:21:18.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2024-08-20T01:21:18.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-08-20T01:21:18.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-08-20T01:21:18.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-20T01:21:18.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:21:18.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-20T01:21:18.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-20T01:21:18.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:18.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-20T01:21:18.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:21:18.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-20T01:21:18.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-20T01:21:18.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-20T01:21:18.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-20T01:21:18.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-20T01:21:18.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-20T01:21:18.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:18.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-20T01:21:18.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-20T01:21:18.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-20T01:21:18.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-20T01:21:18.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-20T01:21:18.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-20T01:21:18.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-20T01:21:18.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-20T01:21:18.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-20T01:21:18.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:18.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-20T01:21:18.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:21:18.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "btime": "2024-08-20T01:20:55:065563+0000", 2024-08-20T01:21:18.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-20T01:21:18.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-20T01:21:18.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:18.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-20T01:21:18.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-20T01:21:18.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-20T01:21:18.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-20T01:21:18.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-20T01:21:18.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-20T01:21:18.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2024-08-20T01:21:18.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-08-20T01:21:18.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-20T01:21:18.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:18.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-20T01:21:18.719 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:21:18.719 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2024-08-20T01:20:55.066225+0000", 2024-08-20T01:21:18.719 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-20T01:21:18.719 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:18.719 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-20T01:21:18.719 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-08-20T01:21:18.719 INFO:teuthology.orchestra.run.smithi022.stdout:mgr not available, waiting (2/15)... 2024-08-20T01:21:19.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:18 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3409130378' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-20T01:21:19.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:18 smithi022 ceph-mon[18709]: mgrmap e3: x(active, since 1.00649s) 2024-08-20T01:21:21.026 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:20 smithi022 ceph-mon[18709]: mgrmap e4: x(active, since 2s) 2024-08-20T01:21:21.867 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-08-20T01:21:21.868 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-08-20T01:21:21.868 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "586fd06c-5e92-11ef-bccf-c7b262605968", 2024-08-20T01:21:21.868 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2024-08-20T01:21:21.868 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-20T01:21:21.868 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-20T01:21:21.868 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-20T01:21:21.868 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:21.868 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-20T01:21:21.868 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-20T01:21:21.868 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2024-08-20T01:21:21.868 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-08-20T01:21:21.868 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-20T01:21:21.869 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2024-08-20T01:21:21.869 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-08-20T01:21:21.869 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-08-20T01:21:21.869 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-20T01:21:21.869 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:21:21.869 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-20T01:21:21.869 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-20T01:21:21.869 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:21.869 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-20T01:21:21.869 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:21:21.869 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-20T01:21:21.869 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-20T01:21:21.869 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-20T01:21:21.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-20T01:21:21.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-20T01:21:21.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-20T01:21:21.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:21.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-20T01:21:21.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-20T01:21:21.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-20T01:21:21.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-20T01:21:21.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-20T01:21:21.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-20T01:21:21.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-20T01:21:21.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-20T01:21:21.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-20T01:21:21.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:21.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-20T01:21:21.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:21:21.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "btime": "2024-08-20T01:20:55:065563+0000", 2024-08-20T01:21:21.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-20T01:21:21.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-20T01:21:21.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:21.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-20T01:21:21.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-20T01:21:21.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-20T01:21:21.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-20T01:21:21.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-20T01:21:21.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-20T01:21:21.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2024-08-20T01:21:21.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-08-20T01:21:21.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-20T01:21:21.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:21.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-20T01:21:21.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:21:21.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2024-08-20T01:20:55.066225+0000", 2024-08-20T01:21:21.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-20T01:21:21.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:21:21.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-20T01:21:21.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-08-20T01:21:21.875 INFO:teuthology.orchestra.run.smithi022.stdout:mgr is available 2024-08-20T01:21:21.980 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:21 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1598606036' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-20T01:21:22.960 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:22 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3351283543' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-20T01:21:22.965 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-08-20T01:21:22.965 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [global] 2024-08-20T01:21:22.965 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout fsid = 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:21:22.965 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-20T01:21:22.965 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.22:3300,v1:172.21.15.22:6789] 2024-08-20T01:21:22.965 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-20T01:21:22.965 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-20T01:21:22.965 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-20T01:21:22.965 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-20T01:21:22.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-08-20T01:21:22.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-20T01:21:22.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-20T01:21:22.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-08-20T01:21:22.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [osd] 2024-08-20T01:21:22.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-20T01:21:22.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-20T01:21:22.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-20T01:21:22.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-20T01:21:22.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-20T01:21:22.966 INFO:teuthology.orchestra.run.smithi022.stdout:Enabling cephadm module... 2024-08-20T01:21:24.017 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:23 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/230533489' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-08-20T01:21:24.017 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:23 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: ignoring --setuser ceph since I am not root 2024-08-20T01:21:24.017 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:23 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: ignoring --setgroup ceph since I am not root 2024-08-20T01:21:24.884 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:24 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/230533489' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-20T01:21:24.884 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:24 smithi022 ceph-mon[18709]: mgrmap e5: x(active, since 6s) 2024-08-20T01:21:25.526 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-08-20T01:21:25.527 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-20T01:21:25.527 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-20T01:21:25.527 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-20T01:21:25.527 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-20T01:21:25.527 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-08-20T01:21:25.527 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for the mgr to restart... 2024-08-20T01:21:25.527 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr epoch 5... 2024-08-20T01:21:25.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:25 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3940747449' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-20T01:21:29.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:29 smithi022 ceph-mon[18709]: Active manager daemon x restarted 2024-08-20T01:21:29.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:29 smithi022 ceph-mon[18709]: Activating manager daemon x 2024-08-20T01:21:29.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:29 smithi022 ceph-mon[18709]: osdmap e2: 0 total, 0 up, 0 in 2024-08-20T01:21:29.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:29 smithi022 ceph-mon[18709]: mgrmap e6: x(active, starting, since 0.00320981s) 2024-08-20T01:21:29.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:29 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:21:29.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:29 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-20T01:21:29.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:29 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-20T01:21:29.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:29 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-20T01:21:29.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:29 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-20T01:21:29.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:29 smithi022 ceph-mon[18709]: Manager daemon x is now available 2024-08-20T01:21:30.548 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-08-20T01:21:30.549 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-20T01:21:30.549 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-20T01:21:30.549 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-08-20T01:21:30.549 INFO:teuthology.orchestra.run.smithi022.stdout:mgr epoch 5 is available 2024-08-20T01:21:30.549 INFO:teuthology.orchestra.run.smithi022.stdout:Setting orchestrator backend to cephadm... 2024-08-20T01:21:31.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:30 smithi022 ceph-mon[18709]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-20T01:21:31.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:30 smithi022 ceph-mon[18709]: mgrmap e7: x(active, since 1.00572s) 2024-08-20T01:21:31.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:30 smithi022 ceph-mon[18709]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-20T01:21:32.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' 2024-08-20T01:21:32.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' 2024-08-20T01:21:32.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-mon[18709]: Found migration_current of "None". Setting to last migration. 2024-08-20T01:21:32.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' 2024-08-20T01:21:32.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' 2024-08-20T01:21:32.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:21:32.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:21:32.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-20T01:21:32.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-20T01:21:32.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-mon[18709]: from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:21:32.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' 2024-08-20T01:21:32.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:21:32.634 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: 2024-08-20T01:21:32.328+0000 7f80d16df640 -1 log_channel(cephadm) log [ERR] : [20/Aug/2024:01:21:32] ENGINE Error in HTTPServer.serve 2024-08-20T01:21:32.635 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: Traceback (most recent call last): 2024-08-20T01:21:32.635 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-20T01:21:32.635 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: self._connections.run(self.expiration_interval) 2024-08-20T01:21:32.635 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-20T01:21:32.635 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: self._run(expiration_interval) 2024-08-20T01:21:32.635 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-20T01:21:32.635 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: new_conn = self._from_server_socket(self.server.socket) 2024-08-20T01:21:32.635 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-20T01:21:32.635 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-20T01:21:32.635 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-20T01:21:32.635 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: s = self.context.wrap_socket( 2024-08-20T01:21:32.636 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-20T01:21:32.636 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: return self.sslsocket_class._create( 2024-08-20T01:21:32.636 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-20T01:21:32.636 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: self.do_handshake() 2024-08-20T01:21:32.636 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-20T01:21:32.636 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: self._sslobj.do_handshake() 2024-08-20T01:21:32.636 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-20T01:21:32.636 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:32 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: 2024-08-20T01:21:32.919 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-20T01:21:32.919 INFO:teuthology.orchestra.run.smithi022.stdout:Generating ssh key... 2024-08-20T01:21:33.227 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-mon[18709]: [20/Aug/2024:01:21:32] ENGINE Bus STARTING 2024-08-20T01:21:33.227 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-mon[18709]: [20/Aug/2024:01:21:32] ENGINE Serving on http://172.21.15.22:8765 2024-08-20T01:21:33.228 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-mon[18709]: [20/Aug/2024:01:21:32] ENGINE Serving on https://172.21.15.22:7150 2024-08-20T01:21:33.228 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-mon[18709]: [20/Aug/2024:01:21:32] ENGINE Bus STARTED 2024-08-20T01:21:33.228 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:21:33.228 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-mon[18709]: [20/Aug/2024:01:21:32] ENGINE Error in HTTPServer.serve 2024-08-20T01:21:33.228 INFO:journalctl@ceph.mon.a.smithi022.stdout: Traceback (most recent call last): 2024-08-20T01:21:33.228 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-20T01:21:33.228 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._connections.run(self.expiration_interval) 2024-08-20T01:21:33.228 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-20T01:21:33.228 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._run(expiration_interval) 2024-08-20T01:21:33.228 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-20T01:21:33.228 INFO:journalctl@ceph.mon.a.smithi022.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-20T01:21:33.229 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-20T01:21:33.229 INFO:journalctl@ceph.mon.a.smithi022.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-20T01:21:33.229 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-20T01:21:33.229 INFO:journalctl@ceph.mon.a.smithi022.stdout: s = self.context.wrap_socket( 2024-08-20T01:21:33.229 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-20T01:21:33.229 INFO:journalctl@ceph.mon.a.smithi022.stdout: return self.sslsocket_class._create( 2024-08-20T01:21:33.229 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-20T01:21:33.229 INFO:journalctl@ceph.mon.a.smithi022.stdout: self.do_handshake() 2024-08-20T01:21:33.229 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-20T01:21:33.229 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._sslobj.do_handshake() 2024-08-20T01:21:33.229 INFO:journalctl@ceph.mon.a.smithi022.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-20T01:21:33.229 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-mon[18709]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:21:34.097 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:34 smithi022 ceph-mon[18709]: mgrmap e8: x(active, since 4s) 2024-08-20T01:21:34.097 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:34 smithi022 ceph-mon[18709]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:21:34.097 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:34 smithi022 ceph-mon[18709]: Generating ssh key... 2024-08-20T01:21:34.097 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:34 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' 2024-08-20T01:21:34.097 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:34 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' 2024-08-20T01:21:34.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: Generating public/private rsa key pair. 2024-08-20T01:21:34.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: Your identification has been saved in /tmp/tmphhkj8c0s/key 2024-08-20T01:21:34.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: Your public key has been saved in /tmp/tmphhkj8c0s/key.pub 2024-08-20T01:21:34.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: The key fingerprint is: 2024-08-20T01:21:34.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: SHA256:6zIdIGZ6LEm88dmGD8n6gpSpolm3vqgKnfIX5jPWldg ceph-586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:21:34.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: The key's randomart image is: 2024-08-20T01:21:34.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: +---[RSA 3072]----+ 2024-08-20T01:21:34.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: | | 2024-08-20T01:21:34.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: | | 2024-08-20T01:21:34.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: | . | 2024-08-20T01:21:34.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: | + + . | 2024-08-20T01:21:34.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: | .o@ * +S. | 2024-08-20T01:21:34.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: | ==.% + E. | 2024-08-20T01:21:34.099 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: |=.+*.* o.. | 2024-08-20T01:21:34.099 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: |==oo*.=.. | 2024-08-20T01:21:34.099 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: |O.o*=+ o. | 2024-08-20T01:21:34.099 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: +----[SHA256]-----+ 2024-08-20T01:21:35.487 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWI6uhIQkCASCTR+xXmwbxOoC6u+trDsZ5uFVLnQtyHzNussVYBzleHisDgao2HN/V+az5LvkbdHxdgJvMtdOxuKWLmJHIYfAIWTvuYvjxbsJrYj/DqRNO4+nc+4ZTbyky2KUSKerfGJ/WyBSOJY8L28vskTd8u7PNYBgEkbjDQcaTuyLgJ7K2YFrADqUfv01a2cUQGQ6x+cDhUtwQUscWmABMwnjJaS0CQIEULK/tGwnFo7qIyLlK7HKvu9ICD3+oOte+A4q40TP3RmuRaICB9mr6OFuD6PSx8ii0VbV7HDvENoAYRQl/DJhUL/JCGC6wDKXmPXL2grdqnD9moxmwKcekd96Llzv+v7gMNNZ88fmN9mbbr1cLGHGGxORI22Kl9kXgFuEpDeSJNAZ4OrJQkMdUhjiI48DfxPRsFh49BZnUXvJ1J/5kfMhM2gv5ldh5kyRfPTSMFFAu8t8ykDCI28M3C6g5LYGUBD+F97fF04lksH+h9c0OUVH76AUutg0= ceph-586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:21:35.488 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-20T01:21:35.488 INFO:teuthology.orchestra.run.smithi022.stdout:Adding key to root@localhost authorized_keys... 2024-08-20T01:21:35.488 INFO:teuthology.orchestra.run.smithi022.stdout:Adding host smithi022... 2024-08-20T01:21:36.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:35 smithi022 ceph-mon[18709]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:21:37.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:36 smithi022 ceph-mon[18709]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi022", "addr": "172.21.15.22", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:21:38.052 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:37 smithi022 ceph-mon[18709]: Deploying cephadm binary to smithi022 2024-08-20T01:21:40.554 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Added host 'smithi022' with addr '172.21.15.22' 2024-08-20T01:21:40.554 INFO:teuthology.orchestra.run.smithi022.stdout:Deploying unmanaged mon service... 2024-08-20T01:21:41.325 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:41 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' 2024-08-20T01:21:41.325 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:41 smithi022 ceph-mon[18709]: Added host smithi022 2024-08-20T01:21:41.325 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:41 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:21:41.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-20T01:21:41.847 INFO:teuthology.orchestra.run.smithi022.stdout:Deploying unmanaged mgr service... 2024-08-20T01:21:42.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:42 smithi022 ceph-mon[18709]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:21:42.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:42 smithi022 ceph-mon[18709]: Saving service mon spec with placement count:5 2024-08-20T01:21:42.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:42 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' 2024-08-20T01:21:43.917 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-20T01:21:44.221 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:43 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' 2024-08-20T01:21:44.221 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:43 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' 2024-08-20T01:21:44.221 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:43 smithi022 ceph-mon[18709]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:21:44.221 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:43 smithi022 ceph-mon[18709]: Saving service mgr spec with placement count:2 2024-08-20T01:21:44.221 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:43 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' 2024-08-20T01:21:45.700 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:45 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1741701214' entity='client.admin' 2024-08-20T01:21:46.425 INFO:teuthology.orchestra.run.smithi022.stdout:Enabling the dashboard module... 2024-08-20T01:21:47.092 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:46 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1853015146' entity='client.admin' 2024-08-20T01:21:47.092 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:46 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' 2024-08-20T01:21:48.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:47 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2334200011' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-08-20T01:21:48.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:47 smithi022 ceph-mon[18709]: from='mgr.14118 172.21.15.22:0/1844142737' entity='mgr.x' 2024-08-20T01:21:48.385 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:47 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: ignoring --setuser ceph since I am not root 2024-08-20T01:21:48.385 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:47 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: ignoring --setgroup ceph since I am not root 2024-08-20T01:21:49.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:48 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2334200011' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-20T01:21:49.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:48 smithi022 ceph-mon[18709]: mgrmap e9: x(active, since 18s) 2024-08-20T01:21:50.483 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:50 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/825286326' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-20T01:21:50.762 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-08-20T01:21:50.762 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-20T01:21:50.762 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-20T01:21:50.762 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-20T01:21:50.762 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-20T01:21:50.762 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-08-20T01:21:50.762 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for the mgr to restart... 2024-08-20T01:21:50.762 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr epoch 9... 2024-08-20T01:21:53.634 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:53 smithi022 ceph-mon[18709]: Active manager daemon x restarted 2024-08-20T01:21:53.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:53 smithi022 ceph-mon[18709]: Activating manager daemon x 2024-08-20T01:21:53.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:53 smithi022 ceph-mon[18709]: osdmap e3: 0 total, 0 up, 0 in 2024-08-20T01:21:53.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:53 smithi022 ceph-mon[18709]: mgrmap e10: x(active, starting, since 0.00330504s) 2024-08-20T01:21:53.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:53 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:21:53.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:53 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-20T01:21:53.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:53 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-20T01:21:53.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:53 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-20T01:21:53.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:53 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-20T01:21:53.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:53 smithi022 ceph-mon[18709]: Manager daemon x is now available 2024-08-20T01:21:54.481 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:21:54.481 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-20T01:21:54.481 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-20T01:21:54.481 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:54 smithi022 ceph-mon[18709]: mgrmap e11: x(active, since 1.00644s) 2024-08-20T01:21:54.759 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-08-20T01:21:54.759 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-20T01:21:54.759 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-20T01:21:54.759 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-08-20T01:21:54.759 INFO:teuthology.orchestra.run.smithi022.stdout:mgr epoch 9 is available 2024-08-20T01:21:54.759 INFO:teuthology.orchestra.run.smithi022.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-08-20T01:21:55.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-mon[18709]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-20T01:21:55.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-mon[18709]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-20T01:21:55.385 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: 2024-08-20T01:21:55.112+0000 7f69fe6e0640 -1 log_channel(cephadm) log [ERR] : [20/Aug/2024:01:21:55] ENGINE Error in HTTPServer.serve 2024-08-20T01:21:55.385 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: Traceback (most recent call last): 2024-08-20T01:21:55.385 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-20T01:21:55.385 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: self._connections.run(self.expiration_interval) 2024-08-20T01:21:55.385 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-20T01:21:55.385 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: self._run(expiration_interval) 2024-08-20T01:21:55.385 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-20T01:21:55.386 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: new_conn = self._from_server_socket(self.server.socket) 2024-08-20T01:21:55.386 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-20T01:21:55.386 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-20T01:21:55.386 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-20T01:21:55.386 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: s = self.context.wrap_socket( 2024-08-20T01:21:55.386 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-20T01:21:55.386 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: return self.sslsocket_class._create( 2024-08-20T01:21:55.386 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-20T01:21:55.386 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: self.do_handshake() 2024-08-20T01:21:55.386 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-20T01:21:55.386 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: self._sslobj.do_handshake() 2024-08-20T01:21:55.386 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-20T01:21:55.387 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:21:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: 2024-08-20T01:21:56.634 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:56 smithi022 ceph-mon[18709]: [20/Aug/2024:01:21:54] ENGINE Bus STARTING 2024-08-20T01:21:56.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:56 smithi022 ceph-mon[18709]: [20/Aug/2024:01:21:55] ENGINE Serving on https://172.21.15.22:7150 2024-08-20T01:21:56.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:56 smithi022 ceph-mon[18709]: [20/Aug/2024:01:21:55] ENGINE Error in HTTPServer.serve 2024-08-20T01:21:56.635 INFO:journalctl@ceph.mon.a.smithi022.stdout: Traceback (most recent call last): 2024-08-20T01:21:56.635 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-20T01:21:56.635 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._connections.run(self.expiration_interval) 2024-08-20T01:21:56.635 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-20T01:21:56.635 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._run(expiration_interval) 2024-08-20T01:21:56.635 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-20T01:21:56.635 INFO:journalctl@ceph.mon.a.smithi022.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-20T01:21:56.635 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-20T01:21:56.635 INFO:journalctl@ceph.mon.a.smithi022.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-20T01:21:56.635 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-20T01:21:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout: s = self.context.wrap_socket( 2024-08-20T01:21:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-20T01:21:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout: return self.sslsocket_class._create( 2024-08-20T01:21:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-20T01:21:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout: self.do_handshake() 2024-08-20T01:21:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-20T01:21:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._sslobj.do_handshake() 2024-08-20T01:21:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-20T01:21:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:56 smithi022 ceph-mon[18709]: [20/Aug/2024:01:21:55] ENGINE Serving on http://172.21.15.22:8765 2024-08-20T01:21:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:56 smithi022 ceph-mon[18709]: [20/Aug/2024:01:21:55] ENGINE Bus STARTED 2024-08-20T01:21:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:56 smithi022 ceph-mon[18709]: mgrmap e12: x(active, since 2s) 2024-08-20T01:21:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:56 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:21:57.884 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:57 smithi022 ceph-mon[18709]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:21:57.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:57 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:21:57.924 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUArU0Ht8+Fu+YSGapENYqn0j+hucwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDgyMDAxMjE1N1oXDTM0\nMDgyMTAxMjE1N1owFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjIyMIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAsqvuS/YAsJOyBgIrZ4myqnzJ8JDuWz2OFxkh\ny7VmSUcicv409BwbcAP+fMN/NRvGxGz8J8mAyfbF1j/fjMtIpWxIXv+lSJ6SfS7F\nKRjo3x8TJTM9m3L/ByO0GqLubSIoktifR4XOtshEQ/OwTNJ72ZHVTlPT6NtC1qQV\nI+6GnAC77JgTfSYiDkRsMYv0dtvP1qKTdka7ABGF+Mfk4jn1LI79Y0Hzhv4bCWXM\nf9s807soFJKJYwONNk6D1EJE1LJsFhlW3tfLZdI2ksUxLPDzGyL464oDkHB6lQr+\nTv65jAgsZNCiIMohyKtP8Kg66ZuN/3RRgs4epdM+DSEoy6m/+9FmhyjwYZMiEX+G\nKF1wY/XwM2njo+ylJfAi/04gf00582siRwZgvMHeY8M40cgya6xNMMIcKi26uuL8\nJin295fA3yDNkhDHinN0UGQjL9xeASNS5BxrXhF461fG+sc8XoqsJKhhfikf+UyT\nVbqKkbyKnrUyUmNqEXrnqrLPbqJNIB0v4u+lNrupNnWoQDXtZXY+F8twjHgMMuTj\ns4q8bVgGu2vLNJV9wTgVE5Qzb05je9AVnUgN772mKE08gujJn3vqzOR5stvRfHvk\nnfwPWeVmQFSDAEEi/t4QE0o92Redlo2uw8HyQP3wSi9iyLPyte/HgaPqTwCbFcL5\nOXh60fsCAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDIyghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPFjAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQCS\nG6uVnTGloO0sOaPsyvkrvR4hJR5qyUOJvQ+RSqdj05CuD+OLrYa4eA/gzccYputQ\nQB7IBbseT1qI6rzq/yqGzVmoEuBlwaUeSuC9kFttPVQVCaN/e3KNZCsfd88VxAs1\ntHA9m4gCUAPPW16PA54YhZZDhBUJaAF5yIEoPOvgBdeViXdM4MWWSg9LWBQs/GPO\nwE0CnOb9dS6zV4cyLJiQ2DIjZAYxKQqgV49uhATYV6q2Mz/MlEDRMx5wur5hnpKv\nmzzvw8aS2PKo6y6em9QbFT5vubC6DLO3Wz51OAWOorgfglLS25m1qxdlbmtXZKZV\nWPjv1I7pXlMBqoS96iB+Y+5QZFtF0DYp/Ns7KejwA+beRNrMmeldaUYD8xbV4NK6\nSHtMgJ7rhCQGg37ClozI2XW22jmbysXsdyf7PFSow5IMWFVKjGrtZE8bFHUGwRSb\nJuVn4zO0h50xBjQOmrPZEG2uX6mjbLoGnhphfE/wau3NJ8IGZBSHjlBVFPmnBK6k\nGqcXrQ7pyMhAU4Y4Rh0ZseLr1QESIePZiF4QJt7NEKUWdbtmNwJCiyD5yEgAwRC8\ng5fMSMZO05eY7rS4M/KsLvlDcB1cafOSiDfjfCOwwX4mjcXGl2Gl1kxpTrGOpZAr\nfFVj4+sUOl7w6T05OFQvpZoBtNiSXbgX6tL2SzJaqA==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJJwIBAAKCAgEAsqvuS/YAsJOyBgIrZ4myqnzJ8JDuWz2OFxkhy7VmSUcicv40\n9BwbcAP+fMN/NRvGxGz8J8mAyfbF1j/fjMtIpWxIXv+lSJ6SfS7FKRjo3x8TJTM9\nm3L/ByO0GqLubSIoktifR4XOtshEQ/OwTNJ72ZHVTlPT6NtC1qQVI+6GnAC77JgT\nfSYiDkRsMYv0dtvP1qKTdka7ABGF+Mfk4jn1LI79Y0Hzhv4bCWXMf9s807soFJKJ\nYwONNk6D1EJE1LJsFhlW3tfLZdI2ksUxLPDzGyL464oDkHB6lQr+Tv65jAgsZNCi\nIMohyKtP8Kg66ZuN/3RRgs4epdM+DSEoy6m/+9FmhyjwYZMiEX+GKF1wY/XwM2nj\no+ylJfAi/04gf00582siRwZgvMHeY8M40cgya6xNMMIcKi26uuL8Jin295fA3yDN\nkhDHinN0UGQjL9xeASNS5BxrXhF461fG+sc8XoqsJKhhfikf+UyTVbqKkbyKnrUy\nUmNqEXrnqrLPbqJNIB0v4u+lNrupNnWoQDXtZXY+F8twjHgMMuTjs4q8bVgGu2vL\nNJV9wTgVE5Qzb05je9AVnUgN772mKE08gujJn3vqzOR5stvRfHvknfwPWeVmQFSD\nAEEi/t4QE0o92Redlo2uw8HyQP3wSi9iyLPyte/HgaPqTwCbFcL5OXh60fsCAwEA\nAQKCAgARl1zwbKmXuQrzjX4hhQyqvXuSbGqTYCWfv5E0wcju2QqawM2M5UGMT1Bc\nj1D0dSYmS8at0iiUee/zjrlfXtppsxYTCF+JHVe17Idr6vBum1wisv9TUUirtsey\nQa1w4EaXYq2X+KQoGeKiwBjxD14zRyj1u8om6IOVp3UPYxosvOPDwRtWHI2I0xLF\n9A4fL7gwXTRglkkuEgubOW8fGO67Mt7eyW0FMvqNe9DdG8RK4mfpUp4lOgHKwYM4\nQEgPmvuKV3dWnG+BuGc4HyMe1iBRYSmZ4y5Dp9dh2kG8nFa/Y0SfrmzwBoa5/6fw\nvVeDjZW2+4hU9R9OW1SGLWgbWTy2D8J8f6t5rb7uxyQaXxW48x+PF0CBkSSsRJTw\nQqzkk4RRA9lf4QwYnb05Tm3fYWj8+w6p9GH4uQ9sU5EDr2an/DpX3KAqweWGsndw\n5mBABO6J8ra0dyfjjNSKvlFvdgRKKGfEskaUbSE/enRizA2H/LxSA7G38+p22olI\noI1uEMQOSuKUs1C+tOft5pvExd+1ZegDtrnfHTGrfHqx3fUMp2zyBdHNlwGfKrLi\neRAwACyWDSwf+u+T0nLq1o2Dalx0pneDPbAJ/ajBj+ebk3TXr4J928KOieJ+56qT\nvstHGJuQAfxpV284n8YJXeYtKvhFHPuhATrHTaXa0AiSUrFflQKCAQEA2b8jl0wJ\ni3HKr9DApZQ78rVxEQULi1tXcmjns4kwXJRE70Oph58YAMWia0nQd6TnSC4SX9Wv\nQfGQNu77RtIGQBd6u4UOTt3PFechniCCq8nM66VQSHTvxJtdQO4XERnJhKFOyuaw\n+BGZ3CP6KKuMixXIYS3GEpP5yWnaEZmbXpsUXT3gWXS++w1p4ImmnQuiKLnaP1R9\nYXrkx+F2vj39QDCwvtqqQX3VoytGBqQ/00qXfuTWt+Q+pC+0RM4MjrTptA47f9i/\nGoH3JQjFfYbzVSWiYYNBY39g92bcsRVtTSMA1nzhxSQAWUO04vqkWXm4eP4eWM98\nmcdiIak3PYlHHQKCAQEA0g9x7MaCeRgGTDE1hb9PwLb906iLvN4S62s5uC6jDbue\nzkw/LAk1wF57QJkOyvQ4E0doYARMgCSZ5mtD/Bsbo90LfHjNoQL2EHBD6E2bJoTk\n9SNDz1ioKCmwBDuWtH+crE0qzn3ZNGbXvoUW4DIOuW2+0gji+r7uh+1LQBrDNVQY\nIW5Ec1ZgPT2jqB3uI1OyiSafohDqryUGsXa1TeA7MCcUOgJlwXkjkdEPHgIKbiju\nZ3DiNsEFJiEVA3piwfQ3V0xm+Rl/BlWkTIRN99I1oXvlX41K4Ss2gLK4BZFTLWu9\n8ZRDPGbHavsiGyEaIaQsK7Z7wiMSqFLH429MO4z59wKCAQA2qI9DlFe1BDxvw8QI\nDFy8ASW/sveB5MzfsEuxOpfENYfUU7TDkYER+IpbyiylS+Surrn4Coiy0fN0hqrW\nzTO6dOpfFfhQfcdU5S8AJYMHomFpKZcsiQYC4UkYWmu55DI8s802i5ASxUBNDU7n\nVKCz7STemAHnefOyxnpx/pAMwHrtKPIfInoqROS183e6ZkgvVu/dA9VxWcsCDauj\n96WRrmc/kV45kF/HVL6APkyzOj8rIEBx6r56smra9qoaTHl5tDTlU8As5EDor/n7\nF5wPXKIVPkB0vG3XzJ9LaGiGe2njbXey5+Wagq9uZqJIv5A59vghLPxHEdClSHfQ\nX5xVAoIBAEW11HPkSOZQ374nUoDJRXlKASBdvcn21MaFtgj2iSwEiKYjzY8am1j0\nwehlIvCdbYKQXwYGRzD7dItwK4adpGWT9LzhBjSZ2/kGmLKeFpAI6Eal5loILP3v\nH7e34sKR2vefQEZ4oz1tp8lVN4s9cX99+SaQxmq6NEStrhxfBUtMVhm6E0NHdfa8\n3vPqwt28Z/J1++H3xTpMilUYdQCcGmhXf7Hkm8pCHljEzUSDHt0B/mQbpSbQlZna\nvrOByQZeuoLhGwctu+bpQvYVrh5BB4VIrY0xQZlKEvNQ3BsU6EqZh9aFAm8oGKPb\nJa1lJdvmNLZo/9ckdouftTA3/k+A8G8CggEAHktpIwZfdBrAEMjoI8fP4+08YyYP\nyI/xMOyAGAsuj/BdWs+lcGx12R0dOwIum7eo0aagZE9FiAUydkZQ7HoYxQkslBfz\nQiFW+Ded++Yb0i3Csiw1zYOn/9Cy87xGHVnU308HpjQeb+C8mKS8lOwn1PMbR8qR\nCVurCVQsvOWKBs4oJ1LewDP9zHqHLCJgVzLSJfwKbUG+yc6bKpgXr7HMUSFsc4d1\nMChgQ08XOr1Oc3Mu+SxOx6OuThjsZB1jS+w1nG/dAwuPocdPnCkSpgU7DbFIgWUb\nY3y7S/2i7tNPMD59T8rYGbKJCHh0jY0q6mQJmIboFw5GifJeS9Oq8aoCYg==\n-----END RSA PRIVATE KEY-----\n"} 2024-08-20T01:21:59.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-08-20T01:21:59.717 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:59 smithi022 ceph-mon[18709]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:21:59.718 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:21:59 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:00.564 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-08-20T01:22:00.564 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial admin user... 2024-08-20T01:22:01.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:01 smithi022 ceph-mon[18709]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:22:01.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:01 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:01.970 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$cDOmy0bcSBIBLoH5ms0dKeNPn5no5Edf8j6scLr6r5bCIR3TZ3.wS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1724116921, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-20T01:22:01.971 INFO:teuthology.orchestra.run.smithi022.stdout:Fetching dashboard port number... 2024-08-20T01:22:02.549 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:02 smithi022 ceph-mon[18709]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:22:02.549 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:02 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:03.086 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 8443 2024-08-20T01:22:03.096 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-20T01:22:03.096 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-08-20T01:22:03.104 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-20T01:22:03.104 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-08-20T01:22:03.104 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-08-20T01:22:03.104 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-20T01:22:03.106 INFO:teuthology.orchestra.run.smithi022.stdout:Ceph Dashboard is now available at: 2024-08-20T01:22:03.106 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:22:03.106 INFO:teuthology.orchestra.run.smithi022.stdout: URL: https://smithi022:8443/ 2024-08-20T01:22:03.106 INFO:teuthology.orchestra.run.smithi022.stdout: User: admin 2024-08-20T01:22:03.106 INFO:teuthology.orchestra.run.smithi022.stdout: Password: 157xcdne5l 2024-08-20T01:22:03.106 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:22:03.107 INFO:teuthology.orchestra.run.smithi022.stdout:Saving cluster configuration to /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config directory 2024-08-20T01:22:03.634 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:03 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1474516706' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-08-20T01:22:04.391 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-20T01:22:04.391 INFO:teuthology.orchestra.run.smithi022.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-20T01:22:04.391 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:22:04.391 INFO:teuthology.orchestra.run.smithi022.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-20T01:22:04.391 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:22:04.391 INFO:teuthology.orchestra.run.smithi022.stdout:Or, if you are only running a single cluster on this host: 2024-08-20T01:22:04.391 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:22:04.391 INFO:teuthology.orchestra.run.smithi022.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-20T01:22:04.391 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:22:04.391 INFO:teuthology.orchestra.run.smithi022.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-20T01:22:04.392 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:22:04.392 INFO:teuthology.orchestra.run.smithi022.stdout: ceph telemetry on 2024-08-20T01:22:04.392 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:22:04.392 INFO:teuthology.orchestra.run.smithi022.stdout:For more information see: 2024-08-20T01:22:04.392 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:22:04.392 INFO:teuthology.orchestra.run.smithi022.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-08-20T01:22:04.392 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:22:04.392 INFO:teuthology.orchestra.run.smithi022.stdout:Bootstrap complete. 2024-08-20T01:22:04.430 INFO:tasks.cephadm:Fetching config... 2024-08-20T01:22:04.430 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-08-20T01:22:04.431 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-20T01:22:04.447 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-20T01:22:04.447 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-08-20T01:22:04.447 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-20T01:22:04.503 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-20T01:22:04.503 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-08-20T01:22:04.504 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/keyring of=/dev/stdout 2024-08-20T01:22:04.569 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-20T01:22:04.570 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-08-20T01:22:04.570 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-20T01:22:04.626 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-20T01:22:04.631 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWI6uhIQkCASCTR+xXmwbxOoC6u+trDsZ5uFVLnQtyHzNussVYBzleHisDgao2HN/V+az5LvkbdHxdgJvMtdOxuKWLmJHIYfAIWTvuYvjxbsJrYj/DqRNO4+nc+4ZTbyky2KUSKerfGJ/WyBSOJY8L28vskTd8u7PNYBgEkbjDQcaTuyLgJ7K2YFrADqUfv01a2cUQGQ6x+cDhUtwQUscWmABMwnjJaS0CQIEULK/tGwnFo7qIyLlK7HKvu9ICD3+oOte+A4q40TP3RmuRaICB9mr6OFuD6PSx8ii0VbV7HDvENoAYRQl/DJhUL/JCGC6wDKXmPXL2grdqnD9moxmwKcekd96Llzv+v7gMNNZ88fmN9mbbr1cLGHGGxORI22Kl9kXgFuEpDeSJNAZ4OrJQkMdUhjiI48DfxPRsFh49BZnUXvJ1J/5kfMhM2gv5ldh5kyRfPTSMFFAu8t8ykDCI28M3C6g5LYGUBD+F97fF04lksH+h9c0OUVH76AUutg0= ceph-586fd06c-5e92-11ef-bccf-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-20T01:22:04.718 INFO:teuthology.orchestra.run.smithi022.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWI6uhIQkCASCTR+xXmwbxOoC6u+trDsZ5uFVLnQtyHzNussVYBzleHisDgao2HN/V+az5LvkbdHxdgJvMtdOxuKWLmJHIYfAIWTvuYvjxbsJrYj/DqRNO4+nc+4ZTbyky2KUSKerfGJ/WyBSOJY8L28vskTd8u7PNYBgEkbjDQcaTuyLgJ7K2YFrADqUfv01a2cUQGQ6x+cDhUtwQUscWmABMwnjJaS0CQIEULK/tGwnFo7qIyLlK7HKvu9ICD3+oOte+A4q40TP3RmuRaICB9mr6OFuD6PSx8ii0VbV7HDvENoAYRQl/DJhUL/JCGC6wDKXmPXL2grdqnD9moxmwKcekd96Llzv+v7gMNNZ88fmN9mbbr1cLGHGGxORI22Kl9kXgFuEpDeSJNAZ4OrJQkMdUhjiI48DfxPRsFh49BZnUXvJ1J/5kfMhM2gv5ldh5kyRfPTSMFFAu8t8ykDCI28M3C6g5LYGUBD+F97fF04lksH+h9c0OUVH76AUutg0= ceph-586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:22:04.730 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWI6uhIQkCASCTR+xXmwbxOoC6u+trDsZ5uFVLnQtyHzNussVYBzleHisDgao2HN/V+az5LvkbdHxdgJvMtdOxuKWLmJHIYfAIWTvuYvjxbsJrYj/DqRNO4+nc+4ZTbyky2KUSKerfGJ/WyBSOJY8L28vskTd8u7PNYBgEkbjDQcaTuyLgJ7K2YFrADqUfv01a2cUQGQ6x+cDhUtwQUscWmABMwnjJaS0CQIEULK/tGwnFo7qIyLlK7HKvu9ICD3+oOte+A4q40TP3RmuRaICB9mr6OFuD6PSx8ii0VbV7HDvENoAYRQl/DJhUL/JCGC6wDKXmPXL2grdqnD9moxmwKcekd96Llzv+v7gMNNZ88fmN9mbbr1cLGHGGxORI22Kl9kXgFuEpDeSJNAZ4OrJQkMdUhjiI48DfxPRsFh49BZnUXvJ1J/5kfMhM2gv5ldh5kyRfPTSMFFAu8t8ykDCI28M3C6g5LYGUBD+F97fF04lksH+h9c0OUVH76AUutg0= ceph-586fd06c-5e92-11ef-bccf-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-20T01:22:04.770 INFO:teuthology.orchestra.run.smithi077.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWI6uhIQkCASCTR+xXmwbxOoC6u+trDsZ5uFVLnQtyHzNussVYBzleHisDgao2HN/V+az5LvkbdHxdgJvMtdOxuKWLmJHIYfAIWTvuYvjxbsJrYj/DqRNO4+nc+4ZTbyky2KUSKerfGJ/WyBSOJY8L28vskTd8u7PNYBgEkbjDQcaTuyLgJ7K2YFrADqUfv01a2cUQGQ6x+cDhUtwQUscWmABMwnjJaS0CQIEULK/tGwnFo7qIyLlK7HKvu9ICD3+oOte+A4q40TP3RmuRaICB9mr6OFuD6PSx8ii0VbV7HDvENoAYRQl/DJhUL/JCGC6wDKXmPXL2grdqnD9moxmwKcekd96Llzv+v7gMNNZ88fmN9mbbr1cLGHGGxORI22Kl9kXgFuEpDeSJNAZ4OrJQkMdUhjiI48DfxPRsFh49BZnUXvJ1J/5kfMhM2gv5ldh5kyRfPTSMFFAu8t8ykDCI28M3C6g5LYGUBD+F97fF04lksH+h9c0OUVH76AUutg0= ceph-586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:22:04.783 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWI6uhIQkCASCTR+xXmwbxOoC6u+trDsZ5uFVLnQtyHzNussVYBzleHisDgao2HN/V+az5LvkbdHxdgJvMtdOxuKWLmJHIYfAIWTvuYvjxbsJrYj/DqRNO4+nc+4ZTbyky2KUSKerfGJ/WyBSOJY8L28vskTd8u7PNYBgEkbjDQcaTuyLgJ7K2YFrADqUfv01a2cUQGQ6x+cDhUtwQUscWmABMwnjJaS0CQIEULK/tGwnFo7qIyLlK7HKvu9ICD3+oOte+A4q40TP3RmuRaICB9mr6OFuD6PSx8ii0VbV7HDvENoAYRQl/DJhUL/JCGC6wDKXmPXL2grdqnD9moxmwKcekd96Llzv+v7gMNNZ88fmN9mbbr1cLGHGGxORI22Kl9kXgFuEpDeSJNAZ4OrJQkMdUhjiI48DfxPRsFh49BZnUXvJ1J/5kfMhM2gv5ldh5kyRfPTSMFFAu8t8ykDCI28M3C6g5LYGUBD+F97fF04lksH+h9c0OUVH76AUutg0= ceph-586fd06c-5e92-11ef-bccf-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-20T01:22:04.824 INFO:teuthology.orchestra.run.smithi134.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWI6uhIQkCASCTR+xXmwbxOoC6u+trDsZ5uFVLnQtyHzNussVYBzleHisDgao2HN/V+az5LvkbdHxdgJvMtdOxuKWLmJHIYfAIWTvuYvjxbsJrYj/DqRNO4+nc+4ZTbyky2KUSKerfGJ/WyBSOJY8L28vskTd8u7PNYBgEkbjDQcaTuyLgJ7K2YFrADqUfv01a2cUQGQ6x+cDhUtwQUscWmABMwnjJaS0CQIEULK/tGwnFo7qIyLlK7HKvu9ICD3+oOte+A4q40TP3RmuRaICB9mr6OFuD6PSx8ii0VbV7HDvENoAYRQl/DJhUL/JCGC6wDKXmPXL2grdqnD9moxmwKcekd96Llzv+v7gMNNZ88fmN9mbbr1cLGHGGxORI22Kl9kXgFuEpDeSJNAZ4OrJQkMdUhjiI48DfxPRsFh49BZnUXvJ1J/5kfMhM2gv5ldh5kyRfPTSMFFAu8t8ykDCI28M3C6g5LYGUBD+F97fF04lksH+h9c0OUVH76AUutg0= ceph-586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:22:04.836 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-20T01:22:05.096 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:05.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:04 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/759228160' entity='client.admin' 2024-08-20T01:22:07.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:06 smithi022 ceph-mon[18709]: mgrmap e13: x(active, since 12s) 2024-08-20T01:22:07.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:06 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:07.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:06 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:07.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:06 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi022", "name": "osd_memory_target"} : dispatch 2024-08-20T01:22:07.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:06 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:07.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:06 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:22:07.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:06 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:07.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:06 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3783166591' entity='client.admin' 2024-08-20T01:22:07.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:06 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:22:07.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:06 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:07.369 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-20T01:22:07.369 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-20T01:22:07.963 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:09.268 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi077 2024-08-20T01:22:09.269 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-08-20T01:22:09.269 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/etc/ceph/ceph.conf 2024-08-20T01:22:09.289 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-08-20T01:22:09.289 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:22:09.348 INFO:tasks.cephadm:Adding host smithi077 to orchestrator... 2024-08-20T01:22:09.348 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch host add smithi077 2024-08-20T01:22:09.604 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:09.819 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:09 smithi022 ceph-mon[18709]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:22:09.819 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:09 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:09.819 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:09 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:22:09.819 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:09 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:09.819 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:09 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:22:09.819 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:09 smithi022 ceph-mon[18709]: Updating smithi022:/etc/ceph/ceph.conf 2024-08-20T01:22:09.820 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:09 smithi022 ceph-mon[18709]: Updating smithi022:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:22:09.820 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:09 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:09.820 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:09 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:09.820 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:09 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:10.884 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:10 smithi022 ceph-mon[18709]: Updating smithi022:/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:22:10.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:10 smithi022 ceph-mon[18709]: Updating smithi022:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-20T01:22:11.884 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:11 smithi022 ceph-mon[18709]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi077", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:22:12.884 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:12 smithi022 ceph-mon[18709]: Deploying cephadm binary to smithi077 2024-08-20T01:22:14.151 INFO:teuthology.orchestra.run.smithi022.stdout:Added host 'smithi077' with addr '172.21.15.77' 2024-08-20T01:22:14.634 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:14 smithi022 ceph-mon[18709]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:14.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:14.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:22:14.970 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch host ls --format=json 2024-08-20T01:22:15.222 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:15.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:15 smithi022 ceph-mon[18709]: Added host smithi077 2024-08-20T01:22:15.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:15 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:15.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:15 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:15.906 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:22:15.906 INFO:teuthology.orchestra.run.smithi022.stdout:[{"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}, {"addr": "172.21.15.77", "hostname": "smithi077", "labels": [], "status": ""}] 2024-08-20T01:22:16.466 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi134 2024-08-20T01:22:16.466 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-08-20T01:22:16.466 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.conf 2024-08-20T01:22:16.485 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-08-20T01:22:16.485 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:22:16.543 INFO:tasks.cephadm:Adding host smithi134 to orchestrator... 2024-08-20T01:22:16.543 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch host add smithi134 2024-08-20T01:22:16.794 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:16.884 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:16 smithi022 ceph-mon[18709]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:16.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:16 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:16.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:16 smithi022 ceph-mon[18709]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:22:18.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:18 smithi022 ceph-mon[18709]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:18.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:18 smithi022 ceph-mon[18709]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:22:18.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:18 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:18.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:18 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:18.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:18 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:18.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:18 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:18.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:18 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi077", "name": "osd_memory_target"} : dispatch 2024-08-20T01:22:18.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:18 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:18.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:18 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:22:19.884 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:19 smithi022 ceph-mon[18709]: Updating smithi077:/etc/ceph/ceph.conf 2024-08-20T01:22:19.884 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:19 smithi022 ceph-mon[18709]: Deploying cephadm binary to smithi134 2024-08-20T01:22:19.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:19 smithi022 ceph-mon[18709]: Updating smithi077:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:22:19.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:19 smithi022 ceph-mon[18709]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:22:19.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:19 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:19.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:19 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:19.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:19 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:20.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:20 smithi022 ceph-mon[18709]: Updating smithi077:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-20T01:22:20.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:20 smithi022 ceph-mon[18709]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:21.347 INFO:teuthology.orchestra.run.smithi022.stdout:Added host 'smithi134' with addr '172.21.15.134' 2024-08-20T01:22:21.962 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch host ls --format=json 2024-08-20T01:22:22.212 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:22.590 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:22 smithi022 ceph-mon[18709]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:22.590 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:22 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:22.590 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:22 smithi022 ceph-mon[18709]: Added host smithi134 2024-08-20T01:22:22.590 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:22 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:22:22.590 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:22 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:22.590 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:22 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:22.891 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:22:22.891 INFO:teuthology.orchestra.run.smithi022.stdout:[{"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}, {"addr": "172.21.15.77", "hostname": "smithi077", "labels": [], "status": ""}, {"addr": "172.21.15.134", "hostname": "smithi134", "labels": [], "status": ""}] 2024-08-20T01:22:23.447 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-20T01:22:23.447 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd crush tunables default 2024-08-20T01:22:23.697 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:24.038 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:23 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:24.038 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:23 smithi022 ceph-mon[18709]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:22:24.708 INFO:teuthology.orchestra.run.smithi022.stderr:adjusted tunables profile to default 2024-08-20T01:22:25.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:24 smithi022 ceph-mon[18709]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:25.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:24 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/830428057' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-20T01:22:25.210 INFO:tasks.cephadm:Adding mon.a on smithi022 2024-08-20T01:22:25.211 INFO:tasks.cephadm:Adding mon.b on smithi077 2024-08-20T01:22:25.211 INFO:tasks.cephadm:Adding mon.c on smithi134 2024-08-20T01:22:25.211 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch apply mon '3;smithi022:172.21.15.22=a;smithi077:172.21.15.77=b;smithi134:172.21.15.134=c' 2024-08-20T01:22:25.528 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-20T01:22:25.574 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-20T01:22:26.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:25 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/830428057' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-20T01:22:26.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:25 smithi022 ceph-mon[18709]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T01:22:26.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:25 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:26.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:25 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:26.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:25 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:26.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:25 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:26.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:25 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"} : dispatch 2024-08-20T01:22:26.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:25 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:26.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:25 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:22:26.256 INFO:teuthology.orchestra.run.smithi134.stdout:Scheduled mon update... 2024-08-20T01:22:26.865 DEBUG:teuthology.orchestra.run.smithi077:mon.b> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mon.b.service 2024-08-20T01:22:26.868 DEBUG:teuthology.orchestra.run.smithi134:mon.c> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mon.c.service 2024-08-20T01:22:26.870 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-20T01:22:26.871 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-20T01:22:27.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:26 smithi022 ceph-mon[18709]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:27.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:26 smithi022 ceph-mon[18709]: Updating smithi134:/etc/ceph/ceph.conf 2024-08-20T01:22:27.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:26 smithi022 ceph-mon[18709]: Updating smithi134:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:22:27.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:26 smithi022 ceph-mon[18709]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:22:27.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:26 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:27.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:26 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:27.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:26 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:27.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:26 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:27.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:26 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:22:27.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:26 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:27.639 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:22:28.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:27 smithi022 ceph-mon[18709]: Updating smithi134:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-20T01:22:28.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:27 smithi022 ceph-mon[18709]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi022:172.21.15.22=a;smithi077:172.21.15.77=b;smithi134:172.21.15.134=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:22:28.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:27 smithi022 ceph-mon[18709]: Saving service mon spec with placement smithi022:172.21.15.22=a;smithi077:172.21.15.77=b;smithi134:172.21.15.134=c;count:3 2024-08-20T01:22:28.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:27 smithi022 ceph-mon[18709]: Deploying daemon mon.c on smithi134 2024-08-20T01:22:28.296 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:22:28.296 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"586fd06c-5e92-11ef-bccf-c7b262605968","modified":"2024-08-20T01:20:52.092445Z","created":"2024-08-20T01:20:52.092445Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-20T01:22:28.297 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-08-20T01:22:29.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:28 smithi022 ceph-mon[18709]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:29.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:28 smithi022 ceph-mon[18709]: from='client.? 172.21.15.134:0/3057221150' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T01:22:30.449 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-20T01:22:30.450 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-20T01:22:30.834 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:22:31.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:30 smithi022 ceph-mon[18709]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:31.514 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 podman[22479]: 2024-08-20 01:22:31.4267618 +0000 UTC m=+0.123668810 container create a037ee0751428103f4ac58d8dfd64e679c774dded5d6092686ae0cebe064b11a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-c, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, GIT_CLEAN=True) 2024-08-20T01:22:31.528 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:22:31.529 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"586fd06c-5e92-11ef-bccf-c7b262605968","modified":"2024-08-20T01:20:52.092445Z","created":"2024-08-20T01:20:52.092445Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-20T01:22:31.529 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-08-20T01:22:32.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 podman[22479]: 2024-08-20 01:22:31.6460862 +0000 UTC m=+0.342993207 container init a037ee0751428103f4ac58d8dfd64e679c774dded5d6092686ae0cebe064b11a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-c, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-20T01:22:32.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 podman[22479]: 2024-08-20 01:22:31.649760258 +0000 UTC m=+0.346667263 container start a037ee0751428103f4ac58d8dfd64e679c774dded5d6092686ae0cebe064b11a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-08-20T01:22:32.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: set uid:gid to 167:167 (ceph:ceph) 2024-08-20T01:22:32.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev), process ceph-mon, pid 2 2024-08-20T01:22:32.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: pidfile_write: ignore empty --pid-file 2024-08-20T01:22:32.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: load: jerasure load: lrc 2024-08-20T01:22:32.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: RocksDB version: 7.9.2 2024-08-20T01:22:32.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Git sha 0 2024-08-20T01:22:32.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Compile date 2024-08-19 15:50:59 2024-08-20T01:22:32.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: DB SUMMARY 2024-08-20T01:22:32.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: DB Session ID: JE7M241NKECFYB8HM0Z9 2024-08-20T01:22:32.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: CURRENT file: CURRENT 2024-08-20T01:22:32.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: IDENTITY file: IDENTITY 2024-08-20T01:22:32.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-20T01:22:32.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-08-20T01:22:32.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-08-20T01:22:32.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.error_if_exists: 0 2024-08-20T01:22:32.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.create_if_missing: 0 2024-08-20T01:22:32.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.paranoid_checks: 1 2024-08-20T01:22:32.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-20T01:22:32.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-20T01:22:32.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-20T01:22:32.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.env: 0x563bcda2abe0 2024-08-20T01:22:32.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.fs: PosixFileSystem 2024-08-20T01:22:32.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.info_log: 0x563bcf6cf700 2024-08-20T01:22:32.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_file_opening_threads: 16 2024-08-20T01:22:32.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.statistics: (nil) 2024-08-20T01:22:32.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.use_fsync: 0 2024-08-20T01:22:32.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_log_file_size: 0 2024-08-20T01:22:32.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-20T01:22:32.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-20T01:22:32.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.keep_log_file_num: 1000 2024-08-20T01:22:32.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.recycle_log_file_num: 0 2024-08-20T01:22:32.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.allow_fallocate: 1 2024-08-20T01:22:32.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.allow_mmap_reads: 0 2024-08-20T01:22:32.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.allow_mmap_writes: 0 2024-08-20T01:22:32.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.use_direct_reads: 0 2024-08-20T01:22:32.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-20T01:22:32.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.create_missing_column_families: 0 2024-08-20T01:22:32.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.db_log_dir: 2024-08-20T01:22:32.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.wal_dir: 2024-08-20T01:22:32.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-20T01:22:32.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-20T01:22:32.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-20T01:22:32.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-20T01:22:32.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-20T01:22:32.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-20T01:22:32.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.advise_random_on_open: 1 2024-08-20T01:22:32.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.db_write_buffer_size: 0 2024-08-20T01:22:32.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.write_buffer_manager: 0x563bcf6d2e60 2024-08-20T01:22:32.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-20T01:22:32.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-20T01:22:32.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-20T01:22:32.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.rate_limiter: (nil) 2024-08-20T01:22:32.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-20T01:22:32.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.wal_recovery_mode: 2 2024-08-20T01:22:32.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.enable_thread_tracking: 0 2024-08-20T01:22:32.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.enable_pipelined_write: 0 2024-08-20T01:22:32.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.unordered_write: 0 2024-08-20T01:22:32.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-20T01:22:32.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-20T01:22:32.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-20T01:22:32.020 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-20T01:22:32.020 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.row_cache: None 2024-08-20T01:22:32.020 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.wal_filter: None 2024-08-20T01:22:32.021 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-20T01:22:32.021 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.allow_ingest_behind: 0 2024-08-20T01:22:32.021 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.two_write_queues: 0 2024-08-20T01:22:32.022 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.manual_wal_flush: 0 2024-08-20T01:22:32.022 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.wal_compression: 0 2024-08-20T01:22:32.022 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.atomic_flush: 0 2024-08-20T01:22:32.022 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-20T01:22:32.022 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-20T01:22:32.022 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-20T01:22:32.022 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.log_readahead_size: 0 2024-08-20T01:22:32.022 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-20T01:22:32.022 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.best_efforts_recovery: 0 2024-08-20T01:22:32.022 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-20T01:22:32.022 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-20T01:22:32.022 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.allow_data_in_errors: 0 2024-08-20T01:22:32.022 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.db_host_id: __hostname__ 2024-08-20T01:22:32.023 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-20T01:22:32.023 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_background_jobs: 2 2024-08-20T01:22:32.023 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_background_compactions: -1 2024-08-20T01:22:32.023 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_subcompactions: 1 2024-08-20T01:22:32.023 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-20T01:22:32.023 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-20T01:22:32.023 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-20T01:22:32.023 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_total_wal_size: 0 2024-08-20T01:22:32.023 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-20T01:22:32.023 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-20T01:22:32.023 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-20T01:22:32.023 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-20T01:22:32.023 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_open_files: -1 2024-08-20T01:22:32.024 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.bytes_per_sync: 0 2024-08-20T01:22:32.024 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-20T01:22:32.024 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-20T01:22:32.024 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compaction_readahead_size: 0 2024-08-20T01:22:32.024 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_background_flushes: -1 2024-08-20T01:22:32.024 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Compression algorithms supported: 2024-08-20T01:22:32.024 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: kZSTD supported: 0 2024-08-20T01:22:32.024 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: kXpressCompression supported: 0 2024-08-20T01:22:32.024 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: kBZip2Compression supported: 0 2024-08-20T01:22:32.024 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-20T01:22:32.024 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: kLZ4Compression supported: 1 2024-08-20T01:22:32.024 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: kZlibCompression supported: 1 2024-08-20T01:22:32.024 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: kLZ4HCCompression supported: 1 2024-08-20T01:22:32.025 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: kSnappyCompression supported: 1 2024-08-20T01:22:32.025 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-20T01:22:32.025 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-20T01:22:32.025 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-08-20T01:22:32.025 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-20T01:22:32.025 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-20T01:22:32.025 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.merge_operator: 2024-08-20T01:22:32.025 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compaction_filter: None 2024-08-20T01:22:32.025 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compaction_filter_factory: None 2024-08-20T01:22:32.025 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.sst_partitioner_factory: None 2024-08-20T01:22:32.025 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-20T01:22:32.025 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-20T01:22:32.025 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563bcf6cf380) 2024-08-20T01:22:32.026 INFO:journalctl@ceph.mon.c.smithi134.stdout: cache_index_and_filter_blocks: 1 2024-08-20T01:22:32.026 INFO:journalctl@ceph.mon.c.smithi134.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-20T01:22:32.026 INFO:journalctl@ceph.mon.c.smithi134.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-20T01:22:32.026 INFO:journalctl@ceph.mon.c.smithi134.stdout: pin_top_level_index_and_filter: 1 2024-08-20T01:22:32.026 INFO:journalctl@ceph.mon.c.smithi134.stdout: index_type: 0 2024-08-20T01:22:32.026 INFO:journalctl@ceph.mon.c.smithi134.stdout: data_block_index_type: 0 2024-08-20T01:22:32.026 INFO:journalctl@ceph.mon.c.smithi134.stdout: index_shortening: 1 2024-08-20T01:22:32.026 INFO:journalctl@ceph.mon.c.smithi134.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-20T01:22:32.026 INFO:journalctl@ceph.mon.c.smithi134.stdout: checksum: 4 2024-08-20T01:22:32.026 INFO:journalctl@ceph.mon.c.smithi134.stdout: no_block_cache: 0 2024-08-20T01:22:32.026 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_cache: 0x563bcf6c3610 2024-08-20T01:22:32.026 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_cache_name: BinnedLRUCache 2024-08-20T01:22:32.026 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_cache_options: 2024-08-20T01:22:32.027 INFO:journalctl@ceph.mon.c.smithi134.stdout: capacity : 536870912 2024-08-20T01:22:32.027 INFO:journalctl@ceph.mon.c.smithi134.stdout: num_shard_bits : 4 2024-08-20T01:22:32.027 INFO:journalctl@ceph.mon.c.smithi134.stdout: strict_capacity_limit : 0 2024-08-20T01:22:32.027 INFO:journalctl@ceph.mon.c.smithi134.stdout: high_pri_pool_ratio: 0.000 2024-08-20T01:22:32.027 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_cache_compressed: (nil) 2024-08-20T01:22:32.027 INFO:journalctl@ceph.mon.c.smithi134.stdout: persistent_cache: (nil) 2024-08-20T01:22:32.027 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_size: 4096 2024-08-20T01:22:32.027 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_size_deviation: 10 2024-08-20T01:22:32.027 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_restart_interval: 16 2024-08-20T01:22:32.027 INFO:journalctl@ceph.mon.c.smithi134.stdout: index_block_restart_interval: 1 2024-08-20T01:22:32.027 INFO:journalctl@ceph.mon.c.smithi134.stdout: metadata_block_size: 4096 2024-08-20T01:22:32.027 INFO:journalctl@ceph.mon.c.smithi134.stdout: partition_filters: 0 2024-08-20T01:22:32.027 INFO:journalctl@ceph.mon.c.smithi134.stdout: use_delta_encoding: 1 2024-08-20T01:22:32.028 INFO:journalctl@ceph.mon.c.smithi134.stdout: filter_policy: bloomfilter 2024-08-20T01:22:32.028 INFO:journalctl@ceph.mon.c.smithi134.stdout: whole_key_filtering: 1 2024-08-20T01:22:32.028 INFO:journalctl@ceph.mon.c.smithi134.stdout: verify_compression: 0 2024-08-20T01:22:32.028 INFO:journalctl@ceph.mon.c.smithi134.stdout: read_amp_bytes_per_bit: 0 2024-08-20T01:22:32.028 INFO:journalctl@ceph.mon.c.smithi134.stdout: format_version: 5 2024-08-20T01:22:32.028 INFO:journalctl@ceph.mon.c.smithi134.stdout: enable_index_compression: 1 2024-08-20T01:22:32.028 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_align: 0 2024-08-20T01:22:32.028 INFO:journalctl@ceph.mon.c.smithi134.stdout: max_auto_readahead_size: 262144 2024-08-20T01:22:32.028 INFO:journalctl@ceph.mon.c.smithi134.stdout: prepopulate_block_cache: 0 2024-08-20T01:22:32.028 INFO:journalctl@ceph.mon.c.smithi134.stdout: initial_auto_readahead_size: 8192 2024-08-20T01:22:32.028 INFO:journalctl@ceph.mon.c.smithi134.stdout: num_file_reads_for_auto_readahead: 2 2024-08-20T01:22:32.028 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.write_buffer_size: 33554432 2024-08-20T01:22:32.028 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_write_buffer_number: 2 2024-08-20T01:22:32.029 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compression: NoCompression 2024-08-20T01:22:32.029 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.bottommost_compression: Disabled 2024-08-20T01:22:32.029 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.prefix_extractor: nullptr 2024-08-20T01:22:32.029 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-20T01:22:32.029 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.num_levels: 7 2024-08-20T01:22:32.029 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-20T01:22:32.029 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-20T01:22:32.029 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-20T01:22:32.029 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-20T01:22:32.029 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-20T01:22:32.029 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-20T01:22:32.029 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-20T01:22:32.029 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-20T01:22:32.030 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-20T01:22:32.030 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-20T01:22:32.030 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-20T01:22:32.030 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-20T01:22:32.030 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-20T01:22:32.030 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compression_opts.level: 32767 2024-08-20T01:22:32.030 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compression_opts.strategy: 0 2024-08-20T01:22:32.030 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-20T01:22:32.030 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-20T01:22:32.030 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-20T01:22:32.030 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-20T01:22:32.030 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compression_opts.enabled: false 2024-08-20T01:22:32.030 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-20T01:22:32.030 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-20T01:22:32.031 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-20T01:22:32.031 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-20T01:22:32.031 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.target_file_size_base: 67108864 2024-08-20T01:22:32.031 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-20T01:22:32.031 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-20T01:22:32.031 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-20T01:22:32.031 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-20T01:22:32.031 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-20T01:22:32.031 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-20T01:22:32.031 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-20T01:22:32.031 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-20T01:22:32.031 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-20T01:22:32.031 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-20T01:22:32.032 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-20T01:22:32.032 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-20T01:22:32.032 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-20T01:22:32.032 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-20T01:22:32.032 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.arena_block_size: 1048576 2024-08-20T01:22:32.032 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-20T01:22:32.032 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-20T01:22:32.032 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.disable_auto_compactions: 0 2024-08-20T01:22:32.032 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-20T01:22:32.032 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-20T01:22:32.032 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-20T01:22:32.032 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-20T01:22:32.032 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-20T01:22:32.032 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-20T01:22:32.033 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-20T01:22:32.033 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-20T01:22:32.033 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-20T01:22:32.033 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-20T01:22:32.033 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-20T01:22:32.033 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.inplace_update_support: 0 2024-08-20T01:22:32.033 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-20T01:22:32.033 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-20T01:22:32.033 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-20T01:22:32.033 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-20T01:22:32.033 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.bloom_locality: 0 2024-08-20T01:22:32.033 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.max_successive_merges: 0 2024-08-20T01:22:32.033 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-20T01:22:32.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.paranoid_file_checks: 0 2024-08-20T01:22:32.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.force_consistency_checks: 1 2024-08-20T01:22:32.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.report_bg_io_stats: 0 2024-08-20T01:22:32.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.ttl: 2592000 2024-08-20T01:22:32.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-20T01:22:32.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-20T01:22:32.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-20T01:22:32.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.enable_blob_files: false 2024-08-20T01:22:32.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.min_blob_size: 0 2024-08-20T01:22:32.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.blob_file_size: 268435456 2024-08-20T01:22:32.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-20T01:22:32.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-20T01:22:32.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-20T01:22:32.035 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-20T01:22:32.035 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-20T01:22:32.035 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.blob_file_starting_level: 0 2024-08-20T01:22:32.035 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-20T01:22:32.035 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-20T01:22:32.035 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-20T01:22:32.035 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 26f384fb-4f52-4167-ac34-aedcd150373e 2024-08-20T01:22:32.035 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724116951678552, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-20T01:22:32.035 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-20T01:22:32.035 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724116951678981, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724116951, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "26f384fb-4f52-4167-ac34-aedcd150373e", "db_session_id": "JE7M241NKECFYB8HM0Z9", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-20T01:22:32.035 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724116951679074, "job": 1, "event": "recovery_finished"} 2024-08-20T01:22:32.035 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-20T01:22:32.035 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-20T01:22:32.035 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563bcf6f2e00 2024-08-20T01:22:32.036 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: DB pointer 0x563bcf7f0000 2024-08-20T01:22:32.036 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-20T01:22:32.036 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-20T01:22:32.036 INFO:journalctl@ceph.mon.c.smithi134.stdout: ** DB Stats ** 2024-08-20T01:22:32.036 INFO:journalctl@ceph.mon.c.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-20T01:22:32.036 INFO:journalctl@ceph.mon.c.smithi134.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-20T01:22:32.036 INFO:journalctl@ceph.mon.c.smithi134.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-20T01:22:32.036 INFO:journalctl@ceph.mon.c.smithi134.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-20T01:22:32.036 INFO:journalctl@ceph.mon.c.smithi134.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-20T01:22:32.036 INFO:journalctl@ceph.mon.c.smithi134.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-20T01:22:32.036 INFO:journalctl@ceph.mon.c.smithi134.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-20T01:22:32.036 INFO:journalctl@ceph.mon.c.smithi134.stdout: 2024-08-20T01:22:32.036 INFO:journalctl@ceph.mon.c.smithi134.stdout: ** Compaction Stats [default] ** 2024-08-20T01:22:32.037 INFO:journalctl@ceph.mon.c.smithi134.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-20T01:22:32.037 INFO:journalctl@ceph.mon.c.smithi134.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-20T01:22:32.037 INFO:journalctl@ceph.mon.c.smithi134.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-20T01:22:32.037 INFO:journalctl@ceph.mon.c.smithi134.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-20T01:22:32.037 INFO:journalctl@ceph.mon.c.smithi134.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-20T01:22:32.037 INFO:journalctl@ceph.mon.c.smithi134.stdout: 2024-08-20T01:22:32.037 INFO:journalctl@ceph.mon.c.smithi134.stdout: ** Compaction Stats [default] ** 2024-08-20T01:22:32.037 INFO:journalctl@ceph.mon.c.smithi134.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-20T01:22:32.037 INFO:journalctl@ceph.mon.c.smithi134.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-20T01:22:32.037 INFO:journalctl@ceph.mon.c.smithi134.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-20T01:22:32.037 INFO:journalctl@ceph.mon.c.smithi134.stdout: 2024-08-20T01:22:32.037 INFO:journalctl@ceph.mon.c.smithi134.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-20T01:22:32.037 INFO:journalctl@ceph.mon.c.smithi134.stdout: 2024-08-20T01:22:32.038 INFO:journalctl@ceph.mon.c.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-20T01:22:32.038 INFO:journalctl@ceph.mon.c.smithi134.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-20T01:22:32.038 INFO:journalctl@ceph.mon.c.smithi134.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-20T01:22:32.038 INFO:journalctl@ceph.mon.c.smithi134.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-20T01:22:32.038 INFO:journalctl@ceph.mon.c.smithi134.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-20T01:22:32.038 INFO:journalctl@ceph.mon.c.smithi134.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-20T01:22:32.038 INFO:journalctl@ceph.mon.c.smithi134.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-20T01:22:32.038 INFO:journalctl@ceph.mon.c.smithi134.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-20T01:22:32.038 INFO:journalctl@ceph.mon.c.smithi134.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-20T01:22:32.038 INFO:journalctl@ceph.mon.c.smithi134.stdout: Block cache BinnedLRUCache@0x563bcf6c3610#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-20T01:22:32.038 INFO:journalctl@ceph.mon.c.smithi134.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-20T01:22:32.038 INFO:journalctl@ceph.mon.c.smithi134.stdout: 2024-08-20T01:22:32.039 INFO:journalctl@ceph.mon.c.smithi134.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-20T01:22:32.039 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-08-20T01:22:32.039 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: using public_addr v2:172.21.15.134:0/0 -> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] 2024-08-20T01:22:32.039 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: starting mon.c rank -1 at public addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] at bind addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:22:32.039 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: mon.c@-1(???) e0 preinit fsid 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:22:32.039 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: mon.c@-1(synchronizing).mds e1 new map 2024-08-20T01:22:32.039 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: mon.c@-1(synchronizing).mds e1 print_map 2024-08-20T01:22:32.039 INFO:journalctl@ceph.mon.c.smithi134.stdout: e1 2024-08-20T01:22:32.039 INFO:journalctl@ceph.mon.c.smithi134.stdout: btime 2024-08-20T01:20:55:065563+0000 2024-08-20T01:22:32.039 INFO:journalctl@ceph.mon.c.smithi134.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-20T01:22:32.039 INFO:journalctl@ceph.mon.c.smithi134.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-20T01:22:32.039 INFO:journalctl@ceph.mon.c.smithi134.stdout: legacy client fscid: -1 2024-08-20T01:22:32.039 INFO:journalctl@ceph.mon.c.smithi134.stdout: 2024-08-20T01:22:32.040 INFO:journalctl@ceph.mon.c.smithi134.stdout: No filesystems configured 2024-08-20T01:22:32.040 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-20T01:22:32.040 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-20T01:22:32.040 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-20T01:22:32.040 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-20T01:22:32.040 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-20T01:22:32.040 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-20T01:22:32.040 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-20T01:22:32.040 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T01:22:32.040 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T01:22:32.040 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T01:22:32.040 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: Updating smithi077:/etc/ceph/ceph.conf 2024-08-20T01:22:32.041 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: Deploying cephadm binary to smithi134 2024-08-20T01:22:32.041 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: Updating smithi077:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:22:32.041 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:22:32.041 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:32.041 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:32.041 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:32.041 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: Updating smithi077:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-20T01:22:32.041 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:32.041 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:32.041 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:32.041 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: Added host smithi134 2024-08-20T01:22:32.041 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:22:32.041 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:32.041 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:32.042 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:32.042 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:22:32.042 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:32.042 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/830428057' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-20T01:22:32.042 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/830428057' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-20T01:22:32.042 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T01:22:32.042 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:32.042 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:32.042 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:32.042 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:32.042 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"} : dispatch 2024-08-20T01:22:32.042 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:32.043 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:22:32.043 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:32.043 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: Updating smithi134:/etc/ceph/ceph.conf 2024-08-20T01:22:32.043 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: Updating smithi134:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:22:32.043 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:22:32.043 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:32.043 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:32.043 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:32.043 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:32.043 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:22:32.043 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:32.043 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: Updating smithi134:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-20T01:22:32.043 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi022:172.21.15.22=a;smithi077:172.21.15.77=b;smithi134:172.21.15.134=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:22:32.044 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: Saving service mon spec with placement smithi022:172.21.15.22=a;smithi077:172.21.15.77=b;smithi134:172.21.15.134=c;count:3 2024-08-20T01:22:32.044 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: Deploying daemon mon.c on smithi134 2024-08-20T01:22:32.044 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:32.044 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: from='client.? 172.21.15.134:0/3057221150' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T01:22:32.044 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:32.044 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 ceph-mon[22511]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-20T01:22:32.044 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 bash[22479]: a037ee0751428103f4ac58d8dfd64e679c774dded5d6092686ae0cebe064b11a 2024-08-20T01:22:32.044 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:31 smithi134 systemd[1]: Started Ceph mon.c for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:22:33.352 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-20T01:22:33.352 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-20T01:22:33.615 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:22:37.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:37.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:22:37.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:22:37.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: mon.a calling monitor election 2024-08-20T01:22:37.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:22:37.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:37.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:22:37.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: mon.c calling monitor election 2024-08-20T01:22:37.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:22:37.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:37.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:22:37.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:22:37.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-20T01:22:37.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: monmap epoch 2 2024-08-20T01:22:37.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: fsid 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:22:37.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: last_changed 2024-08-20T01:22:31.704763+0000 2024-08-20T01:22:37.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: created 2024-08-20T01:20:52.092445+0000 2024-08-20T01:22:37.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: min_mon_release 19 (squid) 2024-08-20T01:22:37.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: election_strategy: 1 2024-08-20T01:22:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-08-20T01:22:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-08-20T01:22:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: fsmap 2024-08-20T01:22:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T01:22:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: mgrmap e13: x(active, since 43s) 2024-08-20T01:22:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: overall HEALTH_OK 2024-08-20T01:22:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:22:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:36 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:37.217 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:37.218 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:22:37.218 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:22:37.218 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: mon.a calling monitor election 2024-08-20T01:22:37.218 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:22:37.218 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:37.218 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:22:37.218 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: mon.c calling monitor election 2024-08-20T01:22:37.218 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:22:37.218 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:37.218 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:22:37.218 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:22:37.219 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-20T01:22:37.219 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: monmap epoch 2 2024-08-20T01:22:37.219 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: fsid 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:22:37.219 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: last_changed 2024-08-20T01:22:31.704763+0000 2024-08-20T01:22:37.219 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: created 2024-08-20T01:20:52.092445+0000 2024-08-20T01:22:37.219 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: min_mon_release 19 (squid) 2024-08-20T01:22:37.219 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: election_strategy: 1 2024-08-20T01:22:37.219 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-08-20T01:22:37.219 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-08-20T01:22:37.219 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: fsmap 2024-08-20T01:22:37.219 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T01:22:37.219 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: mgrmap e13: x(active, since 43s) 2024-08-20T01:22:37.219 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: overall HEALTH_OK 2024-08-20T01:22:37.219 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:37.219 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:37.219 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:37.220 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:22:37.220 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:36 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:37.300 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:22:37.300 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":2,"fsid":"586fd06c-5e92-11ef-bccf-c7b262605968","modified":"2024-08-20T01:22:31.704763Z","created":"2024-08-20T01:20:52.092445Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-20T01:22:37.301 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 2 2024-08-20T01:22:37.862 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:37 smithi134 ceph-mon[22511]: Deploying daemon mon.b on smithi077 2024-08-20T01:22:37.862 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:37 smithi134 ceph-mon[22511]: from='client.? 172.21.15.134:0/2260716810' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T01:22:37.862 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:37 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:22:38.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:37 smithi022 ceph-mon[18709]: Deploying daemon mon.b on smithi077 2024-08-20T01:22:38.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:37 smithi022 ceph-mon[18709]: from='client.? 172.21.15.134:0/2260716810' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T01:22:38.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:37 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:22:38.890 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-20T01:22:38.891 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-20T01:22:39.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:38 smithi022 ceph-mon[18709]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:39.142 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:22:39.263 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:38 smithi134 ceph-mon[22511]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:39.810 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:22:39.810 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":2,"fsid":"586fd06c-5e92-11ef-bccf-c7b262605968","modified":"2024-08-20T01:22:31.704763Z","created":"2024-08-20T01:20:52.092445Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-20T01:22:39.810 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 2 2024-08-20T01:22:40.428 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:40 smithi077 ceph-mon[22251]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-20T01:22:40.428 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:40 smithi077 bash[22232]: 6fa4dc818e4be9623f12a750e3647c2ede07c4e1c39a998dd5ad577aa62f36b4 2024-08-20T01:22:40.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:40 smithi077 systemd[1]: Started Ceph mon.b for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:22:41.374 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-20T01:22:41.375 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-20T01:22:41.628 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:22:45.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:22:45.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: mon.a calling monitor election 2024-08-20T01:22:45.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:45.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:22:45.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: mon.c calling monitor election 2024-08-20T01:22:45.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:45.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:45.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:45.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: mon.b calling monitor election 2024-08-20T01:22:45.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:45.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:45.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:45.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:45.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-20T01:22:45.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: monmap epoch 3 2024-08-20T01:22:45.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: fsid 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:22:45.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: last_changed 2024-08-20T01:22:40.401618+0000 2024-08-20T01:22:45.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: created 2024-08-20T01:20:52.092445+0000 2024-08-20T01:22:45.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: min_mon_release 19 (squid) 2024-08-20T01:22:45.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: election_strategy: 1 2024-08-20T01:22:45.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-08-20T01:22:45.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-08-20T01:22:45.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: 2: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-08-20T01:22:45.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: fsmap 2024-08-20T01:22:45.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T01:22:45.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: mgrmap e13: x(active, since 52s) 2024-08-20T01:22:45.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: overall HEALTH_OK 2024-08-20T01:22:45.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:45.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:45.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:45.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:45 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:45.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:22:45.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: mon.a calling monitor election 2024-08-20T01:22:45.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:45.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:22:45.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: mon.c calling monitor election 2024-08-20T01:22:45.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:45.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:45.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:45.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: mon.b calling monitor election 2024-08-20T01:22:45.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:45.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:45.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:45.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:45.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-20T01:22:45.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: monmap epoch 3 2024-08-20T01:22:45.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: fsid 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:22:45.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: last_changed 2024-08-20T01:22:40.401618+0000 2024-08-20T01:22:45.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: created 2024-08-20T01:20:52.092445+0000 2024-08-20T01:22:45.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: min_mon_release 19 (squid) 2024-08-20T01:22:45.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: election_strategy: 1 2024-08-20T01:22:45.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-08-20T01:22:45.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-08-20T01:22:45.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: 2: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-08-20T01:22:45.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: fsmap 2024-08-20T01:22:45.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T01:22:45.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: mgrmap e13: x(active, since 52s) 2024-08-20T01:22:45.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: overall HEALTH_OK 2024-08-20T01:22:45.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:45.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:45.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:45.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:45 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:45.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:22:45.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: mon.a calling monitor election 2024-08-20T01:22:45.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:45.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:22:45.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: mon.c calling monitor election 2024-08-20T01:22:45.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:45.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:45.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:45.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: mon.b calling monitor election 2024-08-20T01:22:45.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:45.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:45.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:45.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:45.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-20T01:22:45.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: monmap epoch 3 2024-08-20T01:22:45.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: fsid 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:22:45.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: last_changed 2024-08-20T01:22:40.401618+0000 2024-08-20T01:22:45.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: created 2024-08-20T01:20:52.092445+0000 2024-08-20T01:22:45.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: min_mon_release 19 (squid) 2024-08-20T01:22:45.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: election_strategy: 1 2024-08-20T01:22:45.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-08-20T01:22:45.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-08-20T01:22:45.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: 2: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-08-20T01:22:45.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: fsmap 2024-08-20T01:22:45.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T01:22:45.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: mgrmap e13: x(active, since 52s) 2024-08-20T01:22:45.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: overall HEALTH_OK 2024-08-20T01:22:45.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:45.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:45.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:45.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:45 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:45.888 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:22:45.888 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":3,"fsid":"586fd06c-5e92-11ef-bccf-c7b262605968","modified":"2024-08-20T01:22:40.401618Z","created":"2024-08-20T01:20:52.092445Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-08-20T01:22:45.888 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 3 2024-08-20T01:22:46.467 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-20T01:22:46.467 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config generate-minimal-conf 2024-08-20T01:22:46.722 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:46.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:46 smithi134 ceph-mon[22511]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:46.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:46 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:22:46.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:46 smithi134 ceph-mon[22511]: from='client.? 172.21.15.134:0/118579998' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T01:22:46.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:46 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:46.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:46 smithi077 ceph-mon[22251]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:46.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:46 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:22:46.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:46 smithi077 ceph-mon[22251]: from='client.? 172.21.15.134:0/118579998' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T01:22:46.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:46 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:46.843 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:46 smithi022 ceph-mon[18709]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:46.843 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:46 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:22:46.843 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:46 smithi022 ceph-mon[18709]: from='client.? 172.21.15.134:0/118579998' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T01:22:46.843 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:46 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:22:47.372 INFO:teuthology.orchestra.run.smithi022.stdout:# minimal ceph.conf for 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:22:47.372 INFO:teuthology.orchestra.run.smithi022.stdout:[global] 2024-08-20T01:22:47.372 INFO:teuthology.orchestra.run.smithi022.stdout: fsid = 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:22:47.372 INFO:teuthology.orchestra.run.smithi022.stdout: mon_host = [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] 2024-08-20T01:22:47.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:47 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:47.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:47 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:47.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:47 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:47.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:47 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:47.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:47 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:47.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:47 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:22:47.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:47 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/63581748' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:47.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:47 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:47.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:47 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:47.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:47 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:47.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:47 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:47.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:47 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:47.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:47 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:22:47.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:47 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/63581748' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:48.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:47 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:47 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:47 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:47 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:47 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:48.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:47 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:22:48.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:47 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/63581748' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:48.059 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-20T01:22:48.059 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-08-20T01:22:48.059 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.conf 2024-08-20T01:22:48.090 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-08-20T01:22:48.091 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:22:48.157 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-08-20T01:22:48.157 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.conf 2024-08-20T01:22:48.185 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-08-20T01:22:48.185 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:22:48.251 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-08-20T01:22:48.251 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.conf 2024-08-20T01:22:48.279 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-08-20T01:22:48.279 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:22:48.345 INFO:tasks.cephadm:Adding mgr.x on smithi022 2024-08-20T01:22:48.345 INFO:tasks.cephadm:Adding mgr.y on smithi077 2024-08-20T01:22:48.345 INFO:tasks.cephadm:Adding mgr.z on smithi134 2024-08-20T01:22:48.345 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch apply mgr '3;smithi022=x;smithi077=y;smithi134=z' 2024-08-20T01:22:48.623 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:22:48.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: Updating smithi022:/etc/ceph/ceph.conf 2024-08-20T01:22:48.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: Updating smithi077:/etc/ceph/ceph.conf 2024-08-20T01:22:48.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: Updating smithi134:/etc/ceph/ceph.conf 2024-08-20T01:22:48.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:48.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: Updating smithi077:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:22:48.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: Updating smithi134:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:22:48.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: Updating smithi022:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:22:48.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: Reconfiguring mon.a (unknown last config time)... 2024-08-20T01:22:48.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:22:48.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T01:22:48.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:48.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:48 smithi022 ceph-mon[18709]: Reconfiguring daemon mon.a on smithi022 2024-08-20T01:22:48.863 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: Updating smithi022:/etc/ceph/ceph.conf 2024-08-20T01:22:48.863 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: Updating smithi077:/etc/ceph/ceph.conf 2024-08-20T01:22:48.863 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: Updating smithi134:/etc/ceph/ceph.conf 2024-08-20T01:22:48.863 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:48.863 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: Updating smithi077:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:22:48.863 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: Updating smithi134:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:22:48.863 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: Updating smithi022:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:22:48.863 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.863 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.863 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.864 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.864 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.864 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.864 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.864 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.864 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.864 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.864 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:48.864 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: Reconfiguring mon.a (unknown last config time)... 2024-08-20T01:22:48.864 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:22:48.864 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T01:22:48.864 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:48.864 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:48 smithi134 ceph-mon[22511]: Reconfiguring daemon mon.a on smithi022 2024-08-20T01:22:49.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: Updating smithi022:/etc/ceph/ceph.conf 2024-08-20T01:22:49.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: Updating smithi077:/etc/ceph/ceph.conf 2024-08-20T01:22:49.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: Updating smithi134:/etc/ceph/ceph.conf 2024-08-20T01:22:49.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:49.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: Updating smithi077:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:22:49.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: Updating smithi134:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:22:49.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: Updating smithi022:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:22:49.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:49.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:49.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: Reconfiguring mon.a (unknown last config time)... 2024-08-20T01:22:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:22:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T01:22:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:48 smithi077 ceph-mon[22251]: Reconfiguring daemon mon.a on smithi022 2024-08-20T01:22:49.220 INFO:teuthology.orchestra.run.smithi134.stdout:Scheduled mgr update... 2024-08-20T01:22:49.802 DEBUG:teuthology.orchestra.run.smithi077:mgr.y> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mgr.y.service 2024-08-20T01:22:49.804 DEBUG:teuthology.orchestra.run.smithi134:mgr.z> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mgr.z.service 2024-08-20T01:22:49.806 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-08-20T01:22:49.807 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-08-20T01:22:49.809 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-08-20T01:22:49.809 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set client debug_client 20 2024-08-20T01:22:49.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:49.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:49.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:49.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:22:49.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T01:22:49.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:49.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:49.852 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-08-20T01:22:49.852 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set client debug_ms 1 2024-08-20T01:22:49.895 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-08-20T01:22:49.895 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-08-20T01:22:49.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:49.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:49.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:49.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:22:49.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T01:22:49.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:49.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:49.917 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-08-20T01:22:49.917 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-08-20T01:22:49.960 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-08-20T01:22:49.961 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set mds debug_mds 20 2024-08-20T01:22:50.003 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-08-20T01:22:50.003 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-08-20T01:22:50.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:50.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:50.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:50.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:22:50.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T01:22:50.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:50.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:50.047 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-08-20T01:22:50.047 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set mds debug_ms 2 2024-08-20T01:22:50.090 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-08-20T01:22:50.091 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-08-20T01:22:50.134 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-08-20T01:22:50.135 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-08-20T01:22:50.162 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:50.171 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-08-20T01:22:50.171 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-08-20T01:22:50.221 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-08-20T01:22:50.221 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-08-20T01:22:50.221 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:50.273 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-08-20T01:22:50.273 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-08-20T01:22:50.330 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-08-20T01:22:50.330 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-08-20T01:22:50.377 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-08-20T01:22:50.378 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-08-20T01:22:50.422 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-08-20T01:22:50.422 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-08-20T01:22:50.474 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-08-20T01:22:50.474 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-08-20T01:22:50.520 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-08-20T01:22:50.521 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-08-20T01:22:50.569 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-08-20T01:22:50.569 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-08-20T01:22:50.615 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-08-20T01:22:50.615 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-08-20T01:22:50.675 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-08-20T01:22:50.676 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-08-20T01:22:50.725 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-08-20T01:22:50.725 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-08-20T01:22:50.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:50 smithi022 ceph-mon[18709]: Reconfiguring mon.b (monmap changed)... 2024-08-20T01:22:50.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:50 smithi022 ceph-mon[18709]: Reconfiguring daemon mon.b on smithi077 2024-08-20T01:22:50.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:50 smithi022 ceph-mon[18709]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi022=x;smithi077=y;smithi134=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:22:50.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:50 smithi022 ceph-mon[18709]: Saving service mgr spec with placement smithi022=x;smithi077=y;smithi134=z;count:3 2024-08-20T01:22:50.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:50 smithi022 ceph-mon[18709]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:50.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:50 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:50.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:50 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:50.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:50 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:22:50.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:50 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T01:22:50.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:50 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:50.762 DEBUG:tasks.cephadm:set 22 configs 2024-08-20T01:22:50.762 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi022') 2024-08-20T01:22:51.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:50 smithi134 ceph-mon[22511]: Reconfiguring mon.b (monmap changed)... 2024-08-20T01:22:51.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:50 smithi134 ceph-mon[22511]: Reconfiguring daemon mon.b on smithi077 2024-08-20T01:22:51.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:50 smithi134 ceph-mon[22511]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi022=x;smithi077=y;smithi134=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:22:51.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:50 smithi134 ceph-mon[22511]: Saving service mgr spec with placement smithi022=x;smithi077=y;smithi134=z;count:3 2024-08-20T01:22:51.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:50 smithi134 ceph-mon[22511]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:51.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:50 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:51.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:50 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:51.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:50 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:22:51.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:50 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T01:22:51.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:50 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:51.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:50 smithi077 ceph-mon[22251]: Reconfiguring mon.b (monmap changed)... 2024-08-20T01:22:51.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:50 smithi077 ceph-mon[22251]: Reconfiguring daemon mon.b on smithi077 2024-08-20T01:22:51.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:50 smithi077 ceph-mon[22251]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi022=x;smithi077=y;smithi134=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:22:51.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:50 smithi077 ceph-mon[22251]: Saving service mgr spec with placement smithi022=x;smithi077=y;smithi134=z;count:3 2024-08-20T01:22:51.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:50 smithi077 ceph-mon[22251]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:51.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:50 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:51.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:50 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:51.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:50 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:22:51.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:50 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T01:22:51.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:50 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:51.898 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:51 smithi134 ceph-mon[22511]: Reconfiguring mon.c (monmap changed)... 2024-08-20T01:22:51.898 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:51 smithi134 ceph-mon[22511]: Reconfiguring daemon mon.c on smithi134 2024-08-20T01:22:51.899 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:51 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/608562544' entity='client.admin' 2024-08-20T01:22:51.899 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:51 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:51.899 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:51 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:51.899 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:51 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:22:51.899 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:51 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:51.900 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:51 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:22:51.900 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:51 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:51.900 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:51 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T01:22:51.900 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:51 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-20T01:22:51.900 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:51 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T01:22:51.901 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:51 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:51.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:51 smithi022 ceph-mon[18709]: Reconfiguring mon.c (monmap changed)... 2024-08-20T01:22:51.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:51 smithi022 ceph-mon[18709]: Reconfiguring daemon mon.c on smithi134 2024-08-20T01:22:51.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:51 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/608562544' entity='client.admin' 2024-08-20T01:22:51.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:51 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:51.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:51 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:51.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:51 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:22:51.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:51 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:51.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:51 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:22:51.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:51 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:51.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:51 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T01:22:51.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:51 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-20T01:22:51.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:51 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T01:22:51.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:51 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:51.944 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi022') 2024-08-20T01:22:52.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:51 smithi077 ceph-mon[22251]: Reconfiguring mon.c (monmap changed)... 2024-08-20T01:22:52.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:51 smithi077 ceph-mon[22251]: Reconfiguring daemon mon.c on smithi134 2024-08-20T01:22:52.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:51 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/608562544' entity='client.admin' 2024-08-20T01:22:52.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:51 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:52.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:51 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:52.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:51 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:22:52.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:51 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:52.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:51 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:22:52.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:51 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:52.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:51 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T01:22:52.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:51 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-20T01:22:52.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:51 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T01:22:52.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:51 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:52.473 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi022') 2024-08-20T01:22:52.519 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:52.578 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:52.881 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:52 smithi134 ceph-mon[22511]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:52.881 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:52 smithi134 ceph-mon[22511]: Deploying daemon mgr.z on smithi134 2024-08-20T01:22:52.881 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:52 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/500403664' entity='client.admin' 2024-08-20T01:22:52.970 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:52 smithi022 ceph-mon[18709]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:52.970 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:52 smithi022 ceph-mon[18709]: Deploying daemon mgr.z on smithi134 2024-08-20T01:22:52.970 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:52 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/500403664' entity='client.admin' 2024-08-20T01:22:53.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:52 smithi077 ceph-mon[22251]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:53.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:52 smithi077 ceph-mon[22251]: Deploying daemon mgr.z on smithi134 2024-08-20T01:22:53.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:52 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/500403664' entity='client.admin' 2024-08-20T01:22:53.247 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Aug 20 01:22:53 smithi134 systemd[1]: Starting Ceph mgr.z for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:22:53.358 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:53.358 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:53.359 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:53.359 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:53.507 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Aug 20 01:22:53 smithi134 podman[24078]: 2024-08-20 01:22:53.247904042 +0000 UTC m=+0.103029980 container create 125dd5d7faf052106d7b878e3a00777c8363fcd15cee085acdaee05ddfc76248 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:22:53.507 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Aug 20 01:22:53 smithi134 podman[24078]: 2024-08-20 01:22:53.160653231 +0000 UTC m=+0.015779171 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:22:53.507 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Aug 20 01:22:53 smithi134 podman[24078]: 2024-08-20 01:22:53.441858549 +0000 UTC m=+0.296984487 container init 125dd5d7faf052106d7b878e3a00777c8363fcd15cee085acdaee05ddfc76248 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T01:22:53.507 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Aug 20 01:22:53 smithi134 podman[24078]: 2024-08-20 01:22:53.445199575 +0000 UTC m=+0.300325513 container start 125dd5d7faf052106d7b878e3a00777c8363fcd15cee085acdaee05ddfc76248 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:22:53.508 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Aug 20 01:22:53 smithi134 ceph-mgr[24097]: -- 172.21.15.134:0/3566262519 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c406fbb0e0 con 0x55c406f99400 2024-08-20T01:22:53.508 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Aug 20 01:22:53 smithi134 bash[24078]: 125dd5d7faf052106d7b878e3a00777c8363fcd15cee085acdaee05ddfc76248 2024-08-20T01:22:53.764 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Aug 20 01:22:53 smithi134 systemd[1]: Started Ceph mgr.z for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:22:54.703 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:54 smithi077 ceph-mon[22251]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:54.703 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:54 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2805689334' entity='client.admin' 2024-08-20T01:22:54.704 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:54.704 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:54.704 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:54.704 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T01:22:54.704 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-20T01:22:54.704 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T01:22:54.704 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:54.704 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:54 smithi077 ceph-mon[22251]: Deploying daemon mgr.y on smithi077 2024-08-20T01:22:54.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:54 smithi022 ceph-mon[18709]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:54.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:54 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2805689334' entity='client.admin' 2024-08-20T01:22:54.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:54.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:54.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:54.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T01:22:54.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-20T01:22:54.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T01:22:54.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:54.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:54 smithi022 ceph-mon[18709]: Deploying daemon mgr.y on smithi077 2024-08-20T01:22:55.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:54 smithi134 ceph-mon[22511]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:55.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:54 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2805689334' entity='client.admin' 2024-08-20T01:22:55.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:55.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:55.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:55.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T01:22:55.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-20T01:22:55.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T01:22:55.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:55.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:54 smithi134 ceph-mon[22511]: Deploying daemon mgr.y on smithi077 2024-08-20T01:22:55.681 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:55 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3838058342' entity='client.admin' 2024-08-20T01:22:55.681 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:55 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/624563550' entity='client.admin' 2024-08-20T01:22:55.746 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:55 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3838058342' entity='client.admin' 2024-08-20T01:22:55.746 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:55 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/624563550' entity='client.admin' 2024-08-20T01:22:56.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:55 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3838058342' entity='client.admin' 2024-08-20T01:22:56.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:55 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/624563550' entity='client.admin' 2024-08-20T01:22:56.062 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Aug 20 01:22:55 smithi077 systemd[1]: Started Ceph mgr.y for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:22:56.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.655+0000 7f0357e20640 1 -- 172.21.15.22:0/2840016937 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f033c03ed60 msgr2=0x7f033c041220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:22:56.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.655+0000 7f0357e20640 1 --2- 172.21.15.22:0/2840016937 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f033c03ed60 0x7f033c041220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f034c009fc0 tx=0x7f034c005f90 comp rx=0 tx=0).stop 2024-08-20T01:22:56.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.655+0000 7f0357e20640 1 -- 172.21.15.22:0/2840016937 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03501038a0 msgr2=0x7f0350198fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:22:56.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.655+0000 7f0357e20640 1 --2- 172.21.15.22:0/2840016937 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03501038a0 0x7f0350198fa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0340004770 tx=0x7f03400042f0 comp rx=0 tx=0).stop 2024-08-20T01:22:56.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.655+0000 7f0357e20640 1 -- 172.21.15.22:0/2840016937 shutdown_connections 2024-08-20T01:22:56.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.655+0000 7f0357e20640 1 --2- 172.21.15.22:0/2840016937 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f033c03ed60 0x7f033c041220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:56.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.655+0000 7f0357e20640 1 --2- 172.21.15.22:0/2840016937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0350104260 0x7f0350199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:56.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.655+0000 7f0357e20640 1 --2- 172.21.15.22:0/2840016937 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03501038a0 0x7f0350198fa0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:56.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.655+0000 7f0357e20640 1 --2- 172.21.15.22:0/2840016937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0350102740 0x7f0350198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:56.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.655+0000 7f0357e20640 1 -- 172.21.15.22:0/2840016937 >> 172.21.15.22:0/2840016937 conn(0x7f03500fdff0 msgr2=0x7f0350106cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:22:56.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.655+0000 7f0357e20640 1 -- 172.21.15.22:0/2840016937 shutdown_connections 2024-08-20T01:22:56.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.656+0000 7f0357e20640 1 -- 172.21.15.22:0/2840016937 wait complete. 2024-08-20T01:22:56.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.830+0000 7f94bbefe640 1 -- 172.21.15.22:0/4173565409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f94b4108e70 con 0x7f94b4102770 2024-08-20T01:22:56.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.833+0000 7f94aaffd640 1 -- 172.21.15.22:0/4173565409 <== mon.0 v2:172.21.15.22:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v16)=0 v16) ==== 120+0+0 (secure 0 0 0) 0x7f94a401c030 con 0x7f94b4102770 2024-08-20T01:22:56.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.835+0000 7f94bbefe640 1 -- 172.21.15.22:0/4173565409 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f94a003ed60 msgr2=0x7f94a0041220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:22:56.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.835+0000 7f94bbefe640 1 --2- 172.21.15.22:0/4173565409 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f94a003ed60 0x7f94a0041220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f94b0006010 tx=0x7f94b0004ef0 comp rx=0 tx=0).stop 2024-08-20T01:22:56.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.835+0000 7f94bbefe640 1 -- 172.21.15.22:0/4173565409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94b4102770 msgr2=0x7f94b4199000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:22:56.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.835+0000 7f94bbefe640 1 --2- 172.21.15.22:0/4173565409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94b4102770 0x7f94b4199000 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f94a400d950 tx=0x7f94a400de10 comp rx=0 tx=0).stop 2024-08-20T01:22:56.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.835+0000 7f94bbefe640 1 -- 172.21.15.22:0/4173565409 shutdown_connections 2024-08-20T01:22:56.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.835+0000 7f94bbefe640 1 --2- 172.21.15.22:0/4173565409 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f94a003ed60 0x7f94a0041220 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:56.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.835+0000 7f94bbefe640 1 --2- 172.21.15.22:0/4173565409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94b4103130 0x7f94b4199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:56.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.835+0000 7f94bbefe640 1 --2- 172.21.15.22:0/4173565409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94b4102770 0x7f94b4199000 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:56.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.835+0000 7f94bbefe640 1 --2- 172.21.15.22:0/4173565409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94b4101610 0x7f94b41989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:56.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.835+0000 7f94bbefe640 1 -- 172.21.15.22:0/4173565409 >> 172.21.15.22:0/4173565409 conn(0x7f94b40fcee0 msgr2=0x7f94b40fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:22:56.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.835+0000 7f94bbefe640 1 -- 172.21.15.22:0/4173565409 shutdown_connections 2024-08-20T01:22:56.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:56.835+0000 7f94bbefe640 1 -- 172.21.15.22:0/4173565409 wait complete. 2024-08-20T01:22:57.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:56 smithi077 ceph-mon[22251]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:57.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:56 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:57.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:56 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:57.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:56 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:57.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:56 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:57.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:56 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:22:57.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:56 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2840016937' entity='client.admin' 2024-08-20T01:22:57.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:56 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/4173565409' entity='client.admin' 2024-08-20T01:22:57.203 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:56 smithi022 ceph-mon[18709]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:57.203 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:56 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:57.203 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:56 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:57.203 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:56 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:57.203 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:56 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:57.203 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:56 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:22:57.203 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:56 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2840016937' entity='client.admin' 2024-08-20T01:22:57.203 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:56 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/4173565409' entity='client.admin' 2024-08-20T01:22:57.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:56 smithi134 ceph-mon[22511]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:57.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:56 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:57.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:56 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:57.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:56 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:57.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:56 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:57.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:56 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:22:57.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:56 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2840016937' entity='client.admin' 2024-08-20T01:22:57.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:56 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/4173565409' entity='client.admin' 2024-08-20T01:22:57.863 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi022') 2024-08-20T01:22:57.863 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi022') 2024-08-20T01:22:57.990 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:57.991 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:57.991 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:57.996 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:57.996 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:57.996 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:58.012 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:58.012 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:58.012 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:58.016 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:58.020 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:58.020 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:58.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:58.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:58.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:58.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:58.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:58.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:22:58.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:58.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:58 smithi022 ceph-mon[18709]: Reconfiguring mgr.x (unknown last config time)... 2024-08-20T01:22:58.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T01:22:58.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T01:22:58.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:58.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:58 smithi022 ceph-mon[18709]: Reconfiguring daemon mgr.x on smithi022 2024-08-20T01:22:58.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:58 smithi022 ceph-mon[18709]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:58.207 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:58.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.212+0000 7f9b57887640 1 -- 172.21.15.22:0/4159371173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b50103160 msgr2=0x7f9b50109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:22:58.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.212+0000 7f9b57887640 1 --2- 172.21.15.22:0/4159371173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b50103160 0x7f9b50109c10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9b48009ca0 tx=0x7f9b4802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:22:58.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.213+0000 7f9b57887640 1 -- 172.21.15.22:0/4159371173 shutdown_connections 2024-08-20T01:22:58.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.213+0000 7f9b57887640 1 --2- 172.21.15.22:0/4159371173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b50103160 0x7f9b50109c10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:58.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.213+0000 7f9b57887640 1 --2- 172.21.15.22:0/4159371173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b50102550 0x7f9b501029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:58.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.213+0000 7f9b57887640 1 --2- 172.21.15.22:0/4159371173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b50101c10 0x7f9b50102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:58.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.213+0000 7f9b57887640 1 -- 172.21.15.22:0/4159371173 >> 172.21.15.22:0/4159371173 conn(0x7f9b500fc670 msgr2=0x7f9b500feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:22:58.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.213+0000 7f9b57887640 1 -- 172.21.15.22:0/4159371173 shutdown_connections 2024-08-20T01:22:58.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.213+0000 7f9b57887640 1 -- 172.21.15.22:0/4159371173 wait complete. 2024-08-20T01:22:58.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.214+0000 7f9b57887640 1 Processor -- start 2024-08-20T01:22:58.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.214+0000 7f9b57887640 1 -- start start 2024-08-20T01:22:58.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.214+0000 7f9b57887640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b50101c10 0x7f9b501011e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:22:58.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.214+0000 7f9b57887640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b50102550 0x7f9b5019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:22:58.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.214+0000 7f9b57887640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b50103160 0x7f9b5019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:22:58.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.214+0000 7f9b57887640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5010d120 con 0x7f9b50103160 2024-08-20T01:22:58.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.214+0000 7f9b57887640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5010cfa0 con 0x7f9b50101c10 2024-08-20T01:22:58.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.214+0000 7f9b57887640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5010d2a0 con 0x7f9b50102550 2024-08-20T01:22:58.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.214+0000 7f9b55623640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b50101c10 0x7f9b501011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:22:58.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.214+0000 7f9b55623640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b50101c10 0x7f9b501011e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:36912/0 (socket says 172.21.15.22:36912) 2024-08-20T01:22:58.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.214+0000 7f9b55623640 1 -- 172.21.15.22:0/471405335 learned_addr learned my addr 172.21.15.22:0/471405335 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:22:58.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.215+0000 7f9b54e22640 1 --2- 172.21.15.22:0/471405335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b50102550 0x7f9b5019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:22:58.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.215+0000 7f9b55e24640 1 --2- 172.21.15.22:0/471405335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b50103160 0x7f9b5019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:22:58.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.215+0000 7f9b54e22640 1 -- 172.21.15.22:0/471405335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b50101c10 msgr2=0x7f9b501011e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:22:58.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.215+0000 7f9b54e22640 1 --2- 172.21.15.22:0/471405335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b50101c10 0x7f9b501011e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:58.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.215+0000 7f9b54e22640 1 -- 172.21.15.22:0/471405335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b50103160 msgr2=0x7f9b5019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:22:58.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.215+0000 7f9b54e22640 1 --2- 172.21.15.22:0/471405335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b50103160 0x7f9b5019fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:58.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.215+0000 7f9b54e22640 1 -- 172.21.15.22:0/471405335 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b501a0540 con 0x7f9b50102550 2024-08-20T01:22:58.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.215+0000 7f9b54e22640 1 --2- 172.21.15.22:0/471405335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b50102550 0x7f9b5019d690 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9b40005fd0 tx=0x7f9b4000dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:22:58.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.216+0000 7f9b467fc640 1 -- 172.21.15.22:0/471405335 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b40009c30 con 0x7f9b50102550 2024-08-20T01:22:58.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.216+0000 7f9b57887640 1 -- 172.21.15.22:0/471405335 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b501a0830 con 0x7f9b50102550 2024-08-20T01:22:58.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.216+0000 7f9b467fc640 1 -- 172.21.15.22:0/471405335 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9b400044c0 con 0x7f9b50102550 2024-08-20T01:22:58.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.216+0000 7f9b467fc640 1 -- 172.21.15.22:0/471405335 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b40003d80 con 0x7f9b50102550 2024-08-20T01:22:58.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.216+0000 7f9b57887640 1 -- 172.21.15.22:0/471405335 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b501a0dc0 con 0x7f9b50102550 2024-08-20T01:22:58.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.217+0000 7f9b467fc640 1 -- 172.21.15.22:0/471405335 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7f9b40010460 con 0x7f9b50102550 2024-08-20T01:22:58.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.217+0000 7f9b467fc640 1 --2- 172.21.15.22:0/471405335 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9b3c03ed60 0x7f9b3c041220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:22:58.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.217+0000 7f9b467fc640 1 -- 172.21.15.22:0/471405335 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9b40053bd0 con 0x7f9b50102550 2024-08-20T01:22:58.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.217+0000 7f9b57887640 1 -- 172.21.15.22:0/471405335 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b50108af0 con 0x7f9b50102550 2024-08-20T01:22:58.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.217+0000 7f9b55623640 1 --2- 172.21.15.22:0/471405335 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9b3c03ed60 0x7f9b3c041220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:22:58.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.218+0000 7f9b55623640 1 --2- 172.21.15.22:0/471405335 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9b3c03ed60 0x7f9b3c041220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c005fd0 tx=0x7f9b4c00b2c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:22:58.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.222+0000 7f9b467fc640 1 -- 172.21.15.22:0/471405335 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f9b40017020 con 0x7f9b50102550 2024-08-20T01:22:58.225 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:22:58.312 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:58.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:58.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:58.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:58.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:58.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:22:58.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:58.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:58 smithi077 ceph-mon[22251]: Reconfiguring mgr.x (unknown last config time)... 2024-08-20T01:22:58.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T01:22:58.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T01:22:58.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:58.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:58 smithi077 ceph-mon[22251]: Reconfiguring daemon mgr.x on smithi022 2024-08-20T01:22:58.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:58 smithi077 ceph-mon[22251]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:58.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.416+0000 7f9b57887640 1 -- 172.21.15.22:0/471405335 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f9b50063a80 con 0x7f9b50102550 2024-08-20T01:22:58.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.420+0000 7f9b467fc640 1 -- 172.21.15.22:0/471405335 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v17)=0 v17) ==== 106+0+0 (secure 0 0 0) 0x7f9b40018260 con 0x7f9b50102550 2024-08-20T01:22:58.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.423+0000 7f9b57887640 1 -- 172.21.15.22:0/471405335 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9b3c03ed60 msgr2=0x7f9b3c041220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:22:58.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.423+0000 7f9b57887640 1 --2- 172.21.15.22:0/471405335 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9b3c03ed60 0x7f9b3c041220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c005fd0 tx=0x7f9b4c00b2c0 comp rx=0 tx=0).stop 2024-08-20T01:22:58.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.423+0000 7f9b57887640 1 -- 172.21.15.22:0/471405335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b50102550 msgr2=0x7f9b5019d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:22:58.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.423+0000 7f9b57887640 1 --2- 172.21.15.22:0/471405335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b50102550 0x7f9b5019d690 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9b40005fd0 tx=0x7f9b4000dde0 comp rx=0 tx=0).stop 2024-08-20T01:22:58.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.423+0000 7f9b57887640 1 -- 172.21.15.22:0/471405335 shutdown_connections 2024-08-20T01:22:58.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.423+0000 7f9b57887640 1 --2- 172.21.15.22:0/471405335 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9b3c03ed60 0x7f9b3c041220 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:58.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.423+0000 7f9b57887640 1 --2- 172.21.15.22:0/471405335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b50103160 0x7f9b5019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:58.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.423+0000 7f9b57887640 1 --2- 172.21.15.22:0/471405335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b50102550 0x7f9b5019d690 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:58.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.423+0000 7f9b57887640 1 --2- 172.21.15.22:0/471405335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b50101c10 0x7f9b501011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:58.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.423+0000 7f9b57887640 1 -- 172.21.15.22:0/471405335 >> 172.21.15.22:0/471405335 conn(0x7f9b500fc670 msgr2=0x7f9b50105cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:22:58.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.423+0000 7f9b57887640 1 -- 172.21.15.22:0/471405335 shutdown_connections 2024-08-20T01:22:58.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.423+0000 7f9b57887640 1 -- 172.21.15.22:0/471405335 wait complete. 2024-08-20T01:22:58.514 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:58.514 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:58.514 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:58.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:58.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:58.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:22:58.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:58.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:58 smithi134 ceph-mon[22511]: Reconfiguring mgr.x (unknown last config time)... 2024-08-20T01:22:58.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T01:22:58.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T01:22:58.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:22:58.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:58 smithi134 ceph-mon[22511]: Reconfiguring daemon mgr.x on smithi022 2024-08-20T01:22:58.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:58 smithi134 ceph-mon[22511]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:22:58.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.994+0000 7fd947cec640 1 -- 172.21.15.22:0/1955197702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd940104260 msgr2=0x7fd94010abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:22:58.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.994+0000 7fd947cec640 1 --2- 172.21.15.22:0/1955197702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd940104260 0x7fd94010abe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd930009cd0 tx=0x7fd93002a8e0 comp rx=0 tx=0).stop 2024-08-20T01:22:58.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.994+0000 7fd947cec640 1 -- 172.21.15.22:0/1955197702 shutdown_connections 2024-08-20T01:22:58.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.994+0000 7fd947cec640 1 --2- 172.21.15.22:0/1955197702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd940104260 0x7fd94010abe0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:58.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.994+0000 7fd947cec640 1 --2- 172.21.15.22:0/1955197702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9401038a0 0x7fd940103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:58.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.994+0000 7fd947cec640 1 --2- 172.21.15.22:0/1955197702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd940102740 0x7fd940102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:58.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.994+0000 7fd947cec640 1 -- 172.21.15.22:0/1955197702 >> 172.21.15.22:0/1955197702 conn(0x7fd9400fdff0 msgr2=0x7fd940100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:22:58.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.994+0000 7fd947cec640 1 -- 172.21.15.22:0/1955197702 shutdown_connections 2024-08-20T01:22:58.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.994+0000 7fd947cec640 1 -- 172.21.15.22:0/1955197702 wait complete. 2024-08-20T01:22:58.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.995+0000 7fd947cec640 1 Processor -- start 2024-08-20T01:22:58.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.995+0000 7fd947cec640 1 -- start start 2024-08-20T01:22:58.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.995+0000 7fd947cec640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd940102740 0x7fd940198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:22:58.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.995+0000 7fd947cec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9401038a0 0x7fd940199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:22:58.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.995+0000 7fd947cec640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd940104260 0x7fd940199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:22:58.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.995+0000 7fd947cec640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd94010e280 con 0x7fd940102740 2024-08-20T01:22:58.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.995+0000 7fd947cec640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd94010e100 con 0x7fd9401038a0 2024-08-20T01:22:58.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.995+0000 7fd947cec640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd94010e400 con 0x7fd940104260 2024-08-20T01:22:58.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.995+0000 7fd945a88640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd940102740 0x7fd940198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:22:58.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.995+0000 7fd945a88640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd940102740 0x7fd940198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52864/0 (socket says 172.21.15.22:52864) 2024-08-20T01:22:58.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.995+0000 7fd945a88640 1 -- 172.21.15.22:0/2627719438 learned_addr learned my addr 172.21.15.22:0/2627719438 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:22:58.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.995+0000 7fd945287640 1 --2- 172.21.15.22:0/2627719438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9401038a0 0x7fd940199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:22:58.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.995+0000 7fd946289640 1 --2- 172.21.15.22:0/2627719438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd940104260 0x7fd940199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:22:58.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.995+0000 7fd945a88640 1 -- 172.21.15.22:0/2627719438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd940104260 msgr2=0x7fd940199c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:22:58.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.995+0000 7fd945a88640 1 --2- 172.21.15.22:0/2627719438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd940104260 0x7fd940199c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:58.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.995+0000 7fd945a88640 1 -- 172.21.15.22:0/2627719438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9401038a0 msgr2=0x7fd940199050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:22:58.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.995+0000 7fd945a88640 1 --2- 172.21.15.22:0/2627719438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9401038a0 0x7fd940199050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:58.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.995+0000 7fd945a88640 1 -- 172.21.15.22:0/2627719438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94019a530 con 0x7fd940102740 2024-08-20T01:22:58.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.996+0000 7fd945a88640 1 --2- 172.21.15.22:0/2627719438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd940102740 0x7fd940198a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd93800e9f0 tx=0x7fd93800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:22:58.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.996+0000 7fd93effd640 1 -- 172.21.15.22:0/2627719438 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93800cd80 con 0x7fd940102740 2024-08-20T01:22:59.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.996+0000 7fd947cec640 1 -- 172.21.15.22:0/2627719438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd94019a820 con 0x7fd940102740 2024-08-20T01:22:59.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.996+0000 7fd93effd640 1 -- 172.21.15.22:0/2627719438 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd9380108c0 con 0x7fd940102740 2024-08-20T01:22:59.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.996+0000 7fd93effd640 1 -- 172.21.15.22:0/2627719438 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9380187d0 con 0x7fd940102740 2024-08-20T01:22:59.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.996+0000 7fd947cec640 1 -- 172.21.15.22:0/2627719438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd940075280 con 0x7fd940102740 2024-08-20T01:22:59.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.997+0000 7fd93effd640 1 -- 172.21.15.22:0/2627719438 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7fd938010430 con 0x7fd940102740 2024-08-20T01:22:59.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.997+0000 7fd93effd640 1 --2- 172.21.15.22:0/2627719438 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd92803ed60 0x7fd928041220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:22:59.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.997+0000 7fd947cec640 1 -- 172.21.15.22:0/2627719438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd940102b40 con 0x7fd940102740 2024-08-20T01:22:59.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.997+0000 7fd93effd640 1 -- 172.21.15.22:0/2627719438 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd938053770 con 0x7fd940102740 2024-08-20T01:22:59.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.997+0000 7fd945287640 1 --2- 172.21.15.22:0/2627719438 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd92803ed60 0x7fd928041220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:22:59.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:58.998+0000 7fd945287640 1 --2- 172.21.15.22:0/2627719438 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd92803ed60 0x7fd928041220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd934009bd0 tx=0x7fd934005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:22:59.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.002+0000 7fd93effd640 1 -- 172.21.15.22:0/2627719438 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd93800b2c0 con 0x7fd940102740 2024-08-20T01:22:59.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.187+0000 7fd947cec640 1 -- 172.21.15.22:0/2627719438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fd940109ac0 con 0x7fd940102740 2024-08-20T01:22:59.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.191+0000 7fd93effd640 1 -- 172.21.15.22:0/2627719438 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7fd938010d50 con 0x7fd940102740 2024-08-20T01:22:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.194+0000 7fd947cec640 1 -- 172.21.15.22:0/2627719438 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd92803ed60 msgr2=0x7fd928041220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:22:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.194+0000 7fd947cec640 1 --2- 172.21.15.22:0/2627719438 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd92803ed60 0x7fd928041220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd934009bd0 tx=0x7fd934005f90 comp rx=0 tx=0).stop 2024-08-20T01:22:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.194+0000 7fd947cec640 1 -- 172.21.15.22:0/2627719438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd940102740 msgr2=0x7fd940198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:22:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.194+0000 7fd947cec640 1 --2- 172.21.15.22:0/2627719438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd940102740 0x7fd940198a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd93800e9f0 tx=0x7fd93800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:22:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.194+0000 7fd947cec640 1 -- 172.21.15.22:0/2627719438 shutdown_connections 2024-08-20T01:22:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.194+0000 7fd947cec640 1 --2- 172.21.15.22:0/2627719438 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd92803ed60 0x7fd928041220 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.194+0000 7fd947cec640 1 --2- 172.21.15.22:0/2627719438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd940104260 0x7fd940199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.194+0000 7fd947cec640 1 --2- 172.21.15.22:0/2627719438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9401038a0 0x7fd940199050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.194+0000 7fd947cec640 1 --2- 172.21.15.22:0/2627719438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd940102740 0x7fd940198a00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.194+0000 7fd947cec640 1 -- 172.21.15.22:0/2627719438 >> 172.21.15.22:0/2627719438 conn(0x7fd9400fdff0 msgr2=0x7fd940106c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:22:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.194+0000 7fd947cec640 1 -- 172.21.15.22:0/2627719438 shutdown_connections 2024-08-20T01:22:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.194+0000 7fd947cec640 1 -- 172.21.15.22:0/2627719438 wait complete. 2024-08-20T01:22:59.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.206+0000 7f2b856ec640 1 -- 172.21.15.22:0/1249674954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b80103d60 msgr2=0x7f2b80104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:22:59.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.206+0000 7f2b856ec640 1 --2- 172.21.15.22:0/1249674954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b80103d60 0x7f2b80104160 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009930 tx=0x7f2b7002a420 comp rx=0 tx=0).stop 2024-08-20T01:22:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.206+0000 7f2b856ec640 1 -- 172.21.15.22:0/1249674954 shutdown_connections 2024-08-20T01:22:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.206+0000 7f2b856ec640 1 --2- 172.21.15.22:0/1249674954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b80100f00 0x7f2b8010ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.206+0000 7f2b856ec640 1 --2- 172.21.15.22:0/1249674954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b801046a0 0x7f2b801007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.206+0000 7f2b856ec640 1 --2- 172.21.15.22:0/1249674954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b80103d60 0x7f2b80104160 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.206+0000 7f2b856ec640 1 -- 172.21.15.22:0/1249674954 >> 172.21.15.22:0/1249674954 conn(0x7f2b800fc670 msgr2=0x7f2b800feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:22:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.207+0000 7f2b856ec640 1 -- 172.21.15.22:0/1249674954 shutdown_connections 2024-08-20T01:22:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.207+0000 7f2b856ec640 1 -- 172.21.15.22:0/1249674954 wait complete. 2024-08-20T01:22:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.208+0000 7f2b856ec640 1 Processor -- start 2024-08-20T01:22:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.208+0000 7f2b856ec640 1 -- start start 2024-08-20T01:22:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.208+0000 7f2b856ec640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b80100f00 0x7f2b80073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:22:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.208+0000 7f2b856ec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b80103d60 0x7f2b80074100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:22:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.208+0000 7f2b856ec640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b801046a0 0x7f2b800726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:22:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.208+0000 7f2b856ec640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8006cec0 con 0x7f2b801046a0 2024-08-20T01:22:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.208+0000 7f2b856ec640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8006cd40 con 0x7f2b80103d60 2024-08-20T01:22:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.208+0000 7f2b856ec640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8006d040 con 0x7f2b80100f00 2024-08-20T01:22:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.208+0000 7f2b7e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b80103d60 0x7f2b80074100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:22:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.208+0000 7f2b7e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b80103d60 0x7f2b80074100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:36928/0 (socket says 172.21.15.22:36928) 2024-08-20T01:22:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.208+0000 7f2b7e7fc640 1 -- 172.21.15.22:0/4272241261 learned_addr learned my addr 172.21.15.22:0/4272241261 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:22:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.208+0000 7f2b7f7fe640 1 --2- 172.21.15.22:0/4272241261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b801046a0 0x7f2b800726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:22:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.208+0000 7f2b7effd640 1 --2- 172.21.15.22:0/4272241261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b80100f00 0x7f2b80073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:22:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.209+0000 7f2b7e7fc640 1 -- 172.21.15.22:0/4272241261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b80100f00 msgr2=0x7f2b80073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:22:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.209+0000 7f2b7e7fc640 1 --2- 172.21.15.22:0/4272241261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b80100f00 0x7f2b80073bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.209+0000 7f2b7e7fc640 1 -- 172.21.15.22:0/4272241261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b801046a0 msgr2=0x7f2b800726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:22:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.209+0000 7f2b7e7fc640 1 --2- 172.21.15.22:0/4272241261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b801046a0 0x7f2b800726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.209+0000 7f2b7e7fc640 1 -- 172.21.15.22:0/4272241261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b80072c20 con 0x7f2b80103d60 2024-08-20T01:22:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.209+0000 7f2b7effd640 1 --2- 172.21.15.22:0/4272241261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b80100f00 0x7f2b80073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:22:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.209+0000 7f2b7e7fc640 1 --2- 172.21.15.22:0/4272241261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b80103d60 0x7f2b80074100 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400e9f0 tx=0x7f2b7400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:22:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.209+0000 7f2b67fff640 1 -- 172.21.15.22:0/4272241261 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7400ccc0 con 0x7f2b80103d60 2024-08-20T01:22:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.209+0000 7f2b67fff640 1 -- 172.21.15.22:0/4272241261 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f2b740044b0 con 0x7f2b80103d60 2024-08-20T01:22:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.209+0000 7f2b856ec640 1 -- 172.21.15.22:0/4272241261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b80072f10 con 0x7f2b80103d60 2024-08-20T01:22:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.209+0000 7f2b67fff640 1 -- 172.21.15.22:0/4272241261 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74010430 con 0x7f2b80103d60 2024-08-20T01:22:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.209+0000 7f2b856ec640 1 -- 172.21.15.22:0/4272241261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b800734a0 con 0x7f2b80103d60 2024-08-20T01:22:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.210+0000 7f2b67fff640 1 -- 172.21.15.22:0/4272241261 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7f2b740105d0 con 0x7f2b80103d60 2024-08-20T01:22:59.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.211+0000 7f2b67fff640 1 --2- 172.21.15.22:0/4272241261 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2b6803eda0 0x7f2b68041260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:22:59.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.211+0000 7f2b67fff640 1 -- 172.21.15.22:0/4272241261 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2b740543b0 con 0x7f2b80103d60 2024-08-20T01:22:59.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.211+0000 7f2b856ec640 1 -- 172.21.15.22:0/4272241261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b80109cb0 con 0x7f2b80103d60 2024-08-20T01:22:59.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.212+0000 7f2b7effd640 1 --2- 172.21.15.22:0/4272241261 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2b6803eda0 0x7f2b68041260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:22:59.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.212+0000 7f2b7effd640 1 --2- 172.21.15.22:0/4272241261 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2b6803eda0 0x7f2b68041260 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009900 tx=0x7f2b70000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:22:59.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.217+0000 7f2b67fff640 1 -- 172.21.15.22:0/4272241261 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f2b7400a250 con 0x7f2b80103d60 2024-08-20T01:22:59.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.406+0000 7f2b856ec640 1 -- 172.21.15.22:0/4272241261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f2b8002e340 con 0x7f2b80103d60 2024-08-20T01:22:59.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.411+0000 7f2b67fff640 1 -- 172.21.15.22:0/4272241261 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f2b74003680 con 0x7f2b80103d60 2024-08-20T01:22:59.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.414+0000 7f2b856ec640 1 -- 172.21.15.22:0/4272241261 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2b6803eda0 msgr2=0x7f2b68041260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:22:59.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.414+0000 7f2b856ec640 1 --2- 172.21.15.22:0/4272241261 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2b6803eda0 0x7f2b68041260 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009900 tx=0x7f2b70000bc0 comp rx=0 tx=0).stop 2024-08-20T01:22:59.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.414+0000 7f2b856ec640 1 -- 172.21.15.22:0/4272241261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b80103d60 msgr2=0x7f2b80074100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:22:59.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.414+0000 7f2b856ec640 1 --2- 172.21.15.22:0/4272241261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b80103d60 0x7f2b80074100 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400e9f0 tx=0x7f2b7400eeb0 comp rx=0 tx=0).stop 2024-08-20T01:22:59.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.414+0000 7f2b856ec640 1 -- 172.21.15.22:0/4272241261 shutdown_connections 2024-08-20T01:22:59.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.414+0000 7f2b856ec640 1 --2- 172.21.15.22:0/4272241261 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2b6803eda0 0x7f2b68041260 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:59.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.414+0000 7f2b856ec640 1 --2- 172.21.15.22:0/4272241261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b801046a0 0x7f2b800726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:59.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.414+0000 7f2b856ec640 1 --2- 172.21.15.22:0/4272241261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b80103d60 0x7f2b80074100 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:59.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.414+0000 7f2b856ec640 1 --2- 172.21.15.22:0/4272241261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b80100f00 0x7f2b80073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:22:59.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.414+0000 7f2b856ec640 1 -- 172.21.15.22:0/4272241261 >> 172.21.15.22:0/4272241261 conn(0x7f2b800fc670 msgr2=0x7f2b80106e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:22:59.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.415+0000 7f2b856ec640 1 -- 172.21.15.22:0/4272241261 shutdown_connections 2024-08-20T01:22:59.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:22:59.415+0000 7f2b856ec640 1 -- 172.21.15.22:0/4272241261 wait complete. 2024-08-20T01:22:59.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:59 smithi022 ceph-mon[18709]: from='client.? ' entity='client.admin' 2024-08-20T01:22:59.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:59 smithi022 ceph-mon[18709]: Standby manager daemon z started 2024-08-20T01:22:59.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:59 smithi022 ceph-mon[18709]: from='mgr.? 172.21.15.134:0/359561517' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-20T01:22:59.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:59 smithi022 ceph-mon[18709]: from='mgr.? 172.21.15.134:0/359561517' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-20T01:22:59.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:59 smithi022 ceph-mon[18709]: from='mgr.? 172.21.15.134:0/359561517' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-20T01:22:59.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:59 smithi022 ceph-mon[18709]: from='mgr.? 172.21.15.134:0/359561517' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-20T01:22:59.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:59 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:59.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:59 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2627719438' entity='client.admin' 2024-08-20T01:22:59.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:22:59 smithi022 ceph-mon[18709]: from='client.? ' entity='client.admin' 2024-08-20T01:22:59.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:59 smithi134 ceph-mon[22511]: from='client.? ' entity='client.admin' 2024-08-20T01:22:59.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:59 smithi134 ceph-mon[22511]: Standby manager daemon z started 2024-08-20T01:22:59.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:59 smithi134 ceph-mon[22511]: from='mgr.? 172.21.15.134:0/359561517' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-20T01:22:59.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:59 smithi134 ceph-mon[22511]: from='mgr.? 172.21.15.134:0/359561517' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-20T01:22:59.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:59 smithi134 ceph-mon[22511]: from='mgr.? 172.21.15.134:0/359561517' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-20T01:22:59.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:59 smithi134 ceph-mon[22511]: from='mgr.? 172.21.15.134:0/359561517' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-20T01:22:59.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:59 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:59.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:59 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2627719438' entity='client.admin' 2024-08-20T01:22:59.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:22:59 smithi134 ceph-mon[22511]: from='client.? ' entity='client.admin' 2024-08-20T01:22:59.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:59 smithi077 ceph-mon[22251]: from='client.? ' entity='client.admin' 2024-08-20T01:22:59.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:59 smithi077 ceph-mon[22251]: Standby manager daemon z started 2024-08-20T01:22:59.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:59 smithi077 ceph-mon[22251]: from='mgr.? 172.21.15.134:0/359561517' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-20T01:22:59.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:59 smithi077 ceph-mon[22251]: from='mgr.? 172.21.15.134:0/359561517' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-20T01:22:59.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:59 smithi077 ceph-mon[22251]: from='mgr.? 172.21.15.134:0/359561517' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-20T01:22:59.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:59 smithi077 ceph-mon[22251]: from='mgr.? 172.21.15.134:0/359561517' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-20T01:22:59.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:59 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:22:59.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:59 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2627719438' entity='client.admin' 2024-08-20T01:22:59.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:22:59 smithi077 ceph-mon[22251]: from='client.? ' entity='client.admin' 2024-08-20T01:23:00.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:00 smithi022 ceph-mon[18709]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:00.466 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:00 smithi022 ceph-mon[18709]: mgrmap e14: x(active, since 66s), standbys: z 2024-08-20T01:23:00.466 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-20T01:23:00.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:00 smithi134 ceph-mon[22511]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:00.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:00 smithi134 ceph-mon[22511]: mgrmap e14: x(active, since 66s), standbys: z 2024-08-20T01:23:00.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-20T01:23:00.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:00 smithi077 ceph-mon[22251]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:00.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:00 smithi077 ceph-mon[22251]: mgrmap e14: x(active, since 66s), standbys: z 2024-08-20T01:23:00.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-20T01:23:01.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.018+0000 7f87f6c06640 1 -- 172.21.15.22:0/521096332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f0103130 msgr2=0x7f87f0109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:01.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.018+0000 7f87f6c06640 1 --2- 172.21.15.22:0/521096332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f0103130 0x7f87f0109ab0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009cd0 tx=0x7f87e802a8e0 comp rx=0 tx=0).stop 2024-08-20T01:23:01.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.018+0000 7f87f6c06640 1 -- 172.21.15.22:0/521096332 shutdown_connections 2024-08-20T01:23:01.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.018+0000 7f87f6c06640 1 --2- 172.21.15.22:0/521096332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f0103130 0x7f87f0109ab0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:01.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.018+0000 7f87f6c06640 1 --2- 172.21.15.22:0/521096332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87f0102770 0x7f87f0102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:01.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.018+0000 7f87f6c06640 1 --2- 172.21.15.22:0/521096332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87f0101610 0x7f87f0101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:01.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.018+0000 7f87f6c06640 1 -- 172.21.15.22:0/521096332 >> 172.21.15.22:0/521096332 conn(0x7f87f00fcee0 msgr2=0x7f87f00ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:01.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.018+0000 7f87f6c06640 1 -- 172.21.15.22:0/521096332 shutdown_connections 2024-08-20T01:23:01.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.018+0000 7f87f6c06640 1 -- 172.21.15.22:0/521096332 wait complete. 2024-08-20T01:23:01.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.019+0000 7f87f6c06640 1 Processor -- start 2024-08-20T01:23:01.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.019+0000 7f87f6c06640 1 -- start start 2024-08-20T01:23:01.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.019+0000 7f87f6c06640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87f0101610 0x7f87f01967b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:01.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.019+0000 7f87f6c06640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87f0102770 0x7f87f0196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:01.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.019+0000 7f87f6c06640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f0103130 0x7f87f0197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:01.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.019+0000 7f87f6c06640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f87f010c090 con 0x7f87f0103130 2024-08-20T01:23:01.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.019+0000 7f87f6c06640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f87f010bf10 con 0x7f87f0101610 2024-08-20T01:23:01.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.019+0000 7f87f6c06640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f87f010c210 con 0x7f87f0102770 2024-08-20T01:23:01.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.020+0000 7f87f49a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87f0101610 0x7f87f01967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:01.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.020+0000 7f87f51a3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f0103130 0x7f87f0197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:01.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.020+0000 7f87f49a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87f0101610 0x7f87f01967b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:56456/0 (socket says 172.21.15.22:56456) 2024-08-20T01:23:01.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.020+0000 7f87f49a2640 1 -- 172.21.15.22:0/2209011488 learned_addr learned my addr 172.21.15.22:0/2209011488 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:23:01.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.020+0000 7f87effff640 1 --2- 172.21.15.22:0/2209011488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87f0102770 0x7f87f0196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:01.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.020+0000 7f87f49a2640 1 -- 172.21.15.22:0/2209011488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87f0102770 msgr2=0x7f87f0196e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:01.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.020+0000 7f87f49a2640 1 --2- 172.21.15.22:0/2209011488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87f0102770 0x7f87f0196e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:01.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.020+0000 7f87f49a2640 1 -- 172.21.15.22:0/2209011488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f0103130 msgr2=0x7f87f0197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:01.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.020+0000 7f87f49a2640 1 --2- 172.21.15.22:0/2209011488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f0103130 0x7f87f0197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:01.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.020+0000 7f87f49a2640 1 -- 172.21.15.22:0/2209011488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f01982e0 con 0x7f87f0101610 2024-08-20T01:23:01.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.020+0000 7f87effff640 1 --2- 172.21.15.22:0/2209011488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87f0102770 0x7f87f0196e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:23:01.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.020+0000 7f87f51a3640 1 --2- 172.21.15.22:0/2209011488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f0103130 0x7f87f0197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:23:01.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.020+0000 7f87f49a2640 1 --2- 172.21.15.22:0/2209011488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87f0101610 0x7f87f01967b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f87e400d950 tx=0x7f87e400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:01.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.020+0000 7f87edffb640 1 -- 172.21.15.22:0/2209011488 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4017070 con 0x7f87f0101610 2024-08-20T01:23:01.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.020+0000 7f87edffb640 1 -- 172.21.15.22:0/2209011488 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f87e4009c30 con 0x7f87f0101610 2024-08-20T01:23:01.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.020+0000 7f87f6c06640 1 -- 172.21.15.22:0/2209011488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f01985d0 con 0x7f87f0101610 2024-08-20T01:23:01.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.020+0000 7f87edffb640 1 -- 172.21.15.22:0/2209011488 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e400f620 con 0x7f87f0101610 2024-08-20T01:23:01.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.020+0000 7f87f6c06640 1 -- 172.21.15.22:0/2209011488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f019ecb0 con 0x7f87f0101610 2024-08-20T01:23:01.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.021+0000 7f87f6c06640 1 -- 172.21.15.22:0/2209011488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f0101a10 con 0x7f87f0101610 2024-08-20T01:23:01.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.022+0000 7f87edffb640 1 -- 172.21.15.22:0/2209011488 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) ==== 100875+0+0 (secure 0 0 0) 0x7f87e4010460 con 0x7f87f0101610 2024-08-20T01:23:01.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.022+0000 7f87edffb640 1 --2- 172.21.15.22:0/2209011488 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f87e0079450 0x7f87e007b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:01.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.023+0000 7f87effff640 1 --2- 172.21.15.22:0/2209011488 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f87e0079450 0x7f87e007b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:01.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.023+0000 7f87edffb640 1 -- 172.21.15.22:0/2209011488 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f87e409a4e0 con 0x7f87f0101610 2024-08-20T01:23:01.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.023+0000 7f87effff640 1 --2- 172.21.15.22:0/2209011488 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f87e0079450 0x7f87e007b910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00bdb0 tx=0x7f87dc00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:01.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.027+0000 7f87edffb640 1 -- 172.21.15.22:0/2209011488 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f87e4009de0 con 0x7f87f0101610 2024-08-20T01:23:01.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.218+0000 7f87f6c06640 1 -- 172.21.15.22:0/2209011488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f87f0108970 con 0x7f87f0101610 2024-08-20T01:23:01.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.222+0000 7f87edffb640 1 -- 172.21.15.22:0/2209011488 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v20)=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7f87e4063230 con 0x7f87f0101610 2024-08-20T01:23:01.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.224+0000 7f87f6c06640 1 -- 172.21.15.22:0/2209011488 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f87e0079450 msgr2=0x7f87e007b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:01.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.224+0000 7f87f6c06640 1 --2- 172.21.15.22:0/2209011488 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f87e0079450 0x7f87e007b910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00bdb0 tx=0x7f87dc00d040 comp rx=0 tx=0).stop 2024-08-20T01:23:01.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.224+0000 7f87f6c06640 1 -- 172.21.15.22:0/2209011488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87f0101610 msgr2=0x7f87f01967b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:01.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.224+0000 7f87f6c06640 1 --2- 172.21.15.22:0/2209011488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87f0101610 0x7f87f01967b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f87e400d950 tx=0x7f87e400de10 comp rx=0 tx=0).stop 2024-08-20T01:23:01.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.224+0000 7f87f6c06640 1 -- 172.21.15.22:0/2209011488 shutdown_connections 2024-08-20T01:23:01.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.224+0000 7f87f6c06640 1 --2- 172.21.15.22:0/2209011488 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f87e0079450 0x7f87e007b910 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:01.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.224+0000 7f87f6c06640 1 --2- 172.21.15.22:0/2209011488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87f0103130 0x7f87f0197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:01.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.224+0000 7f87f6c06640 1 --2- 172.21.15.22:0/2209011488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87f0102770 0x7f87f0196e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:01.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.224+0000 7f87f6c06640 1 --2- 172.21.15.22:0/2209011488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87f0101610 0x7f87f01967b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:01.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.224+0000 7f87f6c06640 1 -- 172.21.15.22:0/2209011488 >> 172.21.15.22:0/2209011488 conn(0x7f87f00fcee0 msgr2=0x7f87f0105b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:01.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.224+0000 7f87f6c06640 1 -- 172.21.15.22:0/2209011488 shutdown_connections 2024-08-20T01:23:01.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.225+0000 7f87f6c06640 1 -- 172.21.15.22:0/2209011488 wait complete. 2024-08-20T01:23:01.742 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:01 smithi022 ceph-mon[18709]: Standby manager daemon y started 2024-08-20T01:23:01.742 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:01 smithi022 ceph-mon[18709]: from='mgr.? 172.21.15.77:0/3911439229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-20T01:23:01.742 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:01 smithi022 ceph-mon[18709]: from='mgr.? 172.21.15.77:0/3911439229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-20T01:23:01.742 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:01 smithi022 ceph-mon[18709]: from='mgr.? 172.21.15.77:0/3911439229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-20T01:23:01.742 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:01 smithi022 ceph-mon[18709]: from='mgr.? 172.21.15.77:0/3911439229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-20T01:23:01.743 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:01 smithi022 ceph-mon[18709]: from='client.? ' entity='client.admin' 2024-08-20T01:23:01.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:01 smithi134 ceph-mon[22511]: Standby manager daemon y started 2024-08-20T01:23:01.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:01 smithi134 ceph-mon[22511]: from='mgr.? 172.21.15.77:0/3911439229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-20T01:23:01.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:01 smithi134 ceph-mon[22511]: from='mgr.? 172.21.15.77:0/3911439229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-20T01:23:01.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:01 smithi134 ceph-mon[22511]: from='mgr.? 172.21.15.77:0/3911439229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-20T01:23:01.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:01 smithi134 ceph-mon[22511]: from='mgr.? 172.21.15.77:0/3911439229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-20T01:23:01.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:01 smithi134 ceph-mon[22511]: from='client.? ' entity='client.admin' 2024-08-20T01:23:01.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:01 smithi077 ceph-mon[22251]: Standby manager daemon y started 2024-08-20T01:23:01.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:01 smithi077 ceph-mon[22251]: from='mgr.? 172.21.15.77:0/3911439229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-20T01:23:01.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:01 smithi077 ceph-mon[22251]: from='mgr.? 172.21.15.77:0/3911439229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-20T01:23:01.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:01 smithi077 ceph-mon[22251]: from='mgr.? 172.21.15.77:0/3911439229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-20T01:23:01.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:01 smithi077 ceph-mon[22251]: from='mgr.? 172.21.15.77:0/3911439229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-20T01:23:01.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:01 smithi077 ceph-mon[22251]: from='client.? ' entity='client.admin' 2024-08-20T01:23:02.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.564+0000 7f74fa7eb640 1 -- 172.21.15.22:0/2207819211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f41027a0 msgr2=0x7f74f4102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:02.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.564+0000 7f74fa7eb640 1 --2- 172.21.15.22:0/2207819211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f41027a0 0x7f74f4102c20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009930 tx=0x7f74e802a420 comp rx=0 tx=0).stop 2024-08-20T01:23:02.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.564+0000 7f74fa7eb640 1 -- 172.21.15.22:0/2207819211 shutdown_connections 2024-08-20T01:23:02.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.564+0000 7f74fa7eb640 1 --2- 172.21.15.22:0/2207819211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f4103160 0x7f74f4109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.564+0000 7f74fa7eb640 1 --2- 172.21.15.22:0/2207819211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f41027a0 0x7f74f4102c20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.564+0000 7f74fa7eb640 1 --2- 172.21.15.22:0/2207819211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74f4101640 0x7f74f4101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.564+0000 7f74fa7eb640 1 -- 172.21.15.22:0/2207819211 >> 172.21.15.22:0/2207819211 conn(0x7f74f40fcf30 msgr2=0x7f74f40ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:02.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.564+0000 7f74fa7eb640 1 -- 172.21.15.22:0/2207819211 shutdown_connections 2024-08-20T01:23:02.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.564+0000 7f74fa7eb640 1 -- 172.21.15.22:0/2207819211 wait complete. 2024-08-20T01:23:02.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.565+0000 7f74fa7eb640 1 Processor -- start 2024-08-20T01:23:02.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.565+0000 7f74fa7eb640 1 -- start start 2024-08-20T01:23:02.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.565+0000 7f74fa7eb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f4101640 0x7f74f406bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:02.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.565+0000 7f74fa7eb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74f41027a0 0x7f74f419d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:02.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.565+0000 7f74fa7eb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f4103160 0x7f74f419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:02.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.565+0000 7f74fa7eb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f74f410d180 con 0x7f74f4101640 2024-08-20T01:23:02.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.565+0000 7f74fa7eb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f74f410d000 con 0x7f74f41027a0 2024-08-20T01:23:02.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.565+0000 7f74fa7eb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f74f410d300 con 0x7f74f4103160 2024-08-20T01:23:02.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.565+0000 7f74f3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f4101640 0x7f74f406bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:02.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.565+0000 7f74f3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f4101640 0x7f74f406bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57574/0 (socket says 172.21.15.22:57574) 2024-08-20T01:23:02.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.565+0000 7f74f3fff640 1 -- 172.21.15.22:0/2167290073 learned_addr learned my addr 172.21.15.22:0/2167290073 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:23:02.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.565+0000 7f74f37fe640 1 --2- 172.21.15.22:0/2167290073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74f41027a0 0x7f74f419d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:02.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.565+0000 7f74f8d88640 1 --2- 172.21.15.22:0/2167290073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f4103160 0x7f74f419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:02.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.565+0000 7f74f3fff640 1 -- 172.21.15.22:0/2167290073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f4103160 msgr2=0x7f74f419fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:02.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.565+0000 7f74f3fff640 1 --2- 172.21.15.22:0/2167290073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f4103160 0x7f74f419fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.565+0000 7f74f3fff640 1 -- 172.21.15.22:0/2167290073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74f41027a0 msgr2=0x7f74f419d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:02.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.565+0000 7f74f3fff640 1 --2- 172.21.15.22:0/2167290073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74f41027a0 0x7f74f419d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.566+0000 7f74f3fff640 1 -- 172.21.15.22:0/2167290073 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f41a0650 con 0x7f74f4101640 2024-08-20T01:23:02.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.566+0000 7f74f3fff640 1 --2- 172.21.15.22:0/2167290073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f4101640 0x7f74f406bb30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f74e400e9f0 tx=0x7f74e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:02.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.566+0000 7f74f17fa640 1 -- 172.21.15.22:0/2167290073 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e400cd80 con 0x7f74f4101640 2024-08-20T01:23:02.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.566+0000 7f74f17fa640 1 -- 172.21.15.22:0/2167290073 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f74e40108c0 con 0x7f74f4101640 2024-08-20T01:23:02.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.566+0000 7f74fa7eb640 1 -- 172.21.15.22:0/2167290073 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f41a0940 con 0x7f74f4101640 2024-08-20T01:23:02.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.566+0000 7f74f17fa640 1 -- 172.21.15.22:0/2167290073 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e40187d0 con 0x7f74f4101640 2024-08-20T01:23:02.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.566+0000 7f74fa7eb640 1 -- 172.21.15.22:0/2167290073 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f41a0e80 con 0x7f74f4101640 2024-08-20T01:23:02.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.567+0000 7f74fa7eb640 1 -- 172.21.15.22:0/2167290073 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74f4108a90 con 0x7f74f4101640 2024-08-20T01:23:02.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.568+0000 7f74f17fa640 1 -- 172.21.15.22:0/2167290073 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f74e4010430 con 0x7f74f4101640 2024-08-20T01:23:02.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.569+0000 7f74f17fa640 1 --2- 172.21.15.22:0/2167290073 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f74dc0b3b40 0x7f74dc0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:02.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.569+0000 7f74f17fa640 1 -- 172.21.15.22:0/2167290073 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f74e40e22a0 con 0x7f74f4101640 2024-08-20T01:23:02.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.569+0000 7f74f37fe640 1 --2- 172.21.15.22:0/2167290073 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f74dc0b3b40 0x7f74dc0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:02.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.570+0000 7f74f37fe640 1 --2- 172.21.15.22:0/2167290073 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f74dc0b3b40 0x7f74dc0b6000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009900 tx=0x7f74e8005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.573+0000 7f74f17fa640 1 -- 172.21.15.22:0/2167290073 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f74e40aaf70 con 0x7f74f4101640 2024-08-20T01:23:02.634 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:02 smithi022 ceph-mon[18709]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:02.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:02 smithi022 ceph-mon[18709]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-08-20T01:23:02.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:02 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-20T01:23:02.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:02 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2421161597' entity='client.admin' 2024-08-20T01:23:02.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.740+0000 7efd1ca83640 1 -- 172.21.15.22:0/531015592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd18102770 msgr2=0x7efd18102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:02.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.740+0000 7efd1ca83640 1 --2- 172.21.15.22:0/531015592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd18102770 0x7efd18102bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efd00009930 tx=0x7efd0002a420 comp rx=0 tx=0).stop 2024-08-20T01:23:02.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.740+0000 7efd1ca83640 1 -- 172.21.15.22:0/531015592 shutdown_connections 2024-08-20T01:23:02.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.740+0000 7efd1ca83640 1 --2- 172.21.15.22:0/531015592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd18103130 0x7efd18109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.740+0000 7efd1ca83640 1 --2- 172.21.15.22:0/531015592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd18102770 0x7efd18102bf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.740+0000 7efd1ca83640 1 --2- 172.21.15.22:0/531015592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd18101610 0x7efd18101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.740+0000 7efd1ca83640 1 -- 172.21.15.22:0/531015592 >> 172.21.15.22:0/531015592 conn(0x7efd180fcee0 msgr2=0x7efd180ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:02.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.740+0000 7efd1ca83640 1 -- 172.21.15.22:0/531015592 shutdown_connections 2024-08-20T01:23:02.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.740+0000 7efd1ca83640 1 -- 172.21.15.22:0/531015592 wait complete. 2024-08-20T01:23:02.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.741+0000 7efd1ca83640 1 Processor -- start 2024-08-20T01:23:02.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.741+0000 7efd1ca83640 1 -- start start 2024-08-20T01:23:02.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd1ca83640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd18101610 0x7efd18197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:02.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd1ca83640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd18102770 0x7efd18197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:02.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd1ca83640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd18103130 0x7efd18198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:02.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd1ca83640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efd1810d150 con 0x7efd18103130 2024-08-20T01:23:02.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd1ca83640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd1810cfd0 con 0x7efd18102770 2024-08-20T01:23:02.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd1ca83640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efd1810d2d0 con 0x7efd18101610 2024-08-20T01:23:02.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd16d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd18103130 0x7efd18198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:02.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd16d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd18103130 0x7efd18198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57584/0 (socket says 172.21.15.22:57584) 2024-08-20T01:23:02.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd16d9d640 1 -- 172.21.15.22:0/944592921 learned_addr learned my addr 172.21.15.22:0/944592921 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:23:02.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd1659c640 1 --2- 172.21.15.22:0/944592921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd18101610 0x7efd18197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:02.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd0ffff640 1 --2- 172.21.15.22:0/944592921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd18102770 0x7efd18197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:02.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd16d9d640 1 -- 172.21.15.22:0/944592921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd18101610 msgr2=0x7efd18197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:02.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd16d9d640 1 --2- 172.21.15.22:0/944592921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd18101610 0x7efd18197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd16d9d640 1 -- 172.21.15.22:0/944592921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd18102770 msgr2=0x7efd18197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:02.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd16d9d640 1 --2- 172.21.15.22:0/944592921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd18102770 0x7efd18197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd16d9d640 1 -- 172.21.15.22:0/944592921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd18199450 con 0x7efd18103130 2024-08-20T01:23:02.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd1659c640 1 --2- 172.21.15.22:0/944592921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd18101610 0x7efd18197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:23:02.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd16d9d640 1 --2- 172.21.15.22:0/944592921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd18103130 0x7efd18198bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efd1000eb10 tx=0x7efd1000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:02.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd0f7fe640 1 -- 172.21.15.22:0/944592921 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd10004b20 con 0x7efd18103130 2024-08-20T01:23:02.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.742+0000 7efd1ca83640 1 -- 172.21.15.22:0/944592921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd18199740 con 0x7efd18103130 2024-08-20T01:23:02.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.743+0000 7efd0f7fe640 1 -- 172.21.15.22:0/944592921 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7efd10004cc0 con 0x7efd18103130 2024-08-20T01:23:02.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.743+0000 7efd0f7fe640 1 -- 172.21.15.22:0/944592921 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd10010690 con 0x7efd18103130 2024-08-20T01:23:02.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.743+0000 7efd1ca83640 1 -- 172.21.15.22:0/944592921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd1819fe20 con 0x7efd18103130 2024-08-20T01:23:02.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.743+0000 7efd1ca83640 1 -- 172.21.15.22:0/944592921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd1819fff0 con 0x7efd18103130 2024-08-20T01:23:02.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.745+0000 7efd0f7fe640 1 -- 172.21.15.22:0/944592921 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7efd10005000 con 0x7efd18103130 2024-08-20T01:23:02.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.746+0000 7efd0f7fe640 1 --2- 172.21.15.22:0/944592921 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efd040b3b40 0x7efd040b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:02.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.746+0000 7efd1659c640 1 --2- 172.21.15.22:0/944592921 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efd040b3b40 0x7efd040b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:02.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.746+0000 7efd0f7fe640 1 -- 172.21.15.22:0/944592921 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efd100e2820 con 0x7efd18103130 2024-08-20T01:23:02.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.746+0000 7efd1659c640 1 --2- 172.21.15.22:0/944592921 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efd040b3b40 0x7efd040b6000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efd08005fd0 tx=0x7efd0800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:02.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.749+0000 7efd0f7fe640 1 -- 172.21.15.22:0/944592921 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7efd100abbd0 con 0x7efd18103130 2024-08-20T01:23:02.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:02 smithi134 ceph-mon[22511]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:02.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:02 smithi134 ceph-mon[22511]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-08-20T01:23:02.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:02 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-20T01:23:02.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:02 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2421161597' entity='client.admin' 2024-08-20T01:23:02.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.766+0000 7f74fa7eb640 1 -- 172.21.15.22:0/2167290073 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f74f4063af0 con 0x7f74f4101640 2024-08-20T01:23:02.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.769+0000 7f74f17fa640 1 -- 172.21.15.22:0/2167290073 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v22)=0 v22) ==== 125+0+0 (secure 0 0 0) 0x7f74e40af4c0 con 0x7f74f4101640 2024-08-20T01:23:02.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.772+0000 7f74fa7eb640 1 -- 172.21.15.22:0/2167290073 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f74dc0b3b40 msgr2=0x7f74dc0b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:02.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.772+0000 7f74fa7eb640 1 --2- 172.21.15.22:0/2167290073 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f74dc0b3b40 0x7f74dc0b6000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009900 tx=0x7f74e8005720 comp rx=0 tx=0).stop 2024-08-20T01:23:02.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.772+0000 7f74fa7eb640 1 -- 172.21.15.22:0/2167290073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f4101640 msgr2=0x7f74f406bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:02.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.772+0000 7f74fa7eb640 1 --2- 172.21.15.22:0/2167290073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f4101640 0x7f74f406bb30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f74e400e9f0 tx=0x7f74e400eeb0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.772+0000 7f74fa7eb640 1 -- 172.21.15.22:0/2167290073 shutdown_connections 2024-08-20T01:23:02.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.772+0000 7f74fa7eb640 1 --2- 172.21.15.22:0/2167290073 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f74dc0b3b40 0x7f74dc0b6000 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.772+0000 7f74fa7eb640 1 --2- 172.21.15.22:0/2167290073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f4103160 0x7f74f419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.772+0000 7f74fa7eb640 1 --2- 172.21.15.22:0/2167290073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74f41027a0 0x7f74f419d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.772+0000 7f74fa7eb640 1 --2- 172.21.15.22:0/2167290073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f4101640 0x7f74f406bb30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.772+0000 7f74fa7eb640 1 -- 172.21.15.22:0/2167290073 >> 172.21.15.22:0/2167290073 conn(0x7f74f40fcf30 msgr2=0x7f74f4105c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:02.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.772+0000 7f74fa7eb640 1 -- 172.21.15.22:0/2167290073 shutdown_connections 2024-08-20T01:23:02.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.772+0000 7f74fa7eb640 1 -- 172.21.15.22:0/2167290073 wait complete. 2024-08-20T01:23:02.812 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:02 smithi077 ceph-mon[22251]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:02.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:02 smithi077 ceph-mon[22251]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-08-20T01:23:02.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:02 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-20T01:23:02.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:02 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2421161597' entity='client.admin' 2024-08-20T01:23:02.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.953+0000 7efd1ca83640 1 -- 172.21.15.22:0/944592921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7efd181a01c0 con 0x7efd18103130 2024-08-20T01:23:02.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.957+0000 7efd0f7fe640 1 -- 172.21.15.22:0/944592921 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v23)=0 v23) ==== 118+0+0 (secure 0 0 0) 0x7efd100ab4d0 con 0x7efd18103130 2024-08-20T01:23:02.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.959+0000 7efd1ca83640 1 -- 172.21.15.22:0/944592921 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efd040b3b40 msgr2=0x7efd040b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:02.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.959+0000 7efd1ca83640 1 --2- 172.21.15.22:0/944592921 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efd040b3b40 0x7efd040b6000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efd08005fd0 tx=0x7efd0800b390 comp rx=0 tx=0).stop 2024-08-20T01:23:02.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.959+0000 7efd1ca83640 1 -- 172.21.15.22:0/944592921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd18103130 msgr2=0x7efd18198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:02.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.959+0000 7efd1ca83640 1 --2- 172.21.15.22:0/944592921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd18103130 0x7efd18198bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efd1000eb10 tx=0x7efd1000c2d0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.959+0000 7efd1ca83640 1 -- 172.21.15.22:0/944592921 shutdown_connections 2024-08-20T01:23:02.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.959+0000 7efd1ca83640 1 --2- 172.21.15.22:0/944592921 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efd040b3b40 0x7efd040b6000 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.959+0000 7efd1ca83640 1 --2- 172.21.15.22:0/944592921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd18103130 0x7efd18198bb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.959+0000 7efd1ca83640 1 --2- 172.21.15.22:0/944592921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd18102770 0x7efd18197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.959+0000 7efd1ca83640 1 --2- 172.21.15.22:0/944592921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd18101610 0x7efd18197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:02.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.959+0000 7efd1ca83640 1 -- 172.21.15.22:0/944592921 >> 172.21.15.22:0/944592921 conn(0x7efd180fcee0 msgr2=0x7efd18103b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:02.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.959+0000 7efd1ca83640 1 -- 172.21.15.22:0/944592921 shutdown_connections 2024-08-20T01:23:02.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:02.960+0000 7efd1ca83640 1 -- 172.21.15.22:0/944592921 wait complete. 2024-08-20T01:23:03.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.514+0000 7f17c1d59640 1 -- 172.21.15.22:0/1989513478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17bc102740 msgr2=0x7f17bc102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:03.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.514+0000 7f17c1d59640 1 --2- 172.21.15.22:0/1989513478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17bc102740 0x7f17bc102b40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f17ac009930 tx=0x7f17ac02a420 comp rx=0 tx=0).stop 2024-08-20T01:23:03.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.514+0000 7f17c1d59640 1 -- 172.21.15.22:0/1989513478 shutdown_connections 2024-08-20T01:23:03.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.514+0000 7f17c1d59640 1 --2- 172.21.15.22:0/1989513478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17bc104260 0x7f17bc10abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:03.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.514+0000 7f17c1d59640 1 --2- 172.21.15.22:0/1989513478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc1038a0 0x7f17bc103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:03.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.514+0000 7f17c1d59640 1 --2- 172.21.15.22:0/1989513478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17bc102740 0x7f17bc102b40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:03.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.514+0000 7f17c1d59640 1 -- 172.21.15.22:0/1989513478 >> 172.21.15.22:0/1989513478 conn(0x7f17bc0fdff0 msgr2=0x7f17bc100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:03.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.514+0000 7f17c1d59640 1 -- 172.21.15.22:0/1989513478 shutdown_connections 2024-08-20T01:23:03.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.514+0000 7f17c1d59640 1 -- 172.21.15.22:0/1989513478 wait complete. 2024-08-20T01:23:03.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.515+0000 7f17c1d59640 1 Processor -- start 2024-08-20T01:23:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.515+0000 7f17c1d59640 1 -- start start 2024-08-20T01:23:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.515+0000 7f17c1d59640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc102740 0x7f17bc19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.515+0000 7f17c1d59640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17bc1038a0 0x7f17bc19b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.515+0000 7f17c1d59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17bc104260 0x7f17bc19bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.515+0000 7f17c1d59640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc10e2d0 con 0x7f17bc104260 2024-08-20T01:23:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.515+0000 7f17c1d59640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc10e150 con 0x7f17bc102740 2024-08-20T01:23:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.515+0000 7f17c1d59640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc10e450 con 0x7f17bc1038a0 2024-08-20T01:23:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.515+0000 7f17bbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17bc104260 0x7f17bc19bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.515+0000 7f17bbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17bc104260 0x7f17bc19bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57604/0 (socket says 172.21.15.22:57604) 2024-08-20T01:23:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.515+0000 7f17bbfff640 1 -- 172.21.15.22:0/3720906190 learned_addr learned my addr 172.21.15.22:0/3720906190 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:23:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.515+0000 7f17baffd640 1 --2- 172.21.15.22:0/3720906190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17bc1038a0 0x7f17bc19b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.515+0000 7f17bb7fe640 1 --2- 172.21.15.22:0/3720906190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc102740 0x7f17bc19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:03.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.516+0000 7f17bbfff640 1 -- 172.21.15.22:0/3720906190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17bc1038a0 msgr2=0x7f17bc19b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:03.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.516+0000 7f17bbfff640 1 --2- 172.21.15.22:0/3720906190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17bc1038a0 0x7f17bc19b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:03.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.516+0000 7f17bbfff640 1 -- 172.21.15.22:0/3720906190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc102740 msgr2=0x7f17bc19ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:03.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.516+0000 7f17bbfff640 1 --2- 172.21.15.22:0/3720906190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc102740 0x7f17bc19ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:03.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.516+0000 7f17bbfff640 1 -- 172.21.15.22:0/3720906190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17bc19c7b0 con 0x7f17bc104260 2024-08-20T01:23:03.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.516+0000 7f17bbfff640 1 --2- 172.21.15.22:0/3720906190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17bc104260 0x7f17bc19bf10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f17b400eaa0 tx=0x7f17b400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:03.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.516+0000 7f17b8ff9640 1 -- 172.21.15.22:0/3720906190 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b400cdb0 con 0x7f17bc104260 2024-08-20T01:23:03.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.516+0000 7f17b8ff9640 1 -- 172.21.15.22:0/3720906190 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f17b4005020 con 0x7f17bc104260 2024-08-20T01:23:03.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.516+0000 7f17c1d59640 1 -- 172.21.15.22:0/3720906190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17bc19caa0 con 0x7f17bc104260 2024-08-20T01:23:03.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.516+0000 7f17b8ff9640 1 -- 172.21.15.22:0/3720906190 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b40116d0 con 0x7f17bc104260 2024-08-20T01:23:03.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.516+0000 7f17c1d59640 1 -- 172.21.15.22:0/3720906190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17bc1a3180 con 0x7f17bc104260 2024-08-20T01:23:03.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.517+0000 7f17c1d59640 1 -- 172.21.15.22:0/3720906190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17bc1a3350 con 0x7f17bc104260 2024-08-20T01:23:03.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.519+0000 7f17b8ff9640 1 -- 172.21.15.22:0/3720906190 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f17b4004a40 con 0x7f17bc104260 2024-08-20T01:23:03.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.520+0000 7f17b8ff9640 1 --2- 172.21.15.22:0/3720906190 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f17a40b3b40 0x7f17a40b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.520+0000 7f17b8ff9640 1 -- 172.21.15.22:0/3720906190 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f17b40e23b0 con 0x7f17bc104260 2024-08-20T01:23:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.521+0000 7f17bb7fe640 1 --2- 172.21.15.22:0/3720906190 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f17a40b3b40 0x7f17a40b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.522+0000 7f17bb7fe640 1 --2- 172.21.15.22:0/3720906190 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f17a40b3b40 0x7f17a40b6000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f17ac005ab0 tx=0x7f17ac005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.524+0000 7f17b8ff9640 1 -- 172.21.15.22:0/3720906190 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f17b4016030 con 0x7f17bc104260 2024-08-20T01:23:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.709+0000 7f17c1d59640 1 -- 172.21.15.22:0/3720906190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f17bc1a3640 con 0x7f17bc104260 2024-08-20T01:23:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.713+0000 7f17b8ff9640 1 -- 172.21.15.22:0/3720906190 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v24)=0 v24) ==== 108+0+0 (secure 0 0 0) 0x7f17b40ab080 con 0x7f17bc104260 2024-08-20T01:23:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.715+0000 7f17c1d59640 1 -- 172.21.15.22:0/3720906190 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f17a40b3b40 msgr2=0x7f17a40b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.715+0000 7f17c1d59640 1 --2- 172.21.15.22:0/3720906190 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f17a40b3b40 0x7f17a40b6000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f17ac005ab0 tx=0x7f17ac005a20 comp rx=0 tx=0).stop 2024-08-20T01:23:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.715+0000 7f17c1d59640 1 -- 172.21.15.22:0/3720906190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17bc104260 msgr2=0x7f17bc19bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.715+0000 7f17c1d59640 1 --2- 172.21.15.22:0/3720906190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17bc104260 0x7f17bc19bf10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f17b400eaa0 tx=0x7f17b400ef60 comp rx=0 tx=0).stop 2024-08-20T01:23:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.715+0000 7f17c1d59640 1 -- 172.21.15.22:0/3720906190 shutdown_connections 2024-08-20T01:23:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.715+0000 7f17c1d59640 1 --2- 172.21.15.22:0/3720906190 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f17a40b3b40 0x7f17a40b6000 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.715+0000 7f17c1d59640 1 --2- 172.21.15.22:0/3720906190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17bc104260 0x7f17bc19bf10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:03.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.715+0000 7f17c1d59640 1 --2- 172.21.15.22:0/3720906190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17bc1038a0 0x7f17bc19b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:03.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.715+0000 7f17c1d59640 1 --2- 172.21.15.22:0/3720906190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc102740 0x7f17bc19ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:03.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.715+0000 7f17c1d59640 1 -- 172.21.15.22:0/3720906190 >> 172.21.15.22:0/3720906190 conn(0x7f17bc0fdff0 msgr2=0x7f17bc109030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:03.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.715+0000 7f17c1d59640 1 -- 172.21.15.22:0/3720906190 shutdown_connections 2024-08-20T01:23:03.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:03.715+0000 7f17c1d59640 1 -- 172.21.15.22:0/3720906190 wait complete. 2024-08-20T01:23:04.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:03 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2167290073' entity='client.admin' 2024-08-20T01:23:04.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:03 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/944592921' entity='client.admin' 2024-08-20T01:23:04.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:03 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3720906190' entity='client.admin' 2024-08-20T01:23:04.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:03 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2167290073' entity='client.admin' 2024-08-20T01:23:04.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:03 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/944592921' entity='client.admin' 2024-08-20T01:23:04.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:03 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3720906190' entity='client.admin' 2024-08-20T01:23:04.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:03 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2167290073' entity='client.admin' 2024-08-20T01:23:04.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:03 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/944592921' entity='client.admin' 2024-08-20T01:23:04.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:03 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3720906190' entity='client.admin' 2024-08-20T01:23:04.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.916+0000 7f7021a05640 1 -- 172.21.15.22:0/3906606863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f701c1058d0 msgr2=0x7f701c107d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:04.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.916+0000 7f7021a05640 1 --2- 172.21.15.22:0/3906606863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f701c1058d0 0x7f701c107d40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7004009900 tx=0x7f700402a410 comp rx=0 tx=0).stop 2024-08-20T01:23:04.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.916+0000 7f7021a05640 1 -- 172.21.15.22:0/3906606863 shutdown_connections 2024-08-20T01:23:04.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.916+0000 7f7021a05640 1 --2- 172.21.15.22:0/3906606863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f701c108480 0x7f701c10a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:04.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.916+0000 7f7021a05640 1 --2- 172.21.15.22:0/3906606863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f701c1058d0 0x7f701c107d40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:04.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.916+0000 7f7021a05640 1 --2- 172.21.15.22:0/3906606863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f701c06bdc0 0x7f701c105340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:04.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.916+0000 7f7021a05640 1 -- 172.21.15.22:0/3906606863 >> 172.21.15.22:0/3906606863 conn(0x7f701c0fcf30 msgr2=0x7f701c0ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:04.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.916+0000 7f7021a05640 1 -- 172.21.15.22:0/3906606863 shutdown_connections 2024-08-20T01:23:04.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.916+0000 7f7021a05640 1 -- 172.21.15.22:0/3906606863 wait complete. 2024-08-20T01:23:04.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.917+0000 7f7021a05640 1 Processor -- start 2024-08-20T01:23:04.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.917+0000 7f7021a05640 1 -- start start 2024-08-20T01:23:04.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.917+0000 7f7021a05640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f701c06bdc0 0x7f701c102a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:04.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.917+0000 7f7021a05640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f701c1058d0 0x7f701c1012e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:04.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.917+0000 7f7021a05640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f701c108480 0x7f701c101820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:04.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.917+0000 7f7021a05640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f701c10e270 con 0x7f701c108480 2024-08-20T01:23:04.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.917+0000 7f7021a05640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f701c10e0f0 con 0x7f701c06bdc0 2024-08-20T01:23:04.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.917+0000 7f7021a05640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f701c10e3f0 con 0x7f701c1058d0 2024-08-20T01:23:04.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.917+0000 7f701b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f701c108480 0x7f701c101820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:04.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.917+0000 7f701b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f701c108480 0x7f701c101820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57634/0 (socket says 172.21.15.22:57634) 2024-08-20T01:23:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.917+0000 7f701b7fe640 1 -- 172.21.15.22:0/2302882431 learned_addr learned my addr 172.21.15.22:0/2302882431 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:23:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.917+0000 7f701a7fc640 1 --2- 172.21.15.22:0/2302882431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f701c1058d0 0x7f701c1012e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.917+0000 7f701affd640 1 --2- 172.21.15.22:0/2302882431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f701c06bdc0 0x7f701c102a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.918+0000 7f701b7fe640 1 -- 172.21.15.22:0/2302882431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f701c1058d0 msgr2=0x7f701c1012e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.918+0000 7f701b7fe640 1 --2- 172.21.15.22:0/2302882431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f701c1058d0 0x7f701c1012e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.918+0000 7f701b7fe640 1 -- 172.21.15.22:0/2302882431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f701c06bdc0 msgr2=0x7f701c102a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.918+0000 7f701b7fe640 1 --2- 172.21.15.22:0/2302882431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f701c06bdc0 0x7f701c102a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.918+0000 7f701b7fe640 1 -- 172.21.15.22:0/2302882431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f701c1020e0 con 0x7f701c108480 2024-08-20T01:23:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.918+0000 7f701b7fe640 1 --2- 172.21.15.22:0/2302882431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f701c108480 0x7f701c101820 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f700c00cad0 tx=0x7f700c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.918+0000 7f7020a03640 1 -- 172.21.15.22:0/2302882431 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c00ae20 con 0x7f701c108480 2024-08-20T01:23:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.918+0000 7f7020a03640 1 -- 172.21.15.22:0/2302882431 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f700c005020 con 0x7f701c108480 2024-08-20T01:23:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.918+0000 7f7020a03640 1 -- 172.21.15.22:0/2302882431 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c00f6b0 con 0x7f701c108480 2024-08-20T01:23:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.918+0000 7f7021a05640 1 -- 172.21.15.22:0/2302882431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f701c1a2bc0 con 0x7f701c108480 2024-08-20T01:23:04.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.918+0000 7f7021a05640 1 -- 172.21.15.22:0/2302882431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f701c1a3080 con 0x7f701c108480 2024-08-20T01:23:04.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.919+0000 7f7021a05640 1 -- 172.21.15.22:0/2302882431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f701c0fea20 con 0x7f701c108480 2024-08-20T01:23:04.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.920+0000 7f7020a03640 1 -- 172.21.15.22:0/2302882431 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f700c004a40 con 0x7f701c108480 2024-08-20T01:23:04.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.921+0000 7f7020a03640 1 --2- 172.21.15.22:0/2302882431 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70080b3bc0 0x7f70080b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:04.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.922+0000 7f701affd640 1 --2- 172.21.15.22:0/2302882431 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70080b3bc0 0x7f70080b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:04.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.922+0000 7f7020a03640 1 -- 172.21.15.22:0/2302882431 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f700c0e1de0 con 0x7f701c108480 2024-08-20T01:23:04.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.922+0000 7f701affd640 1 --2- 172.21.15.22:0/2302882431 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70080b3bc0 0x7f70080b6080 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f701400bbe0 tx=0x7f701400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:04.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:04.925+0000 7f7020a03640 1 -- 172.21.15.22:0/2302882431 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f700c014030 con 0x7f701c108480 2024-08-20T01:23:05.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:05.116+0000 7f7021a05640 1 -- 172.21.15.22:0/2302882431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f701c02e340 con 0x7f701c108480 2024-08-20T01:23:05.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:05.120+0000 7f7020a03640 1 -- 172.21.15.22:0/2302882431 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f700c0aaab0 con 0x7f701c108480 2024-08-20T01:23:05.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:05.122+0000 7f7021a05640 1 -- 172.21.15.22:0/2302882431 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70080b3bc0 msgr2=0x7f70080b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:05.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:05.122+0000 7f7021a05640 1 --2- 172.21.15.22:0/2302882431 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70080b3bc0 0x7f70080b6080 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f701400bbe0 tx=0x7f701400b390 comp rx=0 tx=0).stop 2024-08-20T01:23:05.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:05.122+0000 7f7021a05640 1 -- 172.21.15.22:0/2302882431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f701c108480 msgr2=0x7f701c101820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:05.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:05.122+0000 7f7021a05640 1 --2- 172.21.15.22:0/2302882431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f701c108480 0x7f701c101820 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f700c00cad0 tx=0x7f700c00cf90 comp rx=0 tx=0).stop 2024-08-20T01:23:05.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:05.122+0000 7f7021a05640 1 -- 172.21.15.22:0/2302882431 shutdown_connections 2024-08-20T01:23:05.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:05.122+0000 7f7021a05640 1 --2- 172.21.15.22:0/2302882431 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70080b3bc0 0x7f70080b6080 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:05.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:05.122+0000 7f7021a05640 1 --2- 172.21.15.22:0/2302882431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f701c108480 0x7f701c101820 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:05.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:05.122+0000 7f7021a05640 1 --2- 172.21.15.22:0/2302882431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f701c1058d0 0x7f701c1012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:05.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:05.122+0000 7f7021a05640 1 --2- 172.21.15.22:0/2302882431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f701c06bdc0 0x7f701c102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:05.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:05.122+0000 7f7021a05640 1 -- 172.21.15.22:0/2302882431 >> 172.21.15.22:0/2302882431 conn(0x7f701c0fcf30 msgr2=0x7f701c103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:05.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:05.122+0000 7f7021a05640 1 -- 172.21.15.22:0/2302882431 shutdown_connections 2024-08-20T01:23:05.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:05.122+0000 7f7021a05640 1 -- 172.21.15.22:0/2302882431 wait complete. 2024-08-20T01:23:05.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:04 smithi134 ceph-mon[22511]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:05.312 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:04 smithi077 ceph-mon[22251]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:05.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:04 smithi022 ceph-mon[18709]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:06.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.159+0000 7f2ab8d5b640 1 -- 172.21.15.22:0/1525655014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4102770 msgr2=0x7f2ab4102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:06.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.159+0000 7f2ab8d5b640 1 --2- 172.21.15.22:0/1525655014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4102770 0x7f2ab4102bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009930 tx=0x7f2aa802a420 comp rx=0 tx=0).stop 2024-08-20T01:23:06.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.159+0000 7f2ab8d5b640 1 -- 172.21.15.22:0/1525655014 shutdown_connections 2024-08-20T01:23:06.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.159+0000 7f2ab8d5b640 1 --2- 172.21.15.22:0/1525655014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ab4103130 0x7f2ab4109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.159+0000 7f2ab8d5b640 1 --2- 172.21.15.22:0/1525655014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4102770 0x7f2ab4102bf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.159+0000 7f2ab8d5b640 1 --2- 172.21.15.22:0/1525655014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab4101610 0x7f2ab4101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.159+0000 7f2ab8d5b640 1 -- 172.21.15.22:0/1525655014 >> 172.21.15.22:0/1525655014 conn(0x7f2ab40fcee0 msgr2=0x7f2ab40ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:06.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.160+0000 7f2ab8d5b640 1 -- 172.21.15.22:0/1525655014 shutdown_connections 2024-08-20T01:23:06.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.160+0000 7f2ab8d5b640 1 -- 172.21.15.22:0/1525655014 wait complete. 2024-08-20T01:23:06.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.160+0000 7f2ab8d5b640 1 Processor -- start 2024-08-20T01:23:06.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.160+0000 7f2ab8d5b640 1 -- start start 2024-08-20T01:23:06.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2ab8d5b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab4101610 0x7f2ab41053d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:06.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2ab8d5b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4102770 0x7f2ab4103c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:06.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2ab8d5b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ab4103130 0x7f2ab4104180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:06.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2ab8d5b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab410d230 con 0x7f2ab4102770 2024-08-20T01:23:06.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2ab8d5b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab410d0b0 con 0x7f2ab4103130 2024-08-20T01:23:06.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2ab8d5b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab410d3b0 con 0x7f2ab4101610 2024-08-20T01:23:06.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2ab1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4102770 0x7f2ab4103c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:06.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2ab1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4102770 0x7f2ab4103c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57660/0 (socket says 172.21.15.22:57660) 2024-08-20T01:23:06.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2ab1d9b640 1 -- 172.21.15.22:0/1934297117 learned_addr learned my addr 172.21.15.22:0/1934297117 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:23:06.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2ab259c640 1 --2- 172.21.15.22:0/1934297117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab4101610 0x7f2ab41053d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:06.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2ab2d9d640 1 --2- 172.21.15.22:0/1934297117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ab4103130 0x7f2ab4104180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:06.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2ab1d9b640 1 -- 172.21.15.22:0/1934297117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab4101610 msgr2=0x7f2ab41053d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:06.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2ab1d9b640 1 --2- 172.21.15.22:0/1934297117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab4101610 0x7f2ab41053d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2ab1d9b640 1 -- 172.21.15.22:0/1934297117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ab4103130 msgr2=0x7f2ab4104180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:06.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2ab1d9b640 1 --2- 172.21.15.22:0/1934297117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ab4103130 0x7f2ab4104180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2ab1d9b640 1 -- 172.21.15.22:0/1934297117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab4104a40 con 0x7f2ab4102770 2024-08-20T01:23:06.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2ab2d9d640 1 --2- 172.21.15.22:0/1934297117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ab4103130 0x7f2ab4104180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:23:06.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2ab1d9b640 1 --2- 172.21.15.22:0/1934297117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4102770 0x7f2ab4103c40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009a50 tx=0x7f2aa8032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:06.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2aa37fe640 1 -- 172.21.15.22:0/1934297117 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa803f030 con 0x7f2ab4102770 2024-08-20T01:23:06.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2aa37fe640 1 -- 172.21.15.22:0/1934297117 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f2aa80044b0 con 0x7f2ab4102770 2024-08-20T01:23:06.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2ab8d5b640 1 -- 172.21.15.22:0/1934297117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab41a2c10 con 0x7f2ab4102770 2024-08-20T01:23:06.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.161+0000 7f2aa37fe640 1 -- 172.21.15.22:0/1934297117 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8035070 con 0x7f2ab4102770 2024-08-20T01:23:06.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.162+0000 7f2ab8d5b640 1 -- 172.21.15.22:0/1934297117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab41a30c0 con 0x7f2ab4102770 2024-08-20T01:23:06.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.162+0000 7f2ab8d5b640 1 -- 172.21.15.22:0/1934297117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab41a32f0 con 0x7f2ab4102770 2024-08-20T01:23:06.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.164+0000 7f2aa37fe640 1 -- 172.21.15.22:0/1934297117 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f2aa8042030 con 0x7f2ab4102770 2024-08-20T01:23:06.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.164+0000 7f2aa37fe640 1 --2- 172.21.15.22:0/1934297117 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2a9c0b3b40 0x7f2a9c0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:06.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.165+0000 7f2ab259c640 1 --2- 172.21.15.22:0/1934297117 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2a9c0b3b40 0x7f2a9c0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:06.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.165+0000 7f2aa37fe640 1 -- 172.21.15.22:0/1934297117 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2aa81026e0 con 0x7f2ab4102770 2024-08-20T01:23:06.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.165+0000 7f2ab259c640 1 --2- 172.21.15.22:0/1934297117 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2a9c0b3b40 0x7f2a9c0b6000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4009890 tx=0x7f2aa4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:06.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.169+0000 7f2aa37fe640 1 -- 172.21.15.22:0/1934297117 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f2aa80cba00 con 0x7f2ab4102770 2024-08-20T01:23:06.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.355+0000 7f2ab8d5b640 1 -- 172.21.15.22:0/1934297117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f2ab41a35e0 con 0x7f2ab4102770 2024-08-20T01:23:06.355 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:06 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2302882431' entity='client.admin' 2024-08-20T01:23:06.355 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:06 smithi022 ceph-mon[18709]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:06.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.358+0000 7f2aa37fe640 1 -- 172.21.15.22:0/1934297117 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v26)=0 v26) ==== 116+0+0 (secure 0 0 0) 0x7f2aa80cb300 con 0x7f2ab4102770 2024-08-20T01:23:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.361+0000 7f2ab8d5b640 1 -- 172.21.15.22:0/1934297117 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2a9c0b3b40 msgr2=0x7f2a9c0b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.361+0000 7f2ab8d5b640 1 --2- 172.21.15.22:0/1934297117 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2a9c0b3b40 0x7f2a9c0b6000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4009890 tx=0x7f2aa4008040 comp rx=0 tx=0).stop 2024-08-20T01:23:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.361+0000 7f2ab8d5b640 1 -- 172.21.15.22:0/1934297117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4102770 msgr2=0x7f2ab4103c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.361+0000 7f2ab8d5b640 1 --2- 172.21.15.22:0/1934297117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4102770 0x7f2ab4103c40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009a50 tx=0x7f2aa8032f90 comp rx=0 tx=0).stop 2024-08-20T01:23:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.361+0000 7f2ab8d5b640 1 -- 172.21.15.22:0/1934297117 shutdown_connections 2024-08-20T01:23:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.361+0000 7f2ab8d5b640 1 --2- 172.21.15.22:0/1934297117 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2a9c0b3b40 0x7f2a9c0b6000 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.361+0000 7f2ab8d5b640 1 --2- 172.21.15.22:0/1934297117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ab4103130 0x7f2ab4104180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.361+0000 7f2ab8d5b640 1 --2- 172.21.15.22:0/1934297117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4102770 0x7f2ab4103c40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.361+0000 7f2ab8d5b640 1 --2- 172.21.15.22:0/1934297117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab4101610 0x7f2ab41053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.361+0000 7f2ab8d5b640 1 -- 172.21.15.22:0/1934297117 >> 172.21.15.22:0/1934297117 conn(0x7f2ab40fcee0 msgr2=0x7f2ab40fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.361+0000 7f2ab8d5b640 1 -- 172.21.15.22:0/1934297117 shutdown_connections 2024-08-20T01:23:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.361+0000 7f2ab8d5b640 1 -- 172.21.15.22:0/1934297117 wait complete. 2024-08-20T01:23:06.514 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:06 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2302882431' entity='client.admin' 2024-08-20T01:23:06.514 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:06 smithi134 ceph-mon[22511]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:06.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.518+0000 7fe22f617640 1 -- 172.21.15.22:0/3801631616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe228108470 msgr2=0x7fe22810a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:06.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.518+0000 7fe22f617640 1 --2- 172.21.15.22:0/3801631616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe228108470 0x7fe22810a930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe220009ca0 tx=0x7fe22002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.518+0000 7fe22f617640 1 -- 172.21.15.22:0/3801631616 shutdown_connections 2024-08-20T01:23:06.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.518+0000 7fe22f617640 1 --2- 172.21.15.22:0/3801631616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe228108470 0x7fe22810a930 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.518+0000 7fe22f617640 1 --2- 172.21.15.22:0/3801631616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2281058c0 0x7fe228107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.518+0000 7fe22f617640 1 --2- 172.21.15.22:0/3801631616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe22806bdc0 0x7fe228105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.518+0000 7fe22f617640 1 -- 172.21.15.22:0/3801631616 >> 172.21.15.22:0/3801631616 conn(0x7fe2280fcf00 msgr2=0x7fe2280ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:06.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.518+0000 7fe22f617640 1 -- 172.21.15.22:0/3801631616 shutdown_connections 2024-08-20T01:23:06.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.518+0000 7fe22f617640 1 -- 172.21.15.22:0/3801631616 wait complete. 2024-08-20T01:23:06.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.519+0000 7fe22f617640 1 Processor -- start 2024-08-20T01:23:06.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.519+0000 7fe22f617640 1 -- start start 2024-08-20T01:23:06.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.519+0000 7fe22f617640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe22806bdc0 0x7fe228102a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:06.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.519+0000 7fe22f617640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2281058c0 0x7fe2281012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:06.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.519+0000 7fe22f617640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe228108470 0x7fe228101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:06.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.519+0000 7fe22f617640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe22810e2a0 con 0x7fe2281058c0 2024-08-20T01:23:06.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.519+0000 7fe22f617640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe22810e120 con 0x7fe22806bdc0 2024-08-20T01:23:06.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.520+0000 7fe22f617640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe22810e420 con 0x7fe228108470 2024-08-20T01:23:06.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.520+0000 7fe22cbb2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2281058c0 0x7fe2281012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:06.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.520+0000 7fe22d3b3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe22806bdc0 0x7fe228102a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:06.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.520+0000 7fe22d3b3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe22806bdc0 0x7fe228102a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:56548/0 (socket says 172.21.15.22:56548) 2024-08-20T01:23:06.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.520+0000 7fe22d3b3640 1 -- 172.21.15.22:0/3120170551 learned_addr learned my addr 172.21.15.22:0/3120170551 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:23:06.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.520+0000 7fe22cbb2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2281058c0 0x7fe2281012d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57678/0 (socket says 172.21.15.22:57678) 2024-08-20T01:23:06.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.520+0000 7fe22dbb4640 1 --2- 172.21.15.22:0/3120170551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe228108470 0x7fe228101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:06.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.520+0000 7fe22d3b3640 1 -- 172.21.15.22:0/3120170551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe228108470 msgr2=0x7fe228101810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:06.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.520+0000 7fe22d3b3640 1 --2- 172.21.15.22:0/3120170551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe228108470 0x7fe228101810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.520+0000 7fe22d3b3640 1 -- 172.21.15.22:0/3120170551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2281058c0 msgr2=0x7fe2281012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:06.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.520+0000 7fe22d3b3640 1 --2- 172.21.15.22:0/3120170551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2281058c0 0x7fe2281012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.520+0000 7fe22d3b3640 1 -- 172.21.15.22:0/3120170551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2281020d0 con 0x7fe22806bdc0 2024-08-20T01:23:06.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.520+0000 7fe22dbb4640 1 --2- 172.21.15.22:0/3120170551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe228108470 0x7fe228101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:23:06.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.520+0000 7fe22d3b3640 1 --2- 172.21.15.22:0/3120170551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe22806bdc0 0x7fe228102a60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe22400e9f0 tx=0x7fe22400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:06.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.520+0000 7fe21e7fc640 1 -- 172.21.15.22:0/3120170551 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22400cd80 con 0x7fe22806bdc0 2024-08-20T01:23:06.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.521+0000 7fe21e7fc640 1 -- 172.21.15.22:0/3120170551 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe2240054b0 con 0x7fe22806bdc0 2024-08-20T01:23:06.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.521+0000 7fe22f617640 1 -- 172.21.15.22:0/3120170551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2281a2b50 con 0x7fe22806bdc0 2024-08-20T01:23:06.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.521+0000 7fe21e7fc640 1 -- 172.21.15.22:0/3120170551 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224010430 con 0x7fe22806bdc0 2024-08-20T01:23:06.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.521+0000 7fe22f617640 1 -- 172.21.15.22:0/3120170551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2281a3010 con 0x7fe22806bdc0 2024-08-20T01:23:06.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.522+0000 7fe22f617640 1 -- 172.21.15.22:0/3120170551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2280fe9f0 con 0x7fe22806bdc0 2024-08-20T01:23:06.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.523+0000 7fe21e7fc640 1 -- 172.21.15.22:0/3120170551 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fe2240046c0 con 0x7fe22806bdc0 2024-08-20T01:23:06.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.524+0000 7fe21e7fc640 1 --2- 172.21.15.22:0/3120170551 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe2140b3b40 0x7fe2140b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:06.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.524+0000 7fe22cbb2640 1 --2- 172.21.15.22:0/3120170551 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe2140b3b40 0x7fe2140b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:06.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.524+0000 7fe21e7fc640 1 -- 172.21.15.22:0/3120170551 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe2240e2400 con 0x7fe22806bdc0 2024-08-20T01:23:06.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.524+0000 7fe22cbb2640 1 --2- 172.21.15.22:0/3120170551 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe2140b3b40 0x7fe2140b6000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe22806c270 tx=0x7fe21800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:06.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.528+0000 7fe21e7fc640 1 -- 172.21.15.22:0/3120170551 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe2240ab680 con 0x7fe22806bdc0 2024-08-20T01:23:06.562 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:06 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2302882431' entity='client.admin' 2024-08-20T01:23:06.562 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:06 smithi077 ceph-mon[22251]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:06.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.716+0000 7fe22f617640 1 -- 172.21.15.22:0/3120170551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fe228063b20 con 0x7fe22806bdc0 2024-08-20T01:23:06.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.722+0000 7fe21e7fc640 1 -- 172.21.15.22:0/3120170551 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v27)=0 v27) ==== 116+0+0 (secure 0 0 0) 0x7fe2240aaf80 con 0x7fe22806bdc0 2024-08-20T01:23:06.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.724+0000 7fe22f617640 1 -- 172.21.15.22:0/3120170551 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe2140b3b40 msgr2=0x7fe2140b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:06.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.724+0000 7fe22f617640 1 --2- 172.21.15.22:0/3120170551 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe2140b3b40 0x7fe2140b6000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe22806c270 tx=0x7fe21800b390 comp rx=0 tx=0).stop 2024-08-20T01:23:06.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.724+0000 7fe22f617640 1 -- 172.21.15.22:0/3120170551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe22806bdc0 msgr2=0x7fe228102a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:06.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.724+0000 7fe22f617640 1 --2- 172.21.15.22:0/3120170551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe22806bdc0 0x7fe228102a60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe22400e9f0 tx=0x7fe22400edf0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.724+0000 7fe22f617640 1 -- 172.21.15.22:0/3120170551 shutdown_connections 2024-08-20T01:23:06.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.724+0000 7fe22f617640 1 --2- 172.21.15.22:0/3120170551 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe2140b3b40 0x7fe2140b6000 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.724+0000 7fe22f617640 1 --2- 172.21.15.22:0/3120170551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe228108470 0x7fe228101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.724+0000 7fe22f617640 1 --2- 172.21.15.22:0/3120170551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2281058c0 0x7fe2281012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.724+0000 7fe22f617640 1 --2- 172.21.15.22:0/3120170551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe22806bdc0 0x7fe228102a60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:06.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.724+0000 7fe22f617640 1 -- 172.21.15.22:0/3120170551 >> 172.21.15.22:0/3120170551 conn(0x7fe2280fcf00 msgr2=0x7fe228103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:06.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.724+0000 7fe22f617640 1 -- 172.21.15.22:0/3120170551 shutdown_connections 2024-08-20T01:23:06.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:06.724+0000 7fe22f617640 1 -- 172.21.15.22:0/3120170551 wait complete. 2024-08-20T01:23:07.634 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:07 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1934297117' entity='client.admin' 2024-08-20T01:23:07.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:07 smithi022 ceph-mon[18709]: from='client.? ' entity='client.admin' 2024-08-20T01:23:07.736 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:07 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1934297117' entity='client.admin' 2024-08-20T01:23:07.736 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:07 smithi077 ceph-mon[22251]: from='client.? ' entity='client.admin' 2024-08-20T01:23:07.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:07 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1934297117' entity='client.admin' 2024-08-20T01:23:07.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:07 smithi134 ceph-mon[22511]: from='client.? ' entity='client.admin' 2024-08-20T01:23:08.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.275+0000 7f662bd47640 1 -- 172.21.15.22:0/212452761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6624104260 msgr2=0x7f662410abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:08.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.275+0000 7f662bd47640 1 --2- 172.21.15.22:0/212452761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6624104260 0x7f662410abe0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f661c009cd0 tx=0x7f661c02a8e0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.275+0000 7f662bd47640 1 -- 172.21.15.22:0/212452761 shutdown_connections 2024-08-20T01:23:08.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.275+0000 7f662bd47640 1 --2- 172.21.15.22:0/212452761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6624104260 0x7f662410abe0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.275+0000 7f662bd47640 1 --2- 172.21.15.22:0/212452761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66241038a0 0x7f6624103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.275+0000 7f662bd47640 1 --2- 172.21.15.22:0/212452761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6624102740 0x7f6624102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.275+0000 7f662bd47640 1 -- 172.21.15.22:0/212452761 >> 172.21.15.22:0/212452761 conn(0x7f66240fdff0 msgr2=0x7f6624100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:08.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.276+0000 7f662bd47640 1 -- 172.21.15.22:0/212452761 shutdown_connections 2024-08-20T01:23:08.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.276+0000 7f662bd47640 1 -- 172.21.15.22:0/212452761 wait complete. 2024-08-20T01:23:08.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.276+0000 7f662bd47640 1 Processor -- start 2024-08-20T01:23:08.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.276+0000 7f662bd47640 1 -- start start 2024-08-20T01:23:08.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.276+0000 7f662bd47640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6624102740 0x7f6624076a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:08.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.276+0000 7f662bd47640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66241038a0 0x7f6624075270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:08.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.276+0000 7f662bd47640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6624104260 0x7f66240757b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:08.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.276+0000 7f662bd47640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f662410e3c0 con 0x7f6624104260 2024-08-20T01:23:08.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.276+0000 7f662bd47640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f662410e240 con 0x7f6624102740 2024-08-20T01:23:08.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.276+0000 7f662bd47640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f662410e540 con 0x7f66241038a0 2024-08-20T01:23:08.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.277+0000 7f662a2e4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6624104260 0x7f66240757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:08.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.277+0000 7f662a2e4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6624104260 0x7f66240757b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57710/0 (socket says 172.21.15.22:57710) 2024-08-20T01:23:08.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.277+0000 7f662a2e4640 1 -- 172.21.15.22:0/2418456340 learned_addr learned my addr 172.21.15.22:0/2418456340 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:23:08.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.277+0000 7f6629ae3640 1 --2- 172.21.15.22:0/2418456340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6624102740 0x7f6624076a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:08.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.277+0000 7f66292e2640 1 --2- 172.21.15.22:0/2418456340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66241038a0 0x7f6624075270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:08.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.277+0000 7f6629ae3640 1 -- 172.21.15.22:0/2418456340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66241038a0 msgr2=0x7f6624075270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:08.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.277+0000 7f6629ae3640 1 --2- 172.21.15.22:0/2418456340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66241038a0 0x7f6624075270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.277+0000 7f6629ae3640 1 -- 172.21.15.22:0/2418456340 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6624104260 msgr2=0x7f66240757b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:08.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.277+0000 7f6629ae3640 1 --2- 172.21.15.22:0/2418456340 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6624104260 0x7f66240757b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.277+0000 7f6629ae3640 1 -- 172.21.15.22:0/2418456340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6624076070 con 0x7f6624102740 2024-08-20T01:23:08.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.277+0000 7f662a2e4640 1 --2- 172.21.15.22:0/2418456340 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6624104260 0x7f66240757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:23:08.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.277+0000 7f6629ae3640 1 --2- 172.21.15.22:0/2418456340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6624102740 0x7f6624076a00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f662000e9f0 tx=0x7f662000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:08.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.277+0000 7f661affd640 1 -- 172.21.15.22:0/2418456340 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662000ccc0 con 0x7f6624102740 2024-08-20T01:23:08.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.277+0000 7f662bd47640 1 -- 172.21.15.22:0/2418456340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66241a2bf0 con 0x7f6624102740 2024-08-20T01:23:08.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.277+0000 7f661affd640 1 -- 172.21.15.22:0/2418456340 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66200108e0 con 0x7f6624102740 2024-08-20T01:23:08.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.277+0000 7f661affd640 1 -- 172.21.15.22:0/2418456340 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6620018880 con 0x7f6624102740 2024-08-20T01:23:08.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.277+0000 7f662bd47640 1 -- 172.21.15.22:0/2418456340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66241a3150 con 0x7f6624102740 2024-08-20T01:23:08.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.278+0000 7f662bd47640 1 -- 172.21.15.22:0/2418456340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6624109a60 con 0x7f6624102740 2024-08-20T01:23:08.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.280+0000 7f661affd640 1 -- 172.21.15.22:0/2418456340 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f6620010430 con 0x7f6624102740 2024-08-20T01:23:08.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.281+0000 7f661affd640 1 --2- 172.21.15.22:0/2418456340 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f66100b3bc0 0x7f66100b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:08.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.281+0000 7f66292e2640 1 --2- 172.21.15.22:0/2418456340 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f66100b3bc0 0x7f66100b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:08.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.281+0000 7f661affd640 1 -- 172.21.15.22:0/2418456340 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f66200e2770 con 0x7f6624102740 2024-08-20T01:23:08.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.281+0000 7f66292e2640 1 --2- 172.21.15.22:0/2418456340 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f66100b3bc0 0x7f66100b6080 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6614005fd0 tx=0x7f661400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:08.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.287+0000 7f661affd640 1 -- 172.21.15.22:0/2418456340 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f66200ab3a0 con 0x7f6624102740 2024-08-20T01:23:08.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.433+0000 7f3212e08640 1 -- 172.21.15.22:0/1976731267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f320c104250 msgr2=0x7f320c10abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:08.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.433+0000 7f3212e08640 1 --2- 172.21.15.22:0/1976731267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f320c104250 0x7f320c10abd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3204009cd0 tx=0x7f320402a8e0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.433+0000 7f3212e08640 1 -- 172.21.15.22:0/1976731267 shutdown_connections 2024-08-20T01:23:08.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.433+0000 7f3212e08640 1 --2- 172.21.15.22:0/1976731267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f320c104250 0x7f320c10abd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.433+0000 7f3212e08640 1 --2- 172.21.15.22:0/1976731267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f320c103890 0x7f320c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.433+0000 7f3212e08640 1 --2- 172.21.15.22:0/1976731267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f320c102730 0x7f320c102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.433+0000 7f3212e08640 1 -- 172.21.15.22:0/1976731267 >> 172.21.15.22:0/1976731267 conn(0x7f320c0fe020 msgr2=0x7f320c100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:08.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.434+0000 7f3212e08640 1 -- 172.21.15.22:0/1976731267 shutdown_connections 2024-08-20T01:23:08.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.434+0000 7f3212e08640 1 -- 172.21.15.22:0/1976731267 wait complete. 2024-08-20T01:23:08.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.434+0000 7f3212e08640 1 Processor -- start 2024-08-20T01:23:08.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.434+0000 7f3212e08640 1 -- start start 2024-08-20T01:23:08.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f3212e08640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f320c102730 0x7f320c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:08.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f3212e08640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f320c103890 0x7f320c198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:08.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f3212e08640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f320c104250 0x7f320c199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:08.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f3212e08640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f320c10e2c0 con 0x7f320c104250 2024-08-20T01:23:08.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f3212e08640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f320c10e140 con 0x7f320c103890 2024-08-20T01:23:08.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f3212e08640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f320c10e440 con 0x7f320c102730 2024-08-20T01:23:08.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f32113a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f320c104250 0x7f320c199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:08.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f32113a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f320c104250 0x7f320c199bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57688/0 (socket says 172.21.15.22:57688) 2024-08-20T01:23:08.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f32113a5640 1 -- 172.21.15.22:0/1203560263 learned_addr learned my addr 172.21.15.22:0/1203560263 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:23:08.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f3210ba4640 1 --2- 172.21.15.22:0/1203560263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f320c102730 0x7f320c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:08.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f320bfff640 1 --2- 172.21.15.22:0/1203560263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f320c103890 0x7f320c198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:08.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f32113a5640 1 -- 172.21.15.22:0/1203560263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f320c102730 msgr2=0x7f320c198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:08.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f32113a5640 1 --2- 172.21.15.22:0/1203560263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f320c102730 0x7f320c198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f32113a5640 1 -- 172.21.15.22:0/1203560263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f320c103890 msgr2=0x7f320c198f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:08.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f32113a5640 1 --2- 172.21.15.22:0/1203560263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f320c103890 0x7f320c198f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f32113a5640 1 -- 172.21.15.22:0/1203560263 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320c19a460 con 0x7f320c104250 2024-08-20T01:23:08.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f32113a5640 1 --2- 172.21.15.22:0/1203560263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f320c104250 0x7f320c199bc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3204031040 tx=0x7f3204003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:08.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f3209ffb640 1 -- 172.21.15.22:0/1203560263 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3204004240 con 0x7f320c104250 2024-08-20T01:23:08.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f3209ffb640 1 -- 172.21.15.22:0/1203560263 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f32040305a0 con 0x7f320c104250 2024-08-20T01:23:08.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f3209ffb640 1 -- 172.21.15.22:0/1203560263 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320403a660 con 0x7f320c104250 2024-08-20T01:23:08.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.435+0000 7f3212e08640 1 -- 172.21.15.22:0/1203560263 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f320c19a6f0 con 0x7f320c104250 2024-08-20T01:23:08.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.436+0000 7f3212e08640 1 -- 172.21.15.22:0/1203560263 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f320c1a0e30 con 0x7f320c104250 2024-08-20T01:23:08.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.437+0000 7f3212e08640 1 -- 172.21.15.22:0/1203560263 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f320c102b30 con 0x7f320c104250 2024-08-20T01:23:08.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.438+0000 7f3209ffb640 1 -- 172.21.15.22:0/1203560263 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f3204030a50 con 0x7f320c104250 2024-08-20T01:23:08.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.439+0000 7f3209ffb640 1 --2- 172.21.15.22:0/1203560263 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f31fc0b3c40 0x7f31fc0b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:08.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.439+0000 7f3210ba4640 1 --2- 172.21.15.22:0/1203560263 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f31fc0b3c40 0x7f31fc0b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:08.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.439+0000 7f3209ffb640 1 -- 172.21.15.22:0/1203560263 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f320402e030 con 0x7f320c104250 2024-08-20T01:23:08.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.439+0000 7f3210ba4640 1 --2- 172.21.15.22:0/1203560263 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f31fc0b3c40 0x7f31fc0b6100 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3200005fd0 tx=0x7f320000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:08.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.442+0000 7f3209ffb640 1 -- 172.21.15.22:0/1203560263 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f3204106030 con 0x7f320c104250 2024-08-20T01:23:08.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.635+0000 7f3212e08640 1 -- 172.21.15.22:0/1203560263 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f320c063a80 con 0x7f320c104250 2024-08-20T01:23:08.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.638+0000 7f3209ffb640 1 -- 172.21.15.22:0/1203560263 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v28)=0 v28) ==== 123+0+0 (secure 0 0 0) 0x7f32040cc300 con 0x7f320c104250 2024-08-20T01:23:08.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.639+0000 7f3209ffb640 1 -- 172.21.15.22:0/1203560263 <== mon.0 v2:172.21.15.22:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3204030750 con 0x7f320c104250 2024-08-20T01:23:08.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.641+0000 7f3212e08640 1 -- 172.21.15.22:0/1203560263 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f31fc0b3c40 msgr2=0x7f31fc0b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:08.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.641+0000 7f3212e08640 1 --2- 172.21.15.22:0/1203560263 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f31fc0b3c40 0x7f31fc0b6100 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3200005fd0 tx=0x7f320000b390 comp rx=0 tx=0).stop 2024-08-20T01:23:08.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.641+0000 7f3212e08640 1 -- 172.21.15.22:0/1203560263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f320c104250 msgr2=0x7f320c199bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:08.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.641+0000 7f3212e08640 1 --2- 172.21.15.22:0/1203560263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f320c104250 0x7f320c199bc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3204031040 tx=0x7f3204003ba0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.641+0000 7f3212e08640 1 -- 172.21.15.22:0/1203560263 shutdown_connections 2024-08-20T01:23:08.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.641+0000 7f3212e08640 1 --2- 172.21.15.22:0/1203560263 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f31fc0b3c40 0x7f31fc0b6100 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.641+0000 7f3212e08640 1 --2- 172.21.15.22:0/1203560263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f320c104250 0x7f320c199bc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.641+0000 7f3212e08640 1 --2- 172.21.15.22:0/1203560263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f320c103890 0x7f320c198f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.641+0000 7f3212e08640 1 --2- 172.21.15.22:0/1203560263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f320c102730 0x7f320c198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.641+0000 7f3212e08640 1 -- 172.21.15.22:0/1203560263 >> 172.21.15.22:0/1203560263 conn(0x7f320c0fe020 msgr2=0x7f320c106bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:08.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.641+0000 7f3212e08640 1 -- 172.21.15.22:0/1203560263 shutdown_connections 2024-08-20T01:23:08.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:07.641+0000 7f3212e08640 1 -- 172.21.15.22:0/1203560263 wait complete. 2024-08-20T01:23:08.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.475+0000 7f662bd47640 1 -- 172.21.15.22:0/2418456340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f662402e340 con 0x7f6624102740 2024-08-20T01:23:08.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.481+0000 7f661affd640 1 -- 172.21.15.22:0/2418456340 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v29)=0 v29) ==== 115+0+0 (secure 0 0 0) 0x7f66200af8f0 con 0x7f6624102740 2024-08-20T01:23:08.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.483+0000 7f662bd47640 1 -- 172.21.15.22:0/2418456340 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f66100b3bc0 msgr2=0x7f66100b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:08.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.483+0000 7f662bd47640 1 --2- 172.21.15.22:0/2418456340 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f66100b3bc0 0x7f66100b6080 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6614005fd0 tx=0x7f661400b390 comp rx=0 tx=0).stop 2024-08-20T01:23:08.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.483+0000 7f662bd47640 1 -- 172.21.15.22:0/2418456340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6624102740 msgr2=0x7f6624076a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:08.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.483+0000 7f662bd47640 1 --2- 172.21.15.22:0/2418456340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6624102740 0x7f6624076a00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f662000e9f0 tx=0x7f662000eeb0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.483+0000 7f662bd47640 1 -- 172.21.15.22:0/2418456340 shutdown_connections 2024-08-20T01:23:08.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.483+0000 7f662bd47640 1 --2- 172.21.15.22:0/2418456340 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f66100b3bc0 0x7f66100b6080 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.483+0000 7f662bd47640 1 --2- 172.21.15.22:0/2418456340 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6624104260 0x7f66240757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.483+0000 7f662bd47640 1 --2- 172.21.15.22:0/2418456340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66241038a0 0x7f6624075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.483+0000 7f662bd47640 1 --2- 172.21.15.22:0/2418456340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6624102740 0x7f6624076a00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.483+0000 7f662bd47640 1 -- 172.21.15.22:0/2418456340 >> 172.21.15.22:0/2418456340 conn(0x7f66240fdff0 msgr2=0x7f6624106c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:08.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.483+0000 7f662bd47640 1 -- 172.21.15.22:0/2418456340 shutdown_connections 2024-08-20T01:23:08.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.483+0000 7f662bd47640 1 -- 172.21.15.22:0/2418456340 wait complete. 2024-08-20T01:23:08.687 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:08 smithi134 ceph-mon[22511]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:08.687 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:08 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1203560263' entity='client.admin' 2024-08-20T01:23:08.687 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:08 smithi134 ceph-mon[22511]: from='client.? ' entity='client.admin' 2024-08-20T01:23:08.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.692+0000 7f6ff363e640 1 -- 172.21.15.22:0/1828277362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fec102740 msgr2=0x7f6fec102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:08.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.692+0000 7f6ff363e640 1 --2- 172.21.15.22:0/1828277362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fec102740 0x7f6fec102b40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8009930 tx=0x7f6fe802a420 comp rx=0 tx=0).stop 2024-08-20T01:23:08.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.692+0000 7f6ff363e640 1 -- 172.21.15.22:0/1828277362 shutdown_connections 2024-08-20T01:23:08.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.692+0000 7f6ff363e640 1 --2- 172.21.15.22:0/1828277362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fec104260 0x7f6fec10abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.692+0000 7f6ff363e640 1 --2- 172.21.15.22:0/1828277362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fec1038a0 0x7f6fec103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.692+0000 7f6ff363e640 1 --2- 172.21.15.22:0/1828277362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fec102740 0x7f6fec102b40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.692+0000 7f6ff363e640 1 -- 172.21.15.22:0/1828277362 >> 172.21.15.22:0/1828277362 conn(0x7f6fec0fdff0 msgr2=0x7f6fec100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:08.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.692+0000 7f6ff363e640 1 -- 172.21.15.22:0/1828277362 shutdown_connections 2024-08-20T01:23:08.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.692+0000 7f6ff363e640 1 -- 172.21.15.22:0/1828277362 wait complete. 2024-08-20T01:23:08.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.693+0000 7f6ff363e640 1 Processor -- start 2024-08-20T01:23:08.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.693+0000 7f6ff363e640 1 -- start start 2024-08-20T01:23:08.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.693+0000 7f6ff363e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fec102740 0x7f6fec076a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:08.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.693+0000 7f6ff363e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fec1038a0 0x7f6fec075270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:08.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.693+0000 7f6ff363e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fec104260 0x7f6fec0757b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:08.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.693+0000 7f6ff363e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec10e410 con 0x7f6fec104260 2024-08-20T01:23:08.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.693+0000 7f6ff363e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec10e290 con 0x7f6fec102740 2024-08-20T01:23:08.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.693+0000 7f6ff363e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec10e590 con 0x7f6fec1038a0 2024-08-20T01:23:08.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.693+0000 7f6ff0bd9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fec1038a0 0x7f6fec075270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:08.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.693+0000 7f6ff0bd9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fec1038a0 0x7f6fec075270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:52086/0 (socket says 172.21.15.22:52086) 2024-08-20T01:23:08.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.693+0000 7f6ff0bd9640 1 -- 172.21.15.22:0/4003418170 learned_addr learned my addr 172.21.15.22:0/4003418170 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:23:08.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.693+0000 7f6ff1bdb640 1 --2- 172.21.15.22:0/4003418170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fec104260 0x7f6fec0757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:08.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.693+0000 7f6ff13da640 1 --2- 172.21.15.22:0/4003418170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fec102740 0x7f6fec076a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:08.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.694+0000 7f6ff0bd9640 1 -- 172.21.15.22:0/4003418170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fec102740 msgr2=0x7f6fec076a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:08.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.694+0000 7f6ff0bd9640 1 --2- 172.21.15.22:0/4003418170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fec102740 0x7f6fec076a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.694+0000 7f6ff0bd9640 1 -- 172.21.15.22:0/4003418170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fec104260 msgr2=0x7f6fec0757b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:08.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.694+0000 7f6ff0bd9640 1 --2- 172.21.15.22:0/4003418170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fec104260 0x7f6fec0757b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.694+0000 7f6ff0bd9640 1 -- 172.21.15.22:0/4003418170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fec076070 con 0x7f6fec1038a0 2024-08-20T01:23:08.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.694+0000 7f6ff0bd9640 1 --2- 172.21.15.22:0/4003418170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fec1038a0 0x7f6fec075270 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00e9f0 tx=0x7f6fdc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:08.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.694+0000 7f6fe27fc640 1 -- 172.21.15.22:0/4003418170 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc00cd80 con 0x7f6fec1038a0 2024-08-20T01:23:08.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.694+0000 7f6ff363e640 1 -- 172.21.15.22:0/4003418170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fec1a2bd0 con 0x7f6fec1038a0 2024-08-20T01:23:08.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.694+0000 7f6fe27fc640 1 -- 172.21.15.22:0/4003418170 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fdc0054d0 con 0x7f6fec1038a0 2024-08-20T01:23:08.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.694+0000 7f6fe27fc640 1 -- 172.21.15.22:0/4003418170 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc010690 con 0x7f6fec1038a0 2024-08-20T01:23:08.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.694+0000 7f6ff363e640 1 -- 172.21.15.22:0/4003418170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fec1a30e0 con 0x7f6fec1038a0 2024-08-20T01:23:08.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.695+0000 7f6ff363e640 1 -- 172.21.15.22:0/4003418170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fec109ac0 con 0x7f6fec1038a0 2024-08-20T01:23:08.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.696+0000 7f6fe27fc640 1 -- 172.21.15.22:0/4003418170 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f6fdc004e90 con 0x7f6fec1038a0 2024-08-20T01:23:08.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.697+0000 7f6fe27fc640 1 --2- 172.21.15.22:0/4003418170 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6fd80b3bc0 0x7f6fd80b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:08.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.697+0000 7f6ff13da640 1 --2- 172.21.15.22:0/4003418170 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6fd80b3bc0 0x7f6fd80b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:08.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.697+0000 7f6fe27fc640 1 -- 172.21.15.22:0/4003418170 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6fdc0e2310 con 0x7f6fec1038a0 2024-08-20T01:23:08.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.698+0000 7f6ff13da640 1 --2- 172.21.15.22:0/4003418170 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6fd80b3bc0 0x7f6fd80b6080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8009900 tx=0x7f6fe8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:08.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.701+0000 7f6fe27fc640 1 -- 172.21.15.22:0/4003418170 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f6fdc0ab610 con 0x7f6fec1038a0 2024-08-20T01:23:08.859 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:08 smithi022 ceph-mon[18709]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:08.859 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:08 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1203560263' entity='client.admin' 2024-08-20T01:23:08.859 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:08 smithi022 ceph-mon[18709]: from='client.? ' entity='client.admin' 2024-08-20T01:23:08.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.891+0000 7f6ff363e640 1 -- 172.21.15.22:0/4003418170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f6fec063a80 con 0x7f6fec1038a0 2024-08-20T01:23:08.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.898+0000 7f6fe27fc640 1 -- 172.21.15.22:0/4003418170 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v30)=0 v30) ==== 119+0+0 (secure 0 0 0) 0x7f6fdc0aaf10 con 0x7f6fec1038a0 2024-08-20T01:23:08.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.900+0000 7f6ff363e640 1 -- 172.21.15.22:0/4003418170 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6fd80b3bc0 msgr2=0x7f6fd80b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:08.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.900+0000 7f6ff363e640 1 --2- 172.21.15.22:0/4003418170 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6fd80b3bc0 0x7f6fd80b6080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8009900 tx=0x7f6fe8000bc0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.900+0000 7f6ff363e640 1 -- 172.21.15.22:0/4003418170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fec1038a0 msgr2=0x7f6fec075270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:08.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.900+0000 7f6ff363e640 1 --2- 172.21.15.22:0/4003418170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fec1038a0 0x7f6fec075270 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00e9f0 tx=0x7f6fdc00edf0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.900+0000 7f6ff363e640 1 -- 172.21.15.22:0/4003418170 shutdown_connections 2024-08-20T01:23:08.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.900+0000 7f6ff363e640 1 --2- 172.21.15.22:0/4003418170 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6fd80b3bc0 0x7f6fd80b6080 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.900+0000 7f6ff363e640 1 --2- 172.21.15.22:0/4003418170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fec104260 0x7f6fec0757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.900+0000 7f6ff363e640 1 --2- 172.21.15.22:0/4003418170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fec1038a0 0x7f6fec075270 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.900+0000 7f6ff363e640 1 --2- 172.21.15.22:0/4003418170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fec102740 0x7f6fec076a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:08.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.900+0000 7f6ff363e640 1 -- 172.21.15.22:0/4003418170 >> 172.21.15.22:0/4003418170 conn(0x7f6fec0fdff0 msgr2=0x7f6fec106c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:08.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.900+0000 7f6ff363e640 1 -- 172.21.15.22:0/4003418170 shutdown_connections 2024-08-20T01:23:08.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:08.900+0000 7f6ff363e640 1 -- 172.21.15.22:0/4003418170 wait complete. 2024-08-20T01:23:09.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:08 smithi077 ceph-mon[22251]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:09.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:08 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1203560263' entity='client.admin' 2024-08-20T01:23:09.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:08 smithi077 ceph-mon[22251]: from='client.? ' entity='client.admin' 2024-08-20T01:23:10.039 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:09 smithi022 ceph-mon[18709]: from='client.? ' entity='client.admin' 2024-08-20T01:23:10.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:09 smithi134 ceph-mon[22511]: from='client.? ' entity='client.admin' 2024-08-20T01:23:10.312 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:09 smithi077 ceph-mon[22251]: from='client.? ' entity='client.admin' 2024-08-20T01:23:11.096 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:10 smithi022 ceph-mon[18709]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:11.096 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:10 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:11.096 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:10 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:11.096 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:10 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:23:11.126 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi022') 2024-08-20T01:23:11.126 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi022') 2024-08-20T01:23:11.126 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi022') 2024-08-20T01:23:11.126 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi022') 2024-08-20T01:23:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.252+0000 7fe45b808640 1 -- 172.21.15.22:0/3667020529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4541038a0 msgr2=0x7fe454103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.252+0000 7fe45b808640 1 --2- 172.21.15.22:0/3667020529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4541038a0 0x7fe454103d20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe444009930 tx=0x7fe44402a420 comp rx=0 tx=0).stop 2024-08-20T01:23:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.252+0000 7fe45b808640 1 -- 172.21.15.22:0/3667020529 shutdown_connections 2024-08-20T01:23:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.252+0000 7fe45b808640 1 --2- 172.21.15.22:0/3667020529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe454104260 0x7fe45410abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.252+0000 7fe45b808640 1 --2- 172.21.15.22:0/3667020529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4541038a0 0x7fe454103d20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.252+0000 7fe45b808640 1 --2- 172.21.15.22:0/3667020529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe454102740 0x7fe454102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.252+0000 7fe45b808640 1 -- 172.21.15.22:0/3667020529 >> 172.21.15.22:0/3667020529 conn(0x7fe4540fdff0 msgr2=0x7fe454100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.252+0000 7fe45b808640 1 -- 172.21.15.22:0/3667020529 shutdown_connections 2024-08-20T01:23:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.252+0000 7fe45b808640 1 -- 172.21.15.22:0/3667020529 wait complete. 2024-08-20T01:23:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.253+0000 7fe45b808640 1 Processor -- start 2024-08-20T01:23:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.253+0000 7fe45b808640 1 -- start start 2024-08-20T01:23:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.253+0000 7fe45b808640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe454102740 0x7fe454076a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.253+0000 7fe45b808640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4541038a0 0x7fe454075270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.253+0000 7fe45b808640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe454104260 0x7fe4540757b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.253+0000 7fe45b808640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe45410e3c0 con 0x7fe454104260 2024-08-20T01:23:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.253+0000 7fe45b808640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe45410e240 con 0x7fe454102740 2024-08-20T01:23:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.253+0000 7fe45b808640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe45410e540 con 0x7fe4541038a0 2024-08-20T01:23:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.253+0000 7fe459da5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe454104260 0x7fe4540757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.253+0000 7fe4595a4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe454102740 0x7fe454076a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.253+0000 7fe459da5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe454104260 0x7fe4540757b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47088/0 (socket says 172.21.15.22:47088) 2024-08-20T01:23:11.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.253+0000 7fe459da5640 1 -- 172.21.15.22:0/2670572709 learned_addr learned my addr 172.21.15.22:0/2670572709 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:23:11.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.253+0000 7fe458da3640 1 --2- 172.21.15.22:0/2670572709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4541038a0 0x7fe454075270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:11.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.254+0000 7fe459da5640 1 -- 172.21.15.22:0/2670572709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4541038a0 msgr2=0x7fe454075270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:11.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.254+0000 7fe459da5640 1 --2- 172.21.15.22:0/2670572709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4541038a0 0x7fe454075270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.254+0000 7fe459da5640 1 -- 172.21.15.22:0/2670572709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe454102740 msgr2=0x7fe454076a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:11.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.254+0000 7fe459da5640 1 --2- 172.21.15.22:0/2670572709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe454102740 0x7fe454076a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.254+0000 7fe459da5640 1 -- 172.21.15.22:0/2670572709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe454076070 con 0x7fe454104260 2024-08-20T01:23:11.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.254+0000 7fe458da3640 1 --2- 172.21.15.22:0/2670572709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4541038a0 0x7fe454075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:23:11.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.254+0000 7fe459da5640 1 --2- 172.21.15.22:0/2670572709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe454104260 0x7fe4540757b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe44c00eaa0 tx=0x7fe44c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:11.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.254+0000 7fe44a7fc640 1 -- 172.21.15.22:0/2670572709 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c004d20 con 0x7fe454104260 2024-08-20T01:23:11.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.254+0000 7fe44a7fc640 1 -- 172.21.15.22:0/2670572709 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe44c005020 con 0x7fe454104260 2024-08-20T01:23:11.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.254+0000 7fe45b808640 1 -- 172.21.15.22:0/2670572709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4541a2b70 con 0x7fe454104260 2024-08-20T01:23:11.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.254+0000 7fe44a7fc640 1 -- 172.21.15.22:0/2670572709 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c0116b0 con 0x7fe454104260 2024-08-20T01:23:11.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.254+0000 7fe45b808640 1 -- 172.21.15.22:0/2670572709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4541a30d0 con 0x7fe454104260 2024-08-20T01:23:11.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.255+0000 7fe45b808640 1 -- 172.21.15.22:0/2670572709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4541099f0 con 0x7fe454104260 2024-08-20T01:23:11.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.256+0000 7fe44a7fc640 1 -- 172.21.15.22:0/2670572709 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fe44c0051d0 con 0x7fe454104260 2024-08-20T01:23:11.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.257+0000 7fe44a7fc640 1 --2- 172.21.15.22:0/2670572709 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe4400b3bc0 0x7fe4400b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:11.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.257+0000 7fe4595a4640 1 --2- 172.21.15.22:0/2670572709 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe4400b3bc0 0x7fe4400b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:11.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.257+0000 7fe44a7fc640 1 -- 172.21.15.22:0/2670572709 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe44c0e2050 con 0x7fe454104260 2024-08-20T01:23:11.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.258+0000 7fe4595a4640 1 --2- 172.21.15.22:0/2670572709 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe4400b3bc0 0x7fe4400b6080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe45000abe0 tx=0x7fe45000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:11.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.261+0000 7fe44a7fc640 1 -- 172.21.15.22:0/2670572709 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe44c016030 con 0x7fe454104260 2024-08-20T01:23:11.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:10 smithi134 ceph-mon[22511]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:11.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:10 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:11.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:10 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:11.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:10 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:23:11.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:10 smithi077 ceph-mon[22251]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:11.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:10 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:11.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:10 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:11.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:10 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:23:11.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.741+0000 7f8b46dec640 1 -- 172.21.15.22:0/1351322797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b4010a680 msgr2=0x7f8b4010cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:11.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.741+0000 7f8b46dec640 1 --2- 172.21.15.22:0/1351322797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b4010a680 0x7f8b4010cb40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8b38009ca0 tx=0x7f8b3802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.741+0000 7f8b46dec640 1 -- 172.21.15.22:0/1351322797 shutdown_connections 2024-08-20T01:23:11.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.741+0000 7f8b46dec640 1 --2- 172.21.15.22:0/1351322797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b4010a680 0x7f8b4010cb40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.741+0000 7f8b46dec640 1 --2- 172.21.15.22:0/1351322797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b40107c70 0x7f8b4010a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.741+0000 7f8b46dec640 1 --2- 172.21.15.22:0/1351322797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b4006bcb0 0x7f8b40107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.741+0000 7f8b46dec640 1 -- 172.21.15.22:0/1351322797 >> 172.21.15.22:0/1351322797 conn(0x7f8b400fcf00 msgr2=0x7f8b400ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:11.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.741+0000 7f8b46dec640 1 -- 172.21.15.22:0/1351322797 shutdown_connections 2024-08-20T01:23:11.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.741+0000 7f8b46dec640 1 -- 172.21.15.22:0/1351322797 wait complete. 2024-08-20T01:23:11.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.742+0000 7f8b46dec640 1 Processor -- start 2024-08-20T01:23:11.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.742+0000 7f8b46dec640 1 -- start start 2024-08-20T01:23:11.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.742+0000 7f8b46dec640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b4006bcb0 0x7f8b4019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:11.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.742+0000 7f8b46dec640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b40107c70 0x7f8b4019b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:11.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.742+0000 7f8b46dec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b4010a680 0x7f8b4019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:11.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.742+0000 7f8b46dec640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8b40110490 con 0x7f8b4006bcb0 2024-08-20T01:23:11.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.742+0000 7f8b46dec640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8b40110310 con 0x7f8b4010a680 2024-08-20T01:23:11.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.742+0000 7f8b46dec640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8b40110610 con 0x7f8b40107c70 2024-08-20T01:23:11.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.742+0000 7f8b44b88640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b4006bcb0 0x7f8b4019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:11.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.742+0000 7f8b44b88640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b4006bcb0 0x7f8b4019ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57556/0 (socket says 172.21.15.22:57556) 2024-08-20T01:23:11.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.742+0000 7f8b44b88640 1 -- 172.21.15.22:0/2421161597 learned_addr learned my addr 172.21.15.22:0/2421161597 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:23:11.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.743+0000 7f8b3ffff640 1 --2- 172.21.15.22:0/2421161597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b40107c70 0x7f8b4019b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:11.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.743+0000 7f8b45389640 1 --2- 172.21.15.22:0/2421161597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b4010a680 0x7f8b4019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:11.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.743+0000 7f8b44b88640 1 -- 172.21.15.22:0/2421161597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b40107c70 msgr2=0x7f8b4019b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:11.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.743+0000 7f8b44b88640 1 --2- 172.21.15.22:0/2421161597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b40107c70 0x7f8b4019b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.743+0000 7f8b44b88640 1 -- 172.21.15.22:0/2421161597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b4010a680 msgr2=0x7f8b4019bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:11.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.743+0000 7f8b44b88640 1 --2- 172.21.15.22:0/2421161597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b4010a680 0x7f8b4019bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.743+0000 7f8b44b88640 1 -- 172.21.15.22:0/2421161597 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b4019c630 con 0x7f8b4006bcb0 2024-08-20T01:23:11.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.743+0000 7f8b45389640 1 --2- 172.21.15.22:0/2421161597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b4010a680 0x7f8b4019bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:23:11.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.743+0000 7f8b44b88640 1 --2- 172.21.15.22:0/2421161597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b4006bcb0 0x7f8b4019ab00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400c920 tx=0x7f8b3400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:11.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.743+0000 7f8b3dffb640 1 -- 172.21.15.22:0/2421161597 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b34007c70 con 0x7f8b4006bcb0 2024-08-20T01:23:11.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.743+0000 7f8b3dffb640 1 -- 172.21.15.22:0/2421161597 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8b34007e10 con 0x7f8b4006bcb0 2024-08-20T01:23:11.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.743+0000 7f8b46dec640 1 -- 172.21.15.22:0/2421161597 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b4019c920 con 0x7f8b4006bcb0 2024-08-20T01:23:11.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.743+0000 7f8b3dffb640 1 -- 172.21.15.22:0/2421161597 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b34018720 con 0x7f8b4006bcb0 2024-08-20T01:23:11.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.743+0000 7f8b46dec640 1 -- 172.21.15.22:0/2421161597 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b401a3000 con 0x7f8b4006bcb0 2024-08-20T01:23:11.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.744+0000 7f8b46dec640 1 -- 172.21.15.22:0/2421161597 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b400fe9f0 con 0x7f8b4006bcb0 2024-08-20T01:23:11.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.746+0000 7f8b3dffb640 1 -- 172.21.15.22:0/2421161597 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f8b3400f450 con 0x7f8b4006bcb0 2024-08-20T01:23:11.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.746+0000 7f8b3dffb640 1 --2- 172.21.15.22:0/2421161597 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8b300b3b40 0x7f8b300b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:11.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.747+0000 7f8b3ffff640 1 --2- 172.21.15.22:0/2421161597 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8b300b3b40 0x7f8b300b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:11.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.747+0000 7f8b3dffb640 1 -- 172.21.15.22:0/2421161597 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8b340e2220 con 0x7f8b4006bcb0 2024-08-20T01:23:11.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.747+0000 7f8b3ffff640 1 --2- 172.21.15.22:0/2421161597 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8b300b3b40 0x7f8b300b6000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c005e10 tx=0x7f8b2c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:11.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.750+0000 7f8b3dffb640 1 -- 172.21.15.22:0/2421161597 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f8b34014030 con 0x7f8b4006bcb0 2024-08-20T01:23:11.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.942+0000 7f8b46dec640 1 -- 172.21.15.22:0/2421161597 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f8b40063a80 con 0x7f8b4006bcb0 2024-08-20T01:23:11.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.945+0000 7f8b3dffb640 1 -- 172.21.15.22:0/2421161597 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v21)=0 v21) ==== 120+0+0 (secure 0 0 0) 0x7f8b340ab4a0 con 0x7f8b4006bcb0 2024-08-20T01:23:11.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.947+0000 7f8b46dec640 1 -- 172.21.15.22:0/2421161597 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8b300b3b40 msgr2=0x7f8b300b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:11.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.947+0000 7f8b46dec640 1 --2- 172.21.15.22:0/2421161597 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8b300b3b40 0x7f8b300b6000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c005e10 tx=0x7f8b2c005da0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.947+0000 7f8b46dec640 1 -- 172.21.15.22:0/2421161597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b4006bcb0 msgr2=0x7f8b4019ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:11.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.947+0000 7f8b46dec640 1 --2- 172.21.15.22:0/2421161597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b4006bcb0 0x7f8b4019ab00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400c920 tx=0x7f8b3400cde0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.947+0000 7f8b46dec640 1 -- 172.21.15.22:0/2421161597 shutdown_connections 2024-08-20T01:23:11.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.947+0000 7f8b46dec640 1 --2- 172.21.15.22:0/2421161597 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8b300b3b40 0x7f8b300b6000 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.947+0000 7f8b46dec640 1 --2- 172.21.15.22:0/2421161597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b4010a680 0x7f8b4019bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.947+0000 7f8b46dec640 1 --2- 172.21.15.22:0/2421161597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b40107c70 0x7f8b4019b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.947+0000 7f8b46dec640 1 --2- 172.21.15.22:0/2421161597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b4006bcb0 0x7f8b4019ab00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.947+0000 7f8b46dec640 1 -- 172.21.15.22:0/2421161597 >> 172.21.15.22:0/2421161597 conn(0x7f8b400fcf00 msgr2=0x7f8b40108870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:11.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.947+0000 7f8b46dec640 1 -- 172.21.15.22:0/2421161597 shutdown_connections 2024-08-20T01:23:11.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:01.948+0000 7f8b46dec640 1 -- 172.21.15.22:0/2421161597 wait complete. 2024-08-20T01:23:11.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.451+0000 7fe45b808640 1 -- 172.21.15.22:0/2670572709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fe454063b20 con 0x7fe454104260 2024-08-20T01:23:11.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.455+0000 7fe44a7fc640 1 -- 172.21.15.22:0/2670572709 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v31)=0 v31) ==== 127+0+0 (secure 0 0 0) 0x7fe44c0ab370 con 0x7fe454104260 2024-08-20T01:23:11.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.457+0000 7fe45b808640 1 -- 172.21.15.22:0/2670572709 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe4400b3bc0 msgr2=0x7fe4400b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:11.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.457+0000 7fe45b808640 1 --2- 172.21.15.22:0/2670572709 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe4400b3bc0 0x7fe4400b6080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe45000abe0 tx=0x7fe45000a2d0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.457+0000 7fe45b808640 1 -- 172.21.15.22:0/2670572709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe454104260 msgr2=0x7fe4540757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:11.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.457+0000 7fe45b808640 1 --2- 172.21.15.22:0/2670572709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe454104260 0x7fe4540757b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe44c00eaa0 tx=0x7fe44c00eea0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.457+0000 7fe45b808640 1 -- 172.21.15.22:0/2670572709 shutdown_connections 2024-08-20T01:23:11.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.457+0000 7fe45b808640 1 --2- 172.21.15.22:0/2670572709 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe4400b3bc0 0x7fe4400b6080 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.457+0000 7fe45b808640 1 --2- 172.21.15.22:0/2670572709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe454104260 0x7fe4540757b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.457+0000 7fe45b808640 1 --2- 172.21.15.22:0/2670572709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4541038a0 0x7fe454075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.457+0000 7fe45b808640 1 --2- 172.21.15.22:0/2670572709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe454102740 0x7fe454076a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:11.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.457+0000 7fe45b808640 1 -- 172.21.15.22:0/2670572709 >> 172.21.15.22:0/2670572709 conn(0x7fe4540fdff0 msgr2=0x7fe454106bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:11.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.457+0000 7fe45b808640 1 -- 172.21.15.22:0/2670572709 shutdown_connections 2024-08-20T01:23:11.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:11.457+0000 7fe45b808640 1 -- 172.21.15.22:0/2670572709 wait complete. 2024-08-20T01:23:12.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:11 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:12.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:11 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:23:12.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:11 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:12.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:11 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2670572709' entity='client.admin' 2024-08-20T01:23:12.296 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:11 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:12.297 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:11 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:23:12.297 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:11 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:12.297 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:11 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2670572709' entity='client.admin' 2024-08-20T01:23:12.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:11 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:12.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:11 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:23:12.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:11 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:12.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:11 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2670572709' entity='client.admin' 2024-08-20T01:23:12.776 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi022') 2024-08-20T01:23:12.777 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi022') 2024-08-20T01:23:12.777 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi022') 2024-08-20T01:23:12.777 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi022') 2024-08-20T01:23:12.777 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi022') 2024-08-20T01:23:12.777 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi022') 2024-08-20T01:23:12.777 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi022') 2024-08-20T01:23:12.777 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi022') 2024-08-20T01:23:12.777 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi022') 2024-08-20T01:23:12.777 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi022') 2024-08-20T01:23:12.778 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi022') 2024-08-20T01:23:12.778 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi022') 2024-08-20T01:23:12.778 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '586fd06c-5e92-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi022') 2024-08-20T01:23:12.778 INFO:tasks.cephadm:Deploying OSDs... 2024-08-20T01:23:12.778 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-08-20T01:23:12.778 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/scratch_devs of=/dev/stdout 2024-08-20T01:23:12.798 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-20T01:23:12.798 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_1 2024-08-20T01:23:12.856 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-20T01:23:12.856 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:23:12.856 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-08-20T01:23:12.856 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:23:12.856 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:23:12.856 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-08-20 01:22:07.213583620 +0000 2024-08-20T01:23:12.856 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-08-20 01:17:20.375344328 +0000 2024-08-20T01:23:12.856 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-08-20 01:17:20.375344328 +0000 2024-08-20T01:23:12.856 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-08-20 01:17:20.375344328 +0000 2024-08-20T01:23:12.857 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-20T01:23:12.925 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-08-20T01:23:12.925 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-08-20T01:23:12.925 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000108428 s, 4.7 MB/s 2024-08-20T01:23:12.927 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-20T01:23:12.985 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_2 2024-08-20T01:23:13.042 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-20T01:23:13.042 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:23:13.042 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-08-20T01:23:13.042 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:23:13.043 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:23:13.043 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-08-20 01:22:07.241583253 +0000 2024-08-20T01:23:13.043 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-08-20 01:17:20.688339061 +0000 2024-08-20T01:23:13.043 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-08-20 01:17:20.688339061 +0000 2024-08-20T01:23:13.043 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-08-20 01:17:20.688339061 +0000 2024-08-20T01:23:13.043 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-20T01:23:13.108 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-08-20T01:23:13.108 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-08-20T01:23:13.108 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.00010045 s, 5.1 MB/s 2024-08-20T01:23:13.110 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-20T01:23:13.170 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_3 2024-08-20T01:23:13.227 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-20T01:23:13.227 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:23:13.227 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 707 Links: 1 2024-08-20T01:23:13.227 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:23:13.227 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:23:13.227 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-08-20 01:22:07.268582899 +0000 2024-08-20T01:23:13.227 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-08-20 01:17:21.004333746 +0000 2024-08-20T01:23:13.228 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-08-20 01:17:21.004333746 +0000 2024-08-20T01:23:13.228 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-08-20 01:17:21.004333746 +0000 2024-08-20T01:23:13.228 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-20T01:23:13.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:12 smithi134 ceph-mon[22511]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:13.290 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:12 smithi022 ceph-mon[18709]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:13.293 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-08-20T01:23:13.293 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-08-20T01:23:13.293 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.00010987 s, 4.7 MB/s 2024-08-20T01:23:13.294 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-20T01:23:13.312 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:12 smithi077 ceph-mon[22251]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:13.351 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_4 2024-08-20T01:23:13.408 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-20T01:23:13.408 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:23:13.408 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-08-20T01:23:13.408 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:23:13.408 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:23:13.408 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-08-20 01:22:07.295582546 +0000 2024-08-20T01:23:13.408 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-08-20 01:17:21.314328532 +0000 2024-08-20T01:23:13.408 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-08-20 01:17:21.314328532 +0000 2024-08-20T01:23:13.408 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-08-20 01:17:21.314328532 +0000 2024-08-20T01:23:13.408 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-20T01:23:13.473 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-08-20T01:23:13.473 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-08-20T01:23:13.473 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000106812 s, 4.8 MB/s 2024-08-20T01:23:13.474 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-20T01:23:13.531 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-08-20T01:23:13.531 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2024-08-20T01:23:13.551 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-20T01:23:13.552 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2024-08-20T01:23:13.610 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-20T01:23:13.610 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:23:13.610 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-08-20T01:23:13.610 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:23:13.610 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:23:13.610 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-08-20 01:22:55.312054902 +0000 2024-08-20T01:23:13.610 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-08-20 01:17:54.480220505 +0000 2024-08-20T01:23:13.610 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-08-20 01:17:54.480220505 +0000 2024-08-20T01:23:13.610 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-08-20 01:17:54.480220505 +0000 2024-08-20T01:23:13.611 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-20T01:23:13.680 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-08-20T01:23:13.680 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-08-20T01:23:13.680 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000281453 s, 1.8 MB/s 2024-08-20T01:23:13.681 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-20T01:23:13.740 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2024-08-20T01:23:13.796 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-20T01:23:13.796 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:23:13.796 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-08-20T01:23:13.796 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:23:13.797 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:23:13.797 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-08-20 01:22:55.312054902 +0000 2024-08-20T01:23:13.797 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-08-20 01:17:54.806213623 +0000 2024-08-20T01:23:13.797 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-08-20 01:17:54.806213623 +0000 2024-08-20T01:23:13.797 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-08-20 01:17:54.806213623 +0000 2024-08-20T01:23:13.797 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-20T01:23:13.862 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-08-20T01:23:13.862 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-08-20T01:23:13.862 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000248518 s, 2.1 MB/s 2024-08-20T01:23:13.863 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-20T01:23:13.921 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2024-08-20T01:23:13.978 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-20T01:23:13.978 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:23:13.978 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-08-20T01:23:13.978 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:23:13.978 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:23:13.978 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-08-20 01:22:55.312054902 +0000 2024-08-20T01:23:13.978 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-08-20 01:17:55.134206699 +0000 2024-08-20T01:23:13.978 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-08-20 01:17:55.134206699 +0000 2024-08-20T01:23:13.978 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-08-20 01:17:55.134206699 +0000 2024-08-20T01:23:13.978 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-20T01:23:14.043 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-08-20T01:23:14.043 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-08-20T01:23:14.043 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000220317 s, 2.3 MB/s 2024-08-20T01:23:14.044 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-20T01:23:14.101 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2024-08-20T01:23:14.157 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-20T01:23:14.157 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:23:14.157 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-08-20T01:23:14.157 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:23:14.157 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:23:14.157 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-08-20 01:22:55.313054880 +0000 2024-08-20T01:23:14.157 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-08-20 01:17:55.457199881 +0000 2024-08-20T01:23:14.157 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-08-20 01:17:55.457199881 +0000 2024-08-20T01:23:14.158 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-08-20 01:17:55.457199881 +0000 2024-08-20T01:23:14.158 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-20T01:23:14.222 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-08-20T01:23:14.222 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-08-20T01:23:14.222 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.00020015 s, 2.6 MB/s 2024-08-20T01:23:14.223 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-20T01:23:14.280 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-08-20T01:23:14.280 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-08-20T01:23:14.300 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-20T01:23:14.300 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-08-20T01:23:14.359 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-20T01:23:14.359 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:23:14.359 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-08-20T01:23:14.359 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:23:14.359 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:23:14.359 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-08-20 01:22:52.986253564 +0000 2024-08-20T01:23:14.359 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-08-20 01:17:53.354370406 +0000 2024-08-20T01:23:14.359 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-08-20 01:17:53.354370406 +0000 2024-08-20T01:23:14.360 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-08-20 01:17:53.354370406 +0000 2024-08-20T01:23:14.360 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-20T01:23:14.429 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-08-20T01:23:14.429 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-08-20T01:23:14.429 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000289452 s, 1.8 MB/s 2024-08-20T01:23:14.431 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-20T01:23:14.489 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-08-20T01:23:14.546 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-20T01:23:14.546 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:23:14.546 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-08-20T01:23:14.547 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:23:14.547 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:23:14.547 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-08-20 01:22:52.986253564 +0000 2024-08-20T01:23:14.547 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-08-20 01:17:53.690362723 +0000 2024-08-20T01:23:14.547 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-08-20 01:17:53.690362723 +0000 2024-08-20T01:23:14.547 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-08-20 01:17:53.690362723 +0000 2024-08-20T01:23:14.547 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-20T01:23:14.612 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-08-20T01:23:14.612 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-08-20T01:23:14.612 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000213124 s, 2.4 MB/s 2024-08-20T01:23:14.613 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-20T01:23:14.671 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-08-20T01:23:14.727 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-20T01:23:14.727 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:23:14.727 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-08-20T01:23:14.727 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:23:14.727 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:23:14.727 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-08-20 01:22:52.986253564 +0000 2024-08-20T01:23:14.727 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-08-20 01:17:54.028354995 +0000 2024-08-20T01:23:14.728 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-08-20 01:17:54.028354995 +0000 2024-08-20T01:23:14.728 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-08-20 01:17:54.028354995 +0000 2024-08-20T01:23:14.728 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-20T01:23:14.791 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-08-20T01:23:14.792 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-08-20T01:23:14.792 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000191675 s, 2.7 MB/s 2024-08-20T01:23:14.793 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-20T01:23:14.849 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-08-20T01:23:14.905 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-20T01:23:14.905 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:23:14.905 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-08-20T01:23:14.905 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:23:14.905 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:23:14.905 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-08-20 01:22:52.987253542 +0000 2024-08-20T01:23:14.905 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-08-20 01:17:54.350347632 +0000 2024-08-20T01:23:14.905 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-08-20 01:17:54.350347632 +0000 2024-08-20T01:23:14.906 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-08-20 01:17:54.350347632 +0000 2024-08-20T01:23:14.906 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-20T01:23:14.969 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-08-20T01:23:14.969 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-08-20T01:23:14.969 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000174048 s, 2.9 MB/s 2024-08-20T01:23:14.970 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-20T01:23:15.026 INFO:tasks.cephadm:Deploying osd.0 on smithi022 with /dev/vg_nvme/lv_4... 2024-08-20T01:23:15.026 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-20T01:23:15.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:14 smithi134 ceph-mon[22511]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:15.289 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:23:15.312 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:14 smithi077 ceph-mon[22251]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:15.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:14 smithi022 ceph-mon[18709]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:17.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:16 smithi134 ceph-mon[22511]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:17.312 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:16 smithi077 ceph-mon[22251]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:17.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:16 smithi022 ceph-mon[18709]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:17.625 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:23:17.655 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_4 2024-08-20T01:23:17.915 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:23:18.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.471+0000 7fc039ad8640 1 -- 172.21.15.22:0/3022097259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc034101610 msgr2=0x7fc034101a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:18.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.471+0000 7fc039ad8640 1 --2- 172.21.15.22:0/3022097259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc034101610 0x7fc034101a10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc024009930 tx=0x7fc02402a420 comp rx=0 tx=0).stop 2024-08-20T01:23:18.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.471+0000 7fc039ad8640 1 -- 172.21.15.22:0/3022097259 shutdown_connections 2024-08-20T01:23:18.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.471+0000 7fc039ad8640 1 --2- 172.21.15.22:0/3022097259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc034103130 0x7fc034109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:18.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.471+0000 7fc039ad8640 1 --2- 172.21.15.22:0/3022097259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc034102770 0x7fc034102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:18.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.471+0000 7fc039ad8640 1 --2- 172.21.15.22:0/3022097259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc034101610 0x7fc034101a10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:18.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.471+0000 7fc039ad8640 1 -- 172.21.15.22:0/3022097259 >> 172.21.15.22:0/3022097259 conn(0x7fc0340fcee0 msgr2=0x7fc0340ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:18.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.471+0000 7fc039ad8640 1 -- 172.21.15.22:0/3022097259 shutdown_connections 2024-08-20T01:23:18.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.471+0000 7fc039ad8640 1 -- 172.21.15.22:0/3022097259 wait complete. 2024-08-20T01:23:18.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.471+0000 7fc039ad8640 1 Processor -- start 2024-08-20T01:23:18.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.471+0000 7fc039ad8640 1 -- start start 2024-08-20T01:23:18.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.472+0000 7fc039ad8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc034101610 0x7fc034198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:18.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.472+0000 7fc039ad8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc034102770 0x7fc0341991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:18.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.472+0000 7fc039ad8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc034103130 0x7fc034199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:18.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.472+0000 7fc039ad8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc03410d2f0 con 0x7fc034102770 2024-08-20T01:23:18.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.472+0000 7fc039ad8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc03410d170 con 0x7fc034101610 2024-08-20T01:23:18.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.472+0000 7fc039ad8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc03410d470 con 0x7fc034103130 2024-08-20T01:23:18.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.472+0000 7fc02affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc034102770 0x7fc0341991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:18.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.472+0000 7fc02affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc034102770 0x7fc0341991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47094/0 (socket says 172.21.15.22:47094) 2024-08-20T01:23:18.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.472+0000 7fc02affd640 1 -- 172.21.15.22:0/3393477573 learned_addr learned my addr 172.21.15.22:0/3393477573 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:23:18.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.472+0000 7fc0337fe640 1 --2- 172.21.15.22:0/3393477573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc034101610 0x7fc034198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.472+0000 7fc033fff640 1 --2- 172.21.15.22:0/3393477573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc034103130 0x7fc034199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.472+0000 7fc02affd640 1 -- 172.21.15.22:0/3393477573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc034103130 msgr2=0x7fc034199e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.472+0000 7fc02affd640 1 --2- 172.21.15.22:0/3393477573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc034103130 0x7fc034199e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.472+0000 7fc02affd640 1 -- 172.21.15.22:0/3393477573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc034101610 msgr2=0x7fc034198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.472+0000 7fc02affd640 1 --2- 172.21.15.22:0/3393477573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc034101610 0x7fc034198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.472+0000 7fc02affd640 1 -- 172.21.15.22:0/3393477573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03419a6c0 con 0x7fc034102770 2024-08-20T01:23:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.472+0000 7fc02affd640 1 --2- 172.21.15.22:0/3393477573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc034102770 0x7fc0341991e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00b4a0 tx=0x7fc01c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.473+0000 7fc0317fa640 1 -- 172.21.15.22:0/3393477573 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c014070 con 0x7fc034102770 2024-08-20T01:23:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.473+0000 7fc0317fa640 1 -- 172.21.15.22:0/3393477573 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc01c010ac0 con 0x7fc034102770 2024-08-20T01:23:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.473+0000 7fc039ad8640 1 -- 172.21.15.22:0/3393477573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc03419a9b0 con 0x7fc034102770 2024-08-20T01:23:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.473+0000 7fc0317fa640 1 -- 172.21.15.22:0/3393477573 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c017c30 con 0x7fc034102770 2024-08-20T01:23:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.473+0000 7fc039ad8640 1 -- 172.21.15.22:0/3393477573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0341a1090 con 0x7fc034102770 2024-08-20T01:23:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.474+0000 7fc039ad8640 1 -- 172.21.15.22:0/3393477573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0341a1260 con 0x7fc034102770 2024-08-20T01:23:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.475+0000 7fc0317fa640 1 -- 172.21.15.22:0/3393477573 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fc01c017070 con 0x7fc034102770 2024-08-20T01:23:18.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.476+0000 7fc0317fa640 1 --2- 172.21.15.22:0/3393477573 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc0200b3bc0 0x7fc0200b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:18.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.476+0000 7fc0337fe640 1 --2- 172.21.15.22:0/3393477573 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc0200b3bc0 0x7fc0200b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:18.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.476+0000 7fc0317fa640 1 -- 172.21.15.22:0/3393477573 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc01c0e15e0 con 0x7fc034102770 2024-08-20T01:23:18.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.476+0000 7fc0337fe640 1 --2- 172.21.15.22:0/3393477573 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc0200b3bc0 0x7fc0200b6080 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc024009900 tx=0x7fc024031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:18.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.479+0000 7fc0317fa640 1 -- 172.21.15.22:0/3393477573 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fc01c0aa860 con 0x7fc034102770 2024-08-20T01:23:18.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:18.672+0000 7fc039ad8640 1 -- 172.21.15.22:0/3393477573 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fc0341a1430 con 0x7fc0200b3bc0 2024-08-20T01:23:19.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:18 smithi077 ceph-mon[22251]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:19.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:18 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:23:19.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:18 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:23:19.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:18 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:19.086 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:18 smithi022 ceph-mon[18709]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:19.086 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:18 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:23:19.086 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:18 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:23:19.086 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:18 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:19.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:18 smithi134 ceph-mon[22511]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:19.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:18 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:23:19.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:18 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:23:19.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:18 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:19.990 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:19 smithi022 ceph-mon[18709]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:23:20.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:19 smithi134 ceph-mon[22511]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:23:20.312 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:19 smithi077 ceph-mon[22251]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:23:21.242 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:20 smithi022 ceph-mon[18709]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:21.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:20 smithi134 ceph-mon[22511]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:21.312 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:20 smithi077 ceph-mon[22251]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:22.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:21 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/717645469' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b67a59af-5eea-4073-a4b2-604a1b7b8f82"} : dispatch 2024-08-20T01:23:22.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:21 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/717645469' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b67a59af-5eea-4073-a4b2-604a1b7b8f82"}]': finished 2024-08-20T01:23:22.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:21 smithi134 ceph-mon[22511]: osdmap e5: 1 total, 0 up, 1 in 2024-08-20T01:23:22.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:21 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:23:22.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:21 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3079306778' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:23:22.312 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:21 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/717645469' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b67a59af-5eea-4073-a4b2-604a1b7b8f82"} : dispatch 2024-08-20T01:23:22.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:21 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/717645469' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b67a59af-5eea-4073-a4b2-604a1b7b8f82"}]': finished 2024-08-20T01:23:22.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:21 smithi077 ceph-mon[22251]: osdmap e5: 1 total, 0 up, 1 in 2024-08-20T01:23:22.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:21 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:23:22.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:21 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3079306778' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:23:22.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:21 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/717645469' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b67a59af-5eea-4073-a4b2-604a1b7b8f82"} : dispatch 2024-08-20T01:23:22.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:21 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/717645469' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b67a59af-5eea-4073-a4b2-604a1b7b8f82"}]': finished 2024-08-20T01:23:22.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:21 smithi022 ceph-mon[18709]: osdmap e5: 1 total, 0 up, 1 in 2024-08-20T01:23:22.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:21 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:23:22.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:21 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3079306778' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:23:23.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:22 smithi134 ceph-mon[22511]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:23.312 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:22 smithi077 ceph-mon[22251]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:23.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:22 smithi022 ceph-mon[18709]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:25.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:24 smithi134 ceph-mon[22511]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:25.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:24 smithi077 ceph-mon[22251]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:25.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:24 smithi022 ceph-mon[18709]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:27.125 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:26 smithi022 ceph-mon[18709]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:27.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:26 smithi134 ceph-mon[22511]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:27.312 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:26 smithi077 ceph-mon[22251]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:29.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:28 smithi022 ceph-mon[18709]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:29.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:28 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-20T01:23:29.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:28 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:29.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:28 smithi134 ceph-mon[22511]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:29.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:28 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-20T01:23:29.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:28 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:29.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:28 smithi077 ceph-mon[22251]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:29.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:28 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-20T01:23:29.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:28 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:30.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:29 smithi134 ceph-mon[22511]: Deploying daemon osd.0 on smithi022 2024-08-20T01:23:30.272 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:29 smithi022 ceph-mon[18709]: Deploying daemon osd.0 on smithi022 2024-08-20T01:23:30.312 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:29 smithi077 ceph-mon[22251]: Deploying daemon osd.0 on smithi022 2024-08-20T01:23:31.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:30 smithi134 ceph-mon[22511]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:31.272 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:30 smithi022 ceph-mon[18709]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:31.312 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:30 smithi077 ceph-mon[22251]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:33.205 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:32 smithi022 ceph-mon[18709]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:33.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:32 smithi134 ceph-mon[22511]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:33.312 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:32 smithi077 ceph-mon[22251]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:34.233 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:33 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:23:34.234 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:33 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:34.234 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:33 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:34.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:33 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:23:34.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:33 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:34.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:33 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:34.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:33 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:23:34.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:33 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:34.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:33 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:35.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:34 smithi022 ceph-mon[18709]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:35.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:34 smithi134 ceph-mon[22511]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:35.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:34 smithi077 ceph-mon[22251]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:36.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:36 smithi022 ceph-mon[18709]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:36.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:36 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:36.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:36 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:36.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:36 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:36.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:36 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:23:36.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:36 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:37.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:36 smithi134 ceph-mon[22511]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:37.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:36 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:37.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:36 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:37.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:36 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:37.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:36 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:23:37.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:36 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:37.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:36 smithi077 ceph-mon[22251]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:37.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:36 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:37.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:36 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:37.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:36 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:37.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:36 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:23:37.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:36 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:37.689 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 0 on host 'smithi022' 2024-08-20T01:23:37.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:37.689+0000 7fc0317fa640 1 -- 172.21.15.22:0/3393477573 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc0341a1430 con 0x7fc0200b3bc0 2024-08-20T01:23:37.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:37.692+0000 7fc039ad8640 1 -- 172.21.15.22:0/3393477573 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc0200b3bc0 msgr2=0x7fc0200b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:37.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:37.692+0000 7fc039ad8640 1 --2- 172.21.15.22:0/3393477573 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc0200b3bc0 0x7fc0200b6080 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc024009900 tx=0x7fc024031430 comp rx=0 tx=0).stop 2024-08-20T01:23:37.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:37.692+0000 7fc039ad8640 1 -- 172.21.15.22:0/3393477573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc034102770 msgr2=0x7fc0341991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:37.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:37.692+0000 7fc039ad8640 1 --2- 172.21.15.22:0/3393477573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc034102770 0x7fc0341991e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00b4a0 tx=0x7fc01c00b960 comp rx=0 tx=0).stop 2024-08-20T01:23:37.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:37.692+0000 7fc039ad8640 1 -- 172.21.15.22:0/3393477573 shutdown_connections 2024-08-20T01:23:37.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:37.692+0000 7fc039ad8640 1 --2- 172.21.15.22:0/3393477573 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc0200b3bc0 0x7fc0200b6080 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:37.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:37.692+0000 7fc039ad8640 1 --2- 172.21.15.22:0/3393477573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc034103130 0x7fc034199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:37.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:37.692+0000 7fc039ad8640 1 --2- 172.21.15.22:0/3393477573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc034102770 0x7fc0341991e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:37.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:37.692+0000 7fc039ad8640 1 --2- 172.21.15.22:0/3393477573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc034101610 0x7fc034198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:37.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:37.692+0000 7fc039ad8640 1 -- 172.21.15.22:0/3393477573 >> 172.21.15.22:0/3393477573 conn(0x7fc0340fcee0 msgr2=0x7fc0340fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:37.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:37.692+0000 7fc039ad8640 1 -- 172.21.15.22:0/3393477573 shutdown_connections 2024-08-20T01:23:37.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:23:37.692+0000 7fc039ad8640 1 -- 172.21.15.22:0/3393477573 wait complete. 2024-08-20T01:23:38.340 DEBUG:teuthology.orchestra.run.smithi022:osd.0> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.0.service 2024-08-20T01:23:38.343 INFO:tasks.cephadm:Deploying osd.1 on smithi077 with /dev/vg_nvme/lv_4... 2024-08-20T01:23:38.344 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-20T01:23:38.595 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:23:38.814 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:38 smithi022 ceph-mon[18709]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:38.815 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:38 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:23:38.815 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:38 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:38.815 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:38 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:39.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:38 smithi134 ceph-mon[22511]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:39.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:38 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:23:39.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:38 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:39.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:38 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:39.051 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:38 smithi077 ceph-mon[22251]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:39.051 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:38 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:23:39.051 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:38 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:39.051 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:38 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:40.136 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:23:39 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-0[34650]: 2024-08-20T01:23:39.789+0000 7f36f2c77640 -1 osd.0 0 log_to_monitors true 2024-08-20T01:23:40.966 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:40 smithi022 ceph-mon[18709]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:40.967 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:40 smithi022 ceph-mon[18709]: from='osd.0 [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-20T01:23:41.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:40 smithi134 ceph-mon[22511]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:41.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:40 smithi134 ceph-mon[22511]: from='osd.0 [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-20T01:23:41.038 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:40 smithi077 ceph-mon[22251]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:41.038 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:40 smithi077 ceph-mon[22251]: from='osd.0 [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-20T01:23:41.324 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-08-20T01:23:41.350 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_4 2024-08-20T01:23:41.608 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:23:41.975 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:41 smithi077 ceph-mon[22251]: from='osd.0 [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-20T01:23:41.976 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:41 smithi077 ceph-mon[22251]: osdmap e6: 1 total, 0 up, 1 in 2024-08-20T01:23:41.976 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:41 smithi077 ceph-mon[22251]: from='osd.0 [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-08-20T01:23:41.976 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:41 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:23:41.976 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:41 smithi077 ceph-mon[22251]: Detected new or changed devices on smithi022 2024-08-20T01:23:41.976 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:41 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:41.976 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:41 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:41.976 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:41 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:23:41.976 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:41 smithi077 ceph-mon[22251]: Adjusting osd_memory_target on smithi022 to 17092M 2024-08-20T01:23:41.976 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:41 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:41.976 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:41 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:41.976 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:41 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:23:41.976 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:41 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:42.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:41 smithi134 ceph-mon[22511]: from='osd.0 [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-20T01:23:42.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:41 smithi134 ceph-mon[22511]: osdmap e6: 1 total, 0 up, 1 in 2024-08-20T01:23:42.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:41 smithi134 ceph-mon[22511]: from='osd.0 [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-08-20T01:23:42.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:41 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:23:42.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:41 smithi134 ceph-mon[22511]: Detected new or changed devices on smithi022 2024-08-20T01:23:42.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:41 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:42.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:41 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:42.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:41 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:23:42.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:41 smithi134 ceph-mon[22511]: Adjusting osd_memory_target on smithi022 to 17092M 2024-08-20T01:23:42.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:41 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:42.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:41 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:42.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:41 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:23:42.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:41 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:42.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.060+0000 7f8e3e698640 1 -- 172.21.15.77:0/1482953961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e3806b320 msgr2=0x7f8e381053b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:42.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.060+0000 7f8e3e698640 1 --2- 172.21.15.77:0/1482953961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e3806b320 0x7f8e381053b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009900 tx=0x7f8e2802a410 comp rx=0 tx=0).stop 2024-08-20T01:23:42.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.060+0000 7f8e3e698640 1 -- 172.21.15.77:0/1482953961 shutdown_connections 2024-08-20T01:23:42.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.060+0000 7f8e3e698640 1 --2- 172.21.15.77:0/1482953961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e38108420 0x7f8e3810a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:42.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.060+0000 7f8e3e698640 1 --2- 172.21.15.77:0/1482953961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e381058f0 0x7f8e38107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:42.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.060+0000 7f8e3e698640 1 --2- 172.21.15.77:0/1482953961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e3806b320 0x7f8e381053b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:42.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.060+0000 7f8e3e698640 1 -- 172.21.15.77:0/1482953961 >> 172.21.15.77:0/1482953961 conn(0x7f8e380fcee0 msgr2=0x7f8e380ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:23:42.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.060+0000 7f8e3e698640 1 -- 172.21.15.77:0/1482953961 shutdown_connections 2024-08-20T01:23:42.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.060+0000 7f8e3e698640 1 -- 172.21.15.77:0/1482953961 wait complete. 2024-08-20T01:23:42.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.061+0000 7f8e3e698640 1 Processor -- start 2024-08-20T01:23:42.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.061+0000 7f8e3e698640 1 -- start start 2024-08-20T01:23:42.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.061+0000 7f8e3e698640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e3806b320 0x7f8e38198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:42.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e3e698640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e381058f0 0x7f8e381990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:42.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e3e698640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e38108420 0x7f8e38199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:42.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e3e698640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3810e3a0 con 0x7f8e381058f0 2024-08-20T01:23:42.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e3e698640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3810e220 con 0x7f8e3806b320 2024-08-20T01:23:42.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e3e698640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3810e520 con 0x7f8e38108420 2024-08-20T01:23:42.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e37fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e3806b320 0x7f8e38198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:42.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e37fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e3806b320 0x7f8e38198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52210/0 (socket says 172.21.15.77:52210) 2024-08-20T01:23:42.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e37fff640 1 -- 172.21.15.77:0/2079137417 learned_addr learned my addr 172.21.15.77:0/2079137417 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-08-20T01:23:42.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e377fe640 1 --2- 172.21.15.77:0/2079137417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e381058f0 0x7f8e381990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:42.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e37fff640 1 -- 172.21.15.77:0/2079137417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e38108420 msgr2=0x7f8e38199d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:42.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e37fff640 1 --2- 172.21.15.77:0/2079137417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e38108420 0x7f8e38199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:42.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e37fff640 1 -- 172.21.15.77:0/2079137417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e381058f0 msgr2=0x7f8e381990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:23:42.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e37fff640 1 --2- 172.21.15.77:0/2079137417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e381058f0 0x7f8e381990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:23:42.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e37fff640 1 -- 172.21.15.77:0/2079137417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3819a5c0 con 0x7f8e3806b320 2024-08-20T01:23:42.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e377fe640 1 --2- 172.21.15.77:0/2079137417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e381058f0 0x7f8e381990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:23:42.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e37fff640 1 --2- 172.21.15.77:0/2079137417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e3806b320 0x7f8e38198a90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8e28005ab0 tx=0x7f8e28003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:42.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e357fa640 1 -- 172.21.15.77:0/2079137417 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2803f070 con 0x7f8e3806b320 2024-08-20T01:23:42.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e3e698640 1 -- 172.21.15.77:0/2079137417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e3819a850 con 0x7f8e3806b320 2024-08-20T01:23:42.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e357fa640 1 -- 172.21.15.77:0/2079137417 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e2803b460 con 0x7f8e3806b320 2024-08-20T01:23:42.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e357fa640 1 -- 172.21.15.77:0/2079137417 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e28035030 con 0x7f8e3806b320 2024-08-20T01:23:42.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.062+0000 7f8e3e698640 1 -- 172.21.15.77:0/2079137417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e381a0dc0 con 0x7f8e3806b320 2024-08-20T01:23:42.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.063+0000 7f8e3e698640 1 -- 172.21.15.77:0/2079137417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e380fe9d0 con 0x7f8e3806b320 2024-08-20T01:23:42.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.066+0000 7f8e357fa640 1 -- 172.21.15.77:0/2079137417 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f8e28042070 con 0x7f8e3806b320 2024-08-20T01:23:42.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.066+0000 7f8e357fa640 1 --2- 172.21.15.77:0/2079137417 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8e200b3b40 0x7f8e200b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:23:42.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.066+0000 7f8e357fa640 1 -- 172.21.15.77:0/2079137417 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f8e28102e70 con 0x7f8e3806b320 2024-08-20T01:23:42.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.067+0000 7f8e377fe640 1 --2- 172.21.15.77:0/2079137417 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8e200b3b40 0x7f8e200b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:23:42.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.067+0000 7f8e377fe640 1 --2- 172.21.15.77:0/2079137417 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8e200b3b40 0x7f8e200b6000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009b40 tx=0x7f8e2c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:23:42.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.069+0000 7f8e357fa640 1 -- 172.21.15.77:0/2079137417 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f8e280cc050 con 0x7f8e3806b320 2024-08-20T01:23:42.135 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:23:41 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-0[34650]: 2024-08-20T01:23:41.651+0000 7f36eebfa640 -1 osd.0 0 waiting for initial osdmap 2024-08-20T01:23:42.135 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:23:41 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-0[34650]: 2024-08-20T01:23:41.654+0000 7f36eaa21640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:23:42.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:41 smithi022 ceph-mon[18709]: from='osd.0 [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-20T01:23:42.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:41 smithi022 ceph-mon[18709]: osdmap e6: 1 total, 0 up, 1 in 2024-08-20T01:23:42.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:41 smithi022 ceph-mon[18709]: from='osd.0 [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-08-20T01:23:42.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:41 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:23:42.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:41 smithi022 ceph-mon[18709]: Detected new or changed devices on smithi022 2024-08-20T01:23:42.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:41 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:42.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:41 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:42.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:41 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:23:42.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:41 smithi022 ceph-mon[18709]: Adjusting osd_memory_target on smithi022 to 17092M 2024-08-20T01:23:42.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:41 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:42.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:41 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:42.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:41 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:23:42.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:41 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:42.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:23:42.254+0000 7f8e3e698640 1 -- 172.21.15.77:0/2079137417 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f8e380632c0 con 0x7f8e200b3b40 2024-08-20T01:23:42.953 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:42 smithi077 ceph-mon[22251]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:42.953 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:42 smithi077 ceph-mon[22251]: from='osd.0 [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-08-20T01:23:42.953 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:42 smithi077 ceph-mon[22251]: osdmap e7: 1 total, 0 up, 1 in 2024-08-20T01:23:42.953 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:42 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:23:42.953 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:42 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:23:42.954 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:42 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:23:42.954 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:42 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:23:42.954 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:42 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:43.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:42 smithi134 ceph-mon[22511]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:43.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:42 smithi134 ceph-mon[22511]: from='osd.0 [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-08-20T01:23:43.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:42 smithi134 ceph-mon[22511]: osdmap e7: 1 total, 0 up, 1 in 2024-08-20T01:23:43.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:42 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:23:43.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:42 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:23:43.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:42 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:23:43.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:42 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:23:43.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:42 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:43.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:42 smithi022 ceph-mon[18709]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:43.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:42 smithi022 ceph-mon[18709]: from='osd.0 [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-08-20T01:23:43.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:42 smithi022 ceph-mon[18709]: osdmap e7: 1 total, 0 up, 1 in 2024-08-20T01:23:43.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:42 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:23:43.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:42 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:23:43.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:42 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:23:43.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:42 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:23:43.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:42 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:43.871 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:43 smithi077 ceph-mon[22251]: purged_snaps scrub starts 2024-08-20T01:23:43.871 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:43 smithi077 ceph-mon[22251]: purged_snaps scrub ok 2024-08-20T01:23:43.871 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:43 smithi077 ceph-mon[22251]: from='client.24242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:23:43.871 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:43 smithi077 ceph-mon[22251]: osd.0 [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903] boot 2024-08-20T01:23:43.871 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:43 smithi077 ceph-mon[22251]: osdmap e8: 1 total, 1 up, 1 in 2024-08-20T01:23:43.871 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:43 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:23:44.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:43 smithi134 ceph-mon[22511]: purged_snaps scrub starts 2024-08-20T01:23:44.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:43 smithi134 ceph-mon[22511]: purged_snaps scrub ok 2024-08-20T01:23:44.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:43 smithi134 ceph-mon[22511]: from='client.24242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:23:44.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:43 smithi134 ceph-mon[22511]: osd.0 [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903] boot 2024-08-20T01:23:44.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:43 smithi134 ceph-mon[22511]: osdmap e8: 1 total, 1 up, 1 in 2024-08-20T01:23:44.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:43 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:23:44.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:43 smithi022 ceph-mon[18709]: purged_snaps scrub starts 2024-08-20T01:23:44.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:43 smithi022 ceph-mon[18709]: purged_snaps scrub ok 2024-08-20T01:23:44.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:43 smithi022 ceph-mon[18709]: from='client.24242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:23:44.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:43 smithi022 ceph-mon[18709]: osd.0 [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903] boot 2024-08-20T01:23:44.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:43 smithi022 ceph-mon[18709]: osdmap e8: 1 total, 1 up, 1 in 2024-08-20T01:23:44.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:43 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:23:45.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:44 smithi134 ceph-mon[22511]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:45.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:44 smithi134 ceph-mon[22511]: osdmap e9: 1 total, 1 up, 1 in 2024-08-20T01:23:45.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:44 smithi134 ceph-mon[22511]: from='client.? 172.21.15.77:0/4269954447' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c"} : dispatch 2024-08-20T01:23:45.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:44 smithi134 ceph-mon[22511]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c"} : dispatch 2024-08-20T01:23:45.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:44 smithi134 ceph-mon[22511]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c"}]': finished 2024-08-20T01:23:45.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:44 smithi134 ceph-mon[22511]: osdmap e10: 2 total, 1 up, 2 in 2024-08-20T01:23:45.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:44 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:23:45.036 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:44 smithi022 ceph-mon[18709]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:45.037 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:44 smithi022 ceph-mon[18709]: osdmap e9: 1 total, 1 up, 1 in 2024-08-20T01:23:45.037 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:44 smithi022 ceph-mon[18709]: from='client.? 172.21.15.77:0/4269954447' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c"} : dispatch 2024-08-20T01:23:45.037 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:44 smithi022 ceph-mon[18709]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c"} : dispatch 2024-08-20T01:23:45.037 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:44 smithi022 ceph-mon[18709]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c"}]': finished 2024-08-20T01:23:45.037 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:44 smithi022 ceph-mon[18709]: osdmap e10: 2 total, 1 up, 2 in 2024-08-20T01:23:45.037 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:44 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:23:45.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:44 smithi077 ceph-mon[22251]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:23:45.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:44 smithi077 ceph-mon[22251]: osdmap e9: 1 total, 1 up, 1 in 2024-08-20T01:23:45.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:44 smithi077 ceph-mon[22251]: from='client.? 172.21.15.77:0/4269954447' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c"} : dispatch 2024-08-20T01:23:45.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:44 smithi077 ceph-mon[22251]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c"} : dispatch 2024-08-20T01:23:45.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:44 smithi077 ceph-mon[22251]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c"}]': finished 2024-08-20T01:23:45.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:44 smithi077 ceph-mon[22251]: osdmap e10: 2 total, 1 up, 2 in 2024-08-20T01:23:45.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:44 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:23:46.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:45 smithi134 ceph-mon[22511]: from='client.? 172.21.15.77:0/134118896' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:23:46.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:45 smithi077 ceph-mon[22251]: from='client.? 172.21.15.77:0/134118896' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:23:46.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:45 smithi022 ceph-mon[18709]: from='client.? 172.21.15.77:0/134118896' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:23:47.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:46 smithi134 ceph-mon[22511]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:47.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:46 smithi077 ceph-mon[22251]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:47.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:46 smithi022 ceph-mon[18709]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:49.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:48 smithi134 ceph-mon[22511]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:49.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:48 smithi077 ceph-mon[22251]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:49.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:48 smithi022 ceph-mon[18709]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:50.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:50 smithi077 ceph-mon[22251]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:51.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:50 smithi134 ceph-mon[22511]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:51.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:50 smithi022 ceph-mon[18709]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:52.976 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:52 smithi077 ceph-mon[22251]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:53.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:52 smithi134 ceph-mon[22511]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:53.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:52 smithi022 ceph-mon[18709]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:54.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:53 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-20T01:23:54.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:53 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:54.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:53 smithi134 ceph-mon[22511]: Deploying daemon osd.1 on smithi077 2024-08-20T01:23:54.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:53 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-20T01:23:54.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:53 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:54.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:53 smithi077 ceph-mon[22251]: Deploying daemon osd.1 on smithi077 2024-08-20T01:23:54.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:53 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-20T01:23:54.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:53 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:23:54.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:53 smithi022 ceph-mon[18709]: Deploying daemon osd.1 on smithi077 2024-08-20T01:23:54.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:54 smithi077 ceph-mon[22251]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:55.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:54 smithi134 ceph-mon[22511]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:55.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:54 smithi022 ceph-mon[18709]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:57.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:56 smithi134 ceph-mon[22511]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:57.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:56 smithi077 ceph-mon[22251]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:57.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:56 smithi022 ceph-mon[18709]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:58.777 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:58 smithi077 ceph-mon[22251]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:58.777 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:23:58.777 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:58.777 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:23:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:59.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:58 smithi134 ceph-mon[22511]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:59.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:23:59.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:59.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:23:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:59.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:58 smithi022 ceph-mon[18709]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:23:59.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:23:59.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:23:59.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:23:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:01.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:00 smithi134 ceph-mon[22511]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:24:01.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:01.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:01.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:01.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:24:01.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:01.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:00 smithi077 ceph-mon[22251]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:24:01.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:01.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:01.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:01.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:24:01.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:01.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:00 smithi022 ceph-mon[18709]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:24:01.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:01.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:01.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:01.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:24:01.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:01.950 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 1 on host 'smithi077' 2024-08-20T01:24:01.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:01.949+0000 7f8e357fa640 1 -- 172.21.15.77:0/2079137417 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8e380632c0 con 0x7f8e200b3b40 2024-08-20T01:24:01.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:01.952+0000 7f8e3e698640 1 -- 172.21.15.77:0/2079137417 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8e200b3b40 msgr2=0x7f8e200b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:24:01.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:01.952+0000 7f8e3e698640 1 --2- 172.21.15.77:0/2079137417 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8e200b3b40 0x7f8e200b6000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009b40 tx=0x7f8e2c005e50 comp rx=0 tx=0).stop 2024-08-20T01:24:01.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:01.952+0000 7f8e3e698640 1 -- 172.21.15.77:0/2079137417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e3806b320 msgr2=0x7f8e38198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:24:01.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:01.952+0000 7f8e3e698640 1 --2- 172.21.15.77:0/2079137417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e3806b320 0x7f8e38198a90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8e28005ab0 tx=0x7f8e28003cd0 comp rx=0 tx=0).stop 2024-08-20T01:24:01.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:01.952+0000 7f8e3e698640 1 -- 172.21.15.77:0/2079137417 shutdown_connections 2024-08-20T01:24:01.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:01.952+0000 7f8e3e698640 1 --2- 172.21.15.77:0/2079137417 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8e200b3b40 0x7f8e200b6000 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:01.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:01.952+0000 7f8e3e698640 1 --2- 172.21.15.77:0/2079137417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e38108420 0x7f8e38199d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:01.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:01.952+0000 7f8e3e698640 1 --2- 172.21.15.77:0/2079137417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e381058f0 0x7f8e381990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:01.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:01.952+0000 7f8e3e698640 1 --2- 172.21.15.77:0/2079137417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e3806b320 0x7f8e38198a90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:01.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:01.952+0000 7f8e3e698640 1 -- 172.21.15.77:0/2079137417 >> 172.21.15.77:0/2079137417 conn(0x7f8e380fcee0 msgr2=0x7f8e38103bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:24:01.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:01.952+0000 7f8e3e698640 1 -- 172.21.15.77:0/2079137417 shutdown_connections 2024-08-20T01:24:01.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:01.952+0000 7f8e3e698640 1 -- 172.21.15.77:0/2079137417 wait complete. 2024-08-20T01:24:02.588 DEBUG:teuthology.orchestra.run.smithi077:osd.1> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.1.service 2024-08-20T01:24:02.590 INFO:tasks.cephadm:Deploying osd.2 on smithi134 with /dev/vg_nvme/lv_4... 2024-08-20T01:24:02.590 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-20T01:24:02.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:02 smithi077 ceph-mon[22251]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:24:02.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:02 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:24:02.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:02 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:02.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:02 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:02.841 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:24:02.962 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:02 smithi134 ceph-mon[22511]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:24:02.962 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:02 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:24:02.962 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:02 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:02.962 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:02 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:03.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:02 smithi022 ceph-mon[18709]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:24:03.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:02 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:24:03.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:02 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:03.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:02 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:04.286 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:24:04 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-1[26658]: 2024-08-20T01:24:04.098+0000 7f8577e9e640 -1 osd.1 0 log_to_monitors true 2024-08-20T01:24:05.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:04 smithi134 ceph-mon[22511]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:24:05.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:04 smithi134 ceph-mon[22511]: from='osd.1 [v2:172.21.15.77:6800/823882511,v1:172.21.15.77:6801/823882511]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-20T01:24:05.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:04 smithi134 ceph-mon[22511]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-20T01:24:05.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:04 smithi077 ceph-mon[22251]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:24:05.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:04 smithi077 ceph-mon[22251]: from='osd.1 [v2:172.21.15.77:6800/823882511,v1:172.21.15.77:6801/823882511]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-20T01:24:05.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:04 smithi077 ceph-mon[22251]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-20T01:24:05.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:04 smithi022 ceph-mon[18709]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:24:05.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:04 smithi022 ceph-mon[18709]: from='osd.1 [v2:172.21.15.77:6800/823882511,v1:172.21.15.77:6801/823882511]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-20T01:24:05.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:04 smithi022 ceph-mon[18709]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-20T01:24:05.361 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:24:05.387 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_4 2024-08-20T01:24:05.637 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:24:05.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:05 smithi134 ceph-mon[22511]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-20T01:24:05.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:05 smithi134 ceph-mon[22511]: from='osd.1 [v2:172.21.15.77:6800/823882511,v1:172.21.15.77:6801/823882511]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:24:05.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:05 smithi134 ceph-mon[22511]: osdmap e11: 2 total, 1 up, 2 in 2024-08-20T01:24:05.953 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:05 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:24:05.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:05 smithi134 ceph-mon[22511]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:24:05.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:05 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:05.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:05 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:05.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:05 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:24:05.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:05 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:05.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:05 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:05.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:05 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:24:05.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:05 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:05.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:05 smithi134 ceph-mon[22511]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-08-20T01:24:05.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:05 smithi134 ceph-mon[22511]: osdmap e12: 2 total, 1 up, 2 in 2024-08-20T01:24:05.954 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:05 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:24:06.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.037+0000 7fa289877640 1 -- 172.21.15.134:0/2595400048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa284108460 msgr2=0x7fa28410a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:24:06.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.038+0000 7fa289877640 1 --2- 172.21.15.134:0/2595400048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa284108460 0x7fa28410a920 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa27c009ca0 tx=0x7fa27c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:24:06.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.038+0000 7fa289877640 1 -- 172.21.15.134:0/2595400048 shutdown_connections 2024-08-20T01:24:06.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.038+0000 7fa289877640 1 --2- 172.21.15.134:0/2595400048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa284108460 0x7fa28410a920 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:06.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.038+0000 7fa289877640 1 --2- 172.21.15.134:0/2595400048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2841058b0 0x7fa284107d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:06.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.038+0000 7fa289877640 1 --2- 172.21.15.134:0/2595400048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa28406bdc0 0x7fa284105320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:06.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.038+0000 7fa289877640 1 -- 172.21.15.134:0/2595400048 >> 172.21.15.134:0/2595400048 conn(0x7fa2840fcf30 msgr2=0x7fa2840ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:24:06.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.038+0000 7fa289877640 1 -- 172.21.15.134:0/2595400048 shutdown_connections 2024-08-20T01:24:06.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.038+0000 7fa289877640 1 -- 172.21.15.134:0/2595400048 wait complete. 2024-08-20T01:24:06.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.038+0000 7fa289877640 1 Processor -- start 2024-08-20T01:24:06.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.038+0000 7fa289877640 1 -- start start 2024-08-20T01:24:06.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa289877640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa28406bdc0 0x7fa284102a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:24:06.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa289877640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2841058b0 0x7fa2841012c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:24:06.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa289877640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa284108460 0x7fa284101800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:24:06.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa289877640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa28410e3d0 con 0x7fa28406bdc0 2024-08-20T01:24:06.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa289877640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa28410e250 con 0x7fa284108460 2024-08-20T01:24:06.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa289877640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa28410e550 con 0x7fa2841058b0 2024-08-20T01:24:06.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa2827fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2841058b0 0x7fa2841012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:24:06.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa2827fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2841058b0 0x7fa2841012c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42608/0 (socket says 172.21.15.134:42608) 2024-08-20T01:24:06.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa2827fc640 1 -- 172.21.15.134:0/2110620076 learned_addr learned my addr 172.21.15.134:0/2110620076 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-08-20T01:24:06.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa2837fe640 1 --2- 172.21.15.134:0/2110620076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa284108460 0x7fa284101800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:24:06.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa282ffd640 1 --2- 172.21.15.134:0/2110620076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa28406bdc0 0x7fa284102a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:24:06.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa2827fc640 1 -- 172.21.15.134:0/2110620076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa284108460 msgr2=0x7fa284101800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:24:06.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa2827fc640 1 --2- 172.21.15.134:0/2110620076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa284108460 0x7fa284101800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:06.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa2827fc640 1 -- 172.21.15.134:0/2110620076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa28406bdc0 msgr2=0x7fa284102a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:24:06.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa2827fc640 1 --2- 172.21.15.134:0/2110620076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa28406bdc0 0x7fa284102a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:06.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa2827fc640 1 -- 172.21.15.134:0/2110620076 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2841020c0 con 0x7fa2841058b0 2024-08-20T01:24:06.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa2827fc640 1 --2- 172.21.15.134:0/2110620076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2841058b0 0x7fa2841012c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa27800c970 tx=0x7fa27800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:24:06.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa288875640 1 -- 172.21.15.134:0/2110620076 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa278014070 con 0x7fa2841058b0 2024-08-20T01:24:06.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa289877640 1 -- 172.21.15.134:0/2110620076 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2841a2bf0 con 0x7fa2841058b0 2024-08-20T01:24:06.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa288875640 1 -- 172.21.15.134:0/2110620076 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa278004440 con 0x7fa2841058b0 2024-08-20T01:24:06.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.039+0000 7fa288875640 1 -- 172.21.15.134:0/2110620076 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa278003e50 con 0x7fa2841058b0 2024-08-20T01:24:06.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.040+0000 7fa289877640 1 -- 172.21.15.134:0/2110620076 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2841a3150 con 0x7fa2841058b0 2024-08-20T01:24:06.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.040+0000 7fa289877640 1 -- 172.21.15.134:0/2110620076 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2840fea20 con 0x7fa2841058b0 2024-08-20T01:24:06.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.042+0000 7fa288875640 1 -- 172.21.15.134:0/2110620076 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fa278017070 con 0x7fa2841058b0 2024-08-20T01:24:06.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.043+0000 7fa288875640 1 --2- 172.21.15.134:0/2110620076 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa26c0b3ce0 0x7fa26c0b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:24:06.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.043+0000 7fa288875640 1 -- 172.21.15.134:0/2110620076 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7fa2780e2400 con 0x7fa2841058b0 2024-08-20T01:24:06.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.043+0000 7fa282ffd640 1 --2- 172.21.15.134:0/2110620076 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa26c0b3ce0 0x7fa26c0b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:24:06.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.044+0000 7fa282ffd640 1 --2- 172.21.15.134:0/2110620076 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa26c0b3ce0 0x7fa26c0b61a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa274009aa0 tx=0x7fa274005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:24:06.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.049+0000 7fa288875640 1 -- 172.21.15.134:0/2110620076 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa27801e020 con 0x7fa2841058b0 2024-08-20T01:24:06.061 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:05 smithi077 ceph-mon[22251]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-20T01:24:06.061 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:05 smithi077 ceph-mon[22251]: from='osd.1 [v2:172.21.15.77:6800/823882511,v1:172.21.15.77:6801/823882511]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:24:06.061 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:05 smithi077 ceph-mon[22251]: osdmap e11: 2 total, 1 up, 2 in 2024-08-20T01:24:06.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:05 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:24:06.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:05 smithi077 ceph-mon[22251]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:24:06.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:05 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:06.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:05 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:06.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:05 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:24:06.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:05 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:06.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:05 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:06.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:05 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:24:06.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:05 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:06.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:05 smithi077 ceph-mon[22251]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-08-20T01:24:06.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:05 smithi077 ceph-mon[22251]: osdmap e12: 2 total, 1 up, 2 in 2024-08-20T01:24:06.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:05 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:24:06.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:05 smithi022 ceph-mon[18709]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-20T01:24:06.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:05 smithi022 ceph-mon[18709]: from='osd.1 [v2:172.21.15.77:6800/823882511,v1:172.21.15.77:6801/823882511]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:24:06.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:05 smithi022 ceph-mon[18709]: osdmap e11: 2 total, 1 up, 2 in 2024-08-20T01:24:06.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:05 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:24:06.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:05 smithi022 ceph-mon[18709]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:24:06.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:05 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:06.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:05 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:06.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:05 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:24:06.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:05 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:06.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:05 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:06.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:05 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:24:06.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:05 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:06.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:05 smithi022 ceph-mon[18709]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-08-20T01:24:06.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:05 smithi022 ceph-mon[18709]: osdmap e12: 2 total, 1 up, 2 in 2024-08-20T01:24:06.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:05 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:24:06.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:06.240+0000 7fa289877640 1 -- 172.21.15.134:0/2110620076 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa2840632c0 con 0x7fa26c0b3ce0 2024-08-20T01:24:06.312 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:24:06 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-1[26658]: 2024-08-20T01:24:06.060+0000 7f8573e21640 -1 osd.1 0 waiting for initial osdmap 2024-08-20T01:24:06.313 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:24:06 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-1[26658]: 2024-08-20T01:24:06.064+0000 7f856bc40640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:24:06.880 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:06 smithi134 ceph-mon[22511]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:24:06.881 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:06 smithi134 ceph-mon[22511]: Detected new or changed devices on smithi077 2024-08-20T01:24:06.881 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:06 smithi134 ceph-mon[22511]: Adjusting osd_memory_target on smithi077 to 17088M 2024-08-20T01:24:06.881 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:06 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:24:06.881 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:06 smithi134 ceph-mon[22511]: from='osd.1 ' entity='osd.1' 2024-08-20T01:24:06.881 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:06 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:24:06.881 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:06 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:24:06.881 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:06 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:06.881 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:06 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:24:07.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:06 smithi077 ceph-mon[22251]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:24:07.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:06 smithi077 ceph-mon[22251]: Detected new or changed devices on smithi077 2024-08-20T01:24:07.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:06 smithi077 ceph-mon[22251]: Adjusting osd_memory_target on smithi077 to 17088M 2024-08-20T01:24:07.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:06 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:24:07.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:06 smithi077 ceph-mon[22251]: from='osd.1 ' entity='osd.1' 2024-08-20T01:24:07.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:06 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:24:07.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:06 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:24:07.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:06 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:07.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:06 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:24:07.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:06 smithi022 ceph-mon[18709]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:24:07.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:06 smithi022 ceph-mon[18709]: Detected new or changed devices on smithi077 2024-08-20T01:24:07.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:06 smithi022 ceph-mon[18709]: Adjusting osd_memory_target on smithi077 to 17088M 2024-08-20T01:24:07.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:06 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:24:07.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:06 smithi022 ceph-mon[18709]: from='osd.1 ' entity='osd.1' 2024-08-20T01:24:07.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:06 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:24:07.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:06 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:24:07.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:06 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:07.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:06 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:24:07.919 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:07 smithi134 ceph-mon[22511]: purged_snaps scrub starts 2024-08-20T01:24:07.919 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:07 smithi134 ceph-mon[22511]: purged_snaps scrub ok 2024-08-20T01:24:07.920 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:07 smithi134 ceph-mon[22511]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:24:07.920 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:07 smithi134 ceph-mon[22511]: osd.1 [v2:172.21.15.77:6800/823882511,v1:172.21.15.77:6801/823882511] boot 2024-08-20T01:24:07.920 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:07 smithi134 ceph-mon[22511]: osdmap e13: 2 total, 2 up, 2 in 2024-08-20T01:24:07.920 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:07 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:24:08.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:07 smithi077 ceph-mon[22251]: purged_snaps scrub starts 2024-08-20T01:24:08.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:07 smithi077 ceph-mon[22251]: purged_snaps scrub ok 2024-08-20T01:24:08.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:07 smithi077 ceph-mon[22251]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:24:08.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:07 smithi077 ceph-mon[22251]: osd.1 [v2:172.21.15.77:6800/823882511,v1:172.21.15.77:6801/823882511] boot 2024-08-20T01:24:08.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:07 smithi077 ceph-mon[22251]: osdmap e13: 2 total, 2 up, 2 in 2024-08-20T01:24:08.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:07 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:24:08.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:07 smithi022 ceph-mon[18709]: purged_snaps scrub starts 2024-08-20T01:24:08.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:07 smithi022 ceph-mon[18709]: purged_snaps scrub ok 2024-08-20T01:24:08.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:07 smithi022 ceph-mon[18709]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:24:08.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:07 smithi022 ceph-mon[18709]: osd.1 [v2:172.21.15.77:6800/823882511,v1:172.21.15.77:6801/823882511] boot 2024-08-20T01:24:08.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:07 smithi022 ceph-mon[18709]: osdmap e13: 2 total, 2 up, 2 in 2024-08-20T01:24:08.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:07 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:24:09.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:08 smithi134 ceph-mon[22511]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:24:09.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:08 smithi134 ceph-mon[22511]: from='client.? 172.21.15.134:0/3325373349' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "71e3c019-a3e0-4632-81a8-27ac31279f7d"} : dispatch 2024-08-20T01:24:09.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:08 smithi134 ceph-mon[22511]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "71e3c019-a3e0-4632-81a8-27ac31279f7d"} : dispatch 2024-08-20T01:24:09.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:08 smithi134 ceph-mon[22511]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "71e3c019-a3e0-4632-81a8-27ac31279f7d"}]': finished 2024-08-20T01:24:09.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:08 smithi134 ceph-mon[22511]: osdmap e14: 3 total, 2 up, 3 in 2024-08-20T01:24:09.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:08 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:24:09.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:08 smithi077 ceph-mon[22251]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:24:09.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:08 smithi077 ceph-mon[22251]: from='client.? 172.21.15.134:0/3325373349' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "71e3c019-a3e0-4632-81a8-27ac31279f7d"} : dispatch 2024-08-20T01:24:09.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:08 smithi077 ceph-mon[22251]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "71e3c019-a3e0-4632-81a8-27ac31279f7d"} : dispatch 2024-08-20T01:24:09.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:08 smithi077 ceph-mon[22251]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "71e3c019-a3e0-4632-81a8-27ac31279f7d"}]': finished 2024-08-20T01:24:09.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:08 smithi077 ceph-mon[22251]: osdmap e14: 3 total, 2 up, 3 in 2024-08-20T01:24:09.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:08 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:24:09.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:08 smithi022 ceph-mon[18709]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:24:09.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:08 smithi022 ceph-mon[18709]: from='client.? 172.21.15.134:0/3325373349' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "71e3c019-a3e0-4632-81a8-27ac31279f7d"} : dispatch 2024-08-20T01:24:09.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:08 smithi022 ceph-mon[18709]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "71e3c019-a3e0-4632-81a8-27ac31279f7d"} : dispatch 2024-08-20T01:24:09.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:08 smithi022 ceph-mon[18709]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "71e3c019-a3e0-4632-81a8-27ac31279f7d"}]': finished 2024-08-20T01:24:09.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:08 smithi022 ceph-mon[18709]: osdmap e14: 3 total, 2 up, 3 in 2024-08-20T01:24:09.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:08 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:24:10.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:09 smithi134 ceph-mon[22511]: from='client.? 172.21.15.134:0/1966031696' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:24:10.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:09 smithi077 ceph-mon[22251]: from='client.? 172.21.15.134:0/1966031696' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:24:10.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:09 smithi022 ceph-mon[18709]: from='client.? 172.21.15.134:0/1966031696' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:24:11.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:10 smithi134 ceph-mon[22511]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:11.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:10 smithi077 ceph-mon[22251]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:11.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:10 smithi022 ceph-mon[18709]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:13.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:12 smithi134 ceph-mon[22511]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:13.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:12 smithi077 ceph-mon[22251]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:13.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:12 smithi022 ceph-mon[18709]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:14.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:14 smithi134 ceph-mon[22511]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:15.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:14 smithi077 ceph-mon[22251]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:15.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:14 smithi022 ceph-mon[18709]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:17.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:16 smithi134 ceph-mon[22511]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:17.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:16 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-20T01:24:17.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:16 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:17.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:16 smithi077 ceph-mon[22251]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:17.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:16 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-20T01:24:17.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:16 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:17.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:16 smithi022 ceph-mon[18709]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:17.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:16 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-20T01:24:17.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:16 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:18.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:17 smithi134 ceph-mon[22511]: Deploying daemon osd.2 on smithi134 2024-08-20T01:24:18.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:17 smithi077 ceph-mon[22251]: Deploying daemon osd.2 on smithi134 2024-08-20T01:24:18.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:17 smithi022 ceph-mon[18709]: Deploying daemon osd.2 on smithi134 2024-08-20T01:24:18.939 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:18 smithi134 ceph-mon[22511]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:19.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:18 smithi077 ceph-mon[22251]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:19.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:18 smithi022 ceph-mon[18709]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:20.947 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:20 smithi134 ceph-mon[22511]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:21.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:20 smithi077 ceph-mon[22251]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:21.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:20 smithi022 ceph-mon[18709]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:22.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:22 smithi134 ceph-mon[22511]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:22.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:22 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:24:22.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:22 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:22.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:22 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:23.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:22 smithi077 ceph-mon[22251]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:23.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:22 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:24:23.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:22 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:23.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:22 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:23.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:22 smithi022 ceph-mon[18709]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:23.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:22 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:24:23.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:22 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:23.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:22 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:25.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:24 smithi134 ceph-mon[22511]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:25.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:25.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:25.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:25.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:24:25.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:25.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:24 smithi077 ceph-mon[22251]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:25.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:25.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:25.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:25.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:24:25.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:25.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:24 smithi022 ceph-mon[18709]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:25.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:25.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:25.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:25.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:24:25.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:25.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:25.614+0000 7fa288875640 1 -- 172.21.15.134:0/2110620076 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa2840632c0 con 0x7fa26c0b3ce0 2024-08-20T01:24:25.614 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 2 on host 'smithi134' 2024-08-20T01:24:25.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:25.616+0000 7fa289877640 1 -- 172.21.15.134:0/2110620076 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa26c0b3ce0 msgr2=0x7fa26c0b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:24:25.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:25.616+0000 7fa289877640 1 --2- 172.21.15.134:0/2110620076 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa26c0b3ce0 0x7fa26c0b61a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa274009aa0 tx=0x7fa274005f90 comp rx=0 tx=0).stop 2024-08-20T01:24:25.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:25.617+0000 7fa289877640 1 -- 172.21.15.134:0/2110620076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2841058b0 msgr2=0x7fa2841012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:24:25.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:25.617+0000 7fa289877640 1 --2- 172.21.15.134:0/2110620076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2841058b0 0x7fa2841012c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa27800c970 tx=0x7fa27800ce30 comp rx=0 tx=0).stop 2024-08-20T01:24:25.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:25.617+0000 7fa289877640 1 -- 172.21.15.134:0/2110620076 shutdown_connections 2024-08-20T01:24:25.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:25.617+0000 7fa289877640 1 --2- 172.21.15.134:0/2110620076 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa26c0b3ce0 0x7fa26c0b61a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:25.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:25.617+0000 7fa289877640 1 --2- 172.21.15.134:0/2110620076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa284108460 0x7fa284101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:25.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:25.617+0000 7fa289877640 1 --2- 172.21.15.134:0/2110620076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2841058b0 0x7fa2841012c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:25.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:25.617+0000 7fa289877640 1 --2- 172.21.15.134:0/2110620076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa28406bdc0 0x7fa284102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:25.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:25.617+0000 7fa289877640 1 -- 172.21.15.134:0/2110620076 >> 172.21.15.134:0/2110620076 conn(0x7fa2840fcf30 msgr2=0x7fa284103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:24:25.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:25.617+0000 7fa289877640 1 -- 172.21.15.134:0/2110620076 shutdown_connections 2024-08-20T01:24:25.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:24:25.617+0000 7fa289877640 1 -- 172.21.15.134:0/2110620076 wait complete. 2024-08-20T01:24:26.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:25 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:24:26.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:25 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:26.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:25 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:26.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:25 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:24:26.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:25 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:26.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:25 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:26.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:25 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:24:26.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:25 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:26.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:25 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:26.217 DEBUG:teuthology.orchestra.run.smithi134:osd.2> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.2.service 2024-08-20T01:24:26.220 INFO:tasks.cephadm:Deploying osd.3 on smithi022 with /dev/vg_nvme/lv_3... 2024-08-20T01:24:26.220 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-20T01:24:26.485 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:24:26.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:26 smithi022 ceph-mon[18709]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:27.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:26 smithi134 ceph-mon[22511]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:27.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:26 smithi077 ceph-mon[22251]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:27.455 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:24:27 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-2[27459]: 2024-08-20T01:24:27.353+0000 7fe9bbb9d640 -1 osd.2 0 log_to_monitors true 2024-08-20T01:24:27.973 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:27 smithi022 ceph-mon[18709]: from='osd.2 [v2:172.21.15.134:6800/3873702897,v1:172.21.15.134:6801/3873702897]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-20T01:24:27.973 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:27 smithi022 ceph-mon[18709]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-20T01:24:28.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:27 smithi134 ceph-mon[22511]: from='osd.2 [v2:172.21.15.134:6800/3873702897,v1:172.21.15.134:6801/3873702897]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-20T01:24:28.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:27 smithi134 ceph-mon[22511]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-20T01:24:28.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:27 smithi077 ceph-mon[22251]: from='osd.2 [v2:172.21.15.134:6800/3873702897,v1:172.21.15.134:6801/3873702897]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-20T01:24:28.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:27 smithi077 ceph-mon[22251]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-20T01:24:28.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:28 smithi022 ceph-mon[18709]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:28.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:28 smithi022 ceph-mon[18709]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-20T01:24:28.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:28 smithi022 ceph-mon[18709]: osdmap e15: 3 total, 2 up, 3 in 2024-08-20T01:24:28.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:28 smithi022 ceph-mon[18709]: from='osd.2 [v2:172.21.15.134:6800/3873702897,v1:172.21.15.134:6801/3873702897]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:24:28.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:28 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:24:28.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:28 smithi022 ceph-mon[18709]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:24:28.919 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:24:28.947 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_3 2024-08-20T01:24:29.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:28 smithi134 ceph-mon[22511]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:29.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:28 smithi134 ceph-mon[22511]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-20T01:24:29.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:28 smithi134 ceph-mon[22511]: osdmap e15: 3 total, 2 up, 3 in 2024-08-20T01:24:29.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:28 smithi134 ceph-mon[22511]: from='osd.2 [v2:172.21.15.134:6800/3873702897,v1:172.21.15.134:6801/3873702897]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:24:29.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:28 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:24:29.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:28 smithi134 ceph-mon[22511]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:24:29.016 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:24:28 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-2[27459]: 2024-08-20T01:24:28.758+0000 7fe9b7b20640 -1 osd.2 0 waiting for initial osdmap 2024-08-20T01:24:29.016 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:24:28 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-2[27459]: 2024-08-20T01:24:28.762+0000 7fe9b3947640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:24:29.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:28 smithi077 ceph-mon[22251]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:29.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:28 smithi077 ceph-mon[22251]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-20T01:24:29.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:28 smithi077 ceph-mon[22251]: osdmap e15: 3 total, 2 up, 3 in 2024-08-20T01:24:29.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:28 smithi077 ceph-mon[22251]: from='osd.2 [v2:172.21.15.134:6800/3873702897,v1:172.21.15.134:6801/3873702897]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:24:29.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:28 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:24:29.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:28 smithi077 ceph-mon[22251]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:24:29.218 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:24:29.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.719+0000 7f02f5008640 1 -- 172.21.15.22:0/675834144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f0103170 msgr2=0x7f02f0109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:24:29.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.719+0000 7f02f5008640 1 --2- 172.21.15.22:0/675834144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f0103170 0x7f02f0109af0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009cd0 tx=0x7f02e802a8e0 comp rx=0 tx=0).stop 2024-08-20T01:24:29.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.719+0000 7f02f5008640 1 -- 172.21.15.22:0/675834144 shutdown_connections 2024-08-20T01:24:29.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.719+0000 7f02f5008640 1 --2- 172.21.15.22:0/675834144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f0103170 0x7f02f0109af0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:29.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.719+0000 7f02f5008640 1 --2- 172.21.15.22:0/675834144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02f01027b0 0x7f02f0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:29.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.719+0000 7f02f5008640 1 --2- 172.21.15.22:0/675834144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f0101650 0x7f02f0101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.719+0000 7f02f5008640 1 -- 172.21.15.22:0/675834144 >> 172.21.15.22:0/675834144 conn(0x7f02f00fcf00 msgr2=0x7f02f00ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:24:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.719+0000 7f02f5008640 1 -- 172.21.15.22:0/675834144 shutdown_connections 2024-08-20T01:24:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.719+0000 7f02f5008640 1 -- 172.21.15.22:0/675834144 wait complete. 2024-08-20T01:24:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.720+0000 7f02f5008640 1 Processor -- start 2024-08-20T01:24:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.720+0000 7f02f5008640 1 -- start start 2024-08-20T01:24:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.720+0000 7f02f5008640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f0101650 0x7f02f010bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:24:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.720+0000 7f02f5008640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f01027b0 0x7f02f010a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:24:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.720+0000 7f02f5008640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02f0103170 0x7f02f010ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:24:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.720+0000 7f02f5008640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f02f010e3c0 con 0x7f02f01027b0 2024-08-20T01:24:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.720+0000 7f02f5008640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f02f010e240 con 0x7f02f0101650 2024-08-20T01:24:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.720+0000 7f02f5008640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f02f010e540 con 0x7f02f0103170 2024-08-20T01:24:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.721+0000 7f02ee59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f01027b0 0x7f02f010a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:24:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.721+0000 7f02eed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f0101650 0x7f02f010bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:24:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.721+0000 7f02ee59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f01027b0 0x7f02f010a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47452/0 (socket says 172.21.15.22:47452) 2024-08-20T01:24:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.721+0000 7f02ee59c640 1 -- 172.21.15.22:0/1275374543 learned_addr learned my addr 172.21.15.22:0/1275374543 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:24:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.721+0000 7f02ef59e640 1 --2- 172.21.15.22:0/1275374543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02f0103170 0x7f02f010ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:24:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.721+0000 7f02ee59c640 1 -- 172.21.15.22:0/1275374543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02f0103170 msgr2=0x7f02f010ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:24:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.721+0000 7f02ee59c640 1 --2- 172.21.15.22:0/1275374543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02f0103170 0x7f02f010ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.721+0000 7f02ee59c640 1 -- 172.21.15.22:0/1275374543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f0101650 msgr2=0x7f02f010bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:24:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.721+0000 7f02ee59c640 1 --2- 172.21.15.22:0/1275374543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f0101650 0x7f02f010bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.721+0000 7f02ee59c640 1 -- 172.21.15.22:0/1275374543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f010b540 con 0x7f02f01027b0 2024-08-20T01:24:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.721+0000 7f02eed9d640 1 --2- 172.21.15.22:0/1275374543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f0101650 0x7f02f010bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:24:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.721+0000 7f02ee59c640 1 --2- 172.21.15.22:0/1275374543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f01027b0 0x7f02f010a740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f02e400d950 tx=0x7f02e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:24:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.721+0000 7f02d7fff640 1 -- 172.21.15.22:0/1275374543 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e4017070 con 0x7f02f01027b0 2024-08-20T01:24:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.721+0000 7f02f5008640 1 -- 172.21.15.22:0/1275374543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f01a2cd0 con 0x7f02f01027b0 2024-08-20T01:24:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.721+0000 7f02d7fff640 1 -- 172.21.15.22:0/1275374543 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02e4009c30 con 0x7f02f01027b0 2024-08-20T01:24:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.721+0000 7f02d7fff640 1 -- 172.21.15.22:0/1275374543 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e400f620 con 0x7f02f01027b0 2024-08-20T01:24:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.721+0000 7f02f5008640 1 -- 172.21.15.22:0/1275374543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f01a31d0 con 0x7f02f01027b0 2024-08-20T01:24:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.722+0000 7f02f5008640 1 -- 172.21.15.22:0/1275374543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f01089d0 con 0x7f02f01027b0 2024-08-20T01:24:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.724+0000 7f02d7fff640 1 -- 172.21.15.22:0/1275374543 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f02e4005030 con 0x7f02f01027b0 2024-08-20T01:24:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.724+0000 7f02d7fff640 1 --2- 172.21.15.22:0/1275374543 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f02d80b3b40 0x7f02d80b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:24:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.724+0000 7f02eed9d640 1 --2- 172.21.15.22:0/1275374543 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f02d80b3b40 0x7f02d80b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:24:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.725+0000 7f02d7fff640 1 -- 172.21.15.22:0/1275374543 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7f02e40e1f80 con 0x7f02f01027b0 2024-08-20T01:24:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.725+0000 7f02eed9d640 1 --2- 172.21.15.22:0/1275374543 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f02d80b3b40 0x7f02d80b6000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f02e000bfd0 tx=0x7f02e000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:24:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.727+0000 7f02d7fff640 1 -- 172.21.15.22:0/1275374543 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f02e4009de0 con 0x7f02f01027b0 2024-08-20T01:24:29.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:29 smithi022 ceph-mon[18709]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-08-20T01:24:29.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:29 smithi022 ceph-mon[18709]: osdmap e16: 3 total, 2 up, 3 in 2024-08-20T01:24:29.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:29 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:24:29.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:29 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:24:29.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:29 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:29.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:29 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:29.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:29 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:24:29.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:29 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:29.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:29 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:29.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:29 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:24:29.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:29 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:29.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:29.933+0000 7f02f5008640 1 -- 172.21.15.22:0/1275374543 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f02f00632c0 con 0x7f02d80b3b40 2024-08-20T01:24:30.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:29 smithi134 ceph-mon[22511]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-08-20T01:24:30.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:29 smithi134 ceph-mon[22511]: osdmap e16: 3 total, 2 up, 3 in 2024-08-20T01:24:30.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:29 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:24:30.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:29 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:24:30.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:29 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:30.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:29 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:30.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:29 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:24:30.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:29 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:30.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:29 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:30.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:29 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:24:30.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:29 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:29 smithi077 ceph-mon[22251]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-08-20T01:24:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:29 smithi077 ceph-mon[22251]: osdmap e16: 3 total, 2 up, 3 in 2024-08-20T01:24:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:29 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:24:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:29 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:24:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:29 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:29 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:29 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:24:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:29 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:29 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:30.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:29 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:24:30.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:29 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:30.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:30 smithi022 ceph-mon[18709]: purged_snaps scrub starts 2024-08-20T01:24:30.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:30 smithi022 ceph-mon[18709]: purged_snaps scrub ok 2024-08-20T01:24:30.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:30 smithi022 ceph-mon[18709]: Detected new or changed devices on smithi134 2024-08-20T01:24:30.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:30 smithi022 ceph-mon[18709]: Adjusting osd_memory_target on smithi134 to 17088M 2024-08-20T01:24:30.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:30 smithi022 ceph-mon[18709]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:30.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:30 smithi022 ceph-mon[18709]: osd.2 [v2:172.21.15.134:6800/3873702897,v1:172.21.15.134:6801/3873702897] boot 2024-08-20T01:24:30.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:30 smithi022 ceph-mon[18709]: osdmap e17: 3 total, 3 up, 3 in 2024-08-20T01:24:30.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:30 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:24:30.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:30 smithi022 ceph-mon[18709]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:24:30.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:30 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:24:30.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:30 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:24:30.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:30 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:31.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:30 smithi134 ceph-mon[22511]: purged_snaps scrub starts 2024-08-20T01:24:31.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:30 smithi134 ceph-mon[22511]: purged_snaps scrub ok 2024-08-20T01:24:31.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:30 smithi134 ceph-mon[22511]: Detected new or changed devices on smithi134 2024-08-20T01:24:31.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:30 smithi134 ceph-mon[22511]: Adjusting osd_memory_target on smithi134 to 17088M 2024-08-20T01:24:31.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:30 smithi134 ceph-mon[22511]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:31.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:30 smithi134 ceph-mon[22511]: osd.2 [v2:172.21.15.134:6800/3873702897,v1:172.21.15.134:6801/3873702897] boot 2024-08-20T01:24:31.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:30 smithi134 ceph-mon[22511]: osdmap e17: 3 total, 3 up, 3 in 2024-08-20T01:24:31.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:30 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:24:31.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:30 smithi134 ceph-mon[22511]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:24:31.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:30 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:24:31.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:30 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:24:31.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:30 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:31.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:30 smithi077 ceph-mon[22251]: purged_snaps scrub starts 2024-08-20T01:24:31.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:30 smithi077 ceph-mon[22251]: purged_snaps scrub ok 2024-08-20T01:24:31.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:30 smithi077 ceph-mon[22251]: Detected new or changed devices on smithi134 2024-08-20T01:24:31.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:30 smithi077 ceph-mon[22251]: Adjusting osd_memory_target on smithi134 to 17088M 2024-08-20T01:24:31.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:30 smithi077 ceph-mon[22251]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:24:31.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:30 smithi077 ceph-mon[22251]: osd.2 [v2:172.21.15.134:6800/3873702897,v1:172.21.15.134:6801/3873702897] boot 2024-08-20T01:24:31.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:30 smithi077 ceph-mon[22251]: osdmap e17: 3 total, 3 up, 3 in 2024-08-20T01:24:31.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:30 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:24:31.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:30 smithi077 ceph-mon[22251]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:24:31.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:30 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:24:31.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:30 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:24:31.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:30 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:32.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:32 smithi022 ceph-mon[18709]: osdmap e18: 3 total, 3 up, 3 in 2024-08-20T01:24:32.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:32 smithi022 ceph-mon[18709]: pgmap v87: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:32.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:32 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-20T01:24:32.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:32 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/272168' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a60de748-aa65-477d-864e-6281db1261ee"} : dispatch 2024-08-20T01:24:32.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:32 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-20T01:24:32.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:32 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/272168' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a60de748-aa65-477d-864e-6281db1261ee"}]': finished 2024-08-20T01:24:32.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:32 smithi022 ceph-mon[18709]: osdmap e19: 4 total, 3 up, 4 in 2024-08-20T01:24:32.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:32 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:32.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:32 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-20T01:24:32.514 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:32 smithi134 ceph-mon[22511]: osdmap e18: 3 total, 3 up, 3 in 2024-08-20T01:24:32.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:32 smithi134 ceph-mon[22511]: pgmap v87: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:32.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:32 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-20T01:24:32.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:32 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/272168' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a60de748-aa65-477d-864e-6281db1261ee"} : dispatch 2024-08-20T01:24:32.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:32 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-20T01:24:32.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:32 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/272168' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a60de748-aa65-477d-864e-6281db1261ee"}]': finished 2024-08-20T01:24:32.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:32 smithi134 ceph-mon[22511]: osdmap e19: 4 total, 3 up, 4 in 2024-08-20T01:24:32.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:32 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:32.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:32 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-20T01:24:32.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:32 smithi077 ceph-mon[22251]: osdmap e18: 3 total, 3 up, 3 in 2024-08-20T01:24:32.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:32 smithi077 ceph-mon[22251]: pgmap v87: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:32.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:32 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-20T01:24:32.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:32 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/272168' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a60de748-aa65-477d-864e-6281db1261ee"} : dispatch 2024-08-20T01:24:32.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:32 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-20T01:24:32.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:32 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/272168' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a60de748-aa65-477d-864e-6281db1261ee"}]': finished 2024-08-20T01:24:32.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:32 smithi077 ceph-mon[22251]: osdmap e19: 4 total, 3 up, 4 in 2024-08-20T01:24:32.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:32 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:32.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:32 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-20T01:24:33.464 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:24:33 smithi134 sudo[31218]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-20T01:24:33.464 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:24:33 smithi134 sudo[31218]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:24:33.464 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:24:33 smithi134 sudo[31218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:24:33.464 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:24:33 smithi134 sudo[31218]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:24:33.464 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:24:33 smithi134 sudo[31221]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-20T01:24:33.464 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:24:33 smithi134 sudo[31221]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:24:33.465 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:24:33 smithi134 sudo[31221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:24:33.465 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:24:33 smithi134 sudo[31221]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:24:33.465 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:33 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/629520588' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:24:33.465 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:33 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-20T01:24:33.465 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:33 smithi134 ceph-mon[22511]: osdmap e20: 4 total, 3 up, 4 in 2024-08-20T01:24:33.465 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:33 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:33.465 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:33 smithi134 sudo[31224]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-20T01:24:33.465 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:33 smithi134 sudo[31224]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:24:33.465 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:33 smithi134 sudo[31224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:24:33.465 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:33 smithi134 sudo[31224]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:24:33.488 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:33 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/629520588' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:24:33.488 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:33 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-20T01:24:33.488 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:33 smithi077 ceph-mon[22251]: osdmap e20: 4 total, 3 up, 4 in 2024-08-20T01:24:33.488 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:33 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:33.489 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:24:33 smithi077 sudo[30493]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-20T01:24:33.489 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:24:33 smithi077 sudo[30493]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:24:33.489 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:24:33 smithi077 sudo[30493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:24:33.489 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:24:33 smithi077 sudo[30493]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:24:33.489 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:24:33 smithi077 sudo[30496]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-20T01:24:33.489 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:24:33 smithi077 sudo[30496]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:24:33.489 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:24:33 smithi077 sudo[30496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:24:33.489 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:24:33 smithi077 sudo[30496]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:24:33.635 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:24:33 smithi022 sudo[39143]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-20T01:24:33.635 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:24:33 smithi022 sudo[39143]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:24:33.635 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:24:33 smithi022 sudo[39143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:24:33.635 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:24:33 smithi022 sudo[39143]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:24:33.635 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:24:33 smithi022 sudo[39146]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-20T01:24:33.635 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:24:33 smithi022 sudo[39146]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:24:33.636 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:24:33 smithi022 sudo[39146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:24:33.636 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:24:33 smithi022 sudo[39146]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:24:33.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:33 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/629520588' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:24:33.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:33 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-20T01:24:33.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:33 smithi022 ceph-mon[18709]: osdmap e20: 4 total, 3 up, 4 in 2024-08-20T01:24:33.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:33 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:33.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:33 smithi022 sudo[39150]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-20T01:24:33.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:33 smithi022 sudo[39150]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:24:33.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:33 smithi022 sudo[39150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:24:33.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:33 smithi022 sudo[39150]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:24:33.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:33 smithi022 sudo[39153]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-20T01:24:33.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:33 smithi022 sudo[39153]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:24:33.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:33 smithi022 sudo[39153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:24:33.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:33 smithi022 sudo[39153]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:24:33.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:33 smithi134 sudo[31227]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-20T01:24:33.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:33 smithi134 sudo[31227]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:24:33.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:33 smithi134 sudo[31227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:24:33.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:33 smithi134 sudo[31227]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:24:33.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:33 smithi077 sudo[30499]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-20T01:24:33.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:33 smithi077 sudo[30499]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:24:33.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:33 smithi077 sudo[30499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:24:33.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:33 smithi077 sudo[30499]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:24:33.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:33 smithi077 sudo[30502]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-20T01:24:33.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:33 smithi077 sudo[30502]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:24:33.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:33 smithi077 sudo[30502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:24:33.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:33 smithi077 sudo[30502]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:24:34.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:34.266+0000 7f02d7fff640 1 -- 172.21.15.22:0/1275374543 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f02e40a6960 con 0x7f02f01027b0 2024-08-20T01:24:34.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: pgmap v90: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:34.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:34.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:34.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:34.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T01:24:34.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T01:24:34.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:24:34.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:24:34.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:24:34.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T01:24:34.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:24:34.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:24:34.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:24:34.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T01:24:34.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T01:24:34.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:24:34.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:24:34.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:24:34.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T01:24:34.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: osdmap e21: 4 total, 3 up, 4 in 2024-08-20T01:24:34.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:34.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: pgmap v90: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:34.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:34.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:34.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:34.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T01:24:34.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T01:24:34.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:24:34.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:24:34.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:24:34.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T01:24:34.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:24:34.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:24:34.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:24:34.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T01:24:34.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T01:24:34.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:24:34.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:24:34.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:24:34.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T01:24:34.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: osdmap e21: 4 total, 3 up, 4 in 2024-08-20T01:24:34.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:34.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: pgmap v90: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:34.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:34.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:34.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:34.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T01:24:34.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T01:24:34.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:24:34.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:24:34.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:24:34.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T01:24:34.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:24:34.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:24:34.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:24:34.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T01:24:34.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T01:24:34.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:24:34.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:24:34.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:24:34.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T01:24:34.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: osdmap e21: 4 total, 3 up, 4 in 2024-08-20T01:24:34.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:35.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:35 smithi077 ceph-mon[22251]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-20T01:24:35.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:35 smithi022 ceph-mon[18709]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-20T01:24:35.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:35 smithi134 ceph-mon[22511]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-20T01:24:36.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:36 smithi022 ceph-mon[18709]: pgmap v92: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:36.562 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:36 smithi077 ceph-mon[22251]: pgmap v92: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:36.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:36 smithi134 ceph-mon[22511]: pgmap v92: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:38.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:38 smithi022 ceph-mon[18709]: pgmap v93: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:38.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:38 smithi077 ceph-mon[22251]: pgmap v93: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:38.566 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:38 smithi134 ceph-mon[22511]: pgmap v93: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:40.536 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:40 smithi022 ceph-mon[18709]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:40.536 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-20T01:24:40.536 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:40.536 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:40 smithi022 ceph-mon[18709]: Deploying daemon osd.3 on smithi022 2024-08-20T01:24:40.562 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:40 smithi077 ceph-mon[22251]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:40.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-20T01:24:40.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:40.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:40 smithi077 ceph-mon[22251]: Deploying daemon osd.3 on smithi022 2024-08-20T01:24:40.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:40 smithi134 ceph-mon[22511]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:40.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-20T01:24:40.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:40.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:40 smithi134 ceph-mon[22511]: Deploying daemon osd.3 on smithi022 2024-08-20T01:24:42.515 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:42 smithi022 ceph-mon[18709]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:42.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:42 smithi077 ceph-mon[22251]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:42.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:42 smithi134 ceph-mon[22511]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:44.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:44 smithi077 ceph-mon[22251]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:44.608 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:44 smithi022 ceph-mon[18709]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:44.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:44 smithi134 ceph-mon[22511]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:45.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:45 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:24:45.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:45 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:45.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:45 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:45.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:45 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:24:45.603 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:45 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:45.603 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:45 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:45.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:45 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:24:45.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:45 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:45.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:45 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:46.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:46 smithi077 ceph-mon[22251]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:46.624 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:46 smithi022 ceph-mon[18709]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:46.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:46 smithi134 ceph-mon[22511]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:49.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:49.118+0000 7f02d7fff640 1 -- 172.21.15.22:0/1275374543 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f02f00632c0 con 0x7f02d80b3b40 2024-08-20T01:24:49.119 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 3 on host 'smithi022' 2024-08-20T01:24:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:49.121+0000 7f02f5008640 1 -- 172.21.15.22:0/1275374543 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f02d80b3b40 msgr2=0x7f02d80b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:24:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:49.121+0000 7f02f5008640 1 --2- 172.21.15.22:0/1275374543 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f02d80b3b40 0x7f02d80b6000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f02e000bfd0 tx=0x7f02e000b390 comp rx=0 tx=0).stop 2024-08-20T01:24:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:49.121+0000 7f02f5008640 1 -- 172.21.15.22:0/1275374543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f01027b0 msgr2=0x7f02f010a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:24:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:49.121+0000 7f02f5008640 1 --2- 172.21.15.22:0/1275374543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f01027b0 0x7f02f010a740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f02e400d950 tx=0x7f02e400de10 comp rx=0 tx=0).stop 2024-08-20T01:24:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:49.121+0000 7f02f5008640 1 -- 172.21.15.22:0/1275374543 shutdown_connections 2024-08-20T01:24:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:49.121+0000 7f02f5008640 1 --2- 172.21.15.22:0/1275374543 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f02d80b3b40 0x7f02d80b6000 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:49.121+0000 7f02f5008640 1 --2- 172.21.15.22:0/1275374543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02f0103170 0x7f02f010ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:49.121+0000 7f02f5008640 1 --2- 172.21.15.22:0/1275374543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f01027b0 0x7f02f010a740 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:49.121+0000 7f02f5008640 1 --2- 172.21.15.22:0/1275374543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f0101650 0x7f02f010bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:49.121+0000 7f02f5008640 1 -- 172.21.15.22:0/1275374543 >> 172.21.15.22:0/1275374543 conn(0x7f02f00fcf00 msgr2=0x7f02f0105ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:24:49.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:48 smithi022 ceph-mon[18709]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:49.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:49.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:49.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:49.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:24:49.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:49.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:49.121+0000 7f02f5008640 1 -- 172.21.15.22:0/1275374543 shutdown_connections 2024-08-20T01:24:49.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:24:49.121+0000 7f02f5008640 1 -- 172.21.15.22:0/1275374543 wait complete. 2024-08-20T01:24:49.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:48 smithi134 ceph-mon[22511]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:49.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:49.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:49.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:49.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:24:49.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:49.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:48 smithi077 ceph-mon[22251]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:49.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:49.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:49.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:49.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:24:49.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:49.745 DEBUG:teuthology.orchestra.run.smithi022:osd.3> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.3.service 2024-08-20T01:24:49.748 INFO:tasks.cephadm:Deploying osd.4 on smithi077 with /dev/vg_nvme/lv_3... 2024-08-20T01:24:49.748 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-20T01:24:49.997 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:24:49.997 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:49.997 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:49.999 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:24:50.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:24:50.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:50.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:50.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:24:50.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:50.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:51.126 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:50 smithi022 ceph-mon[18709]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:51.127 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:24:51 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-3[41101]: 2024-08-20T01:24:51.031+0000 7fa4f9401640 -1 osd.3 0 log_to_monitors true 2024-08-20T01:24:51.166 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:50 smithi077 ceph-mon[22251]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:51.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:50 smithi134 ceph-mon[22511]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:52.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:51 smithi022 ceph-mon[18709]: from='osd.3 [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-20T01:24:52.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:51 smithi134 ceph-mon[22511]: from='osd.3 [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-20T01:24:52.298 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:51 smithi077 ceph-mon[22251]: from='osd.3 [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-20T01:24:52.618 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-08-20T01:24:52.645 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_3 2024-08-20T01:24:52.899 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:24:53.182 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:52 smithi077 ceph-mon[22251]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:53.182 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:52 smithi077 ceph-mon[22251]: from='osd.3 [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-20T01:24:53.182 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:52 smithi077 ceph-mon[22251]: osdmap e22: 4 total, 3 up, 4 in 2024-08-20T01:24:53.182 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:52 smithi077 ceph-mon[22251]: from='osd.3 [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-08-20T01:24:53.182 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:52 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:53.183 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:52 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:53.183 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:52 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:53.183 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:52 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:24:53.183 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:52 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:24:53.183 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:52 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:53.183 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:52 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:53.183 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:52 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:24:53.183 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:52 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:53.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:52 smithi134 ceph-mon[22511]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:53.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:52 smithi134 ceph-mon[22511]: from='osd.3 [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-20T01:24:53.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:52 smithi134 ceph-mon[22511]: osdmap e22: 4 total, 3 up, 4 in 2024-08-20T01:24:53.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:52 smithi134 ceph-mon[22511]: from='osd.3 [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-08-20T01:24:53.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:52 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:53.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:52 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:53.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:52 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:53.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:52 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:24:53.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:52 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:24:53.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:52 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:53.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:52 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:53.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:52 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:24:53.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:52 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:53.358 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:52 smithi022 ceph-mon[18709]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:53.358 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:52 smithi022 ceph-mon[18709]: from='osd.3 [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-20T01:24:53.358 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:52 smithi022 ceph-mon[18709]: osdmap e22: 4 total, 3 up, 4 in 2024-08-20T01:24:53.358 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:52 smithi022 ceph-mon[18709]: from='osd.3 [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-08-20T01:24:53.359 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:52 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:53.359 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:52 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:53.359 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:52 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:53.359 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:52 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:24:53.359 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:52 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:24:53.359 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:52 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:53.359 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:52 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:53.359 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:52 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:24:53.359 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:52 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:24:53.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.354+0000 7fa8d4d8c640 1 -- 172.21.15.77:0/2898382155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d010a640 msgr2=0x7fa8d010cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:24:53.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.354+0000 7fa8d4d8c640 1 --2- 172.21.15.77:0/2898382155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d010a640 0x7fa8d010cb00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009ca0 tx=0x7fa8c802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:24:53.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.355+0000 7fa8d4d8c640 1 -- 172.21.15.77:0/2898382155 shutdown_connections 2024-08-20T01:24:53.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.355+0000 7fa8d4d8c640 1 --2- 172.21.15.77:0/2898382155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d010a640 0x7fa8d010cb00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:53.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.355+0000 7fa8d4d8c640 1 --2- 172.21.15.77:0/2898382155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8d0107c90 0x7fa8d010a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:53.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.355+0000 7fa8d4d8c640 1 --2- 172.21.15.77:0/2898382155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d006b270 0x7fa8d0107750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:53.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.355+0000 7fa8d4d8c640 1 -- 172.21.15.77:0/2898382155 >> 172.21.15.77:0/2898382155 conn(0x7fa8d00fcee0 msgr2=0x7fa8d00ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:24:53.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.355+0000 7fa8d4d8c640 1 -- 172.21.15.77:0/2898382155 shutdown_connections 2024-08-20T01:24:53.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.355+0000 7fa8d4d8c640 1 -- 172.21.15.77:0/2898382155 wait complete. 2024-08-20T01:24:53.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.355+0000 7fa8d4d8c640 1 Processor -- start 2024-08-20T01:24:53.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.355+0000 7fa8d4d8c640 1 -- start start 2024-08-20T01:24:53.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.355+0000 7fa8d4d8c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d006b270 0x7fa8d019ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:24:53.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.355+0000 7fa8d4d8c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d0107c90 0x7fa8d019b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:24:53.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8d4d8c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8d010a640 0x7fa8d019bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:24:53.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8d4d8c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d0110610 con 0x7fa8d006b270 2024-08-20T01:24:53.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8d4d8c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d0110490 con 0x7fa8d0107c90 2024-08-20T01:24:53.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8d4d8c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d0110790 con 0x7fa8d010a640 2024-08-20T01:24:53.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8cdd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d0107c90 0x7fa8d019b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:24:53.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8ce59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d006b270 0x7fa8d019ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:24:53.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8cdd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d0107c90 0x7fa8d019b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39124/0 (socket says 172.21.15.77:39124) 2024-08-20T01:24:53.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8cdd9b640 1 -- 172.21.15.77:0/3451864073 learned_addr learned my addr 172.21.15.77:0/3451864073 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-08-20T01:24:53.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8ce59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d006b270 0x7fa8d019ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.77:46530/0 (socket says 172.21.15.77:46530) 2024-08-20T01:24:53.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8ced9d640 1 --2- 172.21.15.77:0/3451864073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8d010a640 0x7fa8d019bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:24:53.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8cdd9b640 1 -- 172.21.15.77:0/3451864073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8d010a640 msgr2=0x7fa8d019bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:24:53.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8cdd9b640 1 --2- 172.21.15.77:0/3451864073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8d010a640 0x7fa8d019bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:53.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8cdd9b640 1 -- 172.21.15.77:0/3451864073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d006b270 msgr2=0x7fa8d019ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:24:53.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8cdd9b640 1 --2- 172.21.15.77:0/3451864073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d006b270 0x7fa8d019ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:24:53.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8cdd9b640 1 -- 172.21.15.77:0/3451864073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d019c830 con 0x7fa8d0107c90 2024-08-20T01:24:53.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8ced9d640 1 --2- 172.21.15.77:0/3451864073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8d010a640 0x7fa8d019bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:24:53.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8cdd9b640 1 --2- 172.21.15.77:0/3451864073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d0107c90 0x7fa8d019b350 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000b450 tx=0x7fa8c000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:24:53.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8bf7fe640 1 -- 172.21.15.77:0/3451864073 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0015020 con 0x7fa8d0107c90 2024-08-20T01:24:53.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8d4d8c640 1 -- 172.21.15.77:0/3451864073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d019cb20 con 0x7fa8d0107c90 2024-08-20T01:24:53.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8bf7fe640 1 -- 172.21.15.77:0/3451864073 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8c0011d40 con 0x7fa8d0107c90 2024-08-20T01:24:53.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8bf7fe640 1 -- 172.21.15.77:0/3451864073 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c000f340 con 0x7fa8d0107c90 2024-08-20T01:24:53.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.356+0000 7fa8d4d8c640 1 -- 172.21.15.77:0/3451864073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d01a3200 con 0x7fa8d0107c90 2024-08-20T01:24:53.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.357+0000 7fa8d4d8c640 1 -- 172.21.15.77:0/3451864073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8d00fe9d0 con 0x7fa8d0107c90 2024-08-20T01:24:53.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.359+0000 7fa8bf7fe640 1 -- 172.21.15.77:0/3451864073 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fa8c0018020 con 0x7fa8d0107c90 2024-08-20T01:24:53.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.359+0000 7fa8bf7fe640 1 --2- 172.21.15.77:0/3451864073 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa8b80b3bd0 0x7fa8b80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:24:53.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.359+0000 7fa8bf7fe640 1 -- 172.21.15.77:0/3451864073 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3389+0+0 (secure 0 0 0) 0x7fa8c00e2370 con 0x7fa8d0107c90 2024-08-20T01:24:53.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.359+0000 7fa8ce59c640 1 --2- 172.21.15.77:0/3451864073 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa8b80b3bd0 0x7fa8b80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:24:53.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.360+0000 7fa8ce59c640 1 --2- 172.21.15.77:0/3451864073 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa8b80b3bd0 0x7fa8b80b6090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4005d00 tx=0x7fa8c400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:24:53.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.367+0000 7fa8bf7fe640 1 -- 172.21.15.77:0/3451864073 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa8c001f020 con 0x7fa8d0107c90 2024-08-20T01:24:53.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:24:53.557+0000 7fa8d4d8c640 1 -- 172.21.15.77:0/3451864073 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa8d00632c0 con 0x7fa8b80b3bd0 2024-08-20T01:24:53.635 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:24:53 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-3[41101]: 2024-08-20T01:24:53.357+0000 7fa4f5b98640 -1 osd.3 0 waiting for initial osdmap 2024-08-20T01:24:53.635 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:24:53 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-3[41101]: 2024-08-20T01:24:53.364+0000 7fa4ed1a3640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:24:54.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:53 smithi077 ceph-mon[22251]: Detected new or changed devices on smithi022 2024-08-20T01:24:54.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:53 smithi077 ceph-mon[22251]: Adjusting osd_memory_target on smithi022 to 8546M 2024-08-20T01:24:54.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:53 smithi077 ceph-mon[22251]: from='osd.3 [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-08-20T01:24:54.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:53 smithi077 ceph-mon[22251]: osdmap e23: 4 total, 3 up, 4 in 2024-08-20T01:24:54.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:53 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:54.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:53 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:54.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:53 smithi077 ceph-mon[22251]: from='osd.3 [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906]' entity='osd.3' 2024-08-20T01:24:54.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:53 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:24:54.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:53 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:24:54.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:53 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:54.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:53 smithi077 ceph-mon[22251]: osd.3 [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906] boot 2024-08-20T01:24:54.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:53 smithi077 ceph-mon[22251]: osdmap e24: 4 total, 4 up, 4 in 2024-08-20T01:24:54.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:53 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:54.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:53 smithi134 ceph-mon[22511]: Detected new or changed devices on smithi022 2024-08-20T01:24:54.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:53 smithi134 ceph-mon[22511]: Adjusting osd_memory_target on smithi022 to 8546M 2024-08-20T01:24:54.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:53 smithi134 ceph-mon[22511]: from='osd.3 [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-08-20T01:24:54.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:53 smithi134 ceph-mon[22511]: osdmap e23: 4 total, 3 up, 4 in 2024-08-20T01:24:54.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:53 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:54.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:53 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:54.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:53 smithi134 ceph-mon[22511]: from='osd.3 [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906]' entity='osd.3' 2024-08-20T01:24:54.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:53 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:24:54.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:53 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:24:54.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:53 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:54.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:53 smithi134 ceph-mon[22511]: osd.3 [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906] boot 2024-08-20T01:24:54.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:53 smithi134 ceph-mon[22511]: osdmap e24: 4 total, 4 up, 4 in 2024-08-20T01:24:54.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:53 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:54.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:53 smithi022 ceph-mon[18709]: Detected new or changed devices on smithi022 2024-08-20T01:24:54.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:53 smithi022 ceph-mon[18709]: Adjusting osd_memory_target on smithi022 to 8546M 2024-08-20T01:24:54.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:53 smithi022 ceph-mon[18709]: from='osd.3 [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-08-20T01:24:54.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:53 smithi022 ceph-mon[18709]: osdmap e23: 4 total, 3 up, 4 in 2024-08-20T01:24:54.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:53 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:54.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:53 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:54.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:53 smithi022 ceph-mon[18709]: from='osd.3 [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906]' entity='osd.3' 2024-08-20T01:24:54.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:53 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:24:54.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:53 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:24:54.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:53 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:24:54.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:53 smithi022 ceph-mon[18709]: osd.3 [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906] boot 2024-08-20T01:24:54.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:53 smithi022 ceph-mon[18709]: osdmap e24: 4 total, 4 up, 4 in 2024-08-20T01:24:54.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:53 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:24:55.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:54 smithi134 ceph-mon[22511]: purged_snaps scrub starts 2024-08-20T01:24:55.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:54 smithi134 ceph-mon[22511]: purged_snaps scrub ok 2024-08-20T01:24:55.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:54 smithi134 ceph-mon[22511]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:55.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:54 smithi134 ceph-mon[22511]: from='client.24314 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:24:55.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:54 smithi134 ceph-mon[22511]: osdmap e25: 4 total, 4 up, 4 in 2024-08-20T01:24:55.278 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:54 smithi077 ceph-mon[22251]: purged_snaps scrub starts 2024-08-20T01:24:55.278 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:54 smithi077 ceph-mon[22251]: purged_snaps scrub ok 2024-08-20T01:24:55.278 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:54 smithi077 ceph-mon[22251]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:55.278 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:54 smithi077 ceph-mon[22251]: from='client.24314 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:24:55.278 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:54 smithi077 ceph-mon[22251]: osdmap e25: 4 total, 4 up, 4 in 2024-08-20T01:24:55.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:54 smithi022 ceph-mon[18709]: purged_snaps scrub starts 2024-08-20T01:24:55.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:54 smithi022 ceph-mon[18709]: purged_snaps scrub ok 2024-08-20T01:24:55.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:54 smithi022 ceph-mon[18709]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:24:55.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:54 smithi022 ceph-mon[18709]: from='client.24314 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:24:55.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:54 smithi022 ceph-mon[18709]: osdmap e25: 4 total, 4 up, 4 in 2024-08-20T01:24:57.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:56 smithi134 ceph-mon[22511]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:24:57.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:56 smithi134 ceph-mon[22511]: osdmap e26: 4 total, 4 up, 4 in 2024-08-20T01:24:57.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:56 smithi134 ceph-mon[22511]: from='client.? 172.21.15.77:0/2223940122' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "07d99671-2ece-471c-ad69-fc9043d917f4"} : dispatch 2024-08-20T01:24:57.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:56 smithi134 ceph-mon[22511]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "07d99671-2ece-471c-ad69-fc9043d917f4"} : dispatch 2024-08-20T01:24:57.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:56 smithi134 ceph-mon[22511]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "07d99671-2ece-471c-ad69-fc9043d917f4"}]': finished 2024-08-20T01:24:57.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:56 smithi134 ceph-mon[22511]: osdmap e27: 5 total, 4 up, 5 in 2024-08-20T01:24:57.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:56 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:24:57.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:56 smithi134 ceph-mon[22511]: from='client.? 172.21.15.77:0/3205544394' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:24:57.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:56 smithi077 ceph-mon[22251]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:24:57.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:56 smithi077 ceph-mon[22251]: osdmap e26: 4 total, 4 up, 4 in 2024-08-20T01:24:57.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:56 smithi077 ceph-mon[22251]: from='client.? 172.21.15.77:0/2223940122' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "07d99671-2ece-471c-ad69-fc9043d917f4"} : dispatch 2024-08-20T01:24:57.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:56 smithi077 ceph-mon[22251]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "07d99671-2ece-471c-ad69-fc9043d917f4"} : dispatch 2024-08-20T01:24:57.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:56 smithi077 ceph-mon[22251]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "07d99671-2ece-471c-ad69-fc9043d917f4"}]': finished 2024-08-20T01:24:57.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:56 smithi077 ceph-mon[22251]: osdmap e27: 5 total, 4 up, 5 in 2024-08-20T01:24:57.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:56 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:24:57.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:56 smithi077 ceph-mon[22251]: from='client.? 172.21.15.77:0/3205544394' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:24:57.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:56 smithi022 ceph-mon[18709]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:24:57.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:56 smithi022 ceph-mon[18709]: osdmap e26: 4 total, 4 up, 4 in 2024-08-20T01:24:57.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:56 smithi022 ceph-mon[18709]: from='client.? 172.21.15.77:0/2223940122' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "07d99671-2ece-471c-ad69-fc9043d917f4"} : dispatch 2024-08-20T01:24:57.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:56 smithi022 ceph-mon[18709]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "07d99671-2ece-471c-ad69-fc9043d917f4"} : dispatch 2024-08-20T01:24:57.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:56 smithi022 ceph-mon[18709]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "07d99671-2ece-471c-ad69-fc9043d917f4"}]': finished 2024-08-20T01:24:57.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:56 smithi022 ceph-mon[18709]: osdmap e27: 5 total, 4 up, 5 in 2024-08-20T01:24:57.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:56 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:24:57.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:56 smithi022 ceph-mon[18709]: from='client.? 172.21.15.77:0/3205544394' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:24:59.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:24:58 smithi134 ceph-mon[22511]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:24:59.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:24:58 smithi077 ceph-mon[22251]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:24:59.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:24:58 smithi022 ceph-mon[18709]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:25:01.167 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:00 smithi077 ceph-mon[22251]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-08-20T01:25:01.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:00 smithi134 ceph-mon[22511]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-08-20T01:25:01.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:00 smithi022 ceph-mon[18709]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-08-20T01:25:03.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:02 smithi134 ceph-mon[22511]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-08-20T01:25:03.275 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:02 smithi077 ceph-mon[22251]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-08-20T01:25:03.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:02 smithi022 ceph-mon[18709]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-08-20T01:25:05.201 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:04 smithi077 ceph-mon[22251]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:25:05.201 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:04 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-20T01:25:05.201 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:04 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:05.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:04 smithi134 ceph-mon[22511]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:25:05.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:04 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-20T01:25:05.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:04 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:05.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:04 smithi022 ceph-mon[18709]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:25:05.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:04 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-20T01:25:05.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:04 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:06.250 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:05 smithi077 ceph-mon[22251]: Deploying daemon osd.4 on smithi077 2024-08-20T01:25:06.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:05 smithi134 ceph-mon[22511]: Deploying daemon osd.4 on smithi077 2024-08-20T01:25:06.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:05 smithi022 ceph-mon[18709]: Deploying daemon osd.4 on smithi077 2024-08-20T01:25:07.204 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:06 smithi077 ceph-mon[22251]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-20T01:25:07.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:06 smithi134 ceph-mon[22511]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-20T01:25:07.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:06 smithi022 ceph-mon[18709]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-20T01:25:09.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:08 smithi077 ceph-mon[22251]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-08-20T01:25:09.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:08 smithi134 ceph-mon[22511]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-08-20T01:25:09.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:08 smithi022 ceph-mon[18709]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-08-20T01:25:11.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:10 smithi077 ceph-mon[22251]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:25:11.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:10 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:25:11.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:10 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:11.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:10 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:11.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:10 smithi134 ceph-mon[22511]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:25:11.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:10 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:25:11.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:10 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:11.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:10 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:11.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:10 smithi022 ceph-mon[18709]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:25:11.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:10 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:25:11.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:10 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:11.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:10 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:13.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:12 smithi134 ceph-mon[22511]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:25:13.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:12 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:13.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:12 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:13.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:12 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:13.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:12 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:25:13.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:12 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:13.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:12 smithi077 ceph-mon[22251]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:25:13.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:12 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:13.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:12 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:13.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:12 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:13.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:12 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:25:13.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:12 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:13.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:12 smithi022 ceph-mon[18709]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:25:13.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:12 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:13.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:12 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:13.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:12 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:13.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:12 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:25:13.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:12 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:14.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:25:14.073+0000 7fa8bf7fe640 1 -- 172.21.15.77:0/3451864073 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa8d00632c0 con 0x7fa8b80b3bd0 2024-08-20T01:25:14.074 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 4 on host 'smithi077' 2024-08-20T01:25:14.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:25:14.076+0000 7fa8d4d8c640 1 -- 172.21.15.77:0/3451864073 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa8b80b3bd0 msgr2=0x7fa8b80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:25:14.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:25:14.076+0000 7fa8d4d8c640 1 --2- 172.21.15.77:0/3451864073 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa8b80b3bd0 0x7fa8b80b6090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4005d00 tx=0x7fa8c400b410 comp rx=0 tx=0).stop 2024-08-20T01:25:14.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:25:14.076+0000 7fa8d4d8c640 1 -- 172.21.15.77:0/3451864073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d0107c90 msgr2=0x7fa8d019b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:25:14.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:25:14.076+0000 7fa8d4d8c640 1 --2- 172.21.15.77:0/3451864073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d0107c90 0x7fa8d019b350 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000b450 tx=0x7fa8c000b910 comp rx=0 tx=0).stop 2024-08-20T01:25:14.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:25:14.076+0000 7fa8d4d8c640 1 -- 172.21.15.77:0/3451864073 shutdown_connections 2024-08-20T01:25:14.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:25:14.076+0000 7fa8d4d8c640 1 --2- 172.21.15.77:0/3451864073 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa8b80b3bd0 0x7fa8b80b6090 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:25:14.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:25:14.076+0000 7fa8d4d8c640 1 --2- 172.21.15.77:0/3451864073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8d010a640 0x7fa8d019bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:25:14.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:25:14.076+0000 7fa8d4d8c640 1 --2- 172.21.15.77:0/3451864073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d0107c90 0x7fa8d019b350 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:25:14.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:25:14.076+0000 7fa8d4d8c640 1 --2- 172.21.15.77:0/3451864073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d006b270 0x7fa8d019ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:25:14.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:25:14.076+0000 7fa8d4d8c640 1 -- 172.21.15.77:0/3451864073 >> 172.21.15.77:0/3451864073 conn(0x7fa8d00fcee0 msgr2=0x7fa8d01088f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:25:14.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:25:14.076+0000 7fa8d4d8c640 1 -- 172.21.15.77:0/3451864073 shutdown_connections 2024-08-20T01:25:14.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:25:14.076+0000 7fa8d4d8c640 1 -- 172.21.15.77:0/3451864073 wait complete. 2024-08-20T01:25:14.756 DEBUG:teuthology.orchestra.run.smithi077:osd.4> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.4.service 2024-08-20T01:25:14.758 INFO:tasks.cephadm:Deploying osd.5 on smithi134 with /dev/vg_nvme/lv_3... 2024-08-20T01:25:14.759 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-20T01:25:15.016 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:25:15.136 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:14 smithi134 ceph-mon[22511]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:25:15.137 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:25:15.137 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:15.137 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:15.224 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:14 smithi077 ceph-mon[22251]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:25:15.224 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:25:15.224 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:15.224 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:15.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:14 smithi022 ceph-mon[18709]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:25:15.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:25:15.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:15.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:16.188 INFO:journalctl@ceph.osd.4.smithi077.stdout:Aug 20 01:25:16 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-4[33243]: 2024-08-20T01:25:16.070+0000 7ff301a30640 -1 osd.4 0 log_to_monitors true 2024-08-20T01:25:17.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:16 smithi134 ceph-mon[22511]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:25:17.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:16 smithi134 ceph-mon[22511]: from='osd.4 [v2:172.21.15.77:6808/1954209322,v1:172.21.15.77:6809/1954209322]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-20T01:25:17.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:16 smithi134 ceph-mon[22511]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-20T01:25:17.207 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:16 smithi022 ceph-mon[18709]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:25:17.207 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:16 smithi022 ceph-mon[18709]: from='osd.4 [v2:172.21.15.77:6808/1954209322,v1:172.21.15.77:6809/1954209322]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-20T01:25:17.207 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:16 smithi022 ceph-mon[18709]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-20T01:25:17.250 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:16 smithi077 ceph-mon[22251]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:25:17.250 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:16 smithi077 ceph-mon[22251]: from='osd.4 [v2:172.21.15.77:6808/1954209322,v1:172.21.15.77:6809/1954209322]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-20T01:25:17.250 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:16 smithi077 ceph-mon[22251]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-20T01:25:17.675 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:25:17.701 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_3 2024-08-20T01:25:17.954 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:25:18.212 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:17 smithi134 ceph-mon[22511]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-20T01:25:18.213 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:17 smithi134 ceph-mon[22511]: from='osd.4 [v2:172.21.15.77:6808/1954209322,v1:172.21.15.77:6809/1954209322]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:25:18.213 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:17 smithi134 ceph-mon[22511]: osdmap e28: 5 total, 4 up, 5 in 2024-08-20T01:25:18.213 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:17 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:25:18.213 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:17 smithi134 ceph-mon[22511]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:25:18.213 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:17 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:18.213 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:17 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:18.213 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:17 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:25:18.213 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:17 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:25:18.213 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:17 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:18.213 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:17 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:18.213 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:17 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:25:18.213 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:17 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:18.214 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:17 smithi134 ceph-mon[22511]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-08-20T01:25:18.214 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:17 smithi134 ceph-mon[22511]: osdmap e29: 5 total, 4 up, 5 in 2024-08-20T01:25:18.214 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:17 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:25:18.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:17 smithi077 ceph-mon[22251]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-20T01:25:18.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:17 smithi077 ceph-mon[22251]: from='osd.4 [v2:172.21.15.77:6808/1954209322,v1:172.21.15.77:6809/1954209322]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:25:18.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:17 smithi077 ceph-mon[22251]: osdmap e28: 5 total, 4 up, 5 in 2024-08-20T01:25:18.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:17 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:25:18.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:17 smithi077 ceph-mon[22251]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:25:18.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:17 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:18.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:17 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:18.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:17 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:25:18.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:17 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:25:18.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:17 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:18.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:17 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:18.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:17 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:25:18.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:17 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:18.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:17 smithi077 ceph-mon[22251]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-08-20T01:25:18.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:17 smithi077 ceph-mon[22251]: osdmap e29: 5 total, 4 up, 5 in 2024-08-20T01:25:18.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:17 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:25:18.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:17 smithi022 ceph-mon[18709]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-20T01:25:18.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:17 smithi022 ceph-mon[18709]: from='osd.4 [v2:172.21.15.77:6808/1954209322,v1:172.21.15.77:6809/1954209322]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:25:18.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:17 smithi022 ceph-mon[18709]: osdmap e28: 5 total, 4 up, 5 in 2024-08-20T01:25:18.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:17 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:25:18.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:17 smithi022 ceph-mon[18709]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:25:18.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:17 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:18.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:17 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:18.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:17 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:25:18.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:17 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:25:18.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:17 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:18.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:17 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:18.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:17 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:25:18.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:17 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:18.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:17 smithi022 ceph-mon[18709]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-08-20T01:25:18.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:17 smithi022 ceph-mon[18709]: osdmap e29: 5 total, 4 up, 5 in 2024-08-20T01:25:18.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:17 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:25:18.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.448+0000 7f4f66101640 1 -- 172.21.15.134:0/1676327122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f601027c0 msgr2=0x7f4f60102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:25:18.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.448+0000 7f4f66101640 1 --2- 172.21.15.134:0/1676327122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f601027c0 0x7f4f60102c40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009960 tx=0x7f4f5402a460 comp rx=0 tx=0).stop 2024-08-20T01:25:18.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.448+0000 7f4f66101640 1 -- 172.21.15.134:0/1676327122 shutdown_connections 2024-08-20T01:25:18.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.448+0000 7f4f66101640 1 --2- 172.21.15.134:0/1676327122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f60103180 0x7f4f60109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:25:18.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.448+0000 7f4f66101640 1 --2- 172.21.15.134:0/1676327122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f601027c0 0x7f4f60102c40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:25:18.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.448+0000 7f4f66101640 1 --2- 172.21.15.134:0/1676327122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f60101660 0x7f4f60101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:25:18.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.448+0000 7f4f66101640 1 -- 172.21.15.134:0/1676327122 >> 172.21.15.134:0/1676327122 conn(0x7f4f600fcf30 msgr2=0x7f4f600ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:25:18.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.448+0000 7f4f66101640 1 -- 172.21.15.134:0/1676327122 shutdown_connections 2024-08-20T01:25:18.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.448+0000 7f4f66101640 1 -- 172.21.15.134:0/1676327122 wait complete. 2024-08-20T01:25:18.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.449+0000 7f4f66101640 1 Processor -- start 2024-08-20T01:25:18.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.449+0000 7f4f66101640 1 -- start start 2024-08-20T01:25:18.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.449+0000 7f4f66101640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f60101660 0x7f4f6010bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:25:18.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.449+0000 7f4f66101640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f601027c0 0x7f4f6010a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:25:18.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.449+0000 7f4f66101640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f60103180 0x7f4f6010ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:25:18.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.449+0000 7f4f66101640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6010e410 con 0x7f4f60101660 2024-08-20T01:25:18.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.449+0000 7f4f66101640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6010e290 con 0x7f4f60103180 2024-08-20T01:25:18.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.449+0000 7f4f66101640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6010e590 con 0x7f4f601027c0 2024-08-20T01:25:18.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.449+0000 7f4f5effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f601027c0 0x7f4f6010a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:25:18.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.449+0000 7f4f5f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f60101660 0x7f4f6010bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:25:18.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.449+0000 7f4f5effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f601027c0 0x7f4f6010a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47908/0 (socket says 172.21.15.134:47908) 2024-08-20T01:25:18.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.449+0000 7f4f5effd640 1 -- 172.21.15.134:0/3461469042 learned_addr learned my addr 172.21.15.134:0/3461469042 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-08-20T01:25:18.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.449+0000 7f4f5ffff640 1 --2- 172.21.15.134:0/3461469042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f60103180 0x7f4f6010ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:25:18.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.450+0000 7f4f5effd640 1 -- 172.21.15.134:0/3461469042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f60103180 msgr2=0x7f4f6010ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:25:18.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.450+0000 7f4f5effd640 1 --2- 172.21.15.134:0/3461469042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f60103180 0x7f4f6010ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:25:18.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.450+0000 7f4f5effd640 1 -- 172.21.15.134:0/3461469042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f60101660 msgr2=0x7f4f6010bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:25:18.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.450+0000 7f4f5effd640 1 --2- 172.21.15.134:0/3461469042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f60101660 0x7f4f6010bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:25:18.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.450+0000 7f4f5effd640 1 -- 172.21.15.134:0/3461469042 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6010b550 con 0x7f4f601027c0 2024-08-20T01:25:18.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.450+0000 7f4f5ffff640 1 --2- 172.21.15.134:0/3461469042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f60103180 0x7f4f6010ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:25:18.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.450+0000 7f4f5f7fe640 1 --2- 172.21.15.134:0/3461469042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f60101660 0x7f4f6010bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:25:18.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.450+0000 7f4f5effd640 1 --2- 172.21.15.134:0/3461469042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f601027c0 0x7f4f6010a750 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4f54006010 tx=0x7f4f54004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:25:18.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.450+0000 7f4f5cff9640 1 -- 172.21.15.134:0/3461469042 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5403f030 con 0x7f4f601027c0 2024-08-20T01:25:18.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.450+0000 7f4f66101640 1 -- 172.21.15.134:0/3461469042 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f601a2c70 con 0x7f4f601027c0 2024-08-20T01:25:18.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.450+0000 7f4f5cff9640 1 -- 172.21.15.134:0/3461469042 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f54003aa0 con 0x7f4f601027c0 2024-08-20T01:25:18.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.450+0000 7f4f5cff9640 1 -- 172.21.15.134:0/3461469042 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54035070 con 0x7f4f601027c0 2024-08-20T01:25:18.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.450+0000 7f4f66101640 1 -- 172.21.15.134:0/3461469042 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f601a3120 con 0x7f4f601027c0 2024-08-20T01:25:18.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.451+0000 7f4f66101640 1 -- 172.21.15.134:0/3461469042 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f601a32f0 con 0x7f4f601027c0 2024-08-20T01:25:18.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.452+0000 7f4f5cff9640 1 -- 172.21.15.134:0/3461469042 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f4f54042030 con 0x7f4f601027c0 2024-08-20T01:25:18.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.453+0000 7f4f5cff9640 1 --2- 172.21.15.134:0/3461469042 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4f480b3bd0 0x7f4f480b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:25:18.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.453+0000 7f4f5f7fe640 1 --2- 172.21.15.134:0/3461469042 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4f480b3bd0 0x7f4f480b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:25:18.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.453+0000 7f4f5cff9640 1 -- 172.21.15.134:0/3461469042 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3821+0+0 (secure 0 0 0) 0x7f4f54102d10 con 0x7f4f601027c0 2024-08-20T01:25:18.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.454+0000 7f4f5f7fe640 1 --2- 172.21.15.134:0/3461469042 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4f480b3bd0 0x7f4f480b6090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4f50009fc0 tx=0x7f4f50005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:25:18.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.457+0000 7f4f5cff9640 1 -- 172.21.15.134:0/3461469042 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f4f540caea0 con 0x7f4f601027c0 2024-08-20T01:25:18.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:18.643+0000 7f4f66101640 1 -- 172.21.15.134:0/3461469042 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4f601042e0 con 0x7f4f480b3bd0 2024-08-20T01:25:18.813 INFO:journalctl@ceph.osd.4.smithi077.stdout:Aug 20 01:25:18 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-4[33243]: 2024-08-20T01:25:18.346+0000 7ff2fd9b3640 -1 osd.4 0 waiting for initial osdmap 2024-08-20T01:25:18.813 INFO:journalctl@ceph.osd.4.smithi077.stdout:Aug 20 01:25:18 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-4[33243]: 2024-08-20T01:25:18.351+0000 7ff2f57d2640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:25:19.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:18 smithi134 ceph-mon[22511]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:25:19.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:18 smithi134 ceph-mon[22511]: Detected new or changed devices on smithi077 2024-08-20T01:25:19.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:18 smithi134 ceph-mon[22511]: Adjusting osd_memory_target on smithi077 to 8544M 2024-08-20T01:25:19.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:18 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:25:19.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:18 smithi134 ceph-mon[22511]: from='osd.4 ' entity='osd.4' 2024-08-20T01:25:19.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:18 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:25:19.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:18 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:25:19.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:18 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:19.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:18 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:25:19.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:18 smithi077 ceph-mon[22251]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:25:19.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:18 smithi077 ceph-mon[22251]: Detected new or changed devices on smithi077 2024-08-20T01:25:19.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:18 smithi077 ceph-mon[22251]: Adjusting osd_memory_target on smithi077 to 8544M 2024-08-20T01:25:19.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:18 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:25:19.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:18 smithi077 ceph-mon[22251]: from='osd.4 ' entity='osd.4' 2024-08-20T01:25:19.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:18 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:25:19.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:18 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:25:19.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:18 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:19.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:18 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:25:19.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:18 smithi022 ceph-mon[18709]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:25:19.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:18 smithi022 ceph-mon[18709]: Detected new or changed devices on smithi077 2024-08-20T01:25:19.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:18 smithi022 ceph-mon[18709]: Adjusting osd_memory_target on smithi077 to 8544M 2024-08-20T01:25:19.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:18 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:25:19.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:18 smithi022 ceph-mon[18709]: from='osd.4 ' entity='osd.4' 2024-08-20T01:25:19.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:18 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:25:19.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:18 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:25:19.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:18 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:19.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:18 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:25:20.092 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:19 smithi134 ceph-mon[22511]: purged_snaps scrub starts 2024-08-20T01:25:20.092 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:19 smithi134 ceph-mon[22511]: purged_snaps scrub ok 2024-08-20T01:25:20.093 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:19 smithi134 ceph-mon[22511]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:25:20.093 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:19 smithi134 ceph-mon[22511]: osd.4 [v2:172.21.15.77:6808/1954209322,v1:172.21.15.77:6809/1954209322] boot 2024-08-20T01:25:20.093 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:19 smithi134 ceph-mon[22511]: osdmap e30: 5 total, 5 up, 5 in 2024-08-20T01:25:20.093 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:19 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:25:20.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:19 smithi077 ceph-mon[22251]: purged_snaps scrub starts 2024-08-20T01:25:20.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:19 smithi077 ceph-mon[22251]: purged_snaps scrub ok 2024-08-20T01:25:20.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:19 smithi077 ceph-mon[22251]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:25:20.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:19 smithi077 ceph-mon[22251]: osd.4 [v2:172.21.15.77:6808/1954209322,v1:172.21.15.77:6809/1954209322] boot 2024-08-20T01:25:20.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:19 smithi077 ceph-mon[22251]: osdmap e30: 5 total, 5 up, 5 in 2024-08-20T01:25:20.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:19 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:25:20.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:19 smithi022 ceph-mon[18709]: purged_snaps scrub starts 2024-08-20T01:25:20.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:19 smithi022 ceph-mon[18709]: purged_snaps scrub ok 2024-08-20T01:25:20.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:19 smithi022 ceph-mon[18709]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:25:20.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:19 smithi022 ceph-mon[18709]: osd.4 [v2:172.21.15.77:6808/1954209322,v1:172.21.15.77:6809/1954209322] boot 2024-08-20T01:25:20.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:19 smithi022 ceph-mon[18709]: osdmap e30: 5 total, 5 up, 5 in 2024-08-20T01:25:20.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:19 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:25:21.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:20 smithi134 ceph-mon[22511]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:25:21.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:20 smithi077 ceph-mon[22251]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:25:21.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:20 smithi022 ceph-mon[18709]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-20T01:25:22.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:21 smithi134 ceph-mon[22511]: osdmap e31: 5 total, 5 up, 5 in 2024-08-20T01:25:22.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:21 smithi134 ceph-mon[22511]: from='client.? 172.21.15.134:0/370284846' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "971cac33-0b98-49b1-b4b2-27354fc0ab90"} : dispatch 2024-08-20T01:25:22.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:21 smithi134 ceph-mon[22511]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "971cac33-0b98-49b1-b4b2-27354fc0ab90"} : dispatch 2024-08-20T01:25:22.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:21 smithi134 ceph-mon[22511]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "971cac33-0b98-49b1-b4b2-27354fc0ab90"}]': finished 2024-08-20T01:25:22.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:21 smithi134 ceph-mon[22511]: osdmap e32: 6 total, 5 up, 6 in 2024-08-20T01:25:22.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:21 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:25:22.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:21 smithi134 ceph-mon[22511]: from='client.? 172.21.15.134:0/2680875968' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:25:22.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:21 smithi077 ceph-mon[22251]: osdmap e31: 5 total, 5 up, 5 in 2024-08-20T01:25:22.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:21 smithi077 ceph-mon[22251]: from='client.? 172.21.15.134:0/370284846' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "971cac33-0b98-49b1-b4b2-27354fc0ab90"} : dispatch 2024-08-20T01:25:22.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:21 smithi077 ceph-mon[22251]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "971cac33-0b98-49b1-b4b2-27354fc0ab90"} : dispatch 2024-08-20T01:25:22.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:21 smithi077 ceph-mon[22251]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "971cac33-0b98-49b1-b4b2-27354fc0ab90"}]': finished 2024-08-20T01:25:22.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:21 smithi077 ceph-mon[22251]: osdmap e32: 6 total, 5 up, 6 in 2024-08-20T01:25:22.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:21 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:25:22.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:21 smithi077 ceph-mon[22251]: from='client.? 172.21.15.134:0/2680875968' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:25:22.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:21 smithi022 ceph-mon[18709]: osdmap e31: 5 total, 5 up, 5 in 2024-08-20T01:25:22.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:21 smithi022 ceph-mon[18709]: from='client.? 172.21.15.134:0/370284846' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "971cac33-0b98-49b1-b4b2-27354fc0ab90"} : dispatch 2024-08-20T01:25:22.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:21 smithi022 ceph-mon[18709]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "971cac33-0b98-49b1-b4b2-27354fc0ab90"} : dispatch 2024-08-20T01:25:22.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:21 smithi022 ceph-mon[18709]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "971cac33-0b98-49b1-b4b2-27354fc0ab90"}]': finished 2024-08-20T01:25:22.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:21 smithi022 ceph-mon[18709]: osdmap e32: 6 total, 5 up, 6 in 2024-08-20T01:25:22.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:21 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:25:22.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:21 smithi022 ceph-mon[18709]: from='client.? 172.21.15.134:0/2680875968' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:25:23.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:22 smithi134 ceph-mon[22511]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:23.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:22 smithi077 ceph-mon[22251]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:23.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:22 smithi022 ceph-mon[18709]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:25.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:24 smithi134 ceph-mon[22511]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:25.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:24 smithi077 ceph-mon[22251]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:25.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:24 smithi022 ceph-mon[18709]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:27.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:26 smithi134 ceph-mon[22511]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:27.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:26 smithi077 ceph-mon[22251]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:27.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:26 smithi022 ceph-mon[18709]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:29.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:28 smithi134 ceph-mon[22511]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:29.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:28 smithi077 ceph-mon[22251]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:29.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:28 smithi022 ceph-mon[18709]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:30.086 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:29 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-20T01:25:30.086 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:29 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:30.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:29 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-20T01:25:30.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:29 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:30.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:29 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-20T01:25:30.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:29 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:31.229 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:30 smithi134 ceph-mon[22511]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:31.229 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:30 smithi134 ceph-mon[22511]: Deploying daemon osd.5 on smithi134 2024-08-20T01:25:31.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:30 smithi077 ceph-mon[22251]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:31.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:30 smithi077 ceph-mon[22251]: Deploying daemon osd.5 on smithi134 2024-08-20T01:25:31.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:30 smithi022 ceph-mon[18709]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:31.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:30 smithi022 ceph-mon[18709]: Deploying daemon osd.5 on smithi134 2024-08-20T01:25:33.152 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:32 smithi134 ceph-mon[22511]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:33.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:32 smithi077 ceph-mon[22251]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:33.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:32 smithi022 ceph-mon[18709]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:35.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:34 smithi134 ceph-mon[22511]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:35.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:25:35.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:35.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:35.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:34 smithi077 ceph-mon[22251]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:35.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:25:35.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:35.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:35.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:34 smithi022 ceph-mon[18709]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:35.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:25:35.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:35.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:37.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:36 smithi134 ceph-mon[22511]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:37.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:36 smithi077 ceph-mon[22251]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:37.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:36 smithi022 ceph-mon[18709]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:39.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:38 smithi134 ceph-mon[22511]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:39.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:38 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:39.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:38 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:39.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:38 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:39.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:38 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:25:39.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:38 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:39.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:38 smithi077 ceph-mon[22251]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:39.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:38 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:39.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:38 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:39.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:38 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:39.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:38 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:25:39.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:38 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:39.094 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 5 on host 'smithi134' 2024-08-20T01:25:39.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:39.093+0000 7f4f5cff9640 1 -- 172.21.15.134:0/3461469042 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4f601042e0 con 0x7f4f480b3bd0 2024-08-20T01:25:39.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:39.095+0000 7f4f66101640 1 -- 172.21.15.134:0/3461469042 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4f480b3bd0 msgr2=0x7f4f480b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:25:39.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:39.095+0000 7f4f66101640 1 --2- 172.21.15.134:0/3461469042 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4f480b3bd0 0x7f4f480b6090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4f50009fc0 tx=0x7f4f50005f90 comp rx=0 tx=0).stop 2024-08-20T01:25:39.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:39.095+0000 7f4f66101640 1 -- 172.21.15.134:0/3461469042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f601027c0 msgr2=0x7f4f6010a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:25:39.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:39.095+0000 7f4f66101640 1 --2- 172.21.15.134:0/3461469042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f601027c0 0x7f4f6010a750 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4f54006010 tx=0x7f4f54004270 comp rx=0 tx=0).stop 2024-08-20T01:25:39.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:39.095+0000 7f4f66101640 1 -- 172.21.15.134:0/3461469042 shutdown_connections 2024-08-20T01:25:39.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:39.095+0000 7f4f66101640 1 --2- 172.21.15.134:0/3461469042 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4f480b3bd0 0x7f4f480b6090 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:25:39.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:39.095+0000 7f4f66101640 1 --2- 172.21.15.134:0/3461469042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f60103180 0x7f4f6010ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:25:39.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:39.095+0000 7f4f66101640 1 --2- 172.21.15.134:0/3461469042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f601027c0 0x7f4f6010a750 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:25:39.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:39.095+0000 7f4f66101640 1 --2- 172.21.15.134:0/3461469042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f60101660 0x7f4f6010bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:25:39.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:39.095+0000 7f4f66101640 1 -- 172.21.15.134:0/3461469042 >> 172.21.15.134:0/3461469042 conn(0x7f4f600fcf30 msgr2=0x7f4f60103bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:25:39.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:39.096+0000 7f4f66101640 1 -- 172.21.15.134:0/3461469042 shutdown_connections 2024-08-20T01:25:39.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:25:39.096+0000 7f4f66101640 1 -- 172.21.15.134:0/3461469042 wait complete. 2024-08-20T01:25:39.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:38 smithi022 ceph-mon[18709]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:39.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:38 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:39.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:38 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:39.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:38 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:39.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:38 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:25:39.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:38 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:39.764 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:39 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:25:39.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:39 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:39.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:39 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:39.845 DEBUG:teuthology.orchestra.run.smithi134:osd.5> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.5.service 2024-08-20T01:25:39.847 INFO:tasks.cephadm:Deploying osd.6 on smithi022 with /dev/vg_nvme/lv_2... 2024-08-20T01:25:39.847 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-20T01:25:40.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:39 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:25:40.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:39 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:40.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:39 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:40.115 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:25:40.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:39 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:25:40.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:39 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:40.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:39 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:40.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:40 smithi022 ceph-mon[18709]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:40.974 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:40 smithi134 ceph-mon[22511]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:41.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:40 smithi077 ceph-mon[22251]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:41.260 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:25:41 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:25:41.079+0000 7f0c5f255640 -1 osd.5 0 log_to_monitors true 2024-08-20T01:25:41.794 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:41 smithi022 ceph-mon[18709]: from='osd.5 [v2:172.21.15.134:6808/2805488123,v1:172.21.15.134:6809/2805488123]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-20T01:25:41.794 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:41 smithi022 ceph-mon[18709]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-20T01:25:42.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:41 smithi134 ceph-mon[22511]: from='osd.5 [v2:172.21.15.134:6808/2805488123,v1:172.21.15.134:6809/2805488123]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-20T01:25:42.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:41 smithi134 ceph-mon[22511]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-20T01:25:42.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:41 smithi077 ceph-mon[22251]: from='osd.5 [v2:172.21.15.134:6808/2805488123,v1:172.21.15.134:6809/2805488123]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-20T01:25:42.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:41 smithi077 ceph-mon[22251]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-20T01:25:42.864 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:25:42.891 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_2 2024-08-20T01:25:42.966 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:25:42 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:25:42.714+0000 7f0c5b1d8640 -1 osd.5 0 waiting for initial osdmap 2024-08-20T01:25:42.967 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:25:42 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:25:42.719+0000 7f0c56fff640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:25:42.967 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:42 smithi134 ceph-mon[22511]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:42.967 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:42 smithi134 ceph-mon[22511]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-20T01:25:42.967 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:42 smithi134 ceph-mon[22511]: osdmap e33: 6 total, 5 up, 6 in 2024-08-20T01:25:42.967 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:42 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:25:42.967 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:42 smithi134 ceph-mon[22511]: from='osd.5 [v2:172.21.15.134:6808/2805488123,v1:172.21.15.134:6809/2805488123]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:25:42.967 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:42 smithi134 ceph-mon[22511]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:25:43.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:42 smithi077 ceph-mon[22251]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:43.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:42 smithi077 ceph-mon[22251]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-20T01:25:43.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:42 smithi077 ceph-mon[22251]: osdmap e33: 6 total, 5 up, 6 in 2024-08-20T01:25:43.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:42 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:25:43.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:42 smithi077 ceph-mon[22251]: from='osd.5 [v2:172.21.15.134:6808/2805488123,v1:172.21.15.134:6809/2805488123]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:25:43.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:42 smithi077 ceph-mon[22251]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:25:43.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:42 smithi022 ceph-mon[18709]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:43.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:42 smithi022 ceph-mon[18709]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-20T01:25:43.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:42 smithi022 ceph-mon[18709]: osdmap e33: 6 total, 5 up, 6 in 2024-08-20T01:25:43.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:42 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:25:43.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:42 smithi022 ceph-mon[18709]: from='osd.5 [v2:172.21.15.134:6808/2805488123,v1:172.21.15.134:6809/2805488123]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:25:43.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:42 smithi022 ceph-mon[18709]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:25:43.154 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:25:43.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.719+0000 7f9d547f5640 1 -- 172.21.15.22:0/3595844621 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d4c102740 msgr2=0x7f9d4c102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:25:43.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.719+0000 7f9d547f5640 1 --2- 172.21.15.22:0/3595844621 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d4c102740 0x7f9d4c102b40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009930 tx=0x7f9d4802a420 comp rx=0 tx=0).stop 2024-08-20T01:25:43.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.720+0000 7f9d547f5640 1 -- 172.21.15.22:0/3595844621 shutdown_connections 2024-08-20T01:25:43.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.720+0000 7f9d547f5640 1 --2- 172.21.15.22:0/3595844621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d4c104260 0x7f9d4c10abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:25:43.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.720+0000 7f9d547f5640 1 --2- 172.21.15.22:0/3595844621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d4c1038a0 0x7f9d4c103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:25:43.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.720+0000 7f9d547f5640 1 --2- 172.21.15.22:0/3595844621 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d4c102740 0x7f9d4c102b40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:25:43.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.720+0000 7f9d547f5640 1 -- 172.21.15.22:0/3595844621 >> 172.21.15.22:0/3595844621 conn(0x7f9d4c0fe050 msgr2=0x7f9d4c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:25:43.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.720+0000 7f9d547f5640 1 -- 172.21.15.22:0/3595844621 shutdown_connections 2024-08-20T01:25:43.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.720+0000 7f9d547f5640 1 -- 172.21.15.22:0/3595844621 wait complete. 2024-08-20T01:25:43.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.720+0000 7f9d547f5640 1 Processor -- start 2024-08-20T01:25:43.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.720+0000 7f9d547f5640 1 -- start start 2024-08-20T01:25:43.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.720+0000 7f9d547f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d4c102740 0x7f9d4c198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:25:43.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.720+0000 7f9d547f5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d4c1038a0 0x7f9d4c1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:25:43.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.720+0000 7f9d547f5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d4c104260 0x7f9d4c199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:25:43.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.720+0000 7f9d547f5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c10e410 con 0x7f9d4c104260 2024-08-20T01:25:43.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.720+0000 7f9d547f5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c10e290 con 0x7f9d4c1038a0 2024-08-20T01:25:43.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.720+0000 7f9d547f5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c10e590 con 0x7f9d4c102740 2024-08-20T01:25:43.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.721+0000 7f9d52d92640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d4c104260 0x7f9d4c199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:25:43.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.721+0000 7f9d52591640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d4c102740 0x7f9d4c198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:25:43.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.721+0000 7f9d52d92640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d4c104260 0x7f9d4c199df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36204/0 (socket says 172.21.15.22:36204) 2024-08-20T01:25:43.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.721+0000 7f9d52d92640 1 -- 172.21.15.22:0/1842388331 learned_addr learned my addr 172.21.15.22:0/1842388331 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:25:43.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.721+0000 7f9d51d90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d4c1038a0 0x7f9d4c1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:25:43.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.721+0000 7f9d52d92640 1 -- 172.21.15.22:0/1842388331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d4c102740 msgr2=0x7f9d4c198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:25:43.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.721+0000 7f9d52d92640 1 --2- 172.21.15.22:0/1842388331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d4c102740 0x7f9d4c198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:25:43.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.721+0000 7f9d52d92640 1 -- 172.21.15.22:0/1842388331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d4c1038a0 msgr2=0x7f9d4c1991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:25:43.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.721+0000 7f9d52d92640 1 --2- 172.21.15.22:0/1842388331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d4c1038a0 0x7f9d4c1991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:25:43.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.721+0000 7f9d52d92640 1 -- 172.21.15.22:0/1842388331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d4c19a690 con 0x7f9d4c104260 2024-08-20T01:25:43.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.721+0000 7f9d52591640 1 --2- 172.21.15.22:0/1842388331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d4c102740 0x7f9d4c198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:25:43.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.721+0000 7f9d52d92640 1 --2- 172.21.15.22:0/1842388331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d4c104260 0x7f9d4c199df0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400eaa0 tx=0x7f9d4400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:25:43.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.721+0000 7f9d437fe640 1 -- 172.21.15.22:0/1842388331 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400cdb0 con 0x7f9d4c104260 2024-08-20T01:25:43.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.721+0000 7f9d437fe640 1 -- 172.21.15.22:0/1842388331 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d44005020 con 0x7f9d4c104260 2024-08-20T01:25:43.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.721+0000 7f9d547f5640 1 -- 172.21.15.22:0/1842388331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d4c19a980 con 0x7f9d4c104260 2024-08-20T01:25:43.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.721+0000 7f9d437fe640 1 -- 172.21.15.22:0/1842388331 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d440116d0 con 0x7f9d4c104260 2024-08-20T01:25:43.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.721+0000 7f9d547f5640 1 -- 172.21.15.22:0/1842388331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d4c1a1060 con 0x7f9d4c104260 2024-08-20T01:25:43.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.722+0000 7f9d547f5640 1 -- 172.21.15.22:0/1842388331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d4c102b40 con 0x7f9d4c104260 2024-08-20T01:25:43.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.724+0000 7f9d437fe640 1 -- 172.21.15.22:0/1842388331 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f9d440051d0 con 0x7f9d4c104260 2024-08-20T01:25:43.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.724+0000 7f9d437fe640 1 --2- 172.21.15.22:0/1842388331 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9d380b3bd0 0x7f9d380b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:25:43.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.724+0000 7f9d52591640 1 --2- 172.21.15.22:0/1842388331 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9d380b3bd0 0x7f9d380b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:25:43.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.725+0000 7f9d437fe640 1 -- 172.21.15.22:0/1842388331 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4566+0+0 (secure 0 0 0) 0x7f9d440e2e60 con 0x7f9d4c104260 2024-08-20T01:25:43.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.725+0000 7f9d52591640 1 --2- 172.21.15.22:0/1842388331 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9d380b3bd0 0x7f9d380b6090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9d48005ab0 tx=0x7f9d48005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:25:43.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.729+0000 7f9d437fe640 1 -- 172.21.15.22:0/1842388331 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f9d44016030 con 0x7f9d4c104260 2024-08-20T01:25:43.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:43 smithi022 ceph-mon[18709]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-08-20T01:25:43.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:43 smithi022 ceph-mon[18709]: osdmap e34: 6 total, 5 up, 6 in 2024-08-20T01:25:43.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:43 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:25:43.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:43 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:25:43.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:43 smithi022 ceph-mon[18709]: Detected new or changed devices on smithi134 2024-08-20T01:25:43.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:43 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:43.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:43 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:43.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:43 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:25:43.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:43 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:25:43.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:43 smithi022 ceph-mon[18709]: Adjusting osd_memory_target on smithi134 to 8544M 2024-08-20T01:25:43.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:43 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:43.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:43 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:43.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:43 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:25:43.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:43 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:43.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:25:43.923+0000 7f9d547f5640 1 -- 172.21.15.22:0/1842388331 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9d4c0632c0 con 0x7f9d380b3bd0 2024-08-20T01:25:44.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:43 smithi134 ceph-mon[22511]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-08-20T01:25:44.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:43 smithi134 ceph-mon[22511]: osdmap e34: 6 total, 5 up, 6 in 2024-08-20T01:25:44.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:43 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:25:44.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:43 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:25:44.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:43 smithi134 ceph-mon[22511]: Detected new or changed devices on smithi134 2024-08-20T01:25:44.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:43 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:44.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:43 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:44.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:43 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:25:44.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:43 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:25:44.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:43 smithi134 ceph-mon[22511]: Adjusting osd_memory_target on smithi134 to 8544M 2024-08-20T01:25:44.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:43 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:44.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:43 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:44.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:43 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:25:44.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:43 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:44.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:43 smithi077 ceph-mon[22251]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-08-20T01:25:44.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:43 smithi077 ceph-mon[22251]: osdmap e34: 6 total, 5 up, 6 in 2024-08-20T01:25:44.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:43 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:25:44.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:43 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:25:44.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:43 smithi077 ceph-mon[22251]: Detected new or changed devices on smithi134 2024-08-20T01:25:44.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:43 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:44.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:43 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:44.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:43 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:25:44.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:43 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:25:44.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:43 smithi077 ceph-mon[22251]: Adjusting osd_memory_target on smithi134 to 8544M 2024-08-20T01:25:44.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:43 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:44.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:43 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:44.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:43 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:25:44.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:43 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:25:44.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:44 smithi022 ceph-mon[18709]: purged_snaps scrub starts 2024-08-20T01:25:44.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:44 smithi022 ceph-mon[18709]: purged_snaps scrub ok 2024-08-20T01:25:44.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:44 smithi022 ceph-mon[18709]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:44.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:44 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:25:44.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:44 smithi022 ceph-mon[18709]: osd.5 [v2:172.21.15.134:6808/2805488123,v1:172.21.15.134:6809/2805488123] boot 2024-08-20T01:25:44.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:44 smithi022 ceph-mon[18709]: osdmap e35: 6 total, 6 up, 6 in 2024-08-20T01:25:44.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:44 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:25:44.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:44 smithi022 ceph-mon[18709]: from='client.14496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:25:44.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:44 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:25:44.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:44 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:25:44.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:44 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:45.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:44 smithi134 ceph-mon[22511]: purged_snaps scrub starts 2024-08-20T01:25:45.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:44 smithi134 ceph-mon[22511]: purged_snaps scrub ok 2024-08-20T01:25:45.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:44 smithi134 ceph-mon[22511]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:45.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:44 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:25:45.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:44 smithi134 ceph-mon[22511]: osd.5 [v2:172.21.15.134:6808/2805488123,v1:172.21.15.134:6809/2805488123] boot 2024-08-20T01:25:45.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:44 smithi134 ceph-mon[22511]: osdmap e35: 6 total, 6 up, 6 in 2024-08-20T01:25:45.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:44 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:25:45.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:44 smithi134 ceph-mon[22511]: from='client.14496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:25:45.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:44 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:25:45.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:44 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:25:45.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:44 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:45.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:44 smithi077 ceph-mon[22251]: purged_snaps scrub starts 2024-08-20T01:25:45.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:44 smithi077 ceph-mon[22251]: purged_snaps scrub ok 2024-08-20T01:25:45.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:44 smithi077 ceph-mon[22251]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:25:45.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:44 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:25:45.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:44 smithi077 ceph-mon[22251]: osd.5 [v2:172.21.15.134:6808/2805488123,v1:172.21.15.134:6809/2805488123] boot 2024-08-20T01:25:45.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:44 smithi077 ceph-mon[22251]: osdmap e35: 6 total, 6 up, 6 in 2024-08-20T01:25:45.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:44 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:25:45.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:44 smithi077 ceph-mon[22251]: from='client.14496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:25:45.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:44 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:25:45.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:44 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:25:45.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:44 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:45.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:45 smithi022 ceph-mon[18709]: osdmap e36: 6 total, 6 up, 6 in 2024-08-20T01:25:46.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:45 smithi134 ceph-mon[22511]: osdmap e36: 6 total, 6 up, 6 in 2024-08-20T01:25:46.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:45 smithi077 ceph-mon[22251]: osdmap e36: 6 total, 6 up, 6 in 2024-08-20T01:25:47.013 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:46 smithi022 ceph-mon[18709]: pgmap v142: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:25:47.014 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:46 smithi022 ceph-mon[18709]: osdmap e37: 6 total, 6 up, 6 in 2024-08-20T01:25:47.014 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:46 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/598299989' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "48d90292-8511-47d6-8093-330bd13ae70e"} : dispatch 2024-08-20T01:25:47.014 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:46 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/598299989' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "48d90292-8511-47d6-8093-330bd13ae70e"}]': finished 2024-08-20T01:25:47.014 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:46 smithi022 ceph-mon[18709]: osdmap e38: 7 total, 6 up, 7 in 2024-08-20T01:25:47.014 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:46 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:25:47.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:46 smithi134 ceph-mon[22511]: pgmap v142: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:25:47.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:46 smithi134 ceph-mon[22511]: osdmap e37: 6 total, 6 up, 6 in 2024-08-20T01:25:47.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:46 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/598299989' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "48d90292-8511-47d6-8093-330bd13ae70e"} : dispatch 2024-08-20T01:25:47.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:46 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/598299989' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "48d90292-8511-47d6-8093-330bd13ae70e"}]': finished 2024-08-20T01:25:47.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:46 smithi134 ceph-mon[22511]: osdmap e38: 7 total, 6 up, 7 in 2024-08-20T01:25:47.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:46 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:25:47.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:46 smithi077 ceph-mon[22251]: pgmap v142: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:25:47.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:46 smithi077 ceph-mon[22251]: osdmap e37: 6 total, 6 up, 6 in 2024-08-20T01:25:47.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:46 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/598299989' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "48d90292-8511-47d6-8093-330bd13ae70e"} : dispatch 2024-08-20T01:25:47.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:46 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/598299989' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "48d90292-8511-47d6-8093-330bd13ae70e"}]': finished 2024-08-20T01:25:47.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:46 smithi077 ceph-mon[22251]: osdmap e38: 7 total, 6 up, 7 in 2024-08-20T01:25:47.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:46 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:25:48.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:47 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1723466560' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:25:48.025 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:47 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1723466560' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:25:48.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:47 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1723466560' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:25:49.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:48 smithi134 ceph-mon[22511]: pgmap v145: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:25:49.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:48 smithi077 ceph-mon[22251]: pgmap v145: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:25:49.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:48 smithi022 ceph-mon[18709]: pgmap v145: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:25:51.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:50 smithi134 ceph-mon[22511]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-08-20T01:25:51.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:50 smithi077 ceph-mon[22251]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-08-20T01:25:51.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:50 smithi022 ceph-mon[18709]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-08-20T01:25:53.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:52 smithi134 ceph-mon[22511]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-08-20T01:25:53.028 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:52 smithi022 ceph-mon[18709]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-08-20T01:25:53.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:52 smithi077 ceph-mon[22251]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-08-20T01:25:54.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:54 smithi022 ceph-mon[18709]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:25:55.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:54 smithi134 ceph-mon[22511]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:25:55.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:54 smithi077 ceph-mon[22251]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:25:56.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:55 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-20T01:25:56.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:55 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:56.038 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:55 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-20T01:25:56.038 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:55 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:56.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:55 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-20T01:25:56.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:55 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:25:56.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:56 smithi022 ceph-mon[18709]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-08-20T01:25:56.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:56 smithi022 ceph-mon[18709]: Deploying daemon osd.6 on smithi022 2024-08-20T01:25:57.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:56 smithi134 ceph-mon[22511]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-08-20T01:25:57.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:56 smithi134 ceph-mon[22511]: Deploying daemon osd.6 on smithi022 2024-08-20T01:25:57.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:56 smithi077 ceph-mon[22251]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-08-20T01:25:57.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:56 smithi077 ceph-mon[22251]: Deploying daemon osd.6 on smithi022 2024-08-20T01:25:59.008 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:25:58 smithi022 ceph-mon[18709]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-08-20T01:25:59.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:25:58 smithi134 ceph-mon[22511]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-08-20T01:25:59.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:25:58 smithi077 ceph-mon[22251]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-08-20T01:26:01.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:00 smithi134 ceph-mon[22511]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:26:01.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:26:01.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:00 smithi077 ceph-mon[22251]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:26:01.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:26:01.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:00 smithi022 ceph-mon[18709]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:26:01.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:26:01.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:01 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:01.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:01 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:02.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:01 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:02.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:01 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:02.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:01 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:02.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:01 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:02.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:02 smithi022 ceph-mon[18709]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:26:03.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:02 smithi134 ceph-mon[22511]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:26:03.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:02 smithi077 ceph-mon[22251]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:26:04.771 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 6 on host 'smithi022' 2024-08-20T01:26:04.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:04.771+0000 7f9d437fe640 1 -- 172.21.15.22:0/1842388331 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9d4c0632c0 con 0x7f9d380b3bd0 2024-08-20T01:26:04.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:04.773+0000 7f9d547f5640 1 -- 172.21.15.22:0/1842388331 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9d380b3bd0 msgr2=0x7f9d380b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:26:04.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:04.773+0000 7f9d547f5640 1 --2- 172.21.15.22:0/1842388331 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9d380b3bd0 0x7f9d380b6090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9d48005ab0 tx=0x7f9d48005a20 comp rx=0 tx=0).stop 2024-08-20T01:26:04.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:04.773+0000 7f9d547f5640 1 -- 172.21.15.22:0/1842388331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d4c104260 msgr2=0x7f9d4c199df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:26:04.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:04.773+0000 7f9d547f5640 1 --2- 172.21.15.22:0/1842388331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d4c104260 0x7f9d4c199df0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400eaa0 tx=0x7f9d4400ef60 comp rx=0 tx=0).stop 2024-08-20T01:26:04.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:04.773+0000 7f9d547f5640 1 -- 172.21.15.22:0/1842388331 shutdown_connections 2024-08-20T01:26:04.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:04.773+0000 7f9d547f5640 1 --2- 172.21.15.22:0/1842388331 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9d380b3bd0 0x7f9d380b6090 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:04.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:04.773+0000 7f9d547f5640 1 --2- 172.21.15.22:0/1842388331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d4c104260 0x7f9d4c199df0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:04.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:04.773+0000 7f9d547f5640 1 --2- 172.21.15.22:0/1842388331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d4c1038a0 0x7f9d4c1991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:04.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:04.773+0000 7f9d547f5640 1 --2- 172.21.15.22:0/1842388331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d4c102740 0x7f9d4c198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:04.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:04.773+0000 7f9d547f5640 1 -- 172.21.15.22:0/1842388331 >> 172.21.15.22:0/1842388331 conn(0x7f9d4c0fe050 msgr2=0x7f9d4c106c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:26:04.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:04.774+0000 7f9d547f5640 1 -- 172.21.15.22:0/1842388331 shutdown_connections 2024-08-20T01:26:04.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:04.774+0000 7f9d547f5640 1 -- 172.21.15.22:0/1842388331 wait complete. 2024-08-20T01:26:04.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:04 smithi022 ceph-mon[18709]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:26:04.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:04 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:04.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:04 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:04.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:04 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:04.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:04 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:26:04.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:04 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:05.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:04 smithi134 ceph-mon[22511]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:26:05.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:04 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:05.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:04 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:05.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:04 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:05.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:04 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:26:05.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:04 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:05.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:04 smithi077 ceph-mon[22251]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:26:05.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:04 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:05.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:04 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:05.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:04 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:05.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:04 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:26:05.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:04 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:05.445 DEBUG:teuthology.orchestra.run.smithi022:osd.6> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.6.service 2024-08-20T01:26:05.448 INFO:tasks.cephadm:Deploying osd.7 on smithi077 with /dev/vg_nvme/lv_2... 2024-08-20T01:26:05.448 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-20T01:26:05.703 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:26:05.749 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:05 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:26:05.749 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:05 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:05.749 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:05 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:05.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:05 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:26:05.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:05 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:05.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:05 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:06.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:05 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:26:06.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:05 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:06.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:05 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:06.882 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:06 smithi022 ceph-mon[18709]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:26:06.882 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:26:06 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:26:06.841+0000 7f7cc5ef6640 -1 osd.6 0 log_to_monitors true 2024-08-20T01:26:07.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:06 smithi077 ceph-mon[22251]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:26:07.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:06 smithi134 ceph-mon[22511]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:26:07.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:07 smithi022 ceph-mon[18709]: from='osd.6 [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-20T01:26:08.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:07 smithi077 ceph-mon[22251]: from='osd.6 [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-20T01:26:08.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:07 smithi134 ceph-mon[22511]: from='osd.6 [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-20T01:26:08.443 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-08-20T01:26:08.471 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_2 2024-08-20T01:26:08.727 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:26:09.013 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:08 smithi077 ceph-mon[22251]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:26:09.013 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:08 smithi077 ceph-mon[22251]: from='osd.6 [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-20T01:26:09.013 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:08 smithi077 ceph-mon[22251]: osdmap e39: 7 total, 6 up, 7 in 2024-08-20T01:26:09.013 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:08 smithi077 ceph-mon[22251]: from='osd.6 [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-08-20T01:26:09.013 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:08 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:26:09.013 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:08 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:09.013 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:08 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:09.013 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:08 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:09.013 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:08 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:09.013 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:08 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:09.013 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:08 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:09.014 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:08 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:09.014 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:08 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:26:09.014 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:08 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:09.135 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:26:08 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:26:08.784+0000 7f7cc1e79640 -1 osd.6 0 waiting for initial osdmap 2024-08-20T01:26:09.135 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:26:08 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:26:08.792+0000 7f7cbdca0640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:26:09.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:08 smithi022 ceph-mon[18709]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:26:09.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:08 smithi022 ceph-mon[18709]: from='osd.6 [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-20T01:26:09.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:08 smithi022 ceph-mon[18709]: osdmap e39: 7 total, 6 up, 7 in 2024-08-20T01:26:09.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:08 smithi022 ceph-mon[18709]: from='osd.6 [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-08-20T01:26:09.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:08 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:26:09.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:08 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:09.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:08 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:09.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:08 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:09.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:08 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:09.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:08 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:09.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:08 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:09.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:08 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:09.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:08 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:26:09.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:08 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:09.166 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:08 smithi134 ceph-mon[22511]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:26:09.166 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:08 smithi134 ceph-mon[22511]: from='osd.6 [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-20T01:26:09.166 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:08 smithi134 ceph-mon[22511]: osdmap e39: 7 total, 6 up, 7 in 2024-08-20T01:26:09.166 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:08 smithi134 ceph-mon[22511]: from='osd.6 [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-08-20T01:26:09.167 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:08 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:26:09.167 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:08 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:09.167 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:08 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:09.167 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:08 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:09.167 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:08 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:09.167 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:08 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:09.167 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:08 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:09.167 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:08 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:09.167 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:08 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:26:09.167 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:08 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:09.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.237+0000 7f4fc327c640 1 -- 172.21.15.77:0/1862410376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fbc06b340 msgr2=0x7f4fbc105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:26:09.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.237+0000 7f4fc327c640 1 --2- 172.21.15.77:0/1862410376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fbc06b340 0x7f4fbc105390 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009900 tx=0x7f4fb802a410 comp rx=0 tx=0).stop 2024-08-20T01:26:09.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.237+0000 7f4fc327c640 1 -- 172.21.15.77:0/1862410376 shutdown_connections 2024-08-20T01:26:09.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.237+0000 7f4fc327c640 1 --2- 172.21.15.77:0/1862410376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc108420 0x7f4fbc10a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:09.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.237+0000 7f4fc327c640 1 --2- 172.21.15.77:0/1862410376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fbc1058d0 0x7f4fbc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:09.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.237+0000 7f4fc327c640 1 --2- 172.21.15.77:0/1862410376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fbc06b340 0x7f4fbc105390 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:09.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.237+0000 7f4fc327c640 1 -- 172.21.15.77:0/1862410376 >> 172.21.15.77:0/1862410376 conn(0x7f4fbc0fcee0 msgr2=0x7f4fbc0ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:26:09.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.237+0000 7f4fc327c640 1 -- 172.21.15.77:0/1862410376 shutdown_connections 2024-08-20T01:26:09.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.237+0000 7f4fc327c640 1 -- 172.21.15.77:0/1862410376 wait complete. 2024-08-20T01:26:09.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.238+0000 7f4fc327c640 1 Processor -- start 2024-08-20T01:26:09.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.238+0000 7f4fc327c640 1 -- start start 2024-08-20T01:26:09.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.238+0000 7f4fc327c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc06b340 0x7f4fbc102ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:26:09.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.238+0000 7f4fc327c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fbc1058d0 0x7f4fbc101330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:26:09.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.238+0000 7f4fc327c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fbc108420 0x7f4fbc101870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:26:09.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.238+0000 7f4fc327c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4fbc10e370 con 0x7f4fbc1058d0 2024-08-20T01:26:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.238+0000 7f4fc327c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4fbc10e1f0 con 0x7f4fbc108420 2024-08-20T01:26:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.238+0000 7f4fc327c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4fbc10e4f0 con 0x7f4fbc06b340 2024-08-20T01:26:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.238+0000 7f4fc1819640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fbc108420 0x7f4fbc101870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:26:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.238+0000 7f4fc1819640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fbc108420 0x7f4fbc101870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52420/0 (socket says 172.21.15.77:52420) 2024-08-20T01:26:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.238+0000 7f4fc1819640 1 -- 172.21.15.77:0/1943890258 learned_addr learned my addr 172.21.15.77:0/1943890258 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-08-20T01:26:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.238+0000 7f4fc1018640 1 --2- 172.21.15.77:0/1943890258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc06b340 0x7f4fbc102ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:26:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.238+0000 7f4fc0817640 1 --2- 172.21.15.77:0/1943890258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fbc1058d0 0x7f4fbc101330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:26:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.238+0000 7f4fc1819640 1 -- 172.21.15.77:0/1943890258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc06b340 msgr2=0x7f4fbc102ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:26:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.238+0000 7f4fc1819640 1 --2- 172.21.15.77:0/1943890258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc06b340 0x7f4fbc102ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.238+0000 7f4fc1819640 1 -- 172.21.15.77:0/1943890258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fbc1058d0 msgr2=0x7f4fbc101330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:26:09.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.238+0000 7f4fc1819640 1 --2- 172.21.15.77:0/1943890258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fbc1058d0 0x7f4fbc101330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:09.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.239+0000 7f4fc1819640 1 -- 172.21.15.77:0/1943890258 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fbc102130 con 0x7f4fbc108420 2024-08-20T01:26:09.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.239+0000 7f4fc1819640 1 --2- 172.21.15.77:0/1943890258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fbc108420 0x7f4fbc101870 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400eaa0 tx=0x7f4fb400ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:26:09.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.239+0000 7f4fb27fc640 1 -- 172.21.15.77:0/1943890258 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb400cdb0 con 0x7f4fbc108420 2024-08-20T01:26:09.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.239+0000 7f4fb27fc640 1 -- 172.21.15.77:0/1943890258 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fb4005020 con 0x7f4fbc108420 2024-08-20T01:26:09.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.239+0000 7f4fc327c640 1 -- 172.21.15.77:0/1943890258 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fbc1a2b60 con 0x7f4fbc108420 2024-08-20T01:26:09.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.239+0000 7f4fb27fc640 1 -- 172.21.15.77:0/1943890258 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40116d0 con 0x7f4fbc108420 2024-08-20T01:26:09.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.239+0000 7f4fc327c640 1 -- 172.21.15.77:0/1943890258 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fbc1a3070 con 0x7f4fbc108420 2024-08-20T01:26:09.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.240+0000 7f4fc327c640 1 -- 172.21.15.77:0/1943890258 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fbc0fe9d0 con 0x7f4fbc108420 2024-08-20T01:26:09.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.242+0000 7f4fb27fc640 1 -- 172.21.15.77:0/1943890258 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f4fb40051d0 con 0x7f4fbc108420 2024-08-20T01:26:09.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.243+0000 7f4fb27fc640 1 --2- 172.21.15.77:0/1943890258 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4fa80b3bd0 0x7f4fa80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:26:09.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.243+0000 7f4fb27fc640 1 -- 172.21.15.77:0/1943890258 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4685+0+0 (secure 0 0 0) 0x7f4fb40e32a0 con 0x7f4fbc108420 2024-08-20T01:26:09.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.244+0000 7f4fc1018640 1 --2- 172.21.15.77:0/1943890258 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4fa80b3bd0 0x7f4fa80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:26:09.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.244+0000 7f4fc1018640 1 --2- 172.21.15.77:0/1943890258 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4fa80b3bd0 0x7f4fa80b6090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8000c00 tx=0x7f4fb80314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:26:09.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.245+0000 7f4fb27fc640 1 -- 172.21.15.77:0/1943890258 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f4fb4016030 con 0x7f4fbc108420 2024-08-20T01:26:09.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:09.437+0000 7f4fc327c640 1 -- 172.21.15.77:0/1943890258 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f4fbc0632c0 con 0x7f4fa80b3bd0 2024-08-20T01:26:09.977 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:09 smithi077 ceph-mon[22251]: Detected new or changed devices on smithi022 2024-08-20T01:26:09.977 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:09 smithi077 ceph-mon[22251]: Adjusting osd_memory_target on smithi022 to 5697M 2024-08-20T01:26:09.977 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:09 smithi077 ceph-mon[22251]: from='osd.6 [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-08-20T01:26:09.977 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:09 smithi077 ceph-mon[22251]: osdmap e40: 7 total, 6 up, 7 in 2024-08-20T01:26:09.977 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:09 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:26:09.977 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:09 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:26:09.977 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:09 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:26:09.977 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:09 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:26:09.977 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:09 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:10.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:09 smithi022 ceph-mon[18709]: Detected new or changed devices on smithi022 2024-08-20T01:26:10.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:09 smithi022 ceph-mon[18709]: Adjusting osd_memory_target on smithi022 to 5697M 2024-08-20T01:26:10.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:09 smithi022 ceph-mon[18709]: from='osd.6 [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-08-20T01:26:10.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:09 smithi022 ceph-mon[18709]: osdmap e40: 7 total, 6 up, 7 in 2024-08-20T01:26:10.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:09 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:26:10.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:09 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:26:10.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:09 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:26:10.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:09 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:26:10.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:09 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:10.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:09 smithi134 ceph-mon[22511]: Detected new or changed devices on smithi022 2024-08-20T01:26:10.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:09 smithi134 ceph-mon[22511]: Adjusting osd_memory_target on smithi022 to 5697M 2024-08-20T01:26:10.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:09 smithi134 ceph-mon[22511]: from='osd.6 [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-08-20T01:26:10.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:09 smithi134 ceph-mon[22511]: osdmap e40: 7 total, 6 up, 7 in 2024-08-20T01:26:10.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:09 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:26:10.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:09 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:26:10.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:09 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:26:10.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:09 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:26:10.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:09 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:10.876 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:10 smithi077 ceph-mon[22251]: purged_snaps scrub starts 2024-08-20T01:26:10.876 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:10 smithi077 ceph-mon[22251]: purged_snaps scrub ok 2024-08-20T01:26:10.876 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:10 smithi077 ceph-mon[22251]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:26:10.876 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:10 smithi077 ceph-mon[22251]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:26:10.876 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:10 smithi077 ceph-mon[22251]: osd.6 [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416] boot 2024-08-20T01:26:10.876 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:10 smithi077 ceph-mon[22251]: osdmap e41: 7 total, 7 up, 7 in 2024-08-20T01:26:10.877 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:10 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:26:11.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:10 smithi022 ceph-mon[18709]: purged_snaps scrub starts 2024-08-20T01:26:11.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:10 smithi022 ceph-mon[18709]: purged_snaps scrub ok 2024-08-20T01:26:11.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:10 smithi022 ceph-mon[18709]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:26:11.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:10 smithi022 ceph-mon[18709]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:26:11.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:10 smithi022 ceph-mon[18709]: osd.6 [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416] boot 2024-08-20T01:26:11.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:10 smithi022 ceph-mon[18709]: osdmap e41: 7 total, 7 up, 7 in 2024-08-20T01:26:11.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:10 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:26:11.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:10 smithi134 ceph-mon[22511]: purged_snaps scrub starts 2024-08-20T01:26:11.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:10 smithi134 ceph-mon[22511]: purged_snaps scrub ok 2024-08-20T01:26:11.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:10 smithi134 ceph-mon[22511]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:26:11.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:10 smithi134 ceph-mon[22511]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:26:11.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:10 smithi134 ceph-mon[22511]: osd.6 [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416] boot 2024-08-20T01:26:11.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:10 smithi134 ceph-mon[22511]: osdmap e41: 7 total, 7 up, 7 in 2024-08-20T01:26:11.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:10 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:26:12.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:11 smithi077 ceph-mon[22251]: osdmap e42: 7 total, 7 up, 7 in 2024-08-20T01:26:12.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:11 smithi022 ceph-mon[18709]: osdmap e42: 7 total, 7 up, 7 in 2024-08-20T01:26:12.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:11 smithi134 ceph-mon[22511]: osdmap e42: 7 total, 7 up, 7 in 2024-08-20T01:26:13.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:12 smithi077 ceph-mon[22251]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:13.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:12 smithi077 ceph-mon[22251]: from='client.? 172.21.15.77:0/2349873990' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e217112d-9f56-4a48-93bf-6eb052ce540a"} : dispatch 2024-08-20T01:26:13.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:12 smithi077 ceph-mon[22251]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e217112d-9f56-4a48-93bf-6eb052ce540a"} : dispatch 2024-08-20T01:26:13.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:12 smithi077 ceph-mon[22251]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e217112d-9f56-4a48-93bf-6eb052ce540a"}]': finished 2024-08-20T01:26:13.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:12 smithi077 ceph-mon[22251]: osdmap e43: 8 total, 7 up, 8 in 2024-08-20T01:26:13.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:12 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:26:13.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:12 smithi077 ceph-mon[22251]: from='client.? 172.21.15.77:0/2072906462' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:26:13.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:12 smithi022 ceph-mon[18709]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:13.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:12 smithi022 ceph-mon[18709]: from='client.? 172.21.15.77:0/2349873990' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e217112d-9f56-4a48-93bf-6eb052ce540a"} : dispatch 2024-08-20T01:26:13.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:12 smithi022 ceph-mon[18709]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e217112d-9f56-4a48-93bf-6eb052ce540a"} : dispatch 2024-08-20T01:26:13.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:12 smithi022 ceph-mon[18709]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e217112d-9f56-4a48-93bf-6eb052ce540a"}]': finished 2024-08-20T01:26:13.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:12 smithi022 ceph-mon[18709]: osdmap e43: 8 total, 7 up, 8 in 2024-08-20T01:26:13.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:12 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:26:13.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:12 smithi022 ceph-mon[18709]: from='client.? 172.21.15.77:0/2072906462' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:26:13.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:12 smithi134 ceph-mon[22511]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:13.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:12 smithi134 ceph-mon[22511]: from='client.? 172.21.15.77:0/2349873990' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e217112d-9f56-4a48-93bf-6eb052ce540a"} : dispatch 2024-08-20T01:26:13.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:12 smithi134 ceph-mon[22511]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e217112d-9f56-4a48-93bf-6eb052ce540a"} : dispatch 2024-08-20T01:26:13.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:12 smithi134 ceph-mon[22511]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e217112d-9f56-4a48-93bf-6eb052ce540a"}]': finished 2024-08-20T01:26:13.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:12 smithi134 ceph-mon[22511]: osdmap e43: 8 total, 7 up, 8 in 2024-08-20T01:26:13.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:12 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:26:13.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:12 smithi134 ceph-mon[22511]: from='client.? 172.21.15.77:0/2072906462' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:26:15.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:14 smithi077 ceph-mon[22251]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:15.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:14 smithi022 ceph-mon[18709]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:15.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:14 smithi134 ceph-mon[22511]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:17.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:16 smithi077 ceph-mon[22251]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:17.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:16 smithi022 ceph-mon[18709]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:17.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:16 smithi134 ceph-mon[22511]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:19.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:18 smithi077 ceph-mon[22251]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:19.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:18 smithi022 ceph-mon[18709]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:19.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:18 smithi134 ceph-mon[22511]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:21.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:20 smithi077 ceph-mon[22251]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:21.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:20 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-20T01:26:21.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:20 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:21.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:20 smithi022 ceph-mon[18709]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:21.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:20 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-20T01:26:21.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:20 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:21.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:20 smithi134 ceph-mon[22511]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:21.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:20 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-20T01:26:21.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:20 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:22.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:21 smithi022 ceph-mon[18709]: Deploying daemon osd.7 on smithi077 2024-08-20T01:26:22.227 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:21 smithi077 ceph-mon[22251]: Deploying daemon osd.7 on smithi077 2024-08-20T01:26:22.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:21 smithi134 ceph-mon[22511]: Deploying daemon osd.7 on smithi077 2024-08-20T01:26:23.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:22 smithi022 ceph-mon[18709]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:23.250 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:22 smithi077 ceph-mon[22251]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:23.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:22 smithi134 ceph-mon[22511]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:25.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:24 smithi077 ceph-mon[22251]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:25.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:24 smithi022 ceph-mon[18709]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:25.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:24 smithi134 ceph-mon[22511]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:27.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:26 smithi022 ceph-mon[18709]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:27.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:26 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:26:27.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:26 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:27.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:26 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:27.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:26 smithi134 ceph-mon[22511]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:27.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:26 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:26:27.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:26 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:27.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:26 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:27.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:26 smithi077 ceph-mon[22251]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:27.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:26 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:26:27.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:26 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:27.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:26 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:29.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:28 smithi077 ceph-mon[22251]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:29.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:28 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:29.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:28 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:29.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:28 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:29.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:28 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:26:29.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:28 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:29.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:28 smithi022 ceph-mon[18709]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:29.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:28 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:29.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:28 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:29.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:28 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:29.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:28 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:26:29.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:28 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:29.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:28 smithi134 ceph-mon[22511]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:29.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:28 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:29.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:28 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:29.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:28 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:29.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:28 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:26:29.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:28 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:29.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:29.841+0000 7f4fb27fc640 1 -- 172.21.15.77:0/1943890258 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4fbc0632c0 con 0x7f4fa80b3bd0 2024-08-20T01:26:29.842 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 7 on host 'smithi077' 2024-08-20T01:26:29.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:29.844+0000 7f4fc327c640 1 -- 172.21.15.77:0/1943890258 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4fa80b3bd0 msgr2=0x7f4fa80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:26:29.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:29.844+0000 7f4fc327c640 1 --2- 172.21.15.77:0/1943890258 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4fa80b3bd0 0x7f4fa80b6090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8000c00 tx=0x7f4fb80314a0 comp rx=0 tx=0).stop 2024-08-20T01:26:29.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:29.844+0000 7f4fc327c640 1 -- 172.21.15.77:0/1943890258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fbc108420 msgr2=0x7f4fbc101870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:26:29.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:29.844+0000 7f4fc327c640 1 --2- 172.21.15.77:0/1943890258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fbc108420 0x7f4fbc101870 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400eaa0 tx=0x7f4fb400ef60 comp rx=0 tx=0).stop 2024-08-20T01:26:29.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:29.844+0000 7f4fc327c640 1 -- 172.21.15.77:0/1943890258 shutdown_connections 2024-08-20T01:26:29.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:29.844+0000 7f4fc327c640 1 --2- 172.21.15.77:0/1943890258 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4fa80b3bd0 0x7f4fa80b6090 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:29.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:29.844+0000 7f4fc327c640 1 --2- 172.21.15.77:0/1943890258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fbc108420 0x7f4fbc101870 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:29.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:29.844+0000 7f4fc327c640 1 --2- 172.21.15.77:0/1943890258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fbc1058d0 0x7f4fbc101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:29.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:29.844+0000 7f4fc327c640 1 --2- 172.21.15.77:0/1943890258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fbc06b340 0x7f4fbc102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:29.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:29.844+0000 7f4fc327c640 1 -- 172.21.15.77:0/1943890258 >> 172.21.15.77:0/1943890258 conn(0x7f4fbc0fcee0 msgr2=0x7f4fbc103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:26:29.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:29.844+0000 7f4fc327c640 1 -- 172.21.15.77:0/1943890258 shutdown_connections 2024-08-20T01:26:29.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:26:29.844+0000 7f4fc327c640 1 -- 172.21.15.77:0/1943890258 wait complete. 2024-08-20T01:26:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:29 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:26:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:29 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:30.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:29 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:30.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:29 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:26:30.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:29 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:30.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:29 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:30.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:29 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:26:30.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:29 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:30.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:29 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:30.877 DEBUG:teuthology.orchestra.run.smithi077:osd.7> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.7.service 2024-08-20T01:26:30.880 INFO:tasks.cephadm:Deploying osd.8 on smithi134 with /dev/vg_nvme/lv_2... 2024-08-20T01:26:30.880 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-20T01:26:31.105 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:30 smithi077 ceph-mon[22251]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:31.135 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:26:31.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:30 smithi022 ceph-mon[18709]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:31.256 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:30 smithi134 ceph-mon[22511]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:32.709 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:26:32 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:26:32.365+0000 7f060ac4a640 -1 osd.7 0 log_to_monitors true 2024-08-20T01:26:33.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:32 smithi077 ceph-mon[22251]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:33.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:32 smithi077 ceph-mon[22251]: from='osd.7 [v2:172.21.15.77:6816/700318902,v1:172.21.15.77:6817/700318902]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-20T01:26:33.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:32 smithi077 ceph-mon[22251]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-20T01:26:33.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:32 smithi134 ceph-mon[22511]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:33.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:32 smithi134 ceph-mon[22511]: from='osd.7 [v2:172.21.15.77:6816/700318902,v1:172.21.15.77:6817/700318902]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-20T01:26:33.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:32 smithi134 ceph-mon[22511]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-20T01:26:33.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:32 smithi022 ceph-mon[18709]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:33.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:32 smithi022 ceph-mon[18709]: from='osd.7 [v2:172.21.15.77:6816/700318902,v1:172.21.15.77:6817/700318902]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-20T01:26:33.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:32 smithi022 ceph-mon[18709]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-20T01:26:33.784 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:26:33.810 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_2 2024-08-20T01:26:34.060 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:26:34.181 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:33 smithi134 ceph-mon[22511]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-20T01:26:34.181 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:33 smithi134 ceph-mon[22511]: osdmap e44: 8 total, 7 up, 8 in 2024-08-20T01:26:34.181 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:33 smithi134 ceph-mon[22511]: from='osd.7 [v2:172.21.15.77:6816/700318902,v1:172.21.15.77:6817/700318902]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:26:34.181 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:33 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:26:34.182 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:33 smithi134 ceph-mon[22511]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:26:34.182 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:33 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:34.182 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:33 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:34.182 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:33 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:34.182 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:33 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:34.182 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:33 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:34.182 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:33 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:34.182 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:33 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:34.182 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:33 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:26:34.182 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:33 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:34.182 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:33 smithi134 ceph-mon[22511]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-08-20T01:26:34.298 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:33 smithi077 ceph-mon[22251]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-20T01:26:34.298 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:33 smithi077 ceph-mon[22251]: osdmap e44: 8 total, 7 up, 8 in 2024-08-20T01:26:34.299 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:33 smithi077 ceph-mon[22251]: from='osd.7 [v2:172.21.15.77:6816/700318902,v1:172.21.15.77:6817/700318902]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:26:34.299 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:33 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:26:34.299 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:33 smithi077 ceph-mon[22251]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:26:34.299 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:33 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:34.299 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:33 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:34.299 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:33 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:34.299 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:33 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:34.299 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:33 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:34.299 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:33 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:34.299 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:33 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:34.299 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:33 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:26:34.299 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:33 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:34.301 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:33 smithi077 ceph-mon[22251]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-08-20T01:26:34.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:33 smithi022 ceph-mon[18709]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-20T01:26:34.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:33 smithi022 ceph-mon[18709]: osdmap e44: 8 total, 7 up, 8 in 2024-08-20T01:26:34.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:33 smithi022 ceph-mon[18709]: from='osd.7 [v2:172.21.15.77:6816/700318902,v1:172.21.15.77:6817/700318902]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:26:34.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:33 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:26:34.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:33 smithi022 ceph-mon[18709]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:26:34.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:33 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:34.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:33 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:34.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:33 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:34.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:33 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:34.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:33 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:34.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:33 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:34.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:33 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:34.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:33 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:26:34.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:33 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:34.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:33 smithi022 ceph-mon[18709]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-08-20T01:26:34.563 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:26:34 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:26:34.297+0000 7f0606bcd640 -1 osd.7 0 waiting for initial osdmap 2024-08-20T01:26:34.563 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:26:34 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:26:34.305+0000 7f05fe9ec640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:26:34.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.559+0000 7f540c64b640 1 -- 172.21.15.134:0/3280398257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5404102730 msgr2=0x7f5404102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:26:34.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.559+0000 7f540c64b640 1 --2- 172.21.15.134:0/3280398257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5404102730 0x7f5404102b30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5400009960 tx=0x7f540002a460 comp rx=0 tx=0).stop 2024-08-20T01:26:34.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.560+0000 7f540c64b640 1 -- 172.21.15.134:0/3280398257 shutdown_connections 2024-08-20T01:26:34.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.560+0000 7f540c64b640 1 --2- 172.21.15.134:0/3280398257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5404104250 0x7f540410abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:34.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.560+0000 7f540c64b640 1 --2- 172.21.15.134:0/3280398257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5404103890 0x7f5404103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:34.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.560+0000 7f540c64b640 1 --2- 172.21.15.134:0/3280398257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5404102730 0x7f5404102b30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:34.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.560+0000 7f540c64b640 1 -- 172.21.15.134:0/3280398257 >> 172.21.15.134:0/3280398257 conn(0x7f54040fe020 msgr2=0x7f5404100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:26:34.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.560+0000 7f540c64b640 1 -- 172.21.15.134:0/3280398257 shutdown_connections 2024-08-20T01:26:34.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.560+0000 7f540c64b640 1 -- 172.21.15.134:0/3280398257 wait complete. 2024-08-20T01:26:34.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.560+0000 7f540c64b640 1 Processor -- start 2024-08-20T01:26:34.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.560+0000 7f540c64b640 1 -- start start 2024-08-20T01:26:34.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.560+0000 7f540c64b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5404102730 0x7f5404198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:26:34.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.560+0000 7f540c64b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5404103890 0x7f5404199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:26:34.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.560+0000 7f540c64b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5404104250 0x7f5404199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:26:34.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.560+0000 7f540c64b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f540410e390 con 0x7f5404102730 2024-08-20T01:26:34.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.560+0000 7f540c64b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f540410e210 con 0x7f5404103890 2024-08-20T01:26:34.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.560+0000 7f540c64b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f540410e510 con 0x7f5404104250 2024-08-20T01:26:34.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.561+0000 7f540abe8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5404104250 0x7f5404199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:26:34.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.561+0000 7f540abe8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5404104250 0x7f5404199cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49230/0 (socket says 172.21.15.134:49230) 2024-08-20T01:26:34.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.561+0000 7f540abe8640 1 -- 172.21.15.134:0/1233580290 learned_addr learned my addr 172.21.15.134:0/1233580290 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-08-20T01:26:34.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.561+0000 7f540a3e7640 1 --2- 172.21.15.134:0/1233580290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5404102730 0x7f5404198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:26:34.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.561+0000 7f5409be6640 1 --2- 172.21.15.134:0/1233580290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5404103890 0x7f5404199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:26:34.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.561+0000 7f540abe8640 1 -- 172.21.15.134:0/1233580290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5404103890 msgr2=0x7f5404199080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:26:34.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.561+0000 7f540abe8640 1 --2- 172.21.15.134:0/1233580290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5404103890 0x7f5404199080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:34.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.561+0000 7f540abe8640 1 -- 172.21.15.134:0/1233580290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5404102730 msgr2=0x7f5404198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:26:34.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.561+0000 7f540abe8640 1 --2- 172.21.15.134:0/1233580290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5404102730 0x7f5404198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:34.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.561+0000 7f540abe8640 1 -- 172.21.15.134:0/1233580290 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540419a560 con 0x7f5404104250 2024-08-20T01:26:34.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.561+0000 7f540abe8640 1 --2- 172.21.15.134:0/1233580290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5404104250 0x7f5404199cc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00cce0 tx=0x7f53fc00a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:26:34.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.561+0000 7f53fb7fe640 1 -- 172.21.15.134:0/1233580290 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc00f450 con 0x7f5404104250 2024-08-20T01:26:34.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.561+0000 7f53fb7fe640 1 -- 172.21.15.134:0/1233580290 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53fc00faa0 con 0x7f5404104250 2024-08-20T01:26:34.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.561+0000 7f53fb7fe640 1 -- 172.21.15.134:0/1233580290 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc018b70 con 0x7f5404104250 2024-08-20T01:26:34.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.561+0000 7f540c64b640 1 -- 172.21.15.134:0/1233580290 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f540419a850 con 0x7f5404104250 2024-08-20T01:26:34.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.561+0000 7f540c64b640 1 -- 172.21.15.134:0/1233580290 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54041a0f30 con 0x7f5404104250 2024-08-20T01:26:34.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.562+0000 7f540c64b640 1 -- 172.21.15.134:0/1233580290 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5404109a50 con 0x7f5404104250 2024-08-20T01:26:34.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.564+0000 7f53fb7fe640 1 -- 172.21.15.134:0/1233580290 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f53fc018d10 con 0x7f5404104250 2024-08-20T01:26:34.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.564+0000 7f53fb7fe640 1 --2- 172.21.15.134:0/1233580290 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53f00b3bd0 0x7f53f00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:26:34.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.564+0000 7f53fb7fe640 1 -- 172.21.15.134:0/1233580290 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5117+0+0 (secure 0 0 0) 0x7f53fc0e35b0 con 0x7f5404104250 2024-08-20T01:26:34.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.565+0000 7f540a3e7640 1 --2- 172.21.15.134:0/1233580290 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53f00b3bd0 0x7f53f00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:26:34.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.565+0000 7f540a3e7640 1 --2- 172.21.15.134:0/1233580290 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53f00b3bd0 0x7f53f00b6090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5400006010 tx=0x7f5400005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:26:34.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.567+0000 7f53fb7fe640 1 -- 172.21.15.134:0/1233580290 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f53fc014030 con 0x7f5404104250 2024-08-20T01:26:34.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:34.753+0000 7f540c64b640 1 -- 172.21.15.134:0/1233580290 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f54040632c0 con 0x7f53f00b3bd0 2024-08-20T01:26:35.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:34 smithi134 ceph-mon[22511]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:35.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:34 smithi134 ceph-mon[22511]: Detected new or changed devices on smithi077 2024-08-20T01:26:35.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:34 smithi134 ceph-mon[22511]: Adjusting osd_memory_target on smithi077 to 5696M 2024-08-20T01:26:35.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:34 smithi134 ceph-mon[22511]: osdmap e45: 8 total, 7 up, 8 in 2024-08-20T01:26:35.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:26:35.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:26:35.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:34 smithi134 ceph-mon[22511]: from='osd.7 ' entity='osd.7' 2024-08-20T01:26:35.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:26:35.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:26:35.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:34 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:35.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:34 smithi077 ceph-mon[22251]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:35.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:34 smithi077 ceph-mon[22251]: Detected new or changed devices on smithi077 2024-08-20T01:26:35.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:34 smithi077 ceph-mon[22251]: Adjusting osd_memory_target on smithi077 to 5696M 2024-08-20T01:26:35.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:34 smithi077 ceph-mon[22251]: osdmap e45: 8 total, 7 up, 8 in 2024-08-20T01:26:35.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:26:35.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:26:35.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:34 smithi077 ceph-mon[22251]: from='osd.7 ' entity='osd.7' 2024-08-20T01:26:35.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:26:35.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:26:35.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:34 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:35.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:34 smithi022 ceph-mon[18709]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:35.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:34 smithi022 ceph-mon[18709]: Detected new or changed devices on smithi077 2024-08-20T01:26:35.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:34 smithi022 ceph-mon[18709]: Adjusting osd_memory_target on smithi077 to 5696M 2024-08-20T01:26:35.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:34 smithi022 ceph-mon[18709]: osdmap e45: 8 total, 7 up, 8 in 2024-08-20T01:26:35.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:26:35.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:26:35.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:34 smithi022 ceph-mon[18709]: from='osd.7 ' entity='osd.7' 2024-08-20T01:26:35.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:26:35.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:26:35.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:34 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:36.209 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:35 smithi134 ceph-mon[22511]: purged_snaps scrub starts 2024-08-20T01:26:36.209 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:35 smithi134 ceph-mon[22511]: purged_snaps scrub ok 2024-08-20T01:26:36.209 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:35 smithi134 ceph-mon[22511]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:26:36.209 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:35 smithi134 ceph-mon[22511]: osd.7 [v2:172.21.15.77:6816/700318902,v1:172.21.15.77:6817/700318902] boot 2024-08-20T01:26:36.209 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:35 smithi134 ceph-mon[22511]: osdmap e46: 8 total, 8 up, 8 in 2024-08-20T01:26:36.209 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:35 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:26:36.209 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:35 smithi134 ceph-mon[22511]: osdmap e47: 8 total, 8 up, 8 in 2024-08-20T01:26:36.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:35 smithi077 ceph-mon[22251]: purged_snaps scrub starts 2024-08-20T01:26:36.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:35 smithi077 ceph-mon[22251]: purged_snaps scrub ok 2024-08-20T01:26:36.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:35 smithi077 ceph-mon[22251]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:26:36.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:35 smithi077 ceph-mon[22251]: osd.7 [v2:172.21.15.77:6816/700318902,v1:172.21.15.77:6817/700318902] boot 2024-08-20T01:26:36.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:35 smithi077 ceph-mon[22251]: osdmap e46: 8 total, 8 up, 8 in 2024-08-20T01:26:36.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:35 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:26:36.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:35 smithi077 ceph-mon[22251]: osdmap e47: 8 total, 8 up, 8 in 2024-08-20T01:26:36.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:35 smithi022 ceph-mon[18709]: purged_snaps scrub starts 2024-08-20T01:26:36.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:35 smithi022 ceph-mon[18709]: purged_snaps scrub ok 2024-08-20T01:26:36.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:35 smithi022 ceph-mon[18709]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:26:36.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:35 smithi022 ceph-mon[18709]: osd.7 [v2:172.21.15.77:6816/700318902,v1:172.21.15.77:6817/700318902] boot 2024-08-20T01:26:36.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:35 smithi022 ceph-mon[18709]: osdmap e46: 8 total, 8 up, 8 in 2024-08-20T01:26:36.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:35 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:26:36.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:35 smithi022 ceph-mon[18709]: osdmap e47: 8 total, 8 up, 8 in 2024-08-20T01:26:37.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:36 smithi134 ceph-mon[22511]: pgmap v177: 1 pgs: 1 unknown; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:37.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:36 smithi077 ceph-mon[22251]: pgmap v177: 1 pgs: 1 unknown; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:37.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:36 smithi022 ceph-mon[18709]: pgmap v177: 1 pgs: 1 unknown; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:26:38.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:37 smithi134 ceph-mon[22511]: osdmap e48: 8 total, 8 up, 8 in 2024-08-20T01:26:38.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:37 smithi134 ceph-mon[22511]: from='client.? 172.21.15.134:0/616947145' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1786747c-6ff6-4e00-bcf6-a8176215847f"} : dispatch 2024-08-20T01:26:38.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:37 smithi134 ceph-mon[22511]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1786747c-6ff6-4e00-bcf6-a8176215847f"} : dispatch 2024-08-20T01:26:38.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:37 smithi134 ceph-mon[22511]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1786747c-6ff6-4e00-bcf6-a8176215847f"}]': finished 2024-08-20T01:26:38.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:37 smithi134 ceph-mon[22511]: osdmap e49: 9 total, 8 up, 9 in 2024-08-20T01:26:38.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:37 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:26:38.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:37 smithi134 ceph-mon[22511]: from='client.? 172.21.15.134:0/2736700585' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:26:38.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:37 smithi077 ceph-mon[22251]: osdmap e48: 8 total, 8 up, 8 in 2024-08-20T01:26:38.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:37 smithi077 ceph-mon[22251]: from='client.? 172.21.15.134:0/616947145' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1786747c-6ff6-4e00-bcf6-a8176215847f"} : dispatch 2024-08-20T01:26:38.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:37 smithi077 ceph-mon[22251]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1786747c-6ff6-4e00-bcf6-a8176215847f"} : dispatch 2024-08-20T01:26:38.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:37 smithi077 ceph-mon[22251]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1786747c-6ff6-4e00-bcf6-a8176215847f"}]': finished 2024-08-20T01:26:38.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:37 smithi077 ceph-mon[22251]: osdmap e49: 9 total, 8 up, 9 in 2024-08-20T01:26:38.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:37 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:26:38.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:37 smithi077 ceph-mon[22251]: from='client.? 172.21.15.134:0/2736700585' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:26:38.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:37 smithi022 ceph-mon[18709]: osdmap e48: 8 total, 8 up, 8 in 2024-08-20T01:26:38.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:37 smithi022 ceph-mon[18709]: from='client.? 172.21.15.134:0/616947145' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1786747c-6ff6-4e00-bcf6-a8176215847f"} : dispatch 2024-08-20T01:26:38.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:37 smithi022 ceph-mon[18709]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1786747c-6ff6-4e00-bcf6-a8176215847f"} : dispatch 2024-08-20T01:26:38.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:37 smithi022 ceph-mon[18709]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1786747c-6ff6-4e00-bcf6-a8176215847f"}]': finished 2024-08-20T01:26:38.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:37 smithi022 ceph-mon[18709]: osdmap e49: 9 total, 8 up, 9 in 2024-08-20T01:26:38.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:37 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:26:38.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:37 smithi022 ceph-mon[18709]: from='client.? 172.21.15.134:0/2736700585' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:26:39.169 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:38 smithi134 ceph-mon[22511]: pgmap v181: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:26:39.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:38 smithi077 ceph-mon[22251]: pgmap v181: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:26:39.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:38 smithi022 ceph-mon[18709]: pgmap v181: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:26:41.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:40 smithi134 ceph-mon[22511]: pgmap v182: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:26:41.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:40 smithi077 ceph-mon[22251]: pgmap v182: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:26:41.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:40 smithi022 ceph-mon[18709]: pgmap v182: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:26:43.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:42 smithi134 ceph-mon[22511]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-08-20T01:26:43.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:42 smithi077 ceph-mon[22251]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-08-20T01:26:43.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:42 smithi022 ceph-mon[18709]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-08-20T01:26:45.176 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:44 smithi134 ceph-mon[22511]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-08-20T01:26:45.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:44 smithi077 ceph-mon[22251]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-08-20T01:26:45.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:44 smithi022 ceph-mon[18709]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-08-20T01:26:46.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:45 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-20T01:26:46.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:45 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:46.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:45 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-20T01:26:46.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:45 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:46.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:45 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-20T01:26:46.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:45 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:47.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:46 smithi134 ceph-mon[22511]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-08-20T01:26:47.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:46 smithi134 ceph-mon[22511]: Deploying daemon osd.8 on smithi134 2024-08-20T01:26:47.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:46 smithi077 ceph-mon[22251]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-08-20T01:26:47.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:46 smithi077 ceph-mon[22251]: Deploying daemon osd.8 on smithi134 2024-08-20T01:26:47.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:46 smithi022 ceph-mon[18709]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-08-20T01:26:47.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:46 smithi022 ceph-mon[18709]: Deploying daemon osd.8 on smithi134 2024-08-20T01:26:49.188 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:48 smithi022 ceph-mon[18709]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-08-20T01:26:49.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:48 smithi134 ceph-mon[22511]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-08-20T01:26:49.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:48 smithi077 ceph-mon[22251]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-08-20T01:26:51.236 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:50 smithi134 ceph-mon[22511]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T01:26:51.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:50 smithi077 ceph-mon[22251]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T01:26:51.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:50 smithi022 ceph-mon[18709]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T01:26:52.235 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:51 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:26:52.235 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:51 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:52.235 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:51 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:52.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:51 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:26:52.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:51 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:52.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:51 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:52.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:51 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:26:52.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:51 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:52.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:51 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:53.239 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:52 smithi134 ceph-mon[22511]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T01:26:53.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:52 smithi077 ceph-mon[22251]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T01:26:53.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:52 smithi022 ceph-mon[18709]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T01:26:55.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:54 smithi134 ceph-mon[22511]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:26:55.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:55.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:55.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:55.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:26:55.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:55.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:54 smithi077 ceph-mon[22251]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:26:55.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:55.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:55.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:55.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:26:55.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:55.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:54 smithi022 ceph-mon[18709]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:26:55.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:55.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:55.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:55.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:26:55.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:55.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:55.423+0000 7f53fb7fe640 1 -- 172.21.15.134:0/1233580290 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f54040632c0 con 0x7f53f00b3bd0 2024-08-20T01:26:55.424 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 8 on host 'smithi134' 2024-08-20T01:26:55.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:55.425+0000 7f540c64b640 1 -- 172.21.15.134:0/1233580290 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53f00b3bd0 msgr2=0x7f53f00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:26:55.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:55.425+0000 7f540c64b640 1 --2- 172.21.15.134:0/1233580290 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53f00b3bd0 0x7f53f00b6090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5400006010 tx=0x7f5400005d50 comp rx=0 tx=0).stop 2024-08-20T01:26:55.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:55.425+0000 7f540c64b640 1 -- 172.21.15.134:0/1233580290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5404104250 msgr2=0x7f5404199cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:26:55.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:55.425+0000 7f540c64b640 1 --2- 172.21.15.134:0/1233580290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5404104250 0x7f5404199cc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00cce0 tx=0x7f53fc00a620 comp rx=0 tx=0).stop 2024-08-20T01:26:55.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:55.425+0000 7f540c64b640 1 -- 172.21.15.134:0/1233580290 shutdown_connections 2024-08-20T01:26:55.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:55.425+0000 7f540c64b640 1 --2- 172.21.15.134:0/1233580290 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53f00b3bd0 0x7f53f00b6090 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:55.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:55.425+0000 7f540c64b640 1 --2- 172.21.15.134:0/1233580290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5404104250 0x7f5404199cc0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:55.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:55.425+0000 7f540c64b640 1 --2- 172.21.15.134:0/1233580290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5404103890 0x7f5404199080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:55.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:55.425+0000 7f540c64b640 1 --2- 172.21.15.134:0/1233580290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5404102730 0x7f5404198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:55.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:55.425+0000 7f540c64b640 1 -- 172.21.15.134:0/1233580290 >> 172.21.15.134:0/1233580290 conn(0x7f54040fe020 msgr2=0x7f5404106c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:26:55.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:55.425+0000 7f540c64b640 1 -- 172.21.15.134:0/1233580290 shutdown_connections 2024-08-20T01:26:55.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:26:55.425+0000 7f540c64b640 1 -- 172.21.15.134:0/1233580290 wait complete. 2024-08-20T01:26:56.148 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:55 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:26:56.148 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:55 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:56.149 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:55 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:56.174 DEBUG:teuthology.orchestra.run.smithi134:osd.8> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.8.service 2024-08-20T01:26:56.177 INFO:tasks.cephadm:Deploying osd.9 on smithi022 with /dev/vg_nvme/lv_1... 2024-08-20T01:26:56.177 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-20T01:26:56.206 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:55 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:26:56.207 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:55 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:56.207 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:55 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:56.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:55 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:26:56.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:55 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:56.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:55 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:56.445 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:26:57.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:56 smithi134 ceph-mon[22511]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:26:57.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:56 smithi077 ceph-mon[22251]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:26:57.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:56 smithi022 ceph-mon[18709]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:26:58.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:57 smithi134 ceph-mon[22511]: from='osd.8 [v2:172.21.15.134:6816/1635473481,v1:172.21.15.134:6817/1635473481]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-20T01:26:58.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:57 smithi134 ceph-mon[22511]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-20T01:26:58.015 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:26:57 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:26:57.817+0000 7fed5e04c640 -1 osd.8 0 log_to_monitors true 2024-08-20T01:26:58.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:57 smithi022 ceph-mon[18709]: from='osd.8 [v2:172.21.15.134:6816/1635473481,v1:172.21.15.134:6817/1635473481]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-20T01:26:58.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:57 smithi022 ceph-mon[18709]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-20T01:26:58.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:57 smithi077 ceph-mon[22251]: from='osd.8 [v2:172.21.15.134:6816/1635473481,v1:172.21.15.134:6817/1635473481]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-20T01:26:58.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:57 smithi077 ceph-mon[22251]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-20T01:26:59.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:58 smithi022 ceph-mon[18709]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:26:59.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:58 smithi022 ceph-mon[18709]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-20T01:26:59.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:58 smithi022 ceph-mon[18709]: from='osd.8 [v2:172.21.15.134:6816/1635473481,v1:172.21.15.134:6817/1635473481]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:26:59.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:58 smithi022 ceph-mon[18709]: osdmap e50: 9 total, 8 up, 9 in 2024-08-20T01:26:59.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:26:59.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:58 smithi022 ceph-mon[18709]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:26:59.144 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:26:59.171 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_1 2024-08-20T01:26:59.190 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:58 smithi134 ceph-mon[22511]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:26:59.190 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:58 smithi134 ceph-mon[22511]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-20T01:26:59.190 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:58 smithi134 ceph-mon[22511]: from='osd.8 [v2:172.21.15.134:6816/1635473481,v1:172.21.15.134:6817/1635473481]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:26:59.190 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:58 smithi134 ceph-mon[22511]: osdmap e50: 9 total, 8 up, 9 in 2024-08-20T01:26:59.191 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:26:59.191 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:58 smithi134 ceph-mon[22511]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:26:59.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:58 smithi077 ceph-mon[22251]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:26:59.343 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:58 smithi077 ceph-mon[22251]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-20T01:26:59.343 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:58 smithi077 ceph-mon[22251]: from='osd.8 [v2:172.21.15.134:6816/1635473481,v1:172.21.15.134:6817/1635473481]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:26:59.343 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:58 smithi077 ceph-mon[22251]: osdmap e50: 9 total, 8 up, 9 in 2024-08-20T01:26:59.343 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:26:59.343 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:58 smithi077 ceph-mon[22251]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:26:59.476 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:26:59.515 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:26:59 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:26:59.329+0000 7fed5a7e3640 -1 osd.8 0 waiting for initial osdmap 2024-08-20T01:26:59.515 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:26:59 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:26:59.338+0000 7fed51dee640 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:26:59.972 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:59 smithi022 ceph-mon[18709]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-08-20T01:26:59.973 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:59 smithi022 ceph-mon[18709]: osdmap e51: 9 total, 8 up, 9 in 2024-08-20T01:26:59.973 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:59 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:26:59.973 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:59 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:26:59.973 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:59 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:59.973 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:59 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:59.973 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:59 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:59.973 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:59 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:59.973 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:59 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:26:59.973 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:59 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:59.973 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:59 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:26:59.973 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:59 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:26:59.973 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:59 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:26:59.974 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:26:59 smithi022 ceph-mon[18709]: from='osd.8 ' entity='osd.8' 2024-08-20T01:26:59.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.968+0000 7fe25ed01640 1 -- 172.21.15.22:0/3519309784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe258103130 msgr2=0x7fe258109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:26:59.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.968+0000 7fe25ed01640 1 --2- 172.21.15.22:0/3519309784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe258103130 0x7fe258109ab0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe250009cd0 tx=0x7fe25002a8e0 comp rx=0 tx=0).stop 2024-08-20T01:26:59.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.968+0000 7fe25ed01640 1 -- 172.21.15.22:0/3519309784 shutdown_connections 2024-08-20T01:26:59.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.968+0000 7fe25ed01640 1 --2- 172.21.15.22:0/3519309784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe258103130 0x7fe258109ab0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:59.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.968+0000 7fe25ed01640 1 --2- 172.21.15.22:0/3519309784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe258102770 0x7fe258102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:59.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.968+0000 7fe25ed01640 1 --2- 172.21.15.22:0/3519309784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe258101610 0x7fe258101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:59.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.968+0000 7fe25ed01640 1 -- 172.21.15.22:0/3519309784 >> 172.21.15.22:0/3519309784 conn(0x7fe2580fcee0 msgr2=0x7fe2580ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:26:59.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.968+0000 7fe25ed01640 1 -- 172.21.15.22:0/3519309784 shutdown_connections 2024-08-20T01:26:59.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.968+0000 7fe25ed01640 1 -- 172.21.15.22:0/3519309784 wait complete. 2024-08-20T01:26:59.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.968+0000 7fe25ed01640 1 Processor -- start 2024-08-20T01:26:59.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.969+0000 7fe25ed01640 1 -- start start 2024-08-20T01:26:59.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.969+0000 7fe25ed01640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe258101610 0x7fe2581053d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:26:59.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.969+0000 7fe25ed01640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe258102770 0x7fe258103c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:26:59.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.969+0000 7fe25ed01640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe258103130 0x7fe258104180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:26:59.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.969+0000 7fe25ed01640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe25810d2c0 con 0x7fe258101610 2024-08-20T01:26:59.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.969+0000 7fe25ed01640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe25810d140 con 0x7fe258103130 2024-08-20T01:26:59.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.969+0000 7fe25ed01640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe25810d440 con 0x7fe258102770 2024-08-20T01:26:59.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.969+0000 7fe25ca9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe258101610 0x7fe2581053d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:26:59.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.969+0000 7fe25ca9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe258101610 0x7fe2581053d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43402/0 (socket says 172.21.15.22:43402) 2024-08-20T01:26:59.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.969+0000 7fe25ca9d640 1 -- 172.21.15.22:0/378362852 learned_addr learned my addr 172.21.15.22:0/378362852 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:26:59.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.969+0000 7fe257fff640 1 --2- 172.21.15.22:0/378362852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe258102770 0x7fe258103c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:26:59.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.969+0000 7fe25d29e640 1 --2- 172.21.15.22:0/378362852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe258103130 0x7fe258104180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:26:59.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.969+0000 7fe25d29e640 1 -- 172.21.15.22:0/378362852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe258102770 msgr2=0x7fe258103c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:26:59.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.969+0000 7fe25d29e640 1 --2- 172.21.15.22:0/378362852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe258102770 0x7fe258103c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:59.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.969+0000 7fe25d29e640 1 -- 172.21.15.22:0/378362852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe258101610 msgr2=0x7fe2581053d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:26:59.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.969+0000 7fe25d29e640 1 --2- 172.21.15.22:0/378362852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe258101610 0x7fe2581053d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:26:59.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.969+0000 7fe25d29e640 1 -- 172.21.15.22:0/378362852 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe258104a40 con 0x7fe258103130 2024-08-20T01:26:59.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.969+0000 7fe25ca9d640 1 --2- 172.21.15.22:0/378362852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe258101610 0x7fe2581053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:26:59.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.969+0000 7fe257fff640 1 --2- 172.21.15.22:0/378362852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe258102770 0x7fe258103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:26:59.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.970+0000 7fe25d29e640 1 --2- 172.21.15.22:0/378362852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe258103130 0x7fe258104180 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe25002ae00 tx=0x7fe250003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:26:59.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.972+0000 7fe255ffb640 1 -- 172.21.15.22:0/378362852 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe250004240 con 0x7fe258103130 2024-08-20T01:26:59.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.972+0000 7fe255ffb640 1 -- 172.21.15.22:0/378362852 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2500305a0 con 0x7fe258103130 2024-08-20T01:26:59.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.972+0000 7fe255ffb640 1 -- 172.21.15.22:0/378362852 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25003a660 con 0x7fe258103130 2024-08-20T01:26:59.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.972+0000 7fe25ed01640 1 -- 172.21.15.22:0/378362852 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2581a2ae0 con 0x7fe258103130 2024-08-20T01:26:59.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.972+0000 7fe25ed01640 1 -- 172.21.15.22:0/378362852 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2581a2ff0 con 0x7fe258103130 2024-08-20T01:26:59.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.973+0000 7fe25ed01640 1 -- 172.21.15.22:0/378362852 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2581a31c0 con 0x7fe258103130 2024-08-20T01:26:59.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.974+0000 7fe255ffb640 1 -- 172.21.15.22:0/378362852 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fe250030750 con 0x7fe258103130 2024-08-20T01:26:59.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.975+0000 7fe255ffb640 1 --2- 172.21.15.22:0/378362852 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe2480b3bd0 0x7fe2480b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:26:59.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.975+0000 7fe25ca9d640 1 --2- 172.21.15.22:0/378362852 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe2480b3bd0 0x7fe2480b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:26:59.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.976+0000 7fe255ffb640 1 -- 172.21.15.22:0/378362852 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5862+0+0 (secure 0 0 0) 0x7fe25002e030 con 0x7fe258103130 2024-08-20T01:26:59.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.976+0000 7fe25ca9d640 1 --2- 172.21.15.22:0/378362852 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe2480b3bd0 0x7fe2480b6090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe24c005fd0 tx=0x7fe24c00b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:26:59.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:26:59.980+0000 7fe255ffb640 1 -- 172.21.15.22:0/378362852 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe2500cc2f0 con 0x7fe258103130 2024-08-20T01:27:00.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:27:00.173+0000 7fe25ed01640 1 -- 172.21.15.22:0/378362852 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe2581a3390 con 0x7fe2480b3bd0 2024-08-20T01:27:00.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:59 smithi134 ceph-mon[22511]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-08-20T01:27:00.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:59 smithi134 ceph-mon[22511]: osdmap e51: 9 total, 8 up, 9 in 2024-08-20T01:27:00.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:59 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:27:00.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:59 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:27:00.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:59 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:00.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:59 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:00.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:59 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:00.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:59 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:00.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:59 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:00.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:59 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:00.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:59 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:00.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:59 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:27:00.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:59 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:00.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:26:59 smithi134 ceph-mon[22511]: from='osd.8 ' entity='osd.8' 2024-08-20T01:27:00.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:59 smithi077 ceph-mon[22251]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-08-20T01:27:00.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:59 smithi077 ceph-mon[22251]: osdmap e51: 9 total, 8 up, 9 in 2024-08-20T01:27:00.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:59 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:27:00.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:59 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:27:00.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:59 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:00.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:59 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:00.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:59 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:00.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:59 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:00.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:59 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:00.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:59 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:00.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:59 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:00.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:59 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:27:00.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:59 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:00.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:26:59 smithi077 ceph-mon[22251]: from='osd.8 ' entity='osd.8' 2024-08-20T01:27:01.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:00 smithi134 ceph-mon[22511]: purged_snaps scrub starts 2024-08-20T01:27:01.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:00 smithi134 ceph-mon[22511]: purged_snaps scrub ok 2024-08-20T01:27:01.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:00 smithi134 ceph-mon[22511]: Detected new or changed devices on smithi134 2024-08-20T01:27:01.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:00 smithi134 ceph-mon[22511]: Adjusting osd_memory_target on smithi134 to 5696M 2024-08-20T01:27:01.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:00 smithi134 ceph-mon[22511]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:27:01.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:00 smithi134 ceph-mon[22511]: osd.8 [v2:172.21.15.134:6816/1635473481,v1:172.21.15.134:6817/1635473481] boot 2024-08-20T01:27:01.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:00 smithi134 ceph-mon[22511]: osdmap e52: 9 total, 9 up, 9 in 2024-08-20T01:27:01.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:27:01.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:27:01.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:27:01.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:01.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:00 smithi134 ceph-mon[22511]: osdmap e53: 9 total, 9 up, 9 in 2024-08-20T01:27:01.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:00 smithi077 ceph-mon[22251]: purged_snaps scrub starts 2024-08-20T01:27:01.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:00 smithi077 ceph-mon[22251]: purged_snaps scrub ok 2024-08-20T01:27:01.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:00 smithi077 ceph-mon[22251]: Detected new or changed devices on smithi134 2024-08-20T01:27:01.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:00 smithi077 ceph-mon[22251]: Adjusting osd_memory_target on smithi134 to 5696M 2024-08-20T01:27:01.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:00 smithi077 ceph-mon[22251]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:27:01.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:00 smithi077 ceph-mon[22251]: osd.8 [v2:172.21.15.134:6816/1635473481,v1:172.21.15.134:6817/1635473481] boot 2024-08-20T01:27:01.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:00 smithi077 ceph-mon[22251]: osdmap e52: 9 total, 9 up, 9 in 2024-08-20T01:27:01.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:27:01.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:27:01.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:27:01.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:01.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:00 smithi077 ceph-mon[22251]: osdmap e53: 9 total, 9 up, 9 in 2024-08-20T01:27:01.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:00 smithi022 ceph-mon[18709]: purged_snaps scrub starts 2024-08-20T01:27:01.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:00 smithi022 ceph-mon[18709]: purged_snaps scrub ok 2024-08-20T01:27:01.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:00 smithi022 ceph-mon[18709]: Detected new or changed devices on smithi134 2024-08-20T01:27:01.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:00 smithi022 ceph-mon[18709]: Adjusting osd_memory_target on smithi134 to 5696M 2024-08-20T01:27:01.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:00 smithi022 ceph-mon[18709]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:27:01.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:00 smithi022 ceph-mon[18709]: osd.8 [v2:172.21.15.134:6816/1635473481,v1:172.21.15.134:6817/1635473481] boot 2024-08-20T01:27:01.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:00 smithi022 ceph-mon[18709]: osdmap e52: 9 total, 9 up, 9 in 2024-08-20T01:27:01.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:27:01.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:27:01.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:27:01.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:01.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:00 smithi022 ceph-mon[18709]: osdmap e53: 9 total, 9 up, 9 in 2024-08-20T01:27:02.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:01 smithi134 ceph-mon[22511]: from='client.24416 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:27:02.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:01 smithi134 ceph-mon[22511]: osdmap e54: 9 total, 9 up, 9 in 2024-08-20T01:27:02.286 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:01 smithi022 ceph-mon[18709]: from='client.24416 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:27:02.286 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:01 smithi022 ceph-mon[18709]: osdmap e54: 9 total, 9 up, 9 in 2024-08-20T01:27:02.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:01 smithi077 ceph-mon[22251]: from='client.24416 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:27:02.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:01 smithi077 ceph-mon[22251]: osdmap e54: 9 total, 9 up, 9 in 2024-08-20T01:27:03.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:02 smithi022 ceph-mon[18709]: pgmap v197: 1 pgs: 1 peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:03.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:02 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1555738022' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "708f7390-1b51-4397-a92a-8ff3f4a5bc45"} : dispatch 2024-08-20T01:27:03.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:02 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1555738022' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "708f7390-1b51-4397-a92a-8ff3f4a5bc45"}]': finished 2024-08-20T01:27:03.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:02 smithi022 ceph-mon[18709]: osdmap e55: 10 total, 9 up, 10 in 2024-08-20T01:27:03.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:02 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:27:03.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:02 smithi134 ceph-mon[22511]: pgmap v197: 1 pgs: 1 peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:03.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:02 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1555738022' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "708f7390-1b51-4397-a92a-8ff3f4a5bc45"} : dispatch 2024-08-20T01:27:03.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:02 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1555738022' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "708f7390-1b51-4397-a92a-8ff3f4a5bc45"}]': finished 2024-08-20T01:27:03.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:02 smithi134 ceph-mon[22511]: osdmap e55: 10 total, 9 up, 10 in 2024-08-20T01:27:03.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:02 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:27:03.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:02 smithi077 ceph-mon[22251]: pgmap v197: 1 pgs: 1 peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:03.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:02 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1555738022' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "708f7390-1b51-4397-a92a-8ff3f4a5bc45"} : dispatch 2024-08-20T01:27:03.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:02 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1555738022' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "708f7390-1b51-4397-a92a-8ff3f4a5bc45"}]': finished 2024-08-20T01:27:03.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:02 smithi077 ceph-mon[22251]: osdmap e55: 10 total, 9 up, 10 in 2024-08-20T01:27:03.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:02 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:27:04.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:03 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1969817508' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:27:04.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:03 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1969817508' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:27:04.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:03 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1969817508' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:27:05.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:04 smithi134 ceph-mon[22511]: pgmap v200: 1 pgs: 1 peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:05.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:04 smithi077 ceph-mon[22251]: pgmap v200: 1 pgs: 1 peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:05.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:04 smithi022 ceph-mon[18709]: pgmap v200: 1 pgs: 1 peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:07.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:06 smithi134 ceph-mon[22511]: pgmap v201: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:07.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:06 smithi077 ceph-mon[22251]: pgmap v201: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:07.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:06 smithi022 ceph-mon[18709]: pgmap v201: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:09.236 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:08 smithi022 ceph-mon[18709]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-08-20T01:27:09.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:08 smithi134 ceph-mon[22511]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-08-20T01:27:09.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:08 smithi077 ceph-mon[22251]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-08-20T01:27:11.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:10 smithi022 ceph-mon[18709]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:27:11.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:10 smithi134 ceph-mon[22511]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:27:11.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:10 smithi077 ceph-mon[22251]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:27:12.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:11 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-20T01:27:12.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:11 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:12.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:11 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-20T01:27:12.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:11 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:12.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:11 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-20T01:27:12.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:11 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:13.027 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:12 smithi022 ceph-mon[18709]: Deploying daemon osd.9 on smithi022 2024-08-20T01:27:13.027 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:12 smithi022 ceph-mon[18709]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-20T01:27:13.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:12 smithi134 ceph-mon[22511]: Deploying daemon osd.9 on smithi022 2024-08-20T01:27:13.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:12 smithi134 ceph-mon[22511]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-20T01:27:13.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:12 smithi077 ceph-mon[22251]: Deploying daemon osd.9 on smithi022 2024-08-20T01:27:13.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:12 smithi077 ceph-mon[22251]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-20T01:27:15.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:15 smithi134 ceph-mon[22511]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-20T01:27:15.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:15 smithi077 ceph-mon[22251]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-20T01:27:15.374 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:15 smithi022 ceph-mon[18709]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-20T01:27:17.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:17 smithi022 ceph-mon[18709]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:27:17.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:17 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:27:17.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:17 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:17.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:17 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:17.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:17 smithi134 ceph-mon[22511]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:27:17.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:17 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:27:17.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:17 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:17.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:17 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:17.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:17 smithi077 ceph-mon[22251]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:27:17.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:17 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:27:17.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:17 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:17.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:17 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:19.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:19 smithi022 ceph-mon[18709]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:27:19.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:19 smithi134 ceph-mon[22511]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:27:19.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:19 smithi077 ceph-mon[22251]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:27:19.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:27:19.630+0000 7fe255ffb640 1 -- 172.21.15.22:0/378362852 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe2581a3390 con 0x7fe2480b3bd0 2024-08-20T01:27:19.631 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 9 on host 'smithi022' 2024-08-20T01:27:19.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:27:19.632+0000 7fe25ed01640 1 -- 172.21.15.22:0/378362852 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe2480b3bd0 msgr2=0x7fe2480b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:27:19.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:27:19.632+0000 7fe25ed01640 1 --2- 172.21.15.22:0/378362852 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe2480b3bd0 0x7fe2480b6090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe24c005fd0 tx=0x7fe24c00b480 comp rx=0 tx=0).stop 2024-08-20T01:27:19.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:27:19.632+0000 7fe25ed01640 1 -- 172.21.15.22:0/378362852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe258103130 msgr2=0x7fe258104180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:27:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:27:19.632+0000 7fe25ed01640 1 --2- 172.21.15.22:0/378362852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe258103130 0x7fe258104180 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe25002ae00 tx=0x7fe250003ba0 comp rx=0 tx=0).stop 2024-08-20T01:27:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:27:19.632+0000 7fe25ed01640 1 -- 172.21.15.22:0/378362852 shutdown_connections 2024-08-20T01:27:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:27:19.632+0000 7fe25ed01640 1 --2- 172.21.15.22:0/378362852 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe2480b3bd0 0x7fe2480b6090 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:27:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:27:19.632+0000 7fe25ed01640 1 --2- 172.21.15.22:0/378362852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe258103130 0x7fe258104180 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:27:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:27:19.632+0000 7fe25ed01640 1 --2- 172.21.15.22:0/378362852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe258102770 0x7fe258103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:27:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:27:19.632+0000 7fe25ed01640 1 --2- 172.21.15.22:0/378362852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe258101610 0x7fe2581053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:27:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:27:19.632+0000 7fe25ed01640 1 -- 172.21.15.22:0/378362852 >> 172.21.15.22:0/378362852 conn(0x7fe2580fcee0 msgr2=0x7fe2580fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:27:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:27:19.632+0000 7fe25ed01640 1 -- 172.21.15.22:0/378362852 shutdown_connections 2024-08-20T01:27:19.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:27:19.632+0000 7fe25ed01640 1 -- 172.21.15.22:0/378362852 wait complete. 2024-08-20T01:27:20.337 DEBUG:teuthology.orchestra.run.smithi022:osd.9> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.9.service 2024-08-20T01:27:20.339 INFO:tasks.cephadm:Deploying osd.10 on smithi077 with /dev/vg_nvme/lv_1... 2024-08-20T01:27:20.339 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-20T01:27:20.592 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:27:20.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:20 smithi022 ceph-mon[18709]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:20.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:20 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:20.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:20 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:20.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:20 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:20.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:20 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:20.901 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:20 smithi077 ceph-mon[22251]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:20.901 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:20 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:20.901 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:20 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:20.901 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:20 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:20.901 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:20 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:21.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:20 smithi134 ceph-mon[22511]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:21.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:20 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:21.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:20 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:21.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:20 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:21.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:20 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:22.211 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:27:21 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:27:21.975+0000 7f816dd0c640 -1 osd.9 0 log_to_monitors true 2024-08-20T01:27:22.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:22 smithi077 ceph-mon[22251]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:22.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:22 smithi077 ceph-mon[22251]: from='osd.9 [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-20T01:27:22.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:22 smithi022 ceph-mon[18709]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:22.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:22 smithi022 ceph-mon[18709]: from='osd.9 [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-20T01:27:23.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:22 smithi134 ceph-mon[22511]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:23.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:22 smithi134 ceph-mon[22511]: from='osd.9 [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-20T01:27:23.275 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-08-20T01:27:23.301 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_1 2024-08-20T01:27:23.553 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:27:23.967 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:23 smithi077 ceph-mon[22251]: from='osd.9 [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-20T01:27:23.967 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:23 smithi077 ceph-mon[22251]: osdmap e56: 10 total, 9 up, 10 in 2024-08-20T01:27:23.967 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:23 smithi077 ceph-mon[22251]: from='osd.9 [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-08-20T01:27:23.968 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:23 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:27:24.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:23 smithi134 ceph-mon[22511]: from='osd.9 [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-20T01:27:24.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:23 smithi134 ceph-mon[22511]: osdmap e56: 10 total, 9 up, 10 in 2024-08-20T01:27:24.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:23 smithi134 ceph-mon[22511]: from='osd.9 [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-08-20T01:27:24.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:23 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:27:24.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.050+0000 7f71d77d6640 1 -- 172.21.15.77:0/722024085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d0104250 msgr2=0x7f71d010abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:27:24.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.050+0000 7f71d77d6640 1 --2- 172.21.15.77:0/722024085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d0104250 0x7f71d010abd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f71c8009cd0 tx=0x7f71c802a8e0 comp rx=0 tx=0).stop 2024-08-20T01:27:24.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.050+0000 7f71d77d6640 1 -- 172.21.15.77:0/722024085 shutdown_connections 2024-08-20T01:27:24.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.050+0000 7f71d77d6640 1 --2- 172.21.15.77:0/722024085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d0104250 0x7f71d010abd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:27:24.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.050+0000 7f71d77d6640 1 --2- 172.21.15.77:0/722024085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71d0103890 0x7f71d0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:27:24.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.050+0000 7f71d77d6640 1 --2- 172.21.15.77:0/722024085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71d0102730 0x7f71d0102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:27:24.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.050+0000 7f71d77d6640 1 -- 172.21.15.77:0/722024085 >> 172.21.15.77:0/722024085 conn(0x7f71d00fe020 msgr2=0x7f71d0100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:27:24.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.050+0000 7f71d77d6640 1 -- 172.21.15.77:0/722024085 shutdown_connections 2024-08-20T01:27:24.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.051+0000 7f71d77d6640 1 -- 172.21.15.77:0/722024085 wait complete. 2024-08-20T01:27:24.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.051+0000 7f71d77d6640 1 Processor -- start 2024-08-20T01:27:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.051+0000 7f71d77d6640 1 -- start start 2024-08-20T01:27:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.051+0000 7f71d77d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71d0102730 0x7f71d0198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:27:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.051+0000 7f71d77d6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71d0103890 0x7f71d01991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:27:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.051+0000 7f71d77d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d0104250 0x7f71d0199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:27:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.051+0000 7f71d77d6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f71d010e3b0 con 0x7f71d0103890 2024-08-20T01:27:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.051+0000 7f71d77d6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f71d010e230 con 0x7f71d0104250 2024-08-20T01:27:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.051+0000 7f71d77d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f71d010e530 con 0x7f71d0102730 2024-08-20T01:27:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.051+0000 7f71d5d73640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d0104250 0x7f71d0199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:27:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.051+0000 7f71d5d73640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d0104250 0x7f71d0199e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35678/0 (socket says 172.21.15.77:35678) 2024-08-20T01:27:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.051+0000 7f71d5d73640 1 -- 172.21.15.77:0/1290578503 learned_addr learned my addr 172.21.15.77:0/1290578503 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-08-20T01:27:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.051+0000 7f71d4d71640 1 --2- 172.21.15.77:0/1290578503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71d0103890 0x7f71d01991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:27:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.052+0000 7f71d5572640 1 --2- 172.21.15.77:0/1290578503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71d0102730 0x7f71d0198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:27:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.052+0000 7f71d5d73640 1 -- 172.21.15.77:0/1290578503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71d0102730 msgr2=0x7f71d0198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:27:24.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.052+0000 7f71d5d73640 1 --2- 172.21.15.77:0/1290578503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71d0102730 0x7f71d0198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:27:24.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.052+0000 7f71d5d73640 1 -- 172.21.15.77:0/1290578503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71d0103890 msgr2=0x7f71d01991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:27:24.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.052+0000 7f71d5d73640 1 --2- 172.21.15.77:0/1290578503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71d0103890 0x7f71d01991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:27:24.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.052+0000 7f71d5d73640 1 -- 172.21.15.77:0/1290578503 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d019a6a0 con 0x7f71d0104250 2024-08-20T01:27:24.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.052+0000 7f71d5d73640 1 --2- 172.21.15.77:0/1290578503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d0104250 0x7f71d0199e00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f71c80317d0 tx=0x7f71c8003ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:27:24.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.052+0000 7f71c67fc640 1 -- 172.21.15.77:0/1290578503 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c8004450 con 0x7f71d0104250 2024-08-20T01:27:24.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.052+0000 7f71c67fc640 1 -- 172.21.15.77:0/1290578503 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71c80045f0 con 0x7f71d0104250 2024-08-20T01:27:24.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.052+0000 7f71c67fc640 1 -- 172.21.15.77:0/1290578503 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c8045670 con 0x7f71d0104250 2024-08-20T01:27:24.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.052+0000 7f71d77d6640 1 -- 172.21.15.77:0/1290578503 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d019a930 con 0x7f71d0104250 2024-08-20T01:27:24.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.052+0000 7f71d77d6640 1 -- 172.21.15.77:0/1290578503 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d01a0ea0 con 0x7f71d0104250 2024-08-20T01:27:24.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.053+0000 7f71d77d6640 1 -- 172.21.15.77:0/1290578503 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71d0109a30 con 0x7f71d0104250 2024-08-20T01:27:24.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.054+0000 7f71c67fc640 1 -- 172.21.15.77:0/1290578503 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f71c8043020 con 0x7f71d0104250 2024-08-20T01:27:24.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.055+0000 7f71c67fc640 1 --2- 172.21.15.77:0/1290578503 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f71bc0b3c50 0x7f71bc0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:27:24.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.055+0000 7f71c67fc640 1 -- 172.21.15.77:0/1290578503 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5981+0+0 (secure 0 0 0) 0x7f71c802e030 con 0x7f71d0104250 2024-08-20T01:27:24.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.055+0000 7f71d5572640 1 --2- 172.21.15.77:0/1290578503 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f71bc0b3c50 0x7f71bc0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:27:24.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.056+0000 7f71d5572640 1 --2- 172.21.15.77:0/1290578503 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f71bc0b3c50 0x7f71bc0b6110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f71cc005fd0 tx=0x7f71cc005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:27:24.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.058+0000 7f71c67fc640 1 -- 172.21.15.77:0/1290578503 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f71c804a060 con 0x7f71d0104250 2024-08-20T01:27:24.135 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:27:23 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:27:23.642+0000 7f8169c8f640 -1 osd.9 0 waiting for initial osdmap 2024-08-20T01:27:24.135 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:27:23 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:27:23.654+0000 7f8165ab6640 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:27:24.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:23 smithi022 ceph-mon[18709]: from='osd.9 [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-20T01:27:24.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:23 smithi022 ceph-mon[18709]: osdmap e56: 10 total, 9 up, 10 in 2024-08-20T01:27:24.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:23 smithi022 ceph-mon[18709]: from='osd.9 [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-08-20T01:27:24.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:23 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:27:24.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:24.241+0000 7f71d77d6640 1 -- 172.21.15.77:0/1290578503 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f71d00632c0 con 0x7f71bc0b3c50 2024-08-20T01:27:24.898 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:24.899 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='osd.9 [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-08-20T01:27:24.899 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: osdmap e57: 10 total, 9 up, 10 in 2024-08-20T01:27:24.899 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:27:24.899 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:27:24.899 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: Detected new or changed devices on smithi022 2024-08-20T01:27:24.899 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:24.899 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:24.899 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:24.899 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:24.899 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:24.899 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:24.899 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: Adjusting osd_memory_target on smithi022 to 4273M 2024-08-20T01:27:24.899 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:24.899 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:24.900 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:27:24.900 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:24.900 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:27:24.900 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:24.900 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:27:24.900 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:24.900 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:27:24.900 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:27:24.900 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:25.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:25.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='osd.9 [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-08-20T01:27:25.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: osdmap e57: 10 total, 9 up, 10 in 2024-08-20T01:27:25.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:27:25.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:27:25.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: Detected new or changed devices on smithi022 2024-08-20T01:27:25.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:25.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:25.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:25.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:25.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:25.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:25.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: Adjusting osd_memory_target on smithi022 to 4273M 2024-08-20T01:27:25.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:25.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:25.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:27:25.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:25.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:27:25.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:25.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:27:25.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:25.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:27:25.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:27:25.019 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:25.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:25.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='osd.9 [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-08-20T01:27:25.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: osdmap e57: 10 total, 9 up, 10 in 2024-08-20T01:27:25.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:27:25.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:27:25.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: Detected new or changed devices on smithi022 2024-08-20T01:27:25.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:25.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:25.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:25.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:25.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:25.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:25.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: Adjusting osd_memory_target on smithi022 to 4273M 2024-08-20T01:27:25.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:25.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:25.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:27:25.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:25.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:27:25.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:25.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:27:25.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:25.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:27:25.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:27:25.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:25.916 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:25 smithi077 ceph-mon[22251]: purged_snaps scrub starts 2024-08-20T01:27:25.917 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:25 smithi077 ceph-mon[22251]: purged_snaps scrub ok 2024-08-20T01:27:25.917 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:25 smithi077 ceph-mon[22251]: from='client.24440 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:27:25.917 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:25 smithi077 ceph-mon[22251]: osd.9 [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933] boot 2024-08-20T01:27:25.917 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:25 smithi077 ceph-mon[22251]: osdmap e58: 10 total, 10 up, 10 in 2024-08-20T01:27:25.917 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:25 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:27:26.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:25 smithi134 ceph-mon[22511]: purged_snaps scrub starts 2024-08-20T01:27:26.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:25 smithi134 ceph-mon[22511]: purged_snaps scrub ok 2024-08-20T01:27:26.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:25 smithi134 ceph-mon[22511]: from='client.24440 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:27:26.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:25 smithi134 ceph-mon[22511]: osd.9 [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933] boot 2024-08-20T01:27:26.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:25 smithi134 ceph-mon[22511]: osdmap e58: 10 total, 10 up, 10 in 2024-08-20T01:27:26.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:25 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:27:26.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:25 smithi022 ceph-mon[18709]: purged_snaps scrub starts 2024-08-20T01:27:26.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:25 smithi022 ceph-mon[18709]: purged_snaps scrub ok 2024-08-20T01:27:26.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:25 smithi022 ceph-mon[18709]: from='client.24440 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:27:26.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:25 smithi022 ceph-mon[18709]: osd.9 [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933] boot 2024-08-20T01:27:26.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:25 smithi022 ceph-mon[18709]: osdmap e58: 10 total, 10 up, 10 in 2024-08-20T01:27:26.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:25 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:27:26.954 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:26 smithi077 ceph-mon[22251]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:26.955 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:26 smithi077 ceph-mon[22251]: osdmap e59: 10 total, 10 up, 10 in 2024-08-20T01:27:26.955 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:26 smithi077 ceph-mon[22251]: from='client.? 172.21.15.77:0/3775929570' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d15b0acd-dd08-431d-88aa-756b6420987d"} : dispatch 2024-08-20T01:27:26.955 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:26 smithi077 ceph-mon[22251]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d15b0acd-dd08-431d-88aa-756b6420987d"} : dispatch 2024-08-20T01:27:26.955 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:26 smithi077 ceph-mon[22251]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d15b0acd-dd08-431d-88aa-756b6420987d"}]': finished 2024-08-20T01:27:26.955 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:26 smithi077 ceph-mon[22251]: osdmap e60: 11 total, 10 up, 11 in 2024-08-20T01:27:26.955 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:26 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:27:27.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:26 smithi134 ceph-mon[22511]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:27.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:26 smithi134 ceph-mon[22511]: osdmap e59: 10 total, 10 up, 10 in 2024-08-20T01:27:27.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:26 smithi134 ceph-mon[22511]: from='client.? 172.21.15.77:0/3775929570' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d15b0acd-dd08-431d-88aa-756b6420987d"} : dispatch 2024-08-20T01:27:27.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:26 smithi134 ceph-mon[22511]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d15b0acd-dd08-431d-88aa-756b6420987d"} : dispatch 2024-08-20T01:27:27.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:26 smithi134 ceph-mon[22511]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d15b0acd-dd08-431d-88aa-756b6420987d"}]': finished 2024-08-20T01:27:27.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:26 smithi134 ceph-mon[22511]: osdmap e60: 11 total, 10 up, 11 in 2024-08-20T01:27:27.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:26 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:27:27.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:26 smithi022 ceph-mon[18709]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:27:27.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:26 smithi022 ceph-mon[18709]: osdmap e59: 10 total, 10 up, 10 in 2024-08-20T01:27:27.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:26 smithi022 ceph-mon[18709]: from='client.? 172.21.15.77:0/3775929570' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d15b0acd-dd08-431d-88aa-756b6420987d"} : dispatch 2024-08-20T01:27:27.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:26 smithi022 ceph-mon[18709]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d15b0acd-dd08-431d-88aa-756b6420987d"} : dispatch 2024-08-20T01:27:27.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:26 smithi022 ceph-mon[18709]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d15b0acd-dd08-431d-88aa-756b6420987d"}]': finished 2024-08-20T01:27:27.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:26 smithi022 ceph-mon[18709]: osdmap e60: 11 total, 10 up, 11 in 2024-08-20T01:27:27.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:26 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:27:28.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:27 smithi134 ceph-mon[22511]: from='client.? 172.21.15.77:0/2515994706' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:27:28.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:27 smithi077 ceph-mon[22251]: from='client.? 172.21.15.77:0/2515994706' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:27:28.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:27 smithi022 ceph-mon[18709]: from='client.? 172.21.15.77:0/2515994706' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:27:29.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:28 smithi134 ceph-mon[22511]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:29.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:28 smithi077 ceph-mon[22251]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:29.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:28 smithi022 ceph-mon[18709]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:31.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:30 smithi134 ceph-mon[22511]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:31.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:30 smithi077 ceph-mon[22251]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:31.095 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:30 smithi022 ceph-mon[18709]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:32.911 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:32 smithi077 ceph-mon[22251]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:33.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:32 smithi134 ceph-mon[22511]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:33.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:32 smithi022 ceph-mon[18709]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:35.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:34 smithi134 ceph-mon[22511]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:35.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:34 smithi077 ceph-mon[22251]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:35.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:34 smithi022 ceph-mon[18709]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:35.793 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:35 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-20T01:27:35.793 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:35 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:36.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:35 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-20T01:27:36.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:35 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:36.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:35 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-20T01:27:36.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:35 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:36.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:36 smithi077 ceph-mon[22251]: Deploying daemon osd.10 on smithi077 2024-08-20T01:27:36.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:36 smithi077 ceph-mon[22251]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:37.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:36 smithi134 ceph-mon[22511]: Deploying daemon osd.10 on smithi077 2024-08-20T01:27:37.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:36 smithi134 ceph-mon[22511]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:37.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:36 smithi022 ceph-mon[18709]: Deploying daemon osd.10 on smithi077 2024-08-20T01:27:37.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:36 smithi022 ceph-mon[18709]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:38.985 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:38 smithi077 ceph-mon[22251]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:39.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:38 smithi134 ceph-mon[22511]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:39.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:38 smithi022 ceph-mon[18709]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:40.984 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:40 smithi077 ceph-mon[22251]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:41.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:40 smithi134 ceph-mon[22511]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:41.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:40 smithi022 ceph-mon[18709]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:42.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:41 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:27:42.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:41 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:42.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:41 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:42.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:41 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:27:42.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:41 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:42.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:41 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:42.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:41 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:27:42.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:41 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:42.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:41 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:43.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:42 smithi134 ceph-mon[22511]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:43.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:42 smithi077 ceph-mon[22251]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:43.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:42 smithi022 ceph-mon[18709]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:44.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:44.486+0000 7f71c67fc640 1 -- 172.21.15.77:0/1290578503 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f71d00632c0 con 0x7f71bc0b3c50 2024-08-20T01:27:44.487 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 10 on host 'smithi077' 2024-08-20T01:27:44.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:44.488+0000 7f71d77d6640 1 -- 172.21.15.77:0/1290578503 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f71bc0b3c50 msgr2=0x7f71bc0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:27:44.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:44.488+0000 7f71d77d6640 1 --2- 172.21.15.77:0/1290578503 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f71bc0b3c50 0x7f71bc0b6110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f71cc005fd0 tx=0x7f71cc005e20 comp rx=0 tx=0).stop 2024-08-20T01:27:44.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:44.488+0000 7f71d77d6640 1 -- 172.21.15.77:0/1290578503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d0104250 msgr2=0x7f71d0199e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:27:44.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:44.488+0000 7f71d77d6640 1 --2- 172.21.15.77:0/1290578503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d0104250 0x7f71d0199e00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f71c80317d0 tx=0x7f71c8003ce0 comp rx=0 tx=0).stop 2024-08-20T01:27:44.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:44.488+0000 7f71d77d6640 1 -- 172.21.15.77:0/1290578503 shutdown_connections 2024-08-20T01:27:44.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:44.488+0000 7f71d77d6640 1 --2- 172.21.15.77:0/1290578503 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f71bc0b3c50 0x7f71bc0b6110 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:27:44.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:44.488+0000 7f71d77d6640 1 --2- 172.21.15.77:0/1290578503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d0104250 0x7f71d0199e00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:27:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:44.488+0000 7f71d77d6640 1 --2- 172.21.15.77:0/1290578503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71d0103890 0x7f71d01991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:27:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:44.488+0000 7f71d77d6640 1 --2- 172.21.15.77:0/1290578503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71d0102730 0x7f71d0198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:27:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:44.488+0000 7f71d77d6640 1 -- 172.21.15.77:0/1290578503 >> 172.21.15.77:0/1290578503 conn(0x7f71d00fe020 msgr2=0x7f71d0106c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:27:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:44.489+0000 7f71d77d6640 1 -- 172.21.15.77:0/1290578503 shutdown_connections 2024-08-20T01:27:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-08-20T01:27:44.489+0000 7f71d77d6640 1 -- 172.21.15.77:0/1290578503 wait complete. 2024-08-20T01:27:45.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:44 smithi077 ceph-mon[22251]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:45.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:44 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:45.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:44 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:45.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:44 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:45.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:44 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:27:45.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:44 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:45.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:44 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:27:45.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:44 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:45.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:44 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:45.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:44 smithi022 ceph-mon[18709]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:45.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:44 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:45.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:44 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:45.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:44 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:45.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:44 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:27:45.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:44 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:45.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:44 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:27:45.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:44 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:45.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:44 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:45.143 DEBUG:teuthology.orchestra.run.smithi077:osd.10> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.10.service 2024-08-20T01:27:45.146 INFO:tasks.cephadm:Deploying osd.11 on smithi134 with /dev/vg_nvme/lv_1... 2024-08-20T01:27:45.146 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-20T01:27:45.174 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:44 smithi134 ceph-mon[22511]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:45.174 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:44 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:45.174 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:44 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:45.174 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:44 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:45.174 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:44 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:27:45.174 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:44 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:45.174 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:44 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:27:45.174 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:44 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:45.175 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:44 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:45.401 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:27:46.945 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:46 smithi077 ceph-mon[22251]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:47.108 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:46 smithi134 ceph-mon[22511]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:47.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:46 smithi022 ceph-mon[18709]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:47.313 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:27:47 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:27:47.013+0000 7fa15cf8b640 -1 osd.10 0 log_to_monitors true 2024-08-20T01:27:48.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:47 smithi077 ceph-mon[22251]: from='osd.10 [v2:172.21.15.77:6824/2765589872,v1:172.21.15.77:6825/2765589872]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-20T01:27:48.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:47 smithi077 ceph-mon[22251]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-20T01:27:48.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:47 smithi022 ceph-mon[18709]: from='osd.10 [v2:172.21.15.77:6824/2765589872,v1:172.21.15.77:6825/2765589872]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-20T01:27:48.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:47 smithi022 ceph-mon[18709]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-20T01:27:48.197 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:47 smithi134 ceph-mon[22511]: from='osd.10 [v2:172.21.15.77:6824/2765589872,v1:172.21.15.77:6825/2765589872]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-20T01:27:48.197 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:47 smithi134 ceph-mon[22511]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-20T01:27:48.200 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-08-20T01:27:48.226 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_1 2024-08-20T01:27:48.512 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:27:48.926 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:48 smithi134 ceph-mon[22511]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:48.926 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:48 smithi134 ceph-mon[22511]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-20T01:27:48.926 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:48 smithi134 ceph-mon[22511]: osdmap e61: 11 total, 10 up, 11 in 2024-08-20T01:27:48.926 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:27:48.926 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:48 smithi134 ceph-mon[22511]: from='osd.10 [v2:172.21.15.77:6824/2765589872,v1:172.21.15.77:6825/2765589872]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:27:48.927 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:48 smithi134 ceph-mon[22511]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:27:48.927 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:48.927 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:48.927 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:48.927 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:48.927 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:48.927 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:48.927 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:48.927 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:48.927 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:27:48.927 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:49.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.007+0000 7fc4443c6640 1 -- 172.21.15.134:0/523080452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc43c103890 msgr2=0x7fc43c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:27:49.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.007+0000 7fc4443c6640 1 --2- 172.21.15.134:0/523080452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc43c103890 0x7fc43c103d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009960 tx=0x7fc42c02a460 comp rx=0 tx=0).stop 2024-08-20T01:27:49.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.007+0000 7fc4443c6640 1 -- 172.21.15.134:0/523080452 shutdown_connections 2024-08-20T01:27:49.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.007+0000 7fc4443c6640 1 --2- 172.21.15.134:0/523080452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc43c104250 0x7fc43c10abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:27:49.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.007+0000 7fc4443c6640 1 --2- 172.21.15.134:0/523080452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc43c103890 0x7fc43c103d10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:27:49.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.007+0000 7fc4443c6640 1 --2- 172.21.15.134:0/523080452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc43c102730 0x7fc43c102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:27:49.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.007+0000 7fc4443c6640 1 -- 172.21.15.134:0/523080452 >> 172.21.15.134:0/523080452 conn(0x7fc43c0fe020 msgr2=0x7fc43c100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:27:49.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.007+0000 7fc4443c6640 1 -- 172.21.15.134:0/523080452 shutdown_connections 2024-08-20T01:27:49.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.007+0000 7fc4443c6640 1 -- 172.21.15.134:0/523080452 wait complete. 2024-08-20T01:27:49.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.008+0000 7fc4443c6640 1 Processor -- start 2024-08-20T01:27:49.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.008+0000 7fc4443c6640 1 -- start start 2024-08-20T01:27:49.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.008+0000 7fc4443c6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc43c102730 0x7fc43c198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:27:49.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.008+0000 7fc4443c6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc43c103890 0x7fc43c199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:27:49.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.008+0000 7fc4443c6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc43c104250 0x7fc43c199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:27:49.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.008+0000 7fc4443c6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c10e390 con 0x7fc43c104250 2024-08-20T01:27:49.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.008+0000 7fc4443c6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c10e210 con 0x7fc43c102730 2024-08-20T01:27:49.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.008+0000 7fc4443c6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c10e510 con 0x7fc43c103890 2024-08-20T01:27:49.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.008+0000 7fc441961640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc43c103890 0x7fc43c199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:27:49.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.008+0000 7fc441961640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc43c103890 0x7fc43c199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55028/0 (socket says 172.21.15.134:55028) 2024-08-20T01:27:49.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.008+0000 7fc441961640 1 -- 172.21.15.134:0/1957067113 learned_addr learned my addr 172.21.15.134:0/1957067113 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-08-20T01:27:49.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.008+0000 7fc442162640 1 --2- 172.21.15.134:0/1957067113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc43c102730 0x7fc43c198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:27:49.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.008+0000 7fc442963640 1 --2- 172.21.15.134:0/1957067113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc43c104250 0x7fc43c199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:27:49.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.009+0000 7fc441961640 1 -- 172.21.15.134:0/1957067113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc43c102730 msgr2=0x7fc43c198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:27:49.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.009+0000 7fc441961640 1 --2- 172.21.15.134:0/1957067113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc43c102730 0x7fc43c198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:27:49.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.009+0000 7fc441961640 1 -- 172.21.15.134:0/1957067113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc43c104250 msgr2=0x7fc43c199da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:27:49.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.009+0000 7fc441961640 1 --2- 172.21.15.134:0/1957067113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc43c104250 0x7fc43c199da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:27:49.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.009+0000 7fc441961640 1 -- 172.21.15.134:0/1957067113 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43c19a640 con 0x7fc43c103890 2024-08-20T01:27:49.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.009+0000 7fc441961640 1 --2- 172.21.15.134:0/1957067113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc43c103890 0x7fc43c199160 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc42c006010 tx=0x7fc42c0042e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:27:49.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.009+0000 7fc4337fe640 1 -- 172.21.15.134:0/1957067113 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c03f030 con 0x7fc43c103890 2024-08-20T01:27:49.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.009+0000 7fc4337fe640 1 -- 172.21.15.134:0/1957067113 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc42c003aa0 con 0x7fc43c103890 2024-08-20T01:27:49.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.009+0000 7fc4443c6640 1 -- 172.21.15.134:0/1957067113 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc43c19a8d0 con 0x7fc43c103890 2024-08-20T01:27:49.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.009+0000 7fc4337fe640 1 -- 172.21.15.134:0/1957067113 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c035070 con 0x7fc43c103890 2024-08-20T01:27:49.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.009+0000 7fc4443c6640 1 -- 172.21.15.134:0/1957067113 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc43c1a1010 con 0x7fc43c103890 2024-08-20T01:27:49.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.010+0000 7fc4443c6640 1 -- 172.21.15.134:0/1957067113 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc43c102b30 con 0x7fc43c103890 2024-08-20T01:27:49.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.011+0000 7fc4337fe640 1 -- 172.21.15.134:0/1957067113 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fc42c042030 con 0x7fc43c103890 2024-08-20T01:27:49.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.012+0000 7fc4337fe640 1 --2- 172.21.15.134:0/1957067113 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc4280b3c50 0x7fc4280b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:27:49.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.012+0000 7fc4337fe640 1 -- 172.21.15.134:0/1957067113 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6414+0+0 (secure 0 0 0) 0x7fc42c103da0 con 0x7fc43c103890 2024-08-20T01:27:49.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.012+0000 7fc442162640 1 --2- 172.21.15.134:0/1957067113 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc4280b3c50 0x7fc4280b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:27:49.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.013+0000 7fc442162640 1 --2- 172.21.15.134:0/1957067113 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc4280b3c50 0x7fc4280b6110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc43800bbe0 tx=0x7fc43800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:27:49.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.015+0000 7fc4337fe640 1 -- 172.21.15.134:0/1957067113 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fc42c0cbb60 con 0x7fc43c103890 2024-08-20T01:27:49.063 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:27:48 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:27:48.805+0000 7fa158f0e640 -1 osd.10 0 waiting for initial osdmap 2024-08-20T01:27:49.064 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:27:48 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:27:48.816+0000 7fa154d35640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:27:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:48 smithi077 ceph-mon[22251]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:48 smithi077 ceph-mon[22251]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-20T01:27:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:48 smithi077 ceph-mon[22251]: osdmap e61: 11 total, 10 up, 11 in 2024-08-20T01:27:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:27:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:48 smithi077 ceph-mon[22251]: from='osd.10 [v2:172.21.15.77:6824/2765589872,v1:172.21.15.77:6825/2765589872]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:27:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:48 smithi077 ceph-mon[22251]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:27:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:49.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:49.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:49.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:49.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:49.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:49.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:49.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:27:49.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:49.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:48 smithi022 ceph-mon[18709]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:49.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:48 smithi022 ceph-mon[18709]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-20T01:27:49.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:48 smithi022 ceph-mon[18709]: osdmap e61: 11 total, 10 up, 11 in 2024-08-20T01:27:49.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:27:49.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:48 smithi022 ceph-mon[18709]: from='osd.10 [v2:172.21.15.77:6824/2765589872,v1:172.21.15.77:6825/2765589872]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:27:49.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:48 smithi022 ceph-mon[18709]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]} : dispatch 2024-08-20T01:27:49.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:49.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:49.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:49.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:49.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:49.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T01:27:49.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:49.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:49.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:27:49.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:27:49.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:27:49.204+0000 7fc4443c6640 1 -- 172.21.15.134:0/1957067113 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc43c0632c0 con 0x7fc4280b3c50 2024-08-20T01:27:49.888 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:49 smithi134 ceph-mon[22511]: Detected new or changed devices on smithi077 2024-08-20T01:27:49.888 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:49 smithi134 ceph-mon[22511]: Adjusting osd_memory_target on smithi077 to 4272M 2024-08-20T01:27:49.888 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:49 smithi134 ceph-mon[22511]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-08-20T01:27:49.888 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:49 smithi134 ceph-mon[22511]: osdmap e62: 11 total, 10 up, 11 in 2024-08-20T01:27:49.888 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:27:49.889 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:27:49.889 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:27:49.889 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:27:49.889 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:49.889 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:27:50.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:49 smithi022 ceph-mon[18709]: Detected new or changed devices on smithi077 2024-08-20T01:27:50.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:49 smithi022 ceph-mon[18709]: Adjusting osd_memory_target on smithi077 to 4272M 2024-08-20T01:27:50.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:49 smithi022 ceph-mon[18709]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-08-20T01:27:50.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:49 smithi022 ceph-mon[18709]: osdmap e62: 11 total, 10 up, 11 in 2024-08-20T01:27:50.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:27:50.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:27:50.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:27:50.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:27:50.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:50.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:27:50.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:49 smithi077 ceph-mon[22251]: Detected new or changed devices on smithi077 2024-08-20T01:27:50.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:49 smithi077 ceph-mon[22251]: Adjusting osd_memory_target on smithi077 to 4272M 2024-08-20T01:27:50.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:49 smithi077 ceph-mon[22251]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-08-20T01:27:50.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:49 smithi077 ceph-mon[22251]: osdmap e62: 11 total, 10 up, 11 in 2024-08-20T01:27:50.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:27:50.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:27:50.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:27:50.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:27:50.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:50.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:27:51.088 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:50 smithi134 ceph-mon[22511]: purged_snaps scrub starts 2024-08-20T01:27:51.089 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:50 smithi134 ceph-mon[22511]: purged_snaps scrub ok 2024-08-20T01:27:51.089 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:50 smithi134 ceph-mon[22511]: from='client.24466 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:27:51.089 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:50 smithi134 ceph-mon[22511]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:51.089 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:50 smithi134 ceph-mon[22511]: osd.10 [v2:172.21.15.77:6824/2765589872,v1:172.21.15.77:6825/2765589872] boot 2024-08-20T01:27:51.089 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:50 smithi134 ceph-mon[22511]: osdmap e63: 11 total, 11 up, 11 in 2024-08-20T01:27:51.089 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:50 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:27:51.089 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:50 smithi134 ceph-mon[22511]: osdmap e64: 11 total, 11 up, 11 in 2024-08-20T01:27:51.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:50 smithi022 ceph-mon[18709]: purged_snaps scrub starts 2024-08-20T01:27:51.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:50 smithi022 ceph-mon[18709]: purged_snaps scrub ok 2024-08-20T01:27:51.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:50 smithi022 ceph-mon[18709]: from='client.24466 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:27:51.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:50 smithi022 ceph-mon[18709]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:51.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:50 smithi022 ceph-mon[18709]: osd.10 [v2:172.21.15.77:6824/2765589872,v1:172.21.15.77:6825/2765589872] boot 2024-08-20T01:27:51.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:50 smithi022 ceph-mon[18709]: osdmap e63: 11 total, 11 up, 11 in 2024-08-20T01:27:51.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:50 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:27:51.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:50 smithi022 ceph-mon[18709]: osdmap e64: 11 total, 11 up, 11 in 2024-08-20T01:27:51.262 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:50 smithi077 ceph-mon[22251]: purged_snaps scrub starts 2024-08-20T01:27:51.262 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:50 smithi077 ceph-mon[22251]: purged_snaps scrub ok 2024-08-20T01:27:51.262 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:50 smithi077 ceph-mon[22251]: from='client.24466 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:27:51.262 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:50 smithi077 ceph-mon[22251]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:27:51.262 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:50 smithi077 ceph-mon[22251]: osd.10 [v2:172.21.15.77:6824/2765589872,v1:172.21.15.77:6825/2765589872] boot 2024-08-20T01:27:51.262 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:50 smithi077 ceph-mon[22251]: osdmap e63: 11 total, 11 up, 11 in 2024-08-20T01:27:51.262 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:50 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:27:51.262 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:50 smithi077 ceph-mon[22251]: osdmap e64: 11 total, 11 up, 11 in 2024-08-20T01:27:52.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:52 smithi134 ceph-mon[22511]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:27:52.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:52 smithi134 ceph-mon[22511]: osdmap e65: 11 total, 11 up, 11 in 2024-08-20T01:27:52.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:52 smithi134 ceph-mon[22511]: from='client.? 172.21.15.134:0/1793390591' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d15017fa-3c3d-4096-a35d-275cd54bb9e9"} : dispatch 2024-08-20T01:27:52.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:52 smithi134 ceph-mon[22511]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d15017fa-3c3d-4096-a35d-275cd54bb9e9"} : dispatch 2024-08-20T01:27:52.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:52 smithi134 ceph-mon[22511]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d15017fa-3c3d-4096-a35d-275cd54bb9e9"}]': finished 2024-08-20T01:27:52.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:52 smithi134 ceph-mon[22511]: osdmap e66: 12 total, 11 up, 12 in 2024-08-20T01:27:52.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:52 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:27:52.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:52 smithi134 ceph-mon[22511]: from='client.? 172.21.15.134:0/3805812783' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:27:52.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:52 smithi077 ceph-mon[22251]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:27:52.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:52 smithi077 ceph-mon[22251]: osdmap e65: 11 total, 11 up, 11 in 2024-08-20T01:27:52.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:52 smithi077 ceph-mon[22251]: from='client.? 172.21.15.134:0/1793390591' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d15017fa-3c3d-4096-a35d-275cd54bb9e9"} : dispatch 2024-08-20T01:27:52.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:52 smithi077 ceph-mon[22251]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d15017fa-3c3d-4096-a35d-275cd54bb9e9"} : dispatch 2024-08-20T01:27:52.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:52 smithi077 ceph-mon[22251]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d15017fa-3c3d-4096-a35d-275cd54bb9e9"}]': finished 2024-08-20T01:27:52.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:52 smithi077 ceph-mon[22251]: osdmap e66: 12 total, 11 up, 12 in 2024-08-20T01:27:52.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:52 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:27:52.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:52 smithi077 ceph-mon[22251]: from='client.? 172.21.15.134:0/3805812783' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:27:52.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:52 smithi022 ceph-mon[18709]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:27:52.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:52 smithi022 ceph-mon[18709]: osdmap e65: 11 total, 11 up, 11 in 2024-08-20T01:27:52.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:52 smithi022 ceph-mon[18709]: from='client.? 172.21.15.134:0/1793390591' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d15017fa-3c3d-4096-a35d-275cd54bb9e9"} : dispatch 2024-08-20T01:27:52.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:52 smithi022 ceph-mon[18709]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d15017fa-3c3d-4096-a35d-275cd54bb9e9"} : dispatch 2024-08-20T01:27:52.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:52 smithi022 ceph-mon[18709]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d15017fa-3c3d-4096-a35d-275cd54bb9e9"}]': finished 2024-08-20T01:27:52.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:52 smithi022 ceph-mon[18709]: osdmap e66: 12 total, 11 up, 12 in 2024-08-20T01:27:52.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:52 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:27:52.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:52 smithi022 ceph-mon[18709]: from='client.? 172.21.15.134:0/3805812783' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:27:54.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:54 smithi134 ceph-mon[22511]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:27:54.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:54 smithi077 ceph-mon[22251]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:27:54.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:54 smithi022 ceph-mon[18709]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:27:56.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:56 smithi134 ceph-mon[22511]: pgmap v237: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:27:56.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:56 smithi077 ceph-mon[22251]: pgmap v237: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:27:56.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:56 smithi022 ceph-mon[18709]: pgmap v237: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:27:58.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:27:58 smithi134 ceph-mon[22511]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-08-20T01:27:58.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:27:58 smithi077 ceph-mon[22251]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-08-20T01:27:58.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:27:58 smithi022 ceph-mon[18709]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-08-20T01:28:00.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:00 smithi022 ceph-mon[18709]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:28:00.672 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:00 smithi134 ceph-mon[22511]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:28:00.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:00 smithi077 ceph-mon[22251]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:28:01.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:01 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-20T01:28:01.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:01 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:01.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:01 smithi134 ceph-mon[22511]: Deploying daemon osd.11 on smithi134 2024-08-20T01:28:01.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:01 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-20T01:28:01.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:01 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:01.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:01 smithi077 ceph-mon[22251]: Deploying daemon osd.11 on smithi134 2024-08-20T01:28:01.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:01 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-20T01:28:01.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:01 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:01.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:01 smithi022 ceph-mon[18709]: Deploying daemon osd.11 on smithi134 2024-08-20T01:28:02.743 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:02 smithi134 ceph-mon[22511]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-20T01:28:02.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:02 smithi077 ceph-mon[22251]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-20T01:28:02.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:02 smithi022 ceph-mon[18709]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-20T01:28:04.550 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:04 smithi134 ceph-mon[22511]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-20T01:28:04.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:04 smithi077 ceph-mon[22251]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-20T01:28:04.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:04 smithi022 ceph-mon[18709]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-20T01:28:06.739 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:06 smithi134 ceph-mon[22511]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:28:06.739 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:06 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:06.739 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:06 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:06.739 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:06 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:06.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:06 smithi077 ceph-mon[22251]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:28:06.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:06 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:06.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:06 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:06.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:06 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:06.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:06 smithi022 ceph-mon[18709]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:28:06.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:06 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:06.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:06 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:06.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:06 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:08.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:08 smithi134 ceph-mon[22511]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:28:08.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:08 smithi077 ceph-mon[22251]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:28:08.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:08 smithi022 ceph-mon[18709]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:28:09.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:09.872+0000 7fc4337fe640 1 -- 172.21.15.134:0/1957067113 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fc43c0632c0 con 0x7fc4280b3c50 2024-08-20T01:28:09.872 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 11 on host 'smithi134' 2024-08-20T01:28:09.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:09.874+0000 7fc4443c6640 1 -- 172.21.15.134:0/1957067113 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc4280b3c50 msgr2=0x7fc4280b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:09.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:09.874+0000 7fc4443c6640 1 --2- 172.21.15.134:0/1957067113 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc4280b3c50 0x7fc4280b6110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc43800bbe0 tx=0x7fc43800b390 comp rx=0 tx=0).stop 2024-08-20T01:28:09.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:09.874+0000 7fc4443c6640 1 -- 172.21.15.134:0/1957067113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc43c103890 msgr2=0x7fc43c199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:09.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:09.874+0000 7fc4443c6640 1 --2- 172.21.15.134:0/1957067113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc43c103890 0x7fc43c199160 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc42c006010 tx=0x7fc42c0042e0 comp rx=0 tx=0).stop 2024-08-20T01:28:09.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:09.874+0000 7fc4443c6640 1 -- 172.21.15.134:0/1957067113 shutdown_connections 2024-08-20T01:28:09.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:09.874+0000 7fc4443c6640 1 --2- 172.21.15.134:0/1957067113 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc4280b3c50 0x7fc4280b6110 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:09.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:09.874+0000 7fc4443c6640 1 --2- 172.21.15.134:0/1957067113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc43c104250 0x7fc43c199da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:09.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:09.874+0000 7fc4443c6640 1 --2- 172.21.15.134:0/1957067113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc43c103890 0x7fc43c199160 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:09.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:09.874+0000 7fc4443c6640 1 --2- 172.21.15.134:0/1957067113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc43c102730 0x7fc43c198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:09.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:09.874+0000 7fc4443c6640 1 -- 172.21.15.134:0/1957067113 >> 172.21.15.134:0/1957067113 conn(0x7fc43c0fe020 msgr2=0x7fc43c106c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:09.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:09.874+0000 7fc4443c6640 1 -- 172.21.15.134:0/1957067113 shutdown_connections 2024-08-20T01:28:09.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:09.875+0000 7fc4443c6640 1 -- 172.21.15.134:0/1957067113 wait complete. 2024-08-20T01:28:10.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:10 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:10.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:10 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:10.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:10 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:10.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:10 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:10.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:10 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:10.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:10 smithi134 ceph-mon[22511]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:28:10.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:10 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:10.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:10 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:10.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:10 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:10.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:10 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:10.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:10 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:10.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:10 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:10.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:10 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:10.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:10 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:10.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:10 smithi077 ceph-mon[22251]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:28:10.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:10 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:10.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:10 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:10.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:10 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:10.590 DEBUG:teuthology.orchestra.run.smithi134:osd.11> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.11.service 2024-08-20T01:28:10.592 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-08-20T01:28:10.593 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd stat -f json 2024-08-20T01:28:10.622 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:10 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:10.622 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:10 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:10.622 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:10 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:10.623 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:10 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:10.623 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:10 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:10.623 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:10 smithi022 ceph-mon[18709]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:28:10.623 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:10 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:10.623 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:10 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:10.623 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:10 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:10.862 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:11.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.369+0000 7ff12f644640 1 -- 172.21.15.22:0/2888094446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff128107c30 msgr2=0x7ff12810a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:11.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.369+0000 7ff12f644640 1 --2- 172.21.15.22:0/2888094446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff128107c30 0x7ff12810a020 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009860 tx=0x7ff11c02a340 comp rx=0 tx=0).stop 2024-08-20T01:28:11.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.369+0000 7ff12f644640 1 -- 172.21.15.22:0/2888094446 shutdown_connections 2024-08-20T01:28:11.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.369+0000 7ff12f644640 1 --2- 172.21.15.22:0/2888094446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff12810a640 0x7ff12810cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:11.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.369+0000 7ff12f644640 1 --2- 172.21.15.22:0/2888094446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff128107c30 0x7ff12810a020 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:11.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.369+0000 7ff12f644640 1 --2- 172.21.15.22:0/2888094446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff12806b2d0 0x7ff1281076f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:11.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.369+0000 7ff12f644640 1 -- 172.21.15.22:0/2888094446 >> 172.21.15.22:0/2888094446 conn(0x7ff1280fcee0 msgr2=0x7ff1280ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:11.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.369+0000 7ff12f644640 1 -- 172.21.15.22:0/2888094446 shutdown_connections 2024-08-20T01:28:11.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.369+0000 7ff12f644640 1 -- 172.21.15.22:0/2888094446 wait complete. 2024-08-20T01:28:11.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.369+0000 7ff12f644640 1 Processor -- start 2024-08-20T01:28:11.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.369+0000 7ff12f644640 1 -- start start 2024-08-20T01:28:11.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.370+0000 7ff12f644640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff12806b2d0 0x7ff12819acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:11.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.370+0000 7ff12f644640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff128107c30 0x7ff12819b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:11.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.370+0000 7ff12f644640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff12810a640 0x7ff12819bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:11.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.370+0000 7ff12f644640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff128110570 con 0x7ff128107c30 2024-08-20T01:28:11.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.370+0000 7ff12f644640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff1281103f0 con 0x7ff12810a640 2024-08-20T01:28:11.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.370+0000 7ff12f644640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff1281106f0 con 0x7ff12806b2d0 2024-08-20T01:28:11.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.370+0000 7ff12cbdf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff128107c30 0x7ff12819b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:11.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.370+0000 7ff12d3e0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff12806b2d0 0x7ff12819acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:11.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.370+0000 7ff12d3e0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff12806b2d0 0x7ff12819acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:35714/0 (socket says 172.21.15.22:35714) 2024-08-20T01:28:11.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.370+0000 7ff12d3e0640 1 -- 172.21.15.22:0/2384305447 learned_addr learned my addr 172.21.15.22:0/2384305447 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:28:11.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.370+0000 7ff12dbe1640 1 --2- 172.21.15.22:0/2384305447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff12810a640 0x7ff12819bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:11.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.370+0000 7ff12d3e0640 1 -- 172.21.15.22:0/2384305447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff12810a640 msgr2=0x7ff12819bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:11.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.370+0000 7ff12d3e0640 1 --2- 172.21.15.22:0/2384305447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff12810a640 0x7ff12819bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:11.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.370+0000 7ff12d3e0640 1 -- 172.21.15.22:0/2384305447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff128107c30 msgr2=0x7ff12819b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:11.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.370+0000 7ff12d3e0640 1 --2- 172.21.15.22:0/2384305447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff128107c30 0x7ff12819b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:11.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.370+0000 7ff12d3e0640 1 -- 172.21.15.22:0/2384305447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12819c820 con 0x7ff12806b2d0 2024-08-20T01:28:11.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.370+0000 7ff12d3e0640 1 --2- 172.21.15.22:0/2384305447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff12806b2d0 0x7ff12819acf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff12400ea60 tx=0x7ff12400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:11.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.370+0000 7ff11a7fc640 1 -- 172.21.15.22:0/2384305447 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12400cde0 con 0x7ff12806b2d0 2024-08-20T01:28:11.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.371+0000 7ff11a7fc640 1 -- 172.21.15.22:0/2384305447 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1240035f0 con 0x7ff12806b2d0 2024-08-20T01:28:11.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.371+0000 7ff11a7fc640 1 -- 172.21.15.22:0/2384305447 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124010690 con 0x7ff12806b2d0 2024-08-20T01:28:11.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.371+0000 7ff12f644640 1 -- 172.21.15.22:0/2384305447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12819cb10 con 0x7ff12806b2d0 2024-08-20T01:28:11.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.371+0000 7ff12f644640 1 -- 172.21.15.22:0/2384305447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1281a31f0 con 0x7ff12806b2d0 2024-08-20T01:28:11.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.372+0000 7ff12f644640 1 -- 172.21.15.22:0/2384305447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1280fe9d0 con 0x7ff12806b2d0 2024-08-20T01:28:11.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.373+0000 7ff11a7fc640 1 -- 172.21.15.22:0/2384305447 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7ff1240037a0 con 0x7ff12806b2d0 2024-08-20T01:28:11.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.374+0000 7ff11a7fc640 1 --2- 172.21.15.22:0/2384305447 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff1140b3c50 0x7ff1140b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:11.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.374+0000 7ff12cbdf640 1 --2- 172.21.15.22:0/2384305447 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff1140b3c50 0x7ff1140b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:11.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.374+0000 7ff11a7fc640 1 -- 172.21.15.22:0/2384305447 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6809+0+0 (secure 0 0 0) 0x7ff1240e38f0 con 0x7ff12806b2d0 2024-08-20T01:28:11.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.374+0000 7ff12cbdf640 1 --2- 172.21.15.22:0/2384305447 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff1140b3c50 0x7ff1140b6110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff11c02a930 tx=0x7ff11c030470 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:11.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.378+0000 7ff11a7fc640 1 -- 172.21.15.22:0/2384305447 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff1240ab480 con 0x7ff12806b2d0 2024-08-20T01:28:11.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.565+0000 7ff12f644640 1 -- 172.21.15.22:0/2384305447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff128063a80 con 0x7ff12806b2d0 2024-08-20T01:28:11.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.566+0000 7ff11a7fc640 1 -- 172.21.15.22:0/2384305447 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7ff1240aad80 con 0x7ff12806b2d0 2024-08-20T01:28:11.567 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:28:11.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.568+0000 7ff12f644640 1 -- 172.21.15.22:0/2384305447 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff1140b3c50 msgr2=0x7ff1140b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.568+0000 7ff12f644640 1 --2- 172.21.15.22:0/2384305447 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff1140b3c50 0x7ff1140b6110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff11c02a930 tx=0x7ff11c030470 comp rx=0 tx=0).stop 2024-08-20T01:28:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.568+0000 7ff12f644640 1 -- 172.21.15.22:0/2384305447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff12806b2d0 msgr2=0x7ff12819acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.568+0000 7ff12f644640 1 --2- 172.21.15.22:0/2384305447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff12806b2d0 0x7ff12819acf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff12400ea60 tx=0x7ff12400ef20 comp rx=0 tx=0).stop 2024-08-20T01:28:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.568+0000 7ff12f644640 1 -- 172.21.15.22:0/2384305447 shutdown_connections 2024-08-20T01:28:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.568+0000 7ff12f644640 1 --2- 172.21.15.22:0/2384305447 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff1140b3c50 0x7ff1140b6110 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.568+0000 7ff12f644640 1 --2- 172.21.15.22:0/2384305447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff12810a640 0x7ff12819bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.568+0000 7ff12f644640 1 --2- 172.21.15.22:0/2384305447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff128107c30 0x7ff12819b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.568+0000 7ff12f644640 1 --2- 172.21.15.22:0/2384305447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff12806b2d0 0x7ff12819acf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.568+0000 7ff12f644640 1 -- 172.21.15.22:0/2384305447 >> 172.21.15.22:0/2384305447 conn(0x7ff1280fcee0 msgr2=0x7ff128108830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.568+0000 7ff12f644640 1 -- 172.21.15.22:0/2384305447 shutdown_connections 2024-08-20T01:28:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:11.568+0000 7ff12f644640 1 -- 172.21.15.22:0/2384305447 wait complete. 2024-08-20T01:28:12.342 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:28:12 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:28:12.151+0000 7faf341f8640 -1 osd.11 0 log_to_monitors true 2024-08-20T01:28:12.417 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1724117269,"num_in_osds":12,"osd_in_since":1724117271,"num_remapped_pgs":0} 2024-08-20T01:28:12.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:12 smithi022 ceph-mon[18709]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:28:12.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:12 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2384305447' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T01:28:12.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:12 smithi022 ceph-mon[18709]: from='osd.11 [v2:172.21.15.134:6824/964533669,v1:172.21.15.134:6825/964533669]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-20T01:28:12.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:12 smithi022 ceph-mon[18709]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-20T01:28:12.754 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:12 smithi134 ceph-mon[22511]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:28:12.754 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:12 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2384305447' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T01:28:12.754 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:12 smithi134 ceph-mon[22511]: from='osd.11 [v2:172.21.15.134:6824/964533669,v1:172.21.15.134:6825/964533669]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-20T01:28:12.754 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:12 smithi134 ceph-mon[22511]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-20T01:28:12.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:12 smithi077 ceph-mon[22251]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:28:12.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:12 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2384305447' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T01:28:12.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:12 smithi077 ceph-mon[22251]: from='osd.11 [v2:172.21.15.134:6824/964533669,v1:172.21.15.134:6825/964533669]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-20T01:28:12.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:12 smithi077 ceph-mon[22251]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-20T01:28:13.411 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:13 smithi134 ceph-mon[22511]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-20T01:28:13.411 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:13 smithi134 ceph-mon[22511]: osdmap e67: 12 total, 11 up, 12 in 2024-08-20T01:28:13.411 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:13 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:28:13.411 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:13 smithi134 ceph-mon[22511]: from='osd.11 [v2:172.21.15.134:6824/964533669,v1:172.21.15.134:6825/964533669]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:28:13.411 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:13 smithi134 ceph-mon[22511]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:28:13.419 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd stat -f json 2024-08-20T01:28:13.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:13 smithi022 ceph-mon[18709]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-20T01:28:13.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:13 smithi022 ceph-mon[18709]: osdmap e67: 12 total, 11 up, 12 in 2024-08-20T01:28:13.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:13 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:28:13.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:13 smithi022 ceph-mon[18709]: from='osd.11 [v2:172.21.15.134:6824/964533669,v1:172.21.15.134:6825/964533669]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:28:13.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:13 smithi022 ceph-mon[18709]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:28:13.695 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:13.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:13 smithi077 ceph-mon[22251]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-20T01:28:13.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:13 smithi077 ceph-mon[22251]: osdmap e67: 12 total, 11 up, 12 in 2024-08-20T01:28:13.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:13 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:28:13.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:13 smithi077 ceph-mon[22251]: from='osd.11 [v2:172.21.15.134:6824/964533669,v1:172.21.15.134:6825/964533669]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:28:13.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:13 smithi077 ceph-mon[22251]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-08-20T01:28:14.015 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:28:13 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:28:13.749+0000 7faf3017b640 -1 osd.11 0 waiting for initial osdmap 2024-08-20T01:28:14.015 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:28:13 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:28:13.760+0000 7faf27f9a640 -1 osd.11 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:28:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.161+0000 7fd956025640 1 -- 172.21.15.22:0/282399788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd95006b3e0 msgr2=0x7fd9501052f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.161+0000 7fd956025640 1 --2- 172.21.15.22:0/282399788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd95006b3e0 0x7fd9501052f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd940009ca0 tx=0x7fd94002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:28:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.161+0000 7fd956025640 1 -- 172.21.15.22:0/282399788 shutdown_connections 2024-08-20T01:28:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.161+0000 7fd956025640 1 --2- 172.21.15.22:0/282399788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd950108430 0x7fd95010a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.161+0000 7fd956025640 1 --2- 172.21.15.22:0/282399788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd950105880 0x7fd950107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.161+0000 7fd956025640 1 --2- 172.21.15.22:0/282399788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd95006b3e0 0x7fd9501052f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.161+0000 7fd956025640 1 -- 172.21.15.22:0/282399788 >> 172.21.15.22:0/282399788 conn(0x7fd9500fcee0 msgr2=0x7fd9500ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.161+0000 7fd956025640 1 -- 172.21.15.22:0/282399788 shutdown_connections 2024-08-20T01:28:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.161+0000 7fd956025640 1 -- 172.21.15.22:0/282399788 wait complete. 2024-08-20T01:28:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.161+0000 7fd956025640 1 Processor -- start 2024-08-20T01:28:14.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.162+0000 7fd956025640 1 -- start start 2024-08-20T01:28:14.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.162+0000 7fd956025640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95006b3e0 0x7fd950198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:14.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.162+0000 7fd956025640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd950105880 0x7fd950199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:14.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.162+0000 7fd956025640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd950108430 0x7fd950199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:14.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.162+0000 7fd956025640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd95010e380 con 0x7fd950108430 2024-08-20T01:28:14.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.162+0000 7fd956025640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd95010e200 con 0x7fd950105880 2024-08-20T01:28:14.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.162+0000 7fd956025640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd95010e500 con 0x7fd95006b3e0 2024-08-20T01:28:14.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.162+0000 7fd94ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd950108430 0x7fd950199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:14.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.162+0000 7fd94f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95006b3e0 0x7fd950198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:14.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.162+0000 7fd94ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd950108430 0x7fd950199d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48940/0 (socket says 172.21.15.22:48940) 2024-08-20T01:28:14.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.162+0000 7fd94ffff640 1 -- 172.21.15.22:0/522903375 learned_addr learned my addr 172.21.15.22:0/522903375 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:28:14.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.162+0000 7fd94effd640 1 --2- 172.21.15.22:0/522903375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd950105880 0x7fd950199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:14.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.162+0000 7fd94ffff640 1 -- 172.21.15.22:0/522903375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95006b3e0 msgr2=0x7fd950198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:14.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.162+0000 7fd94ffff640 1 --2- 172.21.15.22:0/522903375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95006b3e0 0x7fd950198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:14.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.162+0000 7fd94ffff640 1 -- 172.21.15.22:0/522903375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd950105880 msgr2=0x7fd950199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:14.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.162+0000 7fd94ffff640 1 --2- 172.21.15.22:0/522903375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd950105880 0x7fd950199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:14.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.162+0000 7fd94ffff640 1 -- 172.21.15.22:0/522903375 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95019a600 con 0x7fd950108430 2024-08-20T01:28:14.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.163+0000 7fd94ffff640 1 --2- 172.21.15.22:0/522903375 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd950108430 0x7fd950199d60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd94800c970 tx=0x7fd94800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:14.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.163+0000 7fd94cff9640 1 -- 172.21.15.22:0/522903375 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd948007bb0 con 0x7fd950108430 2024-08-20T01:28:14.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.163+0000 7fd94cff9640 1 -- 172.21.15.22:0/522903375 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd948007d50 con 0x7fd950108430 2024-08-20T01:28:14.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.163+0000 7fd956025640 1 -- 172.21.15.22:0/522903375 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd95019a8f0 con 0x7fd950108430 2024-08-20T01:28:14.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.163+0000 7fd94cff9640 1 -- 172.21.15.22:0/522903375 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd948018770 con 0x7fd950108430 2024-08-20T01:28:14.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.163+0000 7fd956025640 1 -- 172.21.15.22:0/522903375 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9501a0fd0 con 0x7fd950108430 2024-08-20T01:28:14.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.164+0000 7fd956025640 1 -- 172.21.15.22:0/522903375 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9500fe9d0 con 0x7fd950108430 2024-08-20T01:28:14.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.165+0000 7fd94cff9640 1 -- 172.21.15.22:0/522903375 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fd94800f990 con 0x7fd950108430 2024-08-20T01:28:14.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.166+0000 7fd94cff9640 1 --2- 172.21.15.22:0/522903375 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9380b3c50 0x7fd9380b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:14.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.166+0000 7fd94f7fe640 1 --2- 172.21.15.22:0/522903375 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9380b3c50 0x7fd9380b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:14.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.166+0000 7fd94cff9640 1 -- 172.21.15.22:0/522903375 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6847+0+0 (secure 0 0 0) 0x7fd9480e3700 con 0x7fd950108430 2024-08-20T01:28:14.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.167+0000 7fd94f7fe640 1 --2- 172.21.15.22:0/522903375 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9380b3c50 0x7fd9380b6110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd940005e30 tx=0x7fd940005dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:14.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.169+0000 7fd94cff9640 1 -- 172.21.15.22:0/522903375 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd948014030 con 0x7fd950108430 2024-08-20T01:28:14.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.358+0000 7fd956025640 1 -- 172.21.15.22:0/522903375 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd95002e590 con 0x7fd950108430 2024-08-20T01:28:14.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.358+0000 7fd94cff9640 1 -- 172.21.15.22:0/522903375 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7fd9480ab300 con 0x7fd950108430 2024-08-20T01:28:14.359 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:28:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.360+0000 7fd956025640 1 -- 172.21.15.22:0/522903375 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9380b3c50 msgr2=0x7fd9380b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.360+0000 7fd956025640 1 --2- 172.21.15.22:0/522903375 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9380b3c50 0x7fd9380b6110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd940005e30 tx=0x7fd940005dc0 comp rx=0 tx=0).stop 2024-08-20T01:28:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.360+0000 7fd956025640 1 -- 172.21.15.22:0/522903375 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd950108430 msgr2=0x7fd950199d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.360+0000 7fd956025640 1 --2- 172.21.15.22:0/522903375 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd950108430 0x7fd950199d60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd94800c970 tx=0x7fd94800ce30 comp rx=0 tx=0).stop 2024-08-20T01:28:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.360+0000 7fd956025640 1 -- 172.21.15.22:0/522903375 shutdown_connections 2024-08-20T01:28:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.360+0000 7fd956025640 1 --2- 172.21.15.22:0/522903375 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9380b3c50 0x7fd9380b6110 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.360+0000 7fd956025640 1 --2- 172.21.15.22:0/522903375 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd950108430 0x7fd950199d60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.360+0000 7fd956025640 1 --2- 172.21.15.22:0/522903375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd950105880 0x7fd950199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.360+0000 7fd956025640 1 --2- 172.21.15.22:0/522903375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95006b3e0 0x7fd950198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.360+0000 7fd956025640 1 -- 172.21.15.22:0/522903375 >> 172.21.15.22:0/522903375 conn(0x7fd9500fcee0 msgr2=0x7fd950103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.360+0000 7fd956025640 1 -- 172.21.15.22:0/522903375 shutdown_connections 2024-08-20T01:28:14.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:14.360+0000 7fd956025640 1 -- 172.21.15.22:0/522903375 wait complete. 2024-08-20T01:28:14.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:14 smithi022 ceph-mon[18709]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:28:14.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:14 smithi022 ceph-mon[18709]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-08-20T01:28:14.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:14 smithi022 ceph-mon[18709]: osdmap e68: 12 total, 11 up, 12 in 2024-08-20T01:28:14.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:28:14.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:28:14.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:14 smithi022 ceph-mon[18709]: Detected new or changed devices on smithi134 2024-08-20T01:28:14.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:14.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:14.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:28:14.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:28:14.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:28:14.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-20T01:28:14.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:14 smithi022 ceph-mon[18709]: Adjusting osd_memory_target on smithi134 to 4272M 2024-08-20T01:28:14.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:14.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:14.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:14.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:14.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:14 smithi022 ceph-mon[18709]: from='osd.11 ' entity='osd.11' 2024-08-20T01:28:14.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:14 smithi134 ceph-mon[22511]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:28:14.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:14 smithi134 ceph-mon[22511]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-08-20T01:28:14.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:14 smithi134 ceph-mon[22511]: osdmap e68: 12 total, 11 up, 12 in 2024-08-20T01:28:14.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:28:14.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:28:14.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:14 smithi134 ceph-mon[22511]: Detected new or changed devices on smithi134 2024-08-20T01:28:14.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:14.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:14.767 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:28:14.767 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:28:14.767 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:28:14.767 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-20T01:28:14.767 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:14 smithi134 ceph-mon[22511]: Adjusting osd_memory_target on smithi134 to 4272M 2024-08-20T01:28:14.767 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:14.767 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:14.767 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:14.767 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:14.767 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:14 smithi134 ceph-mon[22511]: from='osd.11 ' entity='osd.11' 2024-08-20T01:28:14.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:14 smithi077 ceph-mon[22251]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:28:14.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:14 smithi077 ceph-mon[22251]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-08-20T01:28:14.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:14 smithi077 ceph-mon[22251]: osdmap e68: 12 total, 11 up, 12 in 2024-08-20T01:28:14.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:28:14.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:28:14.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:14 smithi077 ceph-mon[22251]: Detected new or changed devices on smithi134 2024-08-20T01:28:14.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:14.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:14.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:28:14.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:28:14.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:28:14.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-20T01:28:14.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:14 smithi077 ceph-mon[22251]: Adjusting osd_memory_target on smithi134 to 4272M 2024-08-20T01:28:14.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:14.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:14.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:14.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:14.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:14 smithi077 ceph-mon[22251]: from='osd.11 ' entity='osd.11' 2024-08-20T01:28:15.243 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1724117269,"num_in_osds":12,"osd_in_since":1724117271,"num_remapped_pgs":0} 2024-08-20T01:28:15.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:15 smithi022 ceph-mon[18709]: purged_snaps scrub starts 2024-08-20T01:28:15.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:15 smithi022 ceph-mon[18709]: purged_snaps scrub ok 2024-08-20T01:28:15.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:15 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:28:15.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:15 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/522903375' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T01:28:15.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:15 smithi022 ceph-mon[18709]: osd.11 [v2:172.21.15.134:6824/964533669,v1:172.21.15.134:6825/964533669] boot 2024-08-20T01:28:15.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:15 smithi022 ceph-mon[18709]: osdmap e69: 12 total, 12 up, 12 in 2024-08-20T01:28:15.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:15 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:28:15.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:15 smithi134 ceph-mon[22511]: purged_snaps scrub starts 2024-08-20T01:28:15.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:15 smithi134 ceph-mon[22511]: purged_snaps scrub ok 2024-08-20T01:28:15.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:15 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:28:15.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:15 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/522903375' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T01:28:15.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:15 smithi134 ceph-mon[22511]: osd.11 [v2:172.21.15.134:6824/964533669,v1:172.21.15.134:6825/964533669] boot 2024-08-20T01:28:15.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:15 smithi134 ceph-mon[22511]: osdmap e69: 12 total, 12 up, 12 in 2024-08-20T01:28:15.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:15 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:28:15.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:15 smithi077 ceph-mon[22251]: purged_snaps scrub starts 2024-08-20T01:28:15.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:15 smithi077 ceph-mon[22251]: purged_snaps scrub ok 2024-08-20T01:28:15.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:15 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:28:15.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:15 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/522903375' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T01:28:15.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:15 smithi077 ceph-mon[22251]: osd.11 [v2:172.21.15.134:6824/964533669,v1:172.21.15.134:6825/964533669] boot 2024-08-20T01:28:15.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:15 smithi077 ceph-mon[22251]: osdmap e69: 12 total, 12 up, 12 in 2024-08-20T01:28:15.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:15 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:28:16.244 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd stat -f json 2024-08-20T01:28:16.514 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:16.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:16 smithi022 ceph-mon[18709]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:28:16.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:16 smithi022 ceph-mon[18709]: osdmap e70: 12 total, 12 up, 12 in 2024-08-20T01:28:17.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:16 smithi134 ceph-mon[22511]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:28:17.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:16 smithi134 ceph-mon[22511]: osdmap e70: 12 total, 12 up, 12 in 2024-08-20T01:28:17.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:16 smithi077 ceph-mon[22251]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:28:17.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:16 smithi077 ceph-mon[22251]: osdmap e70: 12 total, 12 up, 12 in 2024-08-20T01:28:17.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.960+0000 7f90102e3640 1 -- 172.21.15.22:0/2300397980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f900806bdc0 msgr2=0x7f9008105330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:17.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.960+0000 7f90102e3640 1 --2- 172.21.15.22:0/2300397980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f900806bdc0 0x7f9008105330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9004009900 tx=0x7f900402a3f0 comp rx=0 tx=0).stop 2024-08-20T01:28:17.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.960+0000 7f90102e3640 1 -- 172.21.15.22:0/2300397980 shutdown_connections 2024-08-20T01:28:17.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.960+0000 7f90102e3640 1 --2- 172.21.15.22:0/2300397980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9008108470 0x7f900810a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:17.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.960+0000 7f90102e3640 1 --2- 172.21.15.22:0/2300397980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90081058c0 0x7f9008107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:17.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.960+0000 7f90102e3640 1 --2- 172.21.15.22:0/2300397980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f900806bdc0 0x7f9008105330 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:17.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.960+0000 7f90102e3640 1 -- 172.21.15.22:0/2300397980 >> 172.21.15.22:0/2300397980 conn(0x7f90080fcf00 msgr2=0x7f90080ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:17.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.960+0000 7f90102e3640 1 -- 172.21.15.22:0/2300397980 shutdown_connections 2024-08-20T01:28:17.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.960+0000 7f90102e3640 1 -- 172.21.15.22:0/2300397980 wait complete. 2024-08-20T01:28:17.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.961+0000 7f90102e3640 1 Processor -- start 2024-08-20T01:28:17.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.961+0000 7f90102e3640 1 -- start start 2024-08-20T01:28:17.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.961+0000 7f90102e3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f900806bdc0 0x7f9008102a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:17.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.961+0000 7f90102e3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90081058c0 0x7f90081012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:17.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.961+0000 7f90102e3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9008108470 0x7f9008101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:17.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.961+0000 7f90102e3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f900810e410 con 0x7f900806bdc0 2024-08-20T01:28:17.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.961+0000 7f90102e3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f900810e290 con 0x7f90081058c0 2024-08-20T01:28:17.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.961+0000 7f90102e3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f900810e590 con 0x7f9008108470 2024-08-20T01:28:17.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.961+0000 7f900e07f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f900806bdc0 0x7f9008102a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:17.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.961+0000 7f900e07f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f900806bdc0 0x7f9008102a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48958/0 (socket says 172.21.15.22:48958) 2024-08-20T01:28:17.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.961+0000 7f900e07f640 1 -- 172.21.15.22:0/1214329734 learned_addr learned my addr 172.21.15.22:0/1214329734 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:28:17.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.962+0000 7f900d87e640 1 --2- 172.21.15.22:0/1214329734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90081058c0 0x7f90081012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:17.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.962+0000 7f900e880640 1 --2- 172.21.15.22:0/1214329734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9008108470 0x7f9008101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:17.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.962+0000 7f900e07f640 1 -- 172.21.15.22:0/1214329734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9008108470 msgr2=0x7f9008101810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:17.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.962+0000 7f900e07f640 1 --2- 172.21.15.22:0/1214329734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9008108470 0x7f9008101810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:17.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.962+0000 7f900e07f640 1 -- 172.21.15.22:0/1214329734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90081058c0 msgr2=0x7f90081012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:17.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.962+0000 7f900e07f640 1 --2- 172.21.15.22:0/1214329734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90081058c0 0x7f90081012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:17.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.962+0000 7f900e07f640 1 -- 172.21.15.22:0/1214329734 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90081020d0 con 0x7f900806bdc0 2024-08-20T01:28:17.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.962+0000 7f900e07f640 1 --2- 172.21.15.22:0/1214329734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f900806bdc0 0x7f9008102a60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9004031500 tx=0x7f9004003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:17.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.962+0000 7f8fff7fe640 1 -- 172.21.15.22:0/1214329734 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900403f070 con 0x7f900806bdc0 2024-08-20T01:28:17.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.962+0000 7f8fff7fe640 1 -- 172.21.15.22:0/1214329734 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f900403b460 con 0x7f900806bdc0 2024-08-20T01:28:17.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.962+0000 7f90102e3640 1 -- 172.21.15.22:0/1214329734 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90081a2b00 con 0x7f900806bdc0 2024-08-20T01:28:17.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.962+0000 7f8fff7fe640 1 -- 172.21.15.22:0/1214329734 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004035030 con 0x7f900806bdc0 2024-08-20T01:28:17.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.962+0000 7f90102e3640 1 -- 172.21.15.22:0/1214329734 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90081a2fb0 con 0x7f900806bdc0 2024-08-20T01:28:17.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.963+0000 7f90102e3640 1 -- 172.21.15.22:0/1214329734 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90080fe9f0 con 0x7f900806bdc0 2024-08-20T01:28:17.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.965+0000 7f8fff7fe640 1 -- 172.21.15.22:0/1214329734 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f9004042070 con 0x7f900806bdc0 2024-08-20T01:28:17.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.965+0000 7f8fff7fe640 1 --2- 172.21.15.22:0/1214329734 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8ff40b3bd0 0x7f8ff40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:17.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.966+0000 7f900d87e640 1 --2- 172.21.15.22:0/1214329734 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8ff40b3bd0 0x7f8ff40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:17.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.966+0000 7f8fff7fe640 1 -- 172.21.15.22:0/1214329734 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f9004104450 con 0x7f900806bdc0 2024-08-20T01:28:17.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.966+0000 7f900d87e640 1 --2- 172.21.15.22:0/1214329734 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8ff40b3bd0 0x7f8ff40b6090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f900806c270 tx=0x7f8ff800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:17.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:16.968+0000 7f8fff7fe640 1 -- 172.21.15.22:0/1214329734 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f90040cbf40 con 0x7f900806bdc0 2024-08-20T01:28:17.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:17.153+0000 7f90102e3640 1 -- 172.21.15.22:0/1214329734 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f900802e590 con 0x7f900806bdc0 2024-08-20T01:28:17.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:17.154+0000 7f8fff7fe640 1 -- 172.21.15.22:0/1214329734 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f90040cb840 con 0x7f900806bdc0 2024-08-20T01:28:17.154 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:28:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:17.156+0000 7f90102e3640 1 -- 172.21.15.22:0/1214329734 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8ff40b3bd0 msgr2=0x7f8ff40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:17.156+0000 7f90102e3640 1 --2- 172.21.15.22:0/1214329734 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8ff40b3bd0 0x7f8ff40b6090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f900806c270 tx=0x7f8ff800a2d0 comp rx=0 tx=0).stop 2024-08-20T01:28:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:17.156+0000 7f90102e3640 1 -- 172.21.15.22:0/1214329734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f900806bdc0 msgr2=0x7f9008102a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:17.156+0000 7f90102e3640 1 --2- 172.21.15.22:0/1214329734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f900806bdc0 0x7f9008102a60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9004031500 tx=0x7f9004003d50 comp rx=0 tx=0).stop 2024-08-20T01:28:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:17.156+0000 7f90102e3640 1 -- 172.21.15.22:0/1214329734 shutdown_connections 2024-08-20T01:28:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:17.156+0000 7f90102e3640 1 --2- 172.21.15.22:0/1214329734 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8ff40b3bd0 0x7f8ff40b6090 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:17.156+0000 7f90102e3640 1 --2- 172.21.15.22:0/1214329734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9008108470 0x7f9008101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:17.156+0000 7f90102e3640 1 --2- 172.21.15.22:0/1214329734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90081058c0 0x7f90081012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:17.156+0000 7f90102e3640 1 --2- 172.21.15.22:0/1214329734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f900806bdc0 0x7f9008102a60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:17.156+0000 7f90102e3640 1 -- 172.21.15.22:0/1214329734 >> 172.21.15.22:0/1214329734 conn(0x7f90080fcf00 msgr2=0x7f9008103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:17.156+0000 7f90102e3640 1 -- 172.21.15.22:0/1214329734 shutdown_connections 2024-08-20T01:28:17.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:17.156+0000 7f90102e3640 1 -- 172.21.15.22:0/1214329734 wait complete. 2024-08-20T01:28:17.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:17 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1214329734' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T01:28:17.933 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":70,"num_osds":12,"num_up_osds":12,"osd_up_since":1724117294,"num_in_osds":12,"osd_in_since":1724117271,"num_remapped_pgs":0} 2024-08-20T01:28:17.933 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:28:18.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:17 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1214329734' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T01:28:18.189 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:18.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:17 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1214329734' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T01:28:18.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.745+0000 7f58bb761640 1 -- 172.21.15.22:0/3532792764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58b4107d20 msgr2=0x7f58b410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:18.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.745+0000 7f58bb761640 1 --2- 172.21.15.22:0/3532792764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58b4107d20 0x7f58b410e520 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f58ac009ca0 tx=0x7f58ac02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:28:18.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.745+0000 7f58bb761640 1 -- 172.21.15.22:0/3532792764 shutdown_connections 2024-08-20T01:28:18.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.745+0000 7f58bb761640 1 --2- 172.21.15.22:0/3532792764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58b4107d20 0x7f58b410e520 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:18.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.745+0000 7f58bb761640 1 --2- 172.21.15.22:0/3532792764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58b41073a0 0x7f58b41077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:18.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.745+0000 7f58bb761640 1 --2- 172.21.15.22:0/3532792764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58b4101990 0x7f58b4101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:18.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.745+0000 7f58bb761640 1 -- 172.21.15.22:0/3532792764 >> 172.21.15.22:0/3532792764 conn(0x7f58b40fd400 msgr2=0x7f58b40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:18.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.745+0000 7f58bb761640 1 -- 172.21.15.22:0/3532792764 shutdown_connections 2024-08-20T01:28:18.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.745+0000 7f58bb761640 1 -- 172.21.15.22:0/3532792764 wait complete. 2024-08-20T01:28:18.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.745+0000 7f58bb761640 1 Processor -- start 2024-08-20T01:28:18.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.746+0000 7f58bb761640 1 -- start start 2024-08-20T01:28:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.746+0000 7f58bb761640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58b4101990 0x7f58b40fdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.746+0000 7f58bb761640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58b41073a0 0x7f58b40fe060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.746+0000 7f58bb761640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58b4107d20 0x7f58b40fe5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.746+0000 7f58bb761640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f58b41119a0 con 0x7f58b4101990 2024-08-20T01:28:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.746+0000 7f58bb761640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f58b4111820 con 0x7f58b41073a0 2024-08-20T01:28:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.746+0000 7f58bb761640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f58b4111b20 con 0x7f58b4107d20 2024-08-20T01:28:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.746+0000 7f58b94fd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58b4101990 0x7f58b40fdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.746+0000 7f58b94fd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58b4101990 0x7f58b40fdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48980/0 (socket says 172.21.15.22:48980) 2024-08-20T01:28:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.746+0000 7f58b94fd640 1 -- 172.21.15.22:0/765410737 learned_addr learned my addr 172.21.15.22:0/765410737 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:28:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.746+0000 7f58b8cfc640 1 --2- 172.21.15.22:0/765410737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58b41073a0 0x7f58b40fe060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.746+0000 7f58b94fd640 1 -- 172.21.15.22:0/765410737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58b4107d20 msgr2=0x7f58b40fe5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.746+0000 7f58b94fd640 1 --2- 172.21.15.22:0/765410737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58b4107d20 0x7f58b40fe5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.746+0000 7f58b94fd640 1 -- 172.21.15.22:0/765410737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58b41073a0 msgr2=0x7f58b40fe060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.746+0000 7f58b94fd640 1 --2- 172.21.15.22:0/765410737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58b41073a0 0x7f58b40fe060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:18.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.746+0000 7f58b94fd640 1 -- 172.21.15.22:0/765410737 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b41a72e0 con 0x7f58b4101990 2024-08-20T01:28:18.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.746+0000 7f58b94fd640 1 --2- 172.21.15.22:0/765410737 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58b4101990 0x7f58b40fdb20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f58b000c920 tx=0x7f58b000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:18.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.746+0000 7f58aa7fc640 1 -- 172.21.15.22:0/765410737 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b0007c70 con 0x7f58b4101990 2024-08-20T01:28:18.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.747+0000 7f58bb761640 1 -- 172.21.15.22:0/765410737 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b41a75d0 con 0x7f58b4101990 2024-08-20T01:28:18.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.747+0000 7f58aa7fc640 1 -- 172.21.15.22:0/765410737 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58b0007e10 con 0x7f58b4101990 2024-08-20T01:28:18.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.747+0000 7f58aa7fc640 1 -- 172.21.15.22:0/765410737 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b0018820 con 0x7f58b4101990 2024-08-20T01:28:18.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.747+0000 7f58bb761640 1 -- 172.21.15.22:0/765410737 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b41a7b60 con 0x7f58b4101990 2024-08-20T01:28:18.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.748+0000 7f58bb761640 1 -- 172.21.15.22:0/765410737 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b4101d70 con 0x7f58b4101990 2024-08-20T01:28:18.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.749+0000 7f58aa7fc640 1 -- 172.21.15.22:0/765410737 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f58b000f450 con 0x7f58b4101990 2024-08-20T01:28:18.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.750+0000 7f58aa7fc640 1 --2- 172.21.15.22:0/765410737 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f58a00b3bd0 0x7f58a00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:18.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.750+0000 7f58b8cfc640 1 --2- 172.21.15.22:0/765410737 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f58a00b3bd0 0x7f58a00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:18.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.750+0000 7f58aa7fc640 1 -- 172.21.15.22:0/765410737 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f58b00e3950 con 0x7f58b4101990 2024-08-20T01:28:18.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.750+0000 7f58b8cfc640 1 --2- 172.21.15.22:0/765410737 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f58a00b3bd0 0x7f58a00b6090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f58b40ff610 tx=0x7f58a400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:18.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.754+0000 7f58aa7fc640 1 -- 172.21.15.22:0/765410737 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f58b0014030 con 0x7f58b4101990 2024-08-20T01:28:18.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.939+0000 7f58bb761640 1 -- 172.21.15.22:0/765410737 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58b402e340 con 0x7f58b4101990 2024-08-20T01:28:18.940 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:18 smithi022 ceph-mon[18709]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:18.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.940+0000 7f58aa7fc640 1 -- 172.21.15.22:0/765410737 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+18419 (secure 0 0 0) 0x7f58b00ab3a0 con 0x7f58b4101990 2024-08-20T01:28:18.941 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:28:18.941 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":70,"fsid":"586fd06c-5e92-11ef-bccf-c7b262605968","created":"2024-08-20T01:20:55.065729+0000","modified":"2024-08-20T01:28:15.754975+0000","last_up_change":"2024-08-20T01:28:14.752931+0000","last_in_change":"2024-08-20T01:27:51.812525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:24:31.674035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b67a59af-5eea-4073-a4b2-604a1b7b8f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6803","nonce":812056903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6805","nonce":812056903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6809","nonce":812056903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6807","nonce":812056903}]},"public_addr":"172.21.15.22:6803/812056903","cluster_addr":"172.21.15.22:6805/812056903","heartbeat_back_addr":"172.21.15.22:6809/812056903","heartbeat_front_addr":"172.21.15.22:6807/812056903","state":["exists","up"]},{"osd":1,"uuid":"9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6801","nonce":823882511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6803","nonce":823882511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6807","nonce":823882511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6805","nonce":823882511}]},"public_addr":"172.21.15.77:6801/823882511","cluster_addr":"172.21.15.77:6803/823882511","heartbeat_back_addr":"172.21.15.77:6807/823882511","heartbeat_front_addr":"172.21.15.77:6805/823882511","state":["exists","up"]},{"osd":2,"uuid":"71e3c019-a3e0-4632-81a8-27ac31279f7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6801","nonce":3873702897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6803","nonce":3873702897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6807","nonce":3873702897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6805","nonce":3873702897}]},"public_addr":"172.21.15.134:6801/3873702897","cluster_addr":"172.21.15.134:6803/3873702897","heartbeat_back_addr":"172.21.15.134:6807/3873702897","heartbeat_front_addr":"172.21.15.134:6805/3873702897","state":["exists","up"]},{"osd":3,"uuid":"a60de748-aa65-477d-864e-6281db1261ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6811","nonce":1775946906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6813","nonce":1775946906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6817","nonce":1775946906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6815","nonce":1775946906}]},"public_addr":"172.21.15.22:6811/1775946906","cluster_addr":"172.21.15.22:6813/1775946906","heartbeat_back_addr":"172.21.15.22:6817/1775946906","heartbeat_front_addr":"172.21.15.22:6815/1775946906","state":["exists","up"]},{"osd":4,"uuid":"07d99671-2ece-471c-ad69-fc9043d917f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6809","nonce":1954209322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6811","nonce":1954209322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6815","nonce":1954209322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6813","nonce":1954209322}]},"public_addr":"172.21.15.77:6809/1954209322","cluster_addr":"172.21.15.77:6811/1954209322","heartbeat_back_addr":"172.21.15.77:6815/1954209322","heartbeat_front_addr":"172.21.15.77:6813/1954209322","state":["exists","up"]},{"osd":5,"uuid":"971cac33-0b98-49b1-b4b2-27354fc0ab90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6809","nonce":2805488123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6811","nonce":2805488123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6815","nonce":2805488123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6813","nonce":2805488123}]},"public_addr":"172.21.15.134:6809/2805488123","cluster_addr":"172.21.15.134:6811/2805488123","heartbeat_back_addr":"172.21.15.134:6815/2805488123","heartbeat_front_addr":"172.21.15.134:6813/2805488123","state":["exists","up"]},{"osd":6,"uuid":"48d90292-8511-47d6-8093-330bd13ae70e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6819","nonce":3804882416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6821","nonce":3804882416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6825","nonce":3804882416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6823","nonce":3804882416}]},"public_addr":"172.21.15.22:6819/3804882416","cluster_addr":"172.21.15.22:6821/3804882416","heartbeat_back_addr":"172.21.15.22:6825/3804882416","heartbeat_front_addr":"172.21.15.22:6823/3804882416","state":["exists","up"]},{"osd":7,"uuid":"e217112d-9f56-4a48-93bf-6eb052ce540a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6817","nonce":700318902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6819","nonce":700318902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6823","nonce":700318902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6821","nonce":700318902}]},"public_addr":"172.21.15.77:6817/700318902","cluster_addr":"172.21.15.77:6819/700318902","heartbeat_back_addr":"172.21.15.77:6823/700318902","heartbeat_front_addr":"172.21.15.77:6821/700318902","state":["exists","up"]},{"osd":8,"uuid":"1786747c-6ff6-4e00-bcf6-a8176215847f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6817","nonce":1635473481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6819","nonce":1635473481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6823","nonce":1635473481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6821","nonce":1635473481}]},"public_addr":"172.21.15.134:6817/1635473481","cluster_addr":"172.21.15.134:6819/1635473481","heartbeat_back_addr":"172.21.15.134:6823/1635473481","heartbeat_front_addr":"172.21.15.134:6821/1635473481","state":["exists","up"]},{"osd":9,"uuid":"708f7390-1b51-4397-a92a-8ff3f4a5bc45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6827","nonce":3899297933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6829","nonce":3899297933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6833","nonce":3899297933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6831","nonce":3899297933}]},"public_addr":"172.21.15.22:6827/3899297933","cluster_addr":"172.21.15.22:6829/3899297933","heartbeat_back_addr":"172.21.15.22:6833/3899297933","heartbeat_front_addr":"172.21.15.22:6831/3899297933","state":["exists","up"]},{"osd":10,"uuid":"d15b0acd-dd08-431d-88aa-756b6420987d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6825","nonce":2765589872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6827","nonce":2765589872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6831","nonce":2765589872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6829","nonce":2765589872}]},"public_addr":"172.21.15.77:6825/2765589872","cluster_addr":"172.21.15.77:6827/2765589872","heartbeat_back_addr":"172.21.15.77:6831/2765589872","heartbeat_front_addr":"172.21.15.77:6829/2765589872","state":["exists","up"]},{"osd":11,"uuid":"d15017fa-3c3d-4096-a35d-275cd54bb9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6825","nonce":964533669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6827","nonce":964533669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6831","nonce":964533669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6829","nonce":964533669}]},"public_addr":"172.21.15.134:6825/964533669","cluster_addr":"172.21.15.134:6827/964533669","heartbeat_back_addr":"172.21.15.134:6831/964533669","heartbeat_front_addr":"172.21.15.134:6829/964533669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:23:40.839725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:05.141389+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:28.340737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:52.028949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:17.029913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:42.092826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:07.831100+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:33.380447+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:58.772655+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:23.017208+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:47.966711+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:28:13.123047+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/416470260":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6800/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/1142422661":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:6800/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/2093308719":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/3772866379":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3424402756":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3864772624":"2024-08-21T01:21:28.981981+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:28:18.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.942+0000 7f58bb761640 1 -- 172.21.15.22:0/765410737 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f58a00b3bd0 msgr2=0x7f58a00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:18.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.942+0000 7f58bb761640 1 --2- 172.21.15.22:0/765410737 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f58a00b3bd0 0x7f58a00b6090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f58b40ff610 tx=0x7f58a400b390 comp rx=0 tx=0).stop 2024-08-20T01:28:18.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.942+0000 7f58bb761640 1 -- 172.21.15.22:0/765410737 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58b4101990 msgr2=0x7f58b40fdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:18.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.942+0000 7f58bb761640 1 --2- 172.21.15.22:0/765410737 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58b4101990 0x7f58b40fdb20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f58b000c920 tx=0x7f58b000cde0 comp rx=0 tx=0).stop 2024-08-20T01:28:18.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.942+0000 7f58bb761640 1 -- 172.21.15.22:0/765410737 shutdown_connections 2024-08-20T01:28:18.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.942+0000 7f58bb761640 1 --2- 172.21.15.22:0/765410737 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f58a00b3bd0 0x7f58a00b6090 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:18.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.942+0000 7f58bb761640 1 --2- 172.21.15.22:0/765410737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58b4107d20 0x7f58b40fe5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:18.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.942+0000 7f58bb761640 1 --2- 172.21.15.22:0/765410737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58b41073a0 0x7f58b40fe060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:18.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.942+0000 7f58bb761640 1 --2- 172.21.15.22:0/765410737 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58b4101990 0x7f58b40fdb20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:18.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.942+0000 7f58bb761640 1 -- 172.21.15.22:0/765410737 >> 172.21.15.22:0/765410737 conn(0x7f58b40fd400 msgr2=0x7f58b406aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:18.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.942+0000 7f58bb761640 1 -- 172.21.15.22:0/765410737 shutdown_connections 2024-08-20T01:28:18.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:18.942+0000 7f58bb761640 1 -- 172.21.15.22:0/765410737 wait complete. 2024-08-20T01:28:19.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:18 smithi077 ceph-mon[22251]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:19.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:18 smithi134 ceph-mon[22511]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:19.719 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-20T01:24:31.674035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-20T01:28:19.719 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-20T01:28:19.979 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:20.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:19 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/765410737' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:28:20.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:19 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/765410737' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:28:20.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:19 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/765410737' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:28:20.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.566+0000 7f703455c640 1 -- 172.21.15.22:0/1438096939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f702c10ce20 msgr2=0x7f702c10f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:20.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.566+0000 7f703455c640 1 --2- 172.21.15.22:0/1438096939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f702c10ce20 0x7f702c10f250 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7024009ca0 tx=0x7f702402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:28:20.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.567+0000 7f703455c640 1 -- 172.21.15.22:0/1438096939 shutdown_connections 2024-08-20T01:28:20.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.567+0000 7f703455c640 1 --2- 172.21.15.22:0/1438096939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f702c10ce20 0x7f702c10f250 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:20.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.567+0000 7f703455c640 1 --2- 172.21.15.22:0/1438096939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f702c104270 0x7f702c10c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:20.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.567+0000 7f703455c640 1 --2- 172.21.15.22:0/1438096939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f702c103870 0x7f702c103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:20.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.567+0000 7f703455c640 1 -- 172.21.15.22:0/1438096939 >> 172.21.15.22:0/1438096939 conn(0x7f702c0fd400 msgr2=0x7f702c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:20.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.567+0000 7f703455c640 1 -- 172.21.15.22:0/1438096939 shutdown_connections 2024-08-20T01:28:20.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.567+0000 7f703455c640 1 -- 172.21.15.22:0/1438096939 wait complete. 2024-08-20T01:28:20.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.567+0000 7f703455c640 1 Processor -- start 2024-08-20T01:28:20.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.567+0000 7f703455c640 1 -- start start 2024-08-20T01:28:20.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.568+0000 7f703455c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f702c103870 0x7f702c198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:20.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.568+0000 7f703455c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f702c104270 0x7f702c199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:20.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.568+0000 7f703455c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f702c10ce20 0x7f702c19e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:20.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.568+0000 7f703455c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f702c112af0 con 0x7f702c104270 2024-08-20T01:28:20.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.568+0000 7f703455c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f702c112970 con 0x7f702c10ce20 2024-08-20T01:28:20.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.568+0000 7f703455c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f702c112c70 con 0x7f702c103870 2024-08-20T01:28:20.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.568+0000 7f7031af7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f702c104270 0x7f702c199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:20.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.568+0000 7f7031af7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f702c104270 0x7f702c199500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47672/0 (socket says 172.21.15.22:47672) 2024-08-20T01:28:20.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.568+0000 7f7031af7640 1 -- 172.21.15.22:0/397672583 learned_addr learned my addr 172.21.15.22:0/397672583 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:28:20.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.568+0000 7f7032af9640 1 --2- 172.21.15.22:0/397672583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f702c10ce20 0x7f702c19e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:20.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.568+0000 7f70322f8640 1 --2- 172.21.15.22:0/397672583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f702c103870 0x7f702c198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:20.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.568+0000 7f7031af7640 1 -- 172.21.15.22:0/397672583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f702c103870 msgr2=0x7f702c198fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:20.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.568+0000 7f7031af7640 1 --2- 172.21.15.22:0/397672583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f702c103870 0x7f702c198fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:20.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.568+0000 7f7031af7640 1 -- 172.21.15.22:0/397672583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f702c10ce20 msgr2=0x7f702c19e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:20.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.568+0000 7f7031af7640 1 --2- 172.21.15.22:0/397672583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f702c10ce20 0x7f702c19e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:20.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.568+0000 7f7031af7640 1 -- 172.21.15.22:0/397672583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702c19f070 con 0x7f702c104270 2024-08-20T01:28:20.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.568+0000 7f70322f8640 1 --2- 172.21.15.22:0/397672583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f702c103870 0x7f702c198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:28:20.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.568+0000 7f7031af7640 1 --2- 172.21.15.22:0/397672583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f702c104270 0x7f702c199500 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f701c00c890 tx=0x7f701c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:20.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.569+0000 7f70237fe640 1 -- 172.21.15.22:0/397672583 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701c004220 con 0x7f702c104270 2024-08-20T01:28:20.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.569+0000 7f703455c640 1 -- 172.21.15.22:0/397672583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f702c19f360 con 0x7f702c104270 2024-08-20T01:28:20.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.569+0000 7f70237fe640 1 -- 172.21.15.22:0/397672583 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f701c0043c0 con 0x7f702c104270 2024-08-20T01:28:20.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.569+0000 7f70237fe640 1 -- 172.21.15.22:0/397672583 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701c004a00 con 0x7f702c104270 2024-08-20T01:28:20.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.569+0000 7f703455c640 1 -- 172.21.15.22:0/397672583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f702c1a5a20 con 0x7f702c104270 2024-08-20T01:28:20.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.570+0000 7f703455c640 1 -- 172.21.15.22:0/397672583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f702c103c50 con 0x7f702c104270 2024-08-20T01:28:20.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.571+0000 7f70237fe640 1 -- 172.21.15.22:0/397672583 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f701c0079b0 con 0x7f702c104270 2024-08-20T01:28:20.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.572+0000 7f70237fe640 1 --2- 172.21.15.22:0/397672583 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70180b3bd0 0x7f70180b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:20.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.572+0000 7f70322f8640 1 --2- 172.21.15.22:0/397672583 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70180b3bd0 0x7f70180b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:20.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.572+0000 7f70237fe640 1 -- 172.21.15.22:0/397672583 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f701c0e34d0 con 0x7f702c104270 2024-08-20T01:28:20.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.572+0000 7f70322f8640 1 --2- 172.21.15.22:0/397672583 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70180b3bd0 0x7f70180b6090 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7028009930 tx=0x7f7028008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:20.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.576+0000 7f70237fe640 1 -- 172.21.15.22:0/397672583 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f701c014030 con 0x7f702c104270 2024-08-20T01:28:20.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.762+0000 7f703455c640 1 -- 172.21.15.22:0/397672583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f702c1a5df0 con 0x7f702c104270 2024-08-20T01:28:20.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.762+0000 7f70237fe640 1 -- 172.21.15.22:0/397672583 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7f701c0aafc0 con 0x7f702c104270 2024-08-20T01:28:20.763 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-08-20T01:28:20.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.764+0000 7f703455c640 1 -- 172.21.15.22:0/397672583 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70180b3bd0 msgr2=0x7f70180b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:20.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.764+0000 7f703455c640 1 --2- 172.21.15.22:0/397672583 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70180b3bd0 0x7f70180b6090 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7028009930 tx=0x7f7028008040 comp rx=0 tx=0).stop 2024-08-20T01:28:20.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.764+0000 7f703455c640 1 -- 172.21.15.22:0/397672583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f702c104270 msgr2=0x7f702c199500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:20.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.764+0000 7f703455c640 1 --2- 172.21.15.22:0/397672583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f702c104270 0x7f702c199500 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f701c00c890 tx=0x7f701c00cd50 comp rx=0 tx=0).stop 2024-08-20T01:28:20.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.764+0000 7f703455c640 1 -- 172.21.15.22:0/397672583 shutdown_connections 2024-08-20T01:28:20.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.764+0000 7f703455c640 1 --2- 172.21.15.22:0/397672583 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70180b3bd0 0x7f70180b6090 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:20.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.764+0000 7f703455c640 1 --2- 172.21.15.22:0/397672583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f702c10ce20 0x7f702c19e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:20.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.764+0000 7f703455c640 1 --2- 172.21.15.22:0/397672583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f702c104270 0x7f702c199500 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:20.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.764+0000 7f703455c640 1 --2- 172.21.15.22:0/397672583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f702c103870 0x7f702c198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:20.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.764+0000 7f703455c640 1 -- 172.21.15.22:0/397672583 >> 172.21.15.22:0/397672583 conn(0x7f702c0fd400 msgr2=0x7f702c10ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:20.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.764+0000 7f703455c640 1 -- 172.21.15.22:0/397672583 shutdown_connections 2024-08-20T01:28:20.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:20.765+0000 7f703455c640 1 -- 172.21.15.22:0/397672583 wait complete. 2024-08-20T01:28:21.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:20 smithi077 ceph-mon[22251]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:21.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:20 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/397672583' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T01:28:21.069 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:20 smithi022 ceph-mon[18709]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:21.069 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:20 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/397672583' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T01:28:21.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:20 smithi134 ceph-mon[22511]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:21.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:20 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/397672583' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T01:28:21.341 INFO:tasks.cephadm:Adding mds.a on smithi022 2024-08-20T01:28:21.341 INFO:tasks.cephadm:Adding mds.d on smithi022 2024-08-20T01:28:21.341 INFO:tasks.cephadm:Adding mds.g on smithi022 2024-08-20T01:28:21.341 INFO:tasks.cephadm:Adding mds.j on smithi022 2024-08-20T01:28:21.341 INFO:tasks.cephadm:Adding mds.b on smithi077 2024-08-20T01:28:21.342 INFO:tasks.cephadm:Adding mds.e on smithi077 2024-08-20T01:28:21.342 INFO:tasks.cephadm:Adding mds.h on smithi077 2024-08-20T01:28:21.342 INFO:tasks.cephadm:Adding mds.k on smithi077 2024-08-20T01:28:21.342 INFO:tasks.cephadm:Adding mds.c on smithi134 2024-08-20T01:28:21.342 INFO:tasks.cephadm:Adding mds.f on smithi134 2024-08-20T01:28:21.342 INFO:tasks.cephadm:Adding mds.i on smithi134 2024-08-20T01:28:21.342 INFO:tasks.cephadm:Adding mds.l on smithi134 2024-08-20T01:28:21.342 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph orch apply mds all '12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l' 2024-08-20T01:28:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:28:22.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.097+0000 7fea6930d640 1 -- 172.21.15.134:0/1394058880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea64101640 msgr2=0x7fea64101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:22.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.097+0000 7fea6930d640 1 --2- 172.21.15.134:0/1394058880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea64101640 0x7fea64101a40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fea54009960 tx=0x7fea5402a460 comp rx=0 tx=0).stop 2024-08-20T01:28:22.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.097+0000 7fea6930d640 1 -- 172.21.15.134:0/1394058880 shutdown_connections 2024-08-20T01:28:22.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.097+0000 7fea6930d640 1 --2- 172.21.15.134:0/1394058880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea64103160 0x7fea64109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:22.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.097+0000 7fea6930d640 1 --2- 172.21.15.134:0/1394058880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea641027a0 0x7fea64102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:22.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.097+0000 7fea6930d640 1 --2- 172.21.15.134:0/1394058880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea64101640 0x7fea64101a40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:22.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.097+0000 7fea6930d640 1 -- 172.21.15.134:0/1394058880 >> 172.21.15.134:0/1394058880 conn(0x7fea640fcf30 msgr2=0x7fea640ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:22.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.097+0000 7fea6930d640 1 -- 172.21.15.134:0/1394058880 shutdown_connections 2024-08-20T01:28:22.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.097+0000 7fea6930d640 1 -- 172.21.15.134:0/1394058880 wait complete. 2024-08-20T01:28:22.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.098+0000 7fea6930d640 1 Processor -- start 2024-08-20T01:28:22.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.098+0000 7fea6930d640 1 -- start start 2024-08-20T01:28:22.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.098+0000 7fea6930d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea64101640 0x7fea6406bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:22.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.098+0000 7fea6930d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea641027a0 0x7fea6419d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:22.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.098+0000 7fea6930d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea64103160 0x7fea6419ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:22.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.098+0000 7fea6930d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea6410d320 con 0x7fea641027a0 2024-08-20T01:28:22.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.098+0000 7fea6930d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea6410d1a0 con 0x7fea64101640 2024-08-20T01:28:22.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.098+0000 7fea6930d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fea6410d4a0 con 0x7fea64103160 2024-08-20T01:28:22.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.098+0000 7fea637fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea64103160 0x7fea6419ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.098+0000 7fea637fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea64103160 0x7fea6419ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57130/0 (socket says 172.21.15.134:57130) 2024-08-20T01:28:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.098+0000 7fea637fe640 1 -- 172.21.15.134:0/2342688417 learned_addr learned my addr 172.21.15.134:0/2342688417 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-08-20T01:28:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.098+0000 7fea62ffd640 1 --2- 172.21.15.134:0/2342688417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea64101640 0x7fea6406bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.098+0000 7fea5bfff640 1 --2- 172.21.15.134:0/2342688417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea641027a0 0x7fea6419d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.099+0000 7fea637fe640 1 -- 172.21.15.134:0/2342688417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea64101640 msgr2=0x7fea6406bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.099+0000 7fea637fe640 1 --2- 172.21.15.134:0/2342688417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea64101640 0x7fea6406bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.099+0000 7fea637fe640 1 -- 172.21.15.134:0/2342688417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea641027a0 msgr2=0x7fea6419d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.099+0000 7fea637fe640 1 --2- 172.21.15.134:0/2342688417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea641027a0 0x7fea6419d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.099+0000 7fea637fe640 1 -- 172.21.15.134:0/2342688417 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea641a0810 con 0x7fea64103160 2024-08-20T01:28:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.099+0000 7fea5bfff640 1 --2- 172.21.15.134:0/2342688417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea641027a0 0x7fea6419d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:28:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.099+0000 7fea62ffd640 1 --2- 172.21.15.134:0/2342688417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea64101640 0x7fea6406bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:28:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.099+0000 7fea637fe640 1 --2- 172.21.15.134:0/2342688417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea64103160 0x7fea6419ff50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00cad0 tx=0x7fea5c00cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.099+0000 7fea60ff9640 1 -- 172.21.15.134:0/2342688417 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c00ae20 con 0x7fea64103160 2024-08-20T01:28:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.099+0000 7fea60ff9640 1 -- 172.21.15.134:0/2342688417 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea5c005020 con 0x7fea64103160 2024-08-20T01:28:22.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.099+0000 7fea6930d640 1 -- 172.21.15.134:0/2342688417 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea641a0b00 con 0x7fea64103160 2024-08-20T01:28:22.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.099+0000 7fea60ff9640 1 -- 172.21.15.134:0/2342688417 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c00f6b0 con 0x7fea64103160 2024-08-20T01:28:22.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.099+0000 7fea6930d640 1 -- 172.21.15.134:0/2342688417 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea641a0ff0 con 0x7fea64103160 2024-08-20T01:28:22.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.100+0000 7fea6930d640 1 -- 172.21.15.134:0/2342688417 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea64108a90 con 0x7fea64103160 2024-08-20T01:28:22.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.101+0000 7fea60ff9640 1 -- 172.21.15.134:0/2342688417 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fea5c0051d0 con 0x7fea64103160 2024-08-20T01:28:22.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.102+0000 7fea60ff9640 1 --2- 172.21.15.134:0/2342688417 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fea500b3bd0 0x7fea500b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:22.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.102+0000 7fea60ff9640 1 -- 172.21.15.134:0/2342688417 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fea5c0e3c50 con 0x7fea64103160 2024-08-20T01:28:22.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.102+0000 7fea62ffd640 1 --2- 172.21.15.134:0/2342688417 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fea500b3bd0 0x7fea500b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:22.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.103+0000 7fea62ffd640 1 --2- 172.21.15.134:0/2342688417 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fea500b3bd0 0x7fea500b6090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fea54031460 tx=0x7fea54000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:22.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.105+0000 7fea60ff9640 1 -- 172.21.15.134:0/2342688417 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fea5c014030 con 0x7fea64103160 2024-08-20T01:28:22.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.290+0000 7fea6930d640 1 -- 172.21.15.134:0/2342688417 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l", "target": ["mon-mgr", ""]}) -- 0x7fea640633c0 con 0x7fea500b3bd0 2024-08-20T01:28:22.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.298+0000 7fea60ff9640 1 -- 172.21.15.134:0/2342688417 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fea640633c0 con 0x7fea500b3bd0 2024-08-20T01:28:22.299 INFO:teuthology.orchestra.run.smithi134.stdout:Scheduled mds.all update... 2024-08-20T01:28:22.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.300+0000 7fea6930d640 1 -- 172.21.15.134:0/2342688417 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fea500b3bd0 msgr2=0x7fea500b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:22.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.300+0000 7fea6930d640 1 --2- 172.21.15.134:0/2342688417 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fea500b3bd0 0x7fea500b6090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fea54031460 tx=0x7fea54000bc0 comp rx=0 tx=0).stop 2024-08-20T01:28:22.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.300+0000 7fea6930d640 1 -- 172.21.15.134:0/2342688417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea64103160 msgr2=0x7fea6419ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:22.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.300+0000 7fea6930d640 1 --2- 172.21.15.134:0/2342688417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea64103160 0x7fea6419ff50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00cad0 tx=0x7fea5c00cf90 comp rx=0 tx=0).stop 2024-08-20T01:28:22.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.300+0000 7fea6930d640 1 -- 172.21.15.134:0/2342688417 shutdown_connections 2024-08-20T01:28:22.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.300+0000 7fea6930d640 1 --2- 172.21.15.134:0/2342688417 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fea500b3bd0 0x7fea500b6090 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:22.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.300+0000 7fea6930d640 1 --2- 172.21.15.134:0/2342688417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea64103160 0x7fea6419ff50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:22.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.300+0000 7fea6930d640 1 --2- 172.21.15.134:0/2342688417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea641027a0 0x7fea6419d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:22.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.300+0000 7fea6930d640 1 --2- 172.21.15.134:0/2342688417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea64101640 0x7fea6406bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:22.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.300+0000 7fea6930d640 1 -- 172.21.15.134:0/2342688417 >> 172.21.15.134:0/2342688417 conn(0x7fea640fcf30 msgr2=0x7fea64105c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:22.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.300+0000 7fea6930d640 1 -- 172.21.15.134:0/2342688417 shutdown_connections 2024-08-20T01:28:22.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-08-20T01:28:22.300+0000 7fea6930d640 1 -- 172.21.15.134:0/2342688417 wait complete. 2024-08-20T01:28:23.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:22 smithi134 ceph-mon[22511]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:23.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:22 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:23.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:22 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:23.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:22 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:23.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:22 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:23.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:22 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:23.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:22 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:23.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:22 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:23.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:22 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:23.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:22 smithi077 ceph-mon[22251]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:23.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:22 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:23.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:22 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:23.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:22 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:23.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:22 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:23.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:22 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:23.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:22 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:23.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:22 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:23.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:22 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:23.106 DEBUG:teuthology.orchestra.run.smithi022:mds.a> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.a.service 2024-08-20T01:28:23.109 DEBUG:teuthology.orchestra.run.smithi022:mds.d> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.d.service 2024-08-20T01:28:23.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:22 smithi022 ceph-mon[18709]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:23.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:22 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:23.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:22 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:23.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:22 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:23.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:22 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:23.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:22 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:23.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:22 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:23.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:22 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:23.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:22 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:23.136 DEBUG:teuthology.orchestra.run.smithi022:mds.g> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.g.service 2024-08-20T01:28:23.179 DEBUG:teuthology.orchestra.run.smithi022:mds.j> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.j.service 2024-08-20T01:28:23.222 DEBUG:teuthology.orchestra.run.smithi077:mds.b> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.b.service 2024-08-20T01:28:23.225 DEBUG:teuthology.orchestra.run.smithi077:mds.e> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.e.service 2024-08-20T01:28:23.267 DEBUG:teuthology.orchestra.run.smithi077:mds.h> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.h.service 2024-08-20T01:28:23.310 DEBUG:teuthology.orchestra.run.smithi077:mds.k> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.k.service 2024-08-20T01:28:23.353 DEBUG:teuthology.orchestra.run.smithi134:mds.c> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.c.service 2024-08-20T01:28:23.356 DEBUG:teuthology.orchestra.run.smithi134:mds.f> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.f.service 2024-08-20T01:28:23.399 DEBUG:teuthology.orchestra.run.smithi134:mds.i> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.i.service 2024-08-20T01:28:23.443 DEBUG:teuthology.orchestra.run.smithi134:mds.l> sudo journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.l.service 2024-08-20T01:28:23.487 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-08-20T01:28:23.487 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:28:23.755 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:24.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:23 smithi134 ceph-mon[22511]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:28:24.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:23 smithi134 ceph-mon[22511]: Saving service mds.all spec with placement smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l;count:12 2024-08-20T01:28:24.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:23 smithi134 ceph-mon[22511]: Deploying daemon mds.l on smithi134 2024-08-20T01:28:24.042 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:23 smithi022 ceph-mon[18709]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:28:24.042 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:23 smithi022 ceph-mon[18709]: Saving service mds.all spec with placement smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l;count:12 2024-08-20T01:28:24.042 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:23 smithi022 ceph-mon[18709]: Deploying daemon mds.l on smithi134 2024-08-20T01:28:24.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:23 smithi077 ceph-mon[22251]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:28:24.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:23 smithi077 ceph-mon[22251]: Saving service mds.all spec with placement smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l;count:12 2024-08-20T01:28:24.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:23 smithi077 ceph-mon[22251]: Deploying daemon mds.l on smithi134 2024-08-20T01:28:24.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.238+0000 7f6ee8027640 1 -- 172.21.15.22:0/718096047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ee01042c0 msgr2=0x7f6ee010c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:24.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.238+0000 7f6ee8027640 1 --2- 172.21.15.22:0/718096047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ee01042c0 0x7f6ee010c7b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009900 tx=0x7f6ed002a410 comp rx=0 tx=0).stop 2024-08-20T01:28:24.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.238+0000 7f6ee8027640 1 -- 172.21.15.22:0/718096047 shutdown_connections 2024-08-20T01:28:24.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.238+0000 7f6ee8027640 1 --2- 172.21.15.22:0/718096047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee010ce00 0x7f6ee010f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:24.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.238+0000 7f6ee8027640 1 --2- 172.21.15.22:0/718096047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ee01042c0 0x7f6ee010c7b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:24.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.238+0000 7f6ee8027640 1 --2- 172.21.15.22:0/718096047 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ee01039a0 0x7f6ee0103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:24.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.238+0000 7f6ee8027640 1 -- 172.21.15.22:0/718096047 >> 172.21.15.22:0/718096047 conn(0x7f6ee00fd400 msgr2=0x7f6ee00ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:24.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.238+0000 7f6ee8027640 1 -- 172.21.15.22:0/718096047 shutdown_connections 2024-08-20T01:28:24.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.238+0000 7f6ee8027640 1 -- 172.21.15.22:0/718096047 wait complete. 2024-08-20T01:28:24.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.239+0000 7f6ee8027640 1 Processor -- start 2024-08-20T01:28:24.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.239+0000 7f6ee8027640 1 -- start start 2024-08-20T01:28:24.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.239+0000 7f6ee8027640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ee01039a0 0x7f6ee0101650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:24.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.239+0000 7f6ee8027640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee01042c0 0x7f6ee0101b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:24.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.239+0000 7f6ee8027640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ee010ce00 0x7f6ee01020d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:24.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.239+0000 7f6ee8027640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee0112a70 con 0x7f6ee01039a0 2024-08-20T01:28:24.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.239+0000 7f6ee8027640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee01128f0 con 0x7f6ee01042c0 2024-08-20T01:28:24.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.239+0000 7f6ee8027640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee0112bf0 con 0x7f6ee010ce00 2024-08-20T01:28:24.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.239+0000 7f6ee5dc3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ee01039a0 0x7f6ee0101650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:24.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.239+0000 7f6ee5dc3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ee01039a0 0x7f6ee0101650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47688/0 (socket says 172.21.15.22:47688) 2024-08-20T01:28:24.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.239+0000 7f6ee5dc3640 1 -- 172.21.15.22:0/3540676941 learned_addr learned my addr 172.21.15.22:0/3540676941 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:28:24.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.239+0000 7f6ee55c2640 1 --2- 172.21.15.22:0/3540676941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee01042c0 0x7f6ee0101b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:24.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.239+0000 7f6ee65c4640 1 --2- 172.21.15.22:0/3540676941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ee010ce00 0x7f6ee01020d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:24.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.239+0000 7f6ee5dc3640 1 -- 172.21.15.22:0/3540676941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ee010ce00 msgr2=0x7f6ee01020d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:24.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.239+0000 7f6ee5dc3640 1 --2- 172.21.15.22:0/3540676941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ee010ce00 0x7f6ee01020d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:24.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.239+0000 7f6ee5dc3640 1 -- 172.21.15.22:0/3540676941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee01042c0 msgr2=0x7f6ee0101b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:24.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.239+0000 7f6ee5dc3640 1 --2- 172.21.15.22:0/3540676941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee01042c0 0x7f6ee0101b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:24.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.239+0000 7f6ee5dc3640 1 -- 172.21.15.22:0/3540676941 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee01a7400 con 0x7f6ee01039a0 2024-08-20T01:28:24.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.239+0000 7f6ee5dc3640 1 --2- 172.21.15.22:0/3540676941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ee01039a0 0x7f6ee0101650 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00ebc0 tx=0x7f6edc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:24.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.240+0000 7f6ed6ffd640 1 -- 172.21.15.22:0/3540676941 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc010630 con 0x7f6ee01039a0 2024-08-20T01:28:24.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.240+0000 7f6ee8027640 1 -- 172.21.15.22:0/3540676941 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee01a76f0 con 0x7f6ee01039a0 2024-08-20T01:28:24.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.240+0000 7f6ed6ffd640 1 -- 172.21.15.22:0/3540676941 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6edc010c80 con 0x7f6ee01039a0 2024-08-20T01:28:24.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.240+0000 7f6ed6ffd640 1 -- 172.21.15.22:0/3540676941 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc018b60 con 0x7f6ee01039a0 2024-08-20T01:28:24.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.240+0000 7f6ee8027640 1 -- 172.21.15.22:0/3540676941 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee01a7c50 con 0x7f6ee01039a0 2024-08-20T01:28:24.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.241+0000 7f6ee8027640 1 -- 172.21.15.22:0/3540676941 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee0103d80 con 0x7f6ee01039a0 2024-08-20T01:28:24.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.242+0000 7f6ed6ffd640 1 -- 172.21.15.22:0/3540676941 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f6edc018d00 con 0x7f6ee01039a0 2024-08-20T01:28:24.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.243+0000 7f6ed6ffd640 1 --2- 172.21.15.22:0/3540676941 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6ecc0b3bd0 0x7f6ecc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:24.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.243+0000 7f6ee55c2640 1 --2- 172.21.15.22:0/3540676941 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6ecc0b3bd0 0x7f6ecc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:24.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.243+0000 7f6ed6ffd640 1 -- 172.21.15.22:0/3540676941 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f6edc0e4310 con 0x7f6ee01039a0 2024-08-20T01:28:24.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.243+0000 7f6ee55c2640 1 --2- 172.21.15.22:0/3540676941 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6ecc0b3bd0 0x7f6ecc0b6090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0000c00 tx=0x7f6ed0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:24.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.246+0000 7f6ed6ffd640 1 -- 172.21.15.22:0/3540676941 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f6edc0abd60 con 0x7f6ee01039a0 2024-08-20T01:28:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.469+0000 7f6ee8027640 1 -- 172.21.15.22:0/3540676941 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ee01a8020 con 0x7f6ee01039a0 2024-08-20T01:28:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.470+0000 7f6ed6ffd640 1 -- 172.21.15.22:0/3540676941 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f6edc0ab660 con 0x7f6ee01039a0 2024-08-20T01:28:24.470 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:28:24.471 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":1,"btime":"2024-08-20T01:20:55:065563+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-08-20T01:28:24.471 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 1 2024-08-20T01:28:24.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.472+0000 7f6ee8027640 1 -- 172.21.15.22:0/3540676941 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6ecc0b3bd0 msgr2=0x7f6ecc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:24.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.472+0000 7f6ee8027640 1 --2- 172.21.15.22:0/3540676941 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6ecc0b3bd0 0x7f6ecc0b6090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0000c00 tx=0x7f6ed0031400 comp rx=0 tx=0).stop 2024-08-20T01:28:24.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.472+0000 7f6ee8027640 1 -- 172.21.15.22:0/3540676941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ee01039a0 msgr2=0x7f6ee0101650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:24.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.472+0000 7f6ee8027640 1 --2- 172.21.15.22:0/3540676941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ee01039a0 0x7f6ee0101650 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00ebc0 tx=0x7f6edc00c6a0 comp rx=0 tx=0).stop 2024-08-20T01:28:24.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.472+0000 7f6ee8027640 1 -- 172.21.15.22:0/3540676941 shutdown_connections 2024-08-20T01:28:24.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.472+0000 7f6ee8027640 1 --2- 172.21.15.22:0/3540676941 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6ecc0b3bd0 0x7f6ecc0b6090 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:24.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.472+0000 7f6ee8027640 1 --2- 172.21.15.22:0/3540676941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ee010ce00 0x7f6ee01020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:24.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.472+0000 7f6ee8027640 1 --2- 172.21.15.22:0/3540676941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee01042c0 0x7f6ee0101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:24.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.472+0000 7f6ee8027640 1 --2- 172.21.15.22:0/3540676941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ee01039a0 0x7f6ee0101650 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:24.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.472+0000 7f6ee8027640 1 -- 172.21.15.22:0/3540676941 >> 172.21.15.22:0/3540676941 conn(0x7f6ee00fd400 msgr2=0x7f6ee00fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:24.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.472+0000 7f6ee8027640 1 -- 172.21.15.22:0/3540676941 shutdown_connections 2024-08-20T01:28:24.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:24.472+0000 7f6ee8027640 1 -- 172.21.15.22:0/3540676941 wait complete. 2024-08-20T01:28:25.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:24 smithi134 ceph-mon[22511]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:25.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:24 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3540676941' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:25.015 INFO:journalctl@ceph.mds.l.smithi134.stdout:Aug 20 01:28:24 smithi134 systemd[1]: Starting Ceph mds.l for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:28:25.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:24 smithi077 ceph-mon[22251]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:25.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:24 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3540676941' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:25.087 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:24 smithi022 ceph-mon[18709]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:25.087 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:24 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3540676941' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:25.401 INFO:journalctl@ceph.mds.l.smithi134.stdout:Aug 20 01:28:25 smithi134 podman[52064]: 2024-08-20 01:28:25.048867859 +0000 UTC m=+0.016039306 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:28:25.401 INFO:journalctl@ceph.mds.l.smithi134.stdout:Aug 20 01:28:25 smithi134 podman[52064]: 2024-08-20 01:28:25.165634517 +0000 UTC m=+0.132805963 container create c777c662cbb9382202a65e1d7c7ee8ef6bbb305864bb7bb80b062e4dd6a654c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-l, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:28:25.401 INFO:journalctl@ceph.mds.l.smithi134.stdout:Aug 20 01:28:25 smithi134 podman[52064]: 2024-08-20 01:28:25.401593021 +0000 UTC m=+0.368764468 container init c777c662cbb9382202a65e1d7c7ee8ef6bbb305864bb7bb80b062e4dd6a654c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:28:25.765 INFO:journalctl@ceph.mds.l.smithi134.stdout:Aug 20 01:28:25 smithi134 podman[52064]: 2024-08-20 01:28:25.40456005 +0000 UTC m=+0.371731499 container start c777c662cbb9382202a65e1d7c7ee8ef6bbb305864bb7bb80b062e4dd6a654c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-l, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-08-20T01:28:25.765 INFO:journalctl@ceph.mds.l.smithi134.stdout:Aug 20 01:28:25 smithi134 ceph-mds[52083]: -- 172.21.15.134:0/316265733 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f97d415860 con 0x55f97d3f3400 2024-08-20T01:28:25.765 INFO:journalctl@ceph.mds.l.smithi134.stdout:Aug 20 01:28:25 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-l[52079]: starting mds.l at 2024-08-20T01:28:25.765 INFO:journalctl@ceph.mds.l.smithi134.stdout:Aug 20 01:28:25 smithi134 bash[52064]: c777c662cbb9382202a65e1d7c7ee8ef6bbb305864bb7bb80b062e4dd6a654c0 2024-08-20T01:28:25.766 INFO:journalctl@ceph.mds.l.smithi134.stdout:Aug 20 01:28:25 smithi134 systemd[1]: Started Ceph mds.l for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:28:26.437 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:26 smithi022 ceph-mon[18709]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:26.437 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:26 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.134:6832/3278477669,v1:172.21.15.134:6833/3278477669] up:boot 2024-08-20T01:28:26.438 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:26 smithi022 ceph-mon[18709]: fsmap 1 up:standby 2024-08-20T01:28:26.438 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:26 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-20T01:28:26.438 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:26 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:26.438 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:26 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:26.438 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:26 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:26.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:26 smithi134 ceph-mon[22511]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:26.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:26 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.134:6832/3278477669,v1:172.21.15.134:6833/3278477669] up:boot 2024-08-20T01:28:26.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:26 smithi134 ceph-mon[22511]: fsmap 1 up:standby 2024-08-20T01:28:26.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:26 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-20T01:28:26.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:26 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:26.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:26 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:26.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:26 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:26.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:26 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:26.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:26 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:26.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:26 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:26.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:26 smithi134 ceph-mon[22511]: Deploying daemon mds.k on smithi077 2024-08-20T01:28:26.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:26 smithi077 ceph-mon[22251]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:26.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:26 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.134:6832/3278477669,v1:172.21.15.134:6833/3278477669] up:boot 2024-08-20T01:28:26.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:26 smithi077 ceph-mon[22251]: fsmap 1 up:standby 2024-08-20T01:28:26.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:26 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-20T01:28:26.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:26 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:26.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:26 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:26.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:26 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:26.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:26 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:26.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:26 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:26.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:26 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:26.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:26 smithi077 ceph-mon[22251]: Deploying daemon mds.k on smithi077 2024-08-20T01:28:26.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:26 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:26.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:26 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:26.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:26 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:26.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:26 smithi022 ceph-mon[18709]: Deploying daemon mds.k on smithi077 2024-08-20T01:28:27.124 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:28:27.394 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:27.753 INFO:journalctl@ceph.mds.k.smithi077.stdout:Aug 20 01:28:27 smithi077 systemd[1]: Starting Ceph mds.k for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:28:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.847+0000 7f3fca731640 1 -- 172.21.15.22:0/2264211434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc4104270 msgr2=0x7f3fc410c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.847+0000 7f3fca731640 1 --2- 172.21.15.22:0/2264211434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc4104270 0x7f3fc410c850 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8009900 tx=0x7f3fb802a410 comp rx=0 tx=0).stop 2024-08-20T01:28:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.847+0000 7f3fca731640 1 -- 172.21.15.22:0/2264211434 shutdown_connections 2024-08-20T01:28:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.847+0000 7f3fca731640 1 --2- 172.21.15.22:0/2264211434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fc410ce20 0x7f3fc410f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.847+0000 7f3fca731640 1 --2- 172.21.15.22:0/2264211434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc4104270 0x7f3fc410c850 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.847+0000 7f3fca731640 1 --2- 172.21.15.22:0/2264211434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fc4103870 0x7f3fc4103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.847+0000 7f3fca731640 1 -- 172.21.15.22:0/2264211434 >> 172.21.15.22:0/2264211434 conn(0x7f3fc40fd440 msgr2=0x7f3fc40ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.847+0000 7f3fca731640 1 -- 172.21.15.22:0/2264211434 shutdown_connections 2024-08-20T01:28:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.847+0000 7f3fca731640 1 -- 172.21.15.22:0/2264211434 wait complete. 2024-08-20T01:28:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.848+0000 7f3fca731640 1 Processor -- start 2024-08-20T01:28:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.848+0000 7f3fca731640 1 -- start start 2024-08-20T01:28:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.848+0000 7f3fca731640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fc4103870 0x7f3fc4199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.848+0000 7f3fca731640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc4104270 0x7f3fc4199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.848+0000 7f3fca731640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fc410ce20 0x7f3fc419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.848+0000 7f3fca731640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc4112aa0 con 0x7f3fc4104270 2024-08-20T01:28:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.848+0000 7f3fca731640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc4112920 con 0x7f3fc410ce20 2024-08-20T01:28:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.848+0000 7f3fca731640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc4112c20 con 0x7f3fc4103870 2024-08-20T01:28:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.848+0000 7f3fc37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc4104270 0x7f3fc4199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.848+0000 7f3fc37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc4104270 0x7f3fc4199550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47710/0 (socket says 172.21.15.22:47710) 2024-08-20T01:28:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.848+0000 7f3fc37fe640 1 -- 172.21.15.22:0/1656071495 learned_addr learned my addr 172.21.15.22:0/1656071495 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:28:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.848+0000 7f3fc3fff640 1 --2- 172.21.15.22:0/1656071495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fc4103870 0x7f3fc4199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:27.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.849+0000 7f3fc8cce640 1 --2- 172.21.15.22:0/1656071495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fc410ce20 0x7f3fc419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:27.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.849+0000 7f3fc37fe640 1 -- 172.21.15.22:0/1656071495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fc4103870 msgr2=0x7f3fc4199010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:27.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.849+0000 7f3fc37fe640 1 --2- 172.21.15.22:0/1656071495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fc4103870 0x7f3fc4199010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:27.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.849+0000 7f3fc37fe640 1 -- 172.21.15.22:0/1656071495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fc410ce20 msgr2=0x7f3fc419e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:27.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.849+0000 7f3fc37fe640 1 --2- 172.21.15.22:0/1656071495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fc410ce20 0x7f3fc419e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:27.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.849+0000 7f3fc37fe640 1 -- 172.21.15.22:0/1656071495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc419f0c0 con 0x7f3fc4104270 2024-08-20T01:28:27.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.849+0000 7f3fc37fe640 1 --2- 172.21.15.22:0/1656071495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc4104270 0x7f3fc4199550 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8005940 tx=0x7f3fb80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:27.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.849+0000 7f3fc17fa640 1 -- 172.21.15.22:0/1656071495 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb803f030 con 0x7f3fc4104270 2024-08-20T01:28:27.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.849+0000 7f3fc17fa640 1 -- 172.21.15.22:0/1656071495 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fb8003cb0 con 0x7f3fc4104270 2024-08-20T01:28:27.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.849+0000 7f3fca731640 1 -- 172.21.15.22:0/1656071495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc419f350 con 0x7f3fc4104270 2024-08-20T01:28:27.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.849+0000 7f3fc17fa640 1 -- 172.21.15.22:0/1656071495 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8035070 con 0x7f3fc4104270 2024-08-20T01:28:27.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.849+0000 7f3fca731640 1 -- 172.21.15.22:0/1656071495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc41a5a70 con 0x7f3fc4104270 2024-08-20T01:28:27.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.850+0000 7f3fca731640 1 -- 172.21.15.22:0/1656071495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fc4103c50 con 0x7f3fc4104270 2024-08-20T01:28:27.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.851+0000 7f3fc17fa640 1 -- 172.21.15.22:0/1656071495 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f3fb8042030 con 0x7f3fc4104270 2024-08-20T01:28:27.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.852+0000 7f3fc17fa640 1 --2- 172.21.15.22:0/1656071495 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3fac0b3c50 0x7f3fac0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:27.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.852+0000 7f3fc3fff640 1 --2- 172.21.15.22:0/1656071495 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3fac0b3c50 0x7f3fac0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:27.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.852+0000 7f3fc17fa640 1 -- 172.21.15.22:0/1656071495 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f3fb81043d0 con 0x7f3fc4104270 2024-08-20T01:28:27.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.853+0000 7f3fc3fff640 1 --2- 172.21.15.22:0/1656071495 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3fac0b3c50 0x7f3fac0b6110 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4005fd0 tx=0x7f3fb4005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:27.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:27.855+0000 7f3fc17fa640 1 -- 172.21.15.22:0/1656071495 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f3fb80cbe20 con 0x7f3fc4104270 2024-08-20T01:28:28.035 INFO:journalctl@ceph.mds.k.smithi077.stdout:Aug 20 01:28:27 smithi077 podman[50937]: 2024-08-20 01:28:27.655695279 +0000 UTC m=+0.015912292 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:28:28.035 INFO:journalctl@ceph.mds.k.smithi077.stdout:Aug 20 01:28:27 smithi077 podman[50937]: 2024-08-20 01:28:27.782808113 +0000 UTC m=+0.143025184 container create 5bf61e15f6e942b4b90938757af94e8bb83be7f91c7f218f5b9f8565bf5a1aa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-08-20T01:28:28.036 INFO:journalctl@ceph.mds.k.smithi077.stdout:Aug 20 01:28:28 smithi077 podman[50937]: 2024-08-20 01:28:28.035398725 +0000 UTC m=+0.395615737 container init 5bf61e15f6e942b4b90938757af94e8bb83be7f91c7f218f5b9f8565bf5a1aa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-k, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-20T01:28:28.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:28.075+0000 7f3fca731640 1 -- 172.21.15.22:0/1656071495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fc419a140 con 0x7f3fc4104270 2024-08-20T01:28:28.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:28.076+0000 7f3fc17fa640 1 -- 172.21.15.22:0/1656071495 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f3fb80d40f0 con 0x7f3fc4104270 2024-08-20T01:28:28.076 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:28:28.077 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":2,"btime":"2024-08-20T01:28:25:432598+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-20T01:28:28.077 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 2 2024-08-20T01:28:28.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:28.078+0000 7f3fca731640 1 -- 172.21.15.22:0/1656071495 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3fac0b3c50 msgr2=0x7f3fac0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:28.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:28.078+0000 7f3fca731640 1 --2- 172.21.15.22:0/1656071495 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3fac0b3c50 0x7f3fac0b6110 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4005fd0 tx=0x7f3fb4005e20 comp rx=0 tx=0).stop 2024-08-20T01:28:28.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:28.078+0000 7f3fca731640 1 -- 172.21.15.22:0/1656071495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc4104270 msgr2=0x7f3fc4199550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:28.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:28.078+0000 7f3fca731640 1 --2- 172.21.15.22:0/1656071495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc4104270 0x7f3fc4199550 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8005940 tx=0x7f3fb80042f0 comp rx=0 tx=0).stop 2024-08-20T01:28:28.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:28.078+0000 7f3fca731640 1 -- 172.21.15.22:0/1656071495 shutdown_connections 2024-08-20T01:28:28.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:28.078+0000 7f3fca731640 1 --2- 172.21.15.22:0/1656071495 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3fac0b3c50 0x7f3fac0b6110 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:28.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:28.078+0000 7f3fca731640 1 --2- 172.21.15.22:0/1656071495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fc410ce20 0x7f3fc419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:28.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:28.078+0000 7f3fca731640 1 --2- 172.21.15.22:0/1656071495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc4104270 0x7f3fc4199550 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:28.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:28.078+0000 7f3fca731640 1 --2- 172.21.15.22:0/1656071495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fc4103870 0x7f3fc4199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:28.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:28.078+0000 7f3fca731640 1 -- 172.21.15.22:0/1656071495 >> 172.21.15.22:0/1656071495 conn(0x7f3fc40fd440 msgr2=0x7f3fc40fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:28.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:28.078+0000 7f3fca731640 1 -- 172.21.15.22:0/1656071495 shutdown_connections 2024-08-20T01:28:28.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:28.078+0000 7f3fca731640 1 -- 172.21.15.22:0/1656071495 wait complete. 2024-08-20T01:28:28.314 INFO:journalctl@ceph.mds.k.smithi077.stdout:Aug 20 01:28:28 smithi077 podman[50937]: 2024-08-20 01:28:28.038363814 +0000 UTC m=+0.398580829 container start 5bf61e15f6e942b4b90938757af94e8bb83be7f91c7f218f5b9f8565bf5a1aa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-k, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-08-20T01:28:28.314 INFO:journalctl@ceph.mds.k.smithi077.stdout:Aug 20 01:28:28 smithi077 ceph-mds[50957]: -- 172.21.15.77:0/3006401002 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5604e0a95860 con 0x5604e0a73400 2024-08-20T01:28:28.314 INFO:journalctl@ceph.mds.k.smithi077.stdout:Aug 20 01:28:28 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-k[50953]: starting mds.k at 2024-08-20T01:28:28.314 INFO:journalctl@ceph.mds.k.smithi077.stdout:Aug 20 01:28:28 smithi077 bash[50937]: 5bf61e15f6e942b4b90938757af94e8bb83be7f91c7f218f5b9f8565bf5a1aa0 2024-08-20T01:28:28.314 INFO:journalctl@ceph.mds.k.smithi077.stdout:Aug 20 01:28:28 smithi077 systemd[1]: Started Ceph mds.k for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:28:28.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:28 smithi022 ceph-mon[18709]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:28.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:28 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1656071495' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:28.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:28 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:28.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:28 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:28.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:28 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:28.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:28 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:28.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:28 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:28.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:28 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:28.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:28 smithi134 ceph-mon[22511]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:28.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:28 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1656071495' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:28.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:28 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:28.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:28 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:28.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:28 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:28.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:28 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:28.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:28 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:28.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:28 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:28.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:28 smithi077 ceph-mon[22251]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:28.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:28 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1656071495' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:28.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:28 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:28.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:28 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:28.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:28 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:28.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:28 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:28.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:28 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:28.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:28 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:29.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:29 smithi134 ceph-mon[22511]: Deploying daemon mds.j on smithi022 2024-08-20T01:28:29.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:29 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.77:6832/2545210984,v1:172.21.15.77:6833/2545210984] up:boot 2024-08-20T01:28:29.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:29 smithi134 ceph-mon[22511]: fsmap 2 up:standby 2024-08-20T01:28:29.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:29 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-20T01:28:29.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:29 smithi077 ceph-mon[22251]: Deploying daemon mds.j on smithi022 2024-08-20T01:28:29.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:29 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.77:6832/2545210984,v1:172.21.15.77:6833/2545210984] up:boot 2024-08-20T01:28:29.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:29 smithi077 ceph-mon[22251]: fsmap 2 up:standby 2024-08-20T01:28:29.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:29 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-20T01:28:29.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:29 smithi022 ceph-mon[18709]: Deploying daemon mds.j on smithi022 2024-08-20T01:28:29.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:29 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.77:6832/2545210984,v1:172.21.15.77:6833/2545210984] up:boot 2024-08-20T01:28:29.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:29 smithi022 ceph-mon[18709]: fsmap 2 up:standby 2024-08-20T01:28:29.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:29 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-20T01:28:30.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:30 smithi022 ceph-mon[18709]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:30.636 INFO:journalctl@ceph.mds.j.smithi022.stdout:Aug 20 01:28:30 smithi022 systemd[1]: Starting Ceph mds.j for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:28:30.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:30 smithi134 ceph-mon[22511]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:30.788 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:28:30.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:30 smithi077 ceph-mon[22251]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:31.055 INFO:journalctl@ceph.mds.j.smithi022.stdout:Aug 20 01:28:30 smithi022 podman[59679]: 2024-08-20 01:28:30.691511288 +0000 UTC m=+0.016410534 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:28:31.056 INFO:journalctl@ceph.mds.j.smithi022.stdout:Aug 20 01:28:30 smithi022 podman[59679]: 2024-08-20 01:28:30.79927142 +0000 UTC m=+0.124170650 container create 084e5c2c28ed87da2b943c1cb7e9eb7778c30144eee1648325dd490075ccdc89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-j, io.buildah.version=1.36.0, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-20T01:28:31.056 INFO:journalctl@ceph.mds.j.smithi022.stdout:Aug 20 01:28:31 smithi022 podman[59679]: 2024-08-20 01:28:31.02721501 +0000 UTC m=+0.352114240 container init 084e5c2c28ed87da2b943c1cb7e9eb7778c30144eee1648325dd490075ccdc89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-20T01:28:31.056 INFO:journalctl@ceph.mds.j.smithi022.stdout:Aug 20 01:28:31 smithi022 podman[59679]: 2024-08-20 01:28:31.030506434 +0000 UTC m=+0.355405665 container start 084e5c2c28ed87da2b943c1cb7e9eb7778c30144eee1648325dd490075ccdc89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:28:31.237 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:31.360 INFO:journalctl@ceph.mds.j.smithi022.stdout:Aug 20 01:28:31 smithi022 ceph-mds[59727]: -- 172.21.15.22:0/692356427 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559b8249f860 con 0x559b8247d000 2024-08-20T01:28:31.360 INFO:journalctl@ceph.mds.j.smithi022.stdout:Aug 20 01:28:31 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-j[59712]: starting mds.j at 2024-08-20T01:28:31.361 INFO:journalctl@ceph.mds.j.smithi022.stdout:Aug 20 01:28:31 smithi022 bash[59679]: 084e5c2c28ed87da2b943c1cb7e9eb7778c30144eee1648325dd490075ccdc89 2024-08-20T01:28:31.361 INFO:journalctl@ceph.mds.j.smithi022.stdout:Aug 20 01:28:31 smithi022 systemd[1]: Started Ceph mds.j for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:28:31.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.739+0000 7fad3d081640 1 -- 172.21.15.22:0/4160569753 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad381039b0 msgr2=0x7fad38103d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.739+0000 7fad3d081640 1 --2- 172.21.15.22:0/4160569753 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad381039b0 0x7fad38103d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fad28009ca0 tx=0x7fad2802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:28:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.739+0000 7fad3d081640 1 -- 172.21.15.22:0/4160569753 shutdown_connections 2024-08-20T01:28:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.739+0000 7fad3d081640 1 --2- 172.21.15.22:0/4160569753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad3810ce10 0x7fad3810f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.739+0000 7fad3d081640 1 --2- 172.21.15.22:0/4160569753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad381042d0 0x7fad3810c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:31.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.739+0000 7fad3d081640 1 --2- 172.21.15.22:0/4160569753 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad381039b0 0x7fad38103d90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:31.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.739+0000 7fad3d081640 1 -- 172.21.15.22:0/4160569753 >> 172.21.15.22:0/4160569753 conn(0x7fad380fd430 msgr2=0x7fad380ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:31.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.739+0000 7fad3d081640 1 -- 172.21.15.22:0/4160569753 shutdown_connections 2024-08-20T01:28:31.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.739+0000 7fad3d081640 1 -- 172.21.15.22:0/4160569753 wait complete. 2024-08-20T01:28:31.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.739+0000 7fad3d081640 1 Processor -- start 2024-08-20T01:28:31.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.740+0000 7fad3d081640 1 -- start start 2024-08-20T01:28:31.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.740+0000 7fad3d081640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad381039b0 0x7fad38101660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:31.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.740+0000 7fad3d081640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad381042d0 0x7fad38101ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:31.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.740+0000 7fad3d081640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad3810ce10 0x7fad381020e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.740+0000 7fad3d081640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fad38112b00 con 0x7fad381042d0 2024-08-20T01:28:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.740+0000 7fad3d081640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fad38112980 con 0x7fad3810ce10 2024-08-20T01:28:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.740+0000 7fad3d081640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fad38112c80 con 0x7fad381039b0 2024-08-20T01:28:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.740+0000 7fad3659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad381042d0 0x7fad38101ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.740+0000 7fad3659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad381042d0 0x7fad38101ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48966/0 (socket says 172.21.15.22:48966) 2024-08-20T01:28:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.740+0000 7fad3659c640 1 -- 172.21.15.22:0/3523568959 learned_addr learned my addr 172.21.15.22:0/3523568959 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:28:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.740+0000 7fad36d9d640 1 --2- 172.21.15.22:0/3523568959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad381039b0 0x7fad38101660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.740+0000 7fad3759e640 1 --2- 172.21.15.22:0/3523568959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad3810ce10 0x7fad381020e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.740+0000 7fad3659c640 1 -- 172.21.15.22:0/3523568959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad381039b0 msgr2=0x7fad38101660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.740+0000 7fad3659c640 1 --2- 172.21.15.22:0/3523568959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad381039b0 0x7fad38101660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.740+0000 7fad3659c640 1 -- 172.21.15.22:0/3523568959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad3810ce10 msgr2=0x7fad381020e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.740+0000 7fad3659c640 1 --2- 172.21.15.22:0/3523568959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad3810ce10 0x7fad381020e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.740+0000 7fad3659c640 1 -- 172.21.15.22:0/3523568959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad381a7450 con 0x7fad381042d0 2024-08-20T01:28:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.741+0000 7fad36d9d640 1 --2- 172.21.15.22:0/3523568959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad381039b0 0x7fad38101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:28:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.741+0000 7fad3659c640 1 --2- 172.21.15.22:0/3523568959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad381042d0 0x7fad38101ba0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fad2000b3c0 tx=0x7fad2000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.741+0000 7fad2ffff640 1 -- 172.21.15.22:0/3523568959 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20011830 con 0x7fad381042d0 2024-08-20T01:28:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.741+0000 7fad2ffff640 1 -- 172.21.15.22:0/3523568959 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad20016070 con 0x7fad381042d0 2024-08-20T01:28:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.741+0000 7fad3d081640 1 -- 172.21.15.22:0/3523568959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad381a7740 con 0x7fad381042d0 2024-08-20T01:28:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.741+0000 7fad2ffff640 1 -- 172.21.15.22:0/3523568959 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20010de0 con 0x7fad381042d0 2024-08-20T01:28:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.741+0000 7fad3d081640 1 -- 172.21.15.22:0/3523568959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad381a7d00 con 0x7fad381042d0 2024-08-20T01:28:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.742+0000 7fad3d081640 1 -- 172.21.15.22:0/3523568959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad38103d90 con 0x7fad381042d0 2024-08-20T01:28:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.743+0000 7fad2ffff640 1 -- 172.21.15.22:0/3523568959 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fad200119d0 con 0x7fad381042d0 2024-08-20T01:28:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.744+0000 7fad2ffff640 1 --2- 172.21.15.22:0/3523568959 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fad240b3bd0 0x7fad240b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.744+0000 7fad36d9d640 1 --2- 172.21.15.22:0/3523568959 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fad240b3bd0 0x7fad240b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.744+0000 7fad2ffff640 1 -- 172.21.15.22:0/3523568959 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fad200e2ec0 con 0x7fad381042d0 2024-08-20T01:28:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.745+0000 7fad36d9d640 1 --2- 172.21.15.22:0/3523568959 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fad240b3bd0 0x7fad240b6090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fad28000f80 tx=0x7fad2802f480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.748+0000 7fad2ffff640 1 -- 172.21.15.22:0/3523568959 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fad200aa910 con 0x7fad381042d0 2024-08-20T01:28:31.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.987+0000 7fad3d081640 1 -- 172.21.15.22:0/3523568959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad381a8090 con 0x7fad381042d0 2024-08-20T01:28:31.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.987+0000 7fad2ffff640 1 -- 172.21.15.22:0/3523568959 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7fad200aa210 con 0x7fad381042d0 2024-08-20T01:28:31.989 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:28:31.989 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":4,"btime":"2024-08-20T01:28:31:447056+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-20T01:28:31.989 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 4 2024-08-20T01:28:31.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.989+0000 7fad3d081640 1 -- 172.21.15.22:0/3523568959 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fad240b3bd0 msgr2=0x7fad240b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:31.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.989+0000 7fad3d081640 1 --2- 172.21.15.22:0/3523568959 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fad240b3bd0 0x7fad240b6090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fad28000f80 tx=0x7fad2802f480 comp rx=0 tx=0).stop 2024-08-20T01:28:31.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.989+0000 7fad3d081640 1 -- 172.21.15.22:0/3523568959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad381042d0 msgr2=0x7fad38101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:31.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.989+0000 7fad3d081640 1 --2- 172.21.15.22:0/3523568959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad381042d0 0x7fad38101ba0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fad2000b3c0 tx=0x7fad2000b880 comp rx=0 tx=0).stop 2024-08-20T01:28:31.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.989+0000 7fad3d081640 1 -- 172.21.15.22:0/3523568959 shutdown_connections 2024-08-20T01:28:31.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.989+0000 7fad3d081640 1 --2- 172.21.15.22:0/3523568959 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fad240b3bd0 0x7fad240b6090 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:31.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.989+0000 7fad3d081640 1 --2- 172.21.15.22:0/3523568959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad3810ce10 0x7fad381020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:31.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.989+0000 7fad3d081640 1 --2- 172.21.15.22:0/3523568959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad381042d0 0x7fad38101ba0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:31.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.989+0000 7fad3d081640 1 --2- 172.21.15.22:0/3523568959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad381039b0 0x7fad38101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:31.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.989+0000 7fad3d081640 1 -- 172.21.15.22:0/3523568959 >> 172.21.15.22:0/3523568959 conn(0x7fad380fd430 msgr2=0x7fad380fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:31.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.989+0000 7fad3d081640 1 -- 172.21.15.22:0/3523568959 shutdown_connections 2024-08-20T01:28:31.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:31.989+0000 7fad3d081640 1 -- 172.21.15.22:0/3523568959 wait complete. 2024-08-20T01:28:32.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:32 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:32.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:32 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:32.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:32 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:32.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:32 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:32.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:32 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:32.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:32 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:32.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:32 smithi134 ceph-mon[22511]: Deploying daemon mds.d on smithi022 2024-08-20T01:28:32.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:32 smithi134 ceph-mon[22511]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:32.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:32 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.22:6834/2832768009,v1:172.21.15.22:6835/2832768009] up:boot 2024-08-20T01:28:32.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:32 smithi134 ceph-mon[22511]: fsmap 3 up:standby 2024-08-20T01:28:32.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:32 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-20T01:28:32.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:32 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3523568959' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:32.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:32 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:32.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:32 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:32.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:32 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:32.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:32 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:32.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:32 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:32.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:32 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:32.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:32 smithi077 ceph-mon[22251]: Deploying daemon mds.d on smithi022 2024-08-20T01:28:32.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:32 smithi077 ceph-mon[22251]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:32.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:32 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.22:6834/2832768009,v1:172.21.15.22:6835/2832768009] up:boot 2024-08-20T01:28:32.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:32 smithi077 ceph-mon[22251]: fsmap 3 up:standby 2024-08-20T01:28:32.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:32 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-20T01:28:32.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:32 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3523568959' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:32.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:32 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:32.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:32 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:32.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:32 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:32.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:32 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:32.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:32 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:32.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:32 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:32.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:32 smithi022 ceph-mon[18709]: Deploying daemon mds.d on smithi022 2024-08-20T01:28:32.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:32 smithi022 ceph-mon[18709]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:32.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:32 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.22:6834/2832768009,v1:172.21.15.22:6835/2832768009] up:boot 2024-08-20T01:28:32.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:32 smithi022 ceph-mon[18709]: fsmap 3 up:standby 2024-08-20T01:28:32.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:32 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-20T01:28:32.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:32 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3523568959' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:34.323 INFO:journalctl@ceph.mds.d.smithi022.stdout:Aug 20 01:28:34 smithi022 systemd[1]: Starting Ceph mds.d for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:28:34.583 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:34 smithi022 ceph-mon[18709]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:34.584 INFO:journalctl@ceph.mds.d.smithi022.stdout:Aug 20 01:28:34 smithi022 podman[60098]: 2024-08-20 01:28:34.225369607 +0000 UTC m=+0.016305339 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:28:34.584 INFO:journalctl@ceph.mds.d.smithi022.stdout:Aug 20 01:28:34 smithi022 podman[60098]: 2024-08-20 01:28:34.347447467 +0000 UTC m=+0.138383190 container create e42dcee1c9e6a6e9c3053b33b605506602f2570002d8af7760689f74d4e884da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-d, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-20T01:28:34.584 INFO:journalctl@ceph.mds.d.smithi022.stdout:Aug 20 01:28:34 smithi022 podman[60098]: 2024-08-20 01:28:34.583892005 +0000 UTC m=+0.374827731 container init e42dcee1c9e6a6e9c3053b33b605506602f2570002d8af7760689f74d4e884da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-d, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True) 2024-08-20T01:28:34.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:34 smithi134 ceph-mon[22511]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:34.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:34 smithi077 ceph-mon[22251]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:34.825 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:28:34.849 INFO:journalctl@ceph.mds.d.smithi022.stdout:Aug 20 01:28:34 smithi022 podman[60098]: 2024-08-20 01:28:34.586997738 +0000 UTC m=+0.377933459 container start e42dcee1c9e6a6e9c3053b33b605506602f2570002d8af7760689f74d4e884da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True) 2024-08-20T01:28:34.849 INFO:journalctl@ceph.mds.d.smithi022.stdout:Aug 20 01:28:34 smithi022 ceph-mds[60118]: -- 172.21.15.22:0/16112664 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fbee4eb860 con 0x55fbee4c9000 2024-08-20T01:28:34.849 INFO:journalctl@ceph.mds.d.smithi022.stdout:Aug 20 01:28:34 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-d[60114]: starting mds.d at 2024-08-20T01:28:34.849 INFO:journalctl@ceph.mds.d.smithi022.stdout:Aug 20 01:28:34 smithi022 bash[60098]: e42dcee1c9e6a6e9c3053b33b605506602f2570002d8af7760689f74d4e884da 2024-08-20T01:28:34.850 INFO:journalctl@ceph.mds.d.smithi022.stdout:Aug 20 01:28:34 smithi022 systemd[1]: Started Ceph mds.d for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:28:35.085 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:35.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.571+0000 7f31de23c640 1 -- 172.21.15.22:0/206557822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31d81084e0 msgr2=0x7f31d8108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:35.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.571+0000 7f31de23c640 1 --2- 172.21.15.22:0/206557822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31d81084e0 0x7f31d8108920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009900 tx=0x7f31cc02a410 comp rx=0 tx=0).stop 2024-08-20T01:28:35.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.571+0000 7f31de23c640 1 -- 172.21.15.22:0/206557822 shutdown_connections 2024-08-20T01:28:35.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.571+0000 7f31de23c640 1 --2- 172.21.15.22:0/206557822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31d8108e60 0x7f31d810f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:35.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.571+0000 7f31de23c640 1 --2- 172.21.15.22:0/206557822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31d81084e0 0x7f31d8108920 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:35.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.571+0000 7f31de23c640 1 --2- 172.21.15.22:0/206557822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31d8102ad0 0x7f31d8102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:35.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.571+0000 7f31de23c640 1 -- 172.21.15.22:0/206557822 >> 172.21.15.22:0/206557822 conn(0x7f31d80fe540 msgr2=0x7f31d8100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:35.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.571+0000 7f31de23c640 1 -- 172.21.15.22:0/206557822 shutdown_connections 2024-08-20T01:28:35.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.571+0000 7f31de23c640 1 -- 172.21.15.22:0/206557822 wait complete. 2024-08-20T01:28:35.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.571+0000 7f31de23c640 1 Processor -- start 2024-08-20T01:28:35.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.572+0000 7f31de23c640 1 -- start start 2024-08-20T01:28:35.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.572+0000 7f31de23c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31d8102ad0 0x7f31d810e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:35.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.572+0000 7f31de23c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31d81084e0 0x7f31d810ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:35.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.572+0000 7f31de23c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31d8108e60 0x7f31d81a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:35.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.572+0000 7f31de23c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f31d8112b30 con 0x7f31d8108e60 2024-08-20T01:28:35.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.572+0000 7f31de23c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f31d81129b0 con 0x7f31d81084e0 2024-08-20T01:28:35.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.572+0000 7f31de23c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f31d8112cb0 con 0x7f31d8102ad0 2024-08-20T01:28:35.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.572+0000 7f31d7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31d8108e60 0x7f31d81a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:35.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.572+0000 7f31d7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31d8108e60 0x7f31d81a1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49006/0 (socket says 172.21.15.22:49006) 2024-08-20T01:28:35.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.572+0000 7f31d7fff640 1 -- 172.21.15.22:0/3012366139 learned_addr learned my addr 172.21.15.22:0/3012366139 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:28:35.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.572+0000 7f31d77fe640 1 --2- 172.21.15.22:0/3012366139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31d8102ad0 0x7f31d810e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:35.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.572+0000 7f31d6ffd640 1 --2- 172.21.15.22:0/3012366139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31d81084e0 0x7f31d810ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:35.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.572+0000 7f31d7fff640 1 -- 172.21.15.22:0/3012366139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31d8102ad0 msgr2=0x7f31d810e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:35.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.572+0000 7f31d7fff640 1 --2- 172.21.15.22:0/3012366139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31d8102ad0 0x7f31d810e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:35.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.572+0000 7f31d7fff640 1 -- 172.21.15.22:0/3012366139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31d81084e0 msgr2=0x7f31d810ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:35.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.572+0000 7f31d7fff640 1 --2- 172.21.15.22:0/3012366139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31d81084e0 0x7f31d810ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:35.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.572+0000 7f31d7fff640 1 -- 172.21.15.22:0/3012366139 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d81a2420 con 0x7f31d8108e60 2024-08-20T01:28:35.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.572+0000 7f31d7fff640 1 --2- 172.21.15.22:0/3012366139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31d8108e60 0x7f31d81a1ca0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f31d000c970 tx=0x7f31d000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:35.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.573+0000 7f31d4ff9640 1 -- 172.21.15.22:0/3012366139 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0007bb0 con 0x7f31d8108e60 2024-08-20T01:28:35.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.573+0000 7f31de23c640 1 -- 172.21.15.22:0/3012366139 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d81a2710 con 0x7f31d8108e60 2024-08-20T01:28:35.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.573+0000 7f31d4ff9640 1 -- 172.21.15.22:0/3012366139 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31d0007d50 con 0x7f31d8108e60 2024-08-20T01:28:35.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.573+0000 7f31d4ff9640 1 -- 172.21.15.22:0/3012366139 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0004e60 con 0x7f31d8108e60 2024-08-20T01:28:35.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.573+0000 7f31de23c640 1 -- 172.21.15.22:0/3012366139 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d81ac060 con 0x7f31d8108e60 2024-08-20T01:28:35.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.574+0000 7f31de23c640 1 -- 172.21.15.22:0/3012366139 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d8102eb0 con 0x7f31d8108e60 2024-08-20T01:28:35.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.575+0000 7f31d4ff9640 1 -- 172.21.15.22:0/3012366139 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f31d0005000 con 0x7f31d8108e60 2024-08-20T01:28:35.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.576+0000 7f31d4ff9640 1 --2- 172.21.15.22:0/3012366139 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f31c00b3bd0 0x7f31c00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:35.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.576+0000 7f31d77fe640 1 --2- 172.21.15.22:0/3012366139 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f31c00b3bd0 0x7f31c00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:35.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.576+0000 7f31d4ff9640 1 -- 172.21.15.22:0/3012366139 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f31d00e36e0 con 0x7f31d8108e60 2024-08-20T01:28:35.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.577+0000 7f31d77fe640 1 --2- 172.21.15.22:0/3012366139 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f31c00b3bd0 0x7f31c00b6090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f31c8005fd0 tx=0x7f31c8009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:35.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.579+0000 7f31d4ff9640 1 -- 172.21.15.22:0/3012366139 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f31d0014030 con 0x7f31d8108e60 2024-08-20T01:28:35.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.802+0000 7f31de23c640 1 -- 172.21.15.22:0/3012366139 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31d802e340 con 0x7f31d8108e60 2024-08-20T01:28:35.803 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:35 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:35.803 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:35 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:35.803 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:35 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:35.803 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:35 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:35.803 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:35 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:35.803 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:35 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:35.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:35 smithi022 ceph-mon[18709]: Deploying daemon mds.e on smithi077 2024-08-20T01:28:35.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:35 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.22:6836/2398926267,v1:172.21.15.22:6837/2398926267] up:boot 2024-08-20T01:28:35.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:35 smithi022 ceph-mon[18709]: fsmap 4 up:standby 2024-08-20T01:28:35.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:35 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-20T01:28:35.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.802+0000 7f31d4ff9640 1 -- 172.21.15.22:0/3012366139 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f31d00aab80 con 0x7f31d8108e60 2024-08-20T01:28:35.804 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:28:35.804 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":5,"btime":"2024-08-20T01:28:35:341551+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-20T01:28:35.805 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 5 2024-08-20T01:28:35.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.805+0000 7f31de23c640 1 -- 172.21.15.22:0/3012366139 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f31c00b3bd0 msgr2=0x7f31c00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:35.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.805+0000 7f31de23c640 1 --2- 172.21.15.22:0/3012366139 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f31c00b3bd0 0x7f31c00b6090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f31c8005fd0 tx=0x7f31c8009680 comp rx=0 tx=0).stop 2024-08-20T01:28:35.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.805+0000 7f31de23c640 1 -- 172.21.15.22:0/3012366139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31d8108e60 msgr2=0x7f31d81a1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:35.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.805+0000 7f31de23c640 1 --2- 172.21.15.22:0/3012366139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31d8108e60 0x7f31d81a1ca0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f31d000c970 tx=0x7f31d000ce30 comp rx=0 tx=0).stop 2024-08-20T01:28:35.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.805+0000 7f31de23c640 1 -- 172.21.15.22:0/3012366139 shutdown_connections 2024-08-20T01:28:35.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.805+0000 7f31de23c640 1 --2- 172.21.15.22:0/3012366139 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f31c00b3bd0 0x7f31c00b6090 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:35.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.805+0000 7f31de23c640 1 --2- 172.21.15.22:0/3012366139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31d8108e60 0x7f31d81a1ca0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:35.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.805+0000 7f31de23c640 1 --2- 172.21.15.22:0/3012366139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31d81084e0 0x7f31d810ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:35.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.805+0000 7f31de23c640 1 --2- 172.21.15.22:0/3012366139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31d8102ad0 0x7f31d810e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:35.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.805+0000 7f31de23c640 1 -- 172.21.15.22:0/3012366139 >> 172.21.15.22:0/3012366139 conn(0x7f31d80fe540 msgr2=0x7f31d8105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:35.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.805+0000 7f31de23c640 1 -- 172.21.15.22:0/3012366139 shutdown_connections 2024-08-20T01:28:35.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:35.805+0000 7f31de23c640 1 -- 172.21.15.22:0/3012366139 wait complete. 2024-08-20T01:28:36.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:35 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:36.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:35 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:36.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:35 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:36.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:35 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:36.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:35 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:36.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:35 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:36.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:35 smithi134 ceph-mon[22511]: Deploying daemon mds.e on smithi077 2024-08-20T01:28:36.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:35 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.22:6836/2398926267,v1:172.21.15.22:6837/2398926267] up:boot 2024-08-20T01:28:36.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:35 smithi134 ceph-mon[22511]: fsmap 4 up:standby 2024-08-20T01:28:36.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:35 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-20T01:28:36.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:35 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:36.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:35 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:36.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:35 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:36.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:35 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:36.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:35 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:36.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:35 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:36.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:35 smithi077 ceph-mon[22251]: Deploying daemon mds.e on smithi077 2024-08-20T01:28:36.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:35 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.22:6836/2398926267,v1:172.21.15.22:6837/2398926267] up:boot 2024-08-20T01:28:36.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:35 smithi077 ceph-mon[22251]: fsmap 4 up:standby 2024-08-20T01:28:36.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:35 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-20T01:28:36.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:36 smithi077 ceph-mon[22251]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:36.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:36 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3012366139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:36.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:36 smithi022 ceph-mon[18709]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:36.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:36 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3012366139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:37.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:36 smithi134 ceph-mon[22511]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:37.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:36 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3012366139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:37.563 INFO:journalctl@ceph.mds.e.smithi077.stdout:Aug 20 01:28:37 smithi077 systemd[1]: Started Ceph mds.e for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:28:38.580 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:28:38.609 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:38 smithi022 ceph-mon[18709]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:38.609 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:38 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:38.609 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:38 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:38.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:38 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:38.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:38 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:38.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:38 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:38.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:38 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:38.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:38 smithi022 ceph-mon[18709]: Deploying daemon mds.f on smithi134 2024-08-20T01:28:38.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:38 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.77:6834/1109505305,v1:172.21.15.77:6835/1109505305] up:boot 2024-08-20T01:28:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:38 smithi022 ceph-mon[18709]: fsmap 5 up:standby 2024-08-20T01:28:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:38 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-20T01:28:38.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:38 smithi134 ceph-mon[22511]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:38.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:38 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:38.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:38 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:38.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:38 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:38.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:38 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:38.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:38 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:38.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:38 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:38.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:38 smithi134 ceph-mon[22511]: Deploying daemon mds.f on smithi134 2024-08-20T01:28:38.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:38 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.77:6834/1109505305,v1:172.21.15.77:6835/1109505305] up:boot 2024-08-20T01:28:38.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:38 smithi134 ceph-mon[22511]: fsmap 5 up:standby 2024-08-20T01:28:38.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:38 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-20T01:28:38.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:38 smithi077 ceph-mon[22251]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:38.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:38 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:38.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:38 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:38.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:38 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:38.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:38 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:38.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:38 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:38.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:38 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:38.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:38 smithi077 ceph-mon[22251]: Deploying daemon mds.f on smithi134 2024-08-20T01:28:38.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:38 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.77:6834/1109505305,v1:172.21.15.77:6835/1109505305] up:boot 2024-08-20T01:28:38.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:38 smithi077 ceph-mon[22251]: fsmap 5 up:standby 2024-08-20T01:28:38.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:38 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-20T01:28:38.852 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:39.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.355+0000 7fc9272ad640 1 -- 172.21.15.22:0/64800220 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9201039e0 msgr2=0x7fc920103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:39.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.355+0000 7fc9272ad640 1 --2- 172.21.15.22:0/64800220 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9201039e0 0x7fc920103dc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009900 tx=0x7fc91c02a410 comp rx=0 tx=0).stop 2024-08-20T01:28:39.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.355+0000 7fc9272ad640 1 -- 172.21.15.22:0/64800220 shutdown_connections 2024-08-20T01:28:39.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.355+0000 7fc9272ad640 1 --2- 172.21.15.22:0/64800220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc92010ce40 0x7fc92010f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:39.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.355+0000 7fc9272ad640 1 --2- 172.21.15.22:0/64800220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc920104300 0x7fc92010c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:39.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.355+0000 7fc9272ad640 1 --2- 172.21.15.22:0/64800220 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9201039e0 0x7fc920103dc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:39.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.355+0000 7fc9272ad640 1 -- 172.21.15.22:0/64800220 >> 172.21.15.22:0/64800220 conn(0x7fc9200fd440 msgr2=0x7fc9200ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:39.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.355+0000 7fc9272ad640 1 -- 172.21.15.22:0/64800220 shutdown_connections 2024-08-20T01:28:39.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.355+0000 7fc9272ad640 1 -- 172.21.15.22:0/64800220 wait complete. 2024-08-20T01:28:39.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.356+0000 7fc9272ad640 1 Processor -- start 2024-08-20T01:28:39.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.356+0000 7fc9272ad640 1 -- start start 2024-08-20T01:28:39.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.356+0000 7fc9272ad640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9201039e0 0x7fc920101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:39.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.356+0000 7fc9272ad640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc920104300 0x7fc920101bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:39.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.356+0000 7fc9272ad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc92010ce40 0x7fc920102110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:39.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.356+0000 7fc9272ad640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc920112b10 con 0x7fc920104300 2024-08-20T01:28:39.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.356+0000 7fc9272ad640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc920112990 con 0x7fc92010ce40 2024-08-20T01:28:39.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.356+0000 7fc9272ad640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc920112c90 con 0x7fc9201039e0 2024-08-20T01:28:39.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.356+0000 7fc924848640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc920104300 0x7fc920101bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:39.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.356+0000 7fc925049640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9201039e0 0x7fc920101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:39.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.356+0000 7fc924848640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc920104300 0x7fc920101bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49034/0 (socket says 172.21.15.22:49034) 2024-08-20T01:28:39.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.356+0000 7fc924848640 1 -- 172.21.15.22:0/1858493398 learned_addr learned my addr 172.21.15.22:0/1858493398 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:28:39.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.357+0000 7fc92584a640 1 --2- 172.21.15.22:0/1858493398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc92010ce40 0x7fc920102110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:39.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.357+0000 7fc924848640 1 -- 172.21.15.22:0/1858493398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9201039e0 msgr2=0x7fc920101690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:39.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.357+0000 7fc924848640 1 --2- 172.21.15.22:0/1858493398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9201039e0 0x7fc920101690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:39.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.357+0000 7fc924848640 1 -- 172.21.15.22:0/1858493398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc92010ce40 msgr2=0x7fc920102110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:39.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.357+0000 7fc924848640 1 --2- 172.21.15.22:0/1858493398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc92010ce40 0x7fc920102110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:39.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.357+0000 7fc924848640 1 -- 172.21.15.22:0/1858493398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9201a74e0 con 0x7fc920104300 2024-08-20T01:28:39.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.357+0000 7fc924848640 1 --2- 172.21.15.22:0/1858493398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc920104300 0x7fc920101bd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc91000b3c0 tx=0x7fc91000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:39.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.357+0000 7fc9167fc640 1 -- 172.21.15.22:0/1858493398 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910011830 con 0x7fc920104300 2024-08-20T01:28:39.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.357+0000 7fc9272ad640 1 -- 172.21.15.22:0/1858493398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9201a77d0 con 0x7fc920104300 2024-08-20T01:28:39.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.357+0000 7fc9167fc640 1 -- 172.21.15.22:0/1858493398 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc910016070 con 0x7fc920104300 2024-08-20T01:28:39.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.357+0000 7fc9167fc640 1 -- 172.21.15.22:0/1858493398 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910010de0 con 0x7fc920104300 2024-08-20T01:28:39.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.357+0000 7fc9272ad640 1 -- 172.21.15.22:0/1858493398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9201a7d10 con 0x7fc920104300 2024-08-20T01:28:39.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.358+0000 7fc9272ad640 1 -- 172.21.15.22:0/1858493398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc920103dc0 con 0x7fc920104300 2024-08-20T01:28:39.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.360+0000 7fc9167fc640 1 -- 172.21.15.22:0/1858493398 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fc9100119d0 con 0x7fc920104300 2024-08-20T01:28:39.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.360+0000 7fc9167fc640 1 --2- 172.21.15.22:0/1858493398 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc90c0b3bd0 0x7fc90c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:39.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.361+0000 7fc925049640 1 --2- 172.21.15.22:0/1858493398 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc90c0b3bd0 0x7fc90c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:39.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.361+0000 7fc9167fc640 1 -- 172.21.15.22:0/1858493398 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fc9100e2cc0 con 0x7fc920104300 2024-08-20T01:28:39.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.361+0000 7fc925049640 1 --2- 172.21.15.22:0/1858493398 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc90c0b3bd0 0x7fc90c0b6090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc91c031440 tx=0x7fc91c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:39.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.365+0000 7fc9167fc640 1 -- 172.21.15.22:0/1858493398 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fc9100aa7b0 con 0x7fc920104300 2024-08-20T01:28:39.458 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:28:39 smithi134 systemd[1]: Starting Ceph mds.f for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:28:39.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.586+0000 7fc9272ad640 1 -- 172.21.15.22:0/1858493398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc92002e340 con 0x7fc920104300 2024-08-20T01:28:39.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.586+0000 7fc9167fc640 1 -- 172.21.15.22:0/1858493398 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7fc9100aa0b0 con 0x7fc920104300 2024-08-20T01:28:39.588 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:28:39.588 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":6,"btime":"2024-08-20T01:28:37:742379+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-08-20T01:28:39.588 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 6 2024-08-20T01:28:39.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.589+0000 7fc9272ad640 1 -- 172.21.15.22:0/1858493398 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc90c0b3bd0 msgr2=0x7fc90c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:39.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.589+0000 7fc9272ad640 1 --2- 172.21.15.22:0/1858493398 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc90c0b3bd0 0x7fc90c0b6090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc91c031440 tx=0x7fc91c005b50 comp rx=0 tx=0).stop 2024-08-20T01:28:39.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.589+0000 7fc9272ad640 1 -- 172.21.15.22:0/1858493398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc920104300 msgr2=0x7fc920101bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:39.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.589+0000 7fc9272ad640 1 --2- 172.21.15.22:0/1858493398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc920104300 0x7fc920101bd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc91000b3c0 tx=0x7fc91000b880 comp rx=0 tx=0).stop 2024-08-20T01:28:39.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.589+0000 7fc9272ad640 1 -- 172.21.15.22:0/1858493398 shutdown_connections 2024-08-20T01:28:39.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.589+0000 7fc9272ad640 1 --2- 172.21.15.22:0/1858493398 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc90c0b3bd0 0x7fc90c0b6090 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:39.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.589+0000 7fc9272ad640 1 --2- 172.21.15.22:0/1858493398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc92010ce40 0x7fc920102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:39.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.589+0000 7fc9272ad640 1 --2- 172.21.15.22:0/1858493398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc920104300 0x7fc920101bd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:39.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.589+0000 7fc9272ad640 1 --2- 172.21.15.22:0/1858493398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9201039e0 0x7fc920101690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:39.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.589+0000 7fc9272ad640 1 -- 172.21.15.22:0/1858493398 >> 172.21.15.22:0/1858493398 conn(0x7fc9200fd440 msgr2=0x7fc9200fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:39.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.589+0000 7fc9272ad640 1 -- 172.21.15.22:0/1858493398 shutdown_connections 2024-08-20T01:28:39.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:39.589+0000 7fc9272ad640 1 -- 172.21.15.22:0/1858493398 wait complete. 2024-08-20T01:28:39.723 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:28:39 smithi134 podman[52364]: 2024-08-20 01:28:39.360189043 +0000 UTC m=+0.016026611 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:28:39.723 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:28:39 smithi134 podman[52364]: 2024-08-20 01:28:39.470699503 +0000 UTC m=+0.126537059 container create 79057991df98fb8521da6e5f56083cf0376d563d1b8ec5df92fdda8de5193aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-08-20T01:28:39.723 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:28:39 smithi134 podman[52364]: 2024-08-20 01:28:39.723604142 +0000 UTC m=+0.379441698 container init 79057991df98fb8521da6e5f56083cf0376d563d1b8ec5df92fdda8de5193aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-20T01:28:40.015 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:28:39 smithi134 podman[52364]: 2024-08-20 01:28:39.726549282 +0000 UTC m=+0.382386841 container start 79057991df98fb8521da6e5f56083cf0376d563d1b8ec5df92fdda8de5193aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0) 2024-08-20T01:28:40.015 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:28:39 smithi134 ceph-mds[52384]: -- 172.21.15.134:0/3312080072 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560ce08f3860 con 0x560ce08d0800 2024-08-20T01:28:40.015 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:28:39 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f[52380]: starting mds.f at 2024-08-20T01:28:40.015 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:28:39 smithi134 bash[52364]: 79057991df98fb8521da6e5f56083cf0376d563d1b8ec5df92fdda8de5193aaa 2024-08-20T01:28:40.016 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:28:39 smithi134 systemd[1]: Started Ceph mds.f for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:28:40.577 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:40 smithi134 ceph-mon[22511]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:40.577 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:40 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1858493398' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:40.578 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:40.578 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:40.578 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:40.578 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:40.578 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:40.578 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:40.578 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:40 smithi134 ceph-mon[22511]: Deploying daemon mds.c on smithi134 2024-08-20T01:28:40.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:40 smithi022 ceph-mon[18709]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:40.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:40 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1858493398' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:40.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:40.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:40.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:40.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:40.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:40.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:40.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:40 smithi022 ceph-mon[18709]: Deploying daemon mds.c on smithi134 2024-08-20T01:28:40.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:40 smithi077 ceph-mon[22251]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:40.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:40 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1858493398' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:40.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:40.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:40.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:40.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:40.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:40.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:40.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:40 smithi077 ceph-mon[22251]: Deploying daemon mds.c on smithi134 2024-08-20T01:28:41.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:41 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.134:6834/3018668202,v1:172.21.15.134:6835/3018668202] up:boot 2024-08-20T01:28:41.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:41 smithi077 ceph-mon[22251]: fsmap 6 up:standby 2024-08-20T01:28:41.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:41 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T01:28:41.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:41 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.134:6834/3018668202,v1:172.21.15.134:6835/3018668202] up:boot 2024-08-20T01:28:41.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:41 smithi022 ceph-mon[18709]: fsmap 6 up:standby 2024-08-20T01:28:41.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:41 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T01:28:41.658 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:41 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.134:6834/3018668202,v1:172.21.15.134:6835/3018668202] up:boot 2024-08-20T01:28:41.658 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:41 smithi134 ceph-mon[22511]: fsmap 6 up:standby 2024-08-20T01:28:41.658 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:41 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T01:28:42.341 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:28:42.618 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:42.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:42 smithi022 ceph-mon[18709]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:42.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:42 smithi134 ceph-mon[22511]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:42.765 INFO:journalctl@ceph.mds.c.smithi134.stdout:Aug 20 01:28:42 smithi134 systemd[1]: Started Ceph mds.c for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:28:42.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:42 smithi077 ceph-mon[22251]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:43.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.150+0000 7f8d53d7a640 1 -- 172.21.15.22:0/3970908990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d4c1073a0 msgr2=0x7f8d4c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:43.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.150+0000 7f8d53d7a640 1 --2- 172.21.15.22:0/3970908990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d4c1073a0 0x7f8d4c1077e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009900 tx=0x7f8d4002a410 comp rx=0 tx=0).stop 2024-08-20T01:28:43.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.150+0000 7f8d53d7a640 1 -- 172.21.15.22:0/3970908990 shutdown_connections 2024-08-20T01:28:43.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.150+0000 7f8d53d7a640 1 --2- 172.21.15.22:0/3970908990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d4c107d20 0x7f8d4c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:43.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.150+0000 7f8d53d7a640 1 --2- 172.21.15.22:0/3970908990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d4c1073a0 0x7f8d4c1077e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:43.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.150+0000 7f8d53d7a640 1 --2- 172.21.15.22:0/3970908990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d4c101990 0x7f8d4c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:43.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.150+0000 7f8d53d7a640 1 -- 172.21.15.22:0/3970908990 >> 172.21.15.22:0/3970908990 conn(0x7f8d4c0fd400 msgr2=0x7f8d4c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:43.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.150+0000 7f8d53d7a640 1 -- 172.21.15.22:0/3970908990 shutdown_connections 2024-08-20T01:28:43.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.150+0000 7f8d53d7a640 1 -- 172.21.15.22:0/3970908990 wait complete. 2024-08-20T01:28:43.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.151+0000 7f8d53d7a640 1 Processor -- start 2024-08-20T01:28:43.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.151+0000 7f8d53d7a640 1 -- start start 2024-08-20T01:28:43.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.151+0000 7f8d53d7a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d4c101990 0x7f8d4c198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:43.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.151+0000 7f8d53d7a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d4c1073a0 0x7f8d4c199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:43.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.151+0000 7f8d53d7a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d4c107d20 0x7f8d4c19e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:43.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.151+0000 7f8d53d7a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4c111a30 con 0x7f8d4c101990 2024-08-20T01:28:43.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.151+0000 7f8d53d7a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4c1118b0 con 0x7f8d4c107d20 2024-08-20T01:28:43.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.151+0000 7f8d53d7a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4c111bb0 con 0x7f8d4c1073a0 2024-08-20T01:28:43.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.151+0000 7f8d51b16640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d4c101990 0x7f8d4c198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:43.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.151+0000 7f8d51b16640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d4c101990 0x7f8d4c198fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60530/0 (socket says 172.21.15.22:60530) 2024-08-20T01:28:43.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.151+0000 7f8d51b16640 1 -- 172.21.15.22:0/3664506517 learned_addr learned my addr 172.21.15.22:0/3664506517 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:28:43.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.151+0000 7f8d51315640 1 --2- 172.21.15.22:0/3664506517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d4c1073a0 0x7f8d4c199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.151+0000 7f8d52317640 1 --2- 172.21.15.22:0/3664506517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d4c107d20 0x7f8d4c19e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.152+0000 7f8d51b16640 1 -- 172.21.15.22:0/3664506517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d4c1073a0 msgr2=0x7f8d4c199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.152+0000 7f8d51b16640 1 --2- 172.21.15.22:0/3664506517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d4c1073a0 0x7f8d4c199510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.152+0000 7f8d51b16640 1 -- 172.21.15.22:0/3664506517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d4c107d20 msgr2=0x7f8d4c19e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.152+0000 7f8d51b16640 1 --2- 172.21.15.22:0/3664506517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d4c107d20 0x7f8d4c19e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.152+0000 7f8d51b16640 1 -- 172.21.15.22:0/3664506517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4c19f080 con 0x7f8d4c101990 2024-08-20T01:28:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.152+0000 7f8d52317640 1 --2- 172.21.15.22:0/3664506517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d4c107d20 0x7f8d4c19e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:28:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.152+0000 7f8d51b16640 1 --2- 172.21.15.22:0/3664506517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d4c101990 0x7f8d4c198fd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800e9f0 tx=0x7f8d4800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.152+0000 7f8d3effd640 1 -- 172.21.15.22:0/3664506517 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4800cd80 con 0x7f8d4c101990 2024-08-20T01:28:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.152+0000 7f8d53d7a640 1 -- 172.21.15.22:0/3664506517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d4c19f370 con 0x7f8d4c101990 2024-08-20T01:28:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.152+0000 7f8d3effd640 1 -- 172.21.15.22:0/3664506517 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d480054d0 con 0x7f8d4c101990 2024-08-20T01:28:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.152+0000 7f8d3effd640 1 -- 172.21.15.22:0/3664506517 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d48010690 con 0x7f8d4c101990 2024-08-20T01:28:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.152+0000 7f8d53d7a640 1 -- 172.21.15.22:0/3664506517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d4c1a5a30 con 0x7f8d4c101990 2024-08-20T01:28:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.153+0000 7f8d53d7a640 1 -- 172.21.15.22:0/3664506517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d4c102c40 con 0x7f8d4c101990 2024-08-20T01:28:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.155+0000 7f8d3effd640 1 -- 172.21.15.22:0/3664506517 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f8d48004e50 con 0x7f8d4c101990 2024-08-20T01:28:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.155+0000 7f8d3effd640 1 --2- 172.21.15.22:0/3664506517 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d380b3c50 0x7f8d380b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.155+0000 7f8d51315640 1 --2- 172.21.15.22:0/3664506517 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d380b3c50 0x7f8d380b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.156+0000 7f8d3effd640 1 -- 172.21.15.22:0/3664506517 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f8d480e3d60 con 0x7f8d4c101990 2024-08-20T01:28:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.156+0000 7f8d51315640 1 --2- 172.21.15.22:0/3664506517 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d380b3c50 0x7f8d380b6110 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8d40005ab0 tx=0x7f8d40005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.162+0000 7f8d3effd640 1 -- 172.21.15.22:0/3664506517 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f8d48055e20 con 0x7f8d4c101990 2024-08-20T01:28:43.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.386+0000 7f8d53d7a640 1 -- 172.21.15.22:0/3664506517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d4c10ab70 con 0x7f8d4c101990 2024-08-20T01:28:43.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.387+0000 7f8d3effd640 1 -- 172.21.15.22:0/3664506517 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6394 (secure 0 0 0) 0x7f8d480ab850 con 0x7f8d4c101990 2024-08-20T01:28:43.388 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:28:43.388 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"btime":"2024-08-20T01:28:43:330063+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24559,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24565,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-08-20T01:28:43.388 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2024-08-20T01:28:43.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.389+0000 7f8d53d7a640 1 -- 172.21.15.22:0/3664506517 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d380b3c50 msgr2=0x7f8d380b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:43.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.389+0000 7f8d53d7a640 1 --2- 172.21.15.22:0/3664506517 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d380b3c50 0x7f8d380b6110 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8d40005ab0 tx=0x7f8d40005a20 comp rx=0 tx=0).stop 2024-08-20T01:28:43.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.389+0000 7f8d53d7a640 1 -- 172.21.15.22:0/3664506517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d4c101990 msgr2=0x7f8d4c198fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:43.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.389+0000 7f8d53d7a640 1 --2- 172.21.15.22:0/3664506517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d4c101990 0x7f8d4c198fd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800e9f0 tx=0x7f8d4800edf0 comp rx=0 tx=0).stop 2024-08-20T01:28:43.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.389+0000 7f8d53d7a640 1 -- 172.21.15.22:0/3664506517 shutdown_connections 2024-08-20T01:28:43.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.389+0000 7f8d53d7a640 1 --2- 172.21.15.22:0/3664506517 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d380b3c50 0x7f8d380b6110 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:43.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.389+0000 7f8d53d7a640 1 --2- 172.21.15.22:0/3664506517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d4c107d20 0x7f8d4c19e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:43.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.389+0000 7f8d53d7a640 1 --2- 172.21.15.22:0/3664506517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d4c1073a0 0x7f8d4c199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:43.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.389+0000 7f8d53d7a640 1 --2- 172.21.15.22:0/3664506517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d4c101990 0x7f8d4c198fd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:43.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.389+0000 7f8d53d7a640 1 -- 172.21.15.22:0/3664506517 >> 172.21.15.22:0/3664506517 conn(0x7f8d4c0fd400 msgr2=0x7f8d4c06aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:43.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.389+0000 7f8d53d7a640 1 -- 172.21.15.22:0/3664506517 shutdown_connections 2024-08-20T01:28:43.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:43.389+0000 7f8d53d7a640 1 -- 172.21.15.22:0/3664506517 wait complete. 2024-08-20T01:28:43.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:43 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:43.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:43 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:43.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:43 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:43.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:43 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:43.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:43 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:43.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:43 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:43.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:43 smithi022 ceph-mon[18709]: Deploying daemon mds.h on smithi077 2024-08-20T01:28:43.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:43 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] up:boot 2024-08-20T01:28:43.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:43 smithi022 ceph-mon[18709]: fsmap 7 up:standby 2024-08-20T01:28:43.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:43 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-20T01:28:43.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:43 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3664506517' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:43.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:43 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:43.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:43 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:43.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:43 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:43.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:43 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:43.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:43 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:43.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:43 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:43.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:43 smithi077 ceph-mon[22251]: Deploying daemon mds.h on smithi077 2024-08-20T01:28:43.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:43 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] up:boot 2024-08-20T01:28:43.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:43 smithi077 ceph-mon[22251]: fsmap 7 up:standby 2024-08-20T01:28:43.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:43 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-20T01:28:43.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:43 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3664506517' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:44.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:43 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:44.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:43 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:44.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:43 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:44.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:43 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:44.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:43 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:44.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:43 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:44.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:43 smithi134 ceph-mon[22511]: Deploying daemon mds.h on smithi077 2024-08-20T01:28:44.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:43 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] up:boot 2024-08-20T01:28:44.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:43 smithi134 ceph-mon[22511]: fsmap 7 up:standby 2024-08-20T01:28:44.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:43 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-20T01:28:44.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:43 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3664506517' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:44.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:44 smithi022 ceph-mon[18709]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:44.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:44 smithi077 ceph-mon[22251]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:44.791 INFO:journalctl@ceph.mds.h.smithi077.stdout:Aug 20 01:28:44 smithi077 systemd[1]: Starting Ceph mds.h for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:28:45.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:44 smithi134 ceph-mon[22511]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:45.063 INFO:journalctl@ceph.mds.h.smithi077.stdout:Aug 20 01:28:44 smithi077 podman[51555]: 2024-08-20 01:28:44.692941111 +0000 UTC m=+0.015777354 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:28:45.064 INFO:journalctl@ceph.mds.h.smithi077.stdout:Aug 20 01:28:44 smithi077 podman[51555]: 2024-08-20 01:28:44.834373365 +0000 UTC m=+0.157209599 container create 9220438b8c1e9d97f2b79151ba09655dd911a984e96d370b0a11c96ec3f929eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-h, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:28:45.564 INFO:journalctl@ceph.mds.h.smithi077.stdout:Aug 20 01:28:45 smithi077 podman[51555]: 2024-08-20 01:28:45.085297227 +0000 UTC m=+0.408133473 container init 9220438b8c1e9d97f2b79151ba09655dd911a984e96d370b0a11c96ec3f929eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-h, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:28:45.564 INFO:journalctl@ceph.mds.h.smithi077.stdout:Aug 20 01:28:45 smithi077 podman[51555]: 2024-08-20 01:28:45.088244872 +0000 UTC m=+0.411081106 container start 9220438b8c1e9d97f2b79151ba09655dd911a984e96d370b0a11c96ec3f929eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-h, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:28:45.564 INFO:journalctl@ceph.mds.h.smithi077.stdout:Aug 20 01:28:45 smithi077 ceph-mds[51574]: -- 172.21.15.77:0/2878793019 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560fdee7f860 con 0x560fdee5c800 2024-08-20T01:28:45.564 INFO:journalctl@ceph.mds.h.smithi077.stdout:Aug 20 01:28:45 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-h[51570]: starting mds.h at 2024-08-20T01:28:45.564 INFO:journalctl@ceph.mds.h.smithi077.stdout:Aug 20 01:28:45 smithi077 bash[51555]: 9220438b8c1e9d97f2b79151ba09655dd911a984e96d370b0a11c96ec3f929eb 2024-08-20T01:28:45.564 INFO:journalctl@ceph.mds.h.smithi077.stdout:Aug 20 01:28:45 smithi077 systemd[1]: Started Ceph mds.h for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:28:46.068 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:28:46.345 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:46.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:46 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:46.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:46 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:46.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:46 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:46.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:46 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:46.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:46 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:46.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:46 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:46.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:46 smithi022 ceph-mon[18709]: Deploying daemon mds.i on smithi134 2024-08-20T01:28:46.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:46 smithi022 ceph-mon[18709]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:46.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:46 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.77:6836/259148624,v1:172.21.15.77:6837/259148624] up:boot 2024-08-20T01:28:46.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:46 smithi022 ceph-mon[18709]: fsmap 8 up:standby 2024-08-20T01:28:46.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:46 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-20T01:28:46.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:46 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:46.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:46 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:46.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:46 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:46.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:46 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:46.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:46 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:46.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:46 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:46.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:46 smithi134 ceph-mon[22511]: Deploying daemon mds.i on smithi134 2024-08-20T01:28:46.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:46 smithi134 ceph-mon[22511]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:46.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:46 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.77:6836/259148624,v1:172.21.15.77:6837/259148624] up:boot 2024-08-20T01:28:46.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:46 smithi134 ceph-mon[22511]: fsmap 8 up:standby 2024-08-20T01:28:46.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:46 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-20T01:28:46.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:46 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:46.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:46 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:46.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:46 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:46.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:46 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:46.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:46 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:46.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:46 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:46.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:46 smithi077 ceph-mon[22251]: Deploying daemon mds.i on smithi134 2024-08-20T01:28:46.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:46 smithi077 ceph-mon[22251]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:46.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:46 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.77:6836/259148624,v1:172.21.15.77:6837/259148624] up:boot 2024-08-20T01:28:46.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:46 smithi077 ceph-mon[22251]: fsmap 8 up:standby 2024-08-20T01:28:46.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:46 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-20T01:28:46.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.826+0000 7f6956fea640 1 -- 172.21.15.22:0/1970320085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6950101990 msgr2=0x7f6950101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:46.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.826+0000 7f6956fea640 1 --2- 172.21.15.22:0/1970320085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6950101990 0x7f6950101d70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6940009900 tx=0x7f694002a410 comp rx=0 tx=0).stop 2024-08-20T01:28:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.826+0000 7f6956fea640 1 -- 172.21.15.22:0/1970320085 shutdown_connections 2024-08-20T01:28:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.826+0000 7f6956fea640 1 --2- 172.21.15.22:0/1970320085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6950107d20 0x7f695010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.826+0000 7f6956fea640 1 --2- 172.21.15.22:0/1970320085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69501073a0 0x7f69501077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.826+0000 7f6956fea640 1 --2- 172.21.15.22:0/1970320085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6950101990 0x7f6950101d70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.826+0000 7f6956fea640 1 -- 172.21.15.22:0/1970320085 >> 172.21.15.22:0/1970320085 conn(0x7f69500fd400 msgr2=0x7f69500ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.826+0000 7f6956fea640 1 -- 172.21.15.22:0/1970320085 shutdown_connections 2024-08-20T01:28:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.826+0000 7f6956fea640 1 -- 172.21.15.22:0/1970320085 wait complete. 2024-08-20T01:28:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.827+0000 7f6956fea640 1 Processor -- start 2024-08-20T01:28:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.827+0000 7f6956fea640 1 -- start start 2024-08-20T01:28:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.827+0000 7f6956fea640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6950101990 0x7f69500fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.827+0000 7f6956fea640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69501073a0 0x7f69500fde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.827+0000 7f6956fea640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6950107d20 0x7f69500fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.827+0000 7f6956fea640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f69501119e0 con 0x7f6950107d20 2024-08-20T01:28:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.827+0000 7f6956fea640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6950111860 con 0x7f69501073a0 2024-08-20T01:28:46.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.827+0000 7f6956fea640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6950111b60 con 0x7f6950101990 2024-08-20T01:28:46.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.827+0000 7f6955587640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6950107d20 0x7f69500fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:46.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.827+0000 7f6954d86640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6950101990 0x7f69500fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:46.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.827+0000 7f6955587640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6950107d20 0x7f69500fe380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60546/0 (socket says 172.21.15.22:60546) 2024-08-20T01:28:46.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.827+0000 7f6955587640 1 -- 172.21.15.22:0/2405478730 learned_addr learned my addr 172.21.15.22:0/2405478730 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:28:46.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.827+0000 7f694ffff640 1 --2- 172.21.15.22:0/2405478730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69501073a0 0x7f69500fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:46.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.827+0000 7f6955587640 1 -- 172.21.15.22:0/2405478730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6950101990 msgr2=0x7f69500fd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:46.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.827+0000 7f6955587640 1 --2- 172.21.15.22:0/2405478730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6950101990 0x7f69500fd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:46.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.828+0000 7f6955587640 1 -- 172.21.15.22:0/2405478730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69501073a0 msgr2=0x7f69500fde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:46.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.828+0000 7f6955587640 1 --2- 172.21.15.22:0/2405478730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69501073a0 0x7f69500fde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:46.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.828+0000 7f6955587640 1 -- 172.21.15.22:0/2405478730 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69501a7490 con 0x7f6950107d20 2024-08-20T01:28:46.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.828+0000 7f6955587640 1 --2- 172.21.15.22:0/2405478730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6950107d20 0x7f69500fe380 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f694800eaa0 tx=0x7f694800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:46.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.828+0000 7f694dffb640 1 -- 172.21.15.22:0/2405478730 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948004d20 con 0x7f6950107d20 2024-08-20T01:28:46.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.828+0000 7f694dffb640 1 -- 172.21.15.22:0/2405478730 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6948005020 con 0x7f6950107d20 2024-08-20T01:28:46.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.828+0000 7f6956fea640 1 -- 172.21.15.22:0/2405478730 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69501a7780 con 0x7f6950107d20 2024-08-20T01:28:46.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.828+0000 7f694dffb640 1 -- 172.21.15.22:0/2405478730 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69480116b0 con 0x7f6950107d20 2024-08-20T01:28:46.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.828+0000 7f6956fea640 1 -- 172.21.15.22:0/2405478730 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69501a7d10 con 0x7f6950107d20 2024-08-20T01:28:46.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.829+0000 7f6956fea640 1 -- 172.21.15.22:0/2405478730 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6950101d70 con 0x7f6950107d20 2024-08-20T01:28:46.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.830+0000 7f694dffb640 1 -- 172.21.15.22:0/2405478730 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f69480051d0 con 0x7f6950107d20 2024-08-20T01:28:46.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.831+0000 7f694dffb640 1 --2- 172.21.15.22:0/2405478730 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f69380b3c50 0x7f69380b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:46.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.831+0000 7f6954d86640 1 --2- 172.21.15.22:0/2405478730 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f69380b3c50 0x7f69380b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:46.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.831+0000 7f694dffb640 1 -- 172.21.15.22:0/2405478730 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f69480e3be0 con 0x7f6950107d20 2024-08-20T01:28:46.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.832+0000 7f6954d86640 1 --2- 172.21.15.22:0/2405478730 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f69380b3c50 0x7f69380b6110 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6940031440 tx=0x7f6940005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:46.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:46.834+0000 7f694dffb640 1 -- 172.21.15.22:0/2405478730 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f6948016030 con 0x7f6950107d20 2024-08-20T01:28:47.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:47.054+0000 7f6956fea640 1 -- 172.21.15.22:0/2405478730 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69500fec00 con 0x7f6950107d20 2024-08-20T01:28:47.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:47.054+0000 7f694dffb640 1 -- 172.21.15.22:0/2405478730 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7216 (secure 0 0 0) 0x7f69500fec00 con 0x7f6950107d20 2024-08-20T01:28:47.055 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:28:47.055 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":9,"btime":"2024-08-20T01:28:45:539221+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24559,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24565,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-08-20T01:28:47.056 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 9 2024-08-20T01:28:47.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:47.057+0000 7f6956fea640 1 -- 172.21.15.22:0/2405478730 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f69380b3c50 msgr2=0x7f69380b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:47.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:47.057+0000 7f6956fea640 1 --2- 172.21.15.22:0/2405478730 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f69380b3c50 0x7f69380b6110 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6940031440 tx=0x7f6940005b50 comp rx=0 tx=0).stop 2024-08-20T01:28:47.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:47.057+0000 7f6956fea640 1 -- 172.21.15.22:0/2405478730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6950107d20 msgr2=0x7f69500fe380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:47.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:47.057+0000 7f6956fea640 1 --2- 172.21.15.22:0/2405478730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6950107d20 0x7f69500fe380 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f694800eaa0 tx=0x7f694800eea0 comp rx=0 tx=0).stop 2024-08-20T01:28:47.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:47.057+0000 7f6956fea640 1 -- 172.21.15.22:0/2405478730 shutdown_connections 2024-08-20T01:28:47.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:47.057+0000 7f6956fea640 1 --2- 172.21.15.22:0/2405478730 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f69380b3c50 0x7f69380b6110 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:47.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:47.057+0000 7f6956fea640 1 --2- 172.21.15.22:0/2405478730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6950107d20 0x7f69500fe380 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:47.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:47.057+0000 7f6956fea640 1 --2- 172.21.15.22:0/2405478730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69501073a0 0x7f69500fde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:47.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:47.057+0000 7f6956fea640 1 --2- 172.21.15.22:0/2405478730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6950101990 0x7f69500fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:47.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:47.057+0000 7f6956fea640 1 -- 172.21.15.22:0/2405478730 >> 172.21.15.22:0/2405478730 conn(0x7f69500fd400 msgr2=0x7f695006ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:47.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:47.057+0000 7f6956fea640 1 -- 172.21.15.22:0/2405478730 shutdown_connections 2024-08-20T01:28:47.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:47.057+0000 7f6956fea640 1 -- 172.21.15.22:0/2405478730 wait complete. 2024-08-20T01:28:47.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:47 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2405478730' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:47.437 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:47 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2405478730' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:47.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:47 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2405478730' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:48.015 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:28:47 smithi134 systemd[1]: Started Ceph mds.i for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:28:49.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:48 smithi022 ceph-mon[18709]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:49.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:49.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:49.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:49.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:49.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:49.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:49.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:48 smithi022 ceph-mon[18709]: Deploying daemon mds.g on smithi022 2024-08-20T01:28:49.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:48 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] up:boot 2024-08-20T01:28:49.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:48 smithi022 ceph-mon[18709]: fsmap 9 up:standby 2024-08-20T01:28:49.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:48 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-20T01:28:49.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:48 smithi134 ceph-mon[22511]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:49.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:49.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:49.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:49.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:49.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:49.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:49.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:48 smithi134 ceph-mon[22511]: Deploying daemon mds.g on smithi022 2024-08-20T01:28:49.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:48 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] up:boot 2024-08-20T01:28:49.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:48 smithi134 ceph-mon[22511]: fsmap 9 up:standby 2024-08-20T01:28:49.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:48 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-20T01:28:49.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:48 smithi077 ceph-mon[22251]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:49.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:49.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:49.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:49.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:49.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:49.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:49.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:48 smithi077 ceph-mon[22251]: Deploying daemon mds.g on smithi022 2024-08-20T01:28:49.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:48 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] up:boot 2024-08-20T01:28:49.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:48 smithi077 ceph-mon[22251]: fsmap 9 up:standby 2024-08-20T01:28:49.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:48 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-20T01:28:49.723 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:28:50.072 INFO:journalctl@ceph.mds.g.smithi022.stdout:Aug 20 01:28:49 smithi022 systemd[1]: Starting Ceph mds.g for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:28:50.330 INFO:journalctl@ceph.mds.g.smithi022.stdout:Aug 20 01:28:50 smithi022 podman[60884]: 2024-08-20 01:28:49.974628796 +0000 UTC m=+0.016703600 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:28:50.330 INFO:journalctl@ceph.mds.g.smithi022.stdout:Aug 20 01:28:50 smithi022 podman[60884]: 2024-08-20 01:28:50.085728571 +0000 UTC m=+0.127803360 container create b4f278ca1b8646b62d8f493e45e5772006797cdcb8869d85f1cdaac2e854d6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-g, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T01:28:50.330 INFO:journalctl@ceph.mds.g.smithi022.stdout:Aug 20 01:28:50 smithi022 podman[60884]: 2024-08-20 01:28:50.329870039 +0000 UTC m=+0.371944828 container init b4f278ca1b8646b62d8f493e45e5772006797cdcb8869d85f1cdaac2e854d6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-g, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-08-20T01:28:50.485 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:50.611 INFO:journalctl@ceph.mds.g.smithi022.stdout:Aug 20 01:28:50 smithi022 podman[60884]: 2024-08-20 01:28:50.333551442 +0000 UTC m=+0.375626238 container start b4f278ca1b8646b62d8f493e45e5772006797cdcb8869d85f1cdaac2e854d6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-g, io.buildah.version=1.36.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:28:50.611 INFO:journalctl@ceph.mds.g.smithi022.stdout:Aug 20 01:28:50 smithi022 ceph-mds[60928]: -- 172.21.15.22:0/2831786929 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c555f47860 con 0x55c555f25000 2024-08-20T01:28:50.611 INFO:journalctl@ceph.mds.g.smithi022.stdout:Aug 20 01:28:50 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-g[60911]: starting mds.g at 2024-08-20T01:28:50.611 INFO:journalctl@ceph.mds.g.smithi022.stdout:Aug 20 01:28:50 smithi022 bash[60884]: b4f278ca1b8646b62d8f493e45e5772006797cdcb8869d85f1cdaac2e854d6a2 2024-08-20T01:28:50.611 INFO:journalctl@ceph.mds.g.smithi022.stdout:Aug 20 01:28:50 smithi022 systemd[1]: Started Ceph mds.g for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:28:51.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.967+0000 7f27013de640 1 -- 172.21.15.22:0/3655984306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc108e60 msgr2=0x7f26fc10f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:51.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.967+0000 7f27013de640 1 --2- 172.21.15.22:0/3655984306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc108e60 0x7f26fc10f660 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009ca0 tx=0x7f26f402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:28:51.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.967+0000 7f27013de640 1 -- 172.21.15.22:0/3655984306 shutdown_connections 2024-08-20T01:28:51.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.967+0000 7f27013de640 1 --2- 172.21.15.22:0/3655984306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc108e60 0x7f26fc10f660 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.967+0000 7f27013de640 1 --2- 172.21.15.22:0/3655984306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26fc1084e0 0x7f26fc108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.967+0000 7f27013de640 1 --2- 172.21.15.22:0/3655984306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26fc102ad0 0x7f26fc102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.967+0000 7f27013de640 1 -- 172.21.15.22:0/3655984306 >> 172.21.15.22:0/3655984306 conn(0x7f26fc0fe540 msgr2=0x7f26fc100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.967+0000 7f27013de640 1 -- 172.21.15.22:0/3655984306 shutdown_connections 2024-08-20T01:28:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.967+0000 7f27013de640 1 -- 172.21.15.22:0/3655984306 wait complete. 2024-08-20T01:28:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.968+0000 7f27013de640 1 Processor -- start 2024-08-20T01:28:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.968+0000 7f27013de640 1 -- start start 2024-08-20T01:28:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.968+0000 7f27013de640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26fc102ad0 0x7f26fc0751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.968+0000 7f27013de640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26fc1084e0 0x7f26fc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.968+0000 7f27013de640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc108e60 0x7f26fc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.968+0000 7f27013de640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f26fc112ae0 con 0x7f26fc108e60 2024-08-20T01:28:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.968+0000 7f27013de640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f26fc112960 con 0x7f26fc1084e0 2024-08-20T01:28:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.968+0000 7f27013de640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f26fc112c60 con 0x7f26fc102ad0 2024-08-20T01:28:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.969+0000 7f26fb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc108e60 0x7f26fc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.969+0000 7f26fb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc108e60 0x7f26fc075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33516/0 (socket says 172.21.15.22:33516) 2024-08-20T01:28:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.969+0000 7f26fb7fe640 1 -- 172.21.15.22:0/827704182 learned_addr learned my addr 172.21.15.22:0/827704182 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:28:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.969+0000 7f26faffd640 1 --2- 172.21.15.22:0/827704182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26fc102ad0 0x7f26fc0751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.969+0000 7f26fa7fc640 1 --2- 172.21.15.22:0/827704182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26fc1084e0 0x7f26fc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.969+0000 7f26fb7fe640 1 -- 172.21.15.22:0/827704182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26fc102ad0 msgr2=0x7f26fc0751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.969+0000 7f26fb7fe640 1 --2- 172.21.15.22:0/827704182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26fc102ad0 0x7f26fc0751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.969+0000 7f26fb7fe640 1 -- 172.21.15.22:0/827704182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26fc1084e0 msgr2=0x7f26fc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.969+0000 7f26fb7fe640 1 --2- 172.21.15.22:0/827704182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26fc1084e0 0x7f26fc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.969+0000 7f26fb7fe640 1 -- 172.21.15.22:0/827704182 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26fc1a72f0 con 0x7f26fc108e60 2024-08-20T01:28:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.969+0000 7f26faffd640 1 --2- 172.21.15.22:0/827704182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26fc102ad0 0x7f26fc0751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:28:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.969+0000 7f26fb7fe640 1 --2- 172.21.15.22:0/827704182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc108e60 0x7f26fc075c50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f26f4005cc0 tx=0x7f26f402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.969+0000 7f26e3fff640 1 -- 172.21.15.22:0/827704182 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f4003cf0 con 0x7f26fc108e60 2024-08-20T01:28:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.969+0000 7f27013de640 1 -- 172.21.15.22:0/827704182 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26fc1a7580 con 0x7f26fc108e60 2024-08-20T01:28:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.969+0000 7f26e3fff640 1 -- 172.21.15.22:0/827704182 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26f40044f0 con 0x7f26fc108e60 2024-08-20T01:28:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.969+0000 7f26e3fff640 1 -- 172.21.15.22:0/827704182 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f402fd10 con 0x7f26fc108e60 2024-08-20T01:28:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.969+0000 7f27013de640 1 -- 172.21.15.22:0/827704182 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26fc1a7b10 con 0x7f26fc108e60 2024-08-20T01:28:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.970+0000 7f27013de640 1 -- 172.21.15.22:0/827704182 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26fc102eb0 con 0x7f26fc108e60 2024-08-20T01:28:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.972+0000 7f26e3fff640 1 -- 172.21.15.22:0/827704182 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f26f4004040 con 0x7f26fc108e60 2024-08-20T01:28:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.973+0000 7f26e3fff640 1 --2- 172.21.15.22:0/827704182 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f26e40b3bd0 0x7f26e40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.973+0000 7f26faffd640 1 --2- 172.21.15.22:0/827704182 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f26e40b3bd0 0x7f26e40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.973+0000 7f26e3fff640 1 -- 172.21.15.22:0/827704182 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f26f4105080 con 0x7f26fc108e60 2024-08-20T01:28:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.973+0000 7f26faffd640 1 --2- 172.21.15.22:0/827704182 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f26e40b3bd0 0x7f26e40b6090 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f26ec00baa0 tx=0x7f26ec005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:51.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:50.977+0000 7f26e3fff640 1 -- 172.21.15.22:0/827704182 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f26f40ccb50 con 0x7f26fc108e60 2024-08-20T01:28:51.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:50 smithi022 ceph-mon[18709]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:51.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:50 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:51.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:50 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:51.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:50 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:51.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:50 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:51.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:50 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:51.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:50 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:51.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:51.208+0000 7f27013de640 1 -- 172.21.15.22:0/827704182 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26fc1a7e60 con 0x7f26fc108e60 2024-08-20T01:28:51.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:51.209+0000 7f26e3fff640 1 -- 172.21.15.22:0/827704182 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8872 (secure 0 0 0) 0x7f26f40cc450 con 0x7f26fc108e60 2024-08-20T01:28:51.210 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:28:51.210 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":11,"btime":"2024-08-20T01:28:50:979886+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24559,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24565,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24586,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-20T01:28:51.210 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 11 2024-08-20T01:28:51.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:51.211+0000 7f27013de640 1 -- 172.21.15.22:0/827704182 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f26e40b3bd0 msgr2=0x7f26e40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:51.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:51.211+0000 7f27013de640 1 --2- 172.21.15.22:0/827704182 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f26e40b3bd0 0x7f26e40b6090 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f26ec00baa0 tx=0x7f26ec005d90 comp rx=0 tx=0).stop 2024-08-20T01:28:51.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:51.211+0000 7f27013de640 1 -- 172.21.15.22:0/827704182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc108e60 msgr2=0x7f26fc075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:51.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:51.211+0000 7f27013de640 1 --2- 172.21.15.22:0/827704182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc108e60 0x7f26fc075c50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f26f4005cc0 tx=0x7f26f402f470 comp rx=0 tx=0).stop 2024-08-20T01:28:51.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:51.211+0000 7f27013de640 1 -- 172.21.15.22:0/827704182 shutdown_connections 2024-08-20T01:28:51.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:51.211+0000 7f27013de640 1 --2- 172.21.15.22:0/827704182 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f26e40b3bd0 0x7f26e40b6090 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:51.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:51.211+0000 7f27013de640 1 --2- 172.21.15.22:0/827704182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26fc108e60 0x7f26fc075c50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:51.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:51.211+0000 7f27013de640 1 --2- 172.21.15.22:0/827704182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26fc1084e0 0x7f26fc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:51.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:51.211+0000 7f27013de640 1 --2- 172.21.15.22:0/827704182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26fc102ad0 0x7f26fc0751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:51.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:51.211+0000 7f27013de640 1 -- 172.21.15.22:0/827704182 >> 172.21.15.22:0/827704182 conn(0x7f26fc0fe540 msgr2=0x7f26fc0fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:51.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:51.211+0000 7f27013de640 1 -- 172.21.15.22:0/827704182 shutdown_connections 2024-08-20T01:28:51.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:51.211+0000 7f27013de640 1 -- 172.21.15.22:0/827704182 wait complete. 2024-08-20T01:28:51.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:50 smithi134 ceph-mon[22511]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:51.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:50 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:51.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:50 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:51.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:50 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:51.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:50 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:51.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:50 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:51.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:50 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:51.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:50 smithi077 ceph-mon[22251]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:51.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:50 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:51.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:50 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:51.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:50 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:51.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:50 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:51.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:50 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:51.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:50 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:52.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:51 smithi134 ceph-mon[22511]: Deploying daemon mds.a on smithi022 2024-08-20T01:28:52.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:51 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.22:6838/1257333272,v1:172.21.15.22:6839/1257333272] up:boot 2024-08-20T01:28:52.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:51 smithi134 ceph-mon[22511]: fsmap 10 up:standby 2024-08-20T01:28:52.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:51 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-20T01:28:52.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:51 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/827704182' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:52.305 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:51 smithi022 ceph-mon[18709]: Deploying daemon mds.a on smithi022 2024-08-20T01:28:52.305 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:51 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.22:6838/1257333272,v1:172.21.15.22:6839/1257333272] up:boot 2024-08-20T01:28:52.305 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:51 smithi022 ceph-mon[18709]: fsmap 10 up:standby 2024-08-20T01:28:52.305 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:51 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-20T01:28:52.305 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:51 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/827704182' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:52.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:51 smithi077 ceph-mon[22251]: Deploying daemon mds.a on smithi022 2024-08-20T01:28:52.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:51 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.22:6838/1257333272,v1:172.21.15.22:6839/1257333272] up:boot 2024-08-20T01:28:52.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:51 smithi077 ceph-mon[22251]: fsmap 10 up:standby 2024-08-20T01:28:52.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:51 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-20T01:28:52.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:51 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/827704182' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:52.886 INFO:journalctl@ceph.mds.a.smithi022.stdout:Aug 20 01:28:52 smithi022 systemd[1]: Starting Ceph mds.a for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:28:53.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:52 smithi134 ceph-mon[22511]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:53.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:52 smithi077 ceph-mon[22251]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:53.322 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:52 smithi022 ceph-mon[18709]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:53.322 INFO:journalctl@ceph.mds.a.smithi022.stdout:Aug 20 01:28:53 smithi022 podman[61278]: 2024-08-20 01:28:52.961030702 +0000 UTC m=+0.016253914 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:28:53.322 INFO:journalctl@ceph.mds.a.smithi022.stdout:Aug 20 01:28:53 smithi022 podman[61278]: 2024-08-20 01:28:53.077474383 +0000 UTC m=+0.132697577 container create 4aa136384356226aead9ca71107b657edf021077bf28534a9204c9e2b2d48e0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-08-20T01:28:53.322 INFO:journalctl@ceph.mds.a.smithi022.stdout:Aug 20 01:28:53 smithi022 podman[61278]: 2024-08-20 01:28:53.321946388 +0000 UTC m=+0.377169588 container init 4aa136384356226aead9ca71107b657edf021077bf28534a9204c9e2b2d48e0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-a, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:28:53.636 INFO:journalctl@ceph.mds.a.smithi022.stdout:Aug 20 01:28:53 smithi022 podman[61278]: 2024-08-20 01:28:53.325243751 +0000 UTC m=+0.380466949 container start 4aa136384356226aead9ca71107b657edf021077bf28534a9204c9e2b2d48e0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-a, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-20T01:28:53.636 INFO:journalctl@ceph.mds.a.smithi022.stdout:Aug 20 01:28:53 smithi022 ceph-mds[61298]: -- 172.21.15.22:0/3156991880 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55689ca2d860 con 0x55689ca0b400 2024-08-20T01:28:53.636 INFO:journalctl@ceph.mds.a.smithi022.stdout:Aug 20 01:28:53 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-a[61294]: starting mds.a at 2024-08-20T01:28:53.636 INFO:journalctl@ceph.mds.a.smithi022.stdout:Aug 20 01:28:53 smithi022 bash[61278]: 4aa136384356226aead9ca71107b657edf021077bf28534a9204c9e2b2d48e0b 2024-08-20T01:28:53.636 INFO:journalctl@ceph.mds.a.smithi022.stdout:Aug 20 01:28:53 smithi022 systemd[1]: Started Ceph mds.a for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:28:54.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:54 smithi134 ceph-mon[22511]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:54.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:54.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:54.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:54.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:54.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:54.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:54.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:54 smithi134 ceph-mon[22511]: Deploying daemon mds.b on smithi077 2024-08-20T01:28:54.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:54 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.22:6840/3674086354,v1:172.21.15.22:6841/3674086354] up:boot 2024-08-20T01:28:54.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:54 smithi134 ceph-mon[22511]: fsmap 11 up:standby 2024-08-20T01:28:54.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-20T01:28:54.814 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:28:54.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:54 smithi077 ceph-mon[22251]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:54.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:54.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:54.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:54.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:54.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:54.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:54.816 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:54 smithi077 ceph-mon[22251]: Deploying daemon mds.b on smithi077 2024-08-20T01:28:54.816 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:54 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.22:6840/3674086354,v1:172.21.15.22:6841/3674086354] up:boot 2024-08-20T01:28:54.816 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:54 smithi077 ceph-mon[22251]: fsmap 11 up:standby 2024-08-20T01:28:54.816 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-20T01:28:54.845 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:54 smithi022 ceph-mon[18709]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:54.845 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:54.846 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:54.846 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:54.846 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:28:54.846 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:28:54.846 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:54.846 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:54 smithi022 ceph-mon[18709]: Deploying daemon mds.b on smithi077 2024-08-20T01:28:54.846 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:54 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.22:6840/3674086354,v1:172.21.15.22:6841/3674086354] up:boot 2024-08-20T01:28:54.846 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:54 smithi022 ceph-mon[18709]: fsmap 11 up:standby 2024-08-20T01:28:54.846 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-20T01:28:55.092 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:55.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.558+0000 7f88bb37e640 1 -- 172.21.15.22:0/1075108053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b4102ad0 msgr2=0x7f88b4102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:55.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.558+0000 7f88bb37e640 1 --2- 172.21.15.22:0/1075108053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b4102ad0 0x7f88b4102eb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f88b0009900 tx=0x7f88b002a410 comp rx=0 tx=0).stop 2024-08-20T01:28:55.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.559+0000 7f88bb37e640 1 -- 172.21.15.22:0/1075108053 shutdown_connections 2024-08-20T01:28:55.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.559+0000 7f88bb37e640 1 --2- 172.21.15.22:0/1075108053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88b4108e60 0x7f88b410f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:55.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.559+0000 7f88bb37e640 1 --2- 172.21.15.22:0/1075108053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88b41084e0 0x7f88b4108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:55.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.559+0000 7f88bb37e640 1 --2- 172.21.15.22:0/1075108053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b4102ad0 0x7f88b4102eb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.559+0000 7f88bb37e640 1 -- 172.21.15.22:0/1075108053 >> 172.21.15.22:0/1075108053 conn(0x7f88b40fe540 msgr2=0x7f88b4100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.559+0000 7f88bb37e640 1 -- 172.21.15.22:0/1075108053 shutdown_connections 2024-08-20T01:28:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.559+0000 7f88bb37e640 1 -- 172.21.15.22:0/1075108053 wait complete. 2024-08-20T01:28:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.559+0000 7f88bb37e640 1 Processor -- start 2024-08-20T01:28:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.559+0000 7f88bb37e640 1 -- start start 2024-08-20T01:28:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.559+0000 7f88bb37e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88b4102ad0 0x7f88b4199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.559+0000 7f88bb37e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b41084e0 0x7f88b4199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.559+0000 7f88bb37e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88b4108e60 0x7f88b419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.559+0000 7f88bb37e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f88b4112ae0 con 0x7f88b41084e0 2024-08-20T01:28:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.559+0000 7f88bb37e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f88b4112960 con 0x7f88b4102ad0 2024-08-20T01:28:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.559+0000 7f88bb37e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f88b4112c60 con 0x7f88b4108e60 2024-08-20T01:28:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.560+0000 7f88b8919640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b41084e0 0x7f88b4199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.560+0000 7f88b8919640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b41084e0 0x7f88b4199550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33548/0 (socket says 172.21.15.22:33548) 2024-08-20T01:28:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.560+0000 7f88b8919640 1 -- 172.21.15.22:0/436079517 learned_addr learned my addr 172.21.15.22:0/436079517 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:28:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.560+0000 7f88b911a640 1 --2- 172.21.15.22:0/436079517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88b4102ad0 0x7f88b4199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.560+0000 7f88b8919640 1 -- 172.21.15.22:0/436079517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88b4108e60 msgr2=0x7f88b419e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.560+0000 7f88b991b640 1 --2- 172.21.15.22:0/436079517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88b4108e60 0x7f88b419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.560+0000 7f88b8919640 1 --2- 172.21.15.22:0/436079517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88b4108e60 0x7f88b419e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.560+0000 7f88b8919640 1 -- 172.21.15.22:0/436079517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88b4102ad0 msgr2=0x7f88b4199010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.560+0000 7f88b8919640 1 --2- 172.21.15.22:0/436079517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88b4102ad0 0x7f88b4199010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.560+0000 7f88b8919640 1 -- 172.21.15.22:0/436079517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b419f0c0 con 0x7f88b41084e0 2024-08-20T01:28:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.560+0000 7f88b991b640 1 --2- 172.21.15.22:0/436079517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88b4108e60 0x7f88b419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:28:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.560+0000 7f88b911a640 1 --2- 172.21.15.22:0/436079517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88b4102ad0 0x7f88b4199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:28:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.560+0000 7f88b8919640 1 --2- 172.21.15.22:0/436079517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b41084e0 0x7f88b4199550 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f88a400e9f0 tx=0x7f88a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.560+0000 7f88aa7fc640 1 -- 172.21.15.22:0/436079517 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a400cd80 con 0x7f88b41084e0 2024-08-20T01:28:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.560+0000 7f88aa7fc640 1 -- 172.21.15.22:0/436079517 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88a40108e0 con 0x7f88b41084e0 2024-08-20T01:28:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.560+0000 7f88bb37e640 1 -- 172.21.15.22:0/436079517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88b419f3b0 con 0x7f88b41084e0 2024-08-20T01:28:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.560+0000 7f88aa7fc640 1 -- 172.21.15.22:0/436079517 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4018980 con 0x7f88b41084e0 2024-08-20T01:28:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.560+0000 7f88bb37e640 1 -- 172.21.15.22:0/436079517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88b41a5a70 con 0x7f88b41084e0 2024-08-20T01:28:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.561+0000 7f88bb37e640 1 -- 172.21.15.22:0/436079517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88b4102eb0 con 0x7f88b41084e0 2024-08-20T01:28:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.563+0000 7f88aa7fc640 1 -- 172.21.15.22:0/436079517 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f88a4010430 con 0x7f88b41084e0 2024-08-20T01:28:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.564+0000 7f88aa7fc640 1 --2- 172.21.15.22:0/436079517 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f88a00b3bd0 0x7f88a00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.564+0000 7f88b911a640 1 --2- 172.21.15.22:0/436079517 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f88a00b3bd0 0x7f88a00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.564+0000 7f88aa7fc640 1 -- 172.21.15.22:0/436079517 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f88a40e4080 con 0x7f88b41084e0 2024-08-20T01:28:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.564+0000 7f88b911a640 1 --2- 172.21.15.22:0/436079517 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f88a00b3bd0 0x7f88a00b6090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f88b0031440 tx=0x7f88b0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.566+0000 7f88aa7fc640 1 -- 172.21.15.22:0/436079517 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f88a40abad0 con 0x7f88b41084e0 2024-08-20T01:28:55.730 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:28:55 smithi077 systemd[1]: Starting Ceph mds.b for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:28:55.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.786+0000 7f88bb37e640 1 -- 172.21.15.22:0/436079517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88b419a140 con 0x7f88b41084e0 2024-08-20T01:28:55.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.787+0000 7f88aa7fc640 1 -- 172.21.15.22:0/436079517 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9698 (secure 0 0 0) 0x7f88b419a140 con 0x7f88b41084e0 2024-08-20T01:28:55.788 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:28:55.788 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"btime":"2024-08-20T01:28:53:994284+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24559,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24565,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24586,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-20T01:28:55.788 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 12 2024-08-20T01:28:55.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.789+0000 7f88bb37e640 1 -- 172.21.15.22:0/436079517 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f88a00b3bd0 msgr2=0x7f88a00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:55.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.789+0000 7f88bb37e640 1 --2- 172.21.15.22:0/436079517 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f88a00b3bd0 0x7f88a00b6090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f88b0031440 tx=0x7f88b0005b50 comp rx=0 tx=0).stop 2024-08-20T01:28:55.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.789+0000 7f88bb37e640 1 -- 172.21.15.22:0/436079517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b41084e0 msgr2=0x7f88b4199550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:55.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.789+0000 7f88bb37e640 1 --2- 172.21.15.22:0/436079517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b41084e0 0x7f88b4199550 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f88a400e9f0 tx=0x7f88a400eeb0 comp rx=0 tx=0).stop 2024-08-20T01:28:55.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.789+0000 7f88bb37e640 1 -- 172.21.15.22:0/436079517 shutdown_connections 2024-08-20T01:28:55.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.789+0000 7f88bb37e640 1 --2- 172.21.15.22:0/436079517 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f88a00b3bd0 0x7f88a00b6090 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:55.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.789+0000 7f88bb37e640 1 --2- 172.21.15.22:0/436079517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88b4108e60 0x7f88b419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:55.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.789+0000 7f88bb37e640 1 --2- 172.21.15.22:0/436079517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b41084e0 0x7f88b4199550 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:55.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.789+0000 7f88bb37e640 1 --2- 172.21.15.22:0/436079517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88b4102ad0 0x7f88b4199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:55.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.789+0000 7f88bb37e640 1 -- 172.21.15.22:0/436079517 >> 172.21.15.22:0/436079517 conn(0x7f88b40fe540 msgr2=0x7f88b4100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:55.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.790+0000 7f88bb37e640 1 -- 172.21.15.22:0/436079517 shutdown_connections 2024-08-20T01:28:55.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:55.790+0000 7f88bb37e640 1 -- 172.21.15.22:0/436079517 wait complete. 2024-08-20T01:28:56.016 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:28:55 smithi077 podman[51856]: 2024-08-20 01:28:55.632939708 +0000 UTC m=+0.015848531 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:28:56.016 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:28:55 smithi077 podman[51856]: 2024-08-20 01:28:55.753180771 +0000 UTC m=+0.136089583 container create a87d0327515b2e190a00c87f45b92461a0128e3c56fd8ca96866906ba881654a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-08-20T01:28:56.017 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:28:56 smithi077 podman[51856]: 2024-08-20 01:28:56.016737522 +0000 UTC m=+0.399646338 container init a87d0327515b2e190a00c87f45b92461a0128e3c56fd8ca96866906ba881654a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:28:56.314 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:28:56 smithi077 podman[51856]: 2024-08-20 01:28:56.019645286 +0000 UTC m=+0.402554106 container start a87d0327515b2e190a00c87f45b92461a0128e3c56fd8ca96866906ba881654a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-08-20T01:28:56.314 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:28:56 smithi077 ceph-mds[51875]: -- 172.21.15.77:0/3003297932 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fb0175f860 con 0x55fb0173d400 2024-08-20T01:28:56.314 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:28:56 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-b[51871]: starting mds.b at 2024-08-20T01:28:56.314 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:28:56 smithi077 bash[51856]: a87d0327515b2e190a00c87f45b92461a0128e3c56fd8ca96866906ba881654a 2024-08-20T01:28:56.314 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:28:56 smithi077 systemd[1]: Started Ceph mds.b for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:28:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:56 smithi022 ceph-mon[18709]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:56 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/436079517' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:56 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:56 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:56 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:56 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:56 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:56 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:56.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:56 smithi134 ceph-mon[22511]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:56.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:56 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/436079517' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:56.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:56 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:56.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:56 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:56.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:56 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:56.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:56 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:56.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:56 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:56.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:56 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:56.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:56 smithi077 ceph-mon[22251]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:56.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:56 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/436079517' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:28:56.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:56 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:56.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:56 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:56.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:56 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:56.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:56 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:56.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:56 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:56.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:56 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:57.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:57 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] up:boot 2024-08-20T01:28:57.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:57 smithi134 ceph-mon[22511]: fsmap 12 up:standby 2024-08-20T01:28:57.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:57 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-20T01:28:57.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:57 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] up:boot 2024-08-20T01:28:57.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:57 smithi077 ceph-mon[22251]: fsmap 12 up:standby 2024-08-20T01:28:57.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:57 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-20T01:28:57.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:57 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] up:boot 2024-08-20T01:28:57.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:57 smithi022 ceph-mon[18709]: fsmap 12 up:standby 2024-08-20T01:28:57.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:57 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-20T01:28:58.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:28:58.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:58 smithi077 ceph-mon[22251]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:58.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:58.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:58.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:58.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:58.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:58.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:58.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:58.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:58.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:58.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:58.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:28:58 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:58.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:58 smithi022 ceph-mon[18709]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:58.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:58.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:58.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:58.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:58.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:58.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:58.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:58.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:58.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:58.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:58.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:28:58 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:59.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:58 smithi134 ceph-mon[22511]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:28:59.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:59.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:59.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:59.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:59.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:59.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:59.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:59.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:59.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:59.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:59.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:28:58 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:28:59.052 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:59.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.501+0000 7f8494ba6640 1 -- 172.21.15.22:0/1378898481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8490108e60 msgr2=0x7f849010f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:59.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.501+0000 7f8494ba6640 1 --2- 172.21.15.22:0/1378898481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8490108e60 0x7f849010f660 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8488009ca0 tx=0x7f848802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.501+0000 7f8494ba6640 1 -- 172.21.15.22:0/1378898481 shutdown_connections 2024-08-20T01:28:59.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.501+0000 7f8494ba6640 1 --2- 172.21.15.22:0/1378898481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8490108e60 0x7f849010f660 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.501+0000 7f8494ba6640 1 --2- 172.21.15.22:0/1378898481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84901084e0 0x7f8490108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.501+0000 7f8494ba6640 1 --2- 172.21.15.22:0/1378898481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8490102ad0 0x7f8490102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.501+0000 7f8494ba6640 1 -- 172.21.15.22:0/1378898481 >> 172.21.15.22:0/1378898481 conn(0x7f84900fe540 msgr2=0x7f8490100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:59.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.501+0000 7f8494ba6640 1 -- 172.21.15.22:0/1378898481 shutdown_connections 2024-08-20T01:28:59.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.501+0000 7f8494ba6640 1 -- 172.21.15.22:0/1378898481 wait complete. 2024-08-20T01:28:59.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.502+0000 7f8494ba6640 1 Processor -- start 2024-08-20T01:28:59.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.502+0000 7f8494ba6640 1 -- start start 2024-08-20T01:28:59.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.502+0000 7f8494ba6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8490102ad0 0x7f84900751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:59.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.502+0000 7f8494ba6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84901084e0 0x7f8490075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:59.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.502+0000 7f8494ba6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8490108e60 0x7f8490075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:59.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.502+0000 7f8494ba6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8490112b20 con 0x7f8490108e60 2024-08-20T01:28:59.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.502+0000 7f8494ba6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f84901129a0 con 0x7f8490102ad0 2024-08-20T01:28:59.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.502+0000 7f8494ba6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8490112ca0 con 0x7f84901084e0 2024-08-20T01:28:59.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.502+0000 7f848ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8490108e60 0x7f8490075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:59.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.502+0000 7f848e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8490102ad0 0x7f84900751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:59.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.502+0000 7f848ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8490108e60 0x7f8490075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33568/0 (socket says 172.21.15.22:33568) 2024-08-20T01:28:59.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.502+0000 7f848e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8490102ad0 0x7f84900751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:42048/0 (socket says 172.21.15.22:42048) 2024-08-20T01:28:59.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.502+0000 7f848ed9d640 1 -- 172.21.15.22:0/1500207090 learned_addr learned my addr 172.21.15.22:0/1500207090 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:28:59.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.502+0000 7f848dd9b640 1 --2- 172.21.15.22:0/1500207090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84901084e0 0x7f8490075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:59.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.503+0000 7f848e59c640 1 -- 172.21.15.22:0/1500207090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84901084e0 msgr2=0x7f8490075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:59.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.503+0000 7f848e59c640 1 --2- 172.21.15.22:0/1500207090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84901084e0 0x7f8490075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.503+0000 7f848e59c640 1 -- 172.21.15.22:0/1500207090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8490108e60 msgr2=0x7f8490075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:59.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.503+0000 7f848e59c640 1 --2- 172.21.15.22:0/1500207090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8490108e60 0x7f8490075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.503+0000 7f848e59c640 1 -- 172.21.15.22:0/1500207090 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84901a73d0 con 0x7f8490102ad0 2024-08-20T01:28:59.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.503+0000 7f848dd9b640 1 --2- 172.21.15.22:0/1500207090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84901084e0 0x7f8490075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:28:59.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.503+0000 7f848ed9d640 1 --2- 172.21.15.22:0/1500207090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8490108e60 0x7f8490075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:28:59.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.503+0000 7f848e59c640 1 --2- 172.21.15.22:0/1500207090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8490102ad0 0x7f84900751d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f848000b3f0 tx=0x7f848000b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:59.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.503+0000 7f847f7fe640 1 -- 172.21.15.22:0/1500207090 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480015020 con 0x7f8490102ad0 2024-08-20T01:28:59.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.503+0000 7f8494ba6640 1 -- 172.21.15.22:0/1500207090 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84901a76c0 con 0x7f8490102ad0 2024-08-20T01:28:59.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.503+0000 7f847f7fe640 1 -- 172.21.15.22:0/1500207090 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8480011ce0 con 0x7f8490102ad0 2024-08-20T01:28:59.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.503+0000 7f847f7fe640 1 -- 172.21.15.22:0/1500207090 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480010d80 con 0x7f8490102ad0 2024-08-20T01:28:59.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.503+0000 7f8494ba6640 1 -- 172.21.15.22:0/1500207090 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84901a7c00 con 0x7f8490102ad0 2024-08-20T01:28:59.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.504+0000 7f8494ba6640 1 -- 172.21.15.22:0/1500207090 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8490102eb0 con 0x7f8490102ad0 2024-08-20T01:28:59.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.505+0000 7f847f7fe640 1 -- 172.21.15.22:0/1500207090 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f8480018020 con 0x7f8490102ad0 2024-08-20T01:28:59.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.506+0000 7f847f7fe640 1 --2- 172.21.15.22:0/1500207090 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f84780b3c50 0x7f84780b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:59.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.506+0000 7f848dd9b640 1 --2- 172.21.15.22:0/1500207090 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f84780b3c50 0x7f84780b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:59.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.506+0000 7f847f7fe640 1 -- 172.21.15.22:0/1500207090 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f84800e2fe0 con 0x7f8490102ad0 2024-08-20T01:28:59.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.506+0000 7f848dd9b640 1 --2- 172.21.15.22:0/1500207090 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f84780b3c50 0x7f84780b6110 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8484005d00 tx=0x7f8484005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:59.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.510+0000 7f847f7fe640 1 -- 172.21.15.22:0/1500207090 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f848001f020 con 0x7f8490102ad0 2024-08-20T01:28:59.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.754+0000 7f8494ba6640 1 -- 172.21.15.22:0/1500207090 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f849002e340 con 0x7f8490102ad0 2024-08-20T01:28:59.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.755+0000 7f847f7fe640 1 -- 172.21.15.22:0/1500207090 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10518 (secure 0 0 0) 0x7f84800aaa90 con 0x7f8490102ad0 2024-08-20T01:28:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:28:59.756 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":13,"btime":"2024-08-20T01:28:56:470906+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24559,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24565,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24586,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-20T01:28:59.756 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 13 2024-08-20T01:28:59.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.757+0000 7f8494ba6640 1 -- 172.21.15.22:0/1500207090 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f84780b3c50 msgr2=0x7f84780b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:59.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.757+0000 7f8494ba6640 1 --2- 172.21.15.22:0/1500207090 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f84780b3c50 0x7f84780b6110 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8484005d00 tx=0x7f8484005c70 comp rx=0 tx=0).stop 2024-08-20T01:28:59.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.757+0000 7f8494ba6640 1 -- 172.21.15.22:0/1500207090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8490102ad0 msgr2=0x7f84900751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:59.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.757+0000 7f8494ba6640 1 --2- 172.21.15.22:0/1500207090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8490102ad0 0x7f84900751d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f848000b3f0 tx=0x7f848000b8b0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.757+0000 7f8494ba6640 1 -- 172.21.15.22:0/1500207090 shutdown_connections 2024-08-20T01:28:59.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.757+0000 7f8494ba6640 1 --2- 172.21.15.22:0/1500207090 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f84780b3c50 0x7f84780b6110 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.757+0000 7f8494ba6640 1 --2- 172.21.15.22:0/1500207090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8490108e60 0x7f8490075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.757+0000 7f8494ba6640 1 --2- 172.21.15.22:0/1500207090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84901084e0 0x7f8490075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.757+0000 7f8494ba6640 1 --2- 172.21.15.22:0/1500207090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8490102ad0 0x7f84900751d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.757+0000 7f8494ba6640 1 -- 172.21.15.22:0/1500207090 >> 172.21.15.22:0/1500207090 conn(0x7f84900fe540 msgr2=0x7f8490105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:59.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.757+0000 7f8494ba6640 1 -- 172.21.15.22:0/1500207090 shutdown_connections 2024-08-20T01:28:59.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:28:59.757+0000 7f8494ba6640 1 -- 172.21.15.22:0/1500207090 wait complete. 2024-08-20T01:29:00.396 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-08-20T01:29:00.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:00 smithi022 ceph-mon[18709]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:29:00.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:00 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1500207090' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:29:00.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:00.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:29:00.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.653 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:00.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:00 smithi134 ceph-mon[22511]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:29:00.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:00 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1500207090' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:29:00.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:00.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:29:00.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:00 smithi077 ceph-mon[22251]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:29:00.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:00 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1500207090' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:29:00.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:00.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:00.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:29:00.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:29:01.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.094+0000 7f291e2bb640 1 -- 172.21.15.22:0/2704188249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2918107d20 msgr2=0x7f291810e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:01.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.094+0000 7f291e2bb640 1 --2- 172.21.15.22:0/2704188249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2918107d20 0x7f291810e520 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2910009ca0 tx=0x7f291002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.095+0000 7f291e2bb640 1 -- 172.21.15.22:0/2704188249 shutdown_connections 2024-08-20T01:29:01.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.095+0000 7f291e2bb640 1 --2- 172.21.15.22:0/2704188249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2918107d20 0x7f291810e520 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.095+0000 7f291e2bb640 1 --2- 172.21.15.22:0/2704188249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29181073a0 0x7f29181077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.095+0000 7f291e2bb640 1 --2- 172.21.15.22:0/2704188249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2918101990 0x7f2918101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.095+0000 7f291e2bb640 1 -- 172.21.15.22:0/2704188249 >> 172.21.15.22:0/2704188249 conn(0x7f29180fd400 msgr2=0x7f29180ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:01.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.095+0000 7f291e2bb640 1 -- 172.21.15.22:0/2704188249 shutdown_connections 2024-08-20T01:29:01.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.095+0000 7f291e2bb640 1 -- 172.21.15.22:0/2704188249 wait complete. 2024-08-20T01:29:01.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.095+0000 7f291e2bb640 1 Processor -- start 2024-08-20T01:29:01.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.095+0000 7f291e2bb640 1 -- start start 2024-08-20T01:29:01.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.096+0000 7f291e2bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2918101990 0x7f2918199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:01.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.096+0000 7f291e2bb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29181073a0 0x7f291819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:01.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.096+0000 7f291e2bb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2918107d20 0x7f291819a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:01.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.096+0000 7f291e2bb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f29181119e0 con 0x7f29181073a0 2024-08-20T01:29:01.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.096+0000 7f291e2bb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2918111860 con 0x7f2918101990 2024-08-20T01:29:01.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.096+0000 7f291e2bb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2918111b60 con 0x7f2918107d20 2024-08-20T01:29:01.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.096+0000 7f29177fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29181073a0 0x7f291819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:01.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.096+0000 7f29177fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29181073a0 0x7f291819a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57758/0 (socket says 172.21.15.22:57758) 2024-08-20T01:29:01.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.096+0000 7f29177fe640 1 -- 172.21.15.22:0/3576800992 learned_addr learned my addr 172.21.15.22:0/3576800992 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:01.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.096+0000 7f2917fff640 1 --2- 172.21.15.22:0/3576800992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2918101990 0x7f2918199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:01.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.096+0000 7f291c858640 1 --2- 172.21.15.22:0/3576800992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2918107d20 0x7f291819a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:01.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.096+0000 7f29177fe640 1 -- 172.21.15.22:0/3576800992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2918107d20 msgr2=0x7f291819a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:01.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.096+0000 7f29177fe640 1 --2- 172.21.15.22:0/3576800992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2918107d20 0x7f291819a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.096+0000 7f29177fe640 1 -- 172.21.15.22:0/3576800992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2918101990 msgr2=0x7f2918199cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:01.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.096+0000 7f29177fe640 1 --2- 172.21.15.22:0/3576800992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2918101990 0x7f2918199cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.096+0000 7f29177fe640 1 -- 172.21.15.22:0/3576800992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29181a50d0 con 0x7f29181073a0 2024-08-20T01:29:01.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.096+0000 7f291c858640 1 --2- 172.21.15.22:0/3576800992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2918107d20 0x7f291819a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:29:01.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.097+0000 7f29177fe640 1 --2- 172.21.15.22:0/3576800992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29181073a0 0x7f291819a230 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f290c00c920 tx=0x7f290c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:01.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.097+0000 7f29157fa640 1 -- 172.21.15.22:0/3576800992 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c007c70 con 0x7f29181073a0 2024-08-20T01:29:01.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.097+0000 7f29157fa640 1 -- 172.21.15.22:0/3576800992 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f290c007e10 con 0x7f29181073a0 2024-08-20T01:29:01.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.097+0000 7f291e2bb640 1 -- 172.21.15.22:0/3576800992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29181a53c0 con 0x7f29181073a0 2024-08-20T01:29:01.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.097+0000 7f29157fa640 1 -- 172.21.15.22:0/3576800992 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c018820 con 0x7f29181073a0 2024-08-20T01:29:01.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.097+0000 7f291e2bb640 1 -- 172.21.15.22:0/3576800992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29181a5900 con 0x7f29181073a0 2024-08-20T01:29:01.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.098+0000 7f291e2bb640 1 -- 172.21.15.22:0/3576800992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2918101d70 con 0x7f29181073a0 2024-08-20T01:29:01.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.099+0000 7f29157fa640 1 -- 172.21.15.22:0/3576800992 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f290c00f450 con 0x7f29181073a0 2024-08-20T01:29:01.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.100+0000 7f29157fa640 1 --2- 172.21.15.22:0/3576800992 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f29000b3bd0 0x7f29000b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:01.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.100+0000 7f2917fff640 1 --2- 172.21.15.22:0/3576800992 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f29000b3bd0 0x7f29000b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:01.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.100+0000 7f29157fa640 1 -- 172.21.15.22:0/3576800992 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f290c0e3c00 con 0x7f29181073a0 2024-08-20T01:29:01.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.100+0000 7f2917fff640 1 --2- 172.21.15.22:0/3576800992 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f29000b3bd0 0x7f29000b6090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f290800bbe0 tx=0x7f290800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:01.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.103+0000 7f29157fa640 1 -- 172.21.15.22:0/3576800992 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f290c014030 con 0x7f29181073a0 2024-08-20T01:29:01.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.293+0000 7f291e2bb640 1 -- 172.21.15.22:0/3576800992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f291806abc0 con 0x7f29181073a0 2024-08-20T01:29:01.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.293+0000 7f29157fa640 1 -- 172.21.15.22:0/3576800992 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) ==== 84+0+65 (secure 0 0 0) 0x7f290c0ab6e0 con 0x7f29181073a0 2024-08-20T01:29:01.294 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:29:01.294 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2024-08-20T01:29:01.294 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:29:01.294 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2024-08-20T01:29:01.294 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2024-08-20T01:29:01.294 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:29:01.294 INFO:teuthology.orchestra.run.smithi022.stdout:] 2024-08-20T01:29:01.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.295+0000 7f291e2bb640 1 -- 172.21.15.22:0/3576800992 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f29000b3bd0 msgr2=0x7f29000b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:01.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.295+0000 7f291e2bb640 1 --2- 172.21.15.22:0/3576800992 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f29000b3bd0 0x7f29000b6090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f290800bbe0 tx=0x7f290800b390 comp rx=0 tx=0).stop 2024-08-20T01:29:01.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.295+0000 7f291e2bb640 1 -- 172.21.15.22:0/3576800992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29181073a0 msgr2=0x7f291819a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:01.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.295+0000 7f291e2bb640 1 --2- 172.21.15.22:0/3576800992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29181073a0 0x7f291819a230 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f290c00c920 tx=0x7f290c00cde0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.295+0000 7f291e2bb640 1 -- 172.21.15.22:0/3576800992 shutdown_connections 2024-08-20T01:29:01.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.295+0000 7f291e2bb640 1 --2- 172.21.15.22:0/3576800992 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f29000b3bd0 0x7f29000b6090 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.295+0000 7f291e2bb640 1 --2- 172.21.15.22:0/3576800992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2918107d20 0x7f291819a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.295+0000 7f291e2bb640 1 --2- 172.21.15.22:0/3576800992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29181073a0 0x7f291819a230 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.295+0000 7f291e2bb640 1 --2- 172.21.15.22:0/3576800992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2918101990 0x7f2918199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.295+0000 7f291e2bb640 1 -- 172.21.15.22:0/3576800992 >> 172.21.15.22:0/3576800992 conn(0x7f29180fd400 msgr2=0x7f29180ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:01.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.295+0000 7f291e2bb640 1 -- 172.21.15.22:0/3576800992 shutdown_connections 2024-08-20T01:29:01.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:01.295+0000 7f291e2bb640 1 -- 172.21.15.22:0/3576800992 wait complete. 2024-08-20T01:29:01.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:01 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3576800992' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-20T01:29:01.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:01 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3576800992' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-20T01:29:01.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:01 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3576800992' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-20T01:29:01.896 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-20T01:29:01.897 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-20T01:29:02.155 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:02.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:02 smithi022 ceph-mon[18709]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:29:02.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.601+0000 7f0f37840640 1 -- 172.21.15.22:0/4285212393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f30102ad0 msgr2=0x7f0f30102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:02.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.601+0000 7f0f37840640 1 --2- 172.21.15.22:0/4285212393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f30102ad0 0x7f0f30102eb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009900 tx=0x7f0f2c02a410 comp rx=0 tx=0).stop 2024-08-20T01:29:02.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.601+0000 7f0f37840640 1 -- 172.21.15.22:0/4285212393 shutdown_connections 2024-08-20T01:29:02.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.601+0000 7f0f37840640 1 --2- 172.21.15.22:0/4285212393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f30108e60 0x7f0f3010f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:02.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.601+0000 7f0f37840640 1 --2- 172.21.15.22:0/4285212393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f301084e0 0x7f0f30108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:02.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.601+0000 7f0f37840640 1 --2- 172.21.15.22:0/4285212393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f30102ad0 0x7f0f30102eb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:02.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.601+0000 7f0f37840640 1 -- 172.21.15.22:0/4285212393 >> 172.21.15.22:0/4285212393 conn(0x7f0f300fe540 msgr2=0x7f0f30100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:02.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.601+0000 7f0f37840640 1 -- 172.21.15.22:0/4285212393 shutdown_connections 2024-08-20T01:29:02.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.601+0000 7f0f37840640 1 -- 172.21.15.22:0/4285212393 wait complete. 2024-08-20T01:29:02.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.602+0000 7f0f37840640 1 Processor -- start 2024-08-20T01:29:02.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.602+0000 7f0f37840640 1 -- start start 2024-08-20T01:29:02.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.602+0000 7f0f37840640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f30102ad0 0x7f0f300751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:02.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.602+0000 7f0f37840640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f301084e0 0x7f0f30075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:02.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.602+0000 7f0f37840640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f30108e60 0x7f0f30075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:02.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.602+0000 7f0f37840640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0f30112b20 con 0x7f0f30102ad0 2024-08-20T01:29:02.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.602+0000 7f0f37840640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0f301129a0 con 0x7f0f30108e60 2024-08-20T01:29:02.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.602+0000 7f0f37840640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0f30112ca0 con 0x7f0f301084e0 2024-08-20T01:29:02.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.602+0000 7f0f355dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f30102ad0 0x7f0f300751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:02.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.602+0000 7f0f355dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f30102ad0 0x7f0f300751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57778/0 (socket says 172.21.15.22:57778) 2024-08-20T01:29:02.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.602+0000 7f0f355dc640 1 -- 172.21.15.22:0/3694907648 learned_addr learned my addr 172.21.15.22:0/3694907648 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:02.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.603+0000 7f0f34ddb640 1 --2- 172.21.15.22:0/3694907648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f301084e0 0x7f0f30075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:02.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.603+0000 7f0f355dc640 1 -- 172.21.15.22:0/3694907648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f301084e0 msgr2=0x7f0f30075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:02.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.603+0000 7f0f355dc640 1 --2- 172.21.15.22:0/3694907648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f301084e0 0x7f0f30075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:02.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.603+0000 7f0f35ddd640 1 --2- 172.21.15.22:0/3694907648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f30108e60 0x7f0f30075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:02.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.603+0000 7f0f355dc640 1 -- 172.21.15.22:0/3694907648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f30108e60 msgr2=0x7f0f30075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:02.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.603+0000 7f0f355dc640 1 --2- 172.21.15.22:0/3694907648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f30108e60 0x7f0f30075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:02.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.603+0000 7f0f355dc640 1 -- 172.21.15.22:0/3694907648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f301a7410 con 0x7f0f30102ad0 2024-08-20T01:29:02.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.603+0000 7f0f34ddb640 1 --2- 172.21.15.22:0/3694907648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f301084e0 0x7f0f30075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:29:02.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.603+0000 7f0f355dc640 1 --2- 172.21.15.22:0/3694907648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f30102ad0 0x7f0f300751d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c005940 tx=0x7f0f2c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:02.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.603+0000 7f0f267fc640 1 -- 172.21.15.22:0/3694907648 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c03f030 con 0x7f0f30102ad0 2024-08-20T01:29:02.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.603+0000 7f0f267fc640 1 -- 172.21.15.22:0/3694907648 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f2c003cb0 con 0x7f0f30102ad0 2024-08-20T01:29:02.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.603+0000 7f0f37840640 1 -- 172.21.15.22:0/3694907648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f301a76a0 con 0x7f0f30102ad0 2024-08-20T01:29:02.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.603+0000 7f0f267fc640 1 -- 172.21.15.22:0/3694907648 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c035070 con 0x7f0f30102ad0 2024-08-20T01:29:02.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.603+0000 7f0f37840640 1 -- 172.21.15.22:0/3694907648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f301a7c00 con 0x7f0f30102ad0 2024-08-20T01:29:02.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.604+0000 7f0f37840640 1 -- 172.21.15.22:0/3694907648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f30102eb0 con 0x7f0f30102ad0 2024-08-20T01:29:02.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.606+0000 7f0f267fc640 1 -- 172.21.15.22:0/3694907648 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f0f2c042030 con 0x7f0f30102ad0 2024-08-20T01:29:02.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.607+0000 7f0f267fc640 1 --2- 172.21.15.22:0/3694907648 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0f1c0b3bd0 0x7f0f1c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:02.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.607+0000 7f0f34ddb640 1 --2- 172.21.15.22:0/3694907648 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0f1c0b3bd0 0x7f0f1c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:02.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.607+0000 7f0f267fc640 1 -- 172.21.15.22:0/3694907648 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f0f2c104330 con 0x7f0f30102ad0 2024-08-20T01:29:02.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.608+0000 7f0f34ddb640 1 --2- 172.21.15.22:0/3694907648 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0f1c0b3bd0 0x7f0f1c0b6090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0f30076cc0 tx=0x7f0f20008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:02.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.610+0000 7f0f267fc640 1 -- 172.21.15.22:0/3694907648 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f0f2c0cbe20 con 0x7f0f30102ad0 2024-08-20T01:29:02.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:02 smithi134 ceph-mon[22511]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:29:02.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:02.796+0000 7f0f37840640 1 -- 172.21.15.22:0/3694907648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0f300764d0 con 0x7f0f30102ad0 2024-08-20T01:29:02.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:02 smithi077 ceph-mon[22251]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:29:03.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:03.391+0000 7f0f267fc640 1 -- 172.21.15.22:0/3694907648 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) ==== 138+0+0 (secure 0 0 0) 0x7f0f2c0d40f0 con 0x7f0f30102ad0 2024-08-20T01:29:03.393 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2024-08-20T01:29:03.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:03.395+0000 7f0f37840640 1 -- 172.21.15.22:0/3694907648 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0f1c0b3bd0 msgr2=0x7f0f1c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:03.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:03.395+0000 7f0f37840640 1 --2- 172.21.15.22:0/3694907648 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0f1c0b3bd0 0x7f0f1c0b6090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0f30076cc0 tx=0x7f0f20008040 comp rx=0 tx=0).stop 2024-08-20T01:29:03.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:03.395+0000 7f0f37840640 1 -- 172.21.15.22:0/3694907648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f30102ad0 msgr2=0x7f0f300751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:03.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:03.395+0000 7f0f37840640 1 --2- 172.21.15.22:0/3694907648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f30102ad0 0x7f0f300751d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c005940 tx=0x7f0f2c0042f0 comp rx=0 tx=0).stop 2024-08-20T01:29:03.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:03.395+0000 7f0f37840640 1 -- 172.21.15.22:0/3694907648 shutdown_connections 2024-08-20T01:29:03.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:03.395+0000 7f0f37840640 1 --2- 172.21.15.22:0/3694907648 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0f1c0b3bd0 0x7f0f1c0b6090 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:03.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:03.395+0000 7f0f37840640 1 --2- 172.21.15.22:0/3694907648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f30108e60 0x7f0f30075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:03.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:03.395+0000 7f0f37840640 1 --2- 172.21.15.22:0/3694907648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f301084e0 0x7f0f30075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:03.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:03.395+0000 7f0f37840640 1 --2- 172.21.15.22:0/3694907648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f30102ad0 0x7f0f300751d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:03.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:03.395+0000 7f0f37840640 1 -- 172.21.15.22:0/3694907648 >> 172.21.15.22:0/3694907648 conn(0x7f0f300fe540 msgr2=0x7f0f30100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:03.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:03.395+0000 7f0f37840640 1 -- 172.21.15.22:0/3694907648 shutdown_connections 2024-08-20T01:29:03.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:03.395+0000 7f0f37840640 1 -- 172.21.15.22:0/3694907648 wait complete. 2024-08-20T01:29:03.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:03 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3694907648' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-20T01:29:03.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:03 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3694907648' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-20T01:29:03.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:03 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3694907648' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-20T01:29:04.039 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-20T01:29:04.306 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:04.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:04 smithi022 ceph-mon[18709]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:29:04.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:04 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3694907648' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-20T01:29:04.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:04 smithi022 ceph-mon[18709]: osdmap e71: 12 total, 12 up, 12 in 2024-08-20T01:29:04.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:04 smithi134 ceph-mon[22511]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:29:04.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:04 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3694907648' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-20T01:29:04.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:04 smithi134 ceph-mon[22511]: osdmap e71: 12 total, 12 up, 12 in 2024-08-20T01:29:04.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.754+0000 7fbc0be64640 1 -- 172.21.15.22:0/4241162638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc04107d20 msgr2=0x7fbc0410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:04.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.754+0000 7fbc0be64640 1 --2- 172.21.15.22:0/4241162638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc04107d20 0x7fbc0410e520 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc009ca0 tx=0x7fbbfc02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:29:04.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.754+0000 7fbc0be64640 1 -- 172.21.15.22:0/4241162638 shutdown_connections 2024-08-20T01:29:04.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.754+0000 7fbc0be64640 1 --2- 172.21.15.22:0/4241162638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc04107d20 0x7fbc0410e520 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:04.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.754+0000 7fbc0be64640 1 --2- 172.21.15.22:0/4241162638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc041073a0 0x7fbc041077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:04.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.754+0000 7fbc0be64640 1 --2- 172.21.15.22:0/4241162638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc04101990 0x7fbc04101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:04.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.754+0000 7fbc0be64640 1 -- 172.21.15.22:0/4241162638 >> 172.21.15.22:0/4241162638 conn(0x7fbc040fd400 msgr2=0x7fbc040ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:04.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.754+0000 7fbc0be64640 1 -- 172.21.15.22:0/4241162638 shutdown_connections 2024-08-20T01:29:04.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.754+0000 7fbc0be64640 1 -- 172.21.15.22:0/4241162638 wait complete. 2024-08-20T01:29:04.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.755+0000 7fbc0be64640 1 Processor -- start 2024-08-20T01:29:04.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.755+0000 7fbc0be64640 1 -- start start 2024-08-20T01:29:04.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.755+0000 7fbc0be64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc04101990 0x7fbc04199d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:04.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.755+0000 7fbc0be64640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc041073a0 0x7fbc0419a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:04.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.755+0000 7fbc0be64640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc04107d20 0x7fbc0419a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:04.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.755+0000 7fbc0be64640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbc041119a0 con 0x7fbc04101990 2024-08-20T01:29:04.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.755+0000 7fbc0be64640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbc04111820 con 0x7fbc04107d20 2024-08-20T01:29:04.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.755+0000 7fbc0be64640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbc04111b20 con 0x7fbc041073a0 2024-08-20T01:29:04.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.755+0000 7fbc09c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc04101990 0x7fbc04199d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:04.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.755+0000 7fbc09c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc04101990 0x7fbc04199d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57786/0 (socket says 172.21.15.22:57786) 2024-08-20T01:29:04.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.755+0000 7fbc09c00640 1 -- 172.21.15.22:0/1719769347 learned_addr learned my addr 172.21.15.22:0/1719769347 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:04.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.755+0000 7fbc0a401640 1 --2- 172.21.15.22:0/1719769347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc04107d20 0x7fbc0419a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:04.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.756+0000 7fbc093ff640 1 --2- 172.21.15.22:0/1719769347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc041073a0 0x7fbc0419a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:04.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.756+0000 7fbc09c00640 1 -- 172.21.15.22:0/1719769347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc041073a0 msgr2=0x7fbc0419a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:04.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.756+0000 7fbc09c00640 1 --2- 172.21.15.22:0/1719769347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc041073a0 0x7fbc0419a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:04.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.756+0000 7fbc09c00640 1 -- 172.21.15.22:0/1719769347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc04107d20 msgr2=0x7fbc0419a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:04.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.756+0000 7fbc09c00640 1 --2- 172.21.15.22:0/1719769347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc04107d20 0x7fbc0419a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:04.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.756+0000 7fbc09c00640 1 -- 172.21.15.22:0/1719769347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc041a5170 con 0x7fbc04101990 2024-08-20T01:29:04.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.756+0000 7fbc093ff640 1 --2- 172.21.15.22:0/1719769347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc041073a0 0x7fbc0419a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:29:04.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.756+0000 7fbc09c00640 1 --2- 172.21.15.22:0/1719769347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc04101990 0x7fbc04199d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000d950 tx=0x7fbc0000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:04.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.756+0000 7fbbfaffd640 1 -- 172.21.15.22:0/1719769347 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc00017030 con 0x7fbc04101990 2024-08-20T01:29:04.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.756+0000 7fbc0be64640 1 -- 172.21.15.22:0/1719769347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc041a5460 con 0x7fbc04101990 2024-08-20T01:29:04.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.756+0000 7fbbfaffd640 1 -- 172.21.15.22:0/1719769347 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc00004020 con 0x7fbc04101990 2024-08-20T01:29:04.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.756+0000 7fbbfaffd640 1 -- 172.21.15.22:0/1719769347 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc000047a0 con 0x7fbc04101990 2024-08-20T01:29:04.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.756+0000 7fbc0be64640 1 -- 172.21.15.22:0/1719769347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc041a59a0 con 0x7fbc04101990 2024-08-20T01:29:04.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.757+0000 7fbc0be64640 1 -- 172.21.15.22:0/1719769347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc04101d70 con 0x7fbc04101990 2024-08-20T01:29:04.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.759+0000 7fbbfaffd640 1 -- 172.21.15.22:0/1719769347 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fbc00009a30 con 0x7fbc04101990 2024-08-20T01:29:04.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.760+0000 7fbbfaffd640 1 --2- 172.21.15.22:0/1719769347 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbbf00b3bd0 0x7fbbf00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:04.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.760+0000 7fbc093ff640 1 --2- 172.21.15.22:0/1719769347 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbbf00b3bd0 0x7fbbf00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:04.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.760+0000 7fbbfaffd640 1 -- 172.21.15.22:0/1719769347 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7497+0+0 (secure 0 0 0) 0x7fbc000e3aa0 con 0x7fbc04101990 2024-08-20T01:29:04.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.760+0000 7fbc093ff640 1 --2- 172.21.15.22:0/1719769347 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbbf00b3bd0 0x7fbbf00b6090 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbc0406b3b0 tx=0x7fbbf4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:04.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.763+0000 7fbbfaffd640 1 -- 172.21.15.22:0/1719769347 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fbc000ab380 con 0x7fbc04101990 2024-08-20T01:29:04.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:04 smithi077 ceph-mon[22251]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:29:04.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:04 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3694907648' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-20T01:29:04.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:04 smithi077 ceph-mon[22251]: osdmap e71: 12 total, 12 up, 12 in 2024-08-20T01:29:04.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:04.947+0000 7fbc0be64640 1 -- 172.21.15.22:0/1719769347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbc0406abc0 con 0x7fbc04101990 2024-08-20T01:29:05.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:05.395+0000 7fbbfaffd640 1 -- 172.21.15.22:0/1719769347 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7fbc000aac80 con 0x7fbc04101990 2024-08-20T01:29:05.396 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2024-08-20T01:29:05.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:05.397+0000 7fbc0be64640 1 -- 172.21.15.22:0/1719769347 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbbf00b3bd0 msgr2=0x7fbbf00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:05.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:05.397+0000 7fbc0be64640 1 --2- 172.21.15.22:0/1719769347 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbbf00b3bd0 0x7fbbf00b6090 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbc0406b3b0 tx=0x7fbbf4005f90 comp rx=0 tx=0).stop 2024-08-20T01:29:05.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:05.397+0000 7fbc0be64640 1 -- 172.21.15.22:0/1719769347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc04101990 msgr2=0x7fbc04199d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:05.397+0000 7fbc0be64640 1 --2- 172.21.15.22:0/1719769347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc04101990 0x7fbc04199d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000d950 tx=0x7fbc0000de10 comp rx=0 tx=0).stop 2024-08-20T01:29:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:05.397+0000 7fbc0be64640 1 -- 172.21.15.22:0/1719769347 shutdown_connections 2024-08-20T01:29:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:05.397+0000 7fbc0be64640 1 --2- 172.21.15.22:0/1719769347 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbbf00b3bd0 0x7fbbf00b6090 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:05.397+0000 7fbc0be64640 1 --2- 172.21.15.22:0/1719769347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc04107d20 0x7fbc0419a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:05.397+0000 7fbc0be64640 1 --2- 172.21.15.22:0/1719769347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc041073a0 0x7fbc0419a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:05.397+0000 7fbc0be64640 1 --2- 172.21.15.22:0/1719769347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc04101990 0x7fbc04199d90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:05.397+0000 7fbc0be64640 1 -- 172.21.15.22:0/1719769347 >> 172.21.15.22:0/1719769347 conn(0x7fbc040fd400 msgr2=0x7fbc040fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:05.398+0000 7fbc0be64640 1 -- 172.21.15.22:0/1719769347 shutdown_connections 2024-08-20T01:29:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:05.398+0000 7fbc0be64640 1 -- 172.21.15.22:0/1719769347 wait complete. 2024-08-20T01:29:05.719 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:05 smithi022 ceph-mon[18709]: osdmap e72: 12 total, 12 up, 12 in 2024-08-20T01:29:05.719 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:05 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1719769347' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-20T01:29:05.720 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:05 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1719769347' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-20T01:29:05.720 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:05 smithi022 ceph-mon[18709]: osdmap e73: 12 total, 12 up, 12 in 2024-08-20T01:29:05.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:05 smithi134 ceph-mon[22511]: osdmap e72: 12 total, 12 up, 12 in 2024-08-20T01:29:05.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:05 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1719769347' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-20T01:29:05.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:05 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1719769347' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-20T01:29:05.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:05 smithi134 ceph-mon[22511]: osdmap e73: 12 total, 12 up, 12 in 2024-08-20T01:29:05.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:05 smithi077 ceph-mon[22251]: osdmap e72: 12 total, 12 up, 12 in 2024-08-20T01:29:05.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:05 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1719769347' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-20T01:29:05.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:05 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1719769347' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-20T01:29:05.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:05 smithi077 ceph-mon[22251]: osdmap e73: 12 total, 12 up, 12 in 2024-08-20T01:29:06.037 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-20T01:29:06.299 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:06.683 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:06 smithi022 ceph-mon[18709]: pgmap v278: 33 pgs: 1 creating+activating, 2 creating+peering, 22 unknown, 8 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:29:06.683 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:06 smithi022 ceph-mon[18709]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-20T01:29:06.683 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:06 smithi022 ceph-mon[18709]: osdmap e74: 12 total, 12 up, 12 in 2024-08-20T01:29:06.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:06 smithi134 ceph-mon[22511]: pgmap v278: 33 pgs: 1 creating+activating, 2 creating+peering, 22 unknown, 8 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:29:06.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:06 smithi134 ceph-mon[22511]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-20T01:29:06.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:06 smithi134 ceph-mon[22511]: osdmap e74: 12 total, 12 up, 12 in 2024-08-20T01:29:06.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.766+0000 7f33f91d0640 1 -- 172.21.15.22:0/226923693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33f41073d0 msgr2=0x7f33f4107810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:06.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.766+0000 7f33f91d0640 1 --2- 172.21.15.22:0/226923693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33f41073d0 0x7f33f4107810 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009900 tx=0x7f33e802a410 comp rx=0 tx=0).stop 2024-08-20T01:29:06.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.766+0000 7f33f91d0640 1 -- 172.21.15.22:0/226923693 shutdown_connections 2024-08-20T01:29:06.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.766+0000 7f33f91d0640 1 --2- 172.21.15.22:0/226923693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33f4107d50 0x7f33f410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:06.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.766+0000 7f33f91d0640 1 --2- 172.21.15.22:0/226923693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33f41073d0 0x7f33f4107810 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:06.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.766+0000 7f33f91d0640 1 --2- 172.21.15.22:0/226923693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33f41019c0 0x7f33f4101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:06.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.766+0000 7f33f91d0640 1 -- 172.21.15.22:0/226923693 >> 172.21.15.22:0/226923693 conn(0x7f33f40fd430 msgr2=0x7f33f40ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:06.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.766+0000 7f33f91d0640 1 -- 172.21.15.22:0/226923693 shutdown_connections 2024-08-20T01:29:06.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.766+0000 7f33f91d0640 1 -- 172.21.15.22:0/226923693 wait complete. 2024-08-20T01:29:06.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.767+0000 7f33f91d0640 1 Processor -- start 2024-08-20T01:29:06.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.767+0000 7f33f91d0640 1 -- start start 2024-08-20T01:29:06.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33f91d0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33f41019c0 0x7f33f4198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:06.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33f91d0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33f41073d0 0x7f33f41994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:06.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33f91d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33f4107d50 0x7f33f419e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:06.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33f91d0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f33f4112b30 con 0x7f33f41073d0 2024-08-20T01:29:06.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33f91d0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f33f41129b0 con 0x7f33f4107d50 2024-08-20T01:29:06.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33f91d0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f33f4112cb0 con 0x7f33f41019c0 2024-08-20T01:29:06.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33f259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33f41073d0 0x7f33f41994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:06.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33f259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33f41073d0 0x7f33f41994e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57810/0 (socket says 172.21.15.22:57810) 2024-08-20T01:29:06.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33f259c640 1 -- 172.21.15.22:0/1351454150 learned_addr learned my addr 172.21.15.22:0/1351454150 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:06.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33f359e640 1 --2- 172.21.15.22:0/1351454150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33f4107d50 0x7f33f419e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:06.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33f2d9d640 1 --2- 172.21.15.22:0/1351454150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33f41019c0 0x7f33f4198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:06.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33f259c640 1 -- 172.21.15.22:0/1351454150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33f41019c0 msgr2=0x7f33f4198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:06.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33f259c640 1 --2- 172.21.15.22:0/1351454150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33f41019c0 0x7f33f4198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:06.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33f259c640 1 -- 172.21.15.22:0/1351454150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33f4107d50 msgr2=0x7f33f419e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:06.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33f259c640 1 --2- 172.21.15.22:0/1351454150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33f4107d50 0x7f33f419e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:06.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33f259c640 1 -- 172.21.15.22:0/1351454150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f419f050 con 0x7f33f41073d0 2024-08-20T01:29:06.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33f259c640 1 --2- 172.21.15.22:0/1351454150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33f41073d0 0x7f33f41994e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f33e8005940 tx=0x7f33e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:06.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33dbfff640 1 -- 172.21.15.22:0/1351454150 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e803f030 con 0x7f33f41073d0 2024-08-20T01:29:06.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33dbfff640 1 -- 172.21.15.22:0/1351454150 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33e8003cb0 con 0x7f33f41073d0 2024-08-20T01:29:06.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33f91d0640 1 -- 172.21.15.22:0/1351454150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f419f2e0 con 0x7f33f41073d0 2024-08-20T01:29:06.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.768+0000 7f33dbfff640 1 -- 172.21.15.22:0/1351454150 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e8035070 con 0x7f33f41073d0 2024-08-20T01:29:06.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.769+0000 7f33f91d0640 1 -- 172.21.15.22:0/1351454150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f41a5a00 con 0x7f33f41073d0 2024-08-20T01:29:06.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.769+0000 7f33f91d0640 1 -- 172.21.15.22:0/1351454150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33f4101da0 con 0x7f33f41073d0 2024-08-20T01:29:06.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.771+0000 7f33dbfff640 1 -- 172.21.15.22:0/1351454150 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f33e8042030 con 0x7f33f41073d0 2024-08-20T01:29:06.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.772+0000 7f33dbfff640 1 --2- 172.21.15.22:0/1351454150 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f33dc0b3bd0 0x7f33dc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:06.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.772+0000 7f33f2d9d640 1 --2- 172.21.15.22:0/1351454150 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f33dc0b3bd0 0x7f33dc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:06.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.772+0000 7f33dbfff640 1 -- 172.21.15.22:0/1351454150 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7879+0+0 (secure 0 0 0) 0x7f33e81045b0 con 0x7f33f41073d0 2024-08-20T01:29:06.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.772+0000 7f33f2d9d640 1 --2- 172.21.15.22:0/1351454150 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f33dc0b3bd0 0x7f33dc0b6090 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f33e4005fd0 tx=0x7f33e400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:06.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:06.775+0000 7f33dbfff640 1 -- 172.21.15.22:0/1351454150 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f33e80cb6c0 con 0x7f33f41073d0 2024-08-20T01:29:06.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:06 smithi077 ceph-mon[22251]: pgmap v278: 33 pgs: 1 creating+activating, 2 creating+peering, 22 unknown, 8 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:29:06.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:06 smithi077 ceph-mon[22251]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-20T01:29:06.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:06 smithi077 ceph-mon[22251]: osdmap e74: 12 total, 12 up, 12 in 2024-08-20T01:29:07.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:07.001+0000 7f33f91d0640 1 -- 172.21.15.22:0/1351454150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f33f419a0d0 con 0x7f33f41073d0 2024-08-20T01:29:07.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:07.425+0000 7f33dbfff640 1 -- 172.21.15.22:0/1351454150 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f33f419a0d0 con 0x7f33f41073d0 2024-08-20T01:29:07.426 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 2 and data pool 3 2024-08-20T01:29:07.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:07.428+0000 7f33f91d0640 1 -- 172.21.15.22:0/1351454150 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f33dc0b3bd0 msgr2=0x7f33dc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:07.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:07.428+0000 7f33f91d0640 1 --2- 172.21.15.22:0/1351454150 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f33dc0b3bd0 0x7f33dc0b6090 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f33e4005fd0 tx=0x7f33e400b390 comp rx=0 tx=0).stop 2024-08-20T01:29:07.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:07.428+0000 7f33f91d0640 1 -- 172.21.15.22:0/1351454150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33f41073d0 msgr2=0x7f33f41994e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:07.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:07.428+0000 7f33f91d0640 1 --2- 172.21.15.22:0/1351454150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33f41073d0 0x7f33f41994e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f33e8005940 tx=0x7f33e80042f0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:07.428+0000 7f33f91d0640 1 -- 172.21.15.22:0/1351454150 shutdown_connections 2024-08-20T01:29:07.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:07.428+0000 7f33f91d0640 1 --2- 172.21.15.22:0/1351454150 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f33dc0b3bd0 0x7f33dc0b6090 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:07.428+0000 7f33f91d0640 1 --2- 172.21.15.22:0/1351454150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33f4107d50 0x7f33f419e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:07.428+0000 7f33f91d0640 1 --2- 172.21.15.22:0/1351454150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33f41073d0 0x7f33f41994e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:07.428+0000 7f33f91d0640 1 --2- 172.21.15.22:0/1351454150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33f41019c0 0x7f33f4198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:07.428+0000 7f33f91d0640 1 -- 172.21.15.22:0/1351454150 >> 172.21.15.22:0/1351454150 conn(0x7f33f40fd430 msgr2=0x7f33f40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:07.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:07.428+0000 7f33f91d0640 1 -- 172.21.15.22:0/1351454150 shutdown_connections 2024-08-20T01:29:07.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:07.428+0000 7f33f91d0640 1 -- 172.21.15.22:0/1351454150 wait complete. 2024-08-20T01:29:07.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:07 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1351454150' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-20T01:29:07.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:07 smithi022 ceph-mon[18709]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-08-20T01:29:07.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:07 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1351454150' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-20T01:29:07.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:07 smithi134 ceph-mon[22511]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-08-20T01:29:07.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:07 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1351454150' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-20T01:29:07.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:07 smithi077 ceph-mon[22251]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-08-20T01:29:08.058 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:29:08.322 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:08.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:08 smithi022 ceph-mon[18709]: pgmap v281: 97 pgs: 1 creating+activating, 30 creating+peering, 37 unknown, 29 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:29:08.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:08 smithi022 ceph-mon[18709]: osdmap e75: 12 total, 12 up, 12 in 2024-08-20T01:29:08.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:08 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1351454150' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-20T01:29:08.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:08 smithi022 ceph-mon[18709]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-08-20T01:29:08.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:08 smithi022 ceph-mon[18709]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-08-20T01:29:08.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:08 smithi134 ceph-mon[22511]: pgmap v281: 97 pgs: 1 creating+activating, 30 creating+peering, 37 unknown, 29 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:29:08.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:08 smithi134 ceph-mon[22511]: osdmap e75: 12 total, 12 up, 12 in 2024-08-20T01:29:08.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:08 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1351454150' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-20T01:29:08.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:08 smithi134 ceph-mon[22511]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-08-20T01:29:08.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:08 smithi134 ceph-mon[22511]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-08-20T01:29:08.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.748+0000 7f9e2334b640 1 -- 172.21.15.22:0/3483708748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e1c101990 msgr2=0x7f9e1c101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:08.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.748+0000 7f9e2334b640 1 --2- 172.21.15.22:0/3483708748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e1c101990 0x7f9e1c101d70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009900 tx=0x7f9e1802a410 comp rx=0 tx=0).stop 2024-08-20T01:29:08.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.748+0000 7f9e2334b640 1 -- 172.21.15.22:0/3483708748 shutdown_connections 2024-08-20T01:29:08.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.748+0000 7f9e2334b640 1 --2- 172.21.15.22:0/3483708748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e1c107d20 0x7f9e1c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:08.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.748+0000 7f9e2334b640 1 --2- 172.21.15.22:0/3483708748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e1c1073a0 0x7f9e1c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:08.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.748+0000 7f9e2334b640 1 --2- 172.21.15.22:0/3483708748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e1c101990 0x7f9e1c101d70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:08.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.748+0000 7f9e2334b640 1 -- 172.21.15.22:0/3483708748 >> 172.21.15.22:0/3483708748 conn(0x7f9e1c0fd400 msgr2=0x7f9e1c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:08.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.748+0000 7f9e2334b640 1 -- 172.21.15.22:0/3483708748 shutdown_connections 2024-08-20T01:29:08.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.748+0000 7f9e2334b640 1 -- 172.21.15.22:0/3483708748 wait complete. 2024-08-20T01:29:08.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.749+0000 7f9e2334b640 1 Processor -- start 2024-08-20T01:29:08.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.749+0000 7f9e2334b640 1 -- start start 2024-08-20T01:29:08.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.749+0000 7f9e2334b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e1c101990 0x7f9e1c199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:08.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.749+0000 7f9e2334b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e1c1073a0 0x7f9e1c19a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:08.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.749+0000 7f9e2334b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e1c107d20 0x7f9e1c19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:08.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.749+0000 7f9e2334b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1c1119e0 con 0x7f9e1c107d20 2024-08-20T01:29:08.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.749+0000 7f9e2334b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1c111860 con 0x7f9e1c1073a0 2024-08-20T01:29:08.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.749+0000 7f9e2334b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1c111b60 con 0x7f9e1c101990 2024-08-20T01:29:08.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.749+0000 7f9e218e8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e1c107d20 0x7f9e1c19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:08.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.749+0000 7f9e218e8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e1c107d20 0x7f9e1c19a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57838/0 (socket says 172.21.15.22:57838) 2024-08-20T01:29:08.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.749+0000 7f9e218e8640 1 -- 172.21.15.22:0/3504942391 learned_addr learned my addr 172.21.15.22:0/3504942391 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:08.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.749+0000 7f9e210e7640 1 --2- 172.21.15.22:0/3504942391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e1c101990 0x7f9e1c199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:08.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.749+0000 7f9e208e6640 1 --2- 172.21.15.22:0/3504942391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e1c1073a0 0x7f9e1c19a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:08.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.749+0000 7f9e218e8640 1 -- 172.21.15.22:0/3504942391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e1c101990 msgr2=0x7f9e1c199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:08.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.749+0000 7f9e218e8640 1 --2- 172.21.15.22:0/3504942391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e1c101990 0x7f9e1c199db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:08.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.749+0000 7f9e218e8640 1 -- 172.21.15.22:0/3504942391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e1c1073a0 msgr2=0x7f9e1c19a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:08.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.749+0000 7f9e218e8640 1 --2- 172.21.15.22:0/3504942391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e1c1073a0 0x7f9e1c19a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:08.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.749+0000 7f9e218e8640 1 -- 172.21.15.22:0/3504942391 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e1c1a51b0 con 0x7f9e1c107d20 2024-08-20T01:29:08.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.750+0000 7f9e218e8640 1 --2- 172.21.15.22:0/3504942391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e1c107d20 0x7f9e1c19a870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9e1400eb10 tx=0x7f9e1400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:08.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.750+0000 7f9e127fc640 1 -- 172.21.15.22:0/3504942391 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e14004b20 con 0x7f9e1c107d20 2024-08-20T01:29:08.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.750+0000 7f9e127fc640 1 -- 172.21.15.22:0/3504942391 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e14004cc0 con 0x7f9e1c107d20 2024-08-20T01:29:08.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.750+0000 7f9e2334b640 1 -- 172.21.15.22:0/3504942391 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e1c1a54a0 con 0x7f9e1c107d20 2024-08-20T01:29:08.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.750+0000 7f9e127fc640 1 -- 172.21.15.22:0/3504942391 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e14010670 con 0x7f9e1c107d20 2024-08-20T01:29:08.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.750+0000 7f9e2334b640 1 -- 172.21.15.22:0/3504942391 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e1c1a5990 con 0x7f9e1c107d20 2024-08-20T01:29:08.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.751+0000 7f9e2334b640 1 -- 172.21.15.22:0/3504942391 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e1c101d70 con 0x7f9e1c107d20 2024-08-20T01:29:08.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.752+0000 7f9e127fc640 1 -- 172.21.15.22:0/3504942391 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f9e14005000 con 0x7f9e1c107d20 2024-08-20T01:29:08.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.753+0000 7f9e127fc640 1 --2- 172.21.15.22:0/3504942391 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9e080b3bd0 0x7f9e080b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:08.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.753+0000 7f9e210e7640 1 --2- 172.21.15.22:0/3504942391 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9e080b3bd0 0x7f9e080b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:08.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.754+0000 7f9e127fc640 1 -- 172.21.15.22:0/3504942391 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f9e140e43c0 con 0x7f9e1c107d20 2024-08-20T01:29:08.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.754+0000 7f9e210e7640 1 --2- 172.21.15.22:0/3504942391 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9e080b3bd0 0x7f9e080b6090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9e18031440 tx=0x7f9e180095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:08.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.757+0000 7f9e127fc640 1 -- 172.21.15.22:0/3504942391 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f9e14055e20 con 0x7f9e1c107d20 2024-08-20T01:29:08.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:08 smithi077 ceph-mon[22251]: pgmap v281: 97 pgs: 1 creating+activating, 30 creating+peering, 37 unknown, 29 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:29:08.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:08 smithi077 ceph-mon[22251]: osdmap e75: 12 total, 12 up, 12 in 2024-08-20T01:29:08.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:08 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1351454150' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-20T01:29:08.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:08 smithi077 ceph-mon[22251]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-08-20T01:29:08.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:08 smithi077 ceph-mon[22251]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-08-20T01:29:08.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.945+0000 7f9e2334b640 1 -- 172.21.15.22:0/3504942391 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e1c06abe0 con 0x7f9e1c107d20 2024-08-20T01:29:08.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.946+0000 7f9e127fc640 1 -- 172.21.15.22:0/3504942391 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22230 (secure 0 0 0) 0x7f9e140abb40 con 0x7f9e1c107d20 2024-08-20T01:29:08.947 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:29:08.947 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":75,"fsid":"586fd06c-5e92-11ef-bccf-c7b262605968","created":"2024-08-20T01:20:55.065729+0000","modified":"2024-08-20T01:29:07.003098+0000","last_up_change":"2024-08-20T01:28:14.752931+0000","last_in_change":"2024-08-20T01:27:51.812525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:24:31.674035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:29:02.800545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:29:04.951975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b67a59af-5eea-4073-a4b2-604a1b7b8f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6803","nonce":812056903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6805","nonce":812056903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6809","nonce":812056903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6807","nonce":812056903}]},"public_addr":"172.21.15.22:6803/812056903","cluster_addr":"172.21.15.22:6805/812056903","heartbeat_back_addr":"172.21.15.22:6809/812056903","heartbeat_front_addr":"172.21.15.22:6807/812056903","state":["exists","up"]},{"osd":1,"uuid":"9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6801","nonce":823882511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6803","nonce":823882511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6807","nonce":823882511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6805","nonce":823882511}]},"public_addr":"172.21.15.77:6801/823882511","cluster_addr":"172.21.15.77:6803/823882511","heartbeat_back_addr":"172.21.15.77:6807/823882511","heartbeat_front_addr":"172.21.15.77:6805/823882511","state":["exists","up"]},{"osd":2,"uuid":"71e3c019-a3e0-4632-81a8-27ac31279f7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6801","nonce":3873702897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6803","nonce":3873702897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6807","nonce":3873702897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6805","nonce":3873702897}]},"public_addr":"172.21.15.134:6801/3873702897","cluster_addr":"172.21.15.134:6803/3873702897","heartbeat_back_addr":"172.21.15.134:6807/3873702897","heartbeat_front_addr":"172.21.15.134:6805/3873702897","state":["exists","up"]},{"osd":3,"uuid":"a60de748-aa65-477d-864e-6281db1261ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6811","nonce":1775946906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6813","nonce":1775946906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6817","nonce":1775946906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6815","nonce":1775946906}]},"public_addr":"172.21.15.22:6811/1775946906","cluster_addr":"172.21.15.22:6813/1775946906","heartbeat_back_addr":"172.21.15.22:6817/1775946906","heartbeat_front_addr":"172.21.15.22:6815/1775946906","state":["exists","up"]},{"osd":4,"uuid":"07d99671-2ece-471c-ad69-fc9043d917f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6809","nonce":1954209322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6811","nonce":1954209322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6815","nonce":1954209322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6813","nonce":1954209322}]},"public_addr":"172.21.15.77:6809/1954209322","cluster_addr":"172.21.15.77:6811/1954209322","heartbeat_back_addr":"172.21.15.77:6815/1954209322","heartbeat_front_addr":"172.21.15.77:6813/1954209322","state":["exists","up"]},{"osd":5,"uuid":"971cac33-0b98-49b1-b4b2-27354fc0ab90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6809","nonce":2805488123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6811","nonce":2805488123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6815","nonce":2805488123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6813","nonce":2805488123}]},"public_addr":"172.21.15.134:6809/2805488123","cluster_addr":"172.21.15.134:6811/2805488123","heartbeat_back_addr":"172.21.15.134:6815/2805488123","heartbeat_front_addr":"172.21.15.134:6813/2805488123","state":["exists","up"]},{"osd":6,"uuid":"48d90292-8511-47d6-8093-330bd13ae70e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6819","nonce":3804882416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6821","nonce":3804882416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6825","nonce":3804882416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6823","nonce":3804882416}]},"public_addr":"172.21.15.22:6819/3804882416","cluster_addr":"172.21.15.22:6821/3804882416","heartbeat_back_addr":"172.21.15.22:6825/3804882416","heartbeat_front_addr":"172.21.15.22:6823/3804882416","state":["exists","up"]},{"osd":7,"uuid":"e217112d-9f56-4a48-93bf-6eb052ce540a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6817","nonce":700318902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6819","nonce":700318902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6823","nonce":700318902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6821","nonce":700318902}]},"public_addr":"172.21.15.77:6817/700318902","cluster_addr":"172.21.15.77:6819/700318902","heartbeat_back_addr":"172.21.15.77:6823/700318902","heartbeat_front_addr":"172.21.15.77:6821/700318902","state":["exists","up"]},{"osd":8,"uuid":"1786747c-6ff6-4e00-bcf6-a8176215847f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6817","nonce":1635473481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6819","nonce":1635473481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6823","nonce":1635473481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6821","nonce":1635473481}]},"public_addr":"172.21.15.134:6817/1635473481","cluster_addr":"172.21.15.134:6819/1635473481","heartbeat_back_addr":"172.21.15.134:6823/1635473481","heartbeat_front_addr":"172.21.15.134:6821/1635473481","state":["exists","up"]},{"osd":9,"uuid":"708f7390-1b51-4397-a92a-8ff3f4a5bc45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6827","nonce":3899297933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6829","nonce":3899297933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6833","nonce":3899297933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6831","nonce":3899297933}]},"public_addr":"172.21.15.22:6827/3899297933","cluster_addr":"172.21.15.22:6829/3899297933","heartbeat_back_addr":"172.21.15.22:6833/3899297933","heartbeat_front_addr":"172.21.15.22:6831/3899297933","state":["exists","up"]},{"osd":10,"uuid":"d15b0acd-dd08-431d-88aa-756b6420987d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6825","nonce":2765589872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6827","nonce":2765589872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6831","nonce":2765589872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6829","nonce":2765589872}]},"public_addr":"172.21.15.77:6825/2765589872","cluster_addr":"172.21.15.77:6827/2765589872","heartbeat_back_addr":"172.21.15.77:6831/2765589872","heartbeat_front_addr":"172.21.15.77:6829/2765589872","state":["exists","up"]},{"osd":11,"uuid":"d15017fa-3c3d-4096-a35d-275cd54bb9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6825","nonce":964533669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6827","nonce":964533669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6831","nonce":964533669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6829","nonce":964533669}]},"public_addr":"172.21.15.134:6825/964533669","cluster_addr":"172.21.15.134:6827/964533669","heartbeat_back_addr":"172.21.15.134:6831/964533669","heartbeat_front_addr":"172.21.15.134:6829/964533669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:23:40.839725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:05.141389+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:28.340737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:52.028949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:17.029913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:42.092826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:07.831100+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:33.380447+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:58.772655+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:23.017208+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:47.966711+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:28:13.123047+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/416470260":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6800/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/1142422661":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:6800/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/2093308719":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/3772866379":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3424402756":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3864772624":"2024-08-21T01:21:28.981981+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:29:08.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.948+0000 7f9e2334b640 1 -- 172.21.15.22:0/3504942391 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9e080b3bd0 msgr2=0x7f9e080b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:08.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.948+0000 7f9e2334b640 1 --2- 172.21.15.22:0/3504942391 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9e080b3bd0 0x7f9e080b6090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9e18031440 tx=0x7f9e180095f0 comp rx=0 tx=0).stop 2024-08-20T01:29:08.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.948+0000 7f9e2334b640 1 -- 172.21.15.22:0/3504942391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e1c107d20 msgr2=0x7f9e1c19a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:08.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.948+0000 7f9e2334b640 1 --2- 172.21.15.22:0/3504942391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e1c107d20 0x7f9e1c19a870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9e1400eb10 tx=0x7f9e1400c2d0 comp rx=0 tx=0).stop 2024-08-20T01:29:08.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.949+0000 7f9e2334b640 1 -- 172.21.15.22:0/3504942391 shutdown_connections 2024-08-20T01:29:08.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.949+0000 7f9e2334b640 1 --2- 172.21.15.22:0/3504942391 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9e080b3bd0 0x7f9e080b6090 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:08.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.949+0000 7f9e2334b640 1 --2- 172.21.15.22:0/3504942391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e1c107d20 0x7f9e1c19a870 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:08.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.949+0000 7f9e2334b640 1 --2- 172.21.15.22:0/3504942391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e1c1073a0 0x7f9e1c19a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:08.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.949+0000 7f9e2334b640 1 --2- 172.21.15.22:0/3504942391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e1c101990 0x7f9e1c199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:08.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.949+0000 7f9e2334b640 1 -- 172.21.15.22:0/3504942391 >> 172.21.15.22:0/3504942391 conn(0x7f9e1c0fd400 msgr2=0x7f9e1c0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:08.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.949+0000 7f9e2334b640 1 -- 172.21.15.22:0/3504942391 shutdown_connections 2024-08-20T01:29:08.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:08.949+0000 7f9e2334b640 1 -- 172.21.15.22:0/3504942391 wait complete. 2024-08-20T01:29:09.547 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:09 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] up:active 2024-08-20T01:29:09.547 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:09 smithi022 ceph-mon[18709]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-20T01:29:09.547 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:09 smithi022 ceph-mon[18709]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-20T01:29:09.548 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:09 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3504942391' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:29:09.578 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:29:09.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:09 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] up:active 2024-08-20T01:29:09.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:09 smithi134 ceph-mon[22511]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-20T01:29:09.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:09 smithi134 ceph-mon[22511]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-20T01:29:09.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:09 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3504942391' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:29:09.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:09 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] up:active 2024-08-20T01:29:09.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:09 smithi077 ceph-mon[22251]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-20T01:29:09.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:09 smithi077 ceph-mon[22251]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-20T01:29:09.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:09 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3504942391' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:29:09.836 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:10.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.290+0000 7fc2f05a2640 1 -- 172.21.15.22:0/2724780975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2e81084e0 msgr2=0x7fc2e8108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.290+0000 7fc2f05a2640 1 --2- 172.21.15.22:0/2724780975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2e81084e0 0x7fc2e8108920 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009900 tx=0x7fc2d802a410 comp rx=0 tx=0).stop 2024-08-20T01:29:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.290+0000 7fc2f05a2640 1 -- 172.21.15.22:0/2724780975 shutdown_connections 2024-08-20T01:29:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.290+0000 7fc2f05a2640 1 --2- 172.21.15.22:0/2724780975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2e8108e60 0x7fc2e810f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.290+0000 7fc2f05a2640 1 --2- 172.21.15.22:0/2724780975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2e81084e0 0x7fc2e8108920 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.290+0000 7fc2f05a2640 1 --2- 172.21.15.22:0/2724780975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e8102ad0 0x7fc2e8102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.290+0000 7fc2f05a2640 1 -- 172.21.15.22:0/2724780975 >> 172.21.15.22:0/2724780975 conn(0x7fc2e80fe540 msgr2=0x7fc2e8100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.290+0000 7fc2f05a2640 1 -- 172.21.15.22:0/2724780975 shutdown_connections 2024-08-20T01:29:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.290+0000 7fc2f05a2640 1 -- 172.21.15.22:0/2724780975 wait complete. 2024-08-20T01:29:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.291+0000 7fc2f05a2640 1 Processor -- start 2024-08-20T01:29:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.291+0000 7fc2f05a2640 1 -- start start 2024-08-20T01:29:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.291+0000 7fc2f05a2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2e8102ad0 0x7fc2e80751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.291+0000 7fc2f05a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2e81084e0 0x7fc2e8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.291+0000 7fc2f05a2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e8108e60 0x7fc2e8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.291+0000 7fc2f05a2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e8112b20 con 0x7fc2e8102ad0 2024-08-20T01:29:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.291+0000 7fc2f05a2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e81129a0 con 0x7fc2e81084e0 2024-08-20T01:29:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.291+0000 7fc2f05a2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e8112ca0 con 0x7fc2e8108e60 2024-08-20T01:29:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.291+0000 7fc2ee33e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2e8102ad0 0x7fc2e80751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.291+0000 7fc2ee33e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2e8102ad0 0x7fc2e80751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43150/0 (socket says 172.21.15.22:43150) 2024-08-20T01:29:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.291+0000 7fc2ee33e640 1 -- 172.21.15.22:0/2082454754 learned_addr learned my addr 172.21.15.22:0/2082454754 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.291+0000 7fc2edb3d640 1 --2- 172.21.15.22:0/2082454754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2e81084e0 0x7fc2e8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:10.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.291+0000 7fc2eeb3f640 1 --2- 172.21.15.22:0/2082454754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e8108e60 0x7fc2e8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:10.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.291+0000 7fc2ee33e640 1 -- 172.21.15.22:0/2082454754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e8108e60 msgr2=0x7fc2e8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:10.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.291+0000 7fc2ee33e640 1 --2- 172.21.15.22:0/2082454754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e8108e60 0x7fc2e8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:10.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.291+0000 7fc2ee33e640 1 -- 172.21.15.22:0/2082454754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2e81084e0 msgr2=0x7fc2e8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:10.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.291+0000 7fc2ee33e640 1 --2- 172.21.15.22:0/2082454754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2e81084e0 0x7fc2e8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:10.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.291+0000 7fc2ee33e640 1 -- 172.21.15.22:0/2082454754 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e81a73f0 con 0x7fc2e8102ad0 2024-08-20T01:29:10.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.291+0000 7fc2eeb3f640 1 --2- 172.21.15.22:0/2082454754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e8108e60 0x7fc2e8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:29:10.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.292+0000 7fc2ee33e640 1 --2- 172.21.15.22:0/2082454754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2e8102ad0 0x7fc2e80751d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400d770 tx=0x7fc2e400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:10.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.292+0000 7fc2df7fe640 1 -- 172.21.15.22:0/2082454754 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4017070 con 0x7fc2e8102ad0 2024-08-20T01:29:10.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.292+0000 7fc2f05a2640 1 -- 172.21.15.22:0/2082454754 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e81a76e0 con 0x7fc2e8102ad0 2024-08-20T01:29:10.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.292+0000 7fc2df7fe640 1 -- 172.21.15.22:0/2082454754 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2e40054d0 con 0x7fc2e8102ad0 2024-08-20T01:29:10.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.292+0000 7fc2df7fe640 1 -- 172.21.15.22:0/2082454754 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4004c30 con 0x7fc2e8102ad0 2024-08-20T01:29:10.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.292+0000 7fc2f05a2640 1 -- 172.21.15.22:0/2082454754 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e81a7bf0 con 0x7fc2e8102ad0 2024-08-20T01:29:10.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.293+0000 7fc2f05a2640 1 -- 172.21.15.22:0/2082454754 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2e8102eb0 con 0x7fc2e8102ad0 2024-08-20T01:29:10.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.294+0000 7fc2df7fe640 1 -- 172.21.15.22:0/2082454754 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fc2e4004dd0 con 0x7fc2e8102ad0 2024-08-20T01:29:10.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.295+0000 7fc2df7fe640 1 --2- 172.21.15.22:0/2082454754 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc2d40b3bd0 0x7fc2d40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:10.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.295+0000 7fc2edb3d640 1 --2- 172.21.15.22:0/2082454754 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc2d40b3bd0 0x7fc2d40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:10.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.295+0000 7fc2df7fe640 1 -- 172.21.15.22:0/2082454754 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fc2e40e3a00 con 0x7fc2e8102ad0 2024-08-20T01:29:10.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.296+0000 7fc2edb3d640 1 --2- 172.21.15.22:0/2082454754 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc2d40b3bd0 0x7fc2d40b6090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8031440 tx=0x7fc2d8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:10.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.298+0000 7fc2df7fe640 1 -- 172.21.15.22:0/2082454754 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fc2e40ab100 con 0x7fc2e8102ad0 2024-08-20T01:29:10.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.485+0000 7fc2f05a2640 1 -- 172.21.15.22:0/2082454754 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2e802e340 con 0x7fc2e8102ad0 2024-08-20T01:29:10.486 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:10 smithi022 ceph-mon[18709]: pgmap v283: 97 pgs: 1 creating+activating, 28 creating+peering, 14 unknown, 54 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:29:10.486 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:10 smithi022 ceph-mon[18709]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-20T01:29:10.486 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:10 smithi022 ceph-mon[18709]: Cluster is now healthy 2024-08-20T01:29:10.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.486+0000 7fc2df7fe640 1 -- 172.21.15.22:0/2082454754 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22230 (secure 0 0 0) 0x7fc2e40aaa00 con 0x7fc2e8102ad0 2024-08-20T01:29:10.487 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:29:10.487 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":75,"fsid":"586fd06c-5e92-11ef-bccf-c7b262605968","created":"2024-08-20T01:20:55.065729+0000","modified":"2024-08-20T01:29:07.003098+0000","last_up_change":"2024-08-20T01:28:14.752931+0000","last_in_change":"2024-08-20T01:27:51.812525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:24:31.674035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:29:02.800545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:29:04.951975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b67a59af-5eea-4073-a4b2-604a1b7b8f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6803","nonce":812056903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6805","nonce":812056903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6809","nonce":812056903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6807","nonce":812056903}]},"public_addr":"172.21.15.22:6803/812056903","cluster_addr":"172.21.15.22:6805/812056903","heartbeat_back_addr":"172.21.15.22:6809/812056903","heartbeat_front_addr":"172.21.15.22:6807/812056903","state":["exists","up"]},{"osd":1,"uuid":"9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6801","nonce":823882511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6803","nonce":823882511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6807","nonce":823882511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6805","nonce":823882511}]},"public_addr":"172.21.15.77:6801/823882511","cluster_addr":"172.21.15.77:6803/823882511","heartbeat_back_addr":"172.21.15.77:6807/823882511","heartbeat_front_addr":"172.21.15.77:6805/823882511","state":["exists","up"]},{"osd":2,"uuid":"71e3c019-a3e0-4632-81a8-27ac31279f7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6801","nonce":3873702897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6803","nonce":3873702897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6807","nonce":3873702897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6805","nonce":3873702897}]},"public_addr":"172.21.15.134:6801/3873702897","cluster_addr":"172.21.15.134:6803/3873702897","heartbeat_back_addr":"172.21.15.134:6807/3873702897","heartbeat_front_addr":"172.21.15.134:6805/3873702897","state":["exists","up"]},{"osd":3,"uuid":"a60de748-aa65-477d-864e-6281db1261ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6811","nonce":1775946906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6813","nonce":1775946906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6817","nonce":1775946906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6815","nonce":1775946906}]},"public_addr":"172.21.15.22:6811/1775946906","cluster_addr":"172.21.15.22:6813/1775946906","heartbeat_back_addr":"172.21.15.22:6817/1775946906","heartbeat_front_addr":"172.21.15.22:6815/1775946906","state":["exists","up"]},{"osd":4,"uuid":"07d99671-2ece-471c-ad69-fc9043d917f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6809","nonce":1954209322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6811","nonce":1954209322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6815","nonce":1954209322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6813","nonce":1954209322}]},"public_addr":"172.21.15.77:6809/1954209322","cluster_addr":"172.21.15.77:6811/1954209322","heartbeat_back_addr":"172.21.15.77:6815/1954209322","heartbeat_front_addr":"172.21.15.77:6813/1954209322","state":["exists","up"]},{"osd":5,"uuid":"971cac33-0b98-49b1-b4b2-27354fc0ab90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6809","nonce":2805488123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6811","nonce":2805488123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6815","nonce":2805488123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6813","nonce":2805488123}]},"public_addr":"172.21.15.134:6809/2805488123","cluster_addr":"172.21.15.134:6811/2805488123","heartbeat_back_addr":"172.21.15.134:6815/2805488123","heartbeat_front_addr":"172.21.15.134:6813/2805488123","state":["exists","up"]},{"osd":6,"uuid":"48d90292-8511-47d6-8093-330bd13ae70e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6819","nonce":3804882416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6821","nonce":3804882416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6825","nonce":3804882416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6823","nonce":3804882416}]},"public_addr":"172.21.15.22:6819/3804882416","cluster_addr":"172.21.15.22:6821/3804882416","heartbeat_back_addr":"172.21.15.22:6825/3804882416","heartbeat_front_addr":"172.21.15.22:6823/3804882416","state":["exists","up"]},{"osd":7,"uuid":"e217112d-9f56-4a48-93bf-6eb052ce540a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6817","nonce":700318902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6819","nonce":700318902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6823","nonce":700318902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6821","nonce":700318902}]},"public_addr":"172.21.15.77:6817/700318902","cluster_addr":"172.21.15.77:6819/700318902","heartbeat_back_addr":"172.21.15.77:6823/700318902","heartbeat_front_addr":"172.21.15.77:6821/700318902","state":["exists","up"]},{"osd":8,"uuid":"1786747c-6ff6-4e00-bcf6-a8176215847f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6817","nonce":1635473481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6819","nonce":1635473481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6823","nonce":1635473481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6821","nonce":1635473481}]},"public_addr":"172.21.15.134:6817/1635473481","cluster_addr":"172.21.15.134:6819/1635473481","heartbeat_back_addr":"172.21.15.134:6823/1635473481","heartbeat_front_addr":"172.21.15.134:6821/1635473481","state":["exists","up"]},{"osd":9,"uuid":"708f7390-1b51-4397-a92a-8ff3f4a5bc45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6827","nonce":3899297933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6829","nonce":3899297933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6833","nonce":3899297933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6831","nonce":3899297933}]},"public_addr":"172.21.15.22:6827/3899297933","cluster_addr":"172.21.15.22:6829/3899297933","heartbeat_back_addr":"172.21.15.22:6833/3899297933","heartbeat_front_addr":"172.21.15.22:6831/3899297933","state":["exists","up"]},{"osd":10,"uuid":"d15b0acd-dd08-431d-88aa-756b6420987d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6825","nonce":2765589872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6827","nonce":2765589872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6831","nonce":2765589872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6829","nonce":2765589872}]},"public_addr":"172.21.15.77:6825/2765589872","cluster_addr":"172.21.15.77:6827/2765589872","heartbeat_back_addr":"172.21.15.77:6831/2765589872","heartbeat_front_addr":"172.21.15.77:6829/2765589872","state":["exists","up"]},{"osd":11,"uuid":"d15017fa-3c3d-4096-a35d-275cd54bb9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6825","nonce":964533669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6827","nonce":964533669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6831","nonce":964533669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6829","nonce":964533669}]},"public_addr":"172.21.15.134:6825/964533669","cluster_addr":"172.21.15.134:6827/964533669","heartbeat_back_addr":"172.21.15.134:6831/964533669","heartbeat_front_addr":"172.21.15.134:6829/964533669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:23:40.839725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:05.141389+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:28.340737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:52.028949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:17.029913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:42.092826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:07.831100+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:33.380447+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:58.772655+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:23.017208+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:47.966711+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:28:13.123047+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/416470260":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6800/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/1142422661":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:6800/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/2093308719":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/3772866379":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3424402756":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3864772624":"2024-08-21T01:21:28.981981+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:29:10.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.489+0000 7fc2f05a2640 1 -- 172.21.15.22:0/2082454754 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc2d40b3bd0 msgr2=0x7fc2d40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:10.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.489+0000 7fc2f05a2640 1 --2- 172.21.15.22:0/2082454754 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc2d40b3bd0 0x7fc2d40b6090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8031440 tx=0x7fc2d8005b50 comp rx=0 tx=0).stop 2024-08-20T01:29:10.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.489+0000 7fc2f05a2640 1 -- 172.21.15.22:0/2082454754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2e8102ad0 msgr2=0x7fc2e80751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:10.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.489+0000 7fc2f05a2640 1 --2- 172.21.15.22:0/2082454754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2e8102ad0 0x7fc2e80751d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400d770 tx=0x7fc2e400dc30 comp rx=0 tx=0).stop 2024-08-20T01:29:10.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.489+0000 7fc2f05a2640 1 -- 172.21.15.22:0/2082454754 shutdown_connections 2024-08-20T01:29:10.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.489+0000 7fc2f05a2640 1 --2- 172.21.15.22:0/2082454754 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc2d40b3bd0 0x7fc2d40b6090 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:10.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.489+0000 7fc2f05a2640 1 --2- 172.21.15.22:0/2082454754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e8108e60 0x7fc2e8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:10.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.489+0000 7fc2f05a2640 1 --2- 172.21.15.22:0/2082454754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2e81084e0 0x7fc2e8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:10.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.489+0000 7fc2f05a2640 1 --2- 172.21.15.22:0/2082454754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2e8102ad0 0x7fc2e80751d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:10.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.489+0000 7fc2f05a2640 1 -- 172.21.15.22:0/2082454754 >> 172.21.15.22:0/2082454754 conn(0x7fc2e80fe540 msgr2=0x7fc2e8100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:10.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.489+0000 7fc2f05a2640 1 -- 172.21.15.22:0/2082454754 shutdown_connections 2024-08-20T01:29:10.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:10.489+0000 7fc2f05a2640 1 -- 172.21.15.22:0/2082454754 wait complete. 2024-08-20T01:29:10.684 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:10 smithi134 ceph-mon[22511]: pgmap v283: 97 pgs: 1 creating+activating, 28 creating+peering, 14 unknown, 54 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:29:10.685 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:10 smithi134 ceph-mon[22511]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-20T01:29:10.685 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:10 smithi134 ceph-mon[22511]: Cluster is now healthy 2024-08-20T01:29:10.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:10 smithi077 ceph-mon[22251]: pgmap v283: 97 pgs: 1 creating+activating, 28 creating+peering, 14 unknown, 54 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:29:10.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:10 smithi077 ceph-mon[22251]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-20T01:29:10.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:10 smithi077 ceph-mon[22251]: Cluster is now healthy 2024-08-20T01:29:11.114 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-08-20T01:29:11.375 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:11.735 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:11 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2082454754' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:29:11.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:11 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2082454754' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:29:11.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:11 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2082454754' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:29:11.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.835+0000 7fd71362c640 1 -- 172.21.15.22:0/724905699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c108e40 msgr2=0x7fd70c10f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:11.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.835+0000 7fd71362c640 1 --2- 172.21.15.22:0/724905699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c108e40 0x7fd70c10f640 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd704009ca0 tx=0x7fd70402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:29:11.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.835+0000 7fd71362c640 1 -- 172.21.15.22:0/724905699 shutdown_connections 2024-08-20T01:29:11.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.835+0000 7fd71362c640 1 --2- 172.21.15.22:0/724905699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c108e40 0x7fd70c10f640 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:11.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.835+0000 7fd71362c640 1 --2- 172.21.15.22:0/724905699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd70c1084c0 0x7fd70c108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:11.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.835+0000 7fd71362c640 1 --2- 172.21.15.22:0/724905699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd70c102ab0 0x7fd70c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:11.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.835+0000 7fd71362c640 1 -- 172.21.15.22:0/724905699 >> 172.21.15.22:0/724905699 conn(0x7fd70c0fe500 msgr2=0x7fd70c100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:11.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.835+0000 7fd71362c640 1 -- 172.21.15.22:0/724905699 shutdown_connections 2024-08-20T01:29:11.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.835+0000 7fd71362c640 1 -- 172.21.15.22:0/724905699 wait complete. 2024-08-20T01:29:11.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.836+0000 7fd71362c640 1 Processor -- start 2024-08-20T01:29:11.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.836+0000 7fd71362c640 1 -- start start 2024-08-20T01:29:11.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.836+0000 7fd71362c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c102ab0 0x7fd70c198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:11.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.836+0000 7fd71362c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd70c1084c0 0x7fd70c199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:11.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.836+0000 7fd71362c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd70c108e40 0x7fd70c19e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:11.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.837+0000 7fd71362c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c112b50 con 0x7fd70c102ab0 2024-08-20T01:29:11.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.837+0000 7fd71362c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c1129d0 con 0x7fd70c108e40 2024-08-20T01:29:11.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.837+0000 7fd71362c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c112cd0 con 0x7fd70c1084c0 2024-08-20T01:29:11.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.837+0000 7fd7113c8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c102ab0 0x7fd70c198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:11.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.837+0000 7fd7113c8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c102ab0 0x7fd70c198f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43156/0 (socket says 172.21.15.22:43156) 2024-08-20T01:29:11.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.837+0000 7fd7113c8640 1 -- 172.21.15.22:0/1070102822 learned_addr learned my addr 172.21.15.22:0/1070102822 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:11.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.837+0000 7fd710bc7640 1 --2- 172.21.15.22:0/1070102822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd70c1084c0 0x7fd70c199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:11.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.837+0000 7fd711bc9640 1 --2- 172.21.15.22:0/1070102822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd70c108e40 0x7fd70c19e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:11.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.837+0000 7fd7113c8640 1 -- 172.21.15.22:0/1070102822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd70c1084c0 msgr2=0x7fd70c199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:11.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.837+0000 7fd7113c8640 1 --2- 172.21.15.22:0/1070102822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd70c1084c0 0x7fd70c199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:11.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.837+0000 7fd7113c8640 1 -- 172.21.15.22:0/1070102822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd70c108e40 msgr2=0x7fd70c19e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:11.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.837+0000 7fd7113c8640 1 --2- 172.21.15.22:0/1070102822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd70c108e40 0x7fd70c19e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:11.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.837+0000 7fd7113c8640 1 -- 172.21.15.22:0/1070102822 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70c19efb0 con 0x7fd70c102ab0 2024-08-20T01:29:11.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.837+0000 7fd7113c8640 1 --2- 172.21.15.22:0/1070102822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c102ab0 0x7fd70c198f00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd70800e9f0 tx=0x7fd70800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:11.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.837+0000 7fd7027fc640 1 -- 172.21.15.22:0/1070102822 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70800cd80 con 0x7fd70c102ab0 2024-08-20T01:29:11.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.837+0000 7fd7027fc640 1 -- 172.21.15.22:0/1070102822 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7080108e0 con 0x7fd70c102ab0 2024-08-20T01:29:11.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.837+0000 7fd71362c640 1 -- 172.21.15.22:0/1070102822 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd70c19f2a0 con 0x7fd70c102ab0 2024-08-20T01:29:11.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.837+0000 7fd7027fc640 1 -- 172.21.15.22:0/1070102822 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd708018980 con 0x7fd70c102ab0 2024-08-20T01:29:11.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.837+0000 7fd71362c640 1 -- 172.21.15.22:0/1070102822 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd70c1a5960 con 0x7fd70c102ab0 2024-08-20T01:29:11.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.838+0000 7fd71362c640 1 -- 172.21.15.22:0/1070102822 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd70c102e90 con 0x7fd70c102ab0 2024-08-20T01:29:11.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.840+0000 7fd7027fc640 1 -- 172.21.15.22:0/1070102822 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fd708010430 con 0x7fd70c102ab0 2024-08-20T01:29:11.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.840+0000 7fd7027fc640 1 --2- 172.21.15.22:0/1070102822 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd6f80b3bd0 0x7fd6f80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:11.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.840+0000 7fd710bc7640 1 --2- 172.21.15.22:0/1070102822 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd6f80b3bd0 0x7fd6f80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:11.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.841+0000 7fd7027fc640 1 -- 172.21.15.22:0/1070102822 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fd7080e4330 con 0x7fd70c102ab0 2024-08-20T01:29:11.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.841+0000 7fd710bc7640 1 --2- 172.21.15.22:0/1070102822 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd6f80b3bd0 0x7fd6f80b6090 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd70c107fa0 tx=0x7fd6fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:11.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:11.843+0000 7fd7027fc640 1 -- 172.21.15.22:0/1070102822 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd7080abad0 con 0x7fd70c102ab0 2024-08-20T01:29:12.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:12.071+0000 7fd71362c640 1 -- 172.21.15.22:0/1070102822 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd70c1a5cf0 con 0x7fd70c102ab0 2024-08-20T01:29:12.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:12.436+0000 7fd7027fc640 1 -- 172.21.15.22:0/1070102822 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fd7080ab3d0 con 0x7fd70c102ab0 2024-08-20T01:29:12.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:12.439+0000 7fd71362c640 1 -- 172.21.15.22:0/1070102822 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd6f80b3bd0 msgr2=0x7fd6f80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:12.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:12.439+0000 7fd71362c640 1 --2- 172.21.15.22:0/1070102822 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd6f80b3bd0 0x7fd6f80b6090 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd70c107fa0 tx=0x7fd6fc005f90 comp rx=0 tx=0).stop 2024-08-20T01:29:12.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:12.439+0000 7fd71362c640 1 -- 172.21.15.22:0/1070102822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c102ab0 msgr2=0x7fd70c198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:12.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:12.439+0000 7fd71362c640 1 --2- 172.21.15.22:0/1070102822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c102ab0 0x7fd70c198f00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd70800e9f0 tx=0x7fd70800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:29:12.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:12.439+0000 7fd71362c640 1 -- 172.21.15.22:0/1070102822 shutdown_connections 2024-08-20T01:29:12.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:12.439+0000 7fd71362c640 1 --2- 172.21.15.22:0/1070102822 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd6f80b3bd0 0x7fd6f80b6090 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:12.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:12.439+0000 7fd71362c640 1 --2- 172.21.15.22:0/1070102822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd70c108e40 0x7fd70c19e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:12.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:12.439+0000 7fd71362c640 1 --2- 172.21.15.22:0/1070102822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd70c1084c0 0x7fd70c199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:12.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:12.439+0000 7fd71362c640 1 --2- 172.21.15.22:0/1070102822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70c102ab0 0x7fd70c198f00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:12.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:12.439+0000 7fd71362c640 1 -- 172.21.15.22:0/1070102822 >> 172.21.15.22:0/1070102822 conn(0x7fd70c0fe500 msgr2=0x7fd70c1008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:12.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:12.439+0000 7fd71362c640 1 -- 172.21.15.22:0/1070102822 shutdown_connections 2024-08-20T01:29:12.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:12.439+0000 7fd71362c640 1 -- 172.21.15.22:0/1070102822 wait complete. 2024-08-20T01:29:12.764 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:12 smithi022 ceph-mon[18709]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-08-20T01:29:12.764 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:12 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1070102822' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-20T01:29:12.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:12 smithi134 ceph-mon[22511]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-08-20T01:29:12.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:12 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1070102822' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-20T01:29:12.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:12 smithi077 ceph-mon[22251]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-08-20T01:29:12.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:12 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1070102822' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-20T01:29:13.101 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-08-20T01:29:13.102 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-08-20T01:29:13.366 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:13.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:13 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1070102822' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-20T01:29:13.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:13 smithi134 ceph-mon[22511]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-20T01:29:13.515 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:29:13 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i[52992]: 2024-08-20T01:29:13.262+0000 7f77012d7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-20T01:29:13.769 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:13 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1070102822' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-20T01:29:13.769 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:13 smithi022 ceph-mon[18709]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-20T01:29:13.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:13 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1070102822' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-20T01:29:13.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:13 smithi077 ceph-mon[22251]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-20T01:29:13.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.853+0000 7f0536c49640 1 -- 172.21.15.22:0/2601568301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0530102ab0 msgr2=0x7f0530102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:13.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.853+0000 7f0536c49640 1 --2- 172.21.15.22:0/2601568301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0530102ab0 0x7f0530102e90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f052c009900 tx=0x7f052c02a410 comp rx=0 tx=0).stop 2024-08-20T01:29:13.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.853+0000 7f0536c49640 1 -- 172.21.15.22:0/2601568301 shutdown_connections 2024-08-20T01:29:13.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.853+0000 7f0536c49640 1 --2- 172.21.15.22:0/2601568301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0530108e40 0x7f053010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:13.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.853+0000 7f0536c49640 1 --2- 172.21.15.22:0/2601568301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05301084c0 0x7f0530108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:13.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.853+0000 7f0536c49640 1 --2- 172.21.15.22:0/2601568301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0530102ab0 0x7f0530102e90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:13.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.853+0000 7f0536c49640 1 -- 172.21.15.22:0/2601568301 >> 172.21.15.22:0/2601568301 conn(0x7f05300fe500 msgr2=0x7f0530100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:13.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.853+0000 7f0536c49640 1 -- 172.21.15.22:0/2601568301 shutdown_connections 2024-08-20T01:29:13.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.853+0000 7f0536c49640 1 -- 172.21.15.22:0/2601568301 wait complete. 2024-08-20T01:29:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.854+0000 7f0536c49640 1 Processor -- start 2024-08-20T01:29:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.854+0000 7f0536c49640 1 -- start start 2024-08-20T01:29:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.854+0000 7f0536c49640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0530102ab0 0x7f053019f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.854+0000 7f0536c49640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05301084c0 0x7f053019fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.854+0000 7f0536c49640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0530108e40 0x7f05301a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.854+0000 7f0536c49640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0530076fc0 con 0x7f0530108e40 2024-08-20T01:29:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.854+0000 7f0536c49640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0530076e40 con 0x7f0530102ab0 2024-08-20T01:29:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.854+0000 7f0536c49640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0530077140 con 0x7f05301084c0 2024-08-20T01:29:13.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.854+0000 7f05351e6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0530108e40 0x7f05301a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:13.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.854+0000 7f05351e6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0530108e40 0x7f05301a4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43180/0 (socket says 172.21.15.22:43180) 2024-08-20T01:29:13.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.854+0000 7f05351e6640 1 -- 172.21.15.22:0/48692523 learned_addr learned my addr 172.21.15.22:0/48692523 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:13.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.854+0000 7f0527fff640 1 --2- 172.21.15.22:0/48692523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05301084c0 0x7f053019fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:13.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.854+0000 7f05349e5640 1 --2- 172.21.15.22:0/48692523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0530102ab0 0x7f053019f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:13.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.854+0000 7f05351e6640 1 -- 172.21.15.22:0/48692523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05301084c0 msgr2=0x7f053019fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.854+0000 7f05351e6640 1 --2- 172.21.15.22:0/48692523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05301084c0 0x7f053019fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.854+0000 7f05351e6640 1 -- 172.21.15.22:0/48692523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0530102ab0 msgr2=0x7f053019f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.854+0000 7f05351e6640 1 --2- 172.21.15.22:0/48692523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0530102ab0 0x7f053019f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.854+0000 7f05351e6640 1 -- 172.21.15.22:0/48692523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05301a5600 con 0x7f0530108e40 2024-08-20T01:29:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.854+0000 7f0527fff640 1 --2- 172.21.15.22:0/48692523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05301084c0 0x7f053019fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:29:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.855+0000 7f05351e6640 1 --2- 172.21.15.22:0/48692523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0530108e40 0x7f05301a4e30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f052800b970 tx=0x7f052800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.855+0000 7f0525ffb640 1 -- 172.21.15.22:0/48692523 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0528019070 con 0x7f0530108e40 2024-08-20T01:29:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.855+0000 7f0536c49640 1 -- 172.21.15.22:0/48692523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05301a58f0 con 0x7f0530108e40 2024-08-20T01:29:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.855+0000 7f0525ffb640 1 -- 172.21.15.22:0/48692523 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0528014440 con 0x7f0530108e40 2024-08-20T01:29:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.855+0000 7f0525ffb640 1 -- 172.21.15.22:0/48692523 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05280075d0 con 0x7f0530108e40 2024-08-20T01:29:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.855+0000 7f0536c49640 1 -- 172.21.15.22:0/48692523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05301abfb0 con 0x7f0530108e40 2024-08-20T01:29:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.856+0000 7f0536c49640 1 -- 172.21.15.22:0/48692523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0530102e90 con 0x7f0530108e40 2024-08-20T01:29:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.857+0000 7f0525ffb640 1 -- 172.21.15.22:0/48692523 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f052801c070 con 0x7f0530108e40 2024-08-20T01:29:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.858+0000 7f0525ffb640 1 --2- 172.21.15.22:0/48692523 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f05180b3bc0 0x7f05180b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:13.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.858+0000 7f05349e5640 1 --2- 172.21.15.22:0/48692523 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f05180b3bc0 0x7f05180b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:13.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.858+0000 7f0525ffb640 1 -- 172.21.15.22:0/48692523 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f05280e3150 con 0x7f0530108e40 2024-08-20T01:29:13.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.859+0000 7f05349e5640 1 --2- 172.21.15.22:0/48692523 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f05180b3bc0 0x7f05180b6080 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f052c031440 tx=0x7f052c005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:13.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:13.863+0000 7f0525ffb640 1 -- 172.21.15.22:0/48692523 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f05280aa200 con 0x7f0530108e40 2024-08-20T01:29:14.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:14.084+0000 7f0536c49640 1 -- 172.21.15.22:0/48692523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f05301ac330 con 0x7f0530108e40 2024-08-20T01:29:14.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:14.447+0000 7f0525ffb640 1 -- 172.21.15.22:0/48692523 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f05280ae750 con 0x7f0530108e40 2024-08-20T01:29:14.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:14.449+0000 7f0536c49640 1 -- 172.21.15.22:0/48692523 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f05180b3bc0 msgr2=0x7f05180b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:14.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:14.449+0000 7f0536c49640 1 --2- 172.21.15.22:0/48692523 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f05180b3bc0 0x7f05180b6080 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f052c031440 tx=0x7f052c005e80 comp rx=0 tx=0).stop 2024-08-20T01:29:14.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:14.449+0000 7f0536c49640 1 -- 172.21.15.22:0/48692523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0530108e40 msgr2=0x7f05301a4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:14.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:14.449+0000 7f0536c49640 1 --2- 172.21.15.22:0/48692523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0530108e40 0x7f05301a4e30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f052800b970 tx=0x7f052800be30 comp rx=0 tx=0).stop 2024-08-20T01:29:14.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:14.450+0000 7f0536c49640 1 -- 172.21.15.22:0/48692523 shutdown_connections 2024-08-20T01:29:14.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:14.450+0000 7f0536c49640 1 --2- 172.21.15.22:0/48692523 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f05180b3bc0 0x7f05180b6080 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:14.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:14.450+0000 7f0536c49640 1 --2- 172.21.15.22:0/48692523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0530108e40 0x7f05301a4e30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:14.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:14.450+0000 7f0536c49640 1 --2- 172.21.15.22:0/48692523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05301084c0 0x7f053019fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:14.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:14.450+0000 7f0536c49640 1 --2- 172.21.15.22:0/48692523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0530102ab0 0x7f053019f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:14.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:14.450+0000 7f0536c49640 1 -- 172.21.15.22:0/48692523 >> 172.21.15.22:0/48692523 conn(0x7f05300fe500 msgr2=0x7f05301008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:14.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:14.450+0000 7f0536c49640 1 -- 172.21.15.22:0/48692523 shutdown_connections 2024-08-20T01:29:14.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:14.450+0000 7f0536c49640 1 -- 172.21.15.22:0/48692523 wait complete. 2024-08-20T01:29:14.757 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:14 smithi022 ceph-mon[18709]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-08-20T01:29:14.757 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:14 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/48692523' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-08-20T01:29:14.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:14 smithi134 ceph-mon[22511]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-08-20T01:29:14.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:14 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/48692523' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-08-20T01:29:14.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:14 smithi077 ceph-mon[22251]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-08-20T01:29:14.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:14 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/48692523' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-08-20T01:29:15.104 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-08-20T01:29:15.365 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:15.739 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:15 smithi022 ceph-mon[18709]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-20T01:29:15.739 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:15 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/48692523' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-20T01:29:15.739 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:15 smithi022 ceph-mon[18709]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-20T01:29:15.739 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:15 smithi022 ceph-mon[18709]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-20T01:29:15.740 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:15 smithi022 ceph-mon[18709]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-08-20T01:29:15.740 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:15 smithi022 ceph-mon[18709]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-08-20T01:29:15.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:15 smithi134 ceph-mon[22511]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-20T01:29:15.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:15 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/48692523' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-20T01:29:15.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:15 smithi134 ceph-mon[22511]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-20T01:29:15.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:15 smithi134 ceph-mon[22511]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-20T01:29:15.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:15 smithi134 ceph-mon[22511]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-08-20T01:29:15.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:15 smithi134 ceph-mon[22511]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-08-20T01:29:15.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:15 smithi077 ceph-mon[22251]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-20T01:29:15.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:15 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/48692523' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-20T01:29:15.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:15 smithi077 ceph-mon[22251]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-20T01:29:15.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:15 smithi077 ceph-mon[22251]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-20T01:29:15.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:15 smithi077 ceph-mon[22251]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-08-20T01:29:15.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:15 smithi077 ceph-mon[22251]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-08-20T01:29:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.873+0000 7faf4dbbd640 1 -- 172.21.15.22:0/180463930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf4810ce40 msgr2=0x7faf4810f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.873+0000 7faf4dbbd640 1 --2- 172.21.15.22:0/180463930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf4810ce40 0x7faf4810f2a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7faf40009ca0 tx=0x7faf4002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:29:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.873+0000 7faf4dbbd640 1 -- 172.21.15.22:0/180463930 shutdown_connections 2024-08-20T01:29:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.873+0000 7faf4dbbd640 1 --2- 172.21.15.22:0/180463930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf4810ce40 0x7faf4810f2a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.873+0000 7faf4dbbd640 1 --2- 172.21.15.22:0/180463930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf48104300 0x7faf4810c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.873+0000 7faf4dbbd640 1 --2- 172.21.15.22:0/180463930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf481039e0 0x7faf48103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.873+0000 7faf4dbbd640 1 -- 172.21.15.22:0/180463930 >> 172.21.15.22:0/180463930 conn(0x7faf480fd440 msgr2=0x7faf480ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.874+0000 7faf4dbbd640 1 -- 172.21.15.22:0/180463930 shutdown_connections 2024-08-20T01:29:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.874+0000 7faf4dbbd640 1 -- 172.21.15.22:0/180463930 wait complete. 2024-08-20T01:29:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.874+0000 7faf4dbbd640 1 Processor -- start 2024-08-20T01:29:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.874+0000 7faf4dbbd640 1 -- start start 2024-08-20T01:29:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf4dbbd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf481039e0 0x7faf48101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf4dbbd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf48104300 0x7faf48101bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf4dbbd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf4810ce40 0x7faf48102110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf4dbbd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faf48112b30 con 0x7faf48104300 2024-08-20T01:29:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf4dbbd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faf481129b0 con 0x7faf4810ce40 2024-08-20T01:29:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf4dbbd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faf48112cb0 con 0x7faf481039e0 2024-08-20T01:29:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf46ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf48104300 0x7faf48101bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf46ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf48104300 0x7faf48101bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43192/0 (socket says 172.21.15.22:43192) 2024-08-20T01:29:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf46ffd640 1 -- 172.21.15.22:0/2612685739 learned_addr learned my addr 172.21.15.22:0/2612685739 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf47fff640 1 --2- 172.21.15.22:0/2612685739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf4810ce40 0x7faf48102110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf46ffd640 1 -- 172.21.15.22:0/2612685739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf481039e0 msgr2=0x7faf48101690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf46ffd640 1 --2- 172.21.15.22:0/2612685739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf481039e0 0x7faf48101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf46ffd640 1 -- 172.21.15.22:0/2612685739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf4810ce40 msgr2=0x7faf48102110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf46ffd640 1 --2- 172.21.15.22:0/2612685739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf4810ce40 0x7faf48102110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf46ffd640 1 -- 172.21.15.22:0/2612685739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf481a7400 con 0x7faf48104300 2024-08-20T01:29:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf46ffd640 1 --2- 172.21.15.22:0/2612685739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf48104300 0x7faf48101bd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00b3c0 tx=0x7faf3c00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf44ff9640 1 -- 172.21.15.22:0/2612685739 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c011830 con 0x7faf48104300 2024-08-20T01:29:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf4dbbd640 1 -- 172.21.15.22:0/2612685739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf481a76f0 con 0x7faf48104300 2024-08-20T01:29:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf44ff9640 1 -- 172.21.15.22:0/2612685739 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf3c016070 con 0x7faf48104300 2024-08-20T01:29:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.875+0000 7faf44ff9640 1 -- 172.21.15.22:0/2612685739 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c010de0 con 0x7faf48104300 2024-08-20T01:29:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.876+0000 7faf4dbbd640 1 -- 172.21.15.22:0/2612685739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf481a7d00 con 0x7faf48104300 2024-08-20T01:29:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.876+0000 7faf4dbbd640 1 -- 172.21.15.22:0/2612685739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf48103dc0 con 0x7faf48104300 2024-08-20T01:29:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.878+0000 7faf44ff9640 1 -- 172.21.15.22:0/2612685739 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7faf3c0119d0 con 0x7faf48104300 2024-08-20T01:29:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.879+0000 7faf44ff9640 1 --2- 172.21.15.22:0/2612685739 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faf300b3c50 0x7faf300b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.879+0000 7faf477fe640 1 --2- 172.21.15.22:0/2612685739 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faf300b3c50 0x7faf300b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.879+0000 7faf44ff9640 1 -- 172.21.15.22:0/2612685739 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7faf3c0e3070 con 0x7faf48104300 2024-08-20T01:29:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.879+0000 7faf477fe640 1 --2- 172.21.15.22:0/2612685739 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faf300b3c50 0x7faf300b6110 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faf38005fd0 tx=0x7faf38005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:15.883+0000 7faf44ff9640 1 -- 172.21.15.22:0/2612685739 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7faf3c0aa810 con 0x7faf48104300 2024-08-20T01:29:16.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:16.106+0000 7faf4dbbd640 1 -- 172.21.15.22:0/2612685739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7faf481a8120 con 0x7faf48104300 2024-08-20T01:29:16.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:16.463+0000 7faf44ff9640 1 -- 172.21.15.22:0/2612685739 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7faf3c0aa110 con 0x7faf48104300 2024-08-20T01:29:16.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:16.466+0000 7faf4dbbd640 1 -- 172.21.15.22:0/2612685739 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faf300b3c50 msgr2=0x7faf300b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:16.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:16.466+0000 7faf4dbbd640 1 --2- 172.21.15.22:0/2612685739 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faf300b3c50 0x7faf300b6110 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faf38005fd0 tx=0x7faf38005850 comp rx=0 tx=0).stop 2024-08-20T01:29:16.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:16.466+0000 7faf4dbbd640 1 -- 172.21.15.22:0/2612685739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf48104300 msgr2=0x7faf48101bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:16.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:16.466+0000 7faf4dbbd640 1 --2- 172.21.15.22:0/2612685739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf48104300 0x7faf48101bd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00b3c0 tx=0x7faf3c00b880 comp rx=0 tx=0).stop 2024-08-20T01:29:16.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:16.466+0000 7faf4dbbd640 1 -- 172.21.15.22:0/2612685739 shutdown_connections 2024-08-20T01:29:16.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:16.466+0000 7faf4dbbd640 1 --2- 172.21.15.22:0/2612685739 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faf300b3c50 0x7faf300b6110 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:16.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:16.466+0000 7faf4dbbd640 1 --2- 172.21.15.22:0/2612685739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf4810ce40 0x7faf48102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:16.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:16.466+0000 7faf4dbbd640 1 --2- 172.21.15.22:0/2612685739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf48104300 0x7faf48101bd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:16.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:16.466+0000 7faf4dbbd640 1 --2- 172.21.15.22:0/2612685739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf481039e0 0x7faf48101690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:16.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:16.466+0000 7faf4dbbd640 1 -- 172.21.15.22:0/2612685739 >> 172.21.15.22:0/2612685739 conn(0x7faf480fd440 msgr2=0x7faf4810f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:16.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:16.466+0000 7faf4dbbd640 1 -- 172.21.15.22:0/2612685739 shutdown_connections 2024-08-20T01:29:16.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:16.466+0000 7faf4dbbd640 1 -- 172.21.15.22:0/2612685739 wait complete. 2024-08-20T01:29:16.759 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:16 smithi022 ceph-mon[18709]: pgmap v286: 97 pgs: 97 active+clean; 580 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 6 op/s 2024-08-20T01:29:16.759 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:16 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] up:active 2024-08-20T01:29:16.759 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:16 smithi022 ceph-mon[18709]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-20T01:29:16.759 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:16 smithi022 ceph-mon[18709]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-20T01:29:16.759 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:16 smithi022 ceph-mon[18709]: Cluster is now healthy 2024-08-20T01:29:16.759 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:16 smithi022 ceph-mon[18709]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-08-20T01:29:16.759 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:16 smithi022 ceph-mon[18709]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-08-20T01:29:16.759 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:16 smithi022 ceph-mon[18709]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-20T01:29:16.759 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:16 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2612685739' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-20T01:29:16.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:16 smithi134 ceph-mon[22511]: pgmap v286: 97 pgs: 97 active+clean; 580 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 6 op/s 2024-08-20T01:29:16.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:16 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] up:active 2024-08-20T01:29:16.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:16 smithi134 ceph-mon[22511]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-20T01:29:16.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:16 smithi134 ceph-mon[22511]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-20T01:29:16.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:16 smithi134 ceph-mon[22511]: Cluster is now healthy 2024-08-20T01:29:16.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:16 smithi134 ceph-mon[22511]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-08-20T01:29:16.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:16 smithi134 ceph-mon[22511]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-08-20T01:29:16.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:16 smithi134 ceph-mon[22511]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-20T01:29:16.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:16 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2612685739' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-20T01:29:16.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:16 smithi077 ceph-mon[22251]: pgmap v286: 97 pgs: 97 active+clean; 580 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 6 op/s 2024-08-20T01:29:16.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:16 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] up:active 2024-08-20T01:29:16.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:16 smithi077 ceph-mon[22251]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-20T01:29:16.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:16 smithi077 ceph-mon[22251]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-20T01:29:16.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:16 smithi077 ceph-mon[22251]: Cluster is now healthy 2024-08-20T01:29:16.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:16 smithi077 ceph-mon[22251]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-08-20T01:29:16.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:16 smithi077 ceph-mon[22251]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-08-20T01:29:16.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:16 smithi077 ceph-mon[22251]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-20T01:29:16.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:16 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2612685739' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-20T01:29:17.070 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-08-20T01:29:17.335 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:17.730 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:17 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2612685739' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-20T01:29:17.730 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:17 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] up:active 2024-08-20T01:29:17.730 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:17 smithi022 ceph-mon[18709]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-08-20T01:29:17.730 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:17 smithi022 ceph-mon[18709]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:29:17.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:17 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2612685739' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-20T01:29:17.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:17 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] up:active 2024-08-20T01:29:17.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:17 smithi134 ceph-mon[22511]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-08-20T01:29:17.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:17 smithi134 ceph-mon[22511]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:29:17.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:17 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2612685739' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-20T01:29:17.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:17 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] up:active 2024-08-20T01:29:17.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:17 smithi077 ceph-mon[22251]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-08-20T01:29:17.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:17 smithi077 ceph-mon[22251]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:29:17.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.814+0000 7f6dd2027640 1 -- 172.21.15.22:0/2406412823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc108e60 msgr2=0x7f6dcc10f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:17.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.814+0000 7f6dd2027640 1 --2- 172.21.15.22:0/2406412823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc108e60 0x7f6dcc10f660 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4009900 tx=0x7f6dc402a410 comp rx=0 tx=0).stop 2024-08-20T01:29:17.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.814+0000 7f6dd2027640 1 -- 172.21.15.22:0/2406412823 shutdown_connections 2024-08-20T01:29:17.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.814+0000 7f6dd2027640 1 --2- 172.21.15.22:0/2406412823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc108e60 0x7f6dcc10f660 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:17.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.814+0000 7f6dd2027640 1 --2- 172.21.15.22:0/2406412823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6dcc1084e0 0x7f6dcc108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:17.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.814+0000 7f6dd2027640 1 --2- 172.21.15.22:0/2406412823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dcc102ad0 0x7f6dcc102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:17.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.814+0000 7f6dd2027640 1 -- 172.21.15.22:0/2406412823 >> 172.21.15.22:0/2406412823 conn(0x7f6dcc0fe540 msgr2=0x7f6dcc100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:17.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.814+0000 7f6dd2027640 1 -- 172.21.15.22:0/2406412823 shutdown_connections 2024-08-20T01:29:17.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.814+0000 7f6dd2027640 1 -- 172.21.15.22:0/2406412823 wait complete. 2024-08-20T01:29:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.815+0000 7f6dd2027640 1 Processor -- start 2024-08-20T01:29:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.815+0000 7f6dd2027640 1 -- start start 2024-08-20T01:29:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.815+0000 7f6dd2027640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dcc102ad0 0x7f6dcc198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.815+0000 7f6dd2027640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6dcc1084e0 0x7f6dcc199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.815+0000 7f6dd2027640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc108e60 0x7f6dcc19e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.815+0000 7f6dd2027640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc112ae0 con 0x7f6dcc108e60 2024-08-20T01:29:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.815+0000 7f6dd2027640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc112960 con 0x7f6dcc1084e0 2024-08-20T01:29:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.815+0000 7f6dd2027640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc112c60 con 0x7f6dcc102ad0 2024-08-20T01:29:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.815+0000 7f6dcbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc108e60 0x7f6dcc19e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.815+0000 7f6dcbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc108e60 0x7f6dcc19e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43204/0 (socket says 172.21.15.22:43204) 2024-08-20T01:29:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.815+0000 7f6dcbfff640 1 -- 172.21.15.22:0/1981031631 learned_addr learned my addr 172.21.15.22:0/1981031631 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.815+0000 7f6dcb7fe640 1 --2- 172.21.15.22:0/1981031631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dcc102ad0 0x7f6dcc198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.815+0000 7f6dcaffd640 1 --2- 172.21.15.22:0/1981031631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6dcc1084e0 0x7f6dcc199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.816+0000 7f6dcbfff640 1 -- 172.21.15.22:0/1981031631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dcc102ad0 msgr2=0x7f6dcc198ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.816+0000 7f6dcbfff640 1 --2- 172.21.15.22:0/1981031631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dcc102ad0 0x7f6dcc198ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.816+0000 7f6dcbfff640 1 -- 172.21.15.22:0/1981031631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6dcc1084e0 msgr2=0x7f6dcc199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.816+0000 7f6dcbfff640 1 --2- 172.21.15.22:0/1981031631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6dcc1084e0 0x7f6dcc199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.816+0000 7f6dcbfff640 1 -- 172.21.15.22:0/1981031631 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dcc19efa0 con 0x7f6dcc108e60 2024-08-20T01:29:17.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.816+0000 7f6dcbfff640 1 --2- 172.21.15.22:0/1981031631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc108e60 0x7f6dcc19e7d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4004770 tx=0x7f6dc4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:17.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.816+0000 7f6dc8ff9640 1 -- 172.21.15.22:0/1981031631 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc403f030 con 0x7f6dcc108e60 2024-08-20T01:29:17.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.816+0000 7f6dc8ff9640 1 -- 172.21.15.22:0/1981031631 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dc4003aa0 con 0x7f6dcc108e60 2024-08-20T01:29:17.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.816+0000 7f6dd2027640 1 -- 172.21.15.22:0/1981031631 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dcc19f230 con 0x7f6dcc108e60 2024-08-20T01:29:17.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.816+0000 7f6dc8ff9640 1 -- 172.21.15.22:0/1981031631 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4035070 con 0x7f6dcc108e60 2024-08-20T01:29:17.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.816+0000 7f6dd2027640 1 -- 172.21.15.22:0/1981031631 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dcc1a5950 con 0x7f6dcc108e60 2024-08-20T01:29:17.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.817+0000 7f6dd2027640 1 -- 172.21.15.22:0/1981031631 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dcc102eb0 con 0x7f6dcc108e60 2024-08-20T01:29:17.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.818+0000 7f6dc8ff9640 1 -- 172.21.15.22:0/1981031631 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f6dc4042030 con 0x7f6dcc108e60 2024-08-20T01:29:17.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.819+0000 7f6dc8ff9640 1 --2- 172.21.15.22:0/1981031631 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6db40b3c50 0x7f6db40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:17.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.819+0000 7f6dcb7fe640 1 --2- 172.21.15.22:0/1981031631 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6db40b3c50 0x7f6db40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:17.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.819+0000 7f6dc8ff9640 1 -- 172.21.15.22:0/1981031631 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f6dc4103e10 con 0x7f6dcc108e60 2024-08-20T01:29:17.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.820+0000 7f6dcb7fe640 1 --2- 172.21.15.22:0/1981031631 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6db40b3c50 0x7f6db40b6110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc007ec0 tx=0x7f6dbc0075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:17.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:17.823+0000 7f6dc8ff9640 1 -- 172.21.15.22:0/1981031631 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f6dc40caf60 con 0x7f6dcc108e60 2024-08-20T01:29:18.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:18.046+0000 7f6dd2027640 1 -- 172.21.15.22:0/1981031631 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f6dcc10a6b0 con 0x7f6dcc108e60 2024-08-20T01:29:18.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:18.479+0000 7f6dc8ff9640 1 -- 172.21.15.22:0/1981031631 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f6dc40cf4b0 con 0x7f6dcc108e60 2024-08-20T01:29:18.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:18.481+0000 7f6dd2027640 1 -- 172.21.15.22:0/1981031631 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6db40b3c50 msgr2=0x7f6db40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:18.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:18.481+0000 7f6dd2027640 1 --2- 172.21.15.22:0/1981031631 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6db40b3c50 0x7f6db40b6110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc007ec0 tx=0x7f6dbc0075b0 comp rx=0 tx=0).stop 2024-08-20T01:29:18.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:18.481+0000 7f6dd2027640 1 -- 172.21.15.22:0/1981031631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc108e60 msgr2=0x7f6dcc19e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:18.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:18.481+0000 7f6dd2027640 1 --2- 172.21.15.22:0/1981031631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc108e60 0x7f6dcc19e7d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4004770 tx=0x7f6dc4004270 comp rx=0 tx=0).stop 2024-08-20T01:29:18.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:18.481+0000 7f6dd2027640 1 -- 172.21.15.22:0/1981031631 shutdown_connections 2024-08-20T01:29:18.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:18.481+0000 7f6dd2027640 1 --2- 172.21.15.22:0/1981031631 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6db40b3c50 0x7f6db40b6110 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:18.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:18.481+0000 7f6dd2027640 1 --2- 172.21.15.22:0/1981031631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc108e60 0x7f6dcc19e7d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:18.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:18.481+0000 7f6dd2027640 1 --2- 172.21.15.22:0/1981031631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6dcc1084e0 0x7f6dcc199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:18.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:18.481+0000 7f6dd2027640 1 --2- 172.21.15.22:0/1981031631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dcc102ad0 0x7f6dcc198ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:18.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:18.481+0000 7f6dd2027640 1 -- 172.21.15.22:0/1981031631 >> 172.21.15.22:0/1981031631 conn(0x7f6dcc0fe540 msgr2=0x7f6dcc0fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:18.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:18.481+0000 7f6dd2027640 1 -- 172.21.15.22:0/1981031631 shutdown_connections 2024-08-20T01:29:18.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:18.481+0000 7f6dd2027640 1 -- 172.21.15.22:0/1981031631 wait complete. 2024-08-20T01:29:18.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:18 smithi134 ceph-mon[22511]: pgmap v287: 97 pgs: 97 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 11 op/s 2024-08-20T01:29:18.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:18 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1981031631' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-20T01:29:18.515 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:29:18 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i[52992]: 2024-08-20T01:29:18.263+0000 7f77012d7640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-08-20T01:29:18.515 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:29:18 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i[52992]: 2024-08-20T01:29:18.263+0000 7f77012d7640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-08-20T01:29:18.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:18 smithi077 ceph-mon[22251]: pgmap v287: 97 pgs: 97 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 11 op/s 2024-08-20T01:29:18.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:18 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1981031631' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-20T01:29:18.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:18 smithi022 ceph-mon[18709]: pgmap v287: 97 pgs: 97 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 11 op/s 2024-08-20T01:29:18.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:18 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1981031631' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-20T01:29:19.145 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-08-20T01:29:19.145 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-08-20T01:29:19.410 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:19.673 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:19 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1981031631' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-20T01:29:19.673 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:19 smithi022 ceph-mon[18709]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:29:19.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:19 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1981031631' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-20T01:29:19.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:19 smithi134 ceph-mon[22511]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:29:19.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:19 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1981031631' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-20T01:29:19.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:19 smithi077 ceph-mon[22251]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:29:19.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.889+0000 7f29b3c91640 1 -- 172.21.15.22:0/1472851045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ac1019d0 msgr2=0x7f29ac101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:19.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.889+0000 7f29b3c91640 1 --2- 172.21.15.22:0/1472851045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ac1019d0 0x7f29ac101db0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009900 tx=0x7f29a802a410 comp rx=0 tx=0).stop 2024-08-20T01:29:19.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.889+0000 7f29b3c91640 1 -- 172.21.15.22:0/1472851045 shutdown_connections 2024-08-20T01:29:19.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.889+0000 7f29b3c91640 1 --2- 172.21.15.22:0/1472851045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29ac107d60 0x7f29ac10e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:19.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.889+0000 7f29b3c91640 1 --2- 172.21.15.22:0/1472851045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29ac1073e0 0x7f29ac107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:19.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.889+0000 7f29b3c91640 1 --2- 172.21.15.22:0/1472851045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ac1019d0 0x7f29ac101db0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:19.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.889+0000 7f29b3c91640 1 -- 172.21.15.22:0/1472851045 >> 172.21.15.22:0/1472851045 conn(0x7f29ac0fd440 msgr2=0x7f29ac0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:19.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.889+0000 7f29b3c91640 1 -- 172.21.15.22:0/1472851045 shutdown_connections 2024-08-20T01:29:19.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.889+0000 7f29b3c91640 1 -- 172.21.15.22:0/1472851045 wait complete. 2024-08-20T01:29:19.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.890+0000 7f29b3c91640 1 Processor -- start 2024-08-20T01:29:19.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.890+0000 7f29b3c91640 1 -- start start 2024-08-20T01:29:19.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.890+0000 7f29b3c91640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29ac1019d0 0x7f29ac19b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:19.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.890+0000 7f29b3c91640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29ac1073e0 0x7f29ac19b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:19.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.890+0000 7f29b3c91640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ac107d60 0x7f29ac1a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:19.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.890+0000 7f29b3c91640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac111a70 con 0x7f29ac107d60 2024-08-20T01:29:19.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.890+0000 7f29b3c91640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac1118f0 con 0x7f29ac1019d0 2024-08-20T01:29:19.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.890+0000 7f29b3c91640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac111bf0 con 0x7f29ac1073e0 2024-08-20T01:29:19.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.890+0000 7f29b222e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ac107d60 0x7f29ac1a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:19.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.890+0000 7f29b222e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ac107d60 0x7f29ac1a0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54246/0 (socket says 172.21.15.22:54246) 2024-08-20T01:29:19.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.890+0000 7f29b222e640 1 -- 172.21.15.22:0/2342599372 learned_addr learned my addr 172.21.15.22:0/2342599372 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:19.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.890+0000 7f29b1a2d640 1 --2- 172.21.15.22:0/2342599372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29ac1019d0 0x7f29ac19b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:19.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.890+0000 7f29b122c640 1 --2- 172.21.15.22:0/2342599372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29ac1073e0 0x7f29ac19b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:19.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.890+0000 7f29b222e640 1 -- 172.21.15.22:0/2342599372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29ac1073e0 msgr2=0x7f29ac19b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:19.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.890+0000 7f29b222e640 1 --2- 172.21.15.22:0/2342599372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29ac1073e0 0x7f29ac19b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:19.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.891+0000 7f29b222e640 1 -- 172.21.15.22:0/2342599372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29ac1019d0 msgr2=0x7f29ac19b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:19.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.891+0000 7f29b222e640 1 --2- 172.21.15.22:0/2342599372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29ac1019d0 0x7f29ac19b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:19.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.891+0000 7f29b222e640 1 -- 172.21.15.22:0/2342599372 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ac1a1340 con 0x7f29ac107d60 2024-08-20T01:29:19.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.891+0000 7f29b222e640 1 --2- 172.21.15.22:0/2342599372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ac107d60 0x7f29ac1a0b70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f29a400eaa0 tx=0x7f29a400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:19.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.891+0000 7f29a2ffd640 1 -- 172.21.15.22:0/2342599372 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a4004d20 con 0x7f29ac107d60 2024-08-20T01:29:19.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.891+0000 7f29a2ffd640 1 -- 172.21.15.22:0/2342599372 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29a4005020 con 0x7f29ac107d60 2024-08-20T01:29:19.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.891+0000 7f29b3c91640 1 -- 172.21.15.22:0/2342599372 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29ac1a1630 con 0x7f29ac107d60 2024-08-20T01:29:19.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.891+0000 7f29a2ffd640 1 -- 172.21.15.22:0/2342599372 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a40116b0 con 0x7f29ac107d60 2024-08-20T01:29:19.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.891+0000 7f29b3c91640 1 -- 172.21.15.22:0/2342599372 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29ac1a7cf0 con 0x7f29ac107d60 2024-08-20T01:29:19.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.892+0000 7f29b3c91640 1 -- 172.21.15.22:0/2342599372 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29ac101db0 con 0x7f29ac107d60 2024-08-20T01:29:19.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.893+0000 7f29a2ffd640 1 -- 172.21.15.22:0/2342599372 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f29a40051d0 con 0x7f29ac107d60 2024-08-20T01:29:19.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.894+0000 7f29a2ffd640 1 --2- 172.21.15.22:0/2342599372 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f29980b3bd0 0x7f29980b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:19.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.894+0000 7f29b1a2d640 1 --2- 172.21.15.22:0/2342599372 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f29980b3bd0 0x7f29980b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:19.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.894+0000 7f29a2ffd640 1 -- 172.21.15.22:0/2342599372 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f29a40e3cb0 con 0x7f29ac107d60 2024-08-20T01:29:19.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.894+0000 7f29b1a2d640 1 --2- 172.21.15.22:0/2342599372 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f29980b3bd0 0x7f29980b6090 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f29a8005ab0 tx=0x7f29a8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:19.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:19.898+0000 7f29a2ffd640 1 -- 172.21.15.22:0/2342599372 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f29a4016030 con 0x7f29ac107d60 2024-08-20T01:29:20.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:20.107+0000 7f29b3c91640 1 -- 172.21.15.22:0/2342599372 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f29ac06b9b0 con 0x7f29980b3bd0 2024-08-20T01:29:20.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:20.133+0000 7f29a2ffd640 1 -- 172.21.15.22:0/2342599372 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f29ac06b9b0 con 0x7f29980b3bd0 2024-08-20T01:29:20.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:20.135+0000 7f29b3c91640 1 -- 172.21.15.22:0/2342599372 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f29980b3bd0 msgr2=0x7f29980b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:20.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:20.135+0000 7f29b3c91640 1 --2- 172.21.15.22:0/2342599372 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f29980b3bd0 0x7f29980b6090 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f29a8005ab0 tx=0x7f29a8005a20 comp rx=0 tx=0).stop 2024-08-20T01:29:20.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:20.136+0000 7f29b3c91640 1 -- 172.21.15.22:0/2342599372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ac107d60 msgr2=0x7f29ac1a0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:20.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:20.136+0000 7f29b3c91640 1 --2- 172.21.15.22:0/2342599372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ac107d60 0x7f29ac1a0b70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f29a400eaa0 tx=0x7f29a400eea0 comp rx=0 tx=0).stop 2024-08-20T01:29:20.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:20.136+0000 7f29b3c91640 1 -- 172.21.15.22:0/2342599372 shutdown_connections 2024-08-20T01:29:20.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:20.136+0000 7f29b3c91640 1 --2- 172.21.15.22:0/2342599372 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f29980b3bd0 0x7f29980b6090 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:20.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:20.136+0000 7f29b3c91640 1 --2- 172.21.15.22:0/2342599372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ac107d60 0x7f29ac1a0b70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:20.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:20.136+0000 7f29b3c91640 1 --2- 172.21.15.22:0/2342599372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29ac1073e0 0x7f29ac19b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:20.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:20.136+0000 7f29b3c91640 1 --2- 172.21.15.22:0/2342599372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29ac1019d0 0x7f29ac19b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:20.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:20.136+0000 7f29b3c91640 1 -- 172.21.15.22:0/2342599372 >> 172.21.15.22:0/2342599372 conn(0x7f29ac0fd440 msgr2=0x7f29ac100900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:20.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:20.136+0000 7f29b3c91640 1 -- 172.21.15.22:0/2342599372 shutdown_connections 2024-08-20T01:29:20.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:20.136+0000 7f29b3c91640 1 -- 172.21.15.22:0/2342599372 wait complete. 2024-08-20T01:29:20.386 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:29:20 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: 2024-08-20T01:29:20.112+0000 7f69fef61640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-20T01:29:20.386 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:29:20 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: 2024-08-20T01:29:20.112+0000 7f69fef61640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-20T01:29:20.386 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:29:20 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: 2024-08-20T01:29:20.112+0000 7f69fef61640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-20T01:29:20.386 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:29:20 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: 2024-08-20T01:29:20.112+0000 7f69fef61640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-20T01:29:20.386 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:29:20 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: 2024-08-20T01:29:20.112+0000 7f69fef61640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-20T01:29:20.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:20 smithi022 ceph-mon[18709]: pgmap v288: 97 pgs: 97 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s wr, 10 op/s 2024-08-20T01:29:20.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:20 smithi134 ceph-mon[22511]: pgmap v288: 97 pgs: 97 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s wr, 10 op/s 2024-08-20T01:29:20.783 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-08-20T01:29:20.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:20 smithi077 ceph-mon[22251]: pgmap v288: 97 pgs: 97 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s wr, 10 op/s 2024-08-20T01:29:21.044 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:21.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.523+0000 7f9093838640 1 -- 172.21.15.22:0/918465479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f908c108e60 msgr2=0x7f908c10f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:21.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.523+0000 7f9093838640 1 --2- 172.21.15.22:0/918465479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f908c108e60 0x7f908c10f660 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9084009ca0 tx=0x7f908402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:29:21.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.523+0000 7f9093838640 1 -- 172.21.15.22:0/918465479 shutdown_connections 2024-08-20T01:29:21.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.523+0000 7f9093838640 1 --2- 172.21.15.22:0/918465479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f908c108e60 0x7f908c10f660 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:21.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.523+0000 7f9093838640 1 --2- 172.21.15.22:0/918465479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f908c1084e0 0x7f908c108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:21.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.523+0000 7f9093838640 1 --2- 172.21.15.22:0/918465479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f908c102ad0 0x7f908c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:21.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.523+0000 7f9093838640 1 -- 172.21.15.22:0/918465479 >> 172.21.15.22:0/918465479 conn(0x7f908c0fe540 msgr2=0x7f908c100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:21.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.524+0000 7f9093838640 1 -- 172.21.15.22:0/918465479 shutdown_connections 2024-08-20T01:29:21.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.524+0000 7f9093838640 1 -- 172.21.15.22:0/918465479 wait complete. 2024-08-20T01:29:21.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.525+0000 7f9093838640 1 Processor -- start 2024-08-20T01:29:21.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.525+0000 7f9093838640 1 -- start start 2024-08-20T01:29:21.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.525+0000 7f9093838640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f908c102ad0 0x7f908c198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:21.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.525+0000 7f9093838640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f908c1084e0 0x7f908c199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:21.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.525+0000 7f9093838640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f908c108e60 0x7f908c19e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:21.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.525+0000 7f9093838640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f908c112b20 con 0x7f908c102ad0 2024-08-20T01:29:21.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.525+0000 7f9093838640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f908c1129a0 con 0x7f908c108e60 2024-08-20T01:29:21.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.525+0000 7f9093838640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f908c112ca0 con 0x7f908c1084e0 2024-08-20T01:29:21.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.525+0000 7f90915d4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f908c102ad0 0x7f908c198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:21.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.525+0000 7f90915d4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f908c102ad0 0x7f908c198f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54286/0 (socket says 172.21.15.22:54286) 2024-08-20T01:29:21.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.525+0000 7f90915d4640 1 -- 172.21.15.22:0/3021045456 learned_addr learned my addr 172.21.15.22:0/3021045456 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:21.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.525+0000 7f9091dd5640 1 --2- 172.21.15.22:0/3021045456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f908c108e60 0x7f908c19e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:21.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.525+0000 7f9090dd3640 1 --2- 172.21.15.22:0/3021045456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f908c1084e0 0x7f908c199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:21.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.525+0000 7f90915d4640 1 -- 172.21.15.22:0/3021045456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f908c1084e0 msgr2=0x7f908c199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:21.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.525+0000 7f90915d4640 1 --2- 172.21.15.22:0/3021045456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f908c1084e0 0x7f908c199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:21.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.526+0000 7f90915d4640 1 -- 172.21.15.22:0/3021045456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f908c108e60 msgr2=0x7f908c19e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:21.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.526+0000 7f90915d4640 1 --2- 172.21.15.22:0/3021045456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f908c108e60 0x7f908c19e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:21.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.526+0000 7f90915d4640 1 -- 172.21.15.22:0/3021045456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908c19f000 con 0x7f908c102ad0 2024-08-20T01:29:21.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.526+0000 7f9090dd3640 1 --2- 172.21.15.22:0/3021045456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f908c1084e0 0x7f908c199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:29:21.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.526+0000 7f90915d4640 1 --2- 172.21.15.22:0/3021045456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f908c102ad0 0x7f908c198f50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f908800d950 tx=0x7f908800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:21.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.526+0000 7f90827fc640 1 -- 172.21.15.22:0/3021045456 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088017070 con 0x7f908c102ad0 2024-08-20T01:29:21.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.526+0000 7f90827fc640 1 -- 172.21.15.22:0/3021045456 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9088009c30 con 0x7f908c102ad0 2024-08-20T01:29:21.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.526+0000 7f9093838640 1 -- 172.21.15.22:0/3021045456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f908c19f2f0 con 0x7f908c102ad0 2024-08-20T01:29:21.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.526+0000 7f90827fc640 1 -- 172.21.15.22:0/3021045456 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908800f620 con 0x7f908c102ad0 2024-08-20T01:29:21.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.526+0000 7f9093838640 1 -- 172.21.15.22:0/3021045456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f908c1a59b0 con 0x7f908c102ad0 2024-08-20T01:29:21.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.527+0000 7f9093838640 1 -- 172.21.15.22:0/3021045456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f908c102eb0 con 0x7f908c102ad0 2024-08-20T01:29:21.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.528+0000 7f90827fc640 1 -- 172.21.15.22:0/3021045456 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f9088010460 con 0x7f908c102ad0 2024-08-20T01:29:21.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.529+0000 7f90827fc640 1 --2- 172.21.15.22:0/3021045456 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f90780b3c60 0x7f90780b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:21.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.529+0000 7f9090dd3640 1 --2- 172.21.15.22:0/3021045456 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f90780b3c60 0x7f90780b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:21.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.529+0000 7f90827fc640 1 -- 172.21.15.22:0/3021045456 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f90880e3810 con 0x7f908c102ad0 2024-08-20T01:29:21.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.530+0000 7f9090dd3640 1 --2- 172.21.15.22:0/3021045456 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f90780b3c60 0x7f90780b6120 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f908c107e40 tx=0x7f907c00b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:21.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.533+0000 7f90827fc640 1 -- 172.21.15.22:0/3021045456 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f90880aaeb0 con 0x7f908c102ad0 2024-08-20T01:29:21.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.743+0000 7f9093838640 1 -- 172.21.15.22:0/3021045456 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f908c0632c0 con 0x7f90780b3c60 2024-08-20T01:29:21.745 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:21 smithi022 ceph-mon[18709]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:21.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:21 smithi134 ceph-mon[22511]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:21.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.768+0000 7f90827fc640 1 -- 172.21.15.22:0/3021045456 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f908c0632c0 con 0x7f90780b3c60 2024-08-20T01:29:21.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.770+0000 7f9093838640 1 -- 172.21.15.22:0/3021045456 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f90780b3c60 msgr2=0x7f90780b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:21.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.770+0000 7f9093838640 1 --2- 172.21.15.22:0/3021045456 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f90780b3c60 0x7f90780b6120 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f908c107e40 tx=0x7f907c00b5f0 comp rx=0 tx=0).stop 2024-08-20T01:29:21.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.770+0000 7f9093838640 1 -- 172.21.15.22:0/3021045456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f908c102ad0 msgr2=0x7f908c198f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:21.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.770+0000 7f9093838640 1 --2- 172.21.15.22:0/3021045456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f908c102ad0 0x7f908c198f50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f908800d950 tx=0x7f908800de10 comp rx=0 tx=0).stop 2024-08-20T01:29:21.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.770+0000 7f9093838640 1 -- 172.21.15.22:0/3021045456 shutdown_connections 2024-08-20T01:29:21.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.771+0000 7f9093838640 1 --2- 172.21.15.22:0/3021045456 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f90780b3c60 0x7f90780b6120 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:21.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.771+0000 7f9093838640 1 --2- 172.21.15.22:0/3021045456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f908c108e60 0x7f908c19e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:21.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.771+0000 7f9093838640 1 --2- 172.21.15.22:0/3021045456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f908c1084e0 0x7f908c199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:21.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.771+0000 7f9093838640 1 --2- 172.21.15.22:0/3021045456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f908c102ad0 0x7f908c198f50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:21.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.771+0000 7f9093838640 1 -- 172.21.15.22:0/3021045456 >> 172.21.15.22:0/3021045456 conn(0x7f908c0fe540 msgr2=0x7f908c100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:21.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.771+0000 7f9093838640 1 -- 172.21.15.22:0/3021045456 shutdown_connections 2024-08-20T01:29:21.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:21.771+0000 7f9093838640 1 -- 172.21.15.22:0/3021045456 wait complete. 2024-08-20T01:29:21.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:21 smithi077 ceph-mon[22251]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:22.413 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-08-20T01:29:22.678 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:22.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:22 smithi134 ceph-mon[22511]: pgmap v289: 97 pgs: 97 active+clean; 588 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3.9 KiB/s wr, 14 op/s 2024-08-20T01:29:22.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:22 smithi134 ceph-mon[22511]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-08-20T01:29:22.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:22 smithi134 ceph-mon[22511]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:22.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:22 smithi022 ceph-mon[18709]: pgmap v289: 97 pgs: 97 active+clean; 588 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3.9 KiB/s wr, 14 op/s 2024-08-20T01:29:22.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:22 smithi022 ceph-mon[18709]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-08-20T01:29:22.798 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:22 smithi022 ceph-mon[18709]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:22.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:22 smithi077 ceph-mon[22251]: pgmap v289: 97 pgs: 97 active+clean; 588 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3.9 KiB/s wr, 14 op/s 2024-08-20T01:29:22.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:22 smithi077 ceph-mon[22251]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-08-20T01:29:22.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:22 smithi077 ceph-mon[22251]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:23.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.111+0000 7f06eeebf640 1 -- 172.21.15.22:0/3012102981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e81039e0 msgr2=0x7f06e8103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:23.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.111+0000 7f06eeebf640 1 --2- 172.21.15.22:0/3012102981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e81039e0 0x7f06e8103dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009900 tx=0x7f06d802a410 comp rx=0 tx=0).stop 2024-08-20T01:29:23.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.111+0000 7f06eeebf640 1 -- 172.21.15.22:0/3012102981 shutdown_connections 2024-08-20T01:29:23.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.111+0000 7f06eeebf640 1 --2- 172.21.15.22:0/3012102981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e810ce40 0x7f06e810f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:23.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.111+0000 7f06eeebf640 1 --2- 172.21.15.22:0/3012102981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e8104300 0x7f06e810c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:23.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.111+0000 7f06eeebf640 1 --2- 172.21.15.22:0/3012102981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e81039e0 0x7f06e8103dc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:23.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.111+0000 7f06eeebf640 1 -- 172.21.15.22:0/3012102981 >> 172.21.15.22:0/3012102981 conn(0x7f06e80fd440 msgr2=0x7f06e80ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:23.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.111+0000 7f06eeebf640 1 -- 172.21.15.22:0/3012102981 shutdown_connections 2024-08-20T01:29:23.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.111+0000 7f06eeebf640 1 -- 172.21.15.22:0/3012102981 wait complete. 2024-08-20T01:29:23.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.112+0000 7f06eeebf640 1 Processor -- start 2024-08-20T01:29:23.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.112+0000 7f06eeebf640 1 -- start start 2024-08-20T01:29:23.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.112+0000 7f06eeebf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e81039e0 0x7f06e819b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:23.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.112+0000 7f06eeebf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e8104300 0x7f06e819b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:23.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.112+0000 7f06eeebf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e810ce40 0x7f06e81a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:23.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.112+0000 7f06eeebf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f06e8112ab0 con 0x7f06e8104300 2024-08-20T01:29:23.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.112+0000 7f06eeebf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f06e8112930 con 0x7f06e81039e0 2024-08-20T01:29:23.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.112+0000 7f06eeebf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f06e8112c30 con 0x7f06e810ce40 2024-08-20T01:29:23.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.112+0000 7f06e7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e8104300 0x7f06e819b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:23.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.112+0000 7f06e7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e8104300 0x7f06e819b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54302/0 (socket says 172.21.15.22:54302) 2024-08-20T01:29:23.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.112+0000 7f06e7fff640 1 -- 172.21.15.22:0/1840953309 learned_addr learned my addr 172.21.15.22:0/1840953309 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:23.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.113+0000 7f06ed45c640 1 --2- 172.21.15.22:0/1840953309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e810ce40 0x7f06e81a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:23.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.113+0000 7f06ecc5b640 1 --2- 172.21.15.22:0/1840953309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e81039e0 0x7f06e819b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:23.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.113+0000 7f06e7fff640 1 -- 172.21.15.22:0/1840953309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e810ce40 msgr2=0x7f06e81a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:23.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.113+0000 7f06e7fff640 1 --2- 172.21.15.22:0/1840953309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e810ce40 0x7f06e81a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:23.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.113+0000 7f06e7fff640 1 -- 172.21.15.22:0/1840953309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e81039e0 msgr2=0x7f06e819b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:23.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.113+0000 7f06e7fff640 1 --2- 172.21.15.22:0/1840953309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e81039e0 0x7f06e819b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:23.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.113+0000 7f06e7fff640 1 -- 172.21.15.22:0/1840953309 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e81a12b0 con 0x7f06e8104300 2024-08-20T01:29:23.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.113+0000 7f06ecc5b640 1 --2- 172.21.15.22:0/1840953309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e81039e0 0x7f06e819b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:29:23.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.113+0000 7f06e7fff640 1 --2- 172.21.15.22:0/1840953309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e8104300 0x7f06e819b740 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00d750 tx=0x7f06dc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:23.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.113+0000 7f06e5ffb640 1 -- 172.21.15.22:0/1840953309 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc017070 con 0x7f06e8104300 2024-08-20T01:29:23.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.113+0000 7f06e5ffb640 1 -- 172.21.15.22:0/1840953309 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06dc004020 con 0x7f06e8104300 2024-08-20T01:29:23.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.113+0000 7f06e5ffb640 1 -- 172.21.15.22:0/1840953309 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc003c00 con 0x7f06e8104300 2024-08-20T01:29:23.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.113+0000 7f06eeebf640 1 -- 172.21.15.22:0/1840953309 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e81a15a0 con 0x7f06e8104300 2024-08-20T01:29:23.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.113+0000 7f06eeebf640 1 -- 172.21.15.22:0/1840953309 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e81a7e30 con 0x7f06e8104300 2024-08-20T01:29:23.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.115+0000 7f06eeebf640 1 -- 172.21.15.22:0/1840953309 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e806b890 con 0x7f06e8104300 2024-08-20T01:29:23.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.116+0000 7f06e5ffb640 1 -- 172.21.15.22:0/1840953309 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f06dc009a30 con 0x7f06e8104300 2024-08-20T01:29:23.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.117+0000 7f06e5ffb640 1 --2- 172.21.15.22:0/1840953309 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f06d00b3ce0 0x7f06d00b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:23.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.117+0000 7f06ecc5b640 1 --2- 172.21.15.22:0/1840953309 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f06d00b3ce0 0x7f06d00b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:23.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.117+0000 7f06e5ffb640 1 -- 172.21.15.22:0/1840953309 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f06dc0e3560 con 0x7f06e8104300 2024-08-20T01:29:23.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.117+0000 7f06ecc5b640 1 --2- 172.21.15.22:0/1840953309 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f06d00b3ce0 0x7f06d00b61a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f06d8000c00 tx=0x7f06d8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:23.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.121+0000 7f06e5ffb640 1 -- 172.21.15.22:0/1840953309 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f06dc0aab00 con 0x7f06e8104300 2024-08-20T01:29:23.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.333+0000 7f06eeebf640 1 -- 172.21.15.22:0/1840953309 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f06e8102da0 con 0x7f06d00b3ce0 2024-08-20T01:29:23.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.338+0000 7f06e5ffb640 1 -- 172.21.15.22:0/1840953309 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f06e8102da0 con 0x7f06d00b3ce0 2024-08-20T01:29:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:/volumes/qa/sv_0/452151a8-8d32-4615-b481-ab3b5ec8d353 2024-08-20T01:29:23.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.340+0000 7f06eeebf640 1 -- 172.21.15.22:0/1840953309 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f06d00b3ce0 msgr2=0x7f06d00b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:23.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.340+0000 7f06eeebf640 1 --2- 172.21.15.22:0/1840953309 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f06d00b3ce0 0x7f06d00b61a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f06d8000c00 tx=0x7f06d8031400 comp rx=0 tx=0).stop 2024-08-20T01:29:23.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.340+0000 7f06eeebf640 1 -- 172.21.15.22:0/1840953309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e8104300 msgr2=0x7f06e819b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.340+0000 7f06eeebf640 1 --2- 172.21.15.22:0/1840953309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e8104300 0x7f06e819b740 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00d750 tx=0x7f06dc00dc10 comp rx=0 tx=0).stop 2024-08-20T01:29:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.340+0000 7f06eeebf640 1 -- 172.21.15.22:0/1840953309 shutdown_connections 2024-08-20T01:29:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.340+0000 7f06eeebf640 1 --2- 172.21.15.22:0/1840953309 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f06d00b3ce0 0x7f06d00b61a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.340+0000 7f06eeebf640 1 --2- 172.21.15.22:0/1840953309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e810ce40 0x7f06e81a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.340+0000 7f06eeebf640 1 --2- 172.21.15.22:0/1840953309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e8104300 0x7f06e819b740 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.340+0000 7f06eeebf640 1 --2- 172.21.15.22:0/1840953309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e81039e0 0x7f06e819b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.340+0000 7f06eeebf640 1 -- 172.21.15.22:0/1840953309 >> 172.21.15.22:0/1840953309 conn(0x7f06e80fd440 msgr2=0x7f06e810f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.340+0000 7f06eeebf640 1 -- 172.21.15.22:0/1840953309 shutdown_connections 2024-08-20T01:29:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:23.341+0000 7f06eeebf640 1 -- 172.21.15.22:0/1840953309 wait complete. 2024-08-20T01:29:23.963 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-08-20T01:29:24.226 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:24.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:24 smithi022 ceph-mon[18709]: pgmap v290: 97 pgs: 97 active+clean; 588 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-08-20T01:29:24.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:24 smithi022 ceph-mon[18709]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.661+0000 7f2bc5dcf640 1 -- 172.21.15.22:0/278882549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bc01039e0 msgr2=0x7f2bc0103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.661+0000 7f2bc5dcf640 1 --2- 172.21.15.22:0/278882549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bc01039e0 0x7f2bc0103dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009900 tx=0x7f2bb002a410 comp rx=0 tx=0).stop 2024-08-20T01:29:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.661+0000 7f2bc5dcf640 1 -- 172.21.15.22:0/278882549 shutdown_connections 2024-08-20T01:29:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.661+0000 7f2bc5dcf640 1 --2- 172.21.15.22:0/278882549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bc010ce40 0x7f2bc010f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.661+0000 7f2bc5dcf640 1 --2- 172.21.15.22:0/278882549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bc0104300 0x7f2bc010c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.661+0000 7f2bc5dcf640 1 --2- 172.21.15.22:0/278882549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bc01039e0 0x7f2bc0103dc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.661+0000 7f2bc5dcf640 1 -- 172.21.15.22:0/278882549 >> 172.21.15.22:0/278882549 conn(0x7f2bc00fd440 msgr2=0x7f2bc00ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.661+0000 7f2bc5dcf640 1 -- 172.21.15.22:0/278882549 shutdown_connections 2024-08-20T01:29:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.661+0000 7f2bc5dcf640 1 -- 172.21.15.22:0/278882549 wait complete. 2024-08-20T01:29:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.662+0000 7f2bc5dcf640 1 Processor -- start 2024-08-20T01:29:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.662+0000 7f2bc5dcf640 1 -- start start 2024-08-20T01:29:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.662+0000 7f2bc5dcf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bc01039e0 0x7f2bc0101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:24.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.662+0000 7f2bc5dcf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bc0104300 0x7f2bc0101bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:24.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.662+0000 7f2bc5dcf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bc010ce40 0x7f2bc0102110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:24.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.662+0000 7f2bc5dcf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc0112b10 con 0x7f2bc0104300 2024-08-20T01:29:24.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.662+0000 7f2bc5dcf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc0112990 con 0x7f2bc01039e0 2024-08-20T01:29:24.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.662+0000 7f2bc5dcf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc0112c90 con 0x7f2bc010ce40 2024-08-20T01:29:24.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.662+0000 7f2bbeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bc0104300 0x7f2bc0101bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:24.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.663+0000 7f2bbeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bc0104300 0x7f2bc0101bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54314/0 (socket says 172.21.15.22:54314) 2024-08-20T01:29:24.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.663+0000 7f2bbeffd640 1 -- 172.21.15.22:0/1151291368 learned_addr learned my addr 172.21.15.22:0/1151291368 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:24.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.663+0000 7f2bbffff640 1 --2- 172.21.15.22:0/1151291368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bc010ce40 0x7f2bc0102110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:24.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.663+0000 7f2bbf7fe640 1 --2- 172.21.15.22:0/1151291368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bc01039e0 0x7f2bc0101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:24.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.663+0000 7f2bbeffd640 1 -- 172.21.15.22:0/1151291368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bc010ce40 msgr2=0x7f2bc0102110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:24.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.663+0000 7f2bbeffd640 1 --2- 172.21.15.22:0/1151291368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bc010ce40 0x7f2bc0102110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:24.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.663+0000 7f2bbeffd640 1 -- 172.21.15.22:0/1151291368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bc01039e0 msgr2=0x7f2bc0101690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:24.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.663+0000 7f2bbeffd640 1 --2- 172.21.15.22:0/1151291368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bc01039e0 0x7f2bc0101690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:24.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.663+0000 7f2bbeffd640 1 -- 172.21.15.22:0/1151291368 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc01a7540 con 0x7f2bc0104300 2024-08-20T01:29:24.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.663+0000 7f2bbeffd640 1 --2- 172.21.15.22:0/1151291368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bc0104300 0x7f2bc0101bd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400d6b0 tx=0x7f2bb400db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:24.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.663+0000 7f2bbcff9640 1 -- 172.21.15.22:0/1151291368 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4017070 con 0x7f2bc0104300 2024-08-20T01:29:24.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.663+0000 7f2bbcff9640 1 -- 172.21.15.22:0/1151291368 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bb4010460 con 0x7f2bc0104300 2024-08-20T01:29:24.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.663+0000 7f2bc5dcf640 1 -- 172.21.15.22:0/1151291368 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bc01a7830 con 0x7f2bc0104300 2024-08-20T01:29:24.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.663+0000 7f2bbcff9640 1 -- 172.21.15.22:0/1151291368 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb400f620 con 0x7f2bc0104300 2024-08-20T01:29:24.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.663+0000 7f2bc5dcf640 1 -- 172.21.15.22:0/1151291368 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bc01a7d20 con 0x7f2bc0104300 2024-08-20T01:29:24.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.664+0000 7f2bc5dcf640 1 -- 172.21.15.22:0/1151291368 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bc0103dc0 con 0x7f2bc0104300 2024-08-20T01:29:24.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.666+0000 7f2bbcff9640 1 -- 172.21.15.22:0/1151291368 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f2bb401a070 con 0x7f2bc0104300 2024-08-20T01:29:24.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.666+0000 7f2bbcff9640 1 --2- 172.21.15.22:0/1151291368 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2ba80b3c60 0x7f2ba80b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:24.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.667+0000 7f2bbf7fe640 1 --2- 172.21.15.22:0/1151291368 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2ba80b3c60 0x7f2ba80b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:24.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.667+0000 7f2bbcff9640 1 -- 172.21.15.22:0/1151291368 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f2bb40e36a0 con 0x7f2bc0104300 2024-08-20T01:29:24.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.667+0000 7f2bbf7fe640 1 --2- 172.21.15.22:0/1151291368 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2ba80b3c60 0x7f2ba80b6120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0031440 tx=0x7f2bb00095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:24.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.669+0000 7f2bbcff9640 1 -- 172.21.15.22:0/1151291368 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f2bb40aac40 con 0x7f2bc0104300 2024-08-20T01:29:24.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:24 smithi134 ceph-mon[22511]: pgmap v290: 97 pgs: 97 active+clean; 588 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-08-20T01:29:24.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:24 smithi134 ceph-mon[22511]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:24.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:24 smithi077 ceph-mon[22251]: pgmap v290: 97 pgs: 97 active+clean; 588 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-08-20T01:29:24.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:24 smithi077 ceph-mon[22251]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:24.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.880+0000 7f2bc5dcf640 1 -- 172.21.15.22:0/1151291368 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f2bc0107f10 con 0x7f2ba80b3c60 2024-08-20T01:29:24.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.905+0000 7f2bbcff9640 1 -- 172.21.15.22:0/1151291368 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2bc0107f10 con 0x7f2ba80b3c60 2024-08-20T01:29:24.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.907+0000 7f2bc5dcf640 1 -- 172.21.15.22:0/1151291368 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2ba80b3c60 msgr2=0x7f2ba80b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:24.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.907+0000 7f2bc5dcf640 1 --2- 172.21.15.22:0/1151291368 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2ba80b3c60 0x7f2ba80b6120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0031440 tx=0x7f2bb00095f0 comp rx=0 tx=0).stop 2024-08-20T01:29:24.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.907+0000 7f2bc5dcf640 1 -- 172.21.15.22:0/1151291368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bc0104300 msgr2=0x7f2bc0101bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:24.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.907+0000 7f2bc5dcf640 1 --2- 172.21.15.22:0/1151291368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bc0104300 0x7f2bc0101bd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400d6b0 tx=0x7f2bb400db70 comp rx=0 tx=0).stop 2024-08-20T01:29:24.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.907+0000 7f2bc5dcf640 1 -- 172.21.15.22:0/1151291368 shutdown_connections 2024-08-20T01:29:24.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.907+0000 7f2bc5dcf640 1 --2- 172.21.15.22:0/1151291368 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2ba80b3c60 0x7f2ba80b6120 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:24.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.907+0000 7f2bc5dcf640 1 --2- 172.21.15.22:0/1151291368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bc010ce40 0x7f2bc0102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:24.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.907+0000 7f2bc5dcf640 1 --2- 172.21.15.22:0/1151291368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bc0104300 0x7f2bc0101bd0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:24.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.907+0000 7f2bc5dcf640 1 --2- 172.21.15.22:0/1151291368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bc01039e0 0x7f2bc0101690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:24.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.907+0000 7f2bc5dcf640 1 -- 172.21.15.22:0/1151291368 >> 172.21.15.22:0/1151291368 conn(0x7f2bc00fd440 msgr2=0x7f2bc00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:24.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.907+0000 7f2bc5dcf640 1 -- 172.21.15.22:0/1151291368 shutdown_connections 2024-08-20T01:29:24.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:24.907+0000 7f2bc5dcf640 1 -- 172.21.15.22:0/1151291368 wait complete. 2024-08-20T01:29:25.524 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:25 smithi022 ceph-mon[18709]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:25.553 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-08-20T01:29:25.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:25 smithi134 ceph-mon[22511]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:25.811 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:25.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:25 smithi077 ceph-mon[22251]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:26.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.246+0000 7fb9b3ad9640 1 -- 172.21.15.22:0/3935570390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9ac100ae0 msgr2=0x7fb9ac100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:26.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.246+0000 7fb9b3ad9640 1 --2- 172.21.15.22:0/3935570390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9ac100ae0 0x7fb9ac100ec0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009900 tx=0x7fb9a802a410 comp rx=0 tx=0).stop 2024-08-20T01:29:26.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.246+0000 7fb9b3ad9640 1 -- 172.21.15.22:0/3935570390 shutdown_connections 2024-08-20T01:29:26.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.246+0000 7fb9b3ad9640 1 --2- 172.21.15.22:0/3935570390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9ac108ef0 0x7fb9ac10f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:26.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.246+0000 7fb9b3ad9640 1 --2- 172.21.15.22:0/3935570390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9ac108550 0x7fb9ac1089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:26.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.246+0000 7fb9b3ad9640 1 --2- 172.21.15.22:0/3935570390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9ac100ae0 0x7fb9ac100ec0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:26.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.246+0000 7fb9b3ad9640 1 -- 172.21.15.22:0/3935570390 >> 172.21.15.22:0/3935570390 conn(0x7fb9ac0fc730 msgr2=0x7fb9ac0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:26.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.247+0000 7fb9b3ad9640 1 -- 172.21.15.22:0/3935570390 shutdown_connections 2024-08-20T01:29:26.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.247+0000 7fb9b3ad9640 1 -- 172.21.15.22:0/3935570390 wait complete. 2024-08-20T01:29:26.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.247+0000 7fb9b3ad9640 1 Processor -- start 2024-08-20T01:29:26.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.247+0000 7fb9b3ad9640 1 -- start start 2024-08-20T01:29:26.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.247+0000 7fb9b3ad9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9ac100ae0 0x7fb9ac198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:26.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.247+0000 7fb9b3ad9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9ac108550 0x7fb9ac199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:26.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.247+0000 7fb9b3ad9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9ac108ef0 0x7fb9ac19e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:26.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.247+0000 7fb9b3ad9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac112a70 con 0x7fb9ac108550 2024-08-20T01:29:26.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.247+0000 7fb9b3ad9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac1128f0 con 0x7fb9ac108ef0 2024-08-20T01:29:26.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.247+0000 7fb9b3ad9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac112bf0 con 0x7fb9ac100ae0 2024-08-20T01:29:26.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.248+0000 7fb9b1074640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9ac108550 0x7fb9ac199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:26.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.248+0000 7fb9b1074640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9ac108550 0x7fb9ac199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54332/0 (socket says 172.21.15.22:54332) 2024-08-20T01:29:26.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.248+0000 7fb9b1074640 1 -- 172.21.15.22:0/1003943068 learned_addr learned my addr 172.21.15.22:0/1003943068 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:26.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.248+0000 7fb9b1875640 1 --2- 172.21.15.22:0/1003943068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9ac100ae0 0x7fb9ac198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:26.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.248+0000 7fb9b2076640 1 --2- 172.21.15.22:0/1003943068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9ac108ef0 0x7fb9ac19e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:26.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.248+0000 7fb9b1074640 1 -- 172.21.15.22:0/1003943068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9ac100ae0 msgr2=0x7fb9ac198f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:26.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.248+0000 7fb9b1074640 1 --2- 172.21.15.22:0/1003943068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9ac100ae0 0x7fb9ac198f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:26.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.248+0000 7fb9b1074640 1 -- 172.21.15.22:0/1003943068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9ac108ef0 msgr2=0x7fb9ac19e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:26.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.248+0000 7fb9b1074640 1 --2- 172.21.15.22:0/1003943068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9ac108ef0 0x7fb9ac19e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:26.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.248+0000 7fb9b1074640 1 -- 172.21.15.22:0/1003943068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ac19efb0 con 0x7fb9ac108550 2024-08-20T01:29:26.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.248+0000 7fb9b1074640 1 --2- 172.21.15.22:0/1003943068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9ac108550 0x7fb9ac199440 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00e9f0 tx=0x7fb99c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:26.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.248+0000 7fb9a2ffd640 1 -- 172.21.15.22:0/1003943068 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c00cd80 con 0x7fb9ac108550 2024-08-20T01:29:26.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.248+0000 7fb9a2ffd640 1 -- 172.21.15.22:0/1003943068 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb99c0108e0 con 0x7fb9ac108550 2024-08-20T01:29:26.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.248+0000 7fb9a2ffd640 1 -- 172.21.15.22:0/1003943068 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c018980 con 0x7fb9ac108550 2024-08-20T01:29:26.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.248+0000 7fb9b3ad9640 1 -- 172.21.15.22:0/1003943068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9ac19f2a0 con 0x7fb9ac108550 2024-08-20T01:29:26.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.248+0000 7fb9b3ad9640 1 -- 172.21.15.22:0/1003943068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9ac1023f0 con 0x7fb9ac108550 2024-08-20T01:29:26.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.250+0000 7fb9b3ad9640 1 -- 172.21.15.22:0/1003943068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9ac101b20 con 0x7fb9ac108550 2024-08-20T01:29:26.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.251+0000 7fb9a2ffd640 1 -- 172.21.15.22:0/1003943068 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fb99c010430 con 0x7fb9ac108550 2024-08-20T01:29:26.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.252+0000 7fb9a2ffd640 1 --2- 172.21.15.22:0/1003943068 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb9980b3ce0 0x7fb9980b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:26.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.253+0000 7fb9b1875640 1 --2- 172.21.15.22:0/1003943068 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb9980b3ce0 0x7fb9980b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:26.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.253+0000 7fb9a2ffd640 1 -- 172.21.15.22:0/1003943068 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fb99c0e4410 con 0x7fb9ac108550 2024-08-20T01:29:26.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.253+0000 7fb9b1875640 1 --2- 172.21.15.22:0/1003943068 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb9980b3ce0 0x7fb9980b61a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8031440 tx=0x7fb9a8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:26.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.255+0000 7fb9a2ffd640 1 -- 172.21.15.22:0/1003943068 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fb99c0aba30 con 0x7fb9ac108550 2024-08-20T01:29:26.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.467+0000 7fb9b3ad9640 1 -- 172.21.15.22:0/1003943068 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fb9ac0fe6d0 con 0x7fb9980b3ce0 2024-08-20T01:29:26.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.471+0000 7fb9a2ffd640 1 -- 172.21.15.22:0/1003943068 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fb9ac0fe6d0 con 0x7fb9980b3ce0 2024-08-20T01:29:26.473 INFO:teuthology.orchestra.run.smithi022.stdout:/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd 2024-08-20T01:29:26.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.473+0000 7fb9b3ad9640 1 -- 172.21.15.22:0/1003943068 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb9980b3ce0 msgr2=0x7fb9980b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:26.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.473+0000 7fb9b3ad9640 1 --2- 172.21.15.22:0/1003943068 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb9980b3ce0 0x7fb9980b61a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8031440 tx=0x7fb9a8005b50 comp rx=0 tx=0).stop 2024-08-20T01:29:26.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.473+0000 7fb9b3ad9640 1 -- 172.21.15.22:0/1003943068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9ac108550 msgr2=0x7fb9ac199440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:26.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.473+0000 7fb9b3ad9640 1 --2- 172.21.15.22:0/1003943068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9ac108550 0x7fb9ac199440 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00e9f0 tx=0x7fb99c00eeb0 comp rx=0 tx=0).stop 2024-08-20T01:29:26.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.474+0000 7fb9b3ad9640 1 -- 172.21.15.22:0/1003943068 shutdown_connections 2024-08-20T01:29:26.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.474+0000 7fb9b3ad9640 1 --2- 172.21.15.22:0/1003943068 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb9980b3ce0 0x7fb9980b61a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:26.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.474+0000 7fb9b3ad9640 1 --2- 172.21.15.22:0/1003943068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9ac108ef0 0x7fb9ac19e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:26.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.474+0000 7fb9b3ad9640 1 --2- 172.21.15.22:0/1003943068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9ac108550 0x7fb9ac199440 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:26.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.474+0000 7fb9b3ad9640 1 --2- 172.21.15.22:0/1003943068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9ac100ae0 0x7fb9ac198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:26.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.474+0000 7fb9b3ad9640 1 -- 172.21.15.22:0/1003943068 >> 172.21.15.22:0/1003943068 conn(0x7fb9ac0fc730 msgr2=0x7fb9ac0fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:26.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.474+0000 7fb9b3ad9640 1 -- 172.21.15.22:0/1003943068 shutdown_connections 2024-08-20T01:29:26.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:26.474+0000 7fb9b3ad9640 1 -- 172.21.15.22:0/1003943068 wait complete. 2024-08-20T01:29:26.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:26 smithi134 ceph-mon[22511]: pgmap v291: 97 pgs: 97 active+clean; 588 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.8 KiB/s wr, 12 op/s 2024-08-20T01:29:26.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:26 smithi077 ceph-mon[22251]: pgmap v291: 97 pgs: 97 active+clean; 588 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.8 KiB/s wr, 12 op/s 2024-08-20T01:29:26.832 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:26 smithi022 ceph-mon[18709]: pgmap v291: 97 pgs: 97 active+clean; 588 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.8 KiB/s wr, 12 op/s 2024-08-20T01:29:27.221 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:29:27.478 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:27.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:27 smithi134 ceph-mon[22511]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:27.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:27 smithi077 ceph-mon[22251]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:27.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:27 smithi022 ceph-mon[18709]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:27.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.934+0000 7f3ca5d3f640 1 -- 172.21.15.22:0/2627425287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca01084c0 msgr2=0x7f3ca0108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:27.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.934+0000 7f3ca5d3f640 1 --2- 172.21.15.22:0/2627425287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca01084c0 0x7f3ca0108900 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3c94009900 tx=0x7f3c9402a410 comp rx=0 tx=0).stop 2024-08-20T01:29:27.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.934+0000 7f3ca5d3f640 1 -- 172.21.15.22:0/2627425287 shutdown_connections 2024-08-20T01:29:27.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.934+0000 7f3ca5d3f640 1 --2- 172.21.15.22:0/2627425287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca0108e40 0x7f3ca010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:27.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.934+0000 7f3ca5d3f640 1 --2- 172.21.15.22:0/2627425287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca01084c0 0x7f3ca0108900 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:27.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.934+0000 7f3ca5d3f640 1 --2- 172.21.15.22:0/2627425287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca0102ab0 0x7f3ca0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:27.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.934+0000 7f3ca5d3f640 1 -- 172.21.15.22:0/2627425287 >> 172.21.15.22:0/2627425287 conn(0x7f3ca00fe500 msgr2=0x7f3ca0100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:27.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.934+0000 7f3ca5d3f640 1 -- 172.21.15.22:0/2627425287 shutdown_connections 2024-08-20T01:29:27.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.934+0000 7f3ca5d3f640 1 -- 172.21.15.22:0/2627425287 wait complete. 2024-08-20T01:29:27.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.934+0000 7f3ca5d3f640 1 Processor -- start 2024-08-20T01:29:27.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.935+0000 7f3ca5d3f640 1 -- start start 2024-08-20T01:29:27.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.935+0000 7f3ca5d3f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca0102ab0 0x7f3ca0198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:27.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.935+0000 7f3ca5d3f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca01084c0 0x7f3ca0199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:27.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.935+0000 7f3ca5d3f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca0108e40 0x7f3ca019e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:27.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.935+0000 7f3ca5d3f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca0112ac0 con 0x7f3ca01084c0 2024-08-20T01:29:27.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.935+0000 7f3ca5d3f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca0112940 con 0x7f3ca0108e40 2024-08-20T01:29:27.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.935+0000 7f3ca5d3f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca0112c40 con 0x7f3ca0102ab0 2024-08-20T01:29:27.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.935+0000 7f3c9effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca01084c0 0x7f3ca0199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:27.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.935+0000 7f3c9effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca01084c0 0x7f3ca0199490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54354/0 (socket says 172.21.15.22:54354) 2024-08-20T01:29:27.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.935+0000 7f3c9effd640 1 -- 172.21.15.22:0/2609953068 learned_addr learned my addr 172.21.15.22:0/2609953068 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:27.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.935+0000 7f3c9ffff640 1 --2- 172.21.15.22:0/2609953068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca0108e40 0x7f3ca019e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:27.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.935+0000 7f3c9f7fe640 1 --2- 172.21.15.22:0/2609953068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca0102ab0 0x7f3ca0198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:27.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.935+0000 7f3c9effd640 1 -- 172.21.15.22:0/2609953068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca0102ab0 msgr2=0x7f3ca0198f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:27.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.935+0000 7f3c9effd640 1 --2- 172.21.15.22:0/2609953068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca0102ab0 0x7f3ca0198f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:27.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.935+0000 7f3c9effd640 1 -- 172.21.15.22:0/2609953068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca0108e40 msgr2=0x7f3ca019e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:27.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.935+0000 7f3c9effd640 1 --2- 172.21.15.22:0/2609953068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca0108e40 0x7f3ca019e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:27.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.935+0000 7f3c9effd640 1 -- 172.21.15.22:0/2609953068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca019f000 con 0x7f3ca01084c0 2024-08-20T01:29:27.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.935+0000 7f3c9effd640 1 --2- 172.21.15.22:0/2609953068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca01084c0 0x7f3ca0199490 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3c94005940 tx=0x7f3c940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:27.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.936+0000 7f3c9cff9640 1 -- 172.21.15.22:0/2609953068 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9403f030 con 0x7f3ca01084c0 2024-08-20T01:29:27.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.936+0000 7f3ca5d3f640 1 -- 172.21.15.22:0/2609953068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca019f290 con 0x7f3ca01084c0 2024-08-20T01:29:27.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.936+0000 7f3c9cff9640 1 -- 172.21.15.22:0/2609953068 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c94003cb0 con 0x7f3ca01084c0 2024-08-20T01:29:27.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.936+0000 7f3c9cff9640 1 -- 172.21.15.22:0/2609953068 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c94035070 con 0x7f3ca01084c0 2024-08-20T01:29:27.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.936+0000 7f3ca5d3f640 1 -- 172.21.15.22:0/2609953068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca01a59b0 con 0x7f3ca01084c0 2024-08-20T01:29:27.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.937+0000 7f3ca5d3f640 1 -- 172.21.15.22:0/2609953068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca0102e90 con 0x7f3ca01084c0 2024-08-20T01:29:27.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.938+0000 7f3c9cff9640 1 -- 172.21.15.22:0/2609953068 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f3c94042030 con 0x7f3ca01084c0 2024-08-20T01:29:27.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.939+0000 7f3c9cff9640 1 --2- 172.21.15.22:0/2609953068 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3c880b3c60 0x7f3c880b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:27.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.939+0000 7f3c9f7fe640 1 --2- 172.21.15.22:0/2609953068 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3c880b3c60 0x7f3c880b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:27.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.939+0000 7f3c9cff9640 1 -- 172.21.15.22:0/2609953068 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f3c94104810 con 0x7f3ca01084c0 2024-08-20T01:29:27.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.940+0000 7f3c9f7fe640 1 --2- 172.21.15.22:0/2609953068 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3c880b3c60 0x7f3c880b6120 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3c90005fd0 tx=0x7f3c90009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:27.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:27.942+0000 7f3c9cff9640 1 -- 172.21.15.22:0/2609953068 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f3c940cb760 con 0x7f3ca01084c0 2024-08-20T01:29:28.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:28.164+0000 7f3ca5d3f640 1 -- 172.21.15.22:0/2609953068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ca019a080 con 0x7f3ca01084c0 2024-08-20T01:29:28.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:28.164+0000 7f3c9cff9640 1 -- 172.21.15.22:0/2609953068 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11906 (secure 0 0 0) 0x7f3c940cfcb0 con 0x7f3ca01084c0 2024-08-20T01:29:28.166 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:29:28.166 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"btime":"2024-08-20T01:29:18:472908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:29:18.048623+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24565,24575,24586]},"id":1}]} 2024-08-20T01:29:28.167 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 24 2024-08-20T01:29:28.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:28.166+0000 7f3ca5d3f640 1 -- 172.21.15.22:0/2609953068 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3c880b3c60 msgr2=0x7f3c880b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:28.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:28.166+0000 7f3ca5d3f640 1 --2- 172.21.15.22:0/2609953068 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3c880b3c60 0x7f3c880b6120 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3c90005fd0 tx=0x7f3c90009680 comp rx=0 tx=0).stop 2024-08-20T01:29:28.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:28.166+0000 7f3ca5d3f640 1 -- 172.21.15.22:0/2609953068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca01084c0 msgr2=0x7f3ca0199490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:28.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:28.166+0000 7f3ca5d3f640 1 --2- 172.21.15.22:0/2609953068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca01084c0 0x7f3ca0199490 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3c94005940 tx=0x7f3c940042f0 comp rx=0 tx=0).stop 2024-08-20T01:29:28.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:28.167+0000 7f3ca5d3f640 1 -- 172.21.15.22:0/2609953068 shutdown_connections 2024-08-20T01:29:28.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:28.167+0000 7f3ca5d3f640 1 --2- 172.21.15.22:0/2609953068 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3c880b3c60 0x7f3c880b6120 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:28.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:28.167+0000 7f3ca5d3f640 1 --2- 172.21.15.22:0/2609953068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca0108e40 0x7f3ca019e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:28.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:28.167+0000 7f3ca5d3f640 1 --2- 172.21.15.22:0/2609953068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca01084c0 0x7f3ca0199490 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:28.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:28.167+0000 7f3ca5d3f640 1 --2- 172.21.15.22:0/2609953068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca0102ab0 0x7f3ca0198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:28.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:28.167+0000 7f3ca5d3f640 1 -- 172.21.15.22:0/2609953068 >> 172.21.15.22:0/2609953068 conn(0x7f3ca00fe500 msgr2=0x7f3ca01008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:28.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:28.167+0000 7f3ca5d3f640 1 -- 172.21.15.22:0/2609953068 shutdown_connections 2024-08-20T01:29:28.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:28.167+0000 7f3ca5d3f640 1 -- 172.21.15.22:0/2609953068 wait complete. 2024-08-20T01:29:28.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:28 smithi134 ceph-mon[22511]: pgmap v292: 97 pgs: 97 active+clean; 621 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2024-08-20T01:29:28.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:28 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2609953068' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:29:28.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:28 smithi077 ceph-mon[22251]: pgmap v292: 97 pgs: 97 active+clean; 621 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2024-08-20T01:29:28.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:28 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2609953068' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:29:28.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:28 smithi022 ceph-mon[18709]: pgmap v292: 97 pgs: 97 active+clean; 621 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2024-08-20T01:29:28.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:28 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2609953068' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:29:28.963 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:29:29.227 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.718+0000 7fe1d3e37640 1 -- 172.21.15.22:0/3117150667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1cc1084e0 msgr2=0x7fe1cc108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.718+0000 7fe1d3e37640 1 --2- 172.21.15.22:0/3117150667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1cc1084e0 0x7fe1cc108920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009900 tx=0x7fe1bc02a3f0 comp rx=0 tx=0).stop 2024-08-20T01:29:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.718+0000 7fe1d3e37640 1 -- 172.21.15.22:0/3117150667 shutdown_connections 2024-08-20T01:29:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.718+0000 7fe1d3e37640 1 --2- 172.21.15.22:0/3117150667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1cc108e60 0x7fe1cc10f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.718+0000 7fe1d3e37640 1 --2- 172.21.15.22:0/3117150667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1cc1084e0 0x7fe1cc108920 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.718+0000 7fe1d3e37640 1 --2- 172.21.15.22:0/3117150667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1cc102ad0 0x7fe1cc102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.718+0000 7fe1d3e37640 1 -- 172.21.15.22:0/3117150667 >> 172.21.15.22:0/3117150667 conn(0x7fe1cc0fe540 msgr2=0x7fe1cc100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.718+0000 7fe1d3e37640 1 -- 172.21.15.22:0/3117150667 shutdown_connections 2024-08-20T01:29:29.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.718+0000 7fe1d3e37640 1 -- 172.21.15.22:0/3117150667 wait complete. 2024-08-20T01:29:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.719+0000 7fe1d3e37640 1 Processor -- start 2024-08-20T01:29:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.719+0000 7fe1d3e37640 1 -- start start 2024-08-20T01:29:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.719+0000 7fe1d3e37640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1cc102ad0 0x7fe1cc199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.719+0000 7fe1d3e37640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1cc1084e0 0x7fe1cc199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.719+0000 7fe1d3e37640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1cc108e60 0x7fe1cc19ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.719+0000 7fe1d3e37640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc112b60 con 0x7fe1cc102ad0 2024-08-20T01:29:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.719+0000 7fe1d3e37640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc1129e0 con 0x7fe1cc1084e0 2024-08-20T01:29:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.719+0000 7fe1d3e37640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc112ce0 con 0x7fe1cc108e60 2024-08-20T01:29:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.719+0000 7fe1d1bd3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1cc102ad0 0x7fe1cc199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.719+0000 7fe1d1bd3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1cc102ad0 0x7fe1cc199150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46886/0 (socket says 172.21.15.22:46886) 2024-08-20T01:29:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.719+0000 7fe1d1bd3640 1 -- 172.21.15.22:0/1722672221 learned_addr learned my addr 172.21.15.22:0/1722672221 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.720+0000 7fe1d23d4640 1 --2- 172.21.15.22:0/1722672221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1cc108e60 0x7fe1cc19ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.720+0000 7fe1d13d2640 1 --2- 172.21.15.22:0/1722672221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1cc1084e0 0x7fe1cc199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.720+0000 7fe1d1bd3640 1 -- 172.21.15.22:0/1722672221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1cc108e60 msgr2=0x7fe1cc19ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.720+0000 7fe1d1bd3640 1 --2- 172.21.15.22:0/1722672221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1cc108e60 0x7fe1cc19ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.720+0000 7fe1d1bd3640 1 -- 172.21.15.22:0/1722672221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1cc1084e0 msgr2=0x7fe1cc199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.720+0000 7fe1d1bd3640 1 --2- 172.21.15.22:0/1722672221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1cc1084e0 0x7fe1cc199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.720+0000 7fe1d1bd3640 1 -- 172.21.15.22:0/1722672221 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1cc19f200 con 0x7fe1cc102ad0 2024-08-20T01:29:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.720+0000 7fe1d23d4640 1 --2- 172.21.15.22:0/1722672221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1cc108e60 0x7fe1cc19ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:29:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.720+0000 7fe1d13d2640 1 --2- 172.21.15.22:0/1722672221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1cc1084e0 0x7fe1cc199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:29:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.720+0000 7fe1d1bd3640 1 --2- 172.21.15.22:0/1722672221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1cc102ad0 0x7fe1cc199150 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800b4a0 tx=0x7fe1c800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.720+0000 7fe1c2ffd640 1 -- 172.21.15.22:0/1722672221 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8014070 con 0x7fe1cc102ad0 2024-08-20T01:29:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.720+0000 7fe1d3e37640 1 -- 172.21.15.22:0/1722672221 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1cc19f4f0 con 0x7fe1cc102ad0 2024-08-20T01:29:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.720+0000 7fe1c2ffd640 1 -- 172.21.15.22:0/1722672221 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1c8010ac0 con 0x7fe1cc102ad0 2024-08-20T01:29:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.720+0000 7fe1c2ffd640 1 -- 172.21.15.22:0/1722672221 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8017c30 con 0x7fe1cc102ad0 2024-08-20T01:29:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.720+0000 7fe1d3e37640 1 -- 172.21.15.22:0/1722672221 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1cc1a5bb0 con 0x7fe1cc102ad0 2024-08-20T01:29:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.721+0000 7fe1d3e37640 1 -- 172.21.15.22:0/1722672221 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1cc102f30 con 0x7fe1cc102ad0 2024-08-20T01:29:29.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.723+0000 7fe1c2ffd640 1 -- 172.21.15.22:0/1722672221 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fe1c8017070 con 0x7fe1cc102ad0 2024-08-20T01:29:29.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.724+0000 7fe1c2ffd640 1 --2- 172.21.15.22:0/1722672221 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe1b80b3c60 0x7fe1b80b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:29.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.724+0000 7fe1d13d2640 1 --2- 172.21.15.22:0/1722672221 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe1b80b3c60 0x7fe1b80b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:29.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.724+0000 7fe1c2ffd640 1 -- 172.21.15.22:0/1722672221 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fe1c80e3380 con 0x7fe1cc102ad0 2024-08-20T01:29:29.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.724+0000 7fe1d13d2640 1 --2- 172.21.15.22:0/1722672221 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe1b80b3c60 0x7fe1b80b6120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc000c00 tx=0x7fe1bc031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:29.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.727+0000 7fe1c2ffd640 1 -- 172.21.15.22:0/1722672221 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe1c80aaa30 con 0x7fe1cc102ad0 2024-08-20T01:29:29.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.912+0000 7fe1d3e37640 1 -- 172.21.15.22:0/1722672221 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1cc02e340 con 0x7fe1cc102ad0 2024-08-20T01:29:29.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.914+0000 7fe1c2ffd640 1 -- 172.21.15.22:0/1722672221 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22230 (secure 0 0 0) 0x7fe1c80aa330 con 0x7fe1cc102ad0 2024-08-20T01:29:29.916 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:29:29.916 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":75,"fsid":"586fd06c-5e92-11ef-bccf-c7b262605968","created":"2024-08-20T01:20:55.065729+0000","modified":"2024-08-20T01:29:07.003098+0000","last_up_change":"2024-08-20T01:28:14.752931+0000","last_in_change":"2024-08-20T01:27:51.812525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:24:31.674035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:29:02.800545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:29:04.951975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b67a59af-5eea-4073-a4b2-604a1b7b8f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6803","nonce":812056903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6805","nonce":812056903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6809","nonce":812056903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6807","nonce":812056903}]},"public_addr":"172.21.15.22:6803/812056903","cluster_addr":"172.21.15.22:6805/812056903","heartbeat_back_addr":"172.21.15.22:6809/812056903","heartbeat_front_addr":"172.21.15.22:6807/812056903","state":["exists","up"]},{"osd":1,"uuid":"9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6801","nonce":823882511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6803","nonce":823882511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6807","nonce":823882511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6805","nonce":823882511}]},"public_addr":"172.21.15.77:6801/823882511","cluster_addr":"172.21.15.77:6803/823882511","heartbeat_back_addr":"172.21.15.77:6807/823882511","heartbeat_front_addr":"172.21.15.77:6805/823882511","state":["exists","up"]},{"osd":2,"uuid":"71e3c019-a3e0-4632-81a8-27ac31279f7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6801","nonce":3873702897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6803","nonce":3873702897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6807","nonce":3873702897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6805","nonce":3873702897}]},"public_addr":"172.21.15.134:6801/3873702897","cluster_addr":"172.21.15.134:6803/3873702897","heartbeat_back_addr":"172.21.15.134:6807/3873702897","heartbeat_front_addr":"172.21.15.134:6805/3873702897","state":["exists","up"]},{"osd":3,"uuid":"a60de748-aa65-477d-864e-6281db1261ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6811","nonce":1775946906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6813","nonce":1775946906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6817","nonce":1775946906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6815","nonce":1775946906}]},"public_addr":"172.21.15.22:6811/1775946906","cluster_addr":"172.21.15.22:6813/1775946906","heartbeat_back_addr":"172.21.15.22:6817/1775946906","heartbeat_front_addr":"172.21.15.22:6815/1775946906","state":["exists","up"]},{"osd":4,"uuid":"07d99671-2ece-471c-ad69-fc9043d917f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6809","nonce":1954209322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6811","nonce":1954209322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6815","nonce":1954209322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6813","nonce":1954209322}]},"public_addr":"172.21.15.77:6809/1954209322","cluster_addr":"172.21.15.77:6811/1954209322","heartbeat_back_addr":"172.21.15.77:6815/1954209322","heartbeat_front_addr":"172.21.15.77:6813/1954209322","state":["exists","up"]},{"osd":5,"uuid":"971cac33-0b98-49b1-b4b2-27354fc0ab90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6809","nonce":2805488123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6811","nonce":2805488123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6815","nonce":2805488123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6813","nonce":2805488123}]},"public_addr":"172.21.15.134:6809/2805488123","cluster_addr":"172.21.15.134:6811/2805488123","heartbeat_back_addr":"172.21.15.134:6815/2805488123","heartbeat_front_addr":"172.21.15.134:6813/2805488123","state":["exists","up"]},{"osd":6,"uuid":"48d90292-8511-47d6-8093-330bd13ae70e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6819","nonce":3804882416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6821","nonce":3804882416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6825","nonce":3804882416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6823","nonce":3804882416}]},"public_addr":"172.21.15.22:6819/3804882416","cluster_addr":"172.21.15.22:6821/3804882416","heartbeat_back_addr":"172.21.15.22:6825/3804882416","heartbeat_front_addr":"172.21.15.22:6823/3804882416","state":["exists","up"]},{"osd":7,"uuid":"e217112d-9f56-4a48-93bf-6eb052ce540a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6817","nonce":700318902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6819","nonce":700318902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6823","nonce":700318902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6821","nonce":700318902}]},"public_addr":"172.21.15.77:6817/700318902","cluster_addr":"172.21.15.77:6819/700318902","heartbeat_back_addr":"172.21.15.77:6823/700318902","heartbeat_front_addr":"172.21.15.77:6821/700318902","state":["exists","up"]},{"osd":8,"uuid":"1786747c-6ff6-4e00-bcf6-a8176215847f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6817","nonce":1635473481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6819","nonce":1635473481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6823","nonce":1635473481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6821","nonce":1635473481}]},"public_addr":"172.21.15.134:6817/1635473481","cluster_addr":"172.21.15.134:6819/1635473481","heartbeat_back_addr":"172.21.15.134:6823/1635473481","heartbeat_front_addr":"172.21.15.134:6821/1635473481","state":["exists","up"]},{"osd":9,"uuid":"708f7390-1b51-4397-a92a-8ff3f4a5bc45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6827","nonce":3899297933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6829","nonce":3899297933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6833","nonce":3899297933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6831","nonce":3899297933}]},"public_addr":"172.21.15.22:6827/3899297933","cluster_addr":"172.21.15.22:6829/3899297933","heartbeat_back_addr":"172.21.15.22:6833/3899297933","heartbeat_front_addr":"172.21.15.22:6831/3899297933","state":["exists","up"]},{"osd":10,"uuid":"d15b0acd-dd08-431d-88aa-756b6420987d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6825","nonce":2765589872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6827","nonce":2765589872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6831","nonce":2765589872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6829","nonce":2765589872}]},"public_addr":"172.21.15.77:6825/2765589872","cluster_addr":"172.21.15.77:6827/2765589872","heartbeat_back_addr":"172.21.15.77:6831/2765589872","heartbeat_front_addr":"172.21.15.77:6829/2765589872","state":["exists","up"]},{"osd":11,"uuid":"d15017fa-3c3d-4096-a35d-275cd54bb9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6825","nonce":964533669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6827","nonce":964533669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6831","nonce":964533669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6829","nonce":964533669}]},"public_addr":"172.21.15.134:6825/964533669","cluster_addr":"172.21.15.134:6827/964533669","heartbeat_back_addr":"172.21.15.134:6831/964533669","heartbeat_front_addr":"172.21.15.134:6829/964533669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:23:40.839725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:05.141389+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:28.340737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:52.028949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:17.029913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:42.092826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:07.831100+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:33.380447+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:58.772655+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:23.017208+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:47.966711+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:28:13.123047+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/416470260":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6800/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/1142422661":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:6800/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/2093308719":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/3772866379":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3424402756":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3864772624":"2024-08-21T01:21:28.981981+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:29:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.916+0000 7fe1d3e37640 1 -- 172.21.15.22:0/1722672221 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe1b80b3c60 msgr2=0x7fe1b80b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.916+0000 7fe1d3e37640 1 --2- 172.21.15.22:0/1722672221 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe1b80b3c60 0x7fe1b80b6120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc000c00 tx=0x7fe1bc031400 comp rx=0 tx=0).stop 2024-08-20T01:29:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.916+0000 7fe1d3e37640 1 -- 172.21.15.22:0/1722672221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1cc102ad0 msgr2=0x7fe1cc199150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.916+0000 7fe1d3e37640 1 --2- 172.21.15.22:0/1722672221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1cc102ad0 0x7fe1cc199150 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800b4a0 tx=0x7fe1c800b960 comp rx=0 tx=0).stop 2024-08-20T01:29:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.916+0000 7fe1d3e37640 1 -- 172.21.15.22:0/1722672221 shutdown_connections 2024-08-20T01:29:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.916+0000 7fe1d3e37640 1 --2- 172.21.15.22:0/1722672221 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe1b80b3c60 0x7fe1b80b6120 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:29.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.916+0000 7fe1d3e37640 1 --2- 172.21.15.22:0/1722672221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1cc108e60 0x7fe1cc19ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:29.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.916+0000 7fe1d3e37640 1 --2- 172.21.15.22:0/1722672221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1cc1084e0 0x7fe1cc199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:29.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.916+0000 7fe1d3e37640 1 --2- 172.21.15.22:0/1722672221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1cc102ad0 0x7fe1cc199150 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:29.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.916+0000 7fe1d3e37640 1 -- 172.21.15.22:0/1722672221 >> 172.21.15.22:0/1722672221 conn(0x7fe1cc0fe540 msgr2=0x7fe1cc100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:29.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.916+0000 7fe1d3e37640 1 -- 172.21.15.22:0/1722672221 shutdown_connections 2024-08-20T01:29:29.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:29.916+0000 7fe1d3e37640 1 -- 172.21.15.22:0/1722672221 wait complete. 2024-08-20T01:29:30.707 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-20T01:29:30.707 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-20T01:29:30.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:30 smithi077 ceph-mon[22251]: pgmap v293: 97 pgs: 97 active+clean; 621 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-08-20T01:29:30.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:30 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1722672221' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:29:30.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:30 smithi022 ceph-mon[18709]: pgmap v293: 97 pgs: 97 active+clean; 621 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-08-20T01:29:30.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:30 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1722672221' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:29:30.964 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:31.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:30 smithi134 ceph-mon[22511]: pgmap v293: 97 pgs: 97 active+clean; 621 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-08-20T01:29:31.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:30 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1722672221' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:29:31.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.395+0000 7f8fa25f0640 1 -- 172.21.15.22:0/4027322306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f9c101520 msgr2=0x7f8f9c101900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:31.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.395+0000 7f8fa25f0640 1 --2- 172.21.15.22:0/4027322306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f9c101520 0x7f8f9c101900 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009900 tx=0x7f8f8c02a410 comp rx=0 tx=0).stop 2024-08-20T01:29:31.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.395+0000 7f8fa25f0640 1 -- 172.21.15.22:0/4027322306 shutdown_connections 2024-08-20T01:29:31.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.395+0000 7f8fa25f0640 1 --2- 172.21.15.22:0/4027322306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f9c1074d0 0x7f8f9c10dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:31.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.395+0000 7f8fa25f0640 1 --2- 172.21.15.22:0/4027322306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9c106b50 0x7f8f9c106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:31.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.395+0000 7f8fa25f0640 1 --2- 172.21.15.22:0/4027322306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f9c101520 0x7f8f9c101900 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:31.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.395+0000 7f8fa25f0640 1 -- 172.21.15.22:0/4027322306 >> 172.21.15.22:0/4027322306 conn(0x7f8f9c076c80 msgr2=0x7f8f9c077090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:31.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.395+0000 7f8fa25f0640 1 -- 172.21.15.22:0/4027322306 shutdown_connections 2024-08-20T01:29:31.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.396+0000 7f8fa25f0640 1 -- 172.21.15.22:0/4027322306 wait complete. 2024-08-20T01:29:31.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.396+0000 7f8fa25f0640 1 Processor -- start 2024-08-20T01:29:31.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.396+0000 7f8fa25f0640 1 -- start start 2024-08-20T01:29:31.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.396+0000 7f8fa25f0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f9c101520 0x7f8f9c10f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:31.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.396+0000 7f8fa25f0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9c106b50 0x7f8f9c10f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:31.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.396+0000 7f8fa25f0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f9c1074d0 0x7f8f9c10fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:31.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.396+0000 7f8fa25f0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c112b10 con 0x7f8f9c1074d0 2024-08-20T01:29:31.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.396+0000 7f8fa25f0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c112990 con 0x7f8f9c106b50 2024-08-20T01:29:31.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.396+0000 7f8fa25f0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c112c90 con 0x7f8f9c101520 2024-08-20T01:29:31.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.397+0000 7f8fa0b8d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f9c1074d0 0x7f8f9c10fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:31.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.397+0000 7f8fa0b8d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f9c1074d0 0x7f8f9c10fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46904/0 (socket says 172.21.15.22:46904) 2024-08-20T01:29:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.397+0000 7f8fa0b8d640 1 -- 172.21.15.22:0/637192025 learned_addr learned my addr 172.21.15.22:0/637192025 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.397+0000 7f8f9bfff640 1 --2- 172.21.15.22:0/637192025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f9c101520 0x7f8f9c10f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.397+0000 7f8f93fff640 1 --2- 172.21.15.22:0/637192025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9c106b50 0x7f8f9c10f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.397+0000 7f8fa0b8d640 1 -- 172.21.15.22:0/637192025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f9c101520 msgr2=0x7f8f9c10f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.397+0000 7f8fa0b8d640 1 --2- 172.21.15.22:0/637192025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f9c101520 0x7f8f9c10f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.397+0000 7f8fa0b8d640 1 -- 172.21.15.22:0/637192025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9c106b50 msgr2=0x7f8f9c10f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.397+0000 7f8fa0b8d640 1 --2- 172.21.15.22:0/637192025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9c106b50 0x7f8f9c10f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.397+0000 7f8fa0b8d640 1 -- 172.21.15.22:0/637192025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9c1a7420 con 0x7f8f9c1074d0 2024-08-20T01:29:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.397+0000 7f8f93fff640 1 --2- 172.21.15.22:0/637192025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9c106b50 0x7f8f9c10f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:29:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.397+0000 7f8fa0b8d640 1 --2- 172.21.15.22:0/637192025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f9c1074d0 0x7f8f9c10fec0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400eaa0 tx=0x7f8f9400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.397+0000 7f8f99ffb640 1 -- 172.21.15.22:0/637192025 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9400cdb0 con 0x7f8f9c1074d0 2024-08-20T01:29:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.397+0000 7f8f99ffb640 1 -- 172.21.15.22:0/637192025 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f94005020 con 0x7f8f9c1074d0 2024-08-20T01:29:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.397+0000 7f8fa25f0640 1 -- 172.21.15.22:0/637192025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f9c1a7710 con 0x7f8f9c1074d0 2024-08-20T01:29:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.397+0000 7f8f99ffb640 1 -- 172.21.15.22:0/637192025 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f940116d0 con 0x7f8f9c1074d0 2024-08-20T01:29:31.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.397+0000 7f8fa25f0640 1 -- 172.21.15.22:0/637192025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f9c1a7ca0 con 0x7f8f9c1074d0 2024-08-20T01:29:31.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.398+0000 7f8fa25f0640 1 -- 172.21.15.22:0/637192025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f9c101900 con 0x7f8f9c1074d0 2024-08-20T01:29:31.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.401+0000 7f8f99ffb640 1 -- 172.21.15.22:0/637192025 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f8f940051d0 con 0x7f8f9c1074d0 2024-08-20T01:29:31.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.401+0000 7f8f99ffb640 1 --2- 172.21.15.22:0/637192025 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8f880b3ce0 0x7f8f880b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:31.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.401+0000 7f8f9bfff640 1 --2- 172.21.15.22:0/637192025 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8f880b3ce0 0x7f8f880b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:31.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.402+0000 7f8f99ffb640 1 -- 172.21.15.22:0/637192025 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f8f940e4170 con 0x7f8f9c1074d0 2024-08-20T01:29:31.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.402+0000 7f8f9bfff640 1 --2- 172.21.15.22:0/637192025 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8f880b3ce0 0x7f8f880b61a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c031440 tx=0x7f8f8c0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:31.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.404+0000 7f8f99ffb640 1 -- 172.21.15.22:0/637192025 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f8f94016030 con 0x7f8f9c1074d0 2024-08-20T01:29:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.586+0000 7f8fa25f0640 1 -- 172.21.15.22:0/637192025 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f9c0632c0 con 0x7f8f880b3ce0 2024-08-20T01:29:31.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.590+0000 7f8f99ffb640 1 -- 172.21.15.22:0/637192025 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258856 (secure 0 0 0) 0x7f8f9c0632c0 con 0x7f8f880b3ce0 2024-08-20T01:29:31.594 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:29:31.595 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-08-20T01:29:31.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.594+0000 7f8fa25f0640 1 -- 172.21.15.22:0/637192025 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8f880b3ce0 msgr2=0x7f8f880b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:31.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.594+0000 7f8fa25f0640 1 --2- 172.21.15.22:0/637192025 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8f880b3ce0 0x7f8f880b61a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c031440 tx=0x7f8f8c0095f0 comp rx=0 tx=0).stop 2024-08-20T01:29:31.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.594+0000 7f8fa25f0640 1 -- 172.21.15.22:0/637192025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f9c1074d0 msgr2=0x7f8f9c10fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:31.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.594+0000 7f8fa25f0640 1 --2- 172.21.15.22:0/637192025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f9c1074d0 0x7f8f9c10fec0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400eaa0 tx=0x7f8f9400ef60 comp rx=0 tx=0).stop 2024-08-20T01:29:31.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.594+0000 7f8fa25f0640 1 -- 172.21.15.22:0/637192025 shutdown_connections 2024-08-20T01:29:31.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.594+0000 7f8fa25f0640 1 --2- 172.21.15.22:0/637192025 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8f880b3ce0 0x7f8f880b61a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:31.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.594+0000 7f8fa25f0640 1 --2- 172.21.15.22:0/637192025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f9c1074d0 0x7f8f9c10fec0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:31.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.594+0000 7f8fa25f0640 1 --2- 172.21.15.22:0/637192025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9c106b50 0x7f8f9c10f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:31.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.594+0000 7f8fa25f0640 1 --2- 172.21.15.22:0/637192025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f9c101520 0x7f8f9c10f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:31.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.594+0000 7f8fa25f0640 1 -- 172.21.15.22:0/637192025 >> 172.21.15.22:0/637192025 conn(0x7f8f9c076c80 msgr2=0x7f8f9c100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:31.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.594+0000 7f8fa25f0640 1 -- 172.21.15.22:0/637192025 shutdown_connections 2024-08-20T01:29:31.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:31.594+0000 7f8fa25f0640 1 -- 172.21.15.22:0/637192025 wait complete. 2024-08-20T01:29:32.353 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2024-08-20T01:29:31.301049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644713,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":190,"num_read_kb":179,"num_write":284,"num_write_kb":2249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363356,"kb_used_data":9948,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124578468,"statfs":{"total":1151940427776,"available":1151568351232,"internally_reserved":0,"allocated":10186752,"data_stored":6588844,"data_compressed":108864,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19139,"internal_metadata":361674045},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49745,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":114,"num_read_kb":115,"num_write":41,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003081"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.423346+0000","last_change":"2024-08-20T01:29:06.421092+0000","last_active":"2024-08-20T01:29:07.423346+0000","last_peered":"2024-08-20T01:29:07.423346+0000","last_clean":"2024-08-20T01:29:07.423346+0000","last_became_active":"2024-08-20T01:29:06.420484+0000","last_became_peered":"2024-08-20T01:29:06.420484+0000","last_unstale":"2024-08-20T01:29:07.423346+0000","last_undegraded":"2024-08-20T01:29:07.423346+0000","last_fullsized":"2024-08-20T01:29:07.423346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:55:54.177863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.440811+0000","last_change":"2024-08-20T01:29:06.414784+0000","last_active":"2024-08-20T01:29:07.440811+0000","last_peered":"2024-08-20T01:29:07.440811+0000","last_clean":"2024-08-20T01:29:07.440811+0000","last_became_active":"2024-08-20T01:29:06.414426+0000","last_became_peered":"2024-08-20T01:29:06.414426+0000","last_unstale":"2024-08-20T01:29:07.440811+0000","last_undegraded":"2024-08-20T01:29:07.440811+0000","last_fullsized":"2024-08-20T01:29:07.440811+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:13:45.634888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.440789+0000","last_change":"2024-08-20T01:29:06.416876+0000","last_active":"2024-08-20T01:29:07.440789+0000","last_peered":"2024-08-20T01:29:07.440789+0000","last_clean":"2024-08-20T01:29:07.440789+0000","last_became_active":"2024-08-20T01:29:06.416548+0000","last_became_peered":"2024-08-20T01:29:06.416548+0000","last_unstale":"2024-08-20T01:29:07.440789+0000","last_undegraded":"2024-08-20T01:29:07.440789+0000","last_fullsized":"2024-08-20T01:29:07.440789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:16:23.092129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.438898+0000","last_change":"2024-08-20T01:29:06.415474+0000","last_active":"2024-08-20T01:29:07.438898+0000","last_peered":"2024-08-20T01:29:07.438898+0000","last_clean":"2024-08-20T01:29:07.438898+0000","last_became_active":"2024-08-20T01:29:06.415120+0000","last_became_peered":"2024-08-20T01:29:06.415120+0000","last_unstale":"2024-08-20T01:29:07.438898+0000","last_undegraded":"2024-08-20T01:29:07.438898+0000","last_fullsized":"2024-08-20T01:29:07.438898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:47.059173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436719+0000","last_change":"2024-08-20T01:29:06.419600+0000","last_active":"2024-08-20T01:29:07.436719+0000","last_peered":"2024-08-20T01:29:07.436719+0000","last_clean":"2024-08-20T01:29:07.436719+0000","last_became_active":"2024-08-20T01:29:06.419280+0000","last_became_peered":"2024-08-20T01:29:06.419280+0000","last_unstale":"2024-08-20T01:29:07.436719+0000","last_undegraded":"2024-08-20T01:29:07.436719+0000","last_fullsized":"2024-08-20T01:29:07.436719+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:41:04.458681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.418917+0000","last_change":"2024-08-20T01:29:06.420995+0000","last_active":"2024-08-20T01:29:07.418917+0000","last_peered":"2024-08-20T01:29:07.418917+0000","last_clean":"2024-08-20T01:29:07.418917+0000","last_became_active":"2024-08-20T01:29:06.420703+0000","last_became_peered":"2024-08-20T01:29:06.420703+0000","last_unstale":"2024-08-20T01:29:07.418917+0000","last_undegraded":"2024-08-20T01:29:07.418917+0000","last_fullsized":"2024-08-20T01:29:07.418917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:21:08.502158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436854+0000","last_change":"2024-08-20T01:29:06.411605+0000","last_active":"2024-08-20T01:29:07.436854+0000","last_peered":"2024-08-20T01:29:07.436854+0000","last_clean":"2024-08-20T01:29:07.436854+0000","last_became_active":"2024-08-20T01:29:06.411258+0000","last_became_peered":"2024-08-20T01:29:06.411258+0000","last_unstale":"2024-08-20T01:29:07.436854+0000","last_undegraded":"2024-08-20T01:29:07.436854+0000","last_fullsized":"2024-08-20T01:29:07.436854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:17:02.390707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437858+0000","last_change":"2024-08-20T01:29:06.418514+0000","last_active":"2024-08-20T01:29:07.437858+0000","last_peered":"2024-08-20T01:29:07.437858+0000","last_clean":"2024-08-20T01:29:07.437858+0000","last_became_active":"2024-08-20T01:29:06.417450+0000","last_became_peered":"2024-08-20T01:29:06.417450+0000","last_unstale":"2024-08-20T01:29:07.437858+0000","last_undegraded":"2024-08-20T01:29:07.437858+0000","last_fullsized":"2024-08-20T01:29:07.437858+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:13:15.485333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437600+0000","last_change":"2024-08-20T01:29:06.425458+0000","last_active":"2024-08-20T01:29:07.437600+0000","last_peered":"2024-08-20T01:29:07.437600+0000","last_clean":"2024-08-20T01:29:07.437600+0000","last_became_active":"2024-08-20T01:29:06.425122+0000","last_became_peered":"2024-08-20T01:29:06.425122+0000","last_unstale":"2024-08-20T01:29:07.437600+0000","last_undegraded":"2024-08-20T01:29:07.437600+0000","last_fullsized":"2024-08-20T01:29:07.437600+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:52:59.857195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.419457+0000","last_change":"2024-08-20T01:29:06.420258+0000","last_active":"2024-08-20T01:29:07.419457+0000","last_peered":"2024-08-20T01:29:07.419457+0000","last_clean":"2024-08-20T01:29:07.419457+0000","last_became_active":"2024-08-20T01:29:06.419982+0000","last_became_peered":"2024-08-20T01:29:06.419982+0000","last_unstale":"2024-08-20T01:29:07.419457+0000","last_undegraded":"2024-08-20T01:29:07.419457+0000","last_fullsized":"2024-08-20T01:29:07.419457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:56:23.296739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437611+0000","last_change":"2024-08-20T01:29:06.421580+0000","last_active":"2024-08-20T01:29:07.437611+0000","last_peered":"2024-08-20T01:29:07.437611+0000","last_clean":"2024-08-20T01:29:07.437611+0000","last_became_active":"2024-08-20T01:29:06.421115+0000","last_became_peered":"2024-08-20T01:29:06.421115+0000","last_unstale":"2024-08-20T01:29:07.437611+0000","last_undegraded":"2024-08-20T01:29:07.437611+0000","last_fullsized":"2024-08-20T01:29:07.437611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:43:13.839230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.439002+0000","last_change":"2024-08-20T01:29:06.416950+0000","last_active":"2024-08-20T01:29:07.439002+0000","last_peered":"2024-08-20T01:29:07.439002+0000","last_clean":"2024-08-20T01:29:07.439002+0000","last_became_active":"2024-08-20T01:29:06.415585+0000","last_became_peered":"2024-08-20T01:29:06.415585+0000","last_unstale":"2024-08-20T01:29:07.439002+0000","last_undegraded":"2024-08-20T01:29:07.439002+0000","last_fullsized":"2024-08-20T01:29:07.439002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:47:54.132535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436200+0000","last_change":"2024-08-20T01:29:06.415145+0000","last_active":"2024-08-20T01:29:07.436200+0000","last_peered":"2024-08-20T01:29:07.436200+0000","last_clean":"2024-08-20T01:29:07.436200+0000","last_became_active":"2024-08-20T01:29:06.414753+0000","last_became_peered":"2024-08-20T01:29:06.414753+0000","last_unstale":"2024-08-20T01:29:07.436200+0000","last_undegraded":"2024-08-20T01:29:07.436200+0000","last_fullsized":"2024-08-20T01:29:07.436200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:43:00.158295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.440501+0000","last_change":"2024-08-20T01:29:06.415494+0000","last_active":"2024-08-20T01:29:07.440501+0000","last_peered":"2024-08-20T01:29:07.440501+0000","last_clean":"2024-08-20T01:29:07.440501+0000","last_became_active":"2024-08-20T01:29:06.415099+0000","last_became_peered":"2024-08-20T01:29:06.415099+0000","last_unstale":"2024-08-20T01:29:07.440501+0000","last_undegraded":"2024-08-20T01:29:07.440501+0000","last_fullsized":"2024-08-20T01:29:07.440501+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:07:01.946143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.440186+0000","last_change":"2024-08-20T01:29:06.418233+0000","last_active":"2024-08-20T01:29:07.440186+0000","last_peered":"2024-08-20T01:29:07.440186+0000","last_clean":"2024-08-20T01:29:07.440186+0000","last_became_active":"2024-08-20T01:29:06.417929+0000","last_became_peered":"2024-08-20T01:29:06.417929+0000","last_unstale":"2024-08-20T01:29:07.440186+0000","last_undegraded":"2024-08-20T01:29:07.440186+0000","last_fullsized":"2024-08-20T01:29:07.440186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:44:08.548821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436119+0000","last_change":"2024-08-20T01:29:06.418819+0000","last_active":"2024-08-20T01:29:07.436119+0000","last_peered":"2024-08-20T01:29:07.436119+0000","last_clean":"2024-08-20T01:29:07.436119+0000","last_became_active":"2024-08-20T01:29:06.418378+0000","last_became_peered":"2024-08-20T01:29:06.418378+0000","last_unstale":"2024-08-20T01:29:07.436119+0000","last_undegraded":"2024-08-20T01:29:07.436119+0000","last_fullsized":"2024-08-20T01:29:07.436119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:01.419539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.423427+0000","last_change":"2024-08-20T01:29:06.420804+0000","last_active":"2024-08-20T01:29:07.423427+0000","last_peered":"2024-08-20T01:29:07.423427+0000","last_clean":"2024-08-20T01:29:07.423427+0000","last_became_active":"2024-08-20T01:29:06.420027+0000","last_became_peered":"2024-08-20T01:29:06.420027+0000","last_unstale":"2024-08-20T01:29:07.423427+0000","last_undegraded":"2024-08-20T01:29:07.423427+0000","last_fullsized":"2024-08-20T01:29:07.423427+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:00:37.104792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.418717+0000","last_change":"2024-08-20T01:29:06.411625+0000","last_active":"2024-08-20T01:29:07.418717+0000","last_peered":"2024-08-20T01:29:07.418717+0000","last_clean":"2024-08-20T01:29:07.418717+0000","last_became_active":"2024-08-20T01:29:06.411284+0000","last_became_peered":"2024-08-20T01:29:06.411284+0000","last_unstale":"2024-08-20T01:29:07.418717+0000","last_undegraded":"2024-08-20T01:29:07.418717+0000","last_fullsized":"2024-08-20T01:29:07.418717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:12:08.510755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436850+0000","last_change":"2024-08-20T01:29:06.421276+0000","last_active":"2024-08-20T01:29:07.436850+0000","last_peered":"2024-08-20T01:29:07.436850+0000","last_clean":"2024-08-20T01:29:07.436850+0000","last_became_active":"2024-08-20T01:29:06.420916+0000","last_became_peered":"2024-08-20T01:29:06.420916+0000","last_unstale":"2024-08-20T01:29:07.436850+0000","last_undegraded":"2024-08-20T01:29:07.436850+0000","last_fullsized":"2024-08-20T01:29:07.436850+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:04:59.399172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.423198+0000","last_change":"2024-08-20T01:29:06.420848+0000","last_active":"2024-08-20T01:29:07.423198+0000","last_peered":"2024-08-20T01:29:07.423198+0000","last_clean":"2024-08-20T01:29:07.423198+0000","last_became_active":"2024-08-20T01:29:06.420465+0000","last_became_peered":"2024-08-20T01:29:06.420465+0000","last_unstale":"2024-08-20T01:29:07.423198+0000","last_undegraded":"2024-08-20T01:29:07.423198+0000","last_fullsized":"2024-08-20T01:29:07.423198+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:42:33.210813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436305+0000","last_change":"2024-08-20T01:29:06.407353+0000","last_active":"2024-08-20T01:29:07.436305+0000","last_peered":"2024-08-20T01:29:07.436305+0000","last_clean":"2024-08-20T01:29:07.436305+0000","last_became_active":"2024-08-20T01:29:06.406944+0000","last_became_peered":"2024-08-20T01:29:06.406944+0000","last_unstale":"2024-08-20T01:29:07.436305+0000","last_undegraded":"2024-08-20T01:29:07.436305+0000","last_fullsized":"2024-08-20T01:29:07.436305+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:49:22.324317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436402+0000","last_change":"2024-08-20T01:29:06.419757+0000","last_active":"2024-08-20T01:29:07.436402+0000","last_peered":"2024-08-20T01:29:07.436402+0000","last_clean":"2024-08-20T01:29:07.436402+0000","last_became_active":"2024-08-20T01:29:06.419433+0000","last_became_peered":"2024-08-20T01:29:06.419433+0000","last_unstale":"2024-08-20T01:29:07.436402+0000","last_undegraded":"2024-08-20T01:29:07.436402+0000","last_fullsized":"2024-08-20T01:29:07.436402+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:22:36.968949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437490+0000","last_change":"2024-08-20T01:29:06.418110+0000","last_active":"2024-08-20T01:29:07.437490+0000","last_peered":"2024-08-20T01:29:07.437490+0000","last_clean":"2024-08-20T01:29:07.437490+0000","last_became_active":"2024-08-20T01:29:06.417776+0000","last_became_peered":"2024-08-20T01:29:06.417776+0000","last_unstale":"2024-08-20T01:29:07.437490+0000","last_undegraded":"2024-08-20T01:29:07.437490+0000","last_fullsized":"2024-08-20T01:29:07.437490+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:55:55.105453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437202+0000","last_change":"2024-08-20T01:29:06.414240+0000","last_active":"2024-08-20T01:29:07.437202+0000","last_peered":"2024-08-20T01:29:07.437202+0000","last_clean":"2024-08-20T01:29:07.437202+0000","last_became_active":"2024-08-20T01:29:06.413884+0000","last_became_peered":"2024-08-20T01:29:06.413884+0000","last_unstale":"2024-08-20T01:29:07.437202+0000","last_undegraded":"2024-08-20T01:29:07.437202+0000","last_fullsized":"2024-08-20T01:29:07.437202+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:00.042588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.438461+0000","last_change":"2024-08-20T01:29:06.419344+0000","last_active":"2024-08-20T01:29:07.438461+0000","last_peered":"2024-08-20T01:29:07.438461+0000","last_clean":"2024-08-20T01:29:07.438461+0000","last_became_active":"2024-08-20T01:29:06.418689+0000","last_became_peered":"2024-08-20T01:29:06.418689+0000","last_unstale":"2024-08-20T01:29:07.438461+0000","last_undegraded":"2024-08-20T01:29:07.438461+0000","last_fullsized":"2024-08-20T01:29:07.438461+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:34:23.604213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.438695+0000","last_change":"2024-08-20T01:29:06.415161+0000","last_active":"2024-08-20T01:29:07.438695+0000","last_peered":"2024-08-20T01:29:07.438695+0000","last_clean":"2024-08-20T01:29:07.438695+0000","last_became_active":"2024-08-20T01:29:06.414812+0000","last_became_peered":"2024-08-20T01:29:06.414812+0000","last_unstale":"2024-08-20T01:29:07.438695+0000","last_undegraded":"2024-08-20T01:29:07.438695+0000","last_fullsized":"2024-08-20T01:29:07.438695+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:10:49.527635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.423328+0000","last_change":"2024-08-20T01:29:06.416502+0000","last_active":"2024-08-20T01:29:07.423328+0000","last_peered":"2024-08-20T01:29:07.423328+0000","last_clean":"2024-08-20T01:29:07.423328+0000","last_became_active":"2024-08-20T01:29:06.416139+0000","last_became_peered":"2024-08-20T01:29:06.416139+0000","last_unstale":"2024-08-20T01:29:07.423328+0000","last_undegraded":"2024-08-20T01:29:07.423328+0000","last_fullsized":"2024-08-20T01:29:07.423328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:19:32.379867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436746+0000","last_change":"2024-08-20T01:29:06.412494+0000","last_active":"2024-08-20T01:29:07.436746+0000","last_peered":"2024-08-20T01:29:07.436746+0000","last_clean":"2024-08-20T01:29:07.436746+0000","last_became_active":"2024-08-20T01:29:06.412158+0000","last_became_peered":"2024-08-20T01:29:06.412158+0000","last_unstale":"2024-08-20T01:29:07.436746+0000","last_undegraded":"2024-08-20T01:29:07.436746+0000","last_fullsized":"2024-08-20T01:29:07.436746+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:57:52.088445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.440581+0000","last_change":"2024-08-20T01:29:06.412869+0000","last_active":"2024-08-20T01:29:07.440581+0000","last_peered":"2024-08-20T01:29:07.440581+0000","last_clean":"2024-08-20T01:29:07.440581+0000","last_became_active":"2024-08-20T01:29:06.412540+0000","last_became_peered":"2024-08-20T01:29:06.412540+0000","last_unstale":"2024-08-20T01:29:07.440581+0000","last_undegraded":"2024-08-20T01:29:07.440581+0000","last_fullsized":"2024-08-20T01:29:07.440581+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:11:10.011252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437144+0000","last_change":"2024-08-20T01:29:06.420162+0000","last_active":"2024-08-20T01:29:07.437144+0000","last_peered":"2024-08-20T01:29:07.437144+0000","last_clean":"2024-08-20T01:29:07.437144+0000","last_became_active":"2024-08-20T01:29:06.419855+0000","last_became_peered":"2024-08-20T01:29:06.419855+0000","last_unstale":"2024-08-20T01:29:07.437144+0000","last_undegraded":"2024-08-20T01:29:07.437144+0000","last_fullsized":"2024-08-20T01:29:07.437144+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:30:28.151619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437803+0000","last_change":"2024-08-20T01:29:06.423874+0000","last_active":"2024-08-20T01:29:07.437803+0000","last_peered":"2024-08-20T01:29:07.437803+0000","last_clean":"2024-08-20T01:29:07.437803+0000","last_became_active":"2024-08-20T01:29:06.423561+0000","last_became_peered":"2024-08-20T01:29:06.423561+0000","last_unstale":"2024-08-20T01:29:07.437803+0000","last_undegraded":"2024-08-20T01:29:07.437803+0000","last_fullsized":"2024-08-20T01:29:07.437803+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:13:53.654099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.423001+0000","last_change":"2024-08-20T01:29:06.414212+0000","last_active":"2024-08-20T01:29:07.423001+0000","last_peered":"2024-08-20T01:29:07.423001+0000","last_clean":"2024-08-20T01:29:07.423001+0000","last_became_active":"2024-08-20T01:29:06.413848+0000","last_became_peered":"2024-08-20T01:29:06.413848+0000","last_unstale":"2024-08-20T01:29:07.423001+0000","last_undegraded":"2024-08-20T01:29:07.423001+0000","last_fullsized":"2024-08-20T01:29:07.423001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:00:29.005461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.438264+0000","last_change":"2024-08-20T01:29:06.418284+0000","last_active":"2024-08-20T01:29:07.438264+0000","last_peered":"2024-08-20T01:29:07.438264+0000","last_clean":"2024-08-20T01:29:07.438264+0000","last_became_active":"2024-08-20T01:29:06.417990+0000","last_became_peered":"2024-08-20T01:29:06.417990+0000","last_unstale":"2024-08-20T01:29:07.438264+0000","last_undegraded":"2024-08-20T01:29:07.438264+0000","last_fullsized":"2024-08-20T01:29:07.438264+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:20:04.456130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":42,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:28.494855+0000","last_change":"2024-08-20T01:29:04.413482+0000","last_active":"2024-08-20T01:29:28.494855+0000","last_peered":"2024-08-20T01:29:28.494855+0000","last_clean":"2024-08-20T01:29:28.494855+0000","last_became_active":"2024-08-20T01:29:04.413096+0000","last_became_peered":"2024-08-20T01:29:04.413096+0000","last_unstale":"2024-08-20T01:29:28.494855+0000","last_undegraded":"2024-08-20T01:29:28.494855+0000","last_fullsized":"2024-08-20T01:29:28.494855+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:26:05.947182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437554+0000","last_change":"2024-08-20T01:29:06.425418+0000","last_active":"2024-08-20T01:29:07.437554+0000","last_peered":"2024-08-20T01:29:07.437554+0000","last_clean":"2024-08-20T01:29:07.437554+0000","last_became_active":"2024-08-20T01:29:06.425102+0000","last_became_peered":"2024-08-20T01:29:06.425102+0000","last_unstale":"2024-08-20T01:29:07.437554+0000","last_undegraded":"2024-08-20T01:29:07.437554+0000","last_fullsized":"2024-08-20T01:29:07.437554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:22:48.891732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:15.474598+0000","last_change":"2024-08-20T01:29:04.409605+0000","last_active":"2024-08-20T01:29:15.474598+0000","last_peered":"2024-08-20T01:29:15.474598+0000","last_clean":"2024-08-20T01:29:15.474598+0000","last_became_active":"2024-08-20T01:29:04.409284+0000","last_became_peered":"2024-08-20T01:29:04.409284+0000","last_unstale":"2024-08-20T01:29:15.474598+0000","last_undegraded":"2024-08-20T01:29:15.474598+0000","last_fullsized":"2024-08-20T01:29:15.474598+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:29:27.471748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:15.473456+0000","last_change":"2024-08-20T01:29:04.400635+0000","last_active":"2024-08-20T01:29:15.473456+0000","last_peered":"2024-08-20T01:29:15.473456+0000","last_clean":"2024-08-20T01:29:15.473456+0000","last_became_active":"2024-08-20T01:29:04.400234+0000","last_became_peered":"2024-08-20T01:29:04.400234+0000","last_unstale":"2024-08-20T01:29:15.473456+0000","last_undegraded":"2024-08-20T01:29:15.473456+0000","last_fullsized":"2024-08-20T01:29:15.473456+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:47:24.810916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.438233+0000","last_change":"2024-08-20T01:29:06.411872+0000","last_active":"2024-08-20T01:29:07.438233+0000","last_peered":"2024-08-20T01:29:07.438233+0000","last_clean":"2024-08-20T01:29:07.438233+0000","last_became_active":"2024-08-20T01:29:06.411563+0000","last_became_peered":"2024-08-20T01:29:06.411563+0000","last_unstale":"2024-08-20T01:29:07.438233+0000","last_undegraded":"2024-08-20T01:29:07.438233+0000","last_fullsized":"2024-08-20T01:29:07.438233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:03:37.351529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436424+0000","last_change":"2024-08-20T01:29:04.407395+0000","last_active":"2024-08-20T01:29:07.436424+0000","last_peered":"2024-08-20T01:29:07.436424+0000","last_clean":"2024-08-20T01:29:07.436424+0000","last_became_active":"2024-08-20T01:29:04.407000+0000","last_became_peered":"2024-08-20T01:29:04.407000+0000","last_unstale":"2024-08-20T01:29:07.436424+0000","last_undegraded":"2024-08-20T01:29:07.436424+0000","last_fullsized":"2024-08-20T01:29:07.436424+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:36:42.512450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.418385+0000","last_change":"2024-08-20T01:29:06.410094+0000","last_active":"2024-08-20T01:29:07.418385+0000","last_peered":"2024-08-20T01:29:07.418385+0000","last_clean":"2024-08-20T01:29:07.418385+0000","last_became_active":"2024-08-20T01:29:06.409749+0000","last_became_peered":"2024-08-20T01:29:06.409749+0000","last_unstale":"2024-08-20T01:29:07.418385+0000","last_undegraded":"2024-08-20T01:29:07.418385+0000","last_fullsized":"2024-08-20T01:29:07.418385+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:52:51.072953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:29.495673+0000","last_change":"2024-08-20T01:29:04.406810+0000","last_active":"2024-08-20T01:29:29.495673+0000","last_peered":"2024-08-20T01:29:29.495673+0000","last_clean":"2024-08-20T01:29:29.495673+0000","last_became_active":"2024-08-20T01:29:04.406436+0000","last_became_peered":"2024-08-20T01:29:04.406436+0000","last_unstale":"2024-08-20T01:29:29.495673+0000","last_undegraded":"2024-08-20T01:29:29.495673+0000","last_fullsized":"2024-08-20T01:29:29.495673+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:49:57.305447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437133+0000","last_change":"2024-08-20T01:29:06.424442+0000","last_active":"2024-08-20T01:29:07.437133+0000","last_peered":"2024-08-20T01:29:07.437133+0000","last_clean":"2024-08-20T01:29:07.437133+0000","last_became_active":"2024-08-20T01:29:06.424132+0000","last_became_peered":"2024-08-20T01:29:06.424132+0000","last_unstale":"2024-08-20T01:29:07.437133+0000","last_undegraded":"2024-08-20T01:29:07.437133+0000","last_fullsized":"2024-08-20T01:29:07.437133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:31:30.861113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:14.464882+0000","last_change":"2024-08-20T01:29:04.412307+0000","last_active":"2024-08-20T01:29:14.464882+0000","last_peered":"2024-08-20T01:29:14.464882+0000","last_clean":"2024-08-20T01:29:14.464882+0000","last_became_active":"2024-08-20T01:29:04.411861+0000","last_became_peered":"2024-08-20T01:29:04.411861+0000","last_unstale":"2024-08-20T01:29:14.464882+0000","last_undegraded":"2024-08-20T01:29:14.464882+0000","last_fullsized":"2024-08-20T01:29:14.464882+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:56:51.356821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.441209+0000","last_change":"2024-08-20T01:29:06.418525+0000","last_active":"2024-08-20T01:29:07.441209+0000","last_peered":"2024-08-20T01:29:07.441209+0000","last_clean":"2024-08-20T01:29:07.441209+0000","last_became_active":"2024-08-20T01:29:06.417902+0000","last_became_peered":"2024-08-20T01:29:06.417902+0000","last_unstale":"2024-08-20T01:29:07.441209+0000","last_undegraded":"2024-08-20T01:29:07.441209+0000","last_fullsized":"2024-08-20T01:29:07.441209+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:28:23.017315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:14.462970+0000","last_change":"2024-08-20T01:29:05.171538+0000","last_active":"2024-08-20T01:29:14.462970+0000","last_peered":"2024-08-20T01:29:14.462970+0000","last_clean":"2024-08-20T01:29:14.462970+0000","last_became_active":"2024-08-20T01:29:05.171172+0000","last_became_peered":"2024-08-20T01:29:05.171172+0000","last_unstale":"2024-08-20T01:29:14.462970+0000","last_undegraded":"2024-08-20T01:29:14.462970+0000","last_fullsized":"2024-08-20T01:29:14.462970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:04:27.968049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436368+0000","last_change":"2024-08-20T01:29:06.426886+0000","last_active":"2024-08-20T01:29:07.436368+0000","last_peered":"2024-08-20T01:29:07.436368+0000","last_clean":"2024-08-20T01:29:07.436368+0000","last_became_active":"2024-08-20T01:29:06.426569+0000","last_became_peered":"2024-08-20T01:29:06.426569+0000","last_unstale":"2024-08-20T01:29:07.436368+0000","last_undegraded":"2024-08-20T01:29:07.436368+0000","last_fullsized":"2024-08-20T01:29:07.436368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:34:21.948591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'25","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:30.501543+0000","last_change":"2024-08-20T01:29:04.412181+0000","last_active":"2024-08-20T01:29:30.501543+0000","last_peered":"2024-08-20T01:29:30.501543+0000","last_clean":"2024-08-20T01:29:30.501543+0000","last_became_active":"2024-08-20T01:29:04.411645+0000","last_became_peered":"2024-08-20T01:29:04.411645+0000","last_unstale":"2024-08-20T01:29:30.501543+0000","last_undegraded":"2024-08-20T01:29:30.501543+0000","last_fullsized":"2024-08-20T01:29:30.501543+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:09:28.425113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":66,"num_write":26,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.439083+0000","last_change":"2024-08-20T01:29:06.417097+0000","last_active":"2024-08-20T01:29:07.439083+0000","last_peered":"2024-08-20T01:29:07.439083+0000","last_clean":"2024-08-20T01:29:07.439083+0000","last_became_active":"2024-08-20T01:29:06.416491+0000","last_became_peered":"2024-08-20T01:29:06.416491+0000","last_unstale":"2024-08-20T01:29:07.439083+0000","last_undegraded":"2024-08-20T01:29:07.439083+0000","last_fullsized":"2024-08-20T01:29:07.439083+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:30:16.071161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:15.473695+0000","last_change":"2024-08-20T01:29:04.412071+0000","last_active":"2024-08-20T01:29:15.473695+0000","last_peered":"2024-08-20T01:29:15.473695+0000","last_clean":"2024-08-20T01:29:15.473695+0000","last_became_active":"2024-08-20T01:29:04.411741+0000","last_became_peered":"2024-08-20T01:29:04.411741+0000","last_unstale":"2024-08-20T01:29:15.473695+0000","last_undegraded":"2024-08-20T01:29:15.473695+0000","last_fullsized":"2024-08-20T01:29:15.473695+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:33:47.753754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.435976+0000","last_change":"2024-08-20T01:29:06.408996+0000","last_active":"2024-08-20T01:29:07.435976+0000","last_peered":"2024-08-20T01:29:07.435976+0000","last_clean":"2024-08-20T01:29:07.435976+0000","last_became_active":"2024-08-20T01:29:06.408685+0000","last_became_peered":"2024-08-20T01:29:06.408685+0000","last_unstale":"2024-08-20T01:29:07.435976+0000","last_undegraded":"2024-08-20T01:29:07.435976+0000","last_fullsized":"2024-08-20T01:29:07.435976+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:18:28.974108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:14.464968+0000","last_change":"2024-08-20T01:29:04.407852+0000","last_active":"2024-08-20T01:29:14.464968+0000","last_peered":"2024-08-20T01:29:14.464968+0000","last_clean":"2024-08-20T01:29:14.464968+0000","last_became_active":"2024-08-20T01:29:04.406828+0000","last_became_peered":"2024-08-20T01:29:04.406828+0000","last_unstale":"2024-08-20T01:29:14.464968+0000","last_undegraded":"2024-08-20T01:29:14.464968+0000","last_fullsized":"2024-08-20T01:29:14.464968+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:36:03.641146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437106+0000","last_change":"2024-08-20T01:29:06.418652+0000","last_active":"2024-08-20T01:29:07.437106+0000","last_peered":"2024-08-20T01:29:07.437106+0000","last_clean":"2024-08-20T01:29:07.437106+0000","last_became_active":"2024-08-20T01:29:06.418340+0000","last_became_peered":"2024-08-20T01:29:06.418340+0000","last_unstale":"2024-08-20T01:29:07.437106+0000","last_undegraded":"2024-08-20T01:29:07.437106+0000","last_fullsized":"2024-08-20T01:29:07.437106+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:56:30.194426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'3","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:28.494396+0000","last_change":"2024-08-20T01:29:04.405950+0000","last_active":"2024-08-20T01:29:28.494396+0000","last_peered":"2024-08-20T01:29:28.494396+0000","last_clean":"2024-08-20T01:29:28.494396+0000","last_became_active":"2024-08-20T01:29:04.405650+0000","last_became_peered":"2024-08-20T01:29:04.405650+0000","last_unstale":"2024-08-20T01:29:28.494396+0000","last_undegraded":"2024-08-20T01:29:28.494396+0000","last_fullsized":"2024-08-20T01:29:28.494396+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:12:01.752958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436457+0000","last_change":"2024-08-20T01:29:06.413967+0000","last_active":"2024-08-20T01:29:07.436457+0000","last_peered":"2024-08-20T01:29:07.436457+0000","last_clean":"2024-08-20T01:29:07.436457+0000","last_became_active":"2024-08-20T01:29:06.413628+0000","last_became_peered":"2024-08-20T01:29:06.413628+0000","last_unstale":"2024-08-20T01:29:07.436457+0000","last_undegraded":"2024-08-20T01:29:07.436457+0000","last_fullsized":"2024-08-20T01:29:07.436457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:09:16.394482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:15.475956+0000","last_change":"2024-08-20T01:29:05.169872+0000","last_active":"2024-08-20T01:29:15.475956+0000","last_peered":"2024-08-20T01:29:15.475956+0000","last_clean":"2024-08-20T01:29:15.475956+0000","last_became_active":"2024-08-20T01:29:05.169186+0000","last_became_peered":"2024-08-20T01:29:05.169186+0000","last_unstale":"2024-08-20T01:29:15.475956+0000","last_undegraded":"2024-08-20T01:29:15.475956+0000","last_fullsized":"2024-08-20T01:29:15.475956+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:55:47.447959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436167+0000","last_change":"2024-08-20T01:29:06.426012+0000","last_active":"2024-08-20T01:29:07.436167+0000","last_peered":"2024-08-20T01:29:07.436167+0000","last_clean":"2024-08-20T01:29:07.436167+0000","last_became_active":"2024-08-20T01:29:06.425512+0000","last_became_peered":"2024-08-20T01:29:06.425512+0000","last_unstale":"2024-08-20T01:29:07.436167+0000","last_undegraded":"2024-08-20T01:29:07.436167+0000","last_fullsized":"2024-08-20T01:29:07.436167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:33:54.472124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:16.470073+0000","last_change":"2024-08-20T01:29:04.408188+0000","last_active":"2024-08-20T01:29:16.470073+0000","last_peered":"2024-08-20T01:29:16.470073+0000","last_clean":"2024-08-20T01:29:16.470073+0000","last_became_active":"2024-08-20T01:29:04.407794+0000","last_became_peered":"2024-08-20T01:29:04.407794+0000","last_unstale":"2024-08-20T01:29:16.470073+0000","last_undegraded":"2024-08-20T01:29:16.470073+0000","last_fullsized":"2024-08-20T01:29:16.470073+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:49:40.679218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.423381+0000","last_change":"2024-08-20T01:29:06.424429+0000","last_active":"2024-08-20T01:29:07.423381+0000","last_peered":"2024-08-20T01:29:07.423381+0000","last_clean":"2024-08-20T01:29:07.423381+0000","last_became_active":"2024-08-20T01:29:06.423923+0000","last_became_peered":"2024-08-20T01:29:06.423923+0000","last_unstale":"2024-08-20T01:29:07.423381+0000","last_undegraded":"2024-08-20T01:29:07.423381+0000","last_fullsized":"2024-08-20T01:29:07.423381+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:46:52.435715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.443139+0000","last_change":"2024-08-20T01:29:04.412178+0000","last_active":"2024-08-20T01:29:07.443139+0000","last_peered":"2024-08-20T01:29:07.443139+0000","last_clean":"2024-08-20T01:29:07.443139+0000","last_became_active":"2024-08-20T01:29:04.411819+0000","last_became_peered":"2024-08-20T01:29:04.411819+0000","last_unstale":"2024-08-20T01:29:07.443139+0000","last_undegraded":"2024-08-20T01:29:07.443139+0000","last_fullsized":"2024-08-20T01:29:07.443139+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:03:11.524911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436517+0000","last_change":"2024-08-20T01:29:06.415697+0000","last_active":"2024-08-20T01:29:07.436517+0000","last_peered":"2024-08-20T01:29:07.436517+0000","last_clean":"2024-08-20T01:29:07.436517+0000","last_became_active":"2024-08-20T01:29:06.415180+0000","last_became_peered":"2024-08-20T01:29:06.415180+0000","last_unstale":"2024-08-20T01:29:07.436517+0000","last_undegraded":"2024-08-20T01:29:07.436517+0000","last_fullsized":"2024-08-20T01:29:07.436517+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:55:50.810063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.442237+0000","last_change":"2024-08-20T01:29:04.405961+0000","last_active":"2024-08-20T01:29:07.442237+0000","last_peered":"2024-08-20T01:29:07.442237+0000","last_clean":"2024-08-20T01:29:07.442237+0000","last_became_active":"2024-08-20T01:29:04.405633+0000","last_became_peered":"2024-08-20T01:29:04.405633+0000","last_unstale":"2024-08-20T01:29:07.442237+0000","last_undegraded":"2024-08-20T01:29:07.442237+0000","last_fullsized":"2024-08-20T01:29:07.442237+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:00:27.918313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436878+0000","last_change":"2024-08-20T01:29:06.417221+0000","last_active":"2024-08-20T01:29:07.436878+0000","last_peered":"2024-08-20T01:29:07.436878+0000","last_clean":"2024-08-20T01:29:07.436878+0000","last_became_active":"2024-08-20T01:29:06.416912+0000","last_became_peered":"2024-08-20T01:29:06.416912+0000","last_unstale":"2024-08-20T01:29:07.436878+0000","last_undegraded":"2024-08-20T01:29:07.436878+0000","last_fullsized":"2024-08-20T01:29:07.436878+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:12:10.667134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:15.474141+0000","last_change":"2024-08-20T01:29:05.169494+0000","last_active":"2024-08-20T01:29:15.474141+0000","last_peered":"2024-08-20T01:29:15.474141+0000","last_clean":"2024-08-20T01:29:15.474141+0000","last_became_active":"2024-08-20T01:29:05.169059+0000","last_became_peered":"2024-08-20T01:29:05.169059+0000","last_unstale":"2024-08-20T01:29:15.474141+0000","last_undegraded":"2024-08-20T01:29:15.474141+0000","last_fullsized":"2024-08-20T01:29:15.474141+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:25:39.300668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437510+0000","last_change":"2024-08-20T01:29:06.424040+0000","last_active":"2024-08-20T01:29:07.437510+0000","last_peered":"2024-08-20T01:29:07.437510+0000","last_clean":"2024-08-20T01:29:07.437510+0000","last_became_active":"2024-08-20T01:29:06.421360+0000","last_became_peered":"2024-08-20T01:29:06.421360+0000","last_unstale":"2024-08-20T01:29:07.437510+0000","last_undegraded":"2024-08-20T01:29:07.437510+0000","last_fullsized":"2024-08-20T01:29:07.437510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:24:50.497310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436571+0000","last_change":"2024-08-20T01:27:51.625696+0000","last_active":"2024-08-20T01:29:07.436571+0000","last_peered":"2024-08-20T01:29:07.436571+0000","last_clean":"2024-08-20T01:29:07.436571+0000","last_became_active":"2024-08-20T01:27:51.620833+0000","last_became_peered":"2024-08-20T01:27:51.620833+0000","last_unstale":"2024-08-20T01:29:07.436571+0000","last_undegraded":"2024-08-20T01:29:07.436571+0000","last_fullsized":"2024-08-20T01:29:07.436571+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:24:32.140649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:24:32.140649+0000","last_clean_scrub_stamp":"2024-08-20T01:24:32.140649+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:54:02.650548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:16.474185+0000","last_change":"2024-08-20T01:29:04.405411+0000","last_active":"2024-08-20T01:29:16.474185+0000","last_peered":"2024-08-20T01:29:16.474185+0000","last_clean":"2024-08-20T01:29:16.474185+0000","last_became_active":"2024-08-20T01:29:04.404980+0000","last_became_peered":"2024-08-20T01:29:04.404980+0000","last_unstale":"2024-08-20T01:29:16.474185+0000","last_undegraded":"2024-08-20T01:29:16.474185+0000","last_fullsized":"2024-08-20T01:29:16.474185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:31:39.335857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.438278+0000","last_change":"2024-08-20T01:29:06.420368+0000","last_active":"2024-08-20T01:29:07.438278+0000","last_peered":"2024-08-20T01:29:07.438278+0000","last_clean":"2024-08-20T01:29:07.438278+0000","last_became_active":"2024-08-20T01:29:06.419653+0000","last_became_peered":"2024-08-20T01:29:06.419653+0000","last_unstale":"2024-08-20T01:29:07.438278+0000","last_undegraded":"2024-08-20T01:29:07.438278+0000","last_fullsized":"2024-08-20T01:29:07.438278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:48.771774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:15.474249+0000","last_change":"2024-08-20T01:29:04.410302+0000","last_active":"2024-08-20T01:29:15.474249+0000","last_peered":"2024-08-20T01:29:15.474249+0000","last_clean":"2024-08-20T01:29:15.474249+0000","last_became_active":"2024-08-20T01:29:04.409977+0000","last_became_peered":"2024-08-20T01:29:04.409977+0000","last_unstale":"2024-08-20T01:29:15.474249+0000","last_undegraded":"2024-08-20T01:29:15.474249+0000","last_fullsized":"2024-08-20T01:29:15.474249+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:57:21.593739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.435794+0000","last_change":"2024-08-20T01:29:06.419798+0000","last_active":"2024-08-20T01:29:07.435794+0000","last_peered":"2024-08-20T01:29:07.435794+0000","last_clean":"2024-08-20T01:29:07.435794+0000","last_became_active":"2024-08-20T01:29:06.419546+0000","last_became_peered":"2024-08-20T01:29:06.419546+0000","last_unstale":"2024-08-20T01:29:07.435794+0000","last_undegraded":"2024-08-20T01:29:07.435794+0000","last_fullsized":"2024-08-20T01:29:07.435794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:51:31.848883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:29.495124+0000","last_change":"2024-08-20T01:29:05.169237+0000","last_active":"2024-08-20T01:29:29.495124+0000","last_peered":"2024-08-20T01:29:29.495124+0000","last_clean":"2024-08-20T01:29:29.495124+0000","last_became_active":"2024-08-20T01:29:05.168778+0000","last_became_peered":"2024-08-20T01:29:05.168778+0000","last_unstale":"2024-08-20T01:29:29.495124+0000","last_undegraded":"2024-08-20T01:29:29.495124+0000","last_fullsized":"2024-08-20T01:29:29.495124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:04:48.847412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436128+0000","last_change":"2024-08-20T01:29:06.418497+0000","last_active":"2024-08-20T01:29:07.436128+0000","last_peered":"2024-08-20T01:29:07.436128+0000","last_clean":"2024-08-20T01:29:07.436128+0000","last_became_active":"2024-08-20T01:29:06.418140+0000","last_became_peered":"2024-08-20T01:29:06.418140+0000","last_unstale":"2024-08-20T01:29:07.436128+0000","last_undegraded":"2024-08-20T01:29:07.436128+0000","last_fullsized":"2024-08-20T01:29:07.436128+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:17:29.756540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437386+0000","last_change":"2024-08-20T01:29:04.404472+0000","last_active":"2024-08-20T01:29:07.437386+0000","last_peered":"2024-08-20T01:29:07.437386+0000","last_clean":"2024-08-20T01:29:07.437386+0000","last_became_active":"2024-08-20T01:29:04.404010+0000","last_became_peered":"2024-08-20T01:29:04.404010+0000","last_unstale":"2024-08-20T01:29:07.437386+0000","last_undegraded":"2024-08-20T01:29:07.437386+0000","last_fullsized":"2024-08-20T01:29:07.437386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:53:04.263362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.419142+0000","last_change":"2024-08-20T01:29:06.421875+0000","last_active":"2024-08-20T01:29:07.419142+0000","last_peered":"2024-08-20T01:29:07.419142+0000","last_clean":"2024-08-20T01:29:07.419142+0000","last_became_active":"2024-08-20T01:29:06.421542+0000","last_became_peered":"2024-08-20T01:29:06.421542+0000","last_unstale":"2024-08-20T01:29:07.419142+0000","last_undegraded":"2024-08-20T01:29:07.419142+0000","last_fullsized":"2024-08-20T01:29:07.419142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:10:46.320252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.418630+0000","last_change":"2024-08-20T01:29:05.169985+0000","last_active":"2024-08-20T01:29:07.418630+0000","last_peered":"2024-08-20T01:29:07.418630+0000","last_clean":"2024-08-20T01:29:07.418630+0000","last_became_active":"2024-08-20T01:29:05.169607+0000","last_became_peered":"2024-08-20T01:29:05.169607+0000","last_unstale":"2024-08-20T01:29:07.418630+0000","last_undegraded":"2024-08-20T01:29:07.418630+0000","last_fullsized":"2024-08-20T01:29:07.418630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:03:23.278369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.419313+0000","last_change":"2024-08-20T01:29:06.414862+0000","last_active":"2024-08-20T01:29:07.419313+0000","last_peered":"2024-08-20T01:29:07.419313+0000","last_clean":"2024-08-20T01:29:07.419313+0000","last_became_active":"2024-08-20T01:29:06.414527+0000","last_became_peered":"2024-08-20T01:29:06.414527+0000","last_unstale":"2024-08-20T01:29:07.419313+0000","last_undegraded":"2024-08-20T01:29:07.419313+0000","last_fullsized":"2024-08-20T01:29:07.419313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:14:20.884073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:14.462825+0000","last_change":"2024-08-20T01:29:05.169638+0000","last_active":"2024-08-20T01:29:14.462825+0000","last_peered":"2024-08-20T01:29:14.462825+0000","last_clean":"2024-08-20T01:29:14.462825+0000","last_became_active":"2024-08-20T01:29:05.169202+0000","last_became_peered":"2024-08-20T01:29:05.169202+0000","last_unstale":"2024-08-20T01:29:14.462825+0000","last_undegraded":"2024-08-20T01:29:14.462825+0000","last_fullsized":"2024-08-20T01:29:14.462825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:05:39.645782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436754+0000","last_change":"2024-08-20T01:29:06.413839+0000","last_active":"2024-08-20T01:29:07.436754+0000","last_peered":"2024-08-20T01:29:07.436754+0000","last_clean":"2024-08-20T01:29:07.436754+0000","last_became_active":"2024-08-20T01:29:06.413488+0000","last_became_peered":"2024-08-20T01:29:06.413488+0000","last_unstale":"2024-08-20T01:29:07.436754+0000","last_undegraded":"2024-08-20T01:29:07.436754+0000","last_fullsized":"2024-08-20T01:29:07.436754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:35:04.007192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'11","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:29.437537+0000","last_change":"2024-08-20T01:29:04.408415+0000","last_active":"2024-08-20T01:29:29.437537+0000","last_peered":"2024-08-20T01:29:29.437537+0000","last_clean":"2024-08-20T01:29:29.437537+0000","last_became_active":"2024-08-20T01:29:04.408095+0000","last_became_peered":"2024-08-20T01:29:04.408095+0000","last_unstale":"2024-08-20T01:29:29.437537+0000","last_undegraded":"2024-08-20T01:29:29.437537+0000","last_fullsized":"2024-08-20T01:29:29.437537+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:20:36.677054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.438657+0000","last_change":"2024-08-20T01:29:06.421024+0000","last_active":"2024-08-20T01:29:07.438657+0000","last_peered":"2024-08-20T01:29:07.438657+0000","last_clean":"2024-08-20T01:29:07.438657+0000","last_became_active":"2024-08-20T01:29:06.420631+0000","last_became_peered":"2024-08-20T01:29:06.420631+0000","last_unstale":"2024-08-20T01:29:07.438657+0000","last_undegraded":"2024-08-20T01:29:07.438657+0000","last_fullsized":"2024-08-20T01:29:07.438657+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:07:57.992230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:14.464216+0000","last_change":"2024-08-20T01:29:04.835075+0000","last_active":"2024-08-20T01:29:14.464216+0000","last_peered":"2024-08-20T01:29:14.464216+0000","last_clean":"2024-08-20T01:29:14.464216+0000","last_became_active":"2024-08-20T01:29:04.834759+0000","last_became_peered":"2024-08-20T01:29:04.834759+0000","last_unstale":"2024-08-20T01:29:14.464216+0000","last_undegraded":"2024-08-20T01:29:14.464216+0000","last_fullsized":"2024-08-20T01:29:14.464216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:45:29.040626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.440998+0000","last_change":"2024-08-20T01:29:06.418187+0000","last_active":"2024-08-20T01:29:07.440998+0000","last_peered":"2024-08-20T01:29:07.440998+0000","last_clean":"2024-08-20T01:29:07.440998+0000","last_became_active":"2024-08-20T01:29:06.417851+0000","last_became_peered":"2024-08-20T01:29:06.417851+0000","last_unstale":"2024-08-20T01:29:07.440998+0000","last_undegraded":"2024-08-20T01:29:07.440998+0000","last_fullsized":"2024-08-20T01:29:07.440998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:15:48.204455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:14.463638+0000","last_change":"2024-08-20T01:29:05.169736+0000","last_active":"2024-08-20T01:29:14.463638+0000","last_peered":"2024-08-20T01:29:14.463638+0000","last_clean":"2024-08-20T01:29:14.463638+0000","last_became_active":"2024-08-20T01:29:05.169403+0000","last_became_peered":"2024-08-20T01:29:05.169403+0000","last_unstale":"2024-08-20T01:29:14.463638+0000","last_undegraded":"2024-08-20T01:29:14.463638+0000","last_fullsized":"2024-08-20T01:29:14.463638+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:43:43.500841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.438586+0000","last_change":"2024-08-20T01:29:06.416433+0000","last_active":"2024-08-20T01:29:07.438586+0000","last_peered":"2024-08-20T01:29:07.438586+0000","last_clean":"2024-08-20T01:29:07.438586+0000","last_became_active":"2024-08-20T01:29:06.414708+0000","last_became_peered":"2024-08-20T01:29:06.414708+0000","last_unstale":"2024-08-20T01:29:07.438586+0000","last_undegraded":"2024-08-20T01:29:07.438586+0000","last_fullsized":"2024-08-20T01:29:07.438586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:17:15.461536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:14.463813+0000","last_change":"2024-08-20T01:29:04.403090+0000","last_active":"2024-08-20T01:29:14.463813+0000","last_peered":"2024-08-20T01:29:14.463813+0000","last_clean":"2024-08-20T01:29:14.463813+0000","last_became_active":"2024-08-20T01:29:04.402697+0000","last_became_peered":"2024-08-20T01:29:04.402697+0000","last_unstale":"2024-08-20T01:29:14.463813+0000","last_undegraded":"2024-08-20T01:29:14.463813+0000","last_fullsized":"2024-08-20T01:29:14.463813+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:36:04.055868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.423049+0000","last_change":"2024-08-20T01:29:06.413427+0000","last_active":"2024-08-20T01:29:07.423049+0000","last_peered":"2024-08-20T01:29:07.423049+0000","last_clean":"2024-08-20T01:29:07.423049+0000","last_became_active":"2024-08-20T01:29:06.413058+0000","last_became_peered":"2024-08-20T01:29:06.413058+0000","last_unstale":"2024-08-20T01:29:07.423049+0000","last_undegraded":"2024-08-20T01:29:07.423049+0000","last_fullsized":"2024-08-20T01:29:07.423049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:38:38.546701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437403+0000","last_change":"2024-08-20T01:29:04.409859+0000","last_active":"2024-08-20T01:29:07.437403+0000","last_peered":"2024-08-20T01:29:07.437403+0000","last_clean":"2024-08-20T01:29:07.437403+0000","last_became_active":"2024-08-20T01:29:04.409497+0000","last_became_peered":"2024-08-20T01:29:04.409497+0000","last_unstale":"2024-08-20T01:29:07.437403+0000","last_undegraded":"2024-08-20T01:29:07.437403+0000","last_fullsized":"2024-08-20T01:29:07.437403+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:23:43.548912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437863+0000","last_change":"2024-08-20T01:29:06.418428+0000","last_active":"2024-08-20T01:29:07.437863+0000","last_peered":"2024-08-20T01:29:07.437863+0000","last_clean":"2024-08-20T01:29:07.437863+0000","last_became_active":"2024-08-20T01:29:06.418033+0000","last_became_peered":"2024-08-20T01:29:06.418033+0000","last_unstale":"2024-08-20T01:29:07.437863+0000","last_undegraded":"2024-08-20T01:29:07.437863+0000","last_fullsized":"2024-08-20T01:29:07.437863+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:23.503977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:14.464593+0000","last_change":"2024-08-20T01:29:04.412549+0000","last_active":"2024-08-20T01:29:14.464593+0000","last_peered":"2024-08-20T01:29:14.464593+0000","last_clean":"2024-08-20T01:29:14.464593+0000","last_became_active":"2024-08-20T01:29:04.412071+0000","last_became_peered":"2024-08-20T01:29:04.412071+0000","last_unstale":"2024-08-20T01:29:14.464593+0000","last_undegraded":"2024-08-20T01:29:14.464593+0000","last_fullsized":"2024-08-20T01:29:14.464593+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:48:51.195295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437261+0000","last_change":"2024-08-20T01:29:06.421431+0000","last_active":"2024-08-20T01:29:07.437261+0000","last_peered":"2024-08-20T01:29:07.437261+0000","last_clean":"2024-08-20T01:29:07.437261+0000","last_became_active":"2024-08-20T01:29:06.420916+0000","last_became_peered":"2024-08-20T01:29:06.420916+0000","last_unstale":"2024-08-20T01:29:07.437261+0000","last_undegraded":"2024-08-20T01:29:07.437261+0000","last_fullsized":"2024-08-20T01:29:07.437261+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:45.674530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437454+0000","last_change":"2024-08-20T01:29:06.418209+0000","last_active":"2024-08-20T01:29:07.437454+0000","last_peered":"2024-08-20T01:29:07.437454+0000","last_clean":"2024-08-20T01:29:07.437454+0000","last_became_active":"2024-08-20T01:29:06.417812+0000","last_became_peered":"2024-08-20T01:29:06.417812+0000","last_unstale":"2024-08-20T01:29:07.437454+0000","last_undegraded":"2024-08-20T01:29:07.437454+0000","last_fullsized":"2024-08-20T01:29:07.437454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:05:43.794281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.444210+0000","last_change":"2024-08-20T01:29:04.408472+0000","last_active":"2024-08-20T01:29:07.444210+0000","last_peered":"2024-08-20T01:29:07.444210+0000","last_clean":"2024-08-20T01:29:07.444210+0000","last_became_active":"2024-08-20T01:29:04.408082+0000","last_became_peered":"2024-08-20T01:29:04.408082+0000","last_unstale":"2024-08-20T01:29:07.444210+0000","last_undegraded":"2024-08-20T01:29:07.444210+0000","last_fullsized":"2024-08-20T01:29:07.444210+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:14:44.659672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436372+0000","last_change":"2024-08-20T01:29:06.423562+0000","last_active":"2024-08-20T01:29:07.436372+0000","last_peered":"2024-08-20T01:29:07.436372+0000","last_clean":"2024-08-20T01:29:07.436372+0000","last_became_active":"2024-08-20T01:29:06.423241+0000","last_became_peered":"2024-08-20T01:29:06.423241+0000","last_unstale":"2024-08-20T01:29:07.436372+0000","last_undegraded":"2024-08-20T01:29:07.436372+0000","last_fullsized":"2024-08-20T01:29:07.436372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:59:46.049449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:15.474533+0000","last_change":"2024-08-20T01:29:04.412287+0000","last_active":"2024-08-20T01:29:15.474533+0000","last_peered":"2024-08-20T01:29:15.474533+0000","last_clean":"2024-08-20T01:29:15.474533+0000","last_became_active":"2024-08-20T01:29:04.411912+0000","last_became_peered":"2024-08-20T01:29:04.411912+0000","last_unstale":"2024-08-20T01:29:15.474533+0000","last_undegraded":"2024-08-20T01:29:15.474533+0000","last_fullsized":"2024-08-20T01:29:15.474533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:19:25.816795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.441137+0000","last_change":"2024-08-20T01:29:06.416899+0000","last_active":"2024-08-20T01:29:07.441137+0000","last_peered":"2024-08-20T01:29:07.441137+0000","last_clean":"2024-08-20T01:29:07.441137+0000","last_became_active":"2024-08-20T01:29:06.416594+0000","last_became_peered":"2024-08-20T01:29:06.416594+0000","last_unstale":"2024-08-20T01:29:07.441137+0000","last_undegraded":"2024-08-20T01:29:07.441137+0000","last_fullsized":"2024-08-20T01:29:07.441137+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:43.896728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.442252+0000","last_change":"2024-08-20T01:29:05.169571+0000","last_active":"2024-08-20T01:29:07.442252+0000","last_peered":"2024-08-20T01:29:07.442252+0000","last_clean":"2024-08-20T01:29:07.442252+0000","last_became_active":"2024-08-20T01:29:05.169250+0000","last_became_peered":"2024-08-20T01:29:05.169250+0000","last_unstale":"2024-08-20T01:29:07.442252+0000","last_undegraded":"2024-08-20T01:29:07.442252+0000","last_fullsized":"2024-08-20T01:29:07.442252+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:32:04.555825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.438100+0000","last_change":"2024-08-20T01:29:06.415582+0000","last_active":"2024-08-20T01:29:07.438100+0000","last_peered":"2024-08-20T01:29:07.438100+0000","last_clean":"2024-08-20T01:29:07.438100+0000","last_became_active":"2024-08-20T01:29:06.415284+0000","last_became_peered":"2024-08-20T01:29:06.415284+0000","last_unstale":"2024-08-20T01:29:07.438100+0000","last_undegraded":"2024-08-20T01:29:07.438100+0000","last_fullsized":"2024-08-20T01:29:07.438100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:43:10.311792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:15.475842+0000","last_change":"2024-08-20T01:29:04.409389+0000","last_active":"2024-08-20T01:29:15.475842+0000","last_peered":"2024-08-20T01:29:15.475842+0000","last_clean":"2024-08-20T01:29:15.475842+0000","last_became_active":"2024-08-20T01:29:04.409099+0000","last_became_peered":"2024-08-20T01:29:04.409099+0000","last_unstale":"2024-08-20T01:29:15.475842+0000","last_undegraded":"2024-08-20T01:29:15.475842+0000","last_fullsized":"2024-08-20T01:29:15.475842+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:19:30.156443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54111,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":114,"num_read_kb":115,"num_write":159,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":159023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285456,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743442,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31972,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713180,"statfs":{"total":95995035648,"available":95962296320,"internally_reserved":0,"allocated":806912,"data_stored":389228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939671,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":1030819,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103195,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":389464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299423,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":823296,"data_stored":389384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495653,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":872448,"data_stored":981314,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659179,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":388853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855408,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":980998,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018933,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":815104,"data_stored":389290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215161,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":389164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444094,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":440497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":429709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":390124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":51851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":51688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T01:29:32.357 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-20T01:29:32.620 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:32.635 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:32 smithi022 ceph-mon[18709]: pgmap v294: 97 pgs: 97 active+clean; 630 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-08-20T01:29:32.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:32 smithi022 ceph-mon[18709]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:29:32.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:32 smithi077 ceph-mon[22251]: pgmap v294: 97 pgs: 97 active+clean; 630 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-08-20T01:29:32.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:32 smithi077 ceph-mon[22251]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:29:33.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:32 smithi134 ceph-mon[22511]: pgmap v294: 97 pgs: 97 active+clean; 630 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-08-20T01:29:33.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:32 smithi134 ceph-mon[22511]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:29:33.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.072+0000 7fa440fcb640 1 -- 172.21.15.22:0/3660592611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa43c107d40 msgr2=0x7fa43c10e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:33.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.072+0000 7fa440fcb640 1 --2- 172.21.15.22:0/3660592611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa43c107d40 0x7fa43c10e540 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa434009ca0 tx=0x7fa43402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:29:33.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.072+0000 7fa440fcb640 1 -- 172.21.15.22:0/3660592611 shutdown_connections 2024-08-20T01:29:33.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.072+0000 7fa440fcb640 1 --2- 172.21.15.22:0/3660592611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa43c107d40 0x7fa43c10e540 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:33.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.072+0000 7fa440fcb640 1 --2- 172.21.15.22:0/3660592611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa43c1073c0 0x7fa43c107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:33.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.072+0000 7fa440fcb640 1 --2- 172.21.15.22:0/3660592611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa43c1019b0 0x7fa43c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:33.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.072+0000 7fa440fcb640 1 -- 172.21.15.22:0/3660592611 >> 172.21.15.22:0/3660592611 conn(0x7fa43c0fd420 msgr2=0x7fa43c0ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:33.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.072+0000 7fa440fcb640 1 -- 172.21.15.22:0/3660592611 shutdown_connections 2024-08-20T01:29:33.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.072+0000 7fa440fcb640 1 -- 172.21.15.22:0/3660592611 wait complete. 2024-08-20T01:29:33.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.073+0000 7fa440fcb640 1 Processor -- start 2024-08-20T01:29:33.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.073+0000 7fa440fcb640 1 -- start start 2024-08-20T01:29:33.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.073+0000 7fa440fcb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa43c1019b0 0x7fa43c199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:33.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.073+0000 7fa440fcb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa43c1073c0 0x7fa43c199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:33.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.073+0000 7fa440fcb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa43c107d40 0x7fa43c19e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:33.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.073+0000 7fa440fcb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa43c111a00 con 0x7fa43c1073c0 2024-08-20T01:29:33.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.073+0000 7fa440fcb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa43c111880 con 0x7fa43c107d40 2024-08-20T01:29:33.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.073+0000 7fa440fcb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa43c111b80 con 0x7fa43c1019b0 2024-08-20T01:29:33.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.073+0000 7fa433fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa43c1073c0 0x7fa43c199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:33.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.073+0000 7fa433fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa43c1073c0 0x7fa43c199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46920/0 (socket says 172.21.15.22:46920) 2024-08-20T01:29:33.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.074+0000 7fa433fff640 1 -- 172.21.15.22:0/4230920052 learned_addr learned my addr 172.21.15.22:0/4230920052 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:33.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.074+0000 7fa43ad9d640 1 --2- 172.21.15.22:0/4230920052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa43c107d40 0x7fa43c19e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:33.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.074+0000 7fa43a59c640 1 --2- 172.21.15.22:0/4230920052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa43c1019b0 0x7fa43c199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:33.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.074+0000 7fa433fff640 1 -- 172.21.15.22:0/4230920052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa43c1019b0 msgr2=0x7fa43c199030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:33.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.074+0000 7fa433fff640 1 --2- 172.21.15.22:0/4230920052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa43c1019b0 0x7fa43c199030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:33.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.074+0000 7fa433fff640 1 -- 172.21.15.22:0/4230920052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa43c107d40 msgr2=0x7fa43c19e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:33.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.074+0000 7fa433fff640 1 --2- 172.21.15.22:0/4230920052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa43c107d40 0x7fa43c19e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:33.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.074+0000 7fa433fff640 1 -- 172.21.15.22:0/4230920052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43c19f0e0 con 0x7fa43c1073c0 2024-08-20T01:29:33.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.074+0000 7fa433fff640 1 --2- 172.21.15.22:0/4230920052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa43c1073c0 0x7fa43c199570 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa42400b4a0 tx=0x7fa42400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:33.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.074+0000 7fa4337fe640 1 -- 172.21.15.22:0/4230920052 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa424014070 con 0x7fa43c1073c0 2024-08-20T01:29:33.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.074+0000 7fa4337fe640 1 -- 172.21.15.22:0/4230920052 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa424010ac0 con 0x7fa43c1073c0 2024-08-20T01:29:33.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.074+0000 7fa440fcb640 1 -- 172.21.15.22:0/4230920052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa43c19f3d0 con 0x7fa43c1073c0 2024-08-20T01:29:33.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.074+0000 7fa4337fe640 1 -- 172.21.15.22:0/4230920052 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa424017c30 con 0x7fa43c1073c0 2024-08-20T01:29:33.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.074+0000 7fa440fcb640 1 -- 172.21.15.22:0/4230920052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa43c1a5a90 con 0x7fa43c1073c0 2024-08-20T01:29:33.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.075+0000 7fa440fcb640 1 -- 172.21.15.22:0/4230920052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa43c101d90 con 0x7fa43c1073c0 2024-08-20T01:29:33.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.077+0000 7fa4337fe640 1 -- 172.21.15.22:0/4230920052 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fa424017070 con 0x7fa43c1073c0 2024-08-20T01:29:33.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.077+0000 7fa4337fe640 1 --2- 172.21.15.22:0/4230920052 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa4280b3c60 0x7fa4280b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:33.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.077+0000 7fa43a59c640 1 --2- 172.21.15.22:0/4230920052 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa4280b3c60 0x7fa4280b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:33.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.077+0000 7fa4337fe640 1 -- 172.21.15.22:0/4230920052 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fa4240e3100 con 0x7fa43c1073c0 2024-08-20T01:29:33.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.078+0000 7fa43a59c640 1 --2- 172.21.15.22:0/4230920052 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa4280b3c60 0x7fa4280b6120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0058c0 tx=0x7fa42c00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:33.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.080+0000 7fa4337fe640 1 -- 172.21.15.22:0/4230920052 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa4240aa260 con 0x7fa43c1073c0 2024-08-20T01:29:33.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.262+0000 7fa440fcb640 1 -- 172.21.15.22:0/4230920052 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa43c104180 con 0x7fa4280b3c60 2024-08-20T01:29:33.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.266+0000 7fa4337fe640 1 -- 172.21.15.22:0/4230920052 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258856 (secure 0 0 0) 0x7fa43c104180 con 0x7fa4280b3c60 2024-08-20T01:29:33.269 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:29:33.270 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-08-20T01:29:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.269+0000 7fa440fcb640 1 -- 172.21.15.22:0/4230920052 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa4280b3c60 msgr2=0x7fa4280b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.269+0000 7fa440fcb640 1 --2- 172.21.15.22:0/4230920052 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa4280b3c60 0x7fa4280b6120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0058c0 tx=0x7fa42c00a250 comp rx=0 tx=0).stop 2024-08-20T01:29:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.269+0000 7fa440fcb640 1 -- 172.21.15.22:0/4230920052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa43c1073c0 msgr2=0x7fa43c199570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.269+0000 7fa440fcb640 1 --2- 172.21.15.22:0/4230920052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa43c1073c0 0x7fa43c199570 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa42400b4a0 tx=0x7fa42400b960 comp rx=0 tx=0).stop 2024-08-20T01:29:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.269+0000 7fa440fcb640 1 -- 172.21.15.22:0/4230920052 shutdown_connections 2024-08-20T01:29:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.269+0000 7fa440fcb640 1 --2- 172.21.15.22:0/4230920052 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa4280b3c60 0x7fa4280b6120 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.269+0000 7fa440fcb640 1 --2- 172.21.15.22:0/4230920052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa43c107d40 0x7fa43c19e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.269+0000 7fa440fcb640 1 --2- 172.21.15.22:0/4230920052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa43c1073c0 0x7fa43c199570 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:33.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.269+0000 7fa440fcb640 1 --2- 172.21.15.22:0/4230920052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa43c1019b0 0x7fa43c199030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:33.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.269+0000 7fa440fcb640 1 -- 172.21.15.22:0/4230920052 >> 172.21.15.22:0/4230920052 conn(0x7fa43c0fd420 msgr2=0x7fa43c06b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:33.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.269+0000 7fa440fcb640 1 -- 172.21.15.22:0/4230920052 shutdown_connections 2024-08-20T01:29:33.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:33.269+0000 7fa440fcb640 1 -- 172.21.15.22:0/4230920052 wait complete. 2024-08-20T01:29:33.952 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2024-08-20T01:29:31.301049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644713,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":190,"num_read_kb":179,"num_write":284,"num_write_kb":2249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363356,"kb_used_data":9948,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124578468,"statfs":{"total":1151940427776,"available":1151568351232,"internally_reserved":0,"allocated":10186752,"data_stored":6588844,"data_compressed":108864,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19139,"internal_metadata":361674045},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49745,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":114,"num_read_kb":115,"num_write":41,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003081"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.423346+0000","last_change":"2024-08-20T01:29:06.421092+0000","last_active":"2024-08-20T01:29:07.423346+0000","last_peered":"2024-08-20T01:29:07.423346+0000","last_clean":"2024-08-20T01:29:07.423346+0000","last_became_active":"2024-08-20T01:29:06.420484+0000","last_became_peered":"2024-08-20T01:29:06.420484+0000","last_unstale":"2024-08-20T01:29:07.423346+0000","last_undegraded":"2024-08-20T01:29:07.423346+0000","last_fullsized":"2024-08-20T01:29:07.423346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:55:54.177863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.440811+0000","last_change":"2024-08-20T01:29:06.414784+0000","last_active":"2024-08-20T01:29:07.440811+0000","last_peered":"2024-08-20T01:29:07.440811+0000","last_clean":"2024-08-20T01:29:07.440811+0000","last_became_active":"2024-08-20T01:29:06.414426+0000","last_became_peered":"2024-08-20T01:29:06.414426+0000","last_unstale":"2024-08-20T01:29:07.440811+0000","last_undegraded":"2024-08-20T01:29:07.440811+0000","last_fullsized":"2024-08-20T01:29:07.440811+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:13:45.634888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.440789+0000","last_change":"2024-08-20T01:29:06.416876+0000","last_active":"2024-08-20T01:29:07.440789+0000","last_peered":"2024-08-20T01:29:07.440789+0000","last_clean":"2024-08-20T01:29:07.440789+0000","last_became_active":"2024-08-20T01:29:06.416548+0000","last_became_peered":"2024-08-20T01:29:06.416548+0000","last_unstale":"2024-08-20T01:29:07.440789+0000","last_undegraded":"2024-08-20T01:29:07.440789+0000","last_fullsized":"2024-08-20T01:29:07.440789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:16:23.092129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.438898+0000","last_change":"2024-08-20T01:29:06.415474+0000","last_active":"2024-08-20T01:29:07.438898+0000","last_peered":"2024-08-20T01:29:07.438898+0000","last_clean":"2024-08-20T01:29:07.438898+0000","last_became_active":"2024-08-20T01:29:06.415120+0000","last_became_peered":"2024-08-20T01:29:06.415120+0000","last_unstale":"2024-08-20T01:29:07.438898+0000","last_undegraded":"2024-08-20T01:29:07.438898+0000","last_fullsized":"2024-08-20T01:29:07.438898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:47.059173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436719+0000","last_change":"2024-08-20T01:29:06.419600+0000","last_active":"2024-08-20T01:29:07.436719+0000","last_peered":"2024-08-20T01:29:07.436719+0000","last_clean":"2024-08-20T01:29:07.436719+0000","last_became_active":"2024-08-20T01:29:06.419280+0000","last_became_peered":"2024-08-20T01:29:06.419280+0000","last_unstale":"2024-08-20T01:29:07.436719+0000","last_undegraded":"2024-08-20T01:29:07.436719+0000","last_fullsized":"2024-08-20T01:29:07.436719+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:41:04.458681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.418917+0000","last_change":"2024-08-20T01:29:06.420995+0000","last_active":"2024-08-20T01:29:07.418917+0000","last_peered":"2024-08-20T01:29:07.418917+0000","last_clean":"2024-08-20T01:29:07.418917+0000","last_became_active":"2024-08-20T01:29:06.420703+0000","last_became_peered":"2024-08-20T01:29:06.420703+0000","last_unstale":"2024-08-20T01:29:07.418917+0000","last_undegraded":"2024-08-20T01:29:07.418917+0000","last_fullsized":"2024-08-20T01:29:07.418917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:21:08.502158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436854+0000","last_change":"2024-08-20T01:29:06.411605+0000","last_active":"2024-08-20T01:29:07.436854+0000","last_peered":"2024-08-20T01:29:07.436854+0000","last_clean":"2024-08-20T01:29:07.436854+0000","last_became_active":"2024-08-20T01:29:06.411258+0000","last_became_peered":"2024-08-20T01:29:06.411258+0000","last_unstale":"2024-08-20T01:29:07.436854+0000","last_undegraded":"2024-08-20T01:29:07.436854+0000","last_fullsized":"2024-08-20T01:29:07.436854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:17:02.390707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437858+0000","last_change":"2024-08-20T01:29:06.418514+0000","last_active":"2024-08-20T01:29:07.437858+0000","last_peered":"2024-08-20T01:29:07.437858+0000","last_clean":"2024-08-20T01:29:07.437858+0000","last_became_active":"2024-08-20T01:29:06.417450+0000","last_became_peered":"2024-08-20T01:29:06.417450+0000","last_unstale":"2024-08-20T01:29:07.437858+0000","last_undegraded":"2024-08-20T01:29:07.437858+0000","last_fullsized":"2024-08-20T01:29:07.437858+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:13:15.485333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437600+0000","last_change":"2024-08-20T01:29:06.425458+0000","last_active":"2024-08-20T01:29:07.437600+0000","last_peered":"2024-08-20T01:29:07.437600+0000","last_clean":"2024-08-20T01:29:07.437600+0000","last_became_active":"2024-08-20T01:29:06.425122+0000","last_became_peered":"2024-08-20T01:29:06.425122+0000","last_unstale":"2024-08-20T01:29:07.437600+0000","last_undegraded":"2024-08-20T01:29:07.437600+0000","last_fullsized":"2024-08-20T01:29:07.437600+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:52:59.857195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.419457+0000","last_change":"2024-08-20T01:29:06.420258+0000","last_active":"2024-08-20T01:29:07.419457+0000","last_peered":"2024-08-20T01:29:07.419457+0000","last_clean":"2024-08-20T01:29:07.419457+0000","last_became_active":"2024-08-20T01:29:06.419982+0000","last_became_peered":"2024-08-20T01:29:06.419982+0000","last_unstale":"2024-08-20T01:29:07.419457+0000","last_undegraded":"2024-08-20T01:29:07.419457+0000","last_fullsized":"2024-08-20T01:29:07.419457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:56:23.296739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437611+0000","last_change":"2024-08-20T01:29:06.421580+0000","last_active":"2024-08-20T01:29:07.437611+0000","last_peered":"2024-08-20T01:29:07.437611+0000","last_clean":"2024-08-20T01:29:07.437611+0000","last_became_active":"2024-08-20T01:29:06.421115+0000","last_became_peered":"2024-08-20T01:29:06.421115+0000","last_unstale":"2024-08-20T01:29:07.437611+0000","last_undegraded":"2024-08-20T01:29:07.437611+0000","last_fullsized":"2024-08-20T01:29:07.437611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:43:13.839230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.439002+0000","last_change":"2024-08-20T01:29:06.416950+0000","last_active":"2024-08-20T01:29:07.439002+0000","last_peered":"2024-08-20T01:29:07.439002+0000","last_clean":"2024-08-20T01:29:07.439002+0000","last_became_active":"2024-08-20T01:29:06.415585+0000","last_became_peered":"2024-08-20T01:29:06.415585+0000","last_unstale":"2024-08-20T01:29:07.439002+0000","last_undegraded":"2024-08-20T01:29:07.439002+0000","last_fullsized":"2024-08-20T01:29:07.439002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:47:54.132535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436200+0000","last_change":"2024-08-20T01:29:06.415145+0000","last_active":"2024-08-20T01:29:07.436200+0000","last_peered":"2024-08-20T01:29:07.436200+0000","last_clean":"2024-08-20T01:29:07.436200+0000","last_became_active":"2024-08-20T01:29:06.414753+0000","last_became_peered":"2024-08-20T01:29:06.414753+0000","last_unstale":"2024-08-20T01:29:07.436200+0000","last_undegraded":"2024-08-20T01:29:07.436200+0000","last_fullsized":"2024-08-20T01:29:07.436200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:43:00.158295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.440501+0000","last_change":"2024-08-20T01:29:06.415494+0000","last_active":"2024-08-20T01:29:07.440501+0000","last_peered":"2024-08-20T01:29:07.440501+0000","last_clean":"2024-08-20T01:29:07.440501+0000","last_became_active":"2024-08-20T01:29:06.415099+0000","last_became_peered":"2024-08-20T01:29:06.415099+0000","last_unstale":"2024-08-20T01:29:07.440501+0000","last_undegraded":"2024-08-20T01:29:07.440501+0000","last_fullsized":"2024-08-20T01:29:07.440501+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:07:01.946143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.440186+0000","last_change":"2024-08-20T01:29:06.418233+0000","last_active":"2024-08-20T01:29:07.440186+0000","last_peered":"2024-08-20T01:29:07.440186+0000","last_clean":"2024-08-20T01:29:07.440186+0000","last_became_active":"2024-08-20T01:29:06.417929+0000","last_became_peered":"2024-08-20T01:29:06.417929+0000","last_unstale":"2024-08-20T01:29:07.440186+0000","last_undegraded":"2024-08-20T01:29:07.440186+0000","last_fullsized":"2024-08-20T01:29:07.440186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:44:08.548821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436119+0000","last_change":"2024-08-20T01:29:06.418819+0000","last_active":"2024-08-20T01:29:07.436119+0000","last_peered":"2024-08-20T01:29:07.436119+0000","last_clean":"2024-08-20T01:29:07.436119+0000","last_became_active":"2024-08-20T01:29:06.418378+0000","last_became_peered":"2024-08-20T01:29:06.418378+0000","last_unstale":"2024-08-20T01:29:07.436119+0000","last_undegraded":"2024-08-20T01:29:07.436119+0000","last_fullsized":"2024-08-20T01:29:07.436119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:01.419539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.423427+0000","last_change":"2024-08-20T01:29:06.420804+0000","last_active":"2024-08-20T01:29:07.423427+0000","last_peered":"2024-08-20T01:29:07.423427+0000","last_clean":"2024-08-20T01:29:07.423427+0000","last_became_active":"2024-08-20T01:29:06.420027+0000","last_became_peered":"2024-08-20T01:29:06.420027+0000","last_unstale":"2024-08-20T01:29:07.423427+0000","last_undegraded":"2024-08-20T01:29:07.423427+0000","last_fullsized":"2024-08-20T01:29:07.423427+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:00:37.104792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.418717+0000","last_change":"2024-08-20T01:29:06.411625+0000","last_active":"2024-08-20T01:29:07.418717+0000","last_peered":"2024-08-20T01:29:07.418717+0000","last_clean":"2024-08-20T01:29:07.418717+0000","last_became_active":"2024-08-20T01:29:06.411284+0000","last_became_peered":"2024-08-20T01:29:06.411284+0000","last_unstale":"2024-08-20T01:29:07.418717+0000","last_undegraded":"2024-08-20T01:29:07.418717+0000","last_fullsized":"2024-08-20T01:29:07.418717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:12:08.510755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436850+0000","last_change":"2024-08-20T01:29:06.421276+0000","last_active":"2024-08-20T01:29:07.436850+0000","last_peered":"2024-08-20T01:29:07.436850+0000","last_clean":"2024-08-20T01:29:07.436850+0000","last_became_active":"2024-08-20T01:29:06.420916+0000","last_became_peered":"2024-08-20T01:29:06.420916+0000","last_unstale":"2024-08-20T01:29:07.436850+0000","last_undegraded":"2024-08-20T01:29:07.436850+0000","last_fullsized":"2024-08-20T01:29:07.436850+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:04:59.399172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.423198+0000","last_change":"2024-08-20T01:29:06.420848+0000","last_active":"2024-08-20T01:29:07.423198+0000","last_peered":"2024-08-20T01:29:07.423198+0000","last_clean":"2024-08-20T01:29:07.423198+0000","last_became_active":"2024-08-20T01:29:06.420465+0000","last_became_peered":"2024-08-20T01:29:06.420465+0000","last_unstale":"2024-08-20T01:29:07.423198+0000","last_undegraded":"2024-08-20T01:29:07.423198+0000","last_fullsized":"2024-08-20T01:29:07.423198+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:42:33.210813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436305+0000","last_change":"2024-08-20T01:29:06.407353+0000","last_active":"2024-08-20T01:29:07.436305+0000","last_peered":"2024-08-20T01:29:07.436305+0000","last_clean":"2024-08-20T01:29:07.436305+0000","last_became_active":"2024-08-20T01:29:06.406944+0000","last_became_peered":"2024-08-20T01:29:06.406944+0000","last_unstale":"2024-08-20T01:29:07.436305+0000","last_undegraded":"2024-08-20T01:29:07.436305+0000","last_fullsized":"2024-08-20T01:29:07.436305+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:49:22.324317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436402+0000","last_change":"2024-08-20T01:29:06.419757+0000","last_active":"2024-08-20T01:29:07.436402+0000","last_peered":"2024-08-20T01:29:07.436402+0000","last_clean":"2024-08-20T01:29:07.436402+0000","last_became_active":"2024-08-20T01:29:06.419433+0000","last_became_peered":"2024-08-20T01:29:06.419433+0000","last_unstale":"2024-08-20T01:29:07.436402+0000","last_undegraded":"2024-08-20T01:29:07.436402+0000","last_fullsized":"2024-08-20T01:29:07.436402+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:22:36.968949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437490+0000","last_change":"2024-08-20T01:29:06.418110+0000","last_active":"2024-08-20T01:29:07.437490+0000","last_peered":"2024-08-20T01:29:07.437490+0000","last_clean":"2024-08-20T01:29:07.437490+0000","last_became_active":"2024-08-20T01:29:06.417776+0000","last_became_peered":"2024-08-20T01:29:06.417776+0000","last_unstale":"2024-08-20T01:29:07.437490+0000","last_undegraded":"2024-08-20T01:29:07.437490+0000","last_fullsized":"2024-08-20T01:29:07.437490+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:55:55.105453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437202+0000","last_change":"2024-08-20T01:29:06.414240+0000","last_active":"2024-08-20T01:29:07.437202+0000","last_peered":"2024-08-20T01:29:07.437202+0000","last_clean":"2024-08-20T01:29:07.437202+0000","last_became_active":"2024-08-20T01:29:06.413884+0000","last_became_peered":"2024-08-20T01:29:06.413884+0000","last_unstale":"2024-08-20T01:29:07.437202+0000","last_undegraded":"2024-08-20T01:29:07.437202+0000","last_fullsized":"2024-08-20T01:29:07.437202+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:00.042588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.438461+0000","last_change":"2024-08-20T01:29:06.419344+0000","last_active":"2024-08-20T01:29:07.438461+0000","last_peered":"2024-08-20T01:29:07.438461+0000","last_clean":"2024-08-20T01:29:07.438461+0000","last_became_active":"2024-08-20T01:29:06.418689+0000","last_became_peered":"2024-08-20T01:29:06.418689+0000","last_unstale":"2024-08-20T01:29:07.438461+0000","last_undegraded":"2024-08-20T01:29:07.438461+0000","last_fullsized":"2024-08-20T01:29:07.438461+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:34:23.604213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.438695+0000","last_change":"2024-08-20T01:29:06.415161+0000","last_active":"2024-08-20T01:29:07.438695+0000","last_peered":"2024-08-20T01:29:07.438695+0000","last_clean":"2024-08-20T01:29:07.438695+0000","last_became_active":"2024-08-20T01:29:06.414812+0000","last_became_peered":"2024-08-20T01:29:06.414812+0000","last_unstale":"2024-08-20T01:29:07.438695+0000","last_undegraded":"2024-08-20T01:29:07.438695+0000","last_fullsized":"2024-08-20T01:29:07.438695+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:10:49.527635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.423328+0000","last_change":"2024-08-20T01:29:06.416502+0000","last_active":"2024-08-20T01:29:07.423328+0000","last_peered":"2024-08-20T01:29:07.423328+0000","last_clean":"2024-08-20T01:29:07.423328+0000","last_became_active":"2024-08-20T01:29:06.416139+0000","last_became_peered":"2024-08-20T01:29:06.416139+0000","last_unstale":"2024-08-20T01:29:07.423328+0000","last_undegraded":"2024-08-20T01:29:07.423328+0000","last_fullsized":"2024-08-20T01:29:07.423328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:19:32.379867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436746+0000","last_change":"2024-08-20T01:29:06.412494+0000","last_active":"2024-08-20T01:29:07.436746+0000","last_peered":"2024-08-20T01:29:07.436746+0000","last_clean":"2024-08-20T01:29:07.436746+0000","last_became_active":"2024-08-20T01:29:06.412158+0000","last_became_peered":"2024-08-20T01:29:06.412158+0000","last_unstale":"2024-08-20T01:29:07.436746+0000","last_undegraded":"2024-08-20T01:29:07.436746+0000","last_fullsized":"2024-08-20T01:29:07.436746+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:57:52.088445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.440581+0000","last_change":"2024-08-20T01:29:06.412869+0000","last_active":"2024-08-20T01:29:07.440581+0000","last_peered":"2024-08-20T01:29:07.440581+0000","last_clean":"2024-08-20T01:29:07.440581+0000","last_became_active":"2024-08-20T01:29:06.412540+0000","last_became_peered":"2024-08-20T01:29:06.412540+0000","last_unstale":"2024-08-20T01:29:07.440581+0000","last_undegraded":"2024-08-20T01:29:07.440581+0000","last_fullsized":"2024-08-20T01:29:07.440581+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:11:10.011252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437144+0000","last_change":"2024-08-20T01:29:06.420162+0000","last_active":"2024-08-20T01:29:07.437144+0000","last_peered":"2024-08-20T01:29:07.437144+0000","last_clean":"2024-08-20T01:29:07.437144+0000","last_became_active":"2024-08-20T01:29:06.419855+0000","last_became_peered":"2024-08-20T01:29:06.419855+0000","last_unstale":"2024-08-20T01:29:07.437144+0000","last_undegraded":"2024-08-20T01:29:07.437144+0000","last_fullsized":"2024-08-20T01:29:07.437144+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:30:28.151619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437803+0000","last_change":"2024-08-20T01:29:06.423874+0000","last_active":"2024-08-20T01:29:07.437803+0000","last_peered":"2024-08-20T01:29:07.437803+0000","last_clean":"2024-08-20T01:29:07.437803+0000","last_became_active":"2024-08-20T01:29:06.423561+0000","last_became_peered":"2024-08-20T01:29:06.423561+0000","last_unstale":"2024-08-20T01:29:07.437803+0000","last_undegraded":"2024-08-20T01:29:07.437803+0000","last_fullsized":"2024-08-20T01:29:07.437803+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:13:53.654099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.423001+0000","last_change":"2024-08-20T01:29:06.414212+0000","last_active":"2024-08-20T01:29:07.423001+0000","last_peered":"2024-08-20T01:29:07.423001+0000","last_clean":"2024-08-20T01:29:07.423001+0000","last_became_active":"2024-08-20T01:29:06.413848+0000","last_became_peered":"2024-08-20T01:29:06.413848+0000","last_unstale":"2024-08-20T01:29:07.423001+0000","last_undegraded":"2024-08-20T01:29:07.423001+0000","last_fullsized":"2024-08-20T01:29:07.423001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:00:29.005461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.438264+0000","last_change":"2024-08-20T01:29:06.418284+0000","last_active":"2024-08-20T01:29:07.438264+0000","last_peered":"2024-08-20T01:29:07.438264+0000","last_clean":"2024-08-20T01:29:07.438264+0000","last_became_active":"2024-08-20T01:29:06.417990+0000","last_became_peered":"2024-08-20T01:29:06.417990+0000","last_unstale":"2024-08-20T01:29:07.438264+0000","last_undegraded":"2024-08-20T01:29:07.438264+0000","last_fullsized":"2024-08-20T01:29:07.438264+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:20:04.456130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":42,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:28.494855+0000","last_change":"2024-08-20T01:29:04.413482+0000","last_active":"2024-08-20T01:29:28.494855+0000","last_peered":"2024-08-20T01:29:28.494855+0000","last_clean":"2024-08-20T01:29:28.494855+0000","last_became_active":"2024-08-20T01:29:04.413096+0000","last_became_peered":"2024-08-20T01:29:04.413096+0000","last_unstale":"2024-08-20T01:29:28.494855+0000","last_undegraded":"2024-08-20T01:29:28.494855+0000","last_fullsized":"2024-08-20T01:29:28.494855+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:26:05.947182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437554+0000","last_change":"2024-08-20T01:29:06.425418+0000","last_active":"2024-08-20T01:29:07.437554+0000","last_peered":"2024-08-20T01:29:07.437554+0000","last_clean":"2024-08-20T01:29:07.437554+0000","last_became_active":"2024-08-20T01:29:06.425102+0000","last_became_peered":"2024-08-20T01:29:06.425102+0000","last_unstale":"2024-08-20T01:29:07.437554+0000","last_undegraded":"2024-08-20T01:29:07.437554+0000","last_fullsized":"2024-08-20T01:29:07.437554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:22:48.891732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:15.474598+0000","last_change":"2024-08-20T01:29:04.409605+0000","last_active":"2024-08-20T01:29:15.474598+0000","last_peered":"2024-08-20T01:29:15.474598+0000","last_clean":"2024-08-20T01:29:15.474598+0000","last_became_active":"2024-08-20T01:29:04.409284+0000","last_became_peered":"2024-08-20T01:29:04.409284+0000","last_unstale":"2024-08-20T01:29:15.474598+0000","last_undegraded":"2024-08-20T01:29:15.474598+0000","last_fullsized":"2024-08-20T01:29:15.474598+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:29:27.471748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:15.473456+0000","last_change":"2024-08-20T01:29:04.400635+0000","last_active":"2024-08-20T01:29:15.473456+0000","last_peered":"2024-08-20T01:29:15.473456+0000","last_clean":"2024-08-20T01:29:15.473456+0000","last_became_active":"2024-08-20T01:29:04.400234+0000","last_became_peered":"2024-08-20T01:29:04.400234+0000","last_unstale":"2024-08-20T01:29:15.473456+0000","last_undegraded":"2024-08-20T01:29:15.473456+0000","last_fullsized":"2024-08-20T01:29:15.473456+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:47:24.810916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.438233+0000","last_change":"2024-08-20T01:29:06.411872+0000","last_active":"2024-08-20T01:29:07.438233+0000","last_peered":"2024-08-20T01:29:07.438233+0000","last_clean":"2024-08-20T01:29:07.438233+0000","last_became_active":"2024-08-20T01:29:06.411563+0000","last_became_peered":"2024-08-20T01:29:06.411563+0000","last_unstale":"2024-08-20T01:29:07.438233+0000","last_undegraded":"2024-08-20T01:29:07.438233+0000","last_fullsized":"2024-08-20T01:29:07.438233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:03:37.351529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436424+0000","last_change":"2024-08-20T01:29:04.407395+0000","last_active":"2024-08-20T01:29:07.436424+0000","last_peered":"2024-08-20T01:29:07.436424+0000","last_clean":"2024-08-20T01:29:07.436424+0000","last_became_active":"2024-08-20T01:29:04.407000+0000","last_became_peered":"2024-08-20T01:29:04.407000+0000","last_unstale":"2024-08-20T01:29:07.436424+0000","last_undegraded":"2024-08-20T01:29:07.436424+0000","last_fullsized":"2024-08-20T01:29:07.436424+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:36:42.512450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.418385+0000","last_change":"2024-08-20T01:29:06.410094+0000","last_active":"2024-08-20T01:29:07.418385+0000","last_peered":"2024-08-20T01:29:07.418385+0000","last_clean":"2024-08-20T01:29:07.418385+0000","last_became_active":"2024-08-20T01:29:06.409749+0000","last_became_peered":"2024-08-20T01:29:06.409749+0000","last_unstale":"2024-08-20T01:29:07.418385+0000","last_undegraded":"2024-08-20T01:29:07.418385+0000","last_fullsized":"2024-08-20T01:29:07.418385+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:52:51.072953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:29.495673+0000","last_change":"2024-08-20T01:29:04.406810+0000","last_active":"2024-08-20T01:29:29.495673+0000","last_peered":"2024-08-20T01:29:29.495673+0000","last_clean":"2024-08-20T01:29:29.495673+0000","last_became_active":"2024-08-20T01:29:04.406436+0000","last_became_peered":"2024-08-20T01:29:04.406436+0000","last_unstale":"2024-08-20T01:29:29.495673+0000","last_undegraded":"2024-08-20T01:29:29.495673+0000","last_fullsized":"2024-08-20T01:29:29.495673+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:49:57.305447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437133+0000","last_change":"2024-08-20T01:29:06.424442+0000","last_active":"2024-08-20T01:29:07.437133+0000","last_peered":"2024-08-20T01:29:07.437133+0000","last_clean":"2024-08-20T01:29:07.437133+0000","last_became_active":"2024-08-20T01:29:06.424132+0000","last_became_peered":"2024-08-20T01:29:06.424132+0000","last_unstale":"2024-08-20T01:29:07.437133+0000","last_undegraded":"2024-08-20T01:29:07.437133+0000","last_fullsized":"2024-08-20T01:29:07.437133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:31:30.861113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:14.464882+0000","last_change":"2024-08-20T01:29:04.412307+0000","last_active":"2024-08-20T01:29:14.464882+0000","last_peered":"2024-08-20T01:29:14.464882+0000","last_clean":"2024-08-20T01:29:14.464882+0000","last_became_active":"2024-08-20T01:29:04.411861+0000","last_became_peered":"2024-08-20T01:29:04.411861+0000","last_unstale":"2024-08-20T01:29:14.464882+0000","last_undegraded":"2024-08-20T01:29:14.464882+0000","last_fullsized":"2024-08-20T01:29:14.464882+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:56:51.356821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.441209+0000","last_change":"2024-08-20T01:29:06.418525+0000","last_active":"2024-08-20T01:29:07.441209+0000","last_peered":"2024-08-20T01:29:07.441209+0000","last_clean":"2024-08-20T01:29:07.441209+0000","last_became_active":"2024-08-20T01:29:06.417902+0000","last_became_peered":"2024-08-20T01:29:06.417902+0000","last_unstale":"2024-08-20T01:29:07.441209+0000","last_undegraded":"2024-08-20T01:29:07.441209+0000","last_fullsized":"2024-08-20T01:29:07.441209+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:28:23.017315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:14.462970+0000","last_change":"2024-08-20T01:29:05.171538+0000","last_active":"2024-08-20T01:29:14.462970+0000","last_peered":"2024-08-20T01:29:14.462970+0000","last_clean":"2024-08-20T01:29:14.462970+0000","last_became_active":"2024-08-20T01:29:05.171172+0000","last_became_peered":"2024-08-20T01:29:05.171172+0000","last_unstale":"2024-08-20T01:29:14.462970+0000","last_undegraded":"2024-08-20T01:29:14.462970+0000","last_fullsized":"2024-08-20T01:29:14.462970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:04:27.968049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436368+0000","last_change":"2024-08-20T01:29:06.426886+0000","last_active":"2024-08-20T01:29:07.436368+0000","last_peered":"2024-08-20T01:29:07.436368+0000","last_clean":"2024-08-20T01:29:07.436368+0000","last_became_active":"2024-08-20T01:29:06.426569+0000","last_became_peered":"2024-08-20T01:29:06.426569+0000","last_unstale":"2024-08-20T01:29:07.436368+0000","last_undegraded":"2024-08-20T01:29:07.436368+0000","last_fullsized":"2024-08-20T01:29:07.436368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:34:21.948591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'25","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:30.501543+0000","last_change":"2024-08-20T01:29:04.412181+0000","last_active":"2024-08-20T01:29:30.501543+0000","last_peered":"2024-08-20T01:29:30.501543+0000","last_clean":"2024-08-20T01:29:30.501543+0000","last_became_active":"2024-08-20T01:29:04.411645+0000","last_became_peered":"2024-08-20T01:29:04.411645+0000","last_unstale":"2024-08-20T01:29:30.501543+0000","last_undegraded":"2024-08-20T01:29:30.501543+0000","last_fullsized":"2024-08-20T01:29:30.501543+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:09:28.425113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":66,"num_write":26,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.439083+0000","last_change":"2024-08-20T01:29:06.417097+0000","last_active":"2024-08-20T01:29:07.439083+0000","last_peered":"2024-08-20T01:29:07.439083+0000","last_clean":"2024-08-20T01:29:07.439083+0000","last_became_active":"2024-08-20T01:29:06.416491+0000","last_became_peered":"2024-08-20T01:29:06.416491+0000","last_unstale":"2024-08-20T01:29:07.439083+0000","last_undegraded":"2024-08-20T01:29:07.439083+0000","last_fullsized":"2024-08-20T01:29:07.439083+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:30:16.071161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:15.473695+0000","last_change":"2024-08-20T01:29:04.412071+0000","last_active":"2024-08-20T01:29:15.473695+0000","last_peered":"2024-08-20T01:29:15.473695+0000","last_clean":"2024-08-20T01:29:15.473695+0000","last_became_active":"2024-08-20T01:29:04.411741+0000","last_became_peered":"2024-08-20T01:29:04.411741+0000","last_unstale":"2024-08-20T01:29:15.473695+0000","last_undegraded":"2024-08-20T01:29:15.473695+0000","last_fullsized":"2024-08-20T01:29:15.473695+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:33:47.753754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.435976+0000","last_change":"2024-08-20T01:29:06.408996+0000","last_active":"2024-08-20T01:29:07.435976+0000","last_peered":"2024-08-20T01:29:07.435976+0000","last_clean":"2024-08-20T01:29:07.435976+0000","last_became_active":"2024-08-20T01:29:06.408685+0000","last_became_peered":"2024-08-20T01:29:06.408685+0000","last_unstale":"2024-08-20T01:29:07.435976+0000","last_undegraded":"2024-08-20T01:29:07.435976+0000","last_fullsized":"2024-08-20T01:29:07.435976+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:18:28.974108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:14.464968+0000","last_change":"2024-08-20T01:29:04.407852+0000","last_active":"2024-08-20T01:29:14.464968+0000","last_peered":"2024-08-20T01:29:14.464968+0000","last_clean":"2024-08-20T01:29:14.464968+0000","last_became_active":"2024-08-20T01:29:04.406828+0000","last_became_peered":"2024-08-20T01:29:04.406828+0000","last_unstale":"2024-08-20T01:29:14.464968+0000","last_undegraded":"2024-08-20T01:29:14.464968+0000","last_fullsized":"2024-08-20T01:29:14.464968+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:36:03.641146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437106+0000","last_change":"2024-08-20T01:29:06.418652+0000","last_active":"2024-08-20T01:29:07.437106+0000","last_peered":"2024-08-20T01:29:07.437106+0000","last_clean":"2024-08-20T01:29:07.437106+0000","last_became_active":"2024-08-20T01:29:06.418340+0000","last_became_peered":"2024-08-20T01:29:06.418340+0000","last_unstale":"2024-08-20T01:29:07.437106+0000","last_undegraded":"2024-08-20T01:29:07.437106+0000","last_fullsized":"2024-08-20T01:29:07.437106+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:56:30.194426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'3","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:28.494396+0000","last_change":"2024-08-20T01:29:04.405950+0000","last_active":"2024-08-20T01:29:28.494396+0000","last_peered":"2024-08-20T01:29:28.494396+0000","last_clean":"2024-08-20T01:29:28.494396+0000","last_became_active":"2024-08-20T01:29:04.405650+0000","last_became_peered":"2024-08-20T01:29:04.405650+0000","last_unstale":"2024-08-20T01:29:28.494396+0000","last_undegraded":"2024-08-20T01:29:28.494396+0000","last_fullsized":"2024-08-20T01:29:28.494396+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:12:01.752958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436457+0000","last_change":"2024-08-20T01:29:06.413967+0000","last_active":"2024-08-20T01:29:07.436457+0000","last_peered":"2024-08-20T01:29:07.436457+0000","last_clean":"2024-08-20T01:29:07.436457+0000","last_became_active":"2024-08-20T01:29:06.413628+0000","last_became_peered":"2024-08-20T01:29:06.413628+0000","last_unstale":"2024-08-20T01:29:07.436457+0000","last_undegraded":"2024-08-20T01:29:07.436457+0000","last_fullsized":"2024-08-20T01:29:07.436457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:09:16.394482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:15.475956+0000","last_change":"2024-08-20T01:29:05.169872+0000","last_active":"2024-08-20T01:29:15.475956+0000","last_peered":"2024-08-20T01:29:15.475956+0000","last_clean":"2024-08-20T01:29:15.475956+0000","last_became_active":"2024-08-20T01:29:05.169186+0000","last_became_peered":"2024-08-20T01:29:05.169186+0000","last_unstale":"2024-08-20T01:29:15.475956+0000","last_undegraded":"2024-08-20T01:29:15.475956+0000","last_fullsized":"2024-08-20T01:29:15.475956+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:55:47.447959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436167+0000","last_change":"2024-08-20T01:29:06.426012+0000","last_active":"2024-08-20T01:29:07.436167+0000","last_peered":"2024-08-20T01:29:07.436167+0000","last_clean":"2024-08-20T01:29:07.436167+0000","last_became_active":"2024-08-20T01:29:06.425512+0000","last_became_peered":"2024-08-20T01:29:06.425512+0000","last_unstale":"2024-08-20T01:29:07.436167+0000","last_undegraded":"2024-08-20T01:29:07.436167+0000","last_fullsized":"2024-08-20T01:29:07.436167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:33:54.472124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:16.470073+0000","last_change":"2024-08-20T01:29:04.408188+0000","last_active":"2024-08-20T01:29:16.470073+0000","last_peered":"2024-08-20T01:29:16.470073+0000","last_clean":"2024-08-20T01:29:16.470073+0000","last_became_active":"2024-08-20T01:29:04.407794+0000","last_became_peered":"2024-08-20T01:29:04.407794+0000","last_unstale":"2024-08-20T01:29:16.470073+0000","last_undegraded":"2024-08-20T01:29:16.470073+0000","last_fullsized":"2024-08-20T01:29:16.470073+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:49:40.679218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.423381+0000","last_change":"2024-08-20T01:29:06.424429+0000","last_active":"2024-08-20T01:29:07.423381+0000","last_peered":"2024-08-20T01:29:07.423381+0000","last_clean":"2024-08-20T01:29:07.423381+0000","last_became_active":"2024-08-20T01:29:06.423923+0000","last_became_peered":"2024-08-20T01:29:06.423923+0000","last_unstale":"2024-08-20T01:29:07.423381+0000","last_undegraded":"2024-08-20T01:29:07.423381+0000","last_fullsized":"2024-08-20T01:29:07.423381+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:46:52.435715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.443139+0000","last_change":"2024-08-20T01:29:04.412178+0000","last_active":"2024-08-20T01:29:07.443139+0000","last_peered":"2024-08-20T01:29:07.443139+0000","last_clean":"2024-08-20T01:29:07.443139+0000","last_became_active":"2024-08-20T01:29:04.411819+0000","last_became_peered":"2024-08-20T01:29:04.411819+0000","last_unstale":"2024-08-20T01:29:07.443139+0000","last_undegraded":"2024-08-20T01:29:07.443139+0000","last_fullsized":"2024-08-20T01:29:07.443139+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:03:11.524911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436517+0000","last_change":"2024-08-20T01:29:06.415697+0000","last_active":"2024-08-20T01:29:07.436517+0000","last_peered":"2024-08-20T01:29:07.436517+0000","last_clean":"2024-08-20T01:29:07.436517+0000","last_became_active":"2024-08-20T01:29:06.415180+0000","last_became_peered":"2024-08-20T01:29:06.415180+0000","last_unstale":"2024-08-20T01:29:07.436517+0000","last_undegraded":"2024-08-20T01:29:07.436517+0000","last_fullsized":"2024-08-20T01:29:07.436517+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:55:50.810063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.442237+0000","last_change":"2024-08-20T01:29:04.405961+0000","last_active":"2024-08-20T01:29:07.442237+0000","last_peered":"2024-08-20T01:29:07.442237+0000","last_clean":"2024-08-20T01:29:07.442237+0000","last_became_active":"2024-08-20T01:29:04.405633+0000","last_became_peered":"2024-08-20T01:29:04.405633+0000","last_unstale":"2024-08-20T01:29:07.442237+0000","last_undegraded":"2024-08-20T01:29:07.442237+0000","last_fullsized":"2024-08-20T01:29:07.442237+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:00:27.918313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436878+0000","last_change":"2024-08-20T01:29:06.417221+0000","last_active":"2024-08-20T01:29:07.436878+0000","last_peered":"2024-08-20T01:29:07.436878+0000","last_clean":"2024-08-20T01:29:07.436878+0000","last_became_active":"2024-08-20T01:29:06.416912+0000","last_became_peered":"2024-08-20T01:29:06.416912+0000","last_unstale":"2024-08-20T01:29:07.436878+0000","last_undegraded":"2024-08-20T01:29:07.436878+0000","last_fullsized":"2024-08-20T01:29:07.436878+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:12:10.667134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:15.474141+0000","last_change":"2024-08-20T01:29:05.169494+0000","last_active":"2024-08-20T01:29:15.474141+0000","last_peered":"2024-08-20T01:29:15.474141+0000","last_clean":"2024-08-20T01:29:15.474141+0000","last_became_active":"2024-08-20T01:29:05.169059+0000","last_became_peered":"2024-08-20T01:29:05.169059+0000","last_unstale":"2024-08-20T01:29:15.474141+0000","last_undegraded":"2024-08-20T01:29:15.474141+0000","last_fullsized":"2024-08-20T01:29:15.474141+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:25:39.300668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437510+0000","last_change":"2024-08-20T01:29:06.424040+0000","last_active":"2024-08-20T01:29:07.437510+0000","last_peered":"2024-08-20T01:29:07.437510+0000","last_clean":"2024-08-20T01:29:07.437510+0000","last_became_active":"2024-08-20T01:29:06.421360+0000","last_became_peered":"2024-08-20T01:29:06.421360+0000","last_unstale":"2024-08-20T01:29:07.437510+0000","last_undegraded":"2024-08-20T01:29:07.437510+0000","last_fullsized":"2024-08-20T01:29:07.437510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:24:50.497310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436571+0000","last_change":"2024-08-20T01:27:51.625696+0000","last_active":"2024-08-20T01:29:07.436571+0000","last_peered":"2024-08-20T01:29:07.436571+0000","last_clean":"2024-08-20T01:29:07.436571+0000","last_became_active":"2024-08-20T01:27:51.620833+0000","last_became_peered":"2024-08-20T01:27:51.620833+0000","last_unstale":"2024-08-20T01:29:07.436571+0000","last_undegraded":"2024-08-20T01:29:07.436571+0000","last_fullsized":"2024-08-20T01:29:07.436571+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:24:32.140649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:24:32.140649+0000","last_clean_scrub_stamp":"2024-08-20T01:24:32.140649+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:54:02.650548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:16.474185+0000","last_change":"2024-08-20T01:29:04.405411+0000","last_active":"2024-08-20T01:29:16.474185+0000","last_peered":"2024-08-20T01:29:16.474185+0000","last_clean":"2024-08-20T01:29:16.474185+0000","last_became_active":"2024-08-20T01:29:04.404980+0000","last_became_peered":"2024-08-20T01:29:04.404980+0000","last_unstale":"2024-08-20T01:29:16.474185+0000","last_undegraded":"2024-08-20T01:29:16.474185+0000","last_fullsized":"2024-08-20T01:29:16.474185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:31:39.335857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.438278+0000","last_change":"2024-08-20T01:29:06.420368+0000","last_active":"2024-08-20T01:29:07.438278+0000","last_peered":"2024-08-20T01:29:07.438278+0000","last_clean":"2024-08-20T01:29:07.438278+0000","last_became_active":"2024-08-20T01:29:06.419653+0000","last_became_peered":"2024-08-20T01:29:06.419653+0000","last_unstale":"2024-08-20T01:29:07.438278+0000","last_undegraded":"2024-08-20T01:29:07.438278+0000","last_fullsized":"2024-08-20T01:29:07.438278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:48.771774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:15.474249+0000","last_change":"2024-08-20T01:29:04.410302+0000","last_active":"2024-08-20T01:29:15.474249+0000","last_peered":"2024-08-20T01:29:15.474249+0000","last_clean":"2024-08-20T01:29:15.474249+0000","last_became_active":"2024-08-20T01:29:04.409977+0000","last_became_peered":"2024-08-20T01:29:04.409977+0000","last_unstale":"2024-08-20T01:29:15.474249+0000","last_undegraded":"2024-08-20T01:29:15.474249+0000","last_fullsized":"2024-08-20T01:29:15.474249+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:57:21.593739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.435794+0000","last_change":"2024-08-20T01:29:06.419798+0000","last_active":"2024-08-20T01:29:07.435794+0000","last_peered":"2024-08-20T01:29:07.435794+0000","last_clean":"2024-08-20T01:29:07.435794+0000","last_became_active":"2024-08-20T01:29:06.419546+0000","last_became_peered":"2024-08-20T01:29:06.419546+0000","last_unstale":"2024-08-20T01:29:07.435794+0000","last_undegraded":"2024-08-20T01:29:07.435794+0000","last_fullsized":"2024-08-20T01:29:07.435794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:51:31.848883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:29.495124+0000","last_change":"2024-08-20T01:29:05.169237+0000","last_active":"2024-08-20T01:29:29.495124+0000","last_peered":"2024-08-20T01:29:29.495124+0000","last_clean":"2024-08-20T01:29:29.495124+0000","last_became_active":"2024-08-20T01:29:05.168778+0000","last_became_peered":"2024-08-20T01:29:05.168778+0000","last_unstale":"2024-08-20T01:29:29.495124+0000","last_undegraded":"2024-08-20T01:29:29.495124+0000","last_fullsized":"2024-08-20T01:29:29.495124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:04:48.847412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436128+0000","last_change":"2024-08-20T01:29:06.418497+0000","last_active":"2024-08-20T01:29:07.436128+0000","last_peered":"2024-08-20T01:29:07.436128+0000","last_clean":"2024-08-20T01:29:07.436128+0000","last_became_active":"2024-08-20T01:29:06.418140+0000","last_became_peered":"2024-08-20T01:29:06.418140+0000","last_unstale":"2024-08-20T01:29:07.436128+0000","last_undegraded":"2024-08-20T01:29:07.436128+0000","last_fullsized":"2024-08-20T01:29:07.436128+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:17:29.756540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437386+0000","last_change":"2024-08-20T01:29:04.404472+0000","last_active":"2024-08-20T01:29:07.437386+0000","last_peered":"2024-08-20T01:29:07.437386+0000","last_clean":"2024-08-20T01:29:07.437386+0000","last_became_active":"2024-08-20T01:29:04.404010+0000","last_became_peered":"2024-08-20T01:29:04.404010+0000","last_unstale":"2024-08-20T01:29:07.437386+0000","last_undegraded":"2024-08-20T01:29:07.437386+0000","last_fullsized":"2024-08-20T01:29:07.437386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:53:04.263362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.419142+0000","last_change":"2024-08-20T01:29:06.421875+0000","last_active":"2024-08-20T01:29:07.419142+0000","last_peered":"2024-08-20T01:29:07.419142+0000","last_clean":"2024-08-20T01:29:07.419142+0000","last_became_active":"2024-08-20T01:29:06.421542+0000","last_became_peered":"2024-08-20T01:29:06.421542+0000","last_unstale":"2024-08-20T01:29:07.419142+0000","last_undegraded":"2024-08-20T01:29:07.419142+0000","last_fullsized":"2024-08-20T01:29:07.419142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:10:46.320252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.418630+0000","last_change":"2024-08-20T01:29:05.169985+0000","last_active":"2024-08-20T01:29:07.418630+0000","last_peered":"2024-08-20T01:29:07.418630+0000","last_clean":"2024-08-20T01:29:07.418630+0000","last_became_active":"2024-08-20T01:29:05.169607+0000","last_became_peered":"2024-08-20T01:29:05.169607+0000","last_unstale":"2024-08-20T01:29:07.418630+0000","last_undegraded":"2024-08-20T01:29:07.418630+0000","last_fullsized":"2024-08-20T01:29:07.418630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:03:23.278369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.419313+0000","last_change":"2024-08-20T01:29:06.414862+0000","last_active":"2024-08-20T01:29:07.419313+0000","last_peered":"2024-08-20T01:29:07.419313+0000","last_clean":"2024-08-20T01:29:07.419313+0000","last_became_active":"2024-08-20T01:29:06.414527+0000","last_became_peered":"2024-08-20T01:29:06.414527+0000","last_unstale":"2024-08-20T01:29:07.419313+0000","last_undegraded":"2024-08-20T01:29:07.419313+0000","last_fullsized":"2024-08-20T01:29:07.419313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:14:20.884073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:14.462825+0000","last_change":"2024-08-20T01:29:05.169638+0000","last_active":"2024-08-20T01:29:14.462825+0000","last_peered":"2024-08-20T01:29:14.462825+0000","last_clean":"2024-08-20T01:29:14.462825+0000","last_became_active":"2024-08-20T01:29:05.169202+0000","last_became_peered":"2024-08-20T01:29:05.169202+0000","last_unstale":"2024-08-20T01:29:14.462825+0000","last_undegraded":"2024-08-20T01:29:14.462825+0000","last_fullsized":"2024-08-20T01:29:14.462825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:05:39.645782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436754+0000","last_change":"2024-08-20T01:29:06.413839+0000","last_active":"2024-08-20T01:29:07.436754+0000","last_peered":"2024-08-20T01:29:07.436754+0000","last_clean":"2024-08-20T01:29:07.436754+0000","last_became_active":"2024-08-20T01:29:06.413488+0000","last_became_peered":"2024-08-20T01:29:06.413488+0000","last_unstale":"2024-08-20T01:29:07.436754+0000","last_undegraded":"2024-08-20T01:29:07.436754+0000","last_fullsized":"2024-08-20T01:29:07.436754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:35:04.007192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'11","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:29.437537+0000","last_change":"2024-08-20T01:29:04.408415+0000","last_active":"2024-08-20T01:29:29.437537+0000","last_peered":"2024-08-20T01:29:29.437537+0000","last_clean":"2024-08-20T01:29:29.437537+0000","last_became_active":"2024-08-20T01:29:04.408095+0000","last_became_peered":"2024-08-20T01:29:04.408095+0000","last_unstale":"2024-08-20T01:29:29.437537+0000","last_undegraded":"2024-08-20T01:29:29.437537+0000","last_fullsized":"2024-08-20T01:29:29.437537+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:20:36.677054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.438657+0000","last_change":"2024-08-20T01:29:06.421024+0000","last_active":"2024-08-20T01:29:07.438657+0000","last_peered":"2024-08-20T01:29:07.438657+0000","last_clean":"2024-08-20T01:29:07.438657+0000","last_became_active":"2024-08-20T01:29:06.420631+0000","last_became_peered":"2024-08-20T01:29:06.420631+0000","last_unstale":"2024-08-20T01:29:07.438657+0000","last_undegraded":"2024-08-20T01:29:07.438657+0000","last_fullsized":"2024-08-20T01:29:07.438657+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:07:57.992230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:14.464216+0000","last_change":"2024-08-20T01:29:04.835075+0000","last_active":"2024-08-20T01:29:14.464216+0000","last_peered":"2024-08-20T01:29:14.464216+0000","last_clean":"2024-08-20T01:29:14.464216+0000","last_became_active":"2024-08-20T01:29:04.834759+0000","last_became_peered":"2024-08-20T01:29:04.834759+0000","last_unstale":"2024-08-20T01:29:14.464216+0000","last_undegraded":"2024-08-20T01:29:14.464216+0000","last_fullsized":"2024-08-20T01:29:14.464216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:45:29.040626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.440998+0000","last_change":"2024-08-20T01:29:06.418187+0000","last_active":"2024-08-20T01:29:07.440998+0000","last_peered":"2024-08-20T01:29:07.440998+0000","last_clean":"2024-08-20T01:29:07.440998+0000","last_became_active":"2024-08-20T01:29:06.417851+0000","last_became_peered":"2024-08-20T01:29:06.417851+0000","last_unstale":"2024-08-20T01:29:07.440998+0000","last_undegraded":"2024-08-20T01:29:07.440998+0000","last_fullsized":"2024-08-20T01:29:07.440998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:15:48.204455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:14.463638+0000","last_change":"2024-08-20T01:29:05.169736+0000","last_active":"2024-08-20T01:29:14.463638+0000","last_peered":"2024-08-20T01:29:14.463638+0000","last_clean":"2024-08-20T01:29:14.463638+0000","last_became_active":"2024-08-20T01:29:05.169403+0000","last_became_peered":"2024-08-20T01:29:05.169403+0000","last_unstale":"2024-08-20T01:29:14.463638+0000","last_undegraded":"2024-08-20T01:29:14.463638+0000","last_fullsized":"2024-08-20T01:29:14.463638+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:43:43.500841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.438586+0000","last_change":"2024-08-20T01:29:06.416433+0000","last_active":"2024-08-20T01:29:07.438586+0000","last_peered":"2024-08-20T01:29:07.438586+0000","last_clean":"2024-08-20T01:29:07.438586+0000","last_became_active":"2024-08-20T01:29:06.414708+0000","last_became_peered":"2024-08-20T01:29:06.414708+0000","last_unstale":"2024-08-20T01:29:07.438586+0000","last_undegraded":"2024-08-20T01:29:07.438586+0000","last_fullsized":"2024-08-20T01:29:07.438586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:17:15.461536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:14.463813+0000","last_change":"2024-08-20T01:29:04.403090+0000","last_active":"2024-08-20T01:29:14.463813+0000","last_peered":"2024-08-20T01:29:14.463813+0000","last_clean":"2024-08-20T01:29:14.463813+0000","last_became_active":"2024-08-20T01:29:04.402697+0000","last_became_peered":"2024-08-20T01:29:04.402697+0000","last_unstale":"2024-08-20T01:29:14.463813+0000","last_undegraded":"2024-08-20T01:29:14.463813+0000","last_fullsized":"2024-08-20T01:29:14.463813+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:36:04.055868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.423049+0000","last_change":"2024-08-20T01:29:06.413427+0000","last_active":"2024-08-20T01:29:07.423049+0000","last_peered":"2024-08-20T01:29:07.423049+0000","last_clean":"2024-08-20T01:29:07.423049+0000","last_became_active":"2024-08-20T01:29:06.413058+0000","last_became_peered":"2024-08-20T01:29:06.413058+0000","last_unstale":"2024-08-20T01:29:07.423049+0000","last_undegraded":"2024-08-20T01:29:07.423049+0000","last_fullsized":"2024-08-20T01:29:07.423049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:38:38.546701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437403+0000","last_change":"2024-08-20T01:29:04.409859+0000","last_active":"2024-08-20T01:29:07.437403+0000","last_peered":"2024-08-20T01:29:07.437403+0000","last_clean":"2024-08-20T01:29:07.437403+0000","last_became_active":"2024-08-20T01:29:04.409497+0000","last_became_peered":"2024-08-20T01:29:04.409497+0000","last_unstale":"2024-08-20T01:29:07.437403+0000","last_undegraded":"2024-08-20T01:29:07.437403+0000","last_fullsized":"2024-08-20T01:29:07.437403+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:23:43.548912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437863+0000","last_change":"2024-08-20T01:29:06.418428+0000","last_active":"2024-08-20T01:29:07.437863+0000","last_peered":"2024-08-20T01:29:07.437863+0000","last_clean":"2024-08-20T01:29:07.437863+0000","last_became_active":"2024-08-20T01:29:06.418033+0000","last_became_peered":"2024-08-20T01:29:06.418033+0000","last_unstale":"2024-08-20T01:29:07.437863+0000","last_undegraded":"2024-08-20T01:29:07.437863+0000","last_fullsized":"2024-08-20T01:29:07.437863+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:23.503977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:14.464593+0000","last_change":"2024-08-20T01:29:04.412549+0000","last_active":"2024-08-20T01:29:14.464593+0000","last_peered":"2024-08-20T01:29:14.464593+0000","last_clean":"2024-08-20T01:29:14.464593+0000","last_became_active":"2024-08-20T01:29:04.412071+0000","last_became_peered":"2024-08-20T01:29:04.412071+0000","last_unstale":"2024-08-20T01:29:14.464593+0000","last_undegraded":"2024-08-20T01:29:14.464593+0000","last_fullsized":"2024-08-20T01:29:14.464593+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:48:51.195295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437261+0000","last_change":"2024-08-20T01:29:06.421431+0000","last_active":"2024-08-20T01:29:07.437261+0000","last_peered":"2024-08-20T01:29:07.437261+0000","last_clean":"2024-08-20T01:29:07.437261+0000","last_became_active":"2024-08-20T01:29:06.420916+0000","last_became_peered":"2024-08-20T01:29:06.420916+0000","last_unstale":"2024-08-20T01:29:07.437261+0000","last_undegraded":"2024-08-20T01:29:07.437261+0000","last_fullsized":"2024-08-20T01:29:07.437261+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:45.674530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.437454+0000","last_change":"2024-08-20T01:29:06.418209+0000","last_active":"2024-08-20T01:29:07.437454+0000","last_peered":"2024-08-20T01:29:07.437454+0000","last_clean":"2024-08-20T01:29:07.437454+0000","last_became_active":"2024-08-20T01:29:06.417812+0000","last_became_peered":"2024-08-20T01:29:06.417812+0000","last_unstale":"2024-08-20T01:29:07.437454+0000","last_undegraded":"2024-08-20T01:29:07.437454+0000","last_fullsized":"2024-08-20T01:29:07.437454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:05:43.794281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.444210+0000","last_change":"2024-08-20T01:29:04.408472+0000","last_active":"2024-08-20T01:29:07.444210+0000","last_peered":"2024-08-20T01:29:07.444210+0000","last_clean":"2024-08-20T01:29:07.444210+0000","last_became_active":"2024-08-20T01:29:04.408082+0000","last_became_peered":"2024-08-20T01:29:04.408082+0000","last_unstale":"2024-08-20T01:29:07.444210+0000","last_undegraded":"2024-08-20T01:29:07.444210+0000","last_fullsized":"2024-08-20T01:29:07.444210+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:14:44.659672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.436372+0000","last_change":"2024-08-20T01:29:06.423562+0000","last_active":"2024-08-20T01:29:07.436372+0000","last_peered":"2024-08-20T01:29:07.436372+0000","last_clean":"2024-08-20T01:29:07.436372+0000","last_became_active":"2024-08-20T01:29:06.423241+0000","last_became_peered":"2024-08-20T01:29:06.423241+0000","last_unstale":"2024-08-20T01:29:07.436372+0000","last_undegraded":"2024-08-20T01:29:07.436372+0000","last_fullsized":"2024-08-20T01:29:07.436372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:59:46.049449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:15.474533+0000","last_change":"2024-08-20T01:29:04.412287+0000","last_active":"2024-08-20T01:29:15.474533+0000","last_peered":"2024-08-20T01:29:15.474533+0000","last_clean":"2024-08-20T01:29:15.474533+0000","last_became_active":"2024-08-20T01:29:04.411912+0000","last_became_peered":"2024-08-20T01:29:04.411912+0000","last_unstale":"2024-08-20T01:29:15.474533+0000","last_undegraded":"2024-08-20T01:29:15.474533+0000","last_fullsized":"2024-08-20T01:29:15.474533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:19:25.816795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.441137+0000","last_change":"2024-08-20T01:29:06.416899+0000","last_active":"2024-08-20T01:29:07.441137+0000","last_peered":"2024-08-20T01:29:07.441137+0000","last_clean":"2024-08-20T01:29:07.441137+0000","last_became_active":"2024-08-20T01:29:06.416594+0000","last_became_peered":"2024-08-20T01:29:06.416594+0000","last_unstale":"2024-08-20T01:29:07.441137+0000","last_undegraded":"2024-08-20T01:29:07.441137+0000","last_fullsized":"2024-08-20T01:29:07.441137+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:43.896728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.442252+0000","last_change":"2024-08-20T01:29:05.169571+0000","last_active":"2024-08-20T01:29:07.442252+0000","last_peered":"2024-08-20T01:29:07.442252+0000","last_clean":"2024-08-20T01:29:07.442252+0000","last_became_active":"2024-08-20T01:29:05.169250+0000","last_became_peered":"2024-08-20T01:29:05.169250+0000","last_unstale":"2024-08-20T01:29:07.442252+0000","last_undegraded":"2024-08-20T01:29:07.442252+0000","last_fullsized":"2024-08-20T01:29:07.442252+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:32:04.555825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:07.438100+0000","last_change":"2024-08-20T01:29:06.415582+0000","last_active":"2024-08-20T01:29:07.438100+0000","last_peered":"2024-08-20T01:29:07.438100+0000","last_clean":"2024-08-20T01:29:07.438100+0000","last_became_active":"2024-08-20T01:29:06.415284+0000","last_became_peered":"2024-08-20T01:29:06.415284+0000","last_unstale":"2024-08-20T01:29:07.438100+0000","last_undegraded":"2024-08-20T01:29:07.438100+0000","last_fullsized":"2024-08-20T01:29:07.438100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:43:10.311792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-20T01:29:15.475842+0000","last_change":"2024-08-20T01:29:04.409389+0000","last_active":"2024-08-20T01:29:15.475842+0000","last_peered":"2024-08-20T01:29:15.475842+0000","last_clean":"2024-08-20T01:29:15.475842+0000","last_became_active":"2024-08-20T01:29:04.409099+0000","last_became_peered":"2024-08-20T01:29:04.409099+0000","last_unstale":"2024-08-20T01:29:15.475842+0000","last_undegraded":"2024-08-20T01:29:15.475842+0000","last_fullsized":"2024-08-20T01:29:15.475842+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:19:30.156443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54111,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":114,"num_read_kb":115,"num_write":159,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":159023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285456,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743442,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31972,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713180,"statfs":{"total":95995035648,"available":95962296320,"internally_reserved":0,"allocated":806912,"data_stored":389228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939671,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":1030819,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103195,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":389464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299423,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":823296,"data_stored":389384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495653,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":872448,"data_stored":981314,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659179,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":388853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855408,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":980998,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018933,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":815104,"data_stored":389290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215161,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":389164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444094,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":440497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":429709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":390124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":51851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":51688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T01:29:33.956 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-20T01:29:33.957 INFO:tasks.cephadm:Setting up client nodes... 2024-08-20T01:29:33.957 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-20T01:29:34.216 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:34.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:34 smithi022 ceph-mon[18709]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:29:34.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:34 smithi022 ceph-mon[18709]: pgmap v295: 97 pgs: 97 active+clean; 630 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-08-20T01:29:34.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.708+0000 7fa094124640 1 -- 172.21.15.22:0/3399000385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa08c102770 msgr2=0x7fa08c102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:34.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.708+0000 7fa094124640 1 --2- 172.21.15.22:0/3399000385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa08c102770 0x7fa08c102bf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009930 tx=0x7fa07c02a420 comp rx=0 tx=0).stop 2024-08-20T01:29:34.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.708+0000 7fa094124640 1 -- 172.21.15.22:0/3399000385 shutdown_connections 2024-08-20T01:29:34.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.708+0000 7fa094124640 1 --2- 172.21.15.22:0/3399000385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa08c103130 0x7fa08c109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:34.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.708+0000 7fa094124640 1 --2- 172.21.15.22:0/3399000385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa08c102770 0x7fa08c102bf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:34.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.708+0000 7fa094124640 1 --2- 172.21.15.22:0/3399000385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa08c101610 0x7fa08c101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:34.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.709+0000 7fa094124640 1 -- 172.21.15.22:0/3399000385 >> 172.21.15.22:0/3399000385 conn(0x7fa08c0fcee0 msgr2=0x7fa08c0ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.709+0000 7fa094124640 1 -- 172.21.15.22:0/3399000385 shutdown_connections 2024-08-20T01:29:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.709+0000 7fa094124640 1 -- 172.21.15.22:0/3399000385 wait complete. 2024-08-20T01:29:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.709+0000 7fa094124640 1 Processor -- start 2024-08-20T01:29:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.709+0000 7fa094124640 1 -- start start 2024-08-20T01:29:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.709+0000 7fa094124640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa08c101610 0x7fa08c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa094124640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa08c102770 0x7fa08c199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa094124640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa08c103130 0x7fa08c199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa094124640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c10e380 con 0x7fa08c103130 2024-08-20T01:29:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa094124640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c10e200 con 0x7fa08c101610 2024-08-20T01:29:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa094124640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c10e500 con 0x7fa08c102770 2024-08-20T01:29:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa0926c1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa08c103130 0x7fa08c199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa0926c1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa08c103130 0x7fa08c199d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46940/0 (socket says 172.21.15.22:46940) 2024-08-20T01:29:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa0926c1640 1 -- 172.21.15.22:0/4207525703 learned_addr learned my addr 172.21.15.22:0/4207525703 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa091ec0640 1 --2- 172.21.15.22:0/4207525703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa08c101610 0x7fa08c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa0916bf640 1 --2- 172.21.15.22:0/4207525703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa08c102770 0x7fa08c199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa0926c1640 1 -- 172.21.15.22:0/4207525703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa08c102770 msgr2=0x7fa08c199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa0926c1640 1 --2- 172.21.15.22:0/4207525703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa08c102770 0x7fa08c199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa0926c1640 1 -- 172.21.15.22:0/4207525703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa08c101610 msgr2=0x7fa08c198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa0926c1640 1 --2- 172.21.15.22:0/4207525703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa08c101610 0x7fa08c198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa0926c1640 1 -- 172.21.15.22:0/4207525703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08c19a5c0 con 0x7fa08c103130 2024-08-20T01:29:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa0926c1640 1 --2- 172.21.15.22:0/4207525703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa08c103130 0x7fa08c199d20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa08400c970 tx=0x7fa08400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa082ffd640 1 -- 172.21.15.22:0/4207525703 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084007bb0 con 0x7fa08c103130 2024-08-20T01:29:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa094124640 1 -- 172.21.15.22:0/4207525703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa08c19a8b0 con 0x7fa08c103130 2024-08-20T01:29:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa082ffd640 1 -- 172.21.15.22:0/4207525703 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa084007d50 con 0x7fa08c103130 2024-08-20T01:29:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.710+0000 7fa082ffd640 1 -- 172.21.15.22:0/4207525703 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084004e60 con 0x7fa08c103130 2024-08-20T01:29:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.711+0000 7fa094124640 1 -- 172.21.15.22:0/4207525703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa08c1a0f90 con 0x7fa08c103130 2024-08-20T01:29:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.711+0000 7fa094124640 1 -- 172.21.15.22:0/4207525703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa08c101a10 con 0x7fa08c103130 2024-08-20T01:29:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.713+0000 7fa082ffd640 1 -- 172.21.15.22:0/4207525703 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fa084005000 con 0x7fa08c103130 2024-08-20T01:29:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.713+0000 7fa082ffd640 1 --2- 172.21.15.22:0/4207525703 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa0780b3c60 0x7fa0780b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.714+0000 7fa091ec0640 1 --2- 172.21.15.22:0/4207525703 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa0780b3c60 0x7fa0780b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.714+0000 7fa082ffd640 1 -- 172.21.15.22:0/4207525703 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fa0840e3cc0 con 0x7fa08c103130 2024-08-20T01:29:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.714+0000 7fa091ec0640 1 --2- 172.21.15.22:0/4207525703 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa0780b3c60 0x7fa0780b6120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa088007ec0 tx=0x7fa0880075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.716+0000 7fa082ffd640 1 -- 172.21.15.22:0/4207525703 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa084014030 con 0x7fa08c103130 2024-08-20T01:29:34.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:34 smithi077 ceph-mon[22251]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:29:34.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:34 smithi077 ceph-mon[22251]: pgmap v295: 97 pgs: 97 active+clean; 630 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-08-20T01:29:34.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.976+0000 7fa094124640 1 -- 172.21.15.22:0/4207525703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fa08c108930 con 0x7fa08c103130 2024-08-20T01:29:34.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.978+0000 7fa082ffd640 1 -- 172.21.15.22:0/4207525703 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fa0840ab360 con 0x7fa08c103130 2024-08-20T01:29:34.979 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2024-08-20T01:29:34.979 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQB+8cNmdK1AOhAAeZdZEBBdqRkY4HXuhT97uA== 2024-08-20T01:29:34.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.980+0000 7fa094124640 1 -- 172.21.15.22:0/4207525703 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa0780b3c60 msgr2=0x7fa0780b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:34.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.980+0000 7fa094124640 1 --2- 172.21.15.22:0/4207525703 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa0780b3c60 0x7fa0780b6120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa088007ec0 tx=0x7fa0880075b0 comp rx=0 tx=0).stop 2024-08-20T01:29:34.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.980+0000 7fa094124640 1 -- 172.21.15.22:0/4207525703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa08c103130 msgr2=0x7fa08c199d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:34.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.980+0000 7fa094124640 1 --2- 172.21.15.22:0/4207525703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa08c103130 0x7fa08c199d20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa08400c970 tx=0x7fa08400ce30 comp rx=0 tx=0).stop 2024-08-20T01:29:34.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.980+0000 7fa094124640 1 -- 172.21.15.22:0/4207525703 shutdown_connections 2024-08-20T01:29:34.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.980+0000 7fa094124640 1 --2- 172.21.15.22:0/4207525703 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa0780b3c60 0x7fa0780b6120 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:34.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.980+0000 7fa094124640 1 --2- 172.21.15.22:0/4207525703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa08c103130 0x7fa08c199d20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:34.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.980+0000 7fa094124640 1 --2- 172.21.15.22:0/4207525703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa08c102770 0x7fa08c199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:34.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.980+0000 7fa094124640 1 --2- 172.21.15.22:0/4207525703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa08c101610 0x7fa08c198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:34.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.980+0000 7fa094124640 1 -- 172.21.15.22:0/4207525703 >> 172.21.15.22:0/4207525703 conn(0x7fa08c0fcee0 msgr2=0x7fa08c105b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:34.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.981+0000 7fa094124640 1 -- 172.21.15.22:0/4207525703 shutdown_connections 2024-08-20T01:29:34.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:34.981+0000 7fa094124640 1 -- 172.21.15.22:0/4207525703 wait complete. 2024-08-20T01:29:35.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:34 smithi134 ceph-mon[22511]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:29:35.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:34 smithi134 ceph-mon[22511]: pgmap v295: 97 pgs: 97 active+clean; 630 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-08-20T01:29:35.598 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:35 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/4207525703' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-20T01:29:35.598 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:35 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/4207525703' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-20T01:29:35.627 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-08-20T01:29:35.628 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-08-20T01:29:35.628 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-20T01:29:35.667 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph config log 1 --format=json 2024-08-20T01:29:35.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:35 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/4207525703' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-20T01:29:35.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:35 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/4207525703' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-20T01:29:35.964 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:36.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:35 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/4207525703' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-20T01:29:36.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:35 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/4207525703' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-20T01:29:36.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.426+0000 7fa0bab49640 1 -- 172.21.15.22:0/1757530586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b4103870 msgr2=0x7fa0b4103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:36.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.426+0000 7fa0bab49640 1 --2- 172.21.15.22:0/1757530586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b4103870 0x7fa0b4103c50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009900 tx=0x7fa0a802a410 comp rx=0 tx=0).stop 2024-08-20T01:29:36.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.426+0000 7fa0bab49640 1 -- 172.21.15.22:0/1757530586 shutdown_connections 2024-08-20T01:29:36.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.426+0000 7fa0bab49640 1 --2- 172.21.15.22:0/1757530586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b410ce20 0x7fa0b410f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:36.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.426+0000 7fa0bab49640 1 --2- 172.21.15.22:0/1757530586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0b4104270 0x7fa0b410c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:36.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.426+0000 7fa0bab49640 1 --2- 172.21.15.22:0/1757530586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b4103870 0x7fa0b4103c50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:36.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.426+0000 7fa0bab49640 1 -- 172.21.15.22:0/1757530586 >> 172.21.15.22:0/1757530586 conn(0x7fa0b40fd440 msgr2=0x7fa0b40ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:36.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.426+0000 7fa0bab49640 1 -- 172.21.15.22:0/1757530586 shutdown_connections 2024-08-20T01:29:36.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.426+0000 7fa0bab49640 1 -- 172.21.15.22:0/1757530586 wait complete. 2024-08-20T01:29:36.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.427+0000 7fa0bab49640 1 Processor -- start 2024-08-20T01:29:36.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.427+0000 7fa0bab49640 1 -- start start 2024-08-20T01:29:36.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.427+0000 7fa0bab49640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0b4103870 0x7fa0b4198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:36.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.427+0000 7fa0bab49640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b4104270 0x7fa0b4199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:36.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.427+0000 7fa0bab49640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b410ce20 0x7fa0b419e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:36.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.427+0000 7fa0bab49640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b4112ae0 con 0x7fa0b410ce20 2024-08-20T01:29:36.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.427+0000 7fa0bab49640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b4112960 con 0x7fa0b4104270 2024-08-20T01:29:36.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.427+0000 7fa0bab49640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b4112c60 con 0x7fa0b4103870 2024-08-20T01:29:36.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.427+0000 7fa0b90e6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b410ce20 0x7fa0b419e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:36.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.427+0000 7fa0b90e6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b410ce20 0x7fa0b419e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46970/0 (socket says 172.21.15.22:46970) 2024-08-20T01:29:36.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.427+0000 7fa0b90e6640 1 -- 172.21.15.22:0/410051081 learned_addr learned my addr 172.21.15.22:0/410051081 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:36.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.427+0000 7fa0b88e5640 1 --2- 172.21.15.22:0/410051081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0b4103870 0x7fa0b4198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:36.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.427+0000 7fa0b3fff640 1 --2- 172.21.15.22:0/410051081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b4104270 0x7fa0b4199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:36.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.428+0000 7fa0b90e6640 1 -- 172.21.15.22:0/410051081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0b4103870 msgr2=0x7fa0b4198fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:36.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.428+0000 7fa0b90e6640 1 --2- 172.21.15.22:0/410051081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0b4103870 0x7fa0b4198fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:36.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.428+0000 7fa0b90e6640 1 -- 172.21.15.22:0/410051081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b4104270 msgr2=0x7fa0b4199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:36.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.428+0000 7fa0b90e6640 1 --2- 172.21.15.22:0/410051081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b4104270 0x7fa0b4199510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:36.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.428+0000 7fa0b90e6640 1 -- 172.21.15.22:0/410051081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b419f080 con 0x7fa0b410ce20 2024-08-20T01:29:36.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.428+0000 7fa0b3fff640 1 --2- 172.21.15.22:0/410051081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b4104270 0x7fa0b4199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:29:36.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.428+0000 7fa0b90e6640 1 --2- 172.21.15.22:0/410051081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b410ce20 0x7fa0b419e8b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00eaa0 tx=0x7fa0ac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:36.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.428+0000 7fa0b1ffb640 1 -- 172.21.15.22:0/410051081 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac00cdb0 con 0x7fa0b410ce20 2024-08-20T01:29:36.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.428+0000 7fa0bab49640 1 -- 172.21.15.22:0/410051081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b419f370 con 0x7fa0b410ce20 2024-08-20T01:29:36.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.428+0000 7fa0b1ffb640 1 -- 172.21.15.22:0/410051081 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0ac005020 con 0x7fa0b410ce20 2024-08-20T01:29:36.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.428+0000 7fa0b1ffb640 1 -- 172.21.15.22:0/410051081 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac0116d0 con 0x7fa0b410ce20 2024-08-20T01:29:36.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.428+0000 7fa0bab49640 1 -- 172.21.15.22:0/410051081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b41a5ab0 con 0x7fa0b410ce20 2024-08-20T01:29:36.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.429+0000 7fa0bab49640 1 -- 172.21.15.22:0/410051081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b4103c50 con 0x7fa0b410ce20 2024-08-20T01:29:36.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.430+0000 7fa0b1ffb640 1 -- 172.21.15.22:0/410051081 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fa0ac0051d0 con 0x7fa0b410ce20 2024-08-20T01:29:36.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.431+0000 7fa0b1ffb640 1 --2- 172.21.15.22:0/410051081 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa0a40b3c60 0x7fa0a40b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:36.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.431+0000 7fa0b1ffb640 1 -- 172.21.15.22:0/410051081 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fa0ac0e3d90 con 0x7fa0b410ce20 2024-08-20T01:29:36.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.431+0000 7fa0b88e5640 1 --2- 172.21.15.22:0/410051081 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa0a40b3c60 0x7fa0a40b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:36.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.432+0000 7fa0b88e5640 1 --2- 172.21.15.22:0/410051081 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa0a40b3c60 0x7fa0a40b6120 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8031440 tx=0x7fa0a8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:36.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.435+0000 7fa0b1ffb640 1 -- 172.21.15.22:0/410051081 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa0ac016030 con 0x7fa0b410ce20 2024-08-20T01:29:36.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.624+0000 7fa0bab49640 1 -- 172.21.15.22:0/410051081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fa0b41078e0 con 0x7fa0b410ce20 2024-08-20T01:29:36.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.625+0000 7fa0b1ffb640 1 -- 172.21.15.22:0/410051081 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v50) ==== 86+0+133 (secure 0 0 0) 0x7fa0ac090e20 con 0x7fa0b410ce20 2024-08-20T01:29:36.626 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:29:36.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.627+0000 7fa0bab49640 1 -- 172.21.15.22:0/410051081 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa0a40b3c60 msgr2=0x7fa0a40b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:36.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.627+0000 7fa0bab49640 1 --2- 172.21.15.22:0/410051081 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa0a40b3c60 0x7fa0a40b6120 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8031440 tx=0x7fa0a8005b50 comp rx=0 tx=0).stop 2024-08-20T01:29:36.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.627+0000 7fa0bab49640 1 -- 172.21.15.22:0/410051081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b410ce20 msgr2=0x7fa0b419e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:36.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.627+0000 7fa0bab49640 1 --2- 172.21.15.22:0/410051081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b410ce20 0x7fa0b419e8b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00eaa0 tx=0x7fa0ac00ef60 comp rx=0 tx=0).stop 2024-08-20T01:29:36.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.627+0000 7fa0bab49640 1 -- 172.21.15.22:0/410051081 shutdown_connections 2024-08-20T01:29:36.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.627+0000 7fa0bab49640 1 --2- 172.21.15.22:0/410051081 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa0a40b3c60 0x7fa0a40b6120 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:36.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.627+0000 7fa0bab49640 1 --2- 172.21.15.22:0/410051081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0b410ce20 0x7fa0b419e8b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:36.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.627+0000 7fa0bab49640 1 --2- 172.21.15.22:0/410051081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b4104270 0x7fa0b4199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:36.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.627+0000 7fa0bab49640 1 --2- 172.21.15.22:0/410051081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0b4103870 0x7fa0b4198fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:36.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.627+0000 7fa0bab49640 1 -- 172.21.15.22:0/410051081 >> 172.21.15.22:0/410051081 conn(0x7fa0b40fd440 msgr2=0x7fa0b40fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:36.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.627+0000 7fa0bab49640 1 -- 172.21.15.22:0/410051081 shutdown_connections 2024-08-20T01:29:36.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:36.627+0000 7fa0bab49640 1 -- 172.21.15.22:0/410051081 wait complete. 2024-08-20T01:29:37.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:36 smithi134 ceph-mon[22511]: pgmap v296: 97 pgs: 97 active+clean; 630 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-08-20T01:29:37.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:36 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/410051081' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-20T01:29:37.290 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:36 smithi022 ceph-mon[18709]: pgmap v296: 97 pgs: 97 active+clean; 630 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-08-20T01:29:37.290 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:36 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/410051081' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-20T01:29:37.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:36 smithi077 ceph-mon[22251]: pgmap v296: 97 pgs: 97 active+clean; 630 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-08-20T01:29:37.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:36 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/410051081' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-20T01:29:37.323 INFO:teuthology.orchestra.run.smithi022.stdout:[{"version":50,"timestamp":"2024-08-20T01:28:56.174733+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-08-20T01:29:37.323 INFO:tasks.ceph_manager:config epoch is 50 2024-08-20T01:29:37.323 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-20T01:29:37.324 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-20T01:29:37.324 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph mgr dump --format=json 2024-08-20T01:29:37.586 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:38.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.050+0000 7fa323ebd640 1 -- 172.21.15.22:0/2252757785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa31c1073a0 msgr2=0x7fa31c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:38.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.050+0000 7fa323ebd640 1 --2- 172.21.15.22:0/2252757785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa31c1073a0 0x7fa31c1077e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009900 tx=0x7fa30c02a410 comp rx=0 tx=0).stop 2024-08-20T01:29:38.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.050+0000 7fa323ebd640 1 -- 172.21.15.22:0/2252757785 shutdown_connections 2024-08-20T01:29:38.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.050+0000 7fa323ebd640 1 --2- 172.21.15.22:0/2252757785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31c107d20 0x7fa31c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:38.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.050+0000 7fa323ebd640 1 --2- 172.21.15.22:0/2252757785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa31c1073a0 0x7fa31c1077e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:38.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.050+0000 7fa323ebd640 1 --2- 172.21.15.22:0/2252757785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa31c101990 0x7fa31c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:38.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.050+0000 7fa323ebd640 1 -- 172.21.15.22:0/2252757785 >> 172.21.15.22:0/2252757785 conn(0x7fa31c0fd400 msgr2=0x7fa31c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:38.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.050+0000 7fa323ebd640 1 -- 172.21.15.22:0/2252757785 shutdown_connections 2024-08-20T01:29:38.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.050+0000 7fa323ebd640 1 -- 172.21.15.22:0/2252757785 wait complete. 2024-08-20T01:29:38.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.050+0000 7fa323ebd640 1 Processor -- start 2024-08-20T01:29:38.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.050+0000 7fa323ebd640 1 -- start start 2024-08-20T01:29:38.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.051+0000 7fa323ebd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa31c101990 0x7fa31c0fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:38.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.051+0000 7fa323ebd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa31c1073a0 0x7fa31c0fde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:38.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.051+0000 7fa323ebd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31c107d20 0x7fa31c0fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:38.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.051+0000 7fa323ebd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c111970 con 0x7fa31c101990 2024-08-20T01:29:38.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.051+0000 7fa323ebd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c1117f0 con 0x7fa31c107d20 2024-08-20T01:29:38.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.051+0000 7fa323ebd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c111af0 con 0x7fa31c1073a0 2024-08-20T01:29:38.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.051+0000 7fa321c59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa31c101990 0x7fa31c0fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:38.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.051+0000 7fa321c59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa31c101990 0x7fa31c0fd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46980/0 (socket says 172.21.15.22:46980) 2024-08-20T01:29:38.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.051+0000 7fa321c59640 1 -- 172.21.15.22:0/3116178623 learned_addr learned my addr 172.21.15.22:0/3116178623 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:38.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.051+0000 7fa32245a640 1 --2- 172.21.15.22:0/3116178623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31c107d20 0x7fa31c0fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:38.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.051+0000 7fa321458640 1 --2- 172.21.15.22:0/3116178623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa31c1073a0 0x7fa31c0fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:38.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.051+0000 7fa321c59640 1 -- 172.21.15.22:0/3116178623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa31c1073a0 msgr2=0x7fa31c0fde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:38.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.051+0000 7fa321c59640 1 --2- 172.21.15.22:0/3116178623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa31c1073a0 0x7fa31c0fde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:38.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.051+0000 7fa321c59640 1 -- 172.21.15.22:0/3116178623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31c107d20 msgr2=0x7fa31c0fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:38.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.051+0000 7fa321c59640 1 --2- 172.21.15.22:0/3116178623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31c107d20 0x7fa31c0fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:38.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.051+0000 7fa321c59640 1 -- 172.21.15.22:0/3116178623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa31c1a73f0 con 0x7fa31c101990 2024-08-20T01:29:38.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.051+0000 7fa321c59640 1 --2- 172.21.15.22:0/3116178623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa31c101990 0x7fa31c0fd900 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa31800d950 tx=0x7fa31800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:38.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.052+0000 7fa312ffd640 1 -- 172.21.15.22:0/3116178623 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318017070 con 0x7fa31c101990 2024-08-20T01:29:38.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.052+0000 7fa312ffd640 1 -- 172.21.15.22:0/3116178623 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa318009c30 con 0x7fa31c101990 2024-08-20T01:29:38.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.052+0000 7fa323ebd640 1 -- 172.21.15.22:0/3116178623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa31c1a76e0 con 0x7fa31c101990 2024-08-20T01:29:38.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.052+0000 7fa312ffd640 1 -- 172.21.15.22:0/3116178623 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31800f620 con 0x7fa31c101990 2024-08-20T01:29:38.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.052+0000 7fa323ebd640 1 -- 172.21.15.22:0/3116178623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa31c1a7bf0 con 0x7fa31c101990 2024-08-20T01:29:38.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.053+0000 7fa323ebd640 1 -- 172.21.15.22:0/3116178623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa31c101d70 con 0x7fa31c101990 2024-08-20T01:29:38.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.054+0000 7fa312ffd640 1 -- 172.21.15.22:0/3116178623 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fa318010460 con 0x7fa31c101990 2024-08-20T01:29:38.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.055+0000 7fa312ffd640 1 --2- 172.21.15.22:0/3116178623 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa3080b3c60 0x7fa3080b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:38.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.055+0000 7fa321458640 1 --2- 172.21.15.22:0/3116178623 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa3080b3c60 0x7fa3080b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:38.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.055+0000 7fa312ffd640 1 -- 172.21.15.22:0/3116178623 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fa3180e38b0 con 0x7fa31c101990 2024-08-20T01:29:38.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.055+0000 7fa321458640 1 --2- 172.21.15.22:0/3116178623 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa3080b3c60 0x7fa3080b6120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa30c031440 tx=0x7fa30c0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:38.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.058+0000 7fa312ffd640 1 -- 172.21.15.22:0/3116178623 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa3180aaf50 con 0x7fa31c101990 2024-08-20T01:29:38.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.292+0000 7fa323ebd640 1 -- 172.21.15.22:0/3116178623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fa31c1a7fb0 con 0x7fa31c101990 2024-08-20T01:29:38.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.297+0000 7fa312ffd640 1 -- 172.21.15.22:0/3116178623 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+291020 (secure 0 0 0) 0x7fa318009de0 con 0x7fa31c101990 2024-08-20T01:29:38.301 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:29:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.301+0000 7fa323ebd640 1 -- 172.21.15.22:0/3116178623 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa3080b3c60 msgr2=0x7fa3080b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.301+0000 7fa323ebd640 1 --2- 172.21.15.22:0/3116178623 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa3080b3c60 0x7fa3080b6120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa30c031440 tx=0x7fa30c0095f0 comp rx=0 tx=0).stop 2024-08-20T01:29:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.301+0000 7fa323ebd640 1 -- 172.21.15.22:0/3116178623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa31c101990 msgr2=0x7fa31c0fd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.301+0000 7fa323ebd640 1 --2- 172.21.15.22:0/3116178623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa31c101990 0x7fa31c0fd900 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa31800d950 tx=0x7fa31800de10 comp rx=0 tx=0).stop 2024-08-20T01:29:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.301+0000 7fa323ebd640 1 -- 172.21.15.22:0/3116178623 shutdown_connections 2024-08-20T01:29:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.301+0000 7fa323ebd640 1 --2- 172.21.15.22:0/3116178623 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa3080b3c60 0x7fa3080b6120 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.301+0000 7fa323ebd640 1 --2- 172.21.15.22:0/3116178623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31c107d20 0x7fa31c0fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.301+0000 7fa323ebd640 1 --2- 172.21.15.22:0/3116178623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa31c1073a0 0x7fa31c0fde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.301+0000 7fa323ebd640 1 --2- 172.21.15.22:0/3116178623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa31c101990 0x7fa31c0fd900 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:38.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.301+0000 7fa323ebd640 1 -- 172.21.15.22:0/3116178623 >> 172.21.15.22:0/3116178623 conn(0x7fa31c0fd400 msgr2=0x7fa31c1044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:38.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.301+0000 7fa323ebd640 1 -- 172.21.15.22:0/3116178623 shutdown_connections 2024-08-20T01:29:38.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:38.301+0000 7fa323ebd640 1 -- 172.21.15.22:0/3116178623 wait complete. 2024-08-20T01:29:39.055 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":2987254321},{"type":"v1","addr":"172.21.15.22:6801","nonce":2987254321}]},"active_addr":"172.21.15.22:6801/2987254321","active_change":"2024-08-20T01:21:53.209914+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24118,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24140,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.22:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":3887821393}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":1566715011}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":2754516966}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":2253999249}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":1882439511}]}]} 2024-08-20T01:29:39.062 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-20T01:29:39.062 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-20T01:29:39.062 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:29:39.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:38 smithi134 ceph-mon[22511]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-08-20T01:29:39.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:38 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3116178623' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-20T01:29:39.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:38 smithi077 ceph-mon[22251]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-08-20T01:29:39.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:38 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3116178623' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-20T01:29:39.320 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:39.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:38 smithi022 ceph-mon[18709]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-08-20T01:29:39.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:38 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3116178623' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-20T01:29:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.794+0000 7fe9b18c1640 1 -- 172.21.15.22:0/3487231612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac1074d0 msgr2=0x7fe9ac10dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.794+0000 7fe9b18c1640 1 --2- 172.21.15.22:0/3487231612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac1074d0 0x7fe9ac10dcd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4009ca0 tx=0x7fe9a402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:29:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.794+0000 7fe9b18c1640 1 -- 172.21.15.22:0/3487231612 shutdown_connections 2024-08-20T01:29:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.794+0000 7fe9b18c1640 1 --2- 172.21.15.22:0/3487231612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac1074d0 0x7fe9ac10dcd0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.794+0000 7fe9b18c1640 1 --2- 172.21.15.22:0/3487231612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9ac106b50 0x7fe9ac106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.794+0000 7fe9b18c1640 1 --2- 172.21.15.22:0/3487231612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9ac101520 0x7fe9ac101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.794+0000 7fe9b18c1640 1 -- 172.21.15.22:0/3487231612 >> 172.21.15.22:0/3487231612 conn(0x7fe9ac076c80 msgr2=0x7fe9ac077090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.794+0000 7fe9b18c1640 1 -- 172.21.15.22:0/3487231612 shutdown_connections 2024-08-20T01:29:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.794+0000 7fe9b18c1640 1 -- 172.21.15.22:0/3487231612 wait complete. 2024-08-20T01:29:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.795+0000 7fe9b18c1640 1 Processor -- start 2024-08-20T01:29:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.795+0000 7fe9b18c1640 1 -- start start 2024-08-20T01:29:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.795+0000 7fe9b18c1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9ac101520 0x7fe9ac198ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.795+0000 7fe9b18c1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac106b50 0x7fe9ac199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.795+0000 7fe9b18c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9ac1074d0 0x7fe9ac19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.795+0000 7fe9b18c1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac1108d0 con 0x7fe9ac106b50 2024-08-20T01:29:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.795+0000 7fe9b18c1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac110750 con 0x7fe9ac1074d0 2024-08-20T01:29:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.795+0000 7fe9b18c1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac110a50 con 0x7fe9ac101520 2024-08-20T01:29:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.795+0000 7fe9aa7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac106b50 0x7fe9ac199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:39.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.795+0000 7fe9aa7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac106b50 0x7fe9ac199530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34452/0 (socket says 172.21.15.22:34452) 2024-08-20T01:29:39.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.795+0000 7fe9aa7fc640 1 -- 172.21.15.22:0/1426530318 learned_addr learned my addr 172.21.15.22:0/1426530318 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:39.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.796+0000 7fe9aaffd640 1 --2- 172.21.15.22:0/1426530318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9ac101520 0x7fe9ac198ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:39.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.796+0000 7fe9aa7fc640 1 -- 172.21.15.22:0/1426530318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9ac101520 msgr2=0x7fe9ac198ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:39.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.796+0000 7fe9aa7fc640 1 --2- 172.21.15.22:0/1426530318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9ac101520 0x7fe9ac198ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:39.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.796+0000 7fe9aa7fc640 1 -- 172.21.15.22:0/1426530318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9ac1074d0 msgr2=0x7fe9ac19e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:39.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.796+0000 7fe9aa7fc640 1 --2- 172.21.15.22:0/1426530318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9ac1074d0 0x7fe9ac19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:39.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.796+0000 7fe9aa7fc640 1 -- 172.21.15.22:0/1426530318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ac19f0a0 con 0x7fe9ac106b50 2024-08-20T01:29:39.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.796+0000 7fe9aa7fc640 1 --2- 172.21.15.22:0/1426530318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac106b50 0x7fe9ac199530 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000dbc0 tx=0x7fe9a000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:39.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.796+0000 7fe9b08bf640 1 -- 172.21.15.22:0/1426530318 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a0005220 con 0x7fe9ac106b50 2024-08-20T01:29:39.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.796+0000 7fe9b08bf640 1 -- 172.21.15.22:0/1426530318 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9a000ae50 con 0x7fe9ac106b50 2024-08-20T01:29:39.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.796+0000 7fe9b08bf640 1 -- 172.21.15.22:0/1426530318 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a000e7d0 con 0x7fe9ac106b50 2024-08-20T01:29:39.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.796+0000 7fe9b18c1640 1 -- 172.21.15.22:0/1426530318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ac19f390 con 0x7fe9ac106b50 2024-08-20T01:29:39.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.796+0000 7fe9b18c1640 1 -- 172.21.15.22:0/1426530318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ac1a5a50 con 0x7fe9ac106b50 2024-08-20T01:29:39.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.797+0000 7fe9b18c1640 1 -- 172.21.15.22:0/1426530318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ac101900 con 0x7fe9ac106b50 2024-08-20T01:29:39.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.799+0000 7fe9b08bf640 1 -- 172.21.15.22:0/1426530318 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fe9a000e970 con 0x7fe9ac106b50 2024-08-20T01:29:39.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.800+0000 7fe9b08bf640 1 --2- 172.21.15.22:0/1426530318 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe9940b3ce0 0x7fe9940b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:39.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.800+0000 7fe9aaffd640 1 --2- 172.21.15.22:0/1426530318 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe9940b3ce0 0x7fe9940b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:39.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.800+0000 7fe9b08bf640 1 -- 172.21.15.22:0/1426530318 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fe9a00e4120 con 0x7fe9ac106b50 2024-08-20T01:29:39.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.800+0000 7fe9aaffd640 1 --2- 172.21.15.22:0/1426530318 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe9940b3ce0 0x7fe9940b61a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0058c0 tx=0x7fe99c00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:39.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.803+0000 7fe9b08bf640 1 -- 172.21.15.22:0/1426530318 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe9a00ab7d0 con 0x7fe9ac106b50 2024-08-20T01:29:39.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.986+0000 7fe9b18c1640 1 -- 172.21.15.22:0/1426530318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9ac02e340 con 0x7fe9ac106b50 2024-08-20T01:29:39.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.988+0000 7fe9b08bf640 1 -- 172.21.15.22:0/1426530318 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22230 (secure 0 0 0) 0x7fe9a00ab0d0 con 0x7fe9ac106b50 2024-08-20T01:29:39.989 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:29:39.989 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":75,"fsid":"586fd06c-5e92-11ef-bccf-c7b262605968","created":"2024-08-20T01:20:55.065729+0000","modified":"2024-08-20T01:29:07.003098+0000","last_up_change":"2024-08-20T01:28:14.752931+0000","last_in_change":"2024-08-20T01:27:51.812525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:24:31.674035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:29:02.800545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:29:04.951975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b67a59af-5eea-4073-a4b2-604a1b7b8f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6803","nonce":812056903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6805","nonce":812056903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6809","nonce":812056903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6807","nonce":812056903}]},"public_addr":"172.21.15.22:6803/812056903","cluster_addr":"172.21.15.22:6805/812056903","heartbeat_back_addr":"172.21.15.22:6809/812056903","heartbeat_front_addr":"172.21.15.22:6807/812056903","state":["exists","up"]},{"osd":1,"uuid":"9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6801","nonce":823882511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6803","nonce":823882511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6807","nonce":823882511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6805","nonce":823882511}]},"public_addr":"172.21.15.77:6801/823882511","cluster_addr":"172.21.15.77:6803/823882511","heartbeat_back_addr":"172.21.15.77:6807/823882511","heartbeat_front_addr":"172.21.15.77:6805/823882511","state":["exists","up"]},{"osd":2,"uuid":"71e3c019-a3e0-4632-81a8-27ac31279f7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6801","nonce":3873702897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6803","nonce":3873702897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6807","nonce":3873702897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6805","nonce":3873702897}]},"public_addr":"172.21.15.134:6801/3873702897","cluster_addr":"172.21.15.134:6803/3873702897","heartbeat_back_addr":"172.21.15.134:6807/3873702897","heartbeat_front_addr":"172.21.15.134:6805/3873702897","state":["exists","up"]},{"osd":3,"uuid":"a60de748-aa65-477d-864e-6281db1261ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6811","nonce":1775946906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6813","nonce":1775946906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6817","nonce":1775946906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6815","nonce":1775946906}]},"public_addr":"172.21.15.22:6811/1775946906","cluster_addr":"172.21.15.22:6813/1775946906","heartbeat_back_addr":"172.21.15.22:6817/1775946906","heartbeat_front_addr":"172.21.15.22:6815/1775946906","state":["exists","up"]},{"osd":4,"uuid":"07d99671-2ece-471c-ad69-fc9043d917f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6809","nonce":1954209322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6811","nonce":1954209322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6815","nonce":1954209322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6813","nonce":1954209322}]},"public_addr":"172.21.15.77:6809/1954209322","cluster_addr":"172.21.15.77:6811/1954209322","heartbeat_back_addr":"172.21.15.77:6815/1954209322","heartbeat_front_addr":"172.21.15.77:6813/1954209322","state":["exists","up"]},{"osd":5,"uuid":"971cac33-0b98-49b1-b4b2-27354fc0ab90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6809","nonce":2805488123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6811","nonce":2805488123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6815","nonce":2805488123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6813","nonce":2805488123}]},"public_addr":"172.21.15.134:6809/2805488123","cluster_addr":"172.21.15.134:6811/2805488123","heartbeat_back_addr":"172.21.15.134:6815/2805488123","heartbeat_front_addr":"172.21.15.134:6813/2805488123","state":["exists","up"]},{"osd":6,"uuid":"48d90292-8511-47d6-8093-330bd13ae70e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6819","nonce":3804882416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6821","nonce":3804882416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6825","nonce":3804882416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6823","nonce":3804882416}]},"public_addr":"172.21.15.22:6819/3804882416","cluster_addr":"172.21.15.22:6821/3804882416","heartbeat_back_addr":"172.21.15.22:6825/3804882416","heartbeat_front_addr":"172.21.15.22:6823/3804882416","state":["exists","up"]},{"osd":7,"uuid":"e217112d-9f56-4a48-93bf-6eb052ce540a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6817","nonce":700318902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6819","nonce":700318902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6823","nonce":700318902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6821","nonce":700318902}]},"public_addr":"172.21.15.77:6817/700318902","cluster_addr":"172.21.15.77:6819/700318902","heartbeat_back_addr":"172.21.15.77:6823/700318902","heartbeat_front_addr":"172.21.15.77:6821/700318902","state":["exists","up"]},{"osd":8,"uuid":"1786747c-6ff6-4e00-bcf6-a8176215847f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6817","nonce":1635473481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6819","nonce":1635473481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6823","nonce":1635473481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6821","nonce":1635473481}]},"public_addr":"172.21.15.134:6817/1635473481","cluster_addr":"172.21.15.134:6819/1635473481","heartbeat_back_addr":"172.21.15.134:6823/1635473481","heartbeat_front_addr":"172.21.15.134:6821/1635473481","state":["exists","up"]},{"osd":9,"uuid":"708f7390-1b51-4397-a92a-8ff3f4a5bc45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6827","nonce":3899297933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6829","nonce":3899297933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6833","nonce":3899297933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6831","nonce":3899297933}]},"public_addr":"172.21.15.22:6827/3899297933","cluster_addr":"172.21.15.22:6829/3899297933","heartbeat_back_addr":"172.21.15.22:6833/3899297933","heartbeat_front_addr":"172.21.15.22:6831/3899297933","state":["exists","up"]},{"osd":10,"uuid":"d15b0acd-dd08-431d-88aa-756b6420987d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6825","nonce":2765589872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6827","nonce":2765589872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6831","nonce":2765589872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6829","nonce":2765589872}]},"public_addr":"172.21.15.77:6825/2765589872","cluster_addr":"172.21.15.77:6827/2765589872","heartbeat_back_addr":"172.21.15.77:6831/2765589872","heartbeat_front_addr":"172.21.15.77:6829/2765589872","state":["exists","up"]},{"osd":11,"uuid":"d15017fa-3c3d-4096-a35d-275cd54bb9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6825","nonce":964533669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6827","nonce":964533669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6831","nonce":964533669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6829","nonce":964533669}]},"public_addr":"172.21.15.134:6825/964533669","cluster_addr":"172.21.15.134:6827/964533669","heartbeat_back_addr":"172.21.15.134:6831/964533669","heartbeat_front_addr":"172.21.15.134:6829/964533669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:23:40.839725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:05.141389+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:28.340737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:52.028949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:17.029913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:42.092826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:07.831100+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:33.380447+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:58.772655+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:23.017208+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:47.966711+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:28:13.123047+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/416470260":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6800/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/1142422661":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:6800/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/2093308719":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/3772866379":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3424402756":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3864772624":"2024-08-21T01:21:28.981981+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:29:39.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.990+0000 7fe9b18c1640 1 -- 172.21.15.22:0/1426530318 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe9940b3ce0 msgr2=0x7fe9940b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:39.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.990+0000 7fe9b18c1640 1 --2- 172.21.15.22:0/1426530318 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe9940b3ce0 0x7fe9940b61a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0058c0 tx=0x7fe99c00a4c0 comp rx=0 tx=0).stop 2024-08-20T01:29:39.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.990+0000 7fe9b18c1640 1 -- 172.21.15.22:0/1426530318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac106b50 msgr2=0x7fe9ac199530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:39.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.990+0000 7fe9b18c1640 1 --2- 172.21.15.22:0/1426530318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac106b50 0x7fe9ac199530 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000dbc0 tx=0x7fe9a000a620 comp rx=0 tx=0).stop 2024-08-20T01:29:39.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.991+0000 7fe9b18c1640 1 -- 172.21.15.22:0/1426530318 shutdown_connections 2024-08-20T01:29:39.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.991+0000 7fe9b18c1640 1 --2- 172.21.15.22:0/1426530318 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe9940b3ce0 0x7fe9940b61a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:39.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.991+0000 7fe9b18c1640 1 --2- 172.21.15.22:0/1426530318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9ac1074d0 0x7fe9ac19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:39.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.991+0000 7fe9b18c1640 1 --2- 172.21.15.22:0/1426530318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac106b50 0x7fe9ac199530 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:39.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.991+0000 7fe9b18c1640 1 --2- 172.21.15.22:0/1426530318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9ac101520 0x7fe9ac198ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:39.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.991+0000 7fe9b18c1640 1 -- 172.21.15.22:0/1426530318 >> 172.21.15.22:0/1426530318 conn(0x7fe9ac076c80 msgr2=0x7fe9ac104da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:39.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.991+0000 7fe9b18c1640 1 -- 172.21.15.22:0/1426530318 shutdown_connections 2024-08-20T01:29:39.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:39.991+0000 7fe9b18c1640 1 -- 172.21.15.22:0/1426530318 wait complete. 2024-08-20T01:29:40.674 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-20T01:29:40.674 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:29:40.931 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:41.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:40 smithi022 ceph-mon[18709]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-08-20T01:29:41.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:40 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1426530318' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:29:41.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:40 smithi134 ceph-mon[22511]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-08-20T01:29:41.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:40 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1426530318' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:29:41.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:40 smithi077 ceph-mon[22251]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-08-20T01:29:41.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:40 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1426530318' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:29:41.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.446+0000 7f8f7d1d5640 1 -- 172.21.15.22:0/2630034477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f78108e60 msgr2=0x7f8f7810f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:41.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.446+0000 7f8f7d1d5640 1 --2- 172.21.15.22:0/2630034477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f78108e60 0x7f8f7810f660 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009ca0 tx=0x7f8f7002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:29:41.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.446+0000 7f8f7d1d5640 1 -- 172.21.15.22:0/2630034477 shutdown_connections 2024-08-20T01:29:41.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.446+0000 7f8f7d1d5640 1 --2- 172.21.15.22:0/2630034477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f78108e60 0x7f8f7810f660 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:41.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.446+0000 7f8f7d1d5640 1 --2- 172.21.15.22:0/2630034477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f781084e0 0x7f8f78108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:41.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.446+0000 7f8f7d1d5640 1 --2- 172.21.15.22:0/2630034477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f78102ad0 0x7f8f78102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:41.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.446+0000 7f8f7d1d5640 1 -- 172.21.15.22:0/2630034477 >> 172.21.15.22:0/2630034477 conn(0x7f8f780fe540 msgr2=0x7f8f78100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:41.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.446+0000 7f8f7d1d5640 1 -- 172.21.15.22:0/2630034477 shutdown_connections 2024-08-20T01:29:41.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.446+0000 7f8f7d1d5640 1 -- 172.21.15.22:0/2630034477 wait complete. 2024-08-20T01:29:41.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.447+0000 7f8f7d1d5640 1 Processor -- start 2024-08-20T01:29:41.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.447+0000 7f8f7d1d5640 1 -- start start 2024-08-20T01:29:41.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.447+0000 7f8f7d1d5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f78102ad0 0x7f8f780751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:41.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.447+0000 7f8f7d1d5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f781084e0 0x7f8f78075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:41.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.447+0000 7f8f7d1d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f78108e60 0x7f8f78075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:41.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.447+0000 7f8f7d1d5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8f78112b20 con 0x7f8f78102ad0 2024-08-20T01:29:41.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.447+0000 7f8f7d1d5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8f781129a0 con 0x7f8f78108e60 2024-08-20T01:29:41.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.447+0000 7f8f7d1d5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8f78112ca0 con 0x7f8f781084e0 2024-08-20T01:29:41.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.447+0000 7f8f76d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f78102ad0 0x7f8f780751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:41.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.447+0000 7f8f76d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f78102ad0 0x7f8f780751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34462/0 (socket says 172.21.15.22:34462) 2024-08-20T01:29:41.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.447+0000 7f8f76d9d640 1 -- 172.21.15.22:0/4008106571 learned_addr learned my addr 172.21.15.22:0/4008106571 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:41.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.448+0000 7f8f6ffff640 1 --2- 172.21.15.22:0/4008106571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f781084e0 0x7f8f78075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.448+0000 7f8f7759e640 1 --2- 172.21.15.22:0/4008106571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f78108e60 0x7f8f78075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.448+0000 7f8f76d9d640 1 -- 172.21.15.22:0/4008106571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f781084e0 msgr2=0x7f8f78075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.448+0000 7f8f76d9d640 1 --2- 172.21.15.22:0/4008106571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f781084e0 0x7f8f78075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.448+0000 7f8f76d9d640 1 -- 172.21.15.22:0/4008106571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f78108e60 msgr2=0x7f8f78075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.448+0000 7f8f76d9d640 1 --2- 172.21.15.22:0/4008106571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f78108e60 0x7f8f78075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.448+0000 7f8f76d9d640 1 -- 172.21.15.22:0/4008106571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f781a73b0 con 0x7f8f78102ad0 2024-08-20T01:29:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.448+0000 7f8f7759e640 1 --2- 172.21.15.22:0/4008106571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f78108e60 0x7f8f78075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:29:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.448+0000 7f8f6ffff640 1 --2- 172.21.15.22:0/4008106571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f781084e0 0x7f8f78075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:29:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.448+0000 7f8f76d9d640 1 --2- 172.21.15.22:0/4008106571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f78102ad0 0x7f8f780751d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800d950 tx=0x7f8f6800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.448+0000 7f8f74d99640 1 -- 172.21.15.22:0/4008106571 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f68017070 con 0x7f8f78102ad0 2024-08-20T01:29:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.448+0000 7f8f7d1d5640 1 -- 172.21.15.22:0/4008106571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f781a76a0 con 0x7f8f78102ad0 2024-08-20T01:29:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.448+0000 7f8f74d99640 1 -- 172.21.15.22:0/4008106571 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f68009c30 con 0x7f8f78102ad0 2024-08-20T01:29:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.448+0000 7f8f74d99640 1 -- 172.21.15.22:0/4008106571 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6800f620 con 0x7f8f78102ad0 2024-08-20T01:29:41.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.448+0000 7f8f7d1d5640 1 -- 172.21.15.22:0/4008106571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f781a7c30 con 0x7f8f78102ad0 2024-08-20T01:29:41.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.449+0000 7f8f7d1d5640 1 -- 172.21.15.22:0/4008106571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f78102eb0 con 0x7f8f78102ad0 2024-08-20T01:29:41.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.451+0000 7f8f74d99640 1 -- 172.21.15.22:0/4008106571 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f8f68010460 con 0x7f8f78102ad0 2024-08-20T01:29:41.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.451+0000 7f8f74d99640 1 --2- 172.21.15.22:0/4008106571 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8f640b3c60 0x7f8f640b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:41.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.451+0000 7f8f6ffff640 1 --2- 172.21.15.22:0/4008106571 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8f640b3c60 0x7f8f640b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:41.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.451+0000 7f8f74d99640 1 -- 172.21.15.22:0/4008106571 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f8f680e38b0 con 0x7f8f78102ad0 2024-08-20T01:29:41.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.452+0000 7f8f6ffff640 1 --2- 172.21.15.22:0/4008106571 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8f640b3c60 0x7f8f640b6120 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8f600058c0 tx=0x7f8f60005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:41.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.454+0000 7f8f74d99640 1 -- 172.21.15.22:0/4008106571 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f8f680aaf50 con 0x7f8f78102ad0 2024-08-20T01:29:41.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.640+0000 7f8f7d1d5640 1 -- 172.21.15.22:0/4008106571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f7810a6b0 con 0x7f8f78102ad0 2024-08-20T01:29:41.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.641+0000 7f8f74d99640 1 -- 172.21.15.22:0/4008106571 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22230 (secure 0 0 0) 0x7f8f68009de0 con 0x7f8f78102ad0 2024-08-20T01:29:41.642 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:29:41.642 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":75,"fsid":"586fd06c-5e92-11ef-bccf-c7b262605968","created":"2024-08-20T01:20:55.065729+0000","modified":"2024-08-20T01:29:07.003098+0000","last_up_change":"2024-08-20T01:28:14.752931+0000","last_in_change":"2024-08-20T01:27:51.812525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:24:31.674035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:29:02.800545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:29:04.951975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b67a59af-5eea-4073-a4b2-604a1b7b8f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6803","nonce":812056903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6805","nonce":812056903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6809","nonce":812056903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6807","nonce":812056903}]},"public_addr":"172.21.15.22:6803/812056903","cluster_addr":"172.21.15.22:6805/812056903","heartbeat_back_addr":"172.21.15.22:6809/812056903","heartbeat_front_addr":"172.21.15.22:6807/812056903","state":["exists","up"]},{"osd":1,"uuid":"9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6801","nonce":823882511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6803","nonce":823882511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6807","nonce":823882511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6805","nonce":823882511}]},"public_addr":"172.21.15.77:6801/823882511","cluster_addr":"172.21.15.77:6803/823882511","heartbeat_back_addr":"172.21.15.77:6807/823882511","heartbeat_front_addr":"172.21.15.77:6805/823882511","state":["exists","up"]},{"osd":2,"uuid":"71e3c019-a3e0-4632-81a8-27ac31279f7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6801","nonce":3873702897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6803","nonce":3873702897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6807","nonce":3873702897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6805","nonce":3873702897}]},"public_addr":"172.21.15.134:6801/3873702897","cluster_addr":"172.21.15.134:6803/3873702897","heartbeat_back_addr":"172.21.15.134:6807/3873702897","heartbeat_front_addr":"172.21.15.134:6805/3873702897","state":["exists","up"]},{"osd":3,"uuid":"a60de748-aa65-477d-864e-6281db1261ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6811","nonce":1775946906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6813","nonce":1775946906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6817","nonce":1775946906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6815","nonce":1775946906}]},"public_addr":"172.21.15.22:6811/1775946906","cluster_addr":"172.21.15.22:6813/1775946906","heartbeat_back_addr":"172.21.15.22:6817/1775946906","heartbeat_front_addr":"172.21.15.22:6815/1775946906","state":["exists","up"]},{"osd":4,"uuid":"07d99671-2ece-471c-ad69-fc9043d917f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6809","nonce":1954209322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6811","nonce":1954209322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6815","nonce":1954209322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6813","nonce":1954209322}]},"public_addr":"172.21.15.77:6809/1954209322","cluster_addr":"172.21.15.77:6811/1954209322","heartbeat_back_addr":"172.21.15.77:6815/1954209322","heartbeat_front_addr":"172.21.15.77:6813/1954209322","state":["exists","up"]},{"osd":5,"uuid":"971cac33-0b98-49b1-b4b2-27354fc0ab90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6809","nonce":2805488123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6811","nonce":2805488123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6815","nonce":2805488123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6813","nonce":2805488123}]},"public_addr":"172.21.15.134:6809/2805488123","cluster_addr":"172.21.15.134:6811/2805488123","heartbeat_back_addr":"172.21.15.134:6815/2805488123","heartbeat_front_addr":"172.21.15.134:6813/2805488123","state":["exists","up"]},{"osd":6,"uuid":"48d90292-8511-47d6-8093-330bd13ae70e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6819","nonce":3804882416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6821","nonce":3804882416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6825","nonce":3804882416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6823","nonce":3804882416}]},"public_addr":"172.21.15.22:6819/3804882416","cluster_addr":"172.21.15.22:6821/3804882416","heartbeat_back_addr":"172.21.15.22:6825/3804882416","heartbeat_front_addr":"172.21.15.22:6823/3804882416","state":["exists","up"]},{"osd":7,"uuid":"e217112d-9f56-4a48-93bf-6eb052ce540a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6817","nonce":700318902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6819","nonce":700318902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6823","nonce":700318902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6821","nonce":700318902}]},"public_addr":"172.21.15.77:6817/700318902","cluster_addr":"172.21.15.77:6819/700318902","heartbeat_back_addr":"172.21.15.77:6823/700318902","heartbeat_front_addr":"172.21.15.77:6821/700318902","state":["exists","up"]},{"osd":8,"uuid":"1786747c-6ff6-4e00-bcf6-a8176215847f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6817","nonce":1635473481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6819","nonce":1635473481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6823","nonce":1635473481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6821","nonce":1635473481}]},"public_addr":"172.21.15.134:6817/1635473481","cluster_addr":"172.21.15.134:6819/1635473481","heartbeat_back_addr":"172.21.15.134:6823/1635473481","heartbeat_front_addr":"172.21.15.134:6821/1635473481","state":["exists","up"]},{"osd":9,"uuid":"708f7390-1b51-4397-a92a-8ff3f4a5bc45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6827","nonce":3899297933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6829","nonce":3899297933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6833","nonce":3899297933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6831","nonce":3899297933}]},"public_addr":"172.21.15.22:6827/3899297933","cluster_addr":"172.21.15.22:6829/3899297933","heartbeat_back_addr":"172.21.15.22:6833/3899297933","heartbeat_front_addr":"172.21.15.22:6831/3899297933","state":["exists","up"]},{"osd":10,"uuid":"d15b0acd-dd08-431d-88aa-756b6420987d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6825","nonce":2765589872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6827","nonce":2765589872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6831","nonce":2765589872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6829","nonce":2765589872}]},"public_addr":"172.21.15.77:6825/2765589872","cluster_addr":"172.21.15.77:6827/2765589872","heartbeat_back_addr":"172.21.15.77:6831/2765589872","heartbeat_front_addr":"172.21.15.77:6829/2765589872","state":["exists","up"]},{"osd":11,"uuid":"d15017fa-3c3d-4096-a35d-275cd54bb9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6825","nonce":964533669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6827","nonce":964533669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6831","nonce":964533669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6829","nonce":964533669}]},"public_addr":"172.21.15.134:6825/964533669","cluster_addr":"172.21.15.134:6827/964533669","heartbeat_back_addr":"172.21.15.134:6831/964533669","heartbeat_front_addr":"172.21.15.134:6829/964533669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:23:40.839725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:05.141389+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:28.340737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:52.028949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:17.029913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:42.092826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:07.831100+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:33.380447+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:58.772655+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:23.017208+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:47.966711+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:28:13.123047+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/416470260":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6800/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/1142422661":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:6800/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/2093308719":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/3772866379":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3424402756":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3864772624":"2024-08-21T01:21:28.981981+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:29:41.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.643+0000 7f8f7d1d5640 1 -- 172.21.15.22:0/4008106571 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8f640b3c60 msgr2=0x7f8f640b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:41.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.643+0000 7f8f7d1d5640 1 --2- 172.21.15.22:0/4008106571 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8f640b3c60 0x7f8f640b6120 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8f600058c0 tx=0x7f8f60005850 comp rx=0 tx=0).stop 2024-08-20T01:29:41.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.643+0000 7f8f7d1d5640 1 -- 172.21.15.22:0/4008106571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f78102ad0 msgr2=0x7f8f780751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:41.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.643+0000 7f8f7d1d5640 1 --2- 172.21.15.22:0/4008106571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f78102ad0 0x7f8f780751d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800d950 tx=0x7f8f6800de10 comp rx=0 tx=0).stop 2024-08-20T01:29:41.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.643+0000 7f8f7d1d5640 1 -- 172.21.15.22:0/4008106571 shutdown_connections 2024-08-20T01:29:41.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.643+0000 7f8f7d1d5640 1 --2- 172.21.15.22:0/4008106571 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8f640b3c60 0x7f8f640b6120 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.643+0000 7f8f7d1d5640 1 --2- 172.21.15.22:0/4008106571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f78108e60 0x7f8f78075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.643+0000 7f8f7d1d5640 1 --2- 172.21.15.22:0/4008106571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f781084e0 0x7f8f78075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.643+0000 7f8f7d1d5640 1 --2- 172.21.15.22:0/4008106571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f78102ad0 0x7f8f780751d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.643+0000 7f8f7d1d5640 1 -- 172.21.15.22:0/4008106571 >> 172.21.15.22:0/4008106571 conn(0x7f8f780fe540 msgr2=0x7f8f78100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.643+0000 7f8f7d1d5640 1 -- 172.21.15.22:0/4008106571 shutdown_connections 2024-08-20T01:29:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:41.643+0000 7f8f7d1d5640 1 -- 172.21.15.22:0/4008106571 wait complete. 2024-08-20T01:29:42.264 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:41 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/4008106571' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:29:42.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:41 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/4008106571' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:29:42.353 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:41 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/4008106571' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:29:42.387 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-20T01:29:42.388 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-20T01:29:42.388 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-20T01:29:42.389 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-08-20T01:29:42.389 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-08-20T01:29:42.389 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-08-20T01:29:42.390 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-08-20T01:29:42.390 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-08-20T01:29:42.391 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-08-20T01:29:42.391 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-08-20T01:29:42.392 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-08-20T01:29:42.392 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-08-20T01:29:43.216 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:43.223 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:43.231 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:43.231 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:43.233 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:43.234 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:43.236 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:43.236 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:43.237 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:43.246 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:43.246 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:43.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:42 smithi134 ceph-mon[22511]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-20T01:29:43.266 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:43.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:42 smithi077 ceph-mon[22251]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-20T01:29:43.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:42 smithi022 ceph-mon[18709]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-20T01:29:44.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.032+0000 7fa7d59cd640 1 -- 172.21.15.22:0/1421062284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d010ce20 msgr2=0x7fa7d010f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:44.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.032+0000 7fa7d59cd640 1 --2- 172.21.15.22:0/1421062284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d010ce20 0x7fa7d010f280 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8009ca0 tx=0x7fa7c802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:29:44.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.032+0000 7fa7d59cd640 1 -- 172.21.15.22:0/1421062284 shutdown_connections 2024-08-20T01:29:44.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.032+0000 7fa7d59cd640 1 --2- 172.21.15.22:0/1421062284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d010ce20 0x7fa7d010f280 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:44.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.032+0000 7fa7d59cd640 1 --2- 172.21.15.22:0/1421062284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7d01042e0 0x7fa7d010c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:44.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.032+0000 7fa7d59cd640 1 --2- 172.21.15.22:0/1421062284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7d01039c0 0x7fa7d0103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:44.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.032+0000 7fa7d59cd640 1 -- 172.21.15.22:0/1421062284 >> 172.21.15.22:0/1421062284 conn(0x7fa7d00fd460 msgr2=0x7fa7d00ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:44.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.032+0000 7fa7d59cd640 1 -- 172.21.15.22:0/1421062284 shutdown_connections 2024-08-20T01:29:44.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.032+0000 7fa7d59cd640 1 -- 172.21.15.22:0/1421062284 wait complete. 2024-08-20T01:29:44.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.033+0000 7fa7d59cd640 1 Processor -- start 2024-08-20T01:29:44.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.033+0000 7fa7d59cd640 1 -- start start 2024-08-20T01:29:44.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.034+0000 7fa7d59cd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d01039c0 0x7fa7d010bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:44.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.034+0000 7fa7d59cd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7d01042e0 0x7fa7d010c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:44.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.034+0000 7fa7d59cd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7d010ce20 0x7fa7d019f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:44.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.034+0000 7fa7d59cd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d0112a90 con 0x7fa7d01039c0 2024-08-20T01:29:44.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.034+0000 7fa7d59cd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d0112910 con 0x7fa7d010ce20 2024-08-20T01:29:44.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.034+0000 7fa7d59cd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d0112c10 con 0x7fa7d01042e0 2024-08-20T01:29:44.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.034+0000 7fa7ceffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d01039c0 0x7fa7d010bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:44.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.034+0000 7fa7ceffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d01039c0 0x7fa7d010bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34480/0 (socket says 172.21.15.22:34480) 2024-08-20T01:29:44.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.034+0000 7fa7ceffd640 1 -- 172.21.15.22:0/3113462955 learned_addr learned my addr 172.21.15.22:0/3113462955 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:44.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.034+0000 7fa7ceffd640 1 -- 172.21.15.22:0/3113462955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7d01042e0 msgr2=0x7fa7d010c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:44.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.034+0000 7fa7ce7fc640 1 --2- 172.21.15.22:0/3113462955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7d01042e0 0x7fa7d010c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:44.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.035+0000 7fa7ceffd640 1 --2- 172.21.15.22:0/3113462955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7d01042e0 0x7fa7d010c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:44.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.035+0000 7fa7ceffd640 1 -- 172.21.15.22:0/3113462955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7d010ce20 msgr2=0x7fa7d019f790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T01:29:44.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.035+0000 7fa7ceffd640 1 --2- 172.21.15.22:0/3113462955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7d010ce20 0x7fa7d019f790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:44.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.035+0000 7fa7ceffd640 1 -- 172.21.15.22:0/3113462955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d019ff10 con 0x7fa7d01039c0 2024-08-20T01:29:44.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.035+0000 7fa7ce7fc640 1 --2- 172.21.15.22:0/3113462955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7d01042e0 0x7fa7d010c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:29:44.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.035+0000 7fa7ceffd640 1 --2- 172.21.15.22:0/3113462955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d01039c0 0x7fa7d010bb00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000d950 tx=0x7fa7c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:44.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.035+0000 7fa7d49cb640 1 -- 172.21.15.22:0/3113462955 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0017070 con 0x7fa7d01039c0 2024-08-20T01:29:44.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.035+0000 7fa7d49cb640 1 -- 172.21.15.22:0/3113462955 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7c0009c30 con 0x7fa7d01039c0 2024-08-20T01:29:44.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.035+0000 7fa7d49cb640 1 -- 172.21.15.22:0/3113462955 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c000f620 con 0x7fa7d01039c0 2024-08-20T01:29:44.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.035+0000 7fa7d59cd640 1 -- 172.21.15.22:0/3113462955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d01a0200 con 0x7fa7d01039c0 2024-08-20T01:29:44.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.036+0000 7fa7d59cd640 1 -- 172.21.15.22:0/3113462955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d019c6c0 con 0x7fa7d01039c0 2024-08-20T01:29:44.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.037+0000 7fa7d59cd640 1 -- 172.21.15.22:0/3113462955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa7d01030d0 con 0x7fa7d01039c0 2024-08-20T01:29:44.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.040+0000 7fa7d49cb640 1 -- 172.21.15.22:0/3113462955 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fa7c0010460 con 0x7fa7d01039c0 2024-08-20T01:29:44.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.040+0000 7fa7d49cb640 1 --2- 172.21.15.22:0/3113462955 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa7b80b3ce0 0x7fa7b80b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:44.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.041+0000 7fa7ce7fc640 1 --2- 172.21.15.22:0/3113462955 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa7b80b3ce0 0x7fa7b80b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:44.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.041+0000 7fa7d49cb640 1 -- 172.21.15.22:0/3113462955 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fa7c00e3c70 con 0x7fa7d01039c0 2024-08-20T01:29:44.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.041+0000 7fa7d49cb640 1 --2- 172.21.15.22:0/3113462955 >> [v2:172.21.15.77:6800/823882511,v1:172.21.15.77:6801/823882511] conn(0x7fa7b80bd530 0x7fa7b80bf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:44.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.041+0000 7fa7d49cb640 1 -- 172.21.15.22:0/3113462955 --> [v2:172.21.15.77:6800/823882511,v1:172.21.15.77:6801/823882511] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa7c0016ec0 con 0x7fa7b80bd530 2024-08-20T01:29:44.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.041+0000 7fa7d49cb640 1 -- 172.21.15.22:0/3113462955 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fa7c00e4150 con 0x7fa7d01039c0 2024-08-20T01:29:44.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.041+0000 7fa7ce7fc640 1 --2- 172.21.15.22:0/3113462955 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa7b80b3ce0 0x7fa7b80b61a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa7d010e2b0 tx=0x7fa7c40092a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:44.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.041+0000 7fa7cf7fe640 1 --2- 172.21.15.22:0/3113462955 >> [v2:172.21.15.77:6800/823882511,v1:172.21.15.77:6801/823882511] conn(0x7fa7b80bd530 0x7fa7b80bf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:44.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.042+0000 7fa7cf7fe640 1 --2- 172.21.15.22:0/3113462955 >> [v2:172.21.15.77:6800/823882511,v1:172.21.15.77:6801/823882511] conn(0x7fa7b80bd530 0x7fa7b80bf950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:44.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.043+0000 7fa7d49cb640 1 -- 172.21.15.22:0/3113462955 <== osd.1 v2:172.21.15.77:6800/823882511 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa7c0016ec0 con 0x7fa7b80bd530 2024-08-20T01:29:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.057+0000 7fa7d59cd640 1 -- 172.21.15.22:0/3113462955 --> [v2:172.21.15.77:6800/823882511,v1:172.21.15.77:6801/823882511] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa7d006b6d0 con 0x7fa7b80bd530 2024-08-20T01:29:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.058+0000 7fa7d49cb640 1 -- 172.21.15.22:0/3113462955 <== osd.1 v2:172.21.15.77:6800/823882511 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa7d006b6d0 con 0x7fa7b80bd530 2024-08-20T01:29:44.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.058+0000 7fa7d59cd640 1 -- 172.21.15.22:0/3113462955 >> [v2:172.21.15.77:6800/823882511,v1:172.21.15.77:6801/823882511] conn(0x7fa7b80bd530 msgr2=0x7fa7b80bf950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:44.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.058+0000 7fa7d59cd640 1 --2- 172.21.15.22:0/3113462955 >> [v2:172.21.15.77:6800/823882511,v1:172.21.15.77:6801/823882511] conn(0x7fa7b80bd530 0x7fa7b80bf950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:44.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.058+0000 7fa7d59cd640 1 -- 172.21.15.22:0/3113462955 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa7b80b3ce0 msgr2=0x7fa7b80b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:44.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.058+0000 7fa7d59cd640 1 --2- 172.21.15.22:0/3113462955 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa7b80b3ce0 0x7fa7b80b61a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa7d010e2b0 tx=0x7fa7c40092a0 comp rx=0 tx=0).stop 2024-08-20T01:29:44.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.058+0000 7fa7d59cd640 1 -- 172.21.15.22:0/3113462955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d01039c0 msgr2=0x7fa7d010bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:44.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.058+0000 7fa7d59cd640 1 --2- 172.21.15.22:0/3113462955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d01039c0 0x7fa7d010bb00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000d950 tx=0x7fa7c000de10 comp rx=0 tx=0).stop 2024-08-20T01:29:44.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.058+0000 7fa7cf7fe640 1 -- 172.21.15.22:0/3113462955 reap_dead start 2024-08-20T01:29:44.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.058+0000 7fa7d59cd640 1 -- 172.21.15.22:0/3113462955 shutdown_connections 2024-08-20T01:29:44.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.058+0000 7fa7d59cd640 1 -- 172.21.15.22:0/3113462955 >> 172.21.15.22:0/3113462955 conn(0x7fa7d00fd460 msgr2=0x7fa7d010f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:44.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.058+0000 7fa7d59cd640 1 -- 172.21.15.22:0/3113462955 shutdown_connections 2024-08-20T01:29:44.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.058+0000 7fa7d59cd640 1 -- 172.21.15.22:0/3113462955 wait complete. 2024-08-20T01:29:45.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:44 smithi022 ceph-mon[18709]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-08-20T01:29:45.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:44 smithi134 ceph-mon[22511]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-08-20T01:29:45.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:44 smithi077 ceph-mon[22251]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-08-20T01:29:45.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.478+0000 7f5ab52f2640 1 -- 172.21.15.22:0/4009874435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ab01039e0 msgr2=0x7f5ab0103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:45.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.478+0000 7f5ab52f2640 1 --2- 172.21.15.22:0/4009874435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ab01039e0 0x7f5ab0103dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0009900 tx=0x7f5aa002a3f0 comp rx=0 tx=0).stop 2024-08-20T01:29:45.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.478+0000 7f5ab52f2640 1 -- 172.21.15.22:0/4009874435 shutdown_connections 2024-08-20T01:29:45.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.478+0000 7f5ab52f2640 1 --2- 172.21.15.22:0/4009874435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab010ce40 0x7f5ab010f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:45.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.478+0000 7f5ab52f2640 1 --2- 172.21.15.22:0/4009874435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ab0104300 0x7f5ab010c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:45.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.478+0000 7f5ab52f2640 1 --2- 172.21.15.22:0/4009874435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ab01039e0 0x7f5ab0103dc0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:45.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.478+0000 7f5ab52f2640 1 -- 172.21.15.22:0/4009874435 >> 172.21.15.22:0/4009874435 conn(0x7f5ab00fd440 msgr2=0x7f5ab00ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:45.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.478+0000 7f5ab52f2640 1 -- 172.21.15.22:0/4009874435 shutdown_connections 2024-08-20T01:29:45.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.478+0000 7f5ab52f2640 1 -- 172.21.15.22:0/4009874435 wait complete. 2024-08-20T01:29:45.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.479+0000 7f5ab52f2640 1 Processor -- start 2024-08-20T01:29:45.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.479+0000 7f5ab52f2640 1 -- start start 2024-08-20T01:29:45.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.479+0000 7f5ab52f2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ab01039e0 0x7f5ab0101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:45.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.479+0000 7f5ab52f2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab0104300 0x7f5ab0101bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:45.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.479+0000 7f5ab52f2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ab010ce40 0x7f5ab0102110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.479+0000 7f5ab52f2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab0112b60 con 0x7f5ab010ce40 2024-08-20T01:29:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.479+0000 7f5ab52f2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab01129e0 con 0x7f5ab0104300 2024-08-20T01:29:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.479+0000 7f5ab52f2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab0112ce0 con 0x7f5ab01039e0 2024-08-20T01:29:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.479+0000 7f5aaf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ab010ce40 0x7f5ab0102110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.479+0000 7f5aaf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ab010ce40 0x7f5ab0102110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34532/0 (socket says 172.21.15.22:34532) 2024-08-20T01:29:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.479+0000 7f5aaeffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ab01039e0 0x7f5ab0101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.479+0000 7f5aaf7fe640 1 -- 172.21.15.22:0/2925237507 learned_addr learned my addr 172.21.15.22:0/2925237507 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.480+0000 7f5aae7fc640 1 --2- 172.21.15.22:0/2925237507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab0104300 0x7f5ab0101bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.480+0000 7f5aaf7fe640 1 -- 172.21.15.22:0/2925237507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ab01039e0 msgr2=0x7f5ab0101690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.480+0000 7f5aaf7fe640 1 --2- 172.21.15.22:0/2925237507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ab01039e0 0x7f5ab0101690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:45.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.480+0000 7f5aaf7fe640 1 -- 172.21.15.22:0/2925237507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab0104300 msgr2=0x7f5ab0101bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:45.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.480+0000 7f5aaf7fe640 1 --2- 172.21.15.22:0/2925237507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab0104300 0x7f5ab0101bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:45.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.480+0000 7f5aaf7fe640 1 -- 172.21.15.22:0/2925237507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab01a73d0 con 0x7f5ab010ce40 2024-08-20T01:29:45.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.480+0000 7f5aaf7fe640 1 --2- 172.21.15.22:0/2925237507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ab010ce40 0x7f5ab0102110 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800cce0 tx=0x7f5aa800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:45.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.480+0000 7f5a97fff640 1 -- 172.21.15.22:0/2925237507 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa800f450 con 0x7f5ab010ce40 2024-08-20T01:29:45.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.480+0000 7f5a97fff640 1 -- 172.21.15.22:0/2925237507 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5aa800faa0 con 0x7f5ab010ce40 2024-08-20T01:29:45.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.480+0000 7f5ab52f2640 1 -- 172.21.15.22:0/2925237507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab01a76c0 con 0x7f5ab010ce40 2024-08-20T01:29:45.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.480+0000 7f5a97fff640 1 -- 172.21.15.22:0/2925237507 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8018b70 con 0x7f5ab010ce40 2024-08-20T01:29:45.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.480+0000 7f5ab52f2640 1 -- 172.21.15.22:0/2925237507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab01a7c80 con 0x7f5ab010ce40 2024-08-20T01:29:45.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.481+0000 7f5ab52f2640 1 -- 172.21.15.22:0/2925237507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ab00ff3a0 con 0x7f5ab010ce40 2024-08-20T01:29:45.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.483+0000 7f5a97fff640 1 -- 172.21.15.22:0/2925237507 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f5aa8018d10 con 0x7f5ab010ce40 2024-08-20T01:29:45.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.484+0000 7f5a97fff640 1 --2- 172.21.15.22:0/2925237507 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5a980b3ce0 0x7f5a980b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:45.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.484+0000 7f5aaeffd640 1 --2- 172.21.15.22:0/2925237507 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5a980b3ce0 0x7f5a980b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:45.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.484+0000 7f5a97fff640 1 -- 172.21.15.22:0/2925237507 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f5aa80e40b0 con 0x7f5ab010ce40 2024-08-20T01:29:45.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.484+0000 7f5a97fff640 1 --2- 172.21.15.22:0/2925237507 >> [v2:172.21.15.77:6824/2765589872,v1:172.21.15.77:6825/2765589872] conn(0x7f5a980bd530 0x7f5a980bf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:45.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.484+0000 7f5a97fff640 1 -- 172.21.15.22:0/2925237507 --> [v2:172.21.15.77:6824/2765589872,v1:172.21.15.77:6825/2765589872] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5aa801ee50 con 0x7f5a980bd530 2024-08-20T01:29:45.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.484+0000 7f5a97fff640 1 -- 172.21.15.22:0/2925237507 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f5aa80eb050 con 0x7f5ab010ce40 2024-08-20T01:29:45.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.484+0000 7f5aaeffd640 1 --2- 172.21.15.22:0/2925237507 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5a980b3ce0 0x7f5a980b61a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0005ab0 tx=0x7f5aa0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:45.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.485+0000 7f5aae7fc640 1 --2- 172.21.15.22:0/2925237507 >> [v2:172.21.15.77:6824/2765589872,v1:172.21.15.77:6825/2765589872] conn(0x7f5a980bd530 0x7f5a980bf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:45.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.485+0000 7f5aae7fc640 1 --2- 172.21.15.22:0/2925237507 >> [v2:172.21.15.77:6824/2765589872,v1:172.21.15.77:6825/2765589872] conn(0x7f5a980bd530 0x7f5a980bf950 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:45.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.486+0000 7f5a97fff640 1 -- 172.21.15.22:0/2925237507 <== osd.10 v2:172.21.15.77:6824/2765589872 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5aa801ee50 con 0x7f5a980bd530 2024-08-20T01:29:45.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.500+0000 7f5ab52f2640 1 -- 172.21.15.22:0/2925237507 --> [v2:172.21.15.77:6824/2765589872,v1:172.21.15.77:6825/2765589872] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5ab006b890 con 0x7f5a980bd530 2024-08-20T01:29:45.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.500+0000 7f5a97fff640 1 -- 172.21.15.22:0/2925237507 <== osd.10 v2:172.21.15.77:6824/2765589872 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5ab006b890 con 0x7f5a980bd530 2024-08-20T01:29:45.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.501+0000 7f5ab52f2640 1 -- 172.21.15.22:0/2925237507 >> [v2:172.21.15.77:6824/2765589872,v1:172.21.15.77:6825/2765589872] conn(0x7f5a980bd530 msgr2=0x7f5a980bf950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:45.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.501+0000 7f5ab52f2640 1 --2- 172.21.15.22:0/2925237507 >> [v2:172.21.15.77:6824/2765589872,v1:172.21.15.77:6825/2765589872] conn(0x7f5a980bd530 0x7f5a980bf950 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:45.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.501+0000 7f5ab52f2640 1 -- 172.21.15.22:0/2925237507 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5a980b3ce0 msgr2=0x7f5a980b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:45.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.501+0000 7f5ab52f2640 1 --2- 172.21.15.22:0/2925237507 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5a980b3ce0 0x7f5a980b61a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0005ab0 tx=0x7f5aa0005a20 comp rx=0 tx=0).stop 2024-08-20T01:29:45.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.501+0000 7f5ab52f2640 1 -- 172.21.15.22:0/2925237507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ab010ce40 msgr2=0x7f5ab0102110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:45.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.501+0000 7f5ab52f2640 1 --2- 172.21.15.22:0/2925237507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ab010ce40 0x7f5ab0102110 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800cce0 tx=0x7f5aa800a620 comp rx=0 tx=0).stop 2024-08-20T01:29:45.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.501+0000 7f5aaf7fe640 1 -- 172.21.15.22:0/2925237507 reap_dead start 2024-08-20T01:29:45.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.501+0000 7f5ab52f2640 1 -- 172.21.15.22:0/2925237507 shutdown_connections 2024-08-20T01:29:45.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.501+0000 7f5ab52f2640 1 -- 172.21.15.22:0/2925237507 >> 172.21.15.22:0/2925237507 conn(0x7f5ab00fd440 msgr2=0x7f5ab010f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:45.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.501+0000 7f5ab52f2640 1 -- 172.21.15.22:0/2925237507 shutdown_connections 2024-08-20T01:29:45.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:45.501+0000 7f5ab52f2640 1 -- 172.21.15.22:0/2925237507 wait complete. 2024-08-20T01:29:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.469+0000 7f9cafab8640 1 -- 172.21.15.22:0/2614197069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ca8104230 msgr2=0x7f9ca810c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.469+0000 7f9cafab8640 1 --2- 172.21.15.22:0/2614197069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ca8104230 0x7f9ca810c810 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009900 tx=0x7f9ca402a410 comp rx=0 tx=0).stop 2024-08-20T01:29:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.469+0000 7f9cafab8640 1 -- 172.21.15.22:0/2614197069 shutdown_connections 2024-08-20T01:29:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.469+0000 7f9cafab8640 1 --2- 172.21.15.22:0/2614197069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca810cde0 0x7f9ca810f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.469+0000 7f9cafab8640 1 --2- 172.21.15.22:0/2614197069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ca8104230 0x7f9ca810c810 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.469+0000 7f9cafab8640 1 --2- 172.21.15.22:0/2614197069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ca8103830 0x7f9ca8103c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.469+0000 7f9cafab8640 1 -- 172.21.15.22:0/2614197069 >> 172.21.15.22:0/2614197069 conn(0x7f9ca80fd400 msgr2=0x7f9ca80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.469+0000 7f9cafab8640 1 -- 172.21.15.22:0/2614197069 shutdown_connections 2024-08-20T01:29:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.469+0000 7f9cafab8640 1 -- 172.21.15.22:0/2614197069 wait complete. 2024-08-20T01:29:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.470+0000 7f9cafab8640 1 Processor -- start 2024-08-20T01:29:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.470+0000 7f9cafab8640 1 -- start start 2024-08-20T01:29:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.470+0000 7f9cafab8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ca8103830 0x7f9ca8198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.470+0000 7f9cafab8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ca8104230 0x7f9ca8199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.470+0000 7f9cafab8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca810cde0 0x7f9ca819e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9cafab8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca8112a60 con 0x7f9ca8104230 2024-08-20T01:29:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9cafab8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca81128e0 con 0x7f9ca810cde0 2024-08-20T01:29:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9cafab8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca8112be0 con 0x7f9ca8103830 2024-08-20T01:29:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9cad053640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ca8104230 0x7f9ca8199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9cad053640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ca8104230 0x7f9ca8199510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34506/0 (socket says 172.21.15.22:34506) 2024-08-20T01:29:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9cad053640 1 -- 172.21.15.22:0/722071072 learned_addr learned my addr 172.21.15.22:0/722071072 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9cad854640 1 --2- 172.21.15.22:0/722071072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ca8103830 0x7f9ca8198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9cae055640 1 --2- 172.21.15.22:0/722071072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca810cde0 0x7f9ca819e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9cad053640 1 -- 172.21.15.22:0/722071072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ca8103830 msgr2=0x7f9ca8198fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9cad053640 1 --2- 172.21.15.22:0/722071072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ca8103830 0x7f9ca8198fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9cad053640 1 -- 172.21.15.22:0/722071072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca810cde0 msgr2=0x7f9ca819e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9cad053640 1 --2- 172.21.15.22:0/722071072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca810cde0 0x7f9ca819e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9cad053640 1 -- 172.21.15.22:0/722071072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca819f080 con 0x7f9ca8104230 2024-08-20T01:29:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9cae055640 1 --2- 172.21.15.22:0/722071072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca810cde0 0x7f9ca819e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:29:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9cad053640 1 --2- 172.21.15.22:0/722071072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ca8104230 0x7f9ca8199510 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4005940 tx=0x7f9ca40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9c9affd640 1 -- 172.21.15.22:0/722071072 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca403f030 con 0x7f9ca8104230 2024-08-20T01:29:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9c9affd640 1 -- 172.21.15.22:0/722071072 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ca40044c0 con 0x7f9ca8104230 2024-08-20T01:29:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9cafab8640 1 -- 172.21.15.22:0/722071072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca819f310 con 0x7f9ca8104230 2024-08-20T01:29:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9c9affd640 1 -- 172.21.15.22:0/722071072 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4035070 con 0x7f9ca8104230 2024-08-20T01:29:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.471+0000 7f9cafab8640 1 -- 172.21.15.22:0/722071072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca81a5a30 con 0x7f9ca8104230 2024-08-20T01:29:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.472+0000 7f9cafab8640 1 -- 172.21.15.22:0/722071072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9ca80635d0 con 0x7f9ca8104230 2024-08-20T01:29:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.474+0000 7f9c9affd640 1 -- 172.21.15.22:0/722071072 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f9ca4042030 con 0x7f9ca8104230 2024-08-20T01:29:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.474+0000 7f9c9affd640 1 --2- 172.21.15.22:0/722071072 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9c940b3c60 0x7f9c940b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.475+0000 7f9cad854640 1 --2- 172.21.15.22:0/722071072 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9c940b3c60 0x7f9c940b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.475+0000 7f9c9affd640 1 -- 172.21.15.22:0/722071072 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f9ca4104660 con 0x7f9ca8104230 2024-08-20T01:29:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.475+0000 7f9c9affd640 1 --2- 172.21.15.22:0/722071072 >> [v2:172.21.15.134:6824/964533669,v1:172.21.15.134:6825/964533669] conn(0x7f9c940bd4b0 0x7f9c940bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.475+0000 7f9c9affd640 1 -- 172.21.15.22:0/722071072 --> [v2:172.21.15.134:6824/964533669,v1:172.21.15.134:6825/964533669] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ca403ce50 con 0x7f9c940bd4b0 2024-08-20T01:29:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.475+0000 7f9c9affd640 1 -- 172.21.15.22:0/722071072 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f9ca4104b40 con 0x7f9ca8104230 2024-08-20T01:29:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.475+0000 7f9cad854640 1 --2- 172.21.15.22:0/722071072 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9c940b3c60 0x7f9c940b6120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009bd0 tx=0x7f9c9c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.475+0000 7f9cae055640 1 --2- 172.21.15.22:0/722071072 >> [v2:172.21.15.134:6824/964533669,v1:172.21.15.134:6825/964533669] conn(0x7f9c940bd4b0 0x7f9c940bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.475+0000 7f9cae055640 1 --2- 172.21.15.22:0/722071072 >> [v2:172.21.15.134:6824/964533669,v1:172.21.15.134:6825/964533669] conn(0x7f9c940bd4b0 0x7f9c940bf8d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.476+0000 7f9c9affd640 1 -- 172.21.15.22:0/722071072 <== osd.11 v2:172.21.15.134:6824/964533669 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ca403ce50 con 0x7f9c940bd4b0 2024-08-20T01:29:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.490+0000 7f9cafab8640 1 -- 172.21.15.22:0/722071072 --> [v2:172.21.15.134:6824/964533669,v1:172.21.15.134:6825/964533669] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9ca8063a50 con 0x7f9c940bd4b0 2024-08-20T01:29:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.491+0000 7f9c9affd640 1 -- 172.21.15.22:0/722071072 <== osd.11 v2:172.21.15.134:6824/964533669 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9ca8063a50 con 0x7f9c940bd4b0 2024-08-20T01:29:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.491+0000 7f9cafab8640 1 -- 172.21.15.22:0/722071072 >> [v2:172.21.15.134:6824/964533669,v1:172.21.15.134:6825/964533669] conn(0x7f9c940bd4b0 msgr2=0x7f9c940bf8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.491+0000 7f9cafab8640 1 --2- 172.21.15.22:0/722071072 >> [v2:172.21.15.134:6824/964533669,v1:172.21.15.134:6825/964533669] conn(0x7f9c940bd4b0 0x7f9c940bf8d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.491+0000 7f9cafab8640 1 -- 172.21.15.22:0/722071072 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9c940b3c60 msgr2=0x7f9c940b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.491+0000 7f9cafab8640 1 --2- 172.21.15.22:0/722071072 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9c940b3c60 0x7f9c940b6120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009bd0 tx=0x7f9c9c005f90 comp rx=0 tx=0).stop 2024-08-20T01:29:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.491+0000 7f9cafab8640 1 -- 172.21.15.22:0/722071072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ca8104230 msgr2=0x7f9ca8199510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.491+0000 7f9cafab8640 1 --2- 172.21.15.22:0/722071072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ca8104230 0x7f9ca8199510 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4005940 tx=0x7f9ca40040c0 comp rx=0 tx=0).stop 2024-08-20T01:29:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.491+0000 7f9cae055640 1 -- 172.21.15.22:0/722071072 reap_dead start 2024-08-20T01:29:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.491+0000 7f9cafab8640 1 -- 172.21.15.22:0/722071072 shutdown_connections 2024-08-20T01:29:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.491+0000 7f9cafab8640 1 -- 172.21.15.22:0/722071072 >> 172.21.15.22:0/722071072 conn(0x7f9ca80fd400 msgr2=0x7f9ca80fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.491+0000 7f9cafab8640 1 -- 172.21.15.22:0/722071072 shutdown_connections 2024-08-20T01:29:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:44.491+0000 7f9cafab8640 1 -- 172.21.15.22:0/722071072 wait complete. 2024-08-20T01:29:46.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.503+0000 7f43a5d3f640 1 -- 172.21.15.22:0/1582432021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a01019d0 msgr2=0x7f43a0101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:46.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.503+0000 7f43a5d3f640 1 --2- 172.21.15.22:0/1582432021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a01019d0 0x7f43a0101db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4390009900 tx=0x7f439002a410 comp rx=0 tx=0).stop 2024-08-20T01:29:46.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.503+0000 7f43a5d3f640 1 -- 172.21.15.22:0/1582432021 shutdown_connections 2024-08-20T01:29:46.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.503+0000 7f43a5d3f640 1 --2- 172.21.15.22:0/1582432021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43a0107d60 0x7f43a010e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:46.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.503+0000 7f43a5d3f640 1 --2- 172.21.15.22:0/1582432021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43a01073e0 0x7f43a0107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:46.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.503+0000 7f43a5d3f640 1 --2- 172.21.15.22:0/1582432021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a01019d0 0x7f43a0101db0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:46.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.503+0000 7f43a5d3f640 1 -- 172.21.15.22:0/1582432021 >> 172.21.15.22:0/1582432021 conn(0x7f43a00fd440 msgr2=0x7f43a00ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:46.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.503+0000 7f43a5d3f640 1 -- 172.21.15.22:0/1582432021 shutdown_connections 2024-08-20T01:29:46.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.503+0000 7f43a5d3f640 1 -- 172.21.15.22:0/1582432021 wait complete. 2024-08-20T01:29:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.504+0000 7f43a5d3f640 1 Processor -- start 2024-08-20T01:29:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.504+0000 7f43a5d3f640 1 -- start start 2024-08-20T01:29:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.504+0000 7f43a5d3f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43a01019d0 0x7f43a0199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.504+0000 7f43a5d3f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a01073e0 0x7f43a01995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.504+0000 7f43a5d3f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43a0107d60 0x7f43a019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.504+0000 7f43a5d3f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f43a0111a20 con 0x7f43a01073e0 2024-08-20T01:29:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.504+0000 7f43a5d3f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43a01118a0 con 0x7f43a0107d60 2024-08-20T01:29:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.504+0000 7f43a5d3f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f43a0111ba0 con 0x7f43a01019d0 2024-08-20T01:29:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.504+0000 7f439effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a01073e0 0x7f43a01995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.504+0000 7f439effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a01073e0 0x7f43a01995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34550/0 (socket says 172.21.15.22:34550) 2024-08-20T01:29:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.504+0000 7f439effd640 1 -- 172.21.15.22:0/492240170 learned_addr learned my addr 172.21.15.22:0/492240170 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.504+0000 7f439f7fe640 1 --2- 172.21.15.22:0/492240170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43a01019d0 0x7f43a0199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.504+0000 7f439ffff640 1 --2- 172.21.15.22:0/492240170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43a0107d60 0x7f43a019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.505+0000 7f439effd640 1 -- 172.21.15.22:0/492240170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43a01019d0 msgr2=0x7f43a0199080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.505+0000 7f439effd640 1 --2- 172.21.15.22:0/492240170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43a01019d0 0x7f43a0199080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.505+0000 7f439effd640 1 -- 172.21.15.22:0/492240170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43a0107d60 msgr2=0x7f43a019e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.505+0000 7f439effd640 1 --2- 172.21.15.22:0/492240170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43a0107d60 0x7f43a019e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.505+0000 7f439effd640 1 -- 172.21.15.22:0/492240170 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a019f130 con 0x7f43a01073e0 2024-08-20T01:29:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.505+0000 7f439f7fe640 1 --2- 172.21.15.22:0/492240170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43a01019d0 0x7f43a0199080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:29:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.505+0000 7f439effd640 1 --2- 172.21.15.22:0/492240170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a01073e0 0x7f43a01995c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f439400c920 tx=0x7f439400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.505+0000 7f439cff9640 1 -- 172.21.15.22:0/492240170 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4394007c70 con 0x7f43a01073e0 2024-08-20T01:29:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.505+0000 7f43a5d3f640 1 -- 172.21.15.22:0/492240170 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43a019f420 con 0x7f43a01073e0 2024-08-20T01:29:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.505+0000 7f439cff9640 1 -- 172.21.15.22:0/492240170 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4394007e10 con 0x7f43a01073e0 2024-08-20T01:29:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.505+0000 7f439cff9640 1 -- 172.21.15.22:0/492240170 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4394018820 con 0x7f43a01073e0 2024-08-20T01:29:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.505+0000 7f43a5d3f640 1 -- 172.21.15.22:0/492240170 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43a01a5cb0 con 0x7f43a01073e0 2024-08-20T01:29:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.506+0000 7f43a5d3f640 1 -- 172.21.15.22:0/492240170 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f43a0063590 con 0x7f43a01073e0 2024-08-20T01:29:46.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.507+0000 7f439cff9640 1 -- 172.21.15.22:0/492240170 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f439400f450 con 0x7f43a01073e0 2024-08-20T01:29:46.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.508+0000 7f439cff9640 1 --2- 172.21.15.22:0/492240170 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f43880b3c60 0x7f43880b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:46.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.508+0000 7f439f7fe640 1 --2- 172.21.15.22:0/492240170 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f43880b3c60 0x7f43880b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:46.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.509+0000 7f439cff9640 1 -- 172.21.15.22:0/492240170 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f43940e4220 con 0x7f43a01073e0 2024-08-20T01:29:46.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.509+0000 7f439cff9640 1 --2- 172.21.15.22:0/492240170 >> [v2:172.21.15.134:6800/3873702897,v1:172.21.15.134:6801/3873702897] conn(0x7f43880bd4b0 0x7f43880bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:46.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.509+0000 7f439cff9640 1 -- 172.21.15.22:0/492240170 --> [v2:172.21.15.134:6800/3873702897,v1:172.21.15.134:6801/3873702897] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4394020e50 con 0x7f43880bd4b0 2024-08-20T01:29:46.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.509+0000 7f439cff9640 1 -- 172.21.15.22:0/492240170 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f43940e4700 con 0x7f43a01073e0 2024-08-20T01:29:46.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.509+0000 7f439f7fe640 1 --2- 172.21.15.22:0/492240170 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f43880b3c60 0x7f43880b6120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4390031440 tx=0x7f43900095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:46.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.509+0000 7f439ffff640 1 --2- 172.21.15.22:0/492240170 >> [v2:172.21.15.134:6800/3873702897,v1:172.21.15.134:6801/3873702897] conn(0x7f43880bd4b0 0x7f43880bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:46.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.510+0000 7f439ffff640 1 --2- 172.21.15.22:0/492240170 >> [v2:172.21.15.134:6800/3873702897,v1:172.21.15.134:6801/3873702897] conn(0x7f43880bd4b0 0x7f43880bf8d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:46.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.510+0000 7f439cff9640 1 -- 172.21.15.22:0/492240170 <== osd.2 v2:172.21.15.134:6800/3873702897 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4394020e50 con 0x7f43880bd4b0 2024-08-20T01:29:46.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.524+0000 7f43a5d3f640 1 -- 172.21.15.22:0/492240170 --> [v2:172.21.15.134:6800/3873702897,v1:172.21.15.134:6801/3873702897] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f43a0063990 con 0x7f43880bd4b0 2024-08-20T01:29:46.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.525+0000 7f439cff9640 1 -- 172.21.15.22:0/492240170 <== osd.2 v2:172.21.15.134:6800/3873702897 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f43a0063990 con 0x7f43880bd4b0 2024-08-20T01:29:46.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.525+0000 7f43a5d3f640 1 -- 172.21.15.22:0/492240170 >> [v2:172.21.15.134:6800/3873702897,v1:172.21.15.134:6801/3873702897] conn(0x7f43880bd4b0 msgr2=0x7f43880bf8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:46.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.525+0000 7f43a5d3f640 1 --2- 172.21.15.22:0/492240170 >> [v2:172.21.15.134:6800/3873702897,v1:172.21.15.134:6801/3873702897] conn(0x7f43880bd4b0 0x7f43880bf8d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:46.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.525+0000 7f43a5d3f640 1 -- 172.21.15.22:0/492240170 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f43880b3c60 msgr2=0x7f43880b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:46.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.525+0000 7f43a5d3f640 1 --2- 172.21.15.22:0/492240170 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f43880b3c60 0x7f43880b6120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4390031440 tx=0x7f43900095f0 comp rx=0 tx=0).stop 2024-08-20T01:29:46.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.525+0000 7f43a5d3f640 1 -- 172.21.15.22:0/492240170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a01073e0 msgr2=0x7f43a01995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:46.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.525+0000 7f43a5d3f640 1 --2- 172.21.15.22:0/492240170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a01073e0 0x7f43a01995c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f439400c920 tx=0x7f439400cde0 comp rx=0 tx=0).stop 2024-08-20T01:29:46.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.525+0000 7f439ffff640 1 -- 172.21.15.22:0/492240170 reap_dead start 2024-08-20T01:29:46.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.526+0000 7f43a5d3f640 1 -- 172.21.15.22:0/492240170 shutdown_connections 2024-08-20T01:29:46.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.526+0000 7f43a5d3f640 1 -- 172.21.15.22:0/492240170 >> 172.21.15.22:0/492240170 conn(0x7f43a00fd440 msgr2=0x7f43a006b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:46.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.526+0000 7f43a5d3f640 1 -- 172.21.15.22:0/492240170 shutdown_connections 2024-08-20T01:29:46.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:46.526+0000 7f43a5d3f640 1 -- 172.21.15.22:0/492240170 wait complete. 2024-08-20T01:29:47.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:46 smithi022 ceph-mon[18709]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 6 op/s 2024-08-20T01:29:47.261 INFO:teuthology.orchestra.run.smithi022.stdout:73014444098 2024-08-20T01:29:47.261 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-20T01:29:47.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:46 smithi134 ceph-mon[22511]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 6 op/s 2024-08-20T01:29:47.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:46 smithi077 ceph-mon[22251]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 6 op/s 2024-08-20T01:29:47.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.437+0000 7ff1f805b640 1 -- 172.21.15.22:0/4168328984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1f0102ad0 msgr2=0x7ff1f0102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:47.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.437+0000 7ff1f805b640 1 --2- 172.21.15.22:0/4168328984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1f0102ad0 0x7ff1f0102eb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4009900 tx=0x7ff1e402a3f0 comp rx=0 tx=0).stop 2024-08-20T01:29:47.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.437+0000 7ff1f805b640 1 -- 172.21.15.22:0/4168328984 shutdown_connections 2024-08-20T01:29:47.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.437+0000 7ff1f805b640 1 --2- 172.21.15.22:0/4168328984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1f0108e60 0x7ff1f010f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:47.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.437+0000 7ff1f805b640 1 --2- 172.21.15.22:0/4168328984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1f01084e0 0x7ff1f0108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:47.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.437+0000 7ff1f805b640 1 --2- 172.21.15.22:0/4168328984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1f0102ad0 0x7ff1f0102eb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:47.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.437+0000 7ff1f805b640 1 -- 172.21.15.22:0/4168328984 >> 172.21.15.22:0/4168328984 conn(0x7ff1f00fe540 msgr2=0x7ff1f0100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:47.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.437+0000 7ff1f805b640 1 -- 172.21.15.22:0/4168328984 shutdown_connections 2024-08-20T01:29:47.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.437+0000 7ff1f805b640 1 -- 172.21.15.22:0/4168328984 wait complete. 2024-08-20T01:29:47.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.438+0000 7ff1f805b640 1 Processor -- start 2024-08-20T01:29:47.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.438+0000 7ff1f805b640 1 -- start start 2024-08-20T01:29:47.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.438+0000 7ff1f805b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1f0102ad0 0x7ff1f0199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:47.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.438+0000 7ff1f805b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1f01084e0 0x7ff1f0199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:47.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.438+0000 7ff1f805b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1f0108e60 0x7ff1f019e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:47.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.438+0000 7ff1f805b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f0112b20 con 0x7ff1f01084e0 2024-08-20T01:29:47.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.438+0000 7ff1f805b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f01129a0 con 0x7ff1f0102ad0 2024-08-20T01:29:47.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.438+0000 7ff1f805b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f0112ca0 con 0x7ff1f0108e60 2024-08-20T01:29:47.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.438+0000 7ff1f55f6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1f01084e0 0x7ff1f0199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:47.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.438+0000 7ff1f55f6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1f01084e0 0x7ff1f0199550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34576/0 (socket says 172.21.15.22:34576) 2024-08-20T01:29:47.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.438+0000 7ff1f55f6640 1 -- 172.21.15.22:0/1224741080 learned_addr learned my addr 172.21.15.22:0/1224741080 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.438+0000 7ff1f65f8640 1 --2- 172.21.15.22:0/1224741080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1f0108e60 0x7ff1f019e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.438+0000 7ff1f5df7640 1 --2- 172.21.15.22:0/1224741080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1f0102ad0 0x7ff1f0199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.439+0000 7ff1f55f6640 1 -- 172.21.15.22:0/1224741080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1f0108e60 msgr2=0x7ff1f019e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.439+0000 7ff1f55f6640 1 --2- 172.21.15.22:0/1224741080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1f0108e60 0x7ff1f019e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.439+0000 7ff1f55f6640 1 -- 172.21.15.22:0/1224741080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1f0102ad0 msgr2=0x7ff1f0199010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.439+0000 7ff1f55f6640 1 --2- 172.21.15.22:0/1224741080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1f0102ad0 0x7ff1f0199010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.439+0000 7ff1f55f6640 1 -- 172.21.15.22:0/1224741080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f019f0c0 con 0x7ff1f01084e0 2024-08-20T01:29:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.439+0000 7ff1f55f6640 1 --2- 172.21.15.22:0/1224741080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1f01084e0 0x7ff1f0199550 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00c920 tx=0x7ff1ec00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.439+0000 7ff1e2ffd640 1 -- 172.21.15.22:0/1224741080 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec007c70 con 0x7ff1f01084e0 2024-08-20T01:29:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.439+0000 7ff1f805b640 1 -- 172.21.15.22:0/1224741080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f019f3b0 con 0x7ff1f01084e0 2024-08-20T01:29:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.439+0000 7ff1e2ffd640 1 -- 172.21.15.22:0/1224741080 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1ec007e10 con 0x7ff1f01084e0 2024-08-20T01:29:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.439+0000 7ff1e2ffd640 1 -- 172.21.15.22:0/1224741080 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec018820 con 0x7ff1f01084e0 2024-08-20T01:29:47.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.439+0000 7ff1f805b640 1 -- 172.21.15.22:0/1224741080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f01a5c40 con 0x7ff1f01084e0 2024-08-20T01:29:47.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.440+0000 7ff1f805b640 1 -- 172.21.15.22:0/1224741080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1f0063610 con 0x7ff1f01084e0 2024-08-20T01:29:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.442+0000 7ff1e2ffd640 1 -- 172.21.15.22:0/1224741080 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7ff1ec00f450 con 0x7ff1f01084e0 2024-08-20T01:29:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.443+0000 7ff1e2ffd640 1 --2- 172.21.15.22:0/1224741080 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff1dc0b3c60 0x7ff1dc0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.443+0000 7ff1f5df7640 1 --2- 172.21.15.22:0/1224741080 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff1dc0b3c60 0x7ff1dc0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.443+0000 7ff1e2ffd640 1 -- 172.21.15.22:0/1224741080 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7ff1ec0e41d0 con 0x7ff1f01084e0 2024-08-20T01:29:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.443+0000 7ff1e2ffd640 1 --2- 172.21.15.22:0/1224741080 >> [v2:172.21.15.134:6808/2805488123,v1:172.21.15.134:6809/2805488123] conn(0x7ff1dc0bd4b0 0x7ff1dc0bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:47.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.443+0000 7ff1e2ffd640 1 -- 172.21.15.22:0/1224741080 --> [v2:172.21.15.134:6808/2805488123,v1:172.21.15.134:6809/2805488123] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1ec020e50 con 0x7ff1dc0bd4b0 2024-08-20T01:29:47.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.443+0000 7ff1e2ffd640 1 -- 172.21.15.22:0/1224741080 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7ff1ec0e4580 con 0x7ff1f01084e0 2024-08-20T01:29:47.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.443+0000 7ff1f5df7640 1 --2- 172.21.15.22:0/1224741080 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff1dc0b3c60 0x7ff1dc0b6120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4031440 tx=0x7ff1e4005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:47.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.443+0000 7ff1f65f8640 1 --2- 172.21.15.22:0/1224741080 >> [v2:172.21.15.134:6808/2805488123,v1:172.21.15.134:6809/2805488123] conn(0x7ff1dc0bd4b0 0x7ff1dc0bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:47.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.444+0000 7ff1f65f8640 1 --2- 172.21.15.22:0/1224741080 >> [v2:172.21.15.134:6808/2805488123,v1:172.21.15.134:6809/2805488123] conn(0x7ff1dc0bd4b0 0x7ff1dc0bf8d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:47.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.445+0000 7ff1e2ffd640 1 -- 172.21.15.22:0/1224741080 <== osd.5 v2:172.21.15.134:6808/2805488123 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff1ec020e50 con 0x7ff1dc0bd4b0 2024-08-20T01:29:47.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.469+0000 7ff1f805b640 1 -- 172.21.15.22:0/1224741080 --> [v2:172.21.15.134:6808/2805488123,v1:172.21.15.134:6809/2805488123] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff1f0063a10 con 0x7ff1dc0bd4b0 2024-08-20T01:29:47.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.469+0000 7ff1e2ffd640 1 -- 172.21.15.22:0/1224741080 <== osd.5 v2:172.21.15.134:6808/2805488123 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff1f0063a10 con 0x7ff1dc0bd4b0 2024-08-20T01:29:47.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.470+0000 7ff1f805b640 1 -- 172.21.15.22:0/1224741080 >> [v2:172.21.15.134:6808/2805488123,v1:172.21.15.134:6809/2805488123] conn(0x7ff1dc0bd4b0 msgr2=0x7ff1dc0bf8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:47.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.470+0000 7ff1f805b640 1 --2- 172.21.15.22:0/1224741080 >> [v2:172.21.15.134:6808/2805488123,v1:172.21.15.134:6809/2805488123] conn(0x7ff1dc0bd4b0 0x7ff1dc0bf8d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:47.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.470+0000 7ff1f805b640 1 -- 172.21.15.22:0/1224741080 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff1dc0b3c60 msgr2=0x7ff1dc0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:47.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.470+0000 7ff1f805b640 1 --2- 172.21.15.22:0/1224741080 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff1dc0b3c60 0x7ff1dc0b6120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4031440 tx=0x7ff1e4005e80 comp rx=0 tx=0).stop 2024-08-20T01:29:47.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.470+0000 7ff1f805b640 1 -- 172.21.15.22:0/1224741080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1f01084e0 msgr2=0x7ff1f0199550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:47.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.470+0000 7ff1f805b640 1 --2- 172.21.15.22:0/1224741080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1f01084e0 0x7ff1f0199550 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00c920 tx=0x7ff1ec00cde0 comp rx=0 tx=0).stop 2024-08-20T01:29:47.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.470+0000 7ff1f65f8640 1 -- 172.21.15.22:0/1224741080 reap_dead start 2024-08-20T01:29:47.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.470+0000 7ff1f805b640 1 -- 172.21.15.22:0/1224741080 shutdown_connections 2024-08-20T01:29:47.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.470+0000 7ff1f805b640 1 -- 172.21.15.22:0/1224741080 >> 172.21.15.22:0/1224741080 conn(0x7ff1f00fe540 msgr2=0x7ff1f00fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:47.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.470+0000 7ff1f805b640 1 -- 172.21.15.22:0/1224741080 shutdown_connections 2024-08-20T01:29:47.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.470+0000 7ff1f805b640 1 -- 172.21.15.22:0/1224741080 wait complete. 2024-08-20T01:29:47.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.771+0000 7f817a6b2640 1 -- 172.21.15.22:0/1349370451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f817410ce00 msgr2=0x7f817410f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:47.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.771+0000 7f817a6b2640 1 --2- 172.21.15.22:0/1349370451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f817410ce00 0x7f817410f250 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f816c009ca0 tx=0x7f816c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:29:47.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.771+0000 7f817a6b2640 1 -- 172.21.15.22:0/1349370451 shutdown_connections 2024-08-20T01:29:47.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.771+0000 7f817a6b2640 1 --2- 172.21.15.22:0/1349370451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f817410ce00 0x7f817410f250 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:47.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.771+0000 7f817a6b2640 1 --2- 172.21.15.22:0/1349370451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8174104250 0x7f817410c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:47.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.771+0000 7f817a6b2640 1 --2- 172.21.15.22:0/1349370451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8174103850 0x7f8174103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:47.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.771+0000 7f817a6b2640 1 -- 172.21.15.22:0/1349370451 >> 172.21.15.22:0/1349370451 conn(0x7f81740fd400 msgr2=0x7f81740ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:47.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.771+0000 7f817a6b2640 1 -- 172.21.15.22:0/1349370451 shutdown_connections 2024-08-20T01:29:47.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.771+0000 7f817a6b2640 1 -- 172.21.15.22:0/1349370451 wait complete. 2024-08-20T01:29:47.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.771+0000 7f817a6b2640 1 Processor -- start 2024-08-20T01:29:47.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.772+0000 7f817a6b2640 1 -- start start 2024-08-20T01:29:47.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.772+0000 7f817a6b2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8174103850 0x7f81741016d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:47.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.772+0000 7f817a6b2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8174104250 0x7f8174101c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:47.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.772+0000 7f817a6b2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f817410ce00 0x7f8174102150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:47.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.772+0000 7f817a6b2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8174112a60 con 0x7f817410ce00 2024-08-20T01:29:47.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.772+0000 7f817a6b2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81741128e0 con 0x7f8174103850 2024-08-20T01:29:47.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.772+0000 7f817a6b2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8174112be0 con 0x7f8174104250 2024-08-20T01:29:47.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.772+0000 7f8178c4f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f817410ce00 0x7f8174102150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:47.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.772+0000 7f8178c4f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f817410ce00 0x7f8174102150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34604/0 (socket says 172.21.15.22:34604) 2024-08-20T01:29:47.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.772+0000 7f8178c4f640 1 -- 172.21.15.22:0/2312096335 learned_addr learned my addr 172.21.15.22:0/2312096335 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:47.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.772+0000 7f8173fff640 1 --2- 172.21.15.22:0/2312096335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8174103850 0x7f81741016d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:47.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.772+0000 7f81737fe640 1 --2- 172.21.15.22:0/2312096335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8174104250 0x7f8174101c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:47.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.773+0000 7f8178c4f640 1 -- 172.21.15.22:0/2312096335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8174104250 msgr2=0x7f8174101c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:47.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.773+0000 7f8178c4f640 1 --2- 172.21.15.22:0/2312096335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8174104250 0x7f8174101c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:47.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.773+0000 7f8178c4f640 1 -- 172.21.15.22:0/2312096335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8174103850 msgr2=0x7f81741016d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:47.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.773+0000 7f8178c4f640 1 --2- 172.21.15.22:0/2312096335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8174103850 0x7f81741016d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:47.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.773+0000 7f8178c4f640 1 -- 172.21.15.22:0/2312096335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81741a7320 con 0x7f817410ce00 2024-08-20T01:29:47.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.773+0000 7f8173fff640 1 --2- 172.21.15.22:0/2312096335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8174103850 0x7f81741016d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:29:47.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.773+0000 7f8178c4f640 1 --2- 172.21.15.22:0/2312096335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f817410ce00 0x7f8174102150 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f816c005cc0 tx=0x7f816c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:47.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.773+0000 7f81717fa640 1 -- 172.21.15.22:0/2312096335 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816c003bf0 con 0x7f817410ce00 2024-08-20T01:29:47.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.773+0000 7f817a6b2640 1 -- 172.21.15.22:0/2312096335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81741a75b0 con 0x7f817410ce00 2024-08-20T01:29:47.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.773+0000 7f81717fa640 1 -- 172.21.15.22:0/2312096335 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f816c003d90 con 0x7f817410ce00 2024-08-20T01:29:47.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.773+0000 7f81717fa640 1 -- 172.21.15.22:0/2312096335 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816c02fbc0 con 0x7f817410ce00 2024-08-20T01:29:47.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.773+0000 7f817a6b2640 1 -- 172.21.15.22:0/2312096335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81741a7b40 con 0x7f817410ce00 2024-08-20T01:29:47.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.774+0000 7f817a6b2640 1 -- 172.21.15.22:0/2312096335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8174063610 con 0x7f817410ce00 2024-08-20T01:29:47.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.776+0000 7f81717fa640 1 -- 172.21.15.22:0/2312096335 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f816c02fd60 con 0x7f817410ce00 2024-08-20T01:29:47.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.776+0000 7f81717fa640 1 --2- 172.21.15.22:0/2312096335 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f815c0b3c60 0x7f815c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:47.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.776+0000 7f8173fff640 1 --2- 172.21.15.22:0/2312096335 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f815c0b3c60 0x7f815c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:47.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.776+0000 7f81717fa640 1 -- 172.21.15.22:0/2312096335 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f816c1052a0 con 0x7f817410ce00 2024-08-20T01:29:47.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.777+0000 7f81717fa640 1 --2- 172.21.15.22:0/2312096335 >> [v2:172.21.15.77:6816/700318902,v1:172.21.15.77:6817/700318902] conn(0x7f815c0bd4b0 0x7f815c0bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:47.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.777+0000 7f81717fa640 1 -- 172.21.15.22:0/2312096335 --> [v2:172.21.15.77:6816/700318902,v1:172.21.15.77:6817/700318902] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f816c03fec0 con 0x7f815c0bd4b0 2024-08-20T01:29:47.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.777+0000 7f81717fa640 1 -- 172.21.15.22:0/2312096335 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f816c105780 con 0x7f817410ce00 2024-08-20T01:29:47.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.777+0000 7f8173fff640 1 --2- 172.21.15.22:0/2312096335 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f815c0b3c60 0x7f815c0b6120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8164005fd0 tx=0x7f816400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:47.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.777+0000 7f81737fe640 1 --2- 172.21.15.22:0/2312096335 >> [v2:172.21.15.77:6816/700318902,v1:172.21.15.77:6817/700318902] conn(0x7f815c0bd4b0 0x7f815c0bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:47.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.777+0000 7f81737fe640 1 --2- 172.21.15.22:0/2312096335 >> [v2:172.21.15.77:6816/700318902,v1:172.21.15.77:6817/700318902] conn(0x7f815c0bd4b0 0x7f815c0bf8d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:47.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.778+0000 7f81717fa640 1 -- 172.21.15.22:0/2312096335 <== osd.7 v2:172.21.15.77:6816/700318902 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f816c03fec0 con 0x7f815c0bd4b0 2024-08-20T01:29:47.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.793+0000 7f817a6b2640 1 -- 172.21.15.22:0/2312096335 --> [v2:172.21.15.77:6816/700318902,v1:172.21.15.77:6817/700318902] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8174063a10 con 0x7f815c0bd4b0 2024-08-20T01:29:47.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.793+0000 7f81717fa640 1 -- 172.21.15.22:0/2312096335 <== osd.7 v2:172.21.15.77:6816/700318902 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8174063a10 con 0x7f815c0bd4b0 2024-08-20T01:29:47.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.794+0000 7f817a6b2640 1 -- 172.21.15.22:0/2312096335 >> [v2:172.21.15.77:6816/700318902,v1:172.21.15.77:6817/700318902] conn(0x7f815c0bd4b0 msgr2=0x7f815c0bf8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:47.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.794+0000 7f817a6b2640 1 --2- 172.21.15.22:0/2312096335 >> [v2:172.21.15.77:6816/700318902,v1:172.21.15.77:6817/700318902] conn(0x7f815c0bd4b0 0x7f815c0bf8d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:47.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.794+0000 7f817a6b2640 1 -- 172.21.15.22:0/2312096335 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f815c0b3c60 msgr2=0x7f815c0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:47.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.794+0000 7f817a6b2640 1 --2- 172.21.15.22:0/2312096335 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f815c0b3c60 0x7f815c0b6120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8164005fd0 tx=0x7f816400b390 comp rx=0 tx=0).stop 2024-08-20T01:29:47.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.794+0000 7f817a6b2640 1 -- 172.21.15.22:0/2312096335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f817410ce00 msgr2=0x7f8174102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:47.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.794+0000 7f817a6b2640 1 --2- 172.21.15.22:0/2312096335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f817410ce00 0x7f8174102150 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f816c005cc0 tx=0x7f816c02f380 comp rx=0 tx=0).stop 2024-08-20T01:29:47.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.794+0000 7f8178c4f640 1 -- 172.21.15.22:0/2312096335 reap_dead start 2024-08-20T01:29:47.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.794+0000 7f817a6b2640 1 -- 172.21.15.22:0/2312096335 shutdown_connections 2024-08-20T01:29:47.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.794+0000 7f817a6b2640 1 -- 172.21.15.22:0/2312096335 >> 172.21.15.22:0/2312096335 conn(0x7f81740fd400 msgr2=0x7f81740fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:47.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.794+0000 7f817a6b2640 1 -- 172.21.15.22:0/2312096335 shutdown_connections 2024-08-20T01:29:47.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.794+0000 7f817a6b2640 1 -- 172.21.15.22:0/2312096335 wait complete. 2024-08-20T01:29:48.229 INFO:teuthology.orchestra.run.smithi022.stdout:270582939674 2024-08-20T01:29:48.230 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-08-20T01:29:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.653+0000 7f6b998eb640 1 -- 172.21.15.22:0/56551249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b94102ad0 msgr2=0x7f6b94102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.653+0000 7f6b998eb640 1 --2- 172.21.15.22:0/56551249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b94102ad0 0x7f6b94102eb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009900 tx=0x7f6b8402a410 comp rx=0 tx=0).stop 2024-08-20T01:29:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.653+0000 7f6b998eb640 1 -- 172.21.15.22:0/56551249 shutdown_connections 2024-08-20T01:29:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.653+0000 7f6b998eb640 1 --2- 172.21.15.22:0/56551249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b94108e60 0x7f6b9410f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.653+0000 7f6b998eb640 1 --2- 172.21.15.22:0/56551249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b941084e0 0x7f6b94108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.653+0000 7f6b998eb640 1 --2- 172.21.15.22:0/56551249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b94102ad0 0x7f6b94102eb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.653+0000 7f6b998eb640 1 -- 172.21.15.22:0/56551249 >> 172.21.15.22:0/56551249 conn(0x7f6b940fe540 msgr2=0x7f6b94100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.653+0000 7f6b998eb640 1 -- 172.21.15.22:0/56551249 shutdown_connections 2024-08-20T01:29:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.653+0000 7f6b998eb640 1 -- 172.21.15.22:0/56551249 wait complete. 2024-08-20T01:29:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.654+0000 7f6b998eb640 1 Processor -- start 2024-08-20T01:29:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.654+0000 7f6b998eb640 1 -- start start 2024-08-20T01:29:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.654+0000 7f6b998eb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b94102ad0 0x7f6b94199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.654+0000 7f6b998eb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b941084e0 0x7f6b94199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.654+0000 7f6b998eb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b94108e60 0x7f6b9419e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.654+0000 7f6b998eb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6b94112b20 con 0x7f6b94108e60 2024-08-20T01:29:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.654+0000 7f6b998eb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6b941129a0 con 0x7f6b941084e0 2024-08-20T01:29:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.654+0000 7f6b998eb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6b94112ca0 con 0x7f6b94102ad0 2024-08-20T01:29:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.654+0000 7f6b937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b94108e60 0x7f6b9419e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.654+0000 7f6b937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b94108e60 0x7f6b9419e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34598/0 (socket says 172.21.15.22:34598) 2024-08-20T01:29:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.654+0000 7f6b937fe640 1 -- 172.21.15.22:0/1929100381 learned_addr learned my addr 172.21.15.22:0/1929100381 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.654+0000 7f6b8bfff640 1 --2- 172.21.15.22:0/1929100381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b941084e0 0x7f6b94199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.654+0000 7f6b937fe640 1 -- 172.21.15.22:0/1929100381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b94102ad0 msgr2=0x7f6b94199030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.654+0000 7f6b92ffd640 1 --2- 172.21.15.22:0/1929100381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b94102ad0 0x7f6b94199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.654+0000 7f6b937fe640 1 --2- 172.21.15.22:0/1929100381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b94102ad0 0x7f6b94199030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.654+0000 7f6b937fe640 1 -- 172.21.15.22:0/1929100381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b941084e0 msgr2=0x7f6b94199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.654+0000 7f6b937fe640 1 --2- 172.21.15.22:0/1929100381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b941084e0 0x7f6b94199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.654+0000 7f6b937fe640 1 -- 172.21.15.22:0/1929100381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9419f0e0 con 0x7f6b94108e60 2024-08-20T01:29:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.654+0000 7f6b937fe640 1 --2- 172.21.15.22:0/1929100381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b94108e60 0x7f6b9419e910 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00eaa0 tx=0x7f6b8c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.655+0000 7f6b988e9640 1 -- 172.21.15.22:0/1929100381 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c004d20 con 0x7f6b94108e60 2024-08-20T01:29:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.655+0000 7f6b998eb640 1 -- 172.21.15.22:0/1929100381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9419f3d0 con 0x7f6b94108e60 2024-08-20T01:29:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.655+0000 7f6b988e9640 1 -- 172.21.15.22:0/1929100381 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b8c005020 con 0x7f6b94108e60 2024-08-20T01:29:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.655+0000 7f6b988e9640 1 -- 172.21.15.22:0/1929100381 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0116b0 con 0x7f6b94108e60 2024-08-20T01:29:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.655+0000 7f6b998eb640 1 -- 172.21.15.22:0/1929100381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b941a5b10 con 0x7f6b94108e60 2024-08-20T01:29:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.655+0000 7f6b998eb640 1 -- 172.21.15.22:0/1929100381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6b94063610 con 0x7f6b94108e60 2024-08-20T01:29:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.657+0000 7f6b988e9640 1 -- 172.21.15.22:0/1929100381 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f6b8c0051d0 con 0x7f6b94108e60 2024-08-20T01:29:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.658+0000 7f6b988e9640 1 --2- 172.21.15.22:0/1929100381 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6b800b3c60 0x7f6b800b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.658+0000 7f6b92ffd640 1 --2- 172.21.15.22:0/1929100381 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6b800b3c60 0x7f6b800b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.658+0000 7f6b988e9640 1 -- 172.21.15.22:0/1929100381 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f6b8c0e4340 con 0x7f6b94108e60 2024-08-20T01:29:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.658+0000 7f6b988e9640 1 --2- 172.21.15.22:0/1929100381 >> [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906] conn(0x7f6b800bd4b0 0x7f6b800bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.658+0000 7f6b988e9640 1 -- 172.21.15.22:0/1929100381 --> [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b8c014ec0 con 0x7f6b800bd4b0 2024-08-20T01:29:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.658+0000 7f6b988e9640 1 -- 172.21.15.22:0/1929100381 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f6b8c0e46f0 con 0x7f6b94108e60 2024-08-20T01:29:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.658+0000 7f6b8bfff640 1 --2- 172.21.15.22:0/1929100381 >> [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906] conn(0x7f6b800bd4b0 0x7f6b800bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.658+0000 7f6b92ffd640 1 --2- 172.21.15.22:0/1929100381 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6b800b3c60 0x7f6b800b6120 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6b84006010 tx=0x7f6b84000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.659+0000 7f6b8bfff640 1 --2- 172.21.15.22:0/1929100381 >> [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906] conn(0x7f6b800bd4b0 0x7f6b800bf8d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.659+0000 7f6b988e9640 1 -- 172.21.15.22:0/1929100381 <== osd.3 v2:172.21.15.22:6810/1775946906 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b8c014ec0 con 0x7f6b800bd4b0 2024-08-20T01:29:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.673+0000 7f6b998eb640 1 -- 172.21.15.22:0/1929100381 --> [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6b94063a90 con 0x7f6b800bd4b0 2024-08-20T01:29:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.673+0000 7f6b988e9640 1 -- 172.21.15.22:0/1929100381 <== osd.3 v2:172.21.15.22:6810/1775946906 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6b94063a90 con 0x7f6b800bd4b0 2024-08-20T01:29:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.674+0000 7f6b998eb640 1 -- 172.21.15.22:0/1929100381 >> [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906] conn(0x7f6b800bd4b0 msgr2=0x7f6b800bf8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.674+0000 7f6b998eb640 1 --2- 172.21.15.22:0/1929100381 >> [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906] conn(0x7f6b800bd4b0 0x7f6b800bf8d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.674+0000 7f6b998eb640 1 -- 172.21.15.22:0/1929100381 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6b800b3c60 msgr2=0x7f6b800b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.674+0000 7f6b998eb640 1 --2- 172.21.15.22:0/1929100381 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6b800b3c60 0x7f6b800b6120 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6b84006010 tx=0x7f6b84000bc0 comp rx=0 tx=0).stop 2024-08-20T01:29:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.674+0000 7f6b998eb640 1 -- 172.21.15.22:0/1929100381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b94108e60 msgr2=0x7f6b9419e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.674+0000 7f6b998eb640 1 --2- 172.21.15.22:0/1929100381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b94108e60 0x7f6b9419e910 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00eaa0 tx=0x7f6b8c00eea0 comp rx=0 tx=0).stop 2024-08-20T01:29:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.674+0000 7f6b937fe640 1 -- 172.21.15.22:0/1929100381 reap_dead start 2024-08-20T01:29:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.674+0000 7f6b998eb640 1 -- 172.21.15.22:0/1929100381 shutdown_connections 2024-08-20T01:29:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.674+0000 7f6b998eb640 1 -- 172.21.15.22:0/1929100381 >> 172.21.15.22:0/1929100381 conn(0x7f6b940fe540 msgr2=0x7f6b94100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.674+0000 7f6b998eb640 1 -- 172.21.15.22:0/1929100381 shutdown_connections 2024-08-20T01:29:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:47.674+0000 7f6b998eb640 1 -- 172.21.15.22:0/1929100381 wait complete. 2024-08-20T01:29:49.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:49 smithi022 ceph-mon[18709]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 7 op/s 2024-08-20T01:29:49.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:49 smithi134 ceph-mon[22511]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 7 op/s 2024-08-20T01:29:49.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:49 smithi077 ceph-mon[22251]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 7 op/s 2024-08-20T01:29:49.690 INFO:teuthology.orchestra.run.smithi022.stdout:55834574919 2024-08-20T01:29:49.690 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-20T01:29:49.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.855+0000 7f9cbc4a6640 1 -- 172.21.15.22:0/1707708231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cb41073a0 msgr2=0x7f9cb41077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:49.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.855+0000 7f9cbc4a6640 1 --2- 172.21.15.22:0/1707708231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cb41073a0 0x7f9cb41077e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009900 tx=0x7f9ca402a410 comp rx=0 tx=0).stop 2024-08-20T01:29:49.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.855+0000 7f9cbc4a6640 1 -- 172.21.15.22:0/1707708231 shutdown_connections 2024-08-20T01:29:49.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.855+0000 7f9cbc4a6640 1 --2- 172.21.15.22:0/1707708231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cb4107d20 0x7f9cb410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:49.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.855+0000 7f9cbc4a6640 1 --2- 172.21.15.22:0/1707708231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cb41073a0 0x7f9cb41077e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:49.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.855+0000 7f9cbc4a6640 1 --2- 172.21.15.22:0/1707708231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cb4101990 0x7f9cb4101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:49.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.855+0000 7f9cbc4a6640 1 -- 172.21.15.22:0/1707708231 >> 172.21.15.22:0/1707708231 conn(0x7f9cb40fd400 msgr2=0x7f9cb40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:49.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.855+0000 7f9cbc4a6640 1 -- 172.21.15.22:0/1707708231 shutdown_connections 2024-08-20T01:29:49.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.855+0000 7f9cbc4a6640 1 -- 172.21.15.22:0/1707708231 wait complete. 2024-08-20T01:29:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.856+0000 7f9cbc4a6640 1 Processor -- start 2024-08-20T01:29:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.856+0000 7f9cbc4a6640 1 -- start start 2024-08-20T01:29:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.856+0000 7f9cbc4a6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cb4101990 0x7f9cb4199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.856+0000 7f9cbc4a6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cb41073a0 0x7f9cb4199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.856+0000 7f9cbc4a6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cb4107d20 0x7f9cb419ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.856+0000 7f9cbc4a6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb4111a20 con 0x7f9cb41073a0 2024-08-20T01:29:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.856+0000 7f9cbc4a6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb41118a0 con 0x7f9cb4101990 2024-08-20T01:29:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.856+0000 7f9cbc4a6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb4111ba0 con 0x7f9cb4107d20 2024-08-20T01:29:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.856+0000 7f9cb9a41640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cb41073a0 0x7f9cb4199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.856+0000 7f9cb9a41640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cb41073a0 0x7f9cb4199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45770/0 (socket says 172.21.15.22:45770) 2024-08-20T01:29:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.856+0000 7f9cb9a41640 1 -- 172.21.15.22:0/1167827403 learned_addr learned my addr 172.21.15.22:0/1167827403 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.856+0000 7f9cba242640 1 --2- 172.21.15.22:0/1167827403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cb4101990 0x7f9cb4199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.856+0000 7f9cbaa43640 1 --2- 172.21.15.22:0/1167827403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cb4107d20 0x7f9cb419ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.857+0000 7f9cb9a41640 1 -- 172.21.15.22:0/1167827403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cb4107d20 msgr2=0x7f9cb419ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.857+0000 7f9cb9a41640 1 --2- 172.21.15.22:0/1167827403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cb4107d20 0x7f9cb419ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.857+0000 7f9cb9a41640 1 -- 172.21.15.22:0/1167827403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cb4101990 msgr2=0x7f9cb4199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.857+0000 7f9cb9a41640 1 --2- 172.21.15.22:0/1167827403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cb4101990 0x7f9cb4199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.857+0000 7f9cb9a41640 1 -- 172.21.15.22:0/1167827403 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb419f1d0 con 0x7f9cb41073a0 2024-08-20T01:29:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.857+0000 7f9cbaa43640 1 --2- 172.21.15.22:0/1167827403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cb4107d20 0x7f9cb419ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:29:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.857+0000 7f9cb9a41640 1 --2- 172.21.15.22:0/1167827403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cb41073a0 0x7f9cb4199660 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4006010 tx=0x7f9ca40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:49.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.857+0000 7f9cab7fe640 1 -- 172.21.15.22:0/1167827403 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca403f030 con 0x7f9cb41073a0 2024-08-20T01:29:49.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.857+0000 7f9cbc4a6640 1 -- 172.21.15.22:0/1167827403 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb419f460 con 0x7f9cb41073a0 2024-08-20T01:29:49.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.857+0000 7f9cab7fe640 1 -- 172.21.15.22:0/1167827403 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ca4003800 con 0x7f9cb41073a0 2024-08-20T01:29:49.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.857+0000 7f9cbc4a6640 1 -- 172.21.15.22:0/1167827403 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb41a5b80 con 0x7f9cb41073a0 2024-08-20T01:29:49.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.857+0000 7f9cab7fe640 1 -- 172.21.15.22:0/1167827403 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4035070 con 0x7f9cb41073a0 2024-08-20T01:29:49.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.858+0000 7f9cbc4a6640 1 -- 172.21.15.22:0/1167827403 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9cb41044b0 con 0x7f9cb41073a0 2024-08-20T01:29:49.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.860+0000 7f9cab7fe640 1 -- 172.21.15.22:0/1167827403 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f9ca4003cb0 con 0x7f9cb41073a0 2024-08-20T01:29:49.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.861+0000 7f9cab7fe640 1 --2- 172.21.15.22:0/1167827403 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9ca00b3c60 0x7f9ca00b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:49.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.861+0000 7f9cba242640 1 --2- 172.21.15.22:0/1167827403 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9ca00b3c60 0x7f9ca00b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:49.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.861+0000 7f9cab7fe640 1 -- 172.21.15.22:0/1167827403 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f9ca4104c00 con 0x7f9cb41073a0 2024-08-20T01:29:49.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.861+0000 7f9cab7fe640 1 --2- 172.21.15.22:0/1167827403 >> [v2:172.21.15.134:6816/1635473481,v1:172.21.15.134:6817/1635473481] conn(0x7f9ca00bd4b0 0x7f9ca00bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:49.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.861+0000 7f9cab7fe640 1 -- 172.21.15.22:0/1167827403 --> [v2:172.21.15.134:6816/1635473481,v1:172.21.15.134:6817/1635473481] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ca403ce50 con 0x7f9ca00bd4b0 2024-08-20T01:29:49.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.861+0000 7f9cab7fe640 1 -- 172.21.15.22:0/1167827403 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f9ca41050e0 con 0x7f9cb41073a0 2024-08-20T01:29:49.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.861+0000 7f9cbaa43640 1 --2- 172.21.15.22:0/1167827403 >> [v2:172.21.15.134:6816/1635473481,v1:172.21.15.134:6817/1635473481] conn(0x7f9ca00bd4b0 0x7f9ca00bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:49.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.861+0000 7f9cba242640 1 --2- 172.21.15.22:0/1167827403 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9ca00b3c60 0x7f9ca00b6120 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009990 tx=0x7f9cb0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:49.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.862+0000 7f9cbaa43640 1 --2- 172.21.15.22:0/1167827403 >> [v2:172.21.15.134:6816/1635473481,v1:172.21.15.134:6817/1635473481] conn(0x7f9ca00bd4b0 0x7f9ca00bf8d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.863+0000 7f9cab7fe640 1 -- 172.21.15.22:0/1167827403 <== osd.8 v2:172.21.15.134:6816/1635473481 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ca403ce50 con 0x7f9ca00bd4b0 2024-08-20T01:29:49.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.877+0000 7f9cbc4a6640 1 -- 172.21.15.22:0/1167827403 --> [v2:172.21.15.134:6816/1635473481,v1:172.21.15.134:6817/1635473481] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9cb4102c40 con 0x7f9ca00bd4b0 2024-08-20T01:29:49.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.877+0000 7f9cab7fe640 1 -- 172.21.15.22:0/1167827403 <== osd.8 v2:172.21.15.134:6816/1635473481 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9cb4102c40 con 0x7f9ca00bd4b0 2024-08-20T01:29:49.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.878+0000 7f9cbc4a6640 1 -- 172.21.15.22:0/1167827403 >> [v2:172.21.15.134:6816/1635473481,v1:172.21.15.134:6817/1635473481] conn(0x7f9ca00bd4b0 msgr2=0x7f9ca00bf8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:49.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.878+0000 7f9cbc4a6640 1 --2- 172.21.15.22:0/1167827403 >> [v2:172.21.15.134:6816/1635473481,v1:172.21.15.134:6817/1635473481] conn(0x7f9ca00bd4b0 0x7f9ca00bf8d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:49.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.878+0000 7f9cbc4a6640 1 -- 172.21.15.22:0/1167827403 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9ca00b3c60 msgr2=0x7f9ca00b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:49.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.878+0000 7f9cbc4a6640 1 --2- 172.21.15.22:0/1167827403 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9ca00b3c60 0x7f9ca00b6120 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009990 tx=0x7f9cb0009110 comp rx=0 tx=0).stop 2024-08-20T01:29:49.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.878+0000 7f9cbc4a6640 1 -- 172.21.15.22:0/1167827403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cb41073a0 msgr2=0x7f9cb4199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:49.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.878+0000 7f9cbc4a6640 1 --2- 172.21.15.22:0/1167827403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cb41073a0 0x7f9cb4199660 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4006010 tx=0x7f9ca40042f0 comp rx=0 tx=0).stop 2024-08-20T01:29:49.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.878+0000 7f9cbaa43640 1 -- 172.21.15.22:0/1167827403 reap_dead start 2024-08-20T01:29:49.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.878+0000 7f9cbc4a6640 1 -- 172.21.15.22:0/1167827403 shutdown_connections 2024-08-20T01:29:49.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.878+0000 7f9cbc4a6640 1 -- 172.21.15.22:0/1167827403 >> 172.21.15.22:0/1167827403 conn(0x7f9cb40fd400 msgr2=0x7f9cb406ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:49.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.878+0000 7f9cbc4a6640 1 -- 172.21.15.22:0/1167827403 shutdown_connections 2024-08-20T01:29:49.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:49.878+0000 7f9cbc4a6640 1 -- 172.21.15.22:0/1167827403 wait complete. 2024-08-20T01:29:50.580 INFO:teuthology.orchestra.run.smithi022.stdout:197568495657 2024-08-20T01:29:50.580 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-08-20T01:29:51.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:51 smithi134 ceph-mon[22511]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-20T01:29:51.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:51 smithi077 ceph-mon[22251]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-20T01:29:51.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:51 smithi022 ceph-mon[18709]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-20T01:29:51.416 INFO:teuthology.orchestra.run.smithi022.stdout:103079215165 2024-08-20T01:29:51.416 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-08-20T01:29:52.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.103+0000 7f11dce38640 1 -- 172.21.15.22:0/446809300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d8102ad0 msgr2=0x7f11d8102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:52.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.103+0000 7f11dce38640 1 --2- 172.21.15.22:0/446809300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d8102ad0 0x7f11d8102eb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009900 tx=0x7f11c802a410 comp rx=0 tx=0).stop 2024-08-20T01:29:52.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.103+0000 7f11dce38640 1 -- 172.21.15.22:0/446809300 shutdown_connections 2024-08-20T01:29:52.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.103+0000 7f11dce38640 1 --2- 172.21.15.22:0/446809300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11d8108e60 0x7f11d810f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.103+0000 7f11dce38640 1 --2- 172.21.15.22:0/446809300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11d81084e0 0x7f11d8108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.103+0000 7f11dce38640 1 --2- 172.21.15.22:0/446809300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d8102ad0 0x7f11d8102eb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.103+0000 7f11dce38640 1 -- 172.21.15.22:0/446809300 >> 172.21.15.22:0/446809300 conn(0x7f11d80fe540 msgr2=0x7f11d8100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:52.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.103+0000 7f11dce38640 1 -- 172.21.15.22:0/446809300 shutdown_connections 2024-08-20T01:29:52.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.104+0000 7f11dce38640 1 -- 172.21.15.22:0/446809300 wait complete. 2024-08-20T01:29:52.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.104+0000 7f11dce38640 1 Processor -- start 2024-08-20T01:29:52.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.104+0000 7f11dce38640 1 -- start start 2024-08-20T01:29:52.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.105+0000 7f11dce38640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11d8102ad0 0x7f11d8199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:52.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.105+0000 7f11dce38640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11d81084e0 0x7f11d81995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:52.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.105+0000 7f11dce38640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d8108e60 0x7f11d819e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:52.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.105+0000 7f11dce38640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f11d8112b70 con 0x7f11d8108e60 2024-08-20T01:29:52.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.105+0000 7f11dce38640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f11d81129f0 con 0x7f11d81084e0 2024-08-20T01:29:52.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.105+0000 7f11dce38640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f11d8112cf0 con 0x7f11d8102ad0 2024-08-20T01:29:52.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.105+0000 7f11d6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d8108e60 0x7f11d819e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:52.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.105+0000 7f11d6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d8108e60 0x7f11d819e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45798/0 (socket says 172.21.15.22:45798) 2024-08-20T01:29:52.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.105+0000 7f11d6d9d640 1 -- 172.21.15.22:0/1759693830 learned_addr learned my addr 172.21.15.22:0/1759693830 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:52.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.105+0000 7f11d5d9b640 1 --2- 172.21.15.22:0/1759693830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11d81084e0 0x7f11d81995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:52.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.105+0000 7f11d659c640 1 --2- 172.21.15.22:0/1759693830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11d8102ad0 0x7f11d8199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:52.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.105+0000 7f11d6d9d640 1 -- 172.21.15.22:0/1759693830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11d8102ad0 msgr2=0x7f11d8199080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:52.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.105+0000 7f11d6d9d640 1 --2- 172.21.15.22:0/1759693830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11d8102ad0 0x7f11d8199080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.105+0000 7f11d6d9d640 1 -- 172.21.15.22:0/1759693830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11d81084e0 msgr2=0x7f11d81995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:52.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.105+0000 7f11d6d9d640 1 --2- 172.21.15.22:0/1759693830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11d81084e0 0x7f11d81995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.105+0000 7f11d6d9d640 1 -- 172.21.15.22:0/1759693830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d819f130 con 0x7f11d8108e60 2024-08-20T01:29:52.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.105+0000 7f11d6d9d640 1 --2- 172.21.15.22:0/1759693830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d8108e60 0x7f11d819e960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f11d000eaa0 tx=0x7f11d000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:52.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.106+0000 7f11c77fe640 1 -- 172.21.15.22:0/1759693830 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d0004d20 con 0x7f11d8108e60 2024-08-20T01:29:52.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.106+0000 7f11c77fe640 1 -- 172.21.15.22:0/1759693830 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11d0005020 con 0x7f11d8108e60 2024-08-20T01:29:52.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.106+0000 7f11dce38640 1 -- 172.21.15.22:0/1759693830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d819f420 con 0x7f11d8108e60 2024-08-20T01:29:52.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.106+0000 7f11c77fe640 1 -- 172.21.15.22:0/1759693830 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d00116b0 con 0x7f11d8108e60 2024-08-20T01:29:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.106+0000 7f11dce38640 1 -- 172.21.15.22:0/1759693830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d81a5cb0 con 0x7f11d8108e60 2024-08-20T01:29:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.107+0000 7f11dce38640 1 -- 172.21.15.22:0/1759693830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f11d8063610 con 0x7f11d8108e60 2024-08-20T01:29:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.108+0000 7f11c77fe640 1 -- 172.21.15.22:0/1759693830 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f11d00051d0 con 0x7f11d8108e60 2024-08-20T01:29:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.109+0000 7f11c77fe640 1 --2- 172.21.15.22:0/1759693830 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f11c00b3ce0 0x7f11c00b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.109+0000 7f11d659c640 1 --2- 172.21.15.22:0/1759693830 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f11c00b3ce0 0x7f11c00b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.109+0000 7f11c77fe640 1 -- 172.21.15.22:0/1759693830 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f11d00e41e0 con 0x7f11d8108e60 2024-08-20T01:29:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.109+0000 7f11c77fe640 1 --2- 172.21.15.22:0/1759693830 >> [v2:172.21.15.77:6808/1954209322,v1:172.21.15.77:6809/1954209322] conn(0x7f11c00bd530 0x7f11c00bf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.109+0000 7f11c77fe640 1 -- 172.21.15.22:0/1759693830 --> [v2:172.21.15.77:6808/1954209322,v1:172.21.15.77:6809/1954209322] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11d0014ec0 con 0x7f11c00bd530 2024-08-20T01:29:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.109+0000 7f11c77fe640 1 -- 172.21.15.22:0/1759693830 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f11d00e4590 con 0x7f11d8108e60 2024-08-20T01:29:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.109+0000 7f11d659c640 1 --2- 172.21.15.22:0/1759693830 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f11c00b3ce0 0x7f11c00b61a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f11c8005ab0 tx=0x7f11c8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.109+0000 7f11d5d9b640 1 --2- 172.21.15.22:0/1759693830 >> [v2:172.21.15.77:6808/1954209322,v1:172.21.15.77:6809/1954209322] conn(0x7f11c00bd530 0x7f11c00bf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:52.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.110+0000 7f11d5d9b640 1 --2- 172.21.15.22:0/1759693830 >> [v2:172.21.15.77:6808/1954209322,v1:172.21.15.77:6809/1954209322] conn(0x7f11c00bd530 0x7f11c00bf950 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:52.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.111+0000 7f11c77fe640 1 -- 172.21.15.22:0/1759693830 <== osd.4 v2:172.21.15.77:6808/1954209322 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f11d0014ec0 con 0x7f11c00bd530 2024-08-20T01:29:52.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.124+0000 7f11dce38640 1 -- 172.21.15.22:0/1759693830 --> [v2:172.21.15.77:6808/1954209322,v1:172.21.15.77:6809/1954209322] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f11d8063a10 con 0x7f11c00bd530 2024-08-20T01:29:52.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.125+0000 7f11c77fe640 1 -- 172.21.15.22:0/1759693830 <== osd.4 v2:172.21.15.77:6808/1954209322 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f11d8063a10 con 0x7f11c00bd530 2024-08-20T01:29:52.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.125+0000 7f11dce38640 1 -- 172.21.15.22:0/1759693830 >> [v2:172.21.15.77:6808/1954209322,v1:172.21.15.77:6809/1954209322] conn(0x7f11c00bd530 msgr2=0x7f11c00bf950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:52.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.125+0000 7f11dce38640 1 --2- 172.21.15.22:0/1759693830 >> [v2:172.21.15.77:6808/1954209322,v1:172.21.15.77:6809/1954209322] conn(0x7f11c00bd530 0x7f11c00bf950 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.125+0000 7f11dce38640 1 -- 172.21.15.22:0/1759693830 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f11c00b3ce0 msgr2=0x7f11c00b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:52.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.125+0000 7f11dce38640 1 --2- 172.21.15.22:0/1759693830 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f11c00b3ce0 0x7f11c00b61a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f11c8005ab0 tx=0x7f11c8005a20 comp rx=0 tx=0).stop 2024-08-20T01:29:52.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.125+0000 7f11dce38640 1 -- 172.21.15.22:0/1759693830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d8108e60 msgr2=0x7f11d819e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:52.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.125+0000 7f11dce38640 1 --2- 172.21.15.22:0/1759693830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d8108e60 0x7f11d819e960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f11d000eaa0 tx=0x7f11d000eea0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.125+0000 7f11d6d9d640 1 -- 172.21.15.22:0/1759693830 reap_dead start 2024-08-20T01:29:52.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.125+0000 7f11dce38640 1 -- 172.21.15.22:0/1759693830 shutdown_connections 2024-08-20T01:29:52.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.125+0000 7f11dce38640 1 -- 172.21.15.22:0/1759693830 >> 172.21.15.22:0/1759693830 conn(0x7f11d80fe540 msgr2=0x7f11d8100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:52.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.126+0000 7f11dce38640 1 -- 172.21.15.22:0/1759693830 shutdown_connections 2024-08-20T01:29:52.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.126+0000 7f11dce38640 1 -- 172.21.15.22:0/1759693830 wait complete. 2024-08-20T01:29:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.010+0000 7fc37444f640 1 -- 172.21.15.22:0/1868714111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc36c1073a0 msgr2=0x7fc36c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.010+0000 7fc37444f640 1 --2- 172.21.15.22:0/1868714111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc36c1073a0 0x7fc36c1077e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc35c009860 tx=0x7fc35c02a340 comp rx=0 tx=0).stop 2024-08-20T01:29:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.010+0000 7fc37444f640 1 -- 172.21.15.22:0/1868714111 shutdown_connections 2024-08-20T01:29:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.010+0000 7fc37444f640 1 --2- 172.21.15.22:0/1868714111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc36c107d20 0x7fc36c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.010+0000 7fc37444f640 1 --2- 172.21.15.22:0/1868714111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc36c1073a0 0x7fc36c1077e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.010+0000 7fc37444f640 1 --2- 172.21.15.22:0/1868714111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc36c101990 0x7fc36c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.010+0000 7fc37444f640 1 -- 172.21.15.22:0/1868714111 >> 172.21.15.22:0/1868714111 conn(0x7fc36c0fd400 msgr2=0x7fc36c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.010+0000 7fc37444f640 1 -- 172.21.15.22:0/1868714111 shutdown_connections 2024-08-20T01:29:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.010+0000 7fc37444f640 1 -- 172.21.15.22:0/1868714111 wait complete. 2024-08-20T01:29:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.011+0000 7fc37444f640 1 Processor -- start 2024-08-20T01:29:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.011+0000 7fc37444f640 1 -- start start 2024-08-20T01:29:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.011+0000 7fc37444f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc36c101990 0x7fc36c0fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.011+0000 7fc37444f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc36c1073a0 0x7fc36c0fde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.011+0000 7fc37444f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc36c107d20 0x7fc36c0fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.011+0000 7fc37444f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c1119a0 con 0x7fc36c1073a0 2024-08-20T01:29:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.011+0000 7fc37444f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c111820 con 0x7fc36c101990 2024-08-20T01:29:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.011+0000 7fc37444f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c111b20 con 0x7fc36c107d20 2024-08-20T01:29:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.011+0000 7fc3719ea640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc36c1073a0 0x7fc36c0fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.011+0000 7fc3719ea640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc36c1073a0 0x7fc36c0fde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45790/0 (socket says 172.21.15.22:45790) 2024-08-20T01:29:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.011+0000 7fc3719ea640 1 -- 172.21.15.22:0/1285226570 learned_addr learned my addr 172.21.15.22:0/1285226570 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.011+0000 7fc3729ec640 1 --2- 172.21.15.22:0/1285226570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc36c107d20 0x7fc36c0fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:52.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.011+0000 7fc3721eb640 1 --2- 172.21.15.22:0/1285226570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc36c101990 0x7fc36c0fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:52.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.012+0000 7fc3719ea640 1 -- 172.21.15.22:0/1285226570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc36c107d20 msgr2=0x7fc36c0fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:52.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.012+0000 7fc3719ea640 1 --2- 172.21.15.22:0/1285226570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc36c107d20 0x7fc36c0fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.012+0000 7fc3719ea640 1 -- 172.21.15.22:0/1285226570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc36c101990 msgr2=0x7fc36c0fd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:52.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.012+0000 7fc3719ea640 1 --2- 172.21.15.22:0/1285226570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc36c101990 0x7fc36c0fd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.012+0000 7fc3719ea640 1 -- 172.21.15.22:0/1285226570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36c1a7400 con 0x7fc36c1073a0 2024-08-20T01:29:52.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.012+0000 7fc3719ea640 1 --2- 172.21.15.22:0/1285226570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc36c1073a0 0x7fc36c0fde40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0303f0 tx=0x7fc35c032eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:52.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.012+0000 7fc3637fe640 1 -- 172.21.15.22:0/1285226570 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35c040020 con 0x7fc36c1073a0 2024-08-20T01:29:52.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.012+0000 7fc3637fe640 1 -- 172.21.15.22:0/1285226570 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc35c030450 con 0x7fc36c1073a0 2024-08-20T01:29:52.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.012+0000 7fc37444f640 1 -- 172.21.15.22:0/1285226570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36c1a7690 con 0x7fc36c1073a0 2024-08-20T01:29:52.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.012+0000 7fc3637fe640 1 -- 172.21.15.22:0/1285226570 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35c037040 con 0x7fc36c1073a0 2024-08-20T01:29:52.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.013+0000 7fc37444f640 1 -- 172.21.15.22:0/1285226570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc36c1a7bc0 con 0x7fc36c1073a0 2024-08-20T01:29:52.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.013+0000 7fc37444f640 1 -- 172.21.15.22:0/1285226570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc36c1002e0 con 0x7fc36c1073a0 2024-08-20T01:29:52.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.016+0000 7fc3637fe640 1 -- 172.21.15.22:0/1285226570 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fc35c043020 con 0x7fc36c1073a0 2024-08-20T01:29:52.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.016+0000 7fc3637fe640 1 --2- 172.21.15.22:0/1285226570 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc3580b3ce0 0x7fc3580b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:52.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.017+0000 7fc3721eb640 1 --2- 172.21.15.22:0/1285226570 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc3580b3ce0 0x7fc3580b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:52.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.017+0000 7fc3637fe640 1 -- 172.21.15.22:0/1285226570 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fc35c103d50 con 0x7fc36c1073a0 2024-08-20T01:29:52.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.017+0000 7fc3637fe640 1 --2- 172.21.15.22:0/1285226570 >> [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416] conn(0x7fc3580bd530 0x7fc3580bf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.017+0000 7fc3637fe640 1 -- 172.21.15.22:0/1285226570 --> [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc35c001d30 con 0x7fc3580bd530 2024-08-20T01:29:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.017+0000 7fc3637fe640 1 -- 172.21.15.22:0/1285226570 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fc35c104230 con 0x7fc36c1073a0 2024-08-20T01:29:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.017+0000 7fc3729ec640 1 --2- 172.21.15.22:0/1285226570 >> [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416] conn(0x7fc3580bd530 0x7fc3580bf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.017+0000 7fc3721eb640 1 --2- 172.21.15.22:0/1285226570 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc3580b3ce0 0x7fc3580b61a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc368005fd0 tx=0x7fc368009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.017+0000 7fc3729ec640 1 --2- 172.21.15.22:0/1285226570 >> [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416] conn(0x7fc3580bd530 0x7fc3580bf950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.018+0000 7fc3637fe640 1 -- 172.21.15.22:0/1285226570 <== osd.6 v2:172.21.15.22:6818/3804882416 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc35c001d30 con 0x7fc3580bd530 2024-08-20T01:29:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.033+0000 7fc37444f640 1 -- 172.21.15.22:0/1285226570 --> [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc36c102c40 con 0x7fc3580bd530 2024-08-20T01:29:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.033+0000 7fc3637fe640 1 -- 172.21.15.22:0/1285226570 <== osd.6 v2:172.21.15.22:6818/3804882416 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc36c102c40 con 0x7fc3580bd530 2024-08-20T01:29:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.033+0000 7fc37444f640 1 -- 172.21.15.22:0/1285226570 >> [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416] conn(0x7fc3580bd530 msgr2=0x7fc3580bf950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.033+0000 7fc37444f640 1 --2- 172.21.15.22:0/1285226570 >> [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416] conn(0x7fc3580bd530 0x7fc3580bf950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.033+0000 7fc37444f640 1 -- 172.21.15.22:0/1285226570 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc3580b3ce0 msgr2=0x7fc3580b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.033+0000 7fc37444f640 1 --2- 172.21.15.22:0/1285226570 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc3580b3ce0 0x7fc3580b61a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc368005fd0 tx=0x7fc368009260 comp rx=0 tx=0).stop 2024-08-20T01:29:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.033+0000 7fc37444f640 1 -- 172.21.15.22:0/1285226570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc36c1073a0 msgr2=0x7fc36c0fde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:52.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.033+0000 7fc37444f640 1 --2- 172.21.15.22:0/1285226570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc36c1073a0 0x7fc36c0fde40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0303f0 tx=0x7fc35c032eb0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.033+0000 7fc3729ec640 1 -- 172.21.15.22:0/1285226570 reap_dead start 2024-08-20T01:29:52.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.034+0000 7fc37444f640 1 -- 172.21.15.22:0/1285226570 shutdown_connections 2024-08-20T01:29:52.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.034+0000 7fc37444f640 1 -- 172.21.15.22:0/1285226570 >> 172.21.15.22:0/1285226570 conn(0x7fc36c0fd400 msgr2=0x7fc36c1044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:52.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.034+0000 7fc37444f640 1 -- 172.21.15.22:0/1285226570 shutdown_connections 2024-08-20T01:29:52.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.034+0000 7fc37444f640 1 -- 172.21.15.22:0/1285226570 wait complete. 2024-08-20T01:29:52.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.611+0000 7f37a43db640 1 -- 172.21.15.22:0/991123450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f379c108e60 msgr2=0x7f379c10f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:52.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.611+0000 7f37a43db640 1 --2- 172.21.15.22:0/991123450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f379c108e60 0x7f379c10f660 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3794009ca0 tx=0x7f379402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.611+0000 7f37a43db640 1 -- 172.21.15.22:0/991123450 shutdown_connections 2024-08-20T01:29:52.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.611+0000 7f37a43db640 1 --2- 172.21.15.22:0/991123450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f379c108e60 0x7f379c10f660 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.611+0000 7f37a43db640 1 --2- 172.21.15.22:0/991123450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f379c1084e0 0x7f379c108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.611+0000 7f37a43db640 1 --2- 172.21.15.22:0/991123450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f379c102ad0 0x7f379c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.611+0000 7f37a43db640 1 -- 172.21.15.22:0/991123450 >> 172.21.15.22:0/991123450 conn(0x7f379c0fe540 msgr2=0x7f379c100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:52.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.611+0000 7f37a43db640 1 -- 172.21.15.22:0/991123450 shutdown_connections 2024-08-20T01:29:52.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.611+0000 7f37a43db640 1 -- 172.21.15.22:0/991123450 wait complete. 2024-08-20T01:29:52.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.612+0000 7f37a43db640 1 Processor -- start 2024-08-20T01:29:52.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.612+0000 7f37a43db640 1 -- start start 2024-08-20T01:29:52.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.612+0000 7f37a43db640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f379c102ad0 0x7f379c198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:52.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.612+0000 7f37a43db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f379c1084e0 0x7f379c199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:52.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.612+0000 7f37a43db640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f379c108e60 0x7f379c19e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:52.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.612+0000 7f37a43db640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f379c112b20 con 0x7f379c1084e0 2024-08-20T01:29:52.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.612+0000 7f37a43db640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f379c1129a0 con 0x7f379c108e60 2024-08-20T01:29:52.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.612+0000 7f37a43db640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f379c112ca0 con 0x7f379c102ad0 2024-08-20T01:29:52.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.612+0000 7f37a1976640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f379c1084e0 0x7f379c199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:52.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.612+0000 7f37a1976640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f379c1084e0 0x7f379c199490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45816/0 (socket says 172.21.15.22:45816) 2024-08-20T01:29:52.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.613+0000 7f37a1976640 1 -- 172.21.15.22:0/2660025672 learned_addr learned my addr 172.21.15.22:0/2660025672 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:52.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.613+0000 7f37a2177640 1 --2- 172.21.15.22:0/2660025672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f379c102ad0 0x7f379c198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:52.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.613+0000 7f37a2978640 1 --2- 172.21.15.22:0/2660025672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f379c108e60 0x7f379c19e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:52.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.613+0000 7f37a1976640 1 -- 172.21.15.22:0/2660025672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f379c102ad0 msgr2=0x7f379c198f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:52.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.613+0000 7f37a1976640 1 --2- 172.21.15.22:0/2660025672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f379c102ad0 0x7f379c198f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.613+0000 7f37a1976640 1 -- 172.21.15.22:0/2660025672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f379c108e60 msgr2=0x7f379c19e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:52.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.613+0000 7f37a1976640 1 --2- 172.21.15.22:0/2660025672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f379c108e60 0x7f379c19e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.613+0000 7f37a1976640 1 -- 172.21.15.22:0/2660025672 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379c19f000 con 0x7f379c1084e0 2024-08-20T01:29:52.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.613+0000 7f37a1976640 1 --2- 172.21.15.22:0/2660025672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f379c1084e0 0x7f379c199490 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f378c00d950 tx=0x7f378c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:52.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.613+0000 7f37937fe640 1 -- 172.21.15.22:0/2660025672 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378c017070 con 0x7f379c1084e0 2024-08-20T01:29:52.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.613+0000 7f37a43db640 1 -- 172.21.15.22:0/2660025672 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f379c19f2f0 con 0x7f379c1084e0 2024-08-20T01:29:52.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.613+0000 7f37937fe640 1 -- 172.21.15.22:0/2660025672 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f378c009c30 con 0x7f379c1084e0 2024-08-20T01:29:52.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.613+0000 7f37937fe640 1 -- 172.21.15.22:0/2660025672 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378c00f620 con 0x7f379c1084e0 2024-08-20T01:29:52.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.613+0000 7f37a43db640 1 -- 172.21.15.22:0/2660025672 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f379c1a59b0 con 0x7f379c1084e0 2024-08-20T01:29:52.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.614+0000 7f37a43db640 1 -- 172.21.15.22:0/2660025672 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f379c105df0 con 0x7f379c1084e0 2024-08-20T01:29:52.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.616+0000 7f37937fe640 1 -- 172.21.15.22:0/2660025672 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f378c010460 con 0x7f379c1084e0 2024-08-20T01:29:52.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.617+0000 7f37937fe640 1 --2- 172.21.15.22:0/2660025672 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f37880b3c60 0x7f37880b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:52.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.617+0000 7f37a2177640 1 --2- 172.21.15.22:0/2660025672 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f37880b3c60 0x7f37880b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:52.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.617+0000 7f37937fe640 1 -- 172.21.15.22:0/2660025672 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f378c0e3c50 con 0x7f379c1084e0 2024-08-20T01:29:52.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.617+0000 7f37937fe640 1 --2- 172.21.15.22:0/2660025672 >> [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903] conn(0x7f37880bd4b0 0x7f37880bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:52.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.617+0000 7f37937fe640 1 -- 172.21.15.22:0/2660025672 --> [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f378c00d130 con 0x7f37880bd4b0 2024-08-20T01:29:52.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.617+0000 7f37937fe640 1 -- 172.21.15.22:0/2660025672 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f378c0e4130 con 0x7f379c1084e0 2024-08-20T01:29:52.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.617+0000 7f37a2978640 1 --2- 172.21.15.22:0/2660025672 >> [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903] conn(0x7f37880bd4b0 0x7f37880bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:52.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.617+0000 7f37a2177640 1 --2- 172.21.15.22:0/2660025672 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f37880b3c60 0x7f37880b6120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f379800bbe0 tx=0x7f379800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:52.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.617+0000 7f37a2978640 1 --2- 172.21.15.22:0/2660025672 >> [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903] conn(0x7f37880bd4b0 0x7f37880bf8d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:52.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.618+0000 7f37937fe640 1 -- 172.21.15.22:0/2660025672 <== osd.0 v2:172.21.15.22:6802/812056903 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f378c00d130 con 0x7f37880bd4b0 2024-08-20T01:29:52.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.632+0000 7f37a43db640 1 -- 172.21.15.22:0/2660025672 --> [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f379c103d80 con 0x7f37880bd4b0 2024-08-20T01:29:52.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.633+0000 7f37937fe640 1 -- 172.21.15.22:0/2660025672 <== osd.0 v2:172.21.15.22:6802/812056903 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f379c103d80 con 0x7f37880bd4b0 2024-08-20T01:29:52.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.633+0000 7f37a43db640 1 -- 172.21.15.22:0/2660025672 >> [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903] conn(0x7f37880bd4b0 msgr2=0x7f37880bf8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:52.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.633+0000 7f37a43db640 1 --2- 172.21.15.22:0/2660025672 >> [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903] conn(0x7f37880bd4b0 0x7f37880bf8d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:52.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.633+0000 7f37a43db640 1 -- 172.21.15.22:0/2660025672 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f37880b3c60 msgr2=0x7f37880b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:52.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.633+0000 7f37a43db640 1 --2- 172.21.15.22:0/2660025672 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f37880b3c60 0x7f37880b6120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f379800bbe0 tx=0x7f379800b390 comp rx=0 tx=0).stop 2024-08-20T01:29:52.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.633+0000 7f37a43db640 1 -- 172.21.15.22:0/2660025672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f379c1084e0 msgr2=0x7f379c199490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:52.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.633+0000 7f37a43db640 1 --2- 172.21.15.22:0/2660025672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f379c1084e0 0x7f379c199490 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f378c00d950 tx=0x7f378c00de10 comp rx=0 tx=0).stop 2024-08-20T01:29:52.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.633+0000 7f37a2978640 1 -- 172.21.15.22:0/2660025672 reap_dead start 2024-08-20T01:29:52.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.633+0000 7f37a43db640 1 -- 172.21.15.22:0/2660025672 shutdown_connections 2024-08-20T01:29:52.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.633+0000 7f37a43db640 1 -- 172.21.15.22:0/2660025672 >> 172.21.15.22:0/2660025672 conn(0x7f379c0fe540 msgr2=0x7f379c100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:52.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.633+0000 7f37a43db640 1 -- 172.21.15.22:0/2660025672 shutdown_connections 2024-08-20T01:29:52.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:52.633+0000 7f37a43db640 1 -- 172.21.15.22:0/2660025672 wait complete. 2024-08-20T01:29:53.086 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:53 smithi022 ceph-mon[18709]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-20T01:29:53.115 INFO:teuthology.orchestra.run.smithi022.stdout:296352743445 2024-08-20T01:29:53.116 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-08-20T01:29:53.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:53 smithi134 ceph-mon[22511]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-20T01:29:53.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:53 smithi077 ceph-mon[22251]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-20T01:29:53.551 INFO:teuthology.orchestra.run.smithi022.stdout:176093659184 2024-08-20T01:29:53.551 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-08-20T01:29:53.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.742+0000 7fc16ef24640 1 -- 172.21.15.22:0/3767688835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc168108e40 msgr2=0x7fc16810f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:53.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.742+0000 7fc16ef24640 1 --2- 172.21.15.22:0/3767688835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc168108e40 0x7fc16810f640 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc160009ca0 tx=0x7fc16002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:29:53.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.742+0000 7fc16ef24640 1 -- 172.21.15.22:0/3767688835 shutdown_connections 2024-08-20T01:29:53.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.742+0000 7fc16ef24640 1 --2- 172.21.15.22:0/3767688835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc168108e40 0x7fc16810f640 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:53.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.742+0000 7fc16ef24640 1 --2- 172.21.15.22:0/3767688835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1681084c0 0x7fc168108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:53.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.742+0000 7fc16ef24640 1 --2- 172.21.15.22:0/3767688835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc168102ab0 0x7fc168102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:53.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.742+0000 7fc16ef24640 1 -- 172.21.15.22:0/3767688835 >> 172.21.15.22:0/3767688835 conn(0x7fc1680fe580 msgr2=0x7fc1681009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:53.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.742+0000 7fc16ef24640 1 -- 172.21.15.22:0/3767688835 shutdown_connections 2024-08-20T01:29:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.742+0000 7fc16ef24640 1 -- 172.21.15.22:0/3767688835 wait complete. 2024-08-20T01:29:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.743+0000 7fc16ef24640 1 Processor -- start 2024-08-20T01:29:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.743+0000 7fc16ef24640 1 -- start start 2024-08-20T01:29:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.743+0000 7fc16ef24640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc168102ab0 0x7fc168198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.743+0000 7fc16ef24640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1681084c0 0x7fc1681992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.743+0000 7fc16ef24640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc168108e40 0x7fc16819e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.743+0000 7fc16ef24640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc168112ac0 con 0x7fc168108e40 2024-08-20T01:29:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.744+0000 7fc16ef24640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc168112940 con 0x7fc168102ab0 2024-08-20T01:29:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.744+0000 7fc16ef24640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc168112c40 con 0x7fc1681084c0 2024-08-20T01:29:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.744+0000 7fc16d4c1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc168108e40 0x7fc16819e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.744+0000 7fc16ccc0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc168102ab0 0x7fc168198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:53.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.744+0000 7fc16d4c1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc168108e40 0x7fc16819e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45834/0 (socket says 172.21.15.22:45834) 2024-08-20T01:29:53.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.744+0000 7fc16d4c1640 1 -- 172.21.15.22:0/3938460148 learned_addr learned my addr 172.21.15.22:0/3938460148 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:53.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.744+0000 7fc167fff640 1 --2- 172.21.15.22:0/3938460148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1681084c0 0x7fc1681992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:53.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.744+0000 7fc16ccc0640 1 -- 172.21.15.22:0/3938460148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1681084c0 msgr2=0x7fc1681992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:53.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.744+0000 7fc16ccc0640 1 --2- 172.21.15.22:0/3938460148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1681084c0 0x7fc1681992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:53.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.744+0000 7fc16ccc0640 1 -- 172.21.15.22:0/3938460148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc168108e40 msgr2=0x7fc16819e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:53.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.744+0000 7fc16ccc0640 1 --2- 172.21.15.22:0/3938460148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc168108e40 0x7fc16819e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:53.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.744+0000 7fc16ccc0640 1 -- 172.21.15.22:0/3938460148 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16819ee20 con 0x7fc168102ab0 2024-08-20T01:29:53.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.744+0000 7fc16d4c1640 1 --2- 172.21.15.22:0/3938460148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc168108e40 0x7fc16819e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:29:53.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.744+0000 7fc16ccc0640 1 --2- 172.21.15.22:0/3938460148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc168102ab0 0x7fc168198d70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00e9f0 tx=0x7fc15c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:53.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.745+0000 7fc165ffb640 1 -- 172.21.15.22:0/3938460148 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c00ccc0 con 0x7fc168102ab0 2024-08-20T01:29:53.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.745+0000 7fc16ef24640 1 -- 172.21.15.22:0/3938460148 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc16819f110 con 0x7fc168102ab0 2024-08-20T01:29:53.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.745+0000 7fc165ffb640 1 -- 172.21.15.22:0/3938460148 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc15c005020 con 0x7fc168102ab0 2024-08-20T01:29:53.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.745+0000 7fc165ffb640 1 -- 172.21.15.22:0/3938460148 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c004a00 con 0x7fc168102ab0 2024-08-20T01:29:53.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.745+0000 7fc16ef24640 1 -- 172.21.15.22:0/3938460148 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1681a57d0 con 0x7fc168102ab0 2024-08-20T01:29:53.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.746+0000 7fc16ef24640 1 -- 172.21.15.22:0/3938460148 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc1680ff530 con 0x7fc168102ab0 2024-08-20T01:29:53.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.747+0000 7fc165ffb640 1 -- 172.21.15.22:0/3938460148 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fc15c004ba0 con 0x7fc168102ab0 2024-08-20T01:29:53.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.748+0000 7fc165ffb640 1 --2- 172.21.15.22:0/3938460148 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc1580b3c60 0x7fc1580b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:53.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.748+0000 7fc167fff640 1 --2- 172.21.15.22:0/3938460148 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc1580b3c60 0x7fc1580b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:53.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.749+0000 7fc165ffb640 1 -- 172.21.15.22:0/3938460148 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fc15c0e3f10 con 0x7fc168102ab0 2024-08-20T01:29:53.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.749+0000 7fc165ffb640 1 --2- 172.21.15.22:0/3938460148 >> [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933] conn(0x7fc1580bd4b0 0x7fc1580bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:53.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.749+0000 7fc165ffb640 1 -- 172.21.15.22:0/3938460148 --> [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc15c023ea0 con 0x7fc1580bd4b0 2024-08-20T01:29:53.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.749+0000 7fc165ffb640 1 -- 172.21.15.22:0/3938460148 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fc15c0e42c0 con 0x7fc168102ab0 2024-08-20T01:29:53.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.749+0000 7fc16d4c1640 1 --2- 172.21.15.22:0/3938460148 >> [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933] conn(0x7fc1580bd4b0 0x7fc1580bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:53.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.749+0000 7fc167fff640 1 --2- 172.21.15.22:0/3938460148 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc1580b3c60 0x7fc1580b6120 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc168100d80 tx=0x7fc154005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:53.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.749+0000 7fc16d4c1640 1 --2- 172.21.15.22:0/3938460148 >> [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933] conn(0x7fc1580bd4b0 0x7fc1580bf8d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:53.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.750+0000 7fc165ffb640 1 -- 172.21.15.22:0/3938460148 <== osd.9 v2:172.21.15.22:6826/3899297933 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc15c023ea0 con 0x7fc1580bd4b0 2024-08-20T01:29:53.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.764+0000 7fc16ef24640 1 -- 172.21.15.22:0/3938460148 --> [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc168103d60 con 0x7fc1580bd4b0 2024-08-20T01:29:53.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.764+0000 7fc165ffb640 1 -- 172.21.15.22:0/3938460148 <== osd.9 v2:172.21.15.22:6826/3899297933 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc168103d60 con 0x7fc1580bd4b0 2024-08-20T01:29:53.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.764+0000 7fc16ef24640 1 -- 172.21.15.22:0/3938460148 >> [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933] conn(0x7fc1580bd4b0 msgr2=0x7fc1580bf8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:53.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.764+0000 7fc16ef24640 1 --2- 172.21.15.22:0/3938460148 >> [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933] conn(0x7fc1580bd4b0 0x7fc1580bf8d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:53.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.765+0000 7fc16ef24640 1 -- 172.21.15.22:0/3938460148 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc1580b3c60 msgr2=0x7fc1580b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:53.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.765+0000 7fc16ef24640 1 --2- 172.21.15.22:0/3938460148 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc1580b3c60 0x7fc1580b6120 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc168100d80 tx=0x7fc154005f90 comp rx=0 tx=0).stop 2024-08-20T01:29:53.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.765+0000 7fc16ef24640 1 -- 172.21.15.22:0/3938460148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc168102ab0 msgr2=0x7fc168198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:53.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.765+0000 7fc16ef24640 1 --2- 172.21.15.22:0/3938460148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc168102ab0 0x7fc168198d70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00e9f0 tx=0x7fc15c00eeb0 comp rx=0 tx=0).stop 2024-08-20T01:29:53.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.765+0000 7fc16d4c1640 1 -- 172.21.15.22:0/3938460148 reap_dead start 2024-08-20T01:29:53.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.765+0000 7fc16ef24640 1 -- 172.21.15.22:0/3938460148 shutdown_connections 2024-08-20T01:29:53.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.765+0000 7fc16ef24640 1 -- 172.21.15.22:0/3938460148 >> 172.21.15.22:0/3938460148 conn(0x7fc1680fe580 msgr2=0x7fc1680fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:53.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.765+0000 7fc16ef24640 1 -- 172.21.15.22:0/3938460148 shutdown_connections 2024-08-20T01:29:53.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:53.765+0000 7fc16ef24640 1 -- 172.21.15.22:0/3938460148 wait complete. 2024-08-20T01:29:54.095 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-08-20T01:29:54.095 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-08-20T01:29:54.095 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]} : dispatch 2024-08-20T01:29:54.095 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]} : dispatch 2024-08-20T01:29:54.095 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]} : dispatch 2024-08-20T01:29:54.095 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]} : dispatch 2024-08-20T01:29:54.096 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]} : dispatch 2024-08-20T01:29:54.096 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]} : dispatch 2024-08-20T01:29:54.096 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]} : dispatch 2024-08-20T01:29:54.096 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]} : dispatch 2024-08-20T01:29:54.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-08-20T01:29:54.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-08-20T01:29:54.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]} : dispatch 2024-08-20T01:29:54.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]} : dispatch 2024-08-20T01:29:54.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]} : dispatch 2024-08-20T01:29:54.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]} : dispatch 2024-08-20T01:29:54.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]} : dispatch 2024-08-20T01:29:54.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]} : dispatch 2024-08-20T01:29:54.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]} : dispatch 2024-08-20T01:29:54.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]} : dispatch 2024-08-20T01:29:54.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-08-20T01:29:54.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-08-20T01:29:54.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]} : dispatch 2024-08-20T01:29:54.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]} : dispatch 2024-08-20T01:29:54.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]} : dispatch 2024-08-20T01:29:54.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]} : dispatch 2024-08-20T01:29:54.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]} : dispatch 2024-08-20T01:29:54.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]} : dispatch 2024-08-20T01:29:54.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]} : dispatch 2024-08-20T01:29:54.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]} : dispatch 2024-08-20T01:29:54.399 INFO:teuthology.orchestra.run.smithi022.stdout:128849018938 2024-08-20T01:29:54.400 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-08-20T01:29:55.164 INFO:teuthology.orchestra.run.smithi022.stdout:223338299427 2024-08-20T01:29:55.164 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-08-20T01:29:55.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:55 smithi077 ceph-mon[22251]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-08-20T01:29:55.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:55 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-08-20T01:29:55.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:55 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-08-20T01:29:55.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:55 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-08-20T01:29:55.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:55 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]': finished 2024-08-20T01:29:55.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:55 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-08-20T01:29:55.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:55 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]': finished 2024-08-20T01:29:55.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:55 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-08-20T01:29:55.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:55 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2024-08-20T01:29:55.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:55 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-08-20T01:29:55.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:55 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]': finished 2024-08-20T01:29:55.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:55 smithi077 ceph-mon[22251]: osdmap e76: 12 total, 12 up, 12 in 2024-08-20T01:29:55.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:55 smithi022 ceph-mon[18709]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-08-20T01:29:55.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:55 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-08-20T01:29:55.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:55 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-08-20T01:29:55.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:55 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-08-20T01:29:55.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:55 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]': finished 2024-08-20T01:29:55.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:55 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-08-20T01:29:55.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:55 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]': finished 2024-08-20T01:29:55.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:55 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-08-20T01:29:55.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:55 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2024-08-20T01:29:55.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:55 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-08-20T01:29:55.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:55 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]': finished 2024-08-20T01:29:55.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:55 smithi022 ceph-mon[18709]: osdmap e76: 12 total, 12 up, 12 in 2024-08-20T01:29:55.466 INFO:teuthology.orchestra.run.smithi022.stdout:150323855412 2024-08-20T01:29:55.466 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-08-20T01:29:55.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:55 smithi134 ceph-mon[22511]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-08-20T01:29:55.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:55 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-08-20T01:29:55.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:55 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-08-20T01:29:55.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:55 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-08-20T01:29:55.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:55 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]': finished 2024-08-20T01:29:55.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:55 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-08-20T01:29:55.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:55 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]': finished 2024-08-20T01:29:55.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:55 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-08-20T01:29:55.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:55 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2024-08-20T01:29:55.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:55 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-08-20T01:29:55.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:55 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]': finished 2024-08-20T01:29:55.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:55 smithi134 ceph-mon[22511]: osdmap e76: 12 total, 12 up, 12 in 2024-08-20T01:29:55.885 INFO:teuthology.orchestra.run.smithi022.stdout:34359738445 2024-08-20T01:29:55.885 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-20T01:29:56.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:56 smithi022 ceph-mon[18709]: osdmap e77: 12 total, 12 up, 12 in 2024-08-20T01:29:56.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:56 smithi077 ceph-mon[22251]: osdmap e77: 12 total, 12 up, 12 in 2024-08-20T01:29:56.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:56 smithi134 ceph-mon[22511]: osdmap e77: 12 total, 12 up, 12 in 2024-08-20T01:29:56.560 INFO:teuthology.orchestra.run.smithi022.stdout:249108103200 2024-08-20T01:29:56.561 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-08-20T01:29:56.688 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:56.732 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:56.734 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:56.735 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:56.967 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:56.970 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:56.970 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:56.970 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:56.971 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:56.971 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:57.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:57 smithi022 ceph-mon[18709]: pgmap v308: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 5 op/s 2024-08-20T01:29:57.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:57 smithi077 ceph-mon[22251]: pgmap v308: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 5 op/s 2024-08-20T01:29:57.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.388+0000 7f70e630e640 1 -- 172.21.15.22:0/3356632853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70e0103870 msgr2=0x7f70e0103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:57.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.388+0000 7f70e630e640 1 --2- 172.21.15.22:0/3356632853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70e0103870 0x7f70e0103c50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009900 tx=0x7f70d002a410 comp rx=0 tx=0).stop 2024-08-20T01:29:57.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.388+0000 7f70e630e640 1 -- 172.21.15.22:0/3356632853 shutdown_connections 2024-08-20T01:29:57.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.388+0000 7f70e630e640 1 --2- 172.21.15.22:0/3356632853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70e010ce20 0x7f70e010f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:57.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.388+0000 7f70e630e640 1 --2- 172.21.15.22:0/3356632853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e0104270 0x7f70e010c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:57.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.388+0000 7f70e630e640 1 --2- 172.21.15.22:0/3356632853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70e0103870 0x7f70e0103c50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:57.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.388+0000 7f70e630e640 1 -- 172.21.15.22:0/3356632853 >> 172.21.15.22:0/3356632853 conn(0x7f70e00fd440 msgr2=0x7f70e00ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:57.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.388+0000 7f70e630e640 1 -- 172.21.15.22:0/3356632853 shutdown_connections 2024-08-20T01:29:57.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.388+0000 7f70e630e640 1 -- 172.21.15.22:0/3356632853 wait complete. 2024-08-20T01:29:57.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.388+0000 7f70e630e640 1 Processor -- start 2024-08-20T01:29:57.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.388+0000 7f70e630e640 1 -- start start 2024-08-20T01:29:57.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70e630e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e0103870 0x7f70e01016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:57.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70e630e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70e0104270 0x7f70e0101c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:57.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70e630e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70e010ce20 0x7f70e0102170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:57.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70e630e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f70e0112ae0 con 0x7f70e010ce20 2024-08-20T01:29:57.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70e630e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f70e0112960 con 0x7f70e0103870 2024-08-20T01:29:57.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70e630e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f70e0112c60 con 0x7f70e0104270 2024-08-20T01:29:57.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70e48ab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70e010ce20 0x7f70e0102170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:57.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70e48ab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70e010ce20 0x7f70e0102170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45848/0 (socket says 172.21.15.22:45848) 2024-08-20T01:29:57.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70e48ab640 1 -- 172.21.15.22:0/3805481763 learned_addr learned my addr 172.21.15.22:0/3805481763 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:57.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70dffff640 1 --2- 172.21.15.22:0/3805481763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e0103870 0x7f70e01016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:57.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70d7fff640 1 --2- 172.21.15.22:0/3805481763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70e0104270 0x7f70e0101c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:57.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70e48ab640 1 -- 172.21.15.22:0/3805481763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70e0104270 msgr2=0x7f70e0101c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:57.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70e48ab640 1 --2- 172.21.15.22:0/3805481763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70e0104270 0x7f70e0101c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:57.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70e48ab640 1 -- 172.21.15.22:0/3805481763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e0103870 msgr2=0x7f70e01016f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:57.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70e48ab640 1 --2- 172.21.15.22:0/3805481763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e0103870 0x7f70e01016f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:57.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70e48ab640 1 -- 172.21.15.22:0/3805481763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e01a7410 con 0x7f70e010ce20 2024-08-20T01:29:57.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70d7fff640 1 --2- 172.21.15.22:0/3805481763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70e0104270 0x7f70e0101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:29:57.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70dffff640 1 --2- 172.21.15.22:0/3805481763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e0103870 0x7f70e01016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:29:57.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70e48ab640 1 --2- 172.21.15.22:0/3805481763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70e010ce20 0x7f70e0102170 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f70d800b970 tx=0x7f70d800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:57.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70ddffb640 1 -- 172.21.15.22:0/3805481763 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8019070 con 0x7f70e010ce20 2024-08-20T01:29:57.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70ddffb640 1 -- 172.21.15.22:0/3805481763 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70d8014440 con 0x7f70e010ce20 2024-08-20T01:29:57.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70e630e640 1 -- 172.21.15.22:0/3805481763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e01a7700 con 0x7f70e010ce20 2024-08-20T01:29:57.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.389+0000 7f70ddffb640 1 -- 172.21.15.22:0/3805481763 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d80075d0 con 0x7f70e010ce20 2024-08-20T01:29:57.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.390+0000 7f70e630e640 1 -- 172.21.15.22:0/3805481763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e01a7cc0 con 0x7f70e010ce20 2024-08-20T01:29:57.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.391+0000 7f70e630e640 1 -- 172.21.15.22:0/3805481763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e0103c50 con 0x7f70e010ce20 2024-08-20T01:29:57.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.392+0000 7f70ddffb640 1 -- 172.21.15.22:0/3805481763 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f70d801c070 con 0x7f70e010ce20 2024-08-20T01:29:57.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.393+0000 7f70ddffb640 1 --2- 172.21.15.22:0/3805481763 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70cc0b3c60 0x7f70cc0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:57.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.393+0000 7f70dffff640 1 --2- 172.21.15.22:0/3805481763 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70cc0b3c60 0x7f70cc0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:57.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.393+0000 7f70ddffb640 1 -- 172.21.15.22:0/3805481763 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f70d80e3330 con 0x7f70e010ce20 2024-08-20T01:29:57.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.393+0000 7f70dffff640 1 --2- 172.21.15.22:0/3805481763 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70cc0b3c60 0x7f70cc0b6120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f70d0031440 tx=0x7f70d0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:57.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.397+0000 7f70ddffb640 1 -- 172.21.15.22:0/3805481763 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f70d80aa8b0 con 0x7f70e010ce20 2024-08-20T01:29:57.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:57 smithi134 ceph-mon[22511]: pgmap v308: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 5 op/s 2024-08-20T01:29:57.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.587+0000 7f70e630e640 1 -- 172.21.15.22:0/3805481763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f70e002e340 con 0x7f70e010ce20 2024-08-20T01:29:57.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.587+0000 7f70ddffb640 1 -- 172.21.15.22:0/3805481763 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f70d80aa1b0 con 0x7f70e010ce20 2024-08-20T01:29:57.588 INFO:teuthology.orchestra.run.smithi022.stdout:270582939676 2024-08-20T01:29:57.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.589+0000 7f70e630e640 1 -- 172.21.15.22:0/3805481763 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70cc0b3c60 msgr2=0x7f70cc0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:57.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.589+0000 7f70e630e640 1 --2- 172.21.15.22:0/3805481763 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70cc0b3c60 0x7f70cc0b6120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f70d0031440 tx=0x7f70d0005a20 comp rx=0 tx=0).stop 2024-08-20T01:29:57.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.589+0000 7f70e630e640 1 -- 172.21.15.22:0/3805481763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70e010ce20 msgr2=0x7f70e0102170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:57.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.589+0000 7f70e630e640 1 --2- 172.21.15.22:0/3805481763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70e010ce20 0x7f70e0102170 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f70d800b970 tx=0x7f70d800be30 comp rx=0 tx=0).stop 2024-08-20T01:29:57.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.589+0000 7f70e630e640 1 -- 172.21.15.22:0/3805481763 shutdown_connections 2024-08-20T01:29:57.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.589+0000 7f70e630e640 1 --2- 172.21.15.22:0/3805481763 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70cc0b3c60 0x7f70cc0b6120 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:57.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.589+0000 7f70e630e640 1 --2- 172.21.15.22:0/3805481763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70e010ce20 0x7f70e0102170 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:57.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.589+0000 7f70e630e640 1 --2- 172.21.15.22:0/3805481763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70e0104270 0x7f70e0101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:57.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.589+0000 7f70e630e640 1 --2- 172.21.15.22:0/3805481763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e0103870 0x7f70e01016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:57.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.589+0000 7f70e630e640 1 -- 172.21.15.22:0/3805481763 >> 172.21.15.22:0/3805481763 conn(0x7f70e00fd440 msgr2=0x7f70e00fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:57.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.589+0000 7f70e630e640 1 -- 172.21.15.22:0/3805481763 shutdown_connections 2024-08-20T01:29:57.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:57.589+0000 7f70e630e640 1 -- 172.21.15.22:0/3805481763 wait complete. 2024-08-20T01:29:58.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.069+0000 7fd281d1b640 1 -- 172.21.15.22:0/865428524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd27c107d20 msgr2=0x7fd27c10e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:58.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.069+0000 7fd281d1b640 1 --2- 172.21.15.22:0/865428524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd27c107d20 0x7fd27c10e520 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd274009ca0 tx=0x7fd27402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.070+0000 7fd281d1b640 1 -- 172.21.15.22:0/865428524 shutdown_connections 2024-08-20T01:29:58.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.070+0000 7fd281d1b640 1 --2- 172.21.15.22:0/865428524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd27c107d20 0x7fd27c10e520 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.070+0000 7fd281d1b640 1 --2- 172.21.15.22:0/865428524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd27c1073a0 0x7fd27c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.070+0000 7fd281d1b640 1 --2- 172.21.15.22:0/865428524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd27c101990 0x7fd27c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.070+0000 7fd281d1b640 1 -- 172.21.15.22:0/865428524 >> 172.21.15.22:0/865428524 conn(0x7fd27c0fd400 msgr2=0x7fd27c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:58.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.070+0000 7fd281d1b640 1 -- 172.21.15.22:0/865428524 shutdown_connections 2024-08-20T01:29:58.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.070+0000 7fd281d1b640 1 -- 172.21.15.22:0/865428524 wait complete. 2024-08-20T01:29:58.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.070+0000 7fd281d1b640 1 Processor -- start 2024-08-20T01:29:58.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.071+0000 7fd281d1b640 1 -- start start 2024-08-20T01:29:58.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.071+0000 7fd281d1b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd27c101990 0x7fd27c199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:58.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.071+0000 7fd281d1b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd27c1073a0 0x7fd27c19a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:58.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.071+0000 7fd281d1b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd27c107d20 0x7fd27c19a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:58.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.071+0000 7fd281d1b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd27c1119e0 con 0x7fd27c101990 2024-08-20T01:29:58.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.071+0000 7fd27b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd27c101990 0x7fd27c199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:58.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.071+0000 7fd281d1b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd27c111860 con 0x7fd27c107d20 2024-08-20T01:29:58.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.071+0000 7fd281d1b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd27c111b60 con 0x7fd27c1073a0 2024-08-20T01:29:58.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.071+0000 7fd27b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd27c101990 0x7fd27c199d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45874/0 (socket says 172.21.15.22:45874) 2024-08-20T01:29:58.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.071+0000 7fd27b7fe640 1 -- 172.21.15.22:0/435040257 learned_addr learned my addr 172.21.15.22:0/435040257 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:58.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.071+0000 7fd27affd640 1 --2- 172.21.15.22:0/435040257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd27c1073a0 0x7fd27c19a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:58.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.071+0000 7fd27bfff640 1 --2- 172.21.15.22:0/435040257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd27c107d20 0x7fd27c19a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:58.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.072+0000 7fd27b7fe640 1 -- 172.21.15.22:0/435040257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd27c1073a0 msgr2=0x7fd27c19a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:58.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.072+0000 7fd27b7fe640 1 --2- 172.21.15.22:0/435040257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd27c1073a0 0x7fd27c19a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.072+0000 7fd27b7fe640 1 -- 172.21.15.22:0/435040257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd27c107d20 msgr2=0x7fd27c19a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:58.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.072+0000 7fd27b7fe640 1 --2- 172.21.15.22:0/435040257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd27c107d20 0x7fd27c19a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.072+0000 7fd27b7fe640 1 -- 172.21.15.22:0/435040257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd27c1a5110 con 0x7fd27c101990 2024-08-20T01:29:58.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.072+0000 7fd27bfff640 1 --2- 172.21.15.22:0/435040257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd27c107d20 0x7fd27c19a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:29:58.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.072+0000 7fd27b7fe640 1 --2- 172.21.15.22:0/435040257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd27c101990 0x7fd27c199d10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd26c00c890 tx=0x7fd26c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:58.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.072+0000 7fd278ff9640 1 -- 172.21.15.22:0/435040257 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c004220 con 0x7fd27c101990 2024-08-20T01:29:58.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.072+0000 7fd281d1b640 1 -- 172.21.15.22:0/435040257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd27c1a5400 con 0x7fd27c101990 2024-08-20T01:29:58.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.072+0000 7fd278ff9640 1 -- 172.21.15.22:0/435040257 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd26c0043c0 con 0x7fd27c101990 2024-08-20T01:29:58.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.072+0000 7fd278ff9640 1 -- 172.21.15.22:0/435040257 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c004a00 con 0x7fd27c101990 2024-08-20T01:29:58.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.072+0000 7fd281d1b640 1 -- 172.21.15.22:0/435040257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd27c1a5940 con 0x7fd27c101990 2024-08-20T01:29:58.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.073+0000 7fd281d1b640 1 -- 172.21.15.22:0/435040257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd27c101d70 con 0x7fd27c101990 2024-08-20T01:29:58.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.075+0000 7fd278ff9640 1 -- 172.21.15.22:0/435040257 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fd26c0079b0 con 0x7fd27c101990 2024-08-20T01:29:58.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.076+0000 7fd278ff9640 1 --2- 172.21.15.22:0/435040257 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd2640b3c60 0x7fd2640b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:58.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.076+0000 7fd278ff9640 1 -- 172.21.15.22:0/435040257 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7fd26c0e3f10 con 0x7fd27c101990 2024-08-20T01:29:58.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.076+0000 7fd27affd640 1 --2- 172.21.15.22:0/435040257 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd2640b3c60 0x7fd2640b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:58.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.077+0000 7fd27affd640 1 --2- 172.21.15.22:0/435040257 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd2640b3c60 0x7fd2640b6120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd27c06b3d0 tx=0x7fd270005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:58.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.079+0000 7fd278ff9640 1 -- 172.21.15.22:0/435040257 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd26c014030 con 0x7fd27c101990 2024-08-20T01:29:58.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.269+0000 7fd281d1b640 1 -- 172.21.15.22:0/435040257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd27c06abe0 con 0x7fd27c101990 2024-08-20T01:29:58.270 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:58 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3805481763' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-20T01:29:58.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.270+0000 7fd278ff9640 1 -- 172.21.15.22:0/435040257 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd27c06abe0 con 0x7fd27c101990 2024-08-20T01:29:58.271 INFO:teuthology.orchestra.run.smithi022.stdout:103079215167 2024-08-20T01:29:58.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.272+0000 7fd281d1b640 1 -- 172.21.15.22:0/435040257 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd2640b3c60 msgr2=0x7fd2640b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:58.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.272+0000 7fd281d1b640 1 --2- 172.21.15.22:0/435040257 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd2640b3c60 0x7fd2640b6120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd27c06b3d0 tx=0x7fd270005f90 comp rx=0 tx=0).stop 2024-08-20T01:29:58.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.272+0000 7fd281d1b640 1 -- 172.21.15.22:0/435040257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd27c101990 msgr2=0x7fd27c199d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:58.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.272+0000 7fd281d1b640 1 --2- 172.21.15.22:0/435040257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd27c101990 0x7fd27c199d10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd26c00c890 tx=0x7fd26c00cd50 comp rx=0 tx=0).stop 2024-08-20T01:29:58.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.272+0000 7fd281d1b640 1 -- 172.21.15.22:0/435040257 shutdown_connections 2024-08-20T01:29:58.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.272+0000 7fd281d1b640 1 --2- 172.21.15.22:0/435040257 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd2640b3c60 0x7fd2640b6120 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.272+0000 7fd281d1b640 1 --2- 172.21.15.22:0/435040257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd27c107d20 0x7fd27c19a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.272+0000 7fd281d1b640 1 --2- 172.21.15.22:0/435040257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd27c1073a0 0x7fd27c19a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.272+0000 7fd281d1b640 1 --2- 172.21.15.22:0/435040257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd27c101990 0x7fd27c199d10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.272+0000 7fd281d1b640 1 -- 172.21.15.22:0/435040257 >> 172.21.15.22:0/435040257 conn(0x7fd27c0fd400 msgr2=0x7fd27c0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:58.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.272+0000 7fd281d1b640 1 -- 172.21.15.22:0/435040257 shutdown_connections 2024-08-20T01:29:58.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.272+0000 7fd281d1b640 1 -- 172.21.15.22:0/435040257 wait complete. 2024-08-20T01:29:58.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:58 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3805481763' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-20T01:29:58.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:58 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3805481763' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-20T01:29:58.526 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939674 got 270582939676 for osd.10 2024-08-20T01:29:58.527 DEBUG:teuthology.parallel:result is None 2024-08-20T01:29:58.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.673+0000 7f1886c15640 1 -- 172.21.15.22:0/3412599992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1880108e60 msgr2=0x7f188010f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:58.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.673+0000 7f1886c15640 1 --2- 172.21.15.22:0/3412599992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1880108e60 0x7f188010f660 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1878009ca0 tx=0x7f187802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.673+0000 7f1886c15640 1 -- 172.21.15.22:0/3412599992 shutdown_connections 2024-08-20T01:29:58.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.673+0000 7f1886c15640 1 --2- 172.21.15.22:0/3412599992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1880108e60 0x7f188010f660 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.673+0000 7f1886c15640 1 --2- 172.21.15.22:0/3412599992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18801084e0 0x7f1880108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.673+0000 7f1886c15640 1 --2- 172.21.15.22:0/3412599992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1880102ad0 0x7f1880102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.673+0000 7f1886c15640 1 -- 172.21.15.22:0/3412599992 >> 172.21.15.22:0/3412599992 conn(0x7f18800fe540 msgr2=0x7f1880100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:58.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.673+0000 7f1886c15640 1 -- 172.21.15.22:0/3412599992 shutdown_connections 2024-08-20T01:29:58.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.673+0000 7f1886c15640 1 -- 172.21.15.22:0/3412599992 wait complete. 2024-08-20T01:29:58.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.674+0000 7f1886c15640 1 Processor -- start 2024-08-20T01:29:58.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.674+0000 7f1886c15640 1 -- start start 2024-08-20T01:29:58.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.674+0000 7f1886c15640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1880102ad0 0x7f1880198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:58.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.674+0000 7f1886c15640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18801084e0 0x7f18801993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:58.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.674+0000 7f1886c15640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1880108e60 0x7f188019e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:58.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.674+0000 7f1886c15640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1880112b20 con 0x7f18801084e0 2024-08-20T01:29:58.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.674+0000 7f1886c15640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f18801129a0 con 0x7f1880102ad0 2024-08-20T01:29:58.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.674+0000 7f1886c15640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1880112ca0 con 0x7f1880108e60 2024-08-20T01:29:58.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.674+0000 7f187ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18801084e0 0x7f18801993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:58.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.674+0000 7f187ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18801084e0 0x7f18801993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45896/0 (socket says 172.21.15.22:45896) 2024-08-20T01:29:58.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.674+0000 7f187ffff640 1 -- 172.21.15.22:0/3449621070 learned_addr learned my addr 172.21.15.22:0/3449621070 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:29:58.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.674+0000 7f18851b2640 1 --2- 172.21.15.22:0/3449621070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1880108e60 0x7f188019e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:58.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.674+0000 7f18849b1640 1 --2- 172.21.15.22:0/3449621070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1880102ad0 0x7f1880198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:58.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.675+0000 7f187ffff640 1 -- 172.21.15.22:0/3449621070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1880108e60 msgr2=0x7f188019e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:58.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.675+0000 7f187ffff640 1 --2- 172.21.15.22:0/3449621070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1880108e60 0x7f188019e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.675+0000 7f187ffff640 1 -- 172.21.15.22:0/3449621070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1880102ad0 msgr2=0x7f1880198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:58.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.675+0000 7f187ffff640 1 --2- 172.21.15.22:0/3449621070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1880102ad0 0x7f1880198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.675+0000 7f187ffff640 1 -- 172.21.15.22:0/3449621070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188019ef60 con 0x7f18801084e0 2024-08-20T01:29:58.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.675+0000 7f18849b1640 1 --2- 172.21.15.22:0/3449621070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1880102ad0 0x7f1880198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:29:58.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.675+0000 7f187ffff640 1 --2- 172.21.15.22:0/3449621070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18801084e0 0x7f18801993f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f186c00c920 tx=0x7f186c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:58.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.675+0000 7f187dffb640 1 -- 172.21.15.22:0/3449621070 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c007c70 con 0x7f18801084e0 2024-08-20T01:29:58.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.675+0000 7f1886c15640 1 -- 172.21.15.22:0/3449621070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188019f250 con 0x7f18801084e0 2024-08-20T01:29:58.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.675+0000 7f187dffb640 1 -- 172.21.15.22:0/3449621070 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f186c007e10 con 0x7f18801084e0 2024-08-20T01:29:58.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.675+0000 7f187dffb640 1 -- 172.21.15.22:0/3449621070 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c018820 con 0x7f18801084e0 2024-08-20T01:29:58.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.675+0000 7f1886c15640 1 -- 172.21.15.22:0/3449621070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18801a5ae0 con 0x7f18801084e0 2024-08-20T01:29:58.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.676+0000 7f1886c15640 1 -- 172.21.15.22:0/3449621070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1880102eb0 con 0x7f18801084e0 2024-08-20T01:29:58.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.678+0000 7f187dffb640 1 -- 172.21.15.22:0/3449621070 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f186c00f450 con 0x7f18801084e0 2024-08-20T01:29:58.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.679+0000 7f187dffb640 1 --2- 172.21.15.22:0/3449621070 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18700b3c60 0x7f18700b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:58.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.679+0000 7f18849b1640 1 --2- 172.21.15.22:0/3449621070 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18700b3c60 0x7f18700b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:58.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.679+0000 7f187dffb640 1 -- 172.21.15.22:0/3449621070 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f186c0e4180 con 0x7f18801084e0 2024-08-20T01:29:58.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.680+0000 7f18849b1640 1 --2- 172.21.15.22:0/3449621070 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18700b3c60 0x7f18700b6120 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f18740058c0 tx=0x7f1874005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:58.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.682+0000 7f187dffb640 1 -- 172.21.15.22:0/3449621070 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f186c014030 con 0x7f18801084e0 2024-08-20T01:29:58.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.870+0000 7f1886c15640 1 -- 172.21.15.22:0/3449621070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f18801a5cb0 con 0x7f18801084e0 2024-08-20T01:29:58.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.870+0000 7f187dffb640 1 -- 172.21.15.22:0/3449621070 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f186c0ab6e0 con 0x7f18801084e0 2024-08-20T01:29:58.871 INFO:teuthology.orchestra.run.smithi022.stdout:296352743448 2024-08-20T01:29:58.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.872+0000 7f1886c15640 1 -- 172.21.15.22:0/3449621070 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18700b3c60 msgr2=0x7f18700b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:58.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.872+0000 7f1886c15640 1 --2- 172.21.15.22:0/3449621070 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18700b3c60 0x7f18700b6120 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f18740058c0 tx=0x7f1874005850 comp rx=0 tx=0).stop 2024-08-20T01:29:58.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.872+0000 7f1886c15640 1 -- 172.21.15.22:0/3449621070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18801084e0 msgr2=0x7f18801993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:58.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.872+0000 7f1886c15640 1 --2- 172.21.15.22:0/3449621070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18801084e0 0x7f18801993f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f186c00c920 tx=0x7f186c00cde0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.872+0000 7f1886c15640 1 -- 172.21.15.22:0/3449621070 shutdown_connections 2024-08-20T01:29:58.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.872+0000 7f1886c15640 1 --2- 172.21.15.22:0/3449621070 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18700b3c60 0x7f18700b6120 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.872+0000 7f1886c15640 1 --2- 172.21.15.22:0/3449621070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1880108e60 0x7f188019e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.872+0000 7f1886c15640 1 --2- 172.21.15.22:0/3449621070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18801084e0 0x7f18801993f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.872+0000 7f1886c15640 1 --2- 172.21.15.22:0/3449621070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1880102ad0 0x7f1880198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.872+0000 7f1886c15640 1 -- 172.21.15.22:0/3449621070 >> 172.21.15.22:0/3449621070 conn(0x7f18800fe540 msgr2=0x7f1880100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.872+0000 7f1886c15640 1 -- 172.21.15.22:0/3449621070 shutdown_connections 2024-08-20T01:29:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:29:58.872+0000 7f1886c15640 1 -- 172.21.15.22:0/3449621070 wait complete. 2024-08-20T01:29:59.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:59 smithi022 ceph-mon[18709]: pgmap v309: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 7.3 KiB/s, 0 keys/s, 0 objects/s recovering 2024-08-20T01:29:59.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:59 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/435040257' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-20T01:29:59.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:29:59 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3449621070' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-20T01:29:59.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:59 smithi077 ceph-mon[22251]: pgmap v309: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 7.3 KiB/s, 0 keys/s, 0 objects/s recovering 2024-08-20T01:29:59.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:59 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/435040257' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-20T01:29:59.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:29:59 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3449621070' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-20T01:29:59.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:59 smithi134 ceph-mon[22511]: pgmap v309: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 7.3 KiB/s, 0 keys/s, 0 objects/s recovering 2024-08-20T01:29:59.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:59 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/435040257' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-20T01:29:59.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:29:59 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3449621070' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-20T01:30:00.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.183+0000 7f53d518a640 1 -- 172.21.15.22:0/2283330172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53d0101990 msgr2=0x7f53d0101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:00.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.183+0000 7f53d518a640 1 --2- 172.21.15.22:0/2283330172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53d0101990 0x7f53d0101d70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009900 tx=0x7f53c002a410 comp rx=0 tx=0).stop 2024-08-20T01:30:00.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.183+0000 7f53d518a640 1 -- 172.21.15.22:0/2283330172 shutdown_connections 2024-08-20T01:30:00.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.183+0000 7f53d518a640 1 --2- 172.21.15.22:0/2283330172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53d0107d20 0x7f53d010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:00.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.183+0000 7f53d518a640 1 --2- 172.21.15.22:0/2283330172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53d01073a0 0x7f53d01077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:00.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.183+0000 7f53d518a640 1 --2- 172.21.15.22:0/2283330172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53d0101990 0x7f53d0101d70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:00.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.183+0000 7f53d518a640 1 -- 172.21.15.22:0/2283330172 >> 172.21.15.22:0/2283330172 conn(0x7f53d00fd400 msgr2=0x7f53d00ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:00.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.183+0000 7f53d518a640 1 -- 172.21.15.22:0/2283330172 shutdown_connections 2024-08-20T01:30:00.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.183+0000 7f53d518a640 1 -- 172.21.15.22:0/2283330172 wait complete. 2024-08-20T01:30:00.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.184+0000 7f53d518a640 1 Processor -- start 2024-08-20T01:30:00.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.184+0000 7f53d518a640 1 -- start start 2024-08-20T01:30:00.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.185+0000 7f53d518a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53d0101990 0x7f53d0198ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:00.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.185+0000 7f53d518a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53d01073a0 0x7f53d0199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:00.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.185+0000 7f53d518a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53d0107d20 0x7f53d019e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:00.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.185+0000 7f53d518a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f53d01119a0 con 0x7f53d0107d20 2024-08-20T01:30:00.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.185+0000 7f53d518a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f53d0111820 con 0x7f53d01073a0 2024-08-20T01:30:00.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.185+0000 7f53d518a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f53d0111b20 con 0x7f53d0101990 2024-08-20T01:30:00.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.185+0000 7f53ce59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53d01073a0 0x7f53d0199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:00.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.185+0000 7f53cf59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53d0107d20 0x7f53d019e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:00.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.185+0000 7f53ce59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53d01073a0 0x7f53d0199530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:54898/0 (socket says 172.21.15.22:54898) 2024-08-20T01:30:00.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.185+0000 7f53ce59c640 1 -- 172.21.15.22:0/5290072 learned_addr learned my addr 172.21.15.22:0/5290072 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:00.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.185+0000 7f53ced9d640 1 --2- 172.21.15.22:0/5290072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53d0101990 0x7f53d0198ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:00.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.185+0000 7f53ce59c640 1 -- 172.21.15.22:0/5290072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53d0101990 msgr2=0x7f53d0198ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:00.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.185+0000 7f53ce59c640 1 --2- 172.21.15.22:0/5290072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53d0101990 0x7f53d0198ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:00.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.185+0000 7f53ce59c640 1 -- 172.21.15.22:0/5290072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53d0107d20 msgr2=0x7f53d019e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:00.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.185+0000 7f53ce59c640 1 --2- 172.21.15.22:0/5290072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53d0107d20 0x7f53d019e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:00.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.185+0000 7f53ce59c640 1 -- 172.21.15.22:0/5290072 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d019f0a0 con 0x7f53d01073a0 2024-08-20T01:30:00.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.186+0000 7f53ce59c640 1 --2- 172.21.15.22:0/5290072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53d01073a0 0x7f53d0199530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f53c400e9f0 tx=0x7f53c400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:00.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.186+0000 7f53b7fff640 1 -- 172.21.15.22:0/5290072 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c400cd80 con 0x7f53d01073a0 2024-08-20T01:30:00.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.186+0000 7f53b7fff640 1 -- 172.21.15.22:0/5290072 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53c40108e0 con 0x7f53d01073a0 2024-08-20T01:30:00.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.186+0000 7f53d518a640 1 -- 172.21.15.22:0/5290072 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d019f390 con 0x7f53d01073a0 2024-08-20T01:30:00.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.186+0000 7f53b7fff640 1 -- 172.21.15.22:0/5290072 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4018980 con 0x7f53d01073a0 2024-08-20T01:30:00.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.186+0000 7f53d518a640 1 -- 172.21.15.22:0/5290072 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d01a5c20 con 0x7f53d01073a0 2024-08-20T01:30:00.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.187+0000 7f53d518a640 1 -- 172.21.15.22:0/5290072 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d0102c40 con 0x7f53d01073a0 2024-08-20T01:30:00.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.188+0000 7f53b7fff640 1 -- 172.21.15.22:0/5290072 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f53c4010430 con 0x7f53d01073a0 2024-08-20T01:30:00.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.189+0000 7f53b7fff640 1 --2- 172.21.15.22:0/5290072 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53b80b3ce0 0x7f53b80b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:00.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.189+0000 7f53ced9d640 1 --2- 172.21.15.22:0/5290072 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53b80b3ce0 0x7f53b80b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:00.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.189+0000 7f53b7fff640 1 -- 172.21.15.22:0/5290072 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f53c40e4290 con 0x7f53d01073a0 2024-08-20T01:30:00.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.190+0000 7f53ced9d640 1 --2- 172.21.15.22:0/5290072 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53b80b3ce0 0x7f53b80b61a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f53c0031440 tx=0x7f53c0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:00.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.196+0000 7f53b7fff640 1 -- 172.21.15.22:0/5290072 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f53c40ab1a0 con 0x7f53d01073a0 2024-08-20T01:30:00.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:00 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:30:00.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:00 smithi077 ceph-mon[22251]: overall HEALTH_OK 2024-08-20T01:30:00.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.382+0000 7f53d518a640 1 -- 172.21.15.22:0/5290072 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f53d010ab10 con 0x7f53d01073a0 2024-08-20T01:30:00.383 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:00 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:30:00.383 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:00 smithi022 ceph-mon[18709]: overall HEALTH_OK 2024-08-20T01:30:00.383 INFO:teuthology.orchestra.run.smithi022.stdout:34359738447 2024-08-20T01:30:00.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.382+0000 7f53b7fff640 1 -- 172.21.15.22:0/5290072 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f53c40af6f0 con 0x7f53d01073a0 2024-08-20T01:30:00.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.385+0000 7f53d518a640 1 -- 172.21.15.22:0/5290072 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53b80b3ce0 msgr2=0x7f53b80b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:00.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.385+0000 7f53d518a640 1 --2- 172.21.15.22:0/5290072 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53b80b3ce0 0x7f53b80b61a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f53c0031440 tx=0x7f53c0005b50 comp rx=0 tx=0).stop 2024-08-20T01:30:00.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.385+0000 7f53d518a640 1 -- 172.21.15.22:0/5290072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53d01073a0 msgr2=0x7f53d0199530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:00.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.385+0000 7f53d518a640 1 --2- 172.21.15.22:0/5290072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53d01073a0 0x7f53d0199530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f53c400e9f0 tx=0x7f53c400eeb0 comp rx=0 tx=0).stop 2024-08-20T01:30:00.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.385+0000 7f53d518a640 1 -- 172.21.15.22:0/5290072 shutdown_connections 2024-08-20T01:30:00.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.385+0000 7f53d518a640 1 --2- 172.21.15.22:0/5290072 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53b80b3ce0 0x7f53b80b61a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:00.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.385+0000 7f53d518a640 1 --2- 172.21.15.22:0/5290072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53d0107d20 0x7f53d019e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:00.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.385+0000 7f53d518a640 1 --2- 172.21.15.22:0/5290072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53d01073a0 0x7f53d0199530 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:00.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.385+0000 7f53d518a640 1 --2- 172.21.15.22:0/5290072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53d0101990 0x7f53d0198ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:00.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.385+0000 7f53d518a640 1 -- 172.21.15.22:0/5290072 >> 172.21.15.22:0/5290072 conn(0x7f53d00fd400 msgr2=0x7f53d006ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:00.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.386+0000 7f53d518a640 1 -- 172.21.15.22:0/5290072 shutdown_connections 2024-08-20T01:30:00.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:00.386+0000 7f53d518a640 1 -- 172.21.15.22:0/5290072 wait complete. 2024-08-20T01:30:00.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:00 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:30:00.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:00 smithi134 ceph-mon[22511]: overall HEALTH_OK 2024-08-20T01:30:01.025 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743445 got 296352743448 for osd.11 2024-08-20T01:30:01.026 DEBUG:teuthology.parallel:result is None 2024-08-20T01:30:01.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:01 smithi077 ceph-mon[22251]: pgmap v310: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s; 7.3 KiB/s, 0 keys/s, 0 objects/s recovering 2024-08-20T01:30:01.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:01 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/5290072' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-20T01:30:01.320 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:01.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:01 smithi022 ceph-mon[18709]: pgmap v310: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s; 7.3 KiB/s, 0 keys/s, 0 objects/s recovering 2024-08-20T01:30:01.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:01 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/5290072' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-20T01:30:01.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:01 smithi134 ceph-mon[22511]: pgmap v310: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s; 7.3 KiB/s, 0 keys/s, 0 objects/s recovering 2024-08-20T01:30:01.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:01 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/5290072' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-20T01:30:01.738 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215165 got 103079215167 for osd.3 2024-08-20T01:30:01.738 DEBUG:teuthology.parallel:result is None 2024-08-20T01:30:02.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.115+0000 7f7a5bbce640 1 -- 172.21.15.22:0/2376652378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54102ab0 msgr2=0x7f7a54102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:02.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.115+0000 7f7a5bbce640 1 --2- 172.21.15.22:0/2376652378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54102ab0 0x7f7a54102e90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7a50009900 tx=0x7f7a5002a410 comp rx=0 tx=0).stop 2024-08-20T01:30:02.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.115+0000 7f7a5bbce640 1 -- 172.21.15.22:0/2376652378 shutdown_connections 2024-08-20T01:30:02.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.115+0000 7f7a5bbce640 1 --2- 172.21.15.22:0/2376652378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a54108e40 0x7f7a5410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:02.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.115+0000 7f7a5bbce640 1 --2- 172.21.15.22:0/2376652378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a541084c0 0x7f7a54108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:02.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.115+0000 7f7a5bbce640 1 --2- 172.21.15.22:0/2376652378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54102ab0 0x7f7a54102e90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:02.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.115+0000 7f7a5bbce640 1 -- 172.21.15.22:0/2376652378 >> 172.21.15.22:0/2376652378 conn(0x7f7a540fe500 msgr2=0x7f7a54100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:02.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.115+0000 7f7a5bbce640 1 -- 172.21.15.22:0/2376652378 shutdown_connections 2024-08-20T01:30:02.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.115+0000 7f7a5bbce640 1 -- 172.21.15.22:0/2376652378 wait complete. 2024-08-20T01:30:02.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.115+0000 7f7a5bbce640 1 Processor -- start 2024-08-20T01:30:02.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a5bbce640 1 -- start start 2024-08-20T01:30:02.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a5bbce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a54102ab0 0x7f7a54199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:02.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a5bbce640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a541084c0 0x7f7a54199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:02.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a5bbce640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54108e40 0x7f7a5419ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:02.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a5bbce640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7a54112b40 con 0x7f7a54108e40 2024-08-20T01:30:02.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a5bbce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7a541129c0 con 0x7f7a54102ab0 2024-08-20T01:30:02.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a5bbce640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7a54112cc0 con 0x7f7a541084c0 2024-08-20T01:30:02.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a5a16b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54108e40 0x7f7a5419ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:02.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a5a16b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54108e40 0x7f7a5419ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37380/0 (socket says 172.21.15.22:37380) 2024-08-20T01:30:02.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a5a16b640 1 -- 172.21.15.22:0/1148999624 learned_addr learned my addr 172.21.15.22:0/1148999624 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:02.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a5996a640 1 --2- 172.21.15.22:0/1148999624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a54102ab0 0x7f7a54199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:02.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a59169640 1 --2- 172.21.15.22:0/1148999624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a541084c0 0x7f7a54199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:02.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a5a16b640 1 -- 172.21.15.22:0/1148999624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a541084c0 msgr2=0x7f7a54199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:02.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a5a16b640 1 --2- 172.21.15.22:0/1148999624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a541084c0 0x7f7a54199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:02.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a5a16b640 1 -- 172.21.15.22:0/1148999624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a54102ab0 msgr2=0x7f7a54199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:02.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a5a16b640 1 --2- 172.21.15.22:0/1148999624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a54102ab0 0x7f7a54199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:02.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a5a16b640 1 -- 172.21.15.22:0/1148999624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a5419f200 con 0x7f7a54108e40 2024-08-20T01:30:02.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a59169640 1 --2- 172.21.15.22:0/1148999624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a541084c0 0x7f7a54199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:02.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a5a16b640 1 --2- 172.21.15.22:0/1148999624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54108e40 0x7f7a5419ea30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00b970 tx=0x7f7a4c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:02.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.116+0000 7f7a4affd640 1 -- 172.21.15.22:0/1148999624 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c019070 con 0x7f7a54108e40 2024-08-20T01:30:02.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.117+0000 7f7a4affd640 1 -- 172.21.15.22:0/1148999624 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a4c014440 con 0x7f7a54108e40 2024-08-20T01:30:02.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.117+0000 7f7a5bbce640 1 -- 172.21.15.22:0/1148999624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a5419f4f0 con 0x7f7a54108e40 2024-08-20T01:30:02.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.117+0000 7f7a4affd640 1 -- 172.21.15.22:0/1148999624 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c0075d0 con 0x7f7a54108e40 2024-08-20T01:30:02.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.117+0000 7f7a5bbce640 1 -- 172.21.15.22:0/1148999624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a541a5bb0 con 0x7f7a54108e40 2024-08-20T01:30:02.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.117+0000 7f7a5bbce640 1 -- 172.21.15.22:0/1148999624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a54102f10 con 0x7f7a54108e40 2024-08-20T01:30:02.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.119+0000 7f7a4affd640 1 -- 172.21.15.22:0/1148999624 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f7a4c01c070 con 0x7f7a54108e40 2024-08-20T01:30:02.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.120+0000 7f7a4affd640 1 --2- 172.21.15.22:0/1148999624 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f7a400b3ce0 0x7f7a400b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:02.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.120+0000 7f7a5996a640 1 --2- 172.21.15.22:0/1148999624 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f7a400b3ce0 0x7f7a400b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:02.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.120+0000 7f7a4affd640 1 -- 172.21.15.22:0/1148999624 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f7a4c0e36c0 con 0x7f7a54108e40 2024-08-20T01:30:02.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.120+0000 7f7a5996a640 1 --2- 172.21.15.22:0/1148999624 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f7a400b3ce0 0x7f7a400b61a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7a50031440 tx=0x7f7a50005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:02.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.123+0000 7f7a4affd640 1 -- 172.21.15.22:0/1148999624 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f7a4c0aa650 con 0x7f7a54108e40 2024-08-20T01:30:02.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.312+0000 7f7a5bbce640 1 -- 172.21.15.22:0/1148999624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7a5419a280 con 0x7f7a54108e40 2024-08-20T01:30:02.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:02 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2381184012' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-20T01:30:02.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:02 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:02.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:02 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:02.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:02 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:02.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:02 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:02.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.312+0000 7f7a4affd640 1 -- 172.21.15.22:0/1148999624 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7a5419a280 con 0x7f7a54108e40 2024-08-20T01:30:02.314 INFO:teuthology.orchestra.run.smithi022.stdout:150323855415 2024-08-20T01:30:02.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:02 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2381184012' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-20T01:30:02.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:02 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:02.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:02 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:02.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:02 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:02.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:02 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:02.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.314+0000 7f7a5bbce640 1 -- 172.21.15.22:0/1148999624 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f7a400b3ce0 msgr2=0x7f7a400b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.314+0000 7f7a5bbce640 1 --2- 172.21.15.22:0/1148999624 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f7a400b3ce0 0x7f7a400b61a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7a50031440 tx=0x7f7a50005e80 comp rx=0 tx=0).stop 2024-08-20T01:30:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.314+0000 7f7a5bbce640 1 -- 172.21.15.22:0/1148999624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54108e40 msgr2=0x7f7a5419ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.314+0000 7f7a5bbce640 1 --2- 172.21.15.22:0/1148999624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54108e40 0x7f7a5419ea30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00b970 tx=0x7f7a4c00be30 comp rx=0 tx=0).stop 2024-08-20T01:30:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.314+0000 7f7a5bbce640 1 -- 172.21.15.22:0/1148999624 shutdown_connections 2024-08-20T01:30:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.314+0000 7f7a5bbce640 1 --2- 172.21.15.22:0/1148999624 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f7a400b3ce0 0x7f7a400b61a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.314+0000 7f7a5bbce640 1 --2- 172.21.15.22:0/1148999624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54108e40 0x7f7a5419ea30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.314+0000 7f7a5bbce640 1 --2- 172.21.15.22:0/1148999624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a541084c0 0x7f7a54199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.314+0000 7f7a5bbce640 1 --2- 172.21.15.22:0/1148999624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a54102ab0 0x7f7a54199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.314+0000 7f7a5bbce640 1 -- 172.21.15.22:0/1148999624 >> 172.21.15.22:0/1148999624 conn(0x7f7a540fe500 msgr2=0x7f7a541008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.315+0000 7f7a5bbce640 1 -- 172.21.15.22:0/1148999624 shutdown_connections 2024-08-20T01:30:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.315+0000 7f7a5bbce640 1 -- 172.21.15.22:0/1148999624 wait complete. 2024-08-20T01:30:02.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:02 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2381184012' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-20T01:30:02.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:02 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:02.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:02 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:02.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:02 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:02.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:02 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:02.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.675+0000 7f58502a9640 1 -- 172.21.15.22:0/3522568920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58481084c0 msgr2=0x7f5848108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:02.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.675+0000 7f58502a9640 1 --2- 172.21.15.22:0/3522568920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58481084c0 0x7f5848108900 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5838009900 tx=0x7f583802a3f0 comp rx=0 tx=0).stop 2024-08-20T01:30:02.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.675+0000 7f58502a9640 1 -- 172.21.15.22:0/3522568920 shutdown_connections 2024-08-20T01:30:02.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.675+0000 7f58502a9640 1 --2- 172.21.15.22:0/3522568920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5848108e40 0x7f584810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:02.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.675+0000 7f58502a9640 1 --2- 172.21.15.22:0/3522568920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58481084c0 0x7f5848108900 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:02.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.675+0000 7f58502a9640 1 --2- 172.21.15.22:0/3522568920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5848102ab0 0x7f5848102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:02.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.675+0000 7f58502a9640 1 -- 172.21.15.22:0/3522568920 >> 172.21.15.22:0/3522568920 conn(0x7f58480fe580 msgr2=0x7f58481009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:02.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.675+0000 7f58502a9640 1 -- 172.21.15.22:0/3522568920 shutdown_connections 2024-08-20T01:30:02.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.675+0000 7f58502a9640 1 -- 172.21.15.22:0/3522568920 wait complete. 2024-08-20T01:30:02.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.676+0000 7f58502a9640 1 Processor -- start 2024-08-20T01:30:02.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.676+0000 7f58502a9640 1 -- start start 2024-08-20T01:30:02.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.676+0000 7f58502a9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5848102ab0 0x7f58480751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:02.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.676+0000 7f58502a9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58481084c0 0x7f5848075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:02.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.676+0000 7f58502a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5848108e40 0x7f5848075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:02.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.676+0000 7f58502a9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5848112b50 con 0x7f58481084c0 2024-08-20T01:30:02.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.676+0000 7f58502a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f58481129d0 con 0x7f5848108e40 2024-08-20T01:30:02.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.676+0000 7f58502a9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5848112cd0 con 0x7f5848102ab0 2024-08-20T01:30:02.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.677+0000 7f584e045640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5848102ab0 0x7f58480751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:02.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.677+0000 7f584e045640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5848102ab0 0x7f58480751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:35212/0 (socket says 172.21.15.22:35212) 2024-08-20T01:30:02.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.677+0000 7f584e045640 1 -- 172.21.15.22:0/466386839 learned_addr learned my addr 172.21.15.22:0/466386839 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:02.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.677+0000 7f584d844640 1 --2- 172.21.15.22:0/466386839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58481084c0 0x7f5848075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:02.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.677+0000 7f584e846640 1 --2- 172.21.15.22:0/466386839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5848108e40 0x7f5848075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:02.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.677+0000 7f584e045640 1 -- 172.21.15.22:0/466386839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5848108e40 msgr2=0x7f5848075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:02.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.677+0000 7f584e045640 1 --2- 172.21.15.22:0/466386839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5848108e40 0x7f5848075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:02.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.677+0000 7f584e045640 1 -- 172.21.15.22:0/466386839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58481084c0 msgr2=0x7f5848075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:02.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.677+0000 7f584e045640 1 --2- 172.21.15.22:0/466386839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58481084c0 0x7f5848075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:02.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.677+0000 7f584e045640 1 -- 172.21.15.22:0/466386839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58481a73c0 con 0x7f5848102ab0 2024-08-20T01:30:02.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.677+0000 7f584e846640 1 --2- 172.21.15.22:0/466386839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5848108e40 0x7f5848075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:02.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.677+0000 7f584e045640 1 --2- 172.21.15.22:0/466386839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5848102ab0 0x7f58480751d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f584400b4a0 tx=0x7f584400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:02.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.678+0000 7f583f7fe640 1 -- 172.21.15.22:0/466386839 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844014070 con 0x7f5848102ab0 2024-08-20T01:30:02.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.678+0000 7f58502a9640 1 -- 172.21.15.22:0/466386839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58481a76b0 con 0x7f5848102ab0 2024-08-20T01:30:02.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.678+0000 7f583f7fe640 1 -- 172.21.15.22:0/466386839 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5844010ac0 con 0x7f5848102ab0 2024-08-20T01:30:02.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.678+0000 7f583f7fe640 1 -- 172.21.15.22:0/466386839 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844017c30 con 0x7f5848102ab0 2024-08-20T01:30:02.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.678+0000 7f58502a9640 1 -- 172.21.15.22:0/466386839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58481a7c90 con 0x7f5848102ab0 2024-08-20T01:30:02.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.679+0000 7f58502a9640 1 -- 172.21.15.22:0/466386839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5848102e90 con 0x7f5848102ab0 2024-08-20T01:30:02.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.680+0000 7f583f7fe640 1 -- 172.21.15.22:0/466386839 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f5844017070 con 0x7f5848102ab0 2024-08-20T01:30:02.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.681+0000 7f583f7fe640 1 --2- 172.21.15.22:0/466386839 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f58340b3ce0 0x7f58340b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:02.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.681+0000 7f584d844640 1 --2- 172.21.15.22:0/466386839 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f58340b3ce0 0x7f58340b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:02.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.681+0000 7f583f7fe640 1 -- 172.21.15.22:0/466386839 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f58440e3360 con 0x7f5848102ab0 2024-08-20T01:30:02.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.682+0000 7f584d844640 1 --2- 172.21.15.22:0/466386839 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f58340b3ce0 0x7f58340b61a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5838005ab0 tx=0x7f5838005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:02.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.684+0000 7f583f7fe640 1 -- 172.21.15.22:0/466386839 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f58440aa8e0 con 0x7f5848102ab0 2024-08-20T01:30:02.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.872+0000 7f58502a9640 1 -- 172.21.15.22:0/466386839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f58481a80b0 con 0x7f5848102ab0 2024-08-20T01:30:02.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.873+0000 7f583f7fe640 1 -- 172.21.15.22:0/466386839 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f58440aa1e0 con 0x7f5848102ab0 2024-08-20T01:30:02.875 INFO:teuthology.orchestra.run.smithi022.stdout:223338299430 2024-08-20T01:30:02.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.875+0000 7f58502a9640 1 -- 172.21.15.22:0/466386839 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f58340b3ce0 msgr2=0x7f58340b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:02.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.875+0000 7f58502a9640 1 --2- 172.21.15.22:0/466386839 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f58340b3ce0 0x7f58340b61a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5838005ab0 tx=0x7f5838005a20 comp rx=0 tx=0).stop 2024-08-20T01:30:02.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.875+0000 7f58502a9640 1 -- 172.21.15.22:0/466386839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5848102ab0 msgr2=0x7f58480751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:02.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.875+0000 7f58502a9640 1 --2- 172.21.15.22:0/466386839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5848102ab0 0x7f58480751d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f584400b4a0 tx=0x7f584400b960 comp rx=0 tx=0).stop 2024-08-20T01:30:02.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.875+0000 7f58502a9640 1 -- 172.21.15.22:0/466386839 shutdown_connections 2024-08-20T01:30:02.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.875+0000 7f58502a9640 1 --2- 172.21.15.22:0/466386839 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f58340b3ce0 0x7f58340b61a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:02.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.875+0000 7f58502a9640 1 --2- 172.21.15.22:0/466386839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5848108e40 0x7f5848075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:02.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.875+0000 7f58502a9640 1 --2- 172.21.15.22:0/466386839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58481084c0 0x7f5848075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:02.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.875+0000 7f58502a9640 1 --2- 172.21.15.22:0/466386839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5848102ab0 0x7f58480751d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:02.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.875+0000 7f58502a9640 1 -- 172.21.15.22:0/466386839 >> 172.21.15.22:0/466386839 conn(0x7f58480fe580 msgr2=0x7f5848100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:02.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.875+0000 7f58502a9640 1 -- 172.21.15.22:0/466386839 shutdown_connections 2024-08-20T01:30:02.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:02.875+0000 7f58502a9640 1 -- 172.21.15.22:0/466386839 wait complete. 2024-08-20T01:30:03.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:03 smithi022 ceph-mon[18709]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 7.3 KiB/s, 0 keys/s, 0 objects/s recovering 2024-08-20T01:30:03.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:03 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1148999624' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-20T01:30:03.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:03 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/466386839' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-20T01:30:03.209 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738445 got 34359738447 for osd.0 2024-08-20T01:30:03.209 DEBUG:teuthology.parallel:result is None 2024-08-20T01:30:03.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:03 smithi077 ceph-mon[22251]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 7.3 KiB/s, 0 keys/s, 0 objects/s recovering 2024-08-20T01:30:03.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:03 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1148999624' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-20T01:30:03.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:03 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/466386839' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-20T01:30:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.415+0000 7f259e757640 1 -- 172.21.15.22:0/1055520970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2598104300 msgr2=0x7f259810c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.415+0000 7f259e757640 1 --2- 172.21.15.22:0/1055520970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2598104300 0x7f259810c7f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f258c009900 tx=0x7f258c02a410 comp rx=0 tx=0).stop 2024-08-20T01:30:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.415+0000 7f259e757640 1 -- 172.21.15.22:0/1055520970 shutdown_connections 2024-08-20T01:30:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.415+0000 7f259e757640 1 --2- 172.21.15.22:0/1055520970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f259810ce40 0x7f259810f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.415+0000 7f259e757640 1 --2- 172.21.15.22:0/1055520970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2598104300 0x7f259810c7f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.415+0000 7f259e757640 1 --2- 172.21.15.22:0/1055520970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25981039e0 0x7f2598103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.415+0000 7f259e757640 1 -- 172.21.15.22:0/1055520970 >> 172.21.15.22:0/1055520970 conn(0x7f25980fd440 msgr2=0x7f25980ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.415+0000 7f259e757640 1 -- 172.21.15.22:0/1055520970 shutdown_connections 2024-08-20T01:30:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.415+0000 7f259e757640 1 -- 172.21.15.22:0/1055520970 wait complete. 2024-08-20T01:30:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.416+0000 7f259e757640 1 Processor -- start 2024-08-20T01:30:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.416+0000 7f259e757640 1 -- start start 2024-08-20T01:30:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.416+0000 7f259e757640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25981039e0 0x7f259819b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.416+0000 7f259e757640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2598104300 0x7f259819b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.416+0000 7f259e757640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f259810ce40 0x7f25981a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.416+0000 7f259e757640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2598112ab0 con 0x7f2598104300 2024-08-20T01:30:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.416+0000 7f259e757640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2598112930 con 0x7f259810ce40 2024-08-20T01:30:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.416+0000 7f259e757640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2598112c30 con 0x7f25981039e0 2024-08-20T01:30:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.417+0000 7f25977fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2598104300 0x7f259819b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.417+0000 7f25977fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2598104300 0x7f259819b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37410/0 (socket says 172.21.15.22:37410) 2024-08-20T01:30:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.417+0000 7f25977fe640 1 -- 172.21.15.22:0/2914293229 learned_addr learned my addr 172.21.15.22:0/2914293229 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.417+0000 7f259ccf4640 1 --2- 172.21.15.22:0/2914293229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f259810ce40 0x7f25981a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.417+0000 7f2597fff640 1 --2- 172.21.15.22:0/2914293229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25981039e0 0x7f259819b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.417+0000 7f25977fe640 1 -- 172.21.15.22:0/2914293229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25981039e0 msgr2=0x7f259819b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.417+0000 7f25977fe640 1 --2- 172.21.15.22:0/2914293229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25981039e0 0x7f259819b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.417+0000 7f25977fe640 1 -- 172.21.15.22:0/2914293229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f259810ce40 msgr2=0x7f25981a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.417+0000 7f25977fe640 1 --2- 172.21.15.22:0/2914293229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f259810ce40 0x7f25981a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.417+0000 7f25977fe640 1 -- 172.21.15.22:0/2914293229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25981a12b0 con 0x7f2598104300 2024-08-20T01:30:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.417+0000 7f259ccf4640 1 --2- 172.21.15.22:0/2914293229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f259810ce40 0x7f25981a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.417+0000 7f2597fff640 1 --2- 172.21.15.22:0/2914293229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25981039e0 0x7f259819b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.417+0000 7f25977fe640 1 --2- 172.21.15.22:0/2914293229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2598104300 0x7f259819b740 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f258c006010 tx=0x7f258c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.417+0000 7f25957fa640 1 -- 172.21.15.22:0/2914293229 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c03f030 con 0x7f2598104300 2024-08-20T01:30:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.417+0000 7f259e757640 1 -- 172.21.15.22:0/2914293229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25981a1540 con 0x7f2598104300 2024-08-20T01:30:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.417+0000 7f25957fa640 1 -- 172.21.15.22:0/2914293229 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f258c003aa0 con 0x7f2598104300 2024-08-20T01:30:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.417+0000 7f25957fa640 1 -- 172.21.15.22:0/2914293229 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c035070 con 0x7f2598104300 2024-08-20T01:30:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.417+0000 7f259e757640 1 -- 172.21.15.22:0/2914293229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25981a7c60 con 0x7f2598104300 2024-08-20T01:30:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.418+0000 7f259e757640 1 -- 172.21.15.22:0/2914293229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2598103dc0 con 0x7f2598104300 2024-08-20T01:30:03.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.420+0000 7f25957fa640 1 -- 172.21.15.22:0/2914293229 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f258c042030 con 0x7f2598104300 2024-08-20T01:30:03.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.420+0000 7f25957fa640 1 --2- 172.21.15.22:0/2914293229 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f25800b3c60 0x7f25800b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:03.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.420+0000 7f2597fff640 1 --2- 172.21.15.22:0/2914293229 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f25800b3c60 0x7f25800b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:03.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.421+0000 7f25957fa640 1 -- 172.21.15.22:0/2914293229 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f258c1046b0 con 0x7f2598104300 2024-08-20T01:30:03.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.421+0000 7f2597fff640 1 --2- 172.21.15.22:0/2914293229 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f25800b3c60 0x7f25800b6120 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f25880058c0 tx=0x7f2588005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:03.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.423+0000 7f25957fa640 1 -- 172.21.15.22:0/2914293229 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f258c0cbb80 con 0x7f2598104300 2024-08-20T01:30:03.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:03 smithi134 ceph-mon[22511]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 7.3 KiB/s, 0 keys/s, 0 objects/s recovering 2024-08-20T01:30:03.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:03 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1148999624' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-20T01:30:03.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:03 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/466386839' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-20T01:30:03.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.197+0000 7f3a3a3ad640 1 -- 172.21.15.22:0/3030927270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a34102ab0 msgr2=0x7f3a34102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:03.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.197+0000 7f3a3a3ad640 1 --2- 172.21.15.22:0/3030927270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a34102ab0 0x7f3a34102e90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009900 tx=0x7f3a2402a410 comp rx=0 tx=0).stop 2024-08-20T01:30:03.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.197+0000 7f3a3a3ad640 1 -- 172.21.15.22:0/3030927270 shutdown_connections 2024-08-20T01:30:03.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.197+0000 7f3a3a3ad640 1 --2- 172.21.15.22:0/3030927270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a34108e40 0x7f3a3410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.197+0000 7f3a3a3ad640 1 --2- 172.21.15.22:0/3030927270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a341084c0 0x7f3a34108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.197+0000 7f3a3a3ad640 1 --2- 172.21.15.22:0/3030927270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a34102ab0 0x7f3a34102e90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.197+0000 7f3a3a3ad640 1 -- 172.21.15.22:0/3030927270 >> 172.21.15.22:0/3030927270 conn(0x7f3a340fe500 msgr2=0x7f3a34100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:03.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.197+0000 7f3a3a3ad640 1 -- 172.21.15.22:0/3030927270 shutdown_connections 2024-08-20T01:30:03.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.197+0000 7f3a3a3ad640 1 -- 172.21.15.22:0/3030927270 wait complete. 2024-08-20T01:30:03.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.198+0000 7f3a3a3ad640 1 Processor -- start 2024-08-20T01:30:03.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.198+0000 7f3a3a3ad640 1 -- start start 2024-08-20T01:30:03.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.198+0000 7f3a3a3ad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a34102ab0 0x7f3a34198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:03.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.198+0000 7f3a3a3ad640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a341084c0 0x7f3a34199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:03.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.198+0000 7f3a3a3ad640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a34108e40 0x7f3a3419e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:03.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.198+0000 7f3a3a3ad640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3a34112b00 con 0x7f3a341084c0 2024-08-20T01:30:03.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.198+0000 7f3a3a3ad640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3a34112980 con 0x7f3a34102ab0 2024-08-20T01:30:03.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.198+0000 7f3a3a3ad640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3a34112c80 con 0x7f3a34108e40 2024-08-20T01:30:03.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.199+0000 7f3a337fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a341084c0 0x7f3a34199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:03.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.199+0000 7f3a337fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a341084c0 0x7f3a34199510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37372/0 (socket says 172.21.15.22:37372) 2024-08-20T01:30:03.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.199+0000 7f3a337fe640 1 -- 172.21.15.22:0/2381184012 learned_addr learned my addr 172.21.15.22:0/2381184012 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:03.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.199+0000 7f3a33fff640 1 --2- 172.21.15.22:0/2381184012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a34102ab0 0x7f3a34198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:03.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.199+0000 7f3a3894a640 1 --2- 172.21.15.22:0/2381184012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a34108e40 0x7f3a3419e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:03.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.199+0000 7f3a337fe640 1 -- 172.21.15.22:0/2381184012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a34108e40 msgr2=0x7f3a3419e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:03.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.199+0000 7f3a337fe640 1 --2- 172.21.15.22:0/2381184012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a34108e40 0x7f3a3419e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.199+0000 7f3a337fe640 1 -- 172.21.15.22:0/2381184012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a34102ab0 msgr2=0x7f3a34198fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:03.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.199+0000 7f3a337fe640 1 --2- 172.21.15.22:0/2381184012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a34102ab0 0x7f3a34198fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.199+0000 7f3a337fe640 1 -- 172.21.15.22:0/2381184012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3419f080 con 0x7f3a341084c0 2024-08-20T01:30:03.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.199+0000 7f3a337fe640 1 --2- 172.21.15.22:0/2381184012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a341084c0 0x7f3a34199510 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800d770 tx=0x7f3a2800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:03.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.199+0000 7f3a317fa640 1 -- 172.21.15.22:0/2381184012 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a28017070 con 0x7f3a341084c0 2024-08-20T01:30:03.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.199+0000 7f3a3a3ad640 1 -- 172.21.15.22:0/2381184012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a3419f370 con 0x7f3a341084c0 2024-08-20T01:30:03.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.199+0000 7f3a317fa640 1 -- 172.21.15.22:0/2381184012 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a280054d0 con 0x7f3a341084c0 2024-08-20T01:30:03.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.199+0000 7f3a317fa640 1 -- 172.21.15.22:0/2381184012 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a28004c30 con 0x7f3a341084c0 2024-08-20T01:30:03.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.199+0000 7f3a3a3ad640 1 -- 172.21.15.22:0/2381184012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a341a5a30 con 0x7f3a341084c0 2024-08-20T01:30:03.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.200+0000 7f3a3a3ad640 1 -- 172.21.15.22:0/2381184012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a34102e90 con 0x7f3a341084c0 2024-08-20T01:30:03.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.202+0000 7f3a317fa640 1 -- 172.21.15.22:0/2381184012 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f3a28004e10 con 0x7f3a341084c0 2024-08-20T01:30:03.545 INFO:teuthology.orchestra.run.smithi022.stdout:55834574922 2024-08-20T01:30:03.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.203+0000 7f3a317fa640 1 --2- 172.21.15.22:0/2381184012 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3a1c0b3c60 0x7f3a1c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:03.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.203+0000 7f3a33fff640 1 --2- 172.21.15.22:0/2381184012 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3a1c0b3c60 0x7f3a1c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:03.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.203+0000 7f3a317fa640 1 -- 172.21.15.22:0/2381184012 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f3a280e3810 con 0x7f3a341084c0 2024-08-20T01:30:03.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.203+0000 7f3a33fff640 1 --2- 172.21.15.22:0/2381184012 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3a1c0b3c60 0x7f3a1c0b6120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3a24031440 tx=0x7f3a24005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:03.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.207+0000 7f3a317fa640 1 -- 172.21.15.22:0/2381184012 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f3a280aa690 con 0x7f3a341084c0 2024-08-20T01:30:03.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.398+0000 7f3a3a3ad640 1 -- 172.21.15.22:0/2381184012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3a3410ac80 con 0x7f3a341084c0 2024-08-20T01:30:03.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.398+0000 7f3a317fa640 1 -- 172.21.15.22:0/2381184012 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3a280aebe0 con 0x7f3a341084c0 2024-08-20T01:30:03.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.401+0000 7f3a3a3ad640 1 -- 172.21.15.22:0/2381184012 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3a1c0b3c60 msgr2=0x7f3a1c0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:03.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.401+0000 7f3a3a3ad640 1 --2- 172.21.15.22:0/2381184012 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3a1c0b3c60 0x7f3a1c0b6120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3a24031440 tx=0x7f3a24005b50 comp rx=0 tx=0).stop 2024-08-20T01:30:03.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.401+0000 7f3a3a3ad640 1 -- 172.21.15.22:0/2381184012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a341084c0 msgr2=0x7f3a34199510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:03.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.401+0000 7f3a3a3ad640 1 --2- 172.21.15.22:0/2381184012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a341084c0 0x7f3a34199510 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800d770 tx=0x7f3a2800dc30 comp rx=0 tx=0).stop 2024-08-20T01:30:03.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.401+0000 7f3a3a3ad640 1 -- 172.21.15.22:0/2381184012 shutdown_connections 2024-08-20T01:30:03.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.401+0000 7f3a3a3ad640 1 --2- 172.21.15.22:0/2381184012 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3a1c0b3c60 0x7f3a1c0b6120 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.401+0000 7f3a3a3ad640 1 --2- 172.21.15.22:0/2381184012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a34108e40 0x7f3a3419e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.401+0000 7f3a3a3ad640 1 --2- 172.21.15.22:0/2381184012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a341084c0 0x7f3a34199510 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.401+0000 7f3a3a3ad640 1 --2- 172.21.15.22:0/2381184012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a34102ab0 0x7f3a34198fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.401+0000 7f3a3a3ad640 1 -- 172.21.15.22:0/2381184012 >> 172.21.15.22:0/2381184012 conn(0x7f3a340fe500 msgr2=0x7f3a341008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:03.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.401+0000 7f3a3a3ad640 1 -- 172.21.15.22:0/2381184012 shutdown_connections 2024-08-20T01:30:03.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:01.401+0000 7f3a3a3ad640 1 -- 172.21.15.22:0/2381184012 wait complete. 2024-08-20T01:30:03.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.616+0000 7f259e757640 1 -- 172.21.15.22:0/2914293229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f25981a7ef0 con 0x7f2598104300 2024-08-20T01:30:03.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.616+0000 7f25957fa640 1 -- 172.21.15.22:0/2914293229 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f258c0cb480 con 0x7f2598104300 2024-08-20T01:30:03.617 INFO:teuthology.orchestra.run.smithi022.stdout:197568495660 2024-08-20T01:30:03.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.618+0000 7f259e757640 1 -- 172.21.15.22:0/2914293229 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f25800b3c60 msgr2=0x7f25800b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:03.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.618+0000 7f259e757640 1 --2- 172.21.15.22:0/2914293229 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f25800b3c60 0x7f25800b6120 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f25880058c0 tx=0x7f2588005850 comp rx=0 tx=0).stop 2024-08-20T01:30:03.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.618+0000 7f259e757640 1 -- 172.21.15.22:0/2914293229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2598104300 msgr2=0x7f259819b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:03.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.618+0000 7f259e757640 1 --2- 172.21.15.22:0/2914293229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2598104300 0x7f259819b740 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f258c006010 tx=0x7f258c004060 comp rx=0 tx=0).stop 2024-08-20T01:30:03.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.618+0000 7f259e757640 1 -- 172.21.15.22:0/2914293229 shutdown_connections 2024-08-20T01:30:03.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.618+0000 7f259e757640 1 --2- 172.21.15.22:0/2914293229 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f25800b3c60 0x7f25800b6120 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.618+0000 7f259e757640 1 --2- 172.21.15.22:0/2914293229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f259810ce40 0x7f25981a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.618+0000 7f259e757640 1 --2- 172.21.15.22:0/2914293229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2598104300 0x7f259819b740 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.618+0000 7f259e757640 1 --2- 172.21.15.22:0/2914293229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25981039e0 0x7f259819b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.618+0000 7f259e757640 1 -- 172.21.15.22:0/2914293229 >> 172.21.15.22:0/2914293229 conn(0x7f25980fd440 msgr2=0x7f25980ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:03.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.618+0000 7f259e757640 1 -- 172.21.15.22:0/2914293229 shutdown_connections 2024-08-20T01:30:03.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.618+0000 7f259e757640 1 -- 172.21.15.22:0/2914293229 wait complete. 2024-08-20T01:30:03.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.917+0000 7f1b18a02640 1 -- 172.21.15.22:0/3837770916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b1410cc60 msgr2=0x7f1b1410f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:03.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.917+0000 7f1b18a02640 1 --2- 172.21.15.22:0/3837770916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b1410cc60 0x7f1b1410f0c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009ca0 tx=0x7f1b0c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.917+0000 7f1b18a02640 1 -- 172.21.15.22:0/3837770916 shutdown_connections 2024-08-20T01:30:03.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.917+0000 7f1b18a02640 1 --2- 172.21.15.22:0/3837770916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b1410cc60 0x7f1b1410f0c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.917+0000 7f1b18a02640 1 --2- 172.21.15.22:0/3837770916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b14104120 0x7f1b1410c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.917+0000 7f1b18a02640 1 --2- 172.21.15.22:0/3837770916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b14103800 0x7f1b14103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.917+0000 7f1b18a02640 1 -- 172.21.15.22:0/3837770916 >> 172.21.15.22:0/3837770916 conn(0x7f1b140fd2a0 msgr2=0x7f1b140ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:03.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.917+0000 7f1b18a02640 1 -- 172.21.15.22:0/3837770916 shutdown_connections 2024-08-20T01:30:03.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.917+0000 7f1b18a02640 1 -- 172.21.15.22:0/3837770916 wait complete. 2024-08-20T01:30:03.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.918+0000 7f1b18a02640 1 Processor -- start 2024-08-20T01:30:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.918+0000 7f1b18a02640 1 -- start start 2024-08-20T01:30:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1b18a02640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b14103800 0x7f1b1419af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1b18a02640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b14104120 0x7f1b1419b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1b18a02640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b1410cc60 0x7f1b141a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1b18a02640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1b14112920 con 0x7f1b14104120 2024-08-20T01:30:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1b18a02640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1b141127a0 con 0x7f1b14103800 2024-08-20T01:30:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1b18a02640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1b14112aa0 con 0x7f1b1410cc60 2024-08-20T01:30:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1b1259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b14104120 0x7f1b1419b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1b1259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b14104120 0x7f1b1419b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37428/0 (socket says 172.21.15.22:37428) 2024-08-20T01:30:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1b1259c640 1 -- 172.21.15.22:0/3750755389 learned_addr learned my addr 172.21.15.22:0/3750755389 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1b12d9d640 1 --2- 172.21.15.22:0/3750755389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b14103800 0x7f1b1419af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1b1359e640 1 --2- 172.21.15.22:0/3750755389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b1410cc60 0x7f1b141a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:03.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1b1259c640 1 -- 172.21.15.22:0/3750755389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b1410cc60 msgr2=0x7f1b141a0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1b1259c640 1 --2- 172.21.15.22:0/3750755389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b1410cc60 0x7f1b141a0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1b1259c640 1 -- 172.21.15.22:0/3750755389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b14103800 msgr2=0x7f1b1419af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1b1259c640 1 --2- 172.21.15.22:0/3750755389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b14103800 0x7f1b1419af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1b1259c640 1 -- 172.21.15.22:0/3750755389 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b141a1040 con 0x7f1b14104120 2024-08-20T01:30:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1b1259c640 1 --2- 172.21.15.22:0/3750755389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b14104120 0x7f1b1419b4d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800d6b0 tx=0x7f1b0800db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1afbfff640 1 -- 172.21.15.22:0/3750755389 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b08017070 con 0x7f1b14104120 2024-08-20T01:30:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1b18a02640 1 -- 172.21.15.22:0/3750755389 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b141a1330 con 0x7f1b14104120 2024-08-20T01:30:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1afbfff640 1 -- 172.21.15.22:0/3750755389 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b08010460 con 0x7f1b14104120 2024-08-20T01:30:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1afbfff640 1 -- 172.21.15.22:0/3750755389 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0800f620 con 0x7f1b14104120 2024-08-20T01:30:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.919+0000 7f1b18a02640 1 -- 172.21.15.22:0/3750755389 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b141a79f0 con 0x7f1b14104120 2024-08-20T01:30:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.921+0000 7f1b18a02640 1 -- 172.21.15.22:0/3750755389 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b14103be0 con 0x7f1b14104120 2024-08-20T01:30:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.922+0000 7f1afbfff640 1 -- 172.21.15.22:0/3750755389 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f1b0801a070 con 0x7f1b14104120 2024-08-20T01:30:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.923+0000 7f1afbfff640 1 --2- 172.21.15.22:0/3750755389 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f1afc0b3d10 0x7f1afc0b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:03.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.923+0000 7f1afbfff640 1 -- 172.21.15.22:0/3750755389 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f1b080e3700 con 0x7f1b14104120 2024-08-20T01:30:03.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.923+0000 7f1b12d9d640 1 --2- 172.21.15.22:0/3750755389 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f1afc0b3d10 0x7f1afc0b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:03.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.923+0000 7f1b12d9d640 1 --2- 172.21.15.22:0/3750755389 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f1afc0b3d10 0x7f1afc0b61d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009bd0 tx=0x7f1b04005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:03.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:03.926+0000 7f1afbfff640 1 -- 172.21.15.22:0/3750755389 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f1b080aabd0 con 0x7f1b14104120 2024-08-20T01:30:04.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.117+0000 7f1b18a02640 1 -- 172.21.15.22:0/3750755389 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1b141a7d20 con 0x7f1b14104120 2024-08-20T01:30:04.119 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:04 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2914293229' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-20T01:30:04.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.118+0000 7f1afbfff640 1 -- 172.21.15.22:0/3750755389 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1b080aa4d0 con 0x7f1b14104120 2024-08-20T01:30:04.119 INFO:teuthology.orchestra.run.smithi022.stdout:176093659186 2024-08-20T01:30:04.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.120+0000 7f1b18a02640 1 -- 172.21.15.22:0/3750755389 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f1afc0b3d10 msgr2=0x7f1afc0b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:04.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.120+0000 7f1b18a02640 1 --2- 172.21.15.22:0/3750755389 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f1afc0b3d10 0x7f1afc0b61d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009bd0 tx=0x7f1b04005f90 comp rx=0 tx=0).stop 2024-08-20T01:30:04.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.120+0000 7f1b18a02640 1 -- 172.21.15.22:0/3750755389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b14104120 msgr2=0x7f1b1419b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:04.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.120+0000 7f1b18a02640 1 --2- 172.21.15.22:0/3750755389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b14104120 0x7f1b1419b4d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800d6b0 tx=0x7f1b0800db70 comp rx=0 tx=0).stop 2024-08-20T01:30:04.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.120+0000 7f1b18a02640 1 -- 172.21.15.22:0/3750755389 shutdown_connections 2024-08-20T01:30:04.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.120+0000 7f1b18a02640 1 --2- 172.21.15.22:0/3750755389 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f1afc0b3d10 0x7f1afc0b61d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:04.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.120+0000 7f1b18a02640 1 --2- 172.21.15.22:0/3750755389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b1410cc60 0x7f1b141a0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:04.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.120+0000 7f1b18a02640 1 --2- 172.21.15.22:0/3750755389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b14104120 0x7f1b1419b4d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:04.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.120+0000 7f1b18a02640 1 --2- 172.21.15.22:0/3750755389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b14103800 0x7f1b1419af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:04.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.120+0000 7f1b18a02640 1 -- 172.21.15.22:0/3750755389 >> 172.21.15.22:0/3750755389 conn(0x7f1b140fd2a0 msgr2=0x7f1b14101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:04.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.120+0000 7f1b18a02640 1 -- 172.21.15.22:0/3750755389 shutdown_connections 2024-08-20T01:30:04.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.120+0000 7f1b18a02640 1 -- 172.21.15.22:0/3750755389 wait complete. 2024-08-20T01:30:04.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:04 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2914293229' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-20T01:30:04.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:04 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2914293229' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-20T01:30:04.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.783+0000 7fd67fb2f640 1 -- 172.21.15.22:0/77151740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd678108e60 msgr2=0x7fd67810f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:04.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.783+0000 7fd67fb2f640 1 --2- 172.21.15.22:0/77151740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd678108e60 0x7fd67810f660 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd670009ca0 tx=0x7fd67002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:30:04.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.783+0000 7fd67fb2f640 1 -- 172.21.15.22:0/77151740 shutdown_connections 2024-08-20T01:30:04.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.783+0000 7fd67fb2f640 1 --2- 172.21.15.22:0/77151740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd678108e60 0x7fd67810f660 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:04.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.783+0000 7fd67fb2f640 1 --2- 172.21.15.22:0/77151740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6781084e0 0x7fd678108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:04.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.783+0000 7fd67fb2f640 1 --2- 172.21.15.22:0/77151740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd678102ad0 0x7fd678102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:04.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.783+0000 7fd67fb2f640 1 -- 172.21.15.22:0/77151740 >> 172.21.15.22:0/77151740 conn(0x7fd6780fe540 msgr2=0x7fd678100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:04.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.783+0000 7fd67fb2f640 1 -- 172.21.15.22:0/77151740 shutdown_connections 2024-08-20T01:30:04.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.783+0000 7fd67fb2f640 1 -- 172.21.15.22:0/77151740 wait complete. 2024-08-20T01:30:04.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.784+0000 7fd67fb2f640 1 Processor -- start 2024-08-20T01:30:04.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.784+0000 7fd67fb2f640 1 -- start start 2024-08-20T01:30:04.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.784+0000 7fd67fb2f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd678102ad0 0x7fd6780751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:04.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.784+0000 7fd67fb2f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6781084e0 0x7fd678075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:04.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.784+0000 7fd67fb2f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd678108e60 0x7fd678075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:04.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.784+0000 7fd67fb2f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd678112b30 con 0x7fd678108e60 2024-08-20T01:30:04.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.784+0000 7fd67fb2f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd6781129b0 con 0x7fd6781084e0 2024-08-20T01:30:04.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.784+0000 7fd67fb2f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd678112cb0 con 0x7fd678102ad0 2024-08-20T01:30:04.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.784+0000 7fd67e0cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd678108e60 0x7fd678075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:04.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.784+0000 7fd67e0cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd678108e60 0x7fd678075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37442/0 (socket says 172.21.15.22:37442) 2024-08-20T01:30:04.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.784+0000 7fd67e0cc640 1 -- 172.21.15.22:0/1154784088 learned_addr learned my addr 172.21.15.22:0/1154784088 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:04.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.784+0000 7fd67d8cb640 1 --2- 172.21.15.22:0/1154784088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd678102ad0 0x7fd6780751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:04.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.784+0000 7fd67d0ca640 1 --2- 172.21.15.22:0/1154784088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6781084e0 0x7fd678075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:04.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.785+0000 7fd67e0cc640 1 -- 172.21.15.22:0/1154784088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd678102ad0 msgr2=0x7fd6780751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:04.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.785+0000 7fd67e0cc640 1 --2- 172.21.15.22:0/1154784088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd678102ad0 0x7fd6780751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:04.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.785+0000 7fd67e0cc640 1 -- 172.21.15.22:0/1154784088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6781084e0 msgr2=0x7fd678075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:04.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.785+0000 7fd67e0cc640 1 --2- 172.21.15.22:0/1154784088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6781084e0 0x7fd678075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:04.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.785+0000 7fd67e0cc640 1 -- 172.21.15.22:0/1154784088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6781a7380 con 0x7fd678108e60 2024-08-20T01:30:04.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.785+0000 7fd67e0cc640 1 --2- 172.21.15.22:0/1154784088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd678108e60 0x7fd678075c50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd670009430 tx=0x7fd6700319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:04.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.785+0000 7fd66effd640 1 -- 172.21.15.22:0/1154784088 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670003c30 con 0x7fd678108e60 2024-08-20T01:30:04.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.785+0000 7fd67fb2f640 1 -- 172.21.15.22:0/1154784088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6781a7610 con 0x7fd678108e60 2024-08-20T01:30:04.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.785+0000 7fd66effd640 1 -- 172.21.15.22:0/1154784088 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd670003dd0 con 0x7fd678108e60 2024-08-20T01:30:04.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.785+0000 7fd66effd640 1 -- 172.21.15.22:0/1154784088 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67002faa0 con 0x7fd678108e60 2024-08-20T01:30:04.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.785+0000 7fd67fb2f640 1 -- 172.21.15.22:0/1154784088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6781a7ba0 con 0x7fd678108e60 2024-08-20T01:30:04.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.786+0000 7fd67fb2f640 1 -- 172.21.15.22:0/1154784088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd678102eb0 con 0x7fd678108e60 2024-08-20T01:30:04.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.787+0000 7fd66effd640 1 -- 172.21.15.22:0/1154784088 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fd67002fcc0 con 0x7fd678108e60 2024-08-20T01:30:04.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.788+0000 7fd66effd640 1 --2- 172.21.15.22:0/1154784088 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd6640b3c60 0x7fd6640b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:04.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.788+0000 7fd67d8cb640 1 --2- 172.21.15.22:0/1154784088 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd6640b3c60 0x7fd6640b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:04.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.788+0000 7fd66effd640 1 -- 172.21.15.22:0/1154784088 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7fd670105330 con 0x7fd678108e60 2024-08-20T01:30:04.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.789+0000 7fd67d8cb640 1 --2- 172.21.15.22:0/1154784088 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd6640b3c60 0x7fd6640b6120 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd67400bbe0 tx=0x7fd67400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:04.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.792+0000 7fd66effd640 1 -- 172.21.15.22:0/1154784088 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd6700cc910 con 0x7fd678108e60 2024-08-20T01:30:04.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.978+0000 7fd67fb2f640 1 -- 172.21.15.22:0/1154784088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd67810a6b0 con 0x7fd678108e60 2024-08-20T01:30:04.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.978+0000 7fd66effd640 1 -- 172.21.15.22:0/1154784088 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd6700cc210 con 0x7fd678108e60 2024-08-20T01:30:04.980 INFO:teuthology.orchestra.run.smithi022.stdout:128849018940 2024-08-20T01:30:04.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.980+0000 7fd67fb2f640 1 -- 172.21.15.22:0/1154784088 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd6640b3c60 msgr2=0x7fd6640b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:04.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.980+0000 7fd67fb2f640 1 --2- 172.21.15.22:0/1154784088 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd6640b3c60 0x7fd6640b6120 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd67400bbe0 tx=0x7fd67400b390 comp rx=0 tx=0).stop 2024-08-20T01:30:04.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.980+0000 7fd67fb2f640 1 -- 172.21.15.22:0/1154784088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd678108e60 msgr2=0x7fd678075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:04.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.980+0000 7fd67fb2f640 1 --2- 172.21.15.22:0/1154784088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd678108e60 0x7fd678075c50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd670009430 tx=0x7fd6700319f0 comp rx=0 tx=0).stop 2024-08-20T01:30:04.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.981+0000 7fd67fb2f640 1 -- 172.21.15.22:0/1154784088 shutdown_connections 2024-08-20T01:30:04.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.981+0000 7fd67fb2f640 1 --2- 172.21.15.22:0/1154784088 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd6640b3c60 0x7fd6640b6120 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:04.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.981+0000 7fd67fb2f640 1 --2- 172.21.15.22:0/1154784088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd678108e60 0x7fd678075c50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:04.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.981+0000 7fd67fb2f640 1 --2- 172.21.15.22:0/1154784088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6781084e0 0x7fd678075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:04.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.981+0000 7fd67fb2f640 1 --2- 172.21.15.22:0/1154784088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd678102ad0 0x7fd6780751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:04.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.981+0000 7fd67fb2f640 1 -- 172.21.15.22:0/1154784088 >> 172.21.15.22:0/1154784088 conn(0x7fd6780fe540 msgr2=0x7fd678100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:04.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.981+0000 7fd67fb2f640 1 -- 172.21.15.22:0/1154784088 shutdown_connections 2024-08-20T01:30:04.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:04.981+0000 7fd67fb2f640 1 -- 172.21.15.22:0/1154784088 wait complete. 2024-08-20T01:30:05.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:05 smithi077 ceph-mon[22251]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 6.3 KiB/s, 0 keys/s, 0 objects/s recovering 2024-08-20T01:30:05.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:05 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3750755389' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-20T01:30:05.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:05 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1154784088' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-20T01:30:05.322 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:05 smithi022 ceph-mon[18709]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 6.3 KiB/s, 0 keys/s, 0 objects/s recovering 2024-08-20T01:30:05.322 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:05 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3750755389' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-20T01:30:05.322 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:05 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1154784088' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-20T01:30:05.351 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855412 got 150323855415 for osd.5 2024-08-20T01:30:05.351 DEBUG:teuthology.parallel:result is None 2024-08-20T01:30:05.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:05 smithi134 ceph-mon[22511]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 6.3 KiB/s, 0 keys/s, 0 objects/s recovering 2024-08-20T01:30:05.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:05 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3750755389' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-20T01:30:05.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:05 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1154784088' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-20T01:30:05.720 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299427 got 223338299430 for osd.8 2024-08-20T01:30:05.721 DEBUG:teuthology.parallel:result is None 2024-08-20T01:30:06.358 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018938 got 128849018940 for osd.4 2024-08-20T01:30:06.359 DEBUG:teuthology.parallel:result is None 2024-08-20T01:30:07.097 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495657 got 197568495660 for osd.7 2024-08-20T01:30:07.097 DEBUG:teuthology.parallel:result is None 2024-08-20T01:30:07.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:07 smithi077 ceph-mon[22251]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 5.7 KiB/s, 0 keys/s, 0 objects/s recovering 2024-08-20T01:30:07.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:07 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1580469310' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-20T01:30:07.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:07 smithi022 ceph-mon[18709]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 5.7 KiB/s, 0 keys/s, 0 objects/s recovering 2024-08-20T01:30:07.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:07 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1580469310' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-20T01:30:07.476 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574919 got 55834574922 for osd.1 2024-08-20T01:30:07.476 DEBUG:teuthology.parallel:result is None 2024-08-20T01:30:07.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:07 smithi134 ceph-mon[22511]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 5.7 KiB/s, 0 keys/s, 0 objects/s recovering 2024-08-20T01:30:07.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:07 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1580469310' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-20T01:30:08.022 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659184 got 176093659186 for osd.6 2024-08-20T01:30:08.022 DEBUG:teuthology.parallel:result is None 2024-08-20T01:30:08.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.756+0000 7ff2242cb640 1 -- 172.21.15.22:0/2071697999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff21c10ce40 msgr2=0x7ff21c10f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:08.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.756+0000 7ff2242cb640 1 --2- 172.21.15.22:0/2071697999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff21c10ce40 0x7ff21c10f250 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff214009ca0 tx=0x7ff21402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:30:08.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.757+0000 7ff2242cb640 1 -- 172.21.15.22:0/2071697999 shutdown_connections 2024-08-20T01:30:08.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.757+0000 7ff2242cb640 1 --2- 172.21.15.22:0/2071697999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff21c10ce40 0x7ff21c10f250 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:08.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.757+0000 7ff2242cb640 1 --2- 172.21.15.22:0/2071697999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff21c104290 0x7ff21c10c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:08.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.757+0000 7ff2242cb640 1 --2- 172.21.15.22:0/2071697999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c103890 0x7ff21c103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:08.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.757+0000 7ff2242cb640 1 -- 172.21.15.22:0/2071697999 >> 172.21.15.22:0/2071697999 conn(0x7ff21c0fd400 msgr2=0x7ff21c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:08.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.757+0000 7ff2242cb640 1 -- 172.21.15.22:0/2071697999 shutdown_connections 2024-08-20T01:30:08.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.757+0000 7ff2242cb640 1 -- 172.21.15.22:0/2071697999 wait complete. 2024-08-20T01:30:08.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.757+0000 7ff2242cb640 1 Processor -- start 2024-08-20T01:30:08.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.757+0000 7ff2242cb640 1 -- start start 2024-08-20T01:30:08.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.758+0000 7ff2242cb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c103890 0x7ff21c198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:08.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.758+0000 7ff2242cb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff21c104290 0x7ff21c199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:08.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.758+0000 7ff2242cb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff21c10ce40 0x7ff21c19e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:08.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.758+0000 7ff2242cb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff21c112a60 con 0x7ff21c10ce40 2024-08-20T01:30:08.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.758+0000 7ff2242cb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff21c1128e0 con 0x7ff21c104290 2024-08-20T01:30:08.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.758+0000 7ff2242cb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff21c112be0 con 0x7ff21c103890 2024-08-20T01:30:08.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.758+0000 7ff222868640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff21c10ce40 0x7ff21c19e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:08.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.758+0000 7ff222868640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff21c10ce40 0x7ff21c19e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37452/0 (socket says 172.21.15.22:37452) 2024-08-20T01:30:08.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.758+0000 7ff222868640 1 -- 172.21.15.22:0/1580469310 learned_addr learned my addr 172.21.15.22:0/1580469310 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:08.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.758+0000 7ff222067640 1 --2- 172.21.15.22:0/1580469310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c103890 0x7ff21c198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:08.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.758+0000 7ff221866640 1 --2- 172.21.15.22:0/1580469310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff21c104290 0x7ff21c199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:08.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.758+0000 7ff222868640 1 -- 172.21.15.22:0/1580469310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c103890 msgr2=0x7ff21c198f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:08.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.758+0000 7ff222868640 1 --2- 172.21.15.22:0/1580469310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c103890 0x7ff21c198f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:08.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.758+0000 7ff222868640 1 -- 172.21.15.22:0/1580469310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff21c104290 msgr2=0x7ff21c199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:08.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.758+0000 7ff222868640 1 --2- 172.21.15.22:0/1580469310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff21c104290 0x7ff21c199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:08.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.758+0000 7ff222868640 1 -- 172.21.15.22:0/1580469310 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff21c19efc0 con 0x7ff21c10ce40 2024-08-20T01:30:08.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.759+0000 7ff222868640 1 --2- 172.21.15.22:0/1580469310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff21c10ce40 0x7ff21c19e7f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff2140319f0 tx=0x7ff214031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:08.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.759+0000 7ff2137fe640 1 -- 172.21.15.22:0/1580469310 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214003bf0 con 0x7ff21c10ce40 2024-08-20T01:30:08.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.759+0000 7ff2242cb640 1 -- 172.21.15.22:0/1580469310 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff21c19f250 con 0x7ff21c10ce40 2024-08-20T01:30:08.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.759+0000 7ff2137fe640 1 -- 172.21.15.22:0/1580469310 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff214003d90 con 0x7ff21c10ce40 2024-08-20T01:30:08.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.759+0000 7ff2137fe640 1 -- 172.21.15.22:0/1580469310 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21402fc00 con 0x7ff21c10ce40 2024-08-20T01:30:08.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.759+0000 7ff2242cb640 1 -- 172.21.15.22:0/1580469310 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff21c1a5970 con 0x7ff21c10ce40 2024-08-20T01:30:08.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.760+0000 7ff2242cb640 1 -- 172.21.15.22:0/1580469310 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff21c103c70 con 0x7ff21c10ce40 2024-08-20T01:30:08.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.761+0000 7ff2137fe640 1 -- 172.21.15.22:0/1580469310 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7ff214004610 con 0x7ff21c10ce40 2024-08-20T01:30:08.097 INFO:teuthology.orchestra.run.smithi022.stdout:73014444101 2024-08-20T01:30:08.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.762+0000 7ff2137fe640 1 --2- 172.21.15.22:0/1580469310 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff2080b3c60 0x7ff2080b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:08.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.762+0000 7ff222067640 1 --2- 172.21.15.22:0/1580469310 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff2080b3c60 0x7ff2080b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:08.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.763+0000 7ff2137fe640 1 -- 172.21.15.22:0/1580469310 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7ff214105190 con 0x7ff21c10ce40 2024-08-20T01:30:08.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.763+0000 7ff222067640 1 --2- 172.21.15.22:0/1580469310 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff2080b3c60 0x7ff2080b6120 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff21800abe0 tx=0x7ff21800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:08.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.767+0000 7ff2137fe640 1 -- 172.21.15.22:0/1580469310 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff2140cc770 con 0x7ff21c10ce40 2024-08-20T01:30:08.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.953+0000 7ff2242cb640 1 -- 172.21.15.22:0/1580469310 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff21c1a5c60 con 0x7ff21c10ce40 2024-08-20T01:30:08.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.954+0000 7ff2137fe640 1 -- 172.21.15.22:0/1580469310 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff2140cc070 con 0x7ff21c10ce40 2024-08-20T01:30:08.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.956+0000 7ff2242cb640 1 -- 172.21.15.22:0/1580469310 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff2080b3c60 msgr2=0x7ff2080b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:08.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.956+0000 7ff2242cb640 1 --2- 172.21.15.22:0/1580469310 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff2080b3c60 0x7ff2080b6120 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff21800abe0 tx=0x7ff21800a2d0 comp rx=0 tx=0).stop 2024-08-20T01:30:08.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.956+0000 7ff2242cb640 1 -- 172.21.15.22:0/1580469310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff21c10ce40 msgr2=0x7ff21c19e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:08.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.956+0000 7ff2242cb640 1 --2- 172.21.15.22:0/1580469310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff21c10ce40 0x7ff21c19e7f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff2140319f0 tx=0x7ff214031a20 comp rx=0 tx=0).stop 2024-08-20T01:30:08.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.956+0000 7ff2242cb640 1 -- 172.21.15.22:0/1580469310 shutdown_connections 2024-08-20T01:30:08.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.956+0000 7ff2242cb640 1 --2- 172.21.15.22:0/1580469310 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff2080b3c60 0x7ff2080b6120 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:08.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.956+0000 7ff2242cb640 1 --2- 172.21.15.22:0/1580469310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff21c10ce40 0x7ff21c19e7f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:08.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.956+0000 7ff2242cb640 1 --2- 172.21.15.22:0/1580469310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff21c104290 0x7ff21c199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:08.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.956+0000 7ff2242cb640 1 --2- 172.21.15.22:0/1580469310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c103890 0x7ff21c198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:08.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.956+0000 7ff2242cb640 1 -- 172.21.15.22:0/1580469310 >> 172.21.15.22:0/1580469310 conn(0x7ff21c0fd400 msgr2=0x7ff21c10f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:08.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.956+0000 7ff2242cb640 1 -- 172.21.15.22:0/1580469310 shutdown_connections 2024-08-20T01:30:08.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:06.956+0000 7ff2242cb640 1 -- 172.21.15.22:0/1580469310 wait complete. 2024-08-20T01:30:08.286 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:08.979 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444098 got 73014444101 for osd.2 2024-08-20T01:30:08.980 DEBUG:teuthology.parallel:result is None 2024-08-20T01:30:09.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.198+0000 7f7272731640 1 -- 172.21.15.22:0/480298348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f726c107d20 msgr2=0x7f726c10e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:09.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.198+0000 7f7272731640 1 --2- 172.21.15.22:0/480298348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f726c107d20 0x7f726c10e520 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7264009ca0 tx=0x7f726402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:30:09.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.198+0000 7f7272731640 1 -- 172.21.15.22:0/480298348 shutdown_connections 2024-08-20T01:30:09.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.198+0000 7f7272731640 1 --2- 172.21.15.22:0/480298348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f726c107d20 0x7f726c10e520 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:09.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.198+0000 7f7272731640 1 --2- 172.21.15.22:0/480298348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f726c1073a0 0x7f726c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:09.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.198+0000 7f7272731640 1 --2- 172.21.15.22:0/480298348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f726c101990 0x7f726c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:09.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.198+0000 7f7272731640 1 -- 172.21.15.22:0/480298348 >> 172.21.15.22:0/480298348 conn(0x7f726c0fd400 msgr2=0x7f726c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:09.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.198+0000 7f7272731640 1 -- 172.21.15.22:0/480298348 shutdown_connections 2024-08-20T01:30:09.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.198+0000 7f7272731640 1 -- 172.21.15.22:0/480298348 wait complete. 2024-08-20T01:30:09.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.199+0000 7f7272731640 1 Processor -- start 2024-08-20T01:30:09.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.199+0000 7f7272731640 1 -- start start 2024-08-20T01:30:09.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.199+0000 7f7272731640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f726c101990 0x7f726c198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:09.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.199+0000 7f7272731640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f726c1073a0 0x7f726c199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:09.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.199+0000 7f7272731640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f726c107d20 0x7f726c19e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:09.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.199+0000 7f7272731640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f726c1119e0 con 0x7f726c101990 2024-08-20T01:30:09.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.199+0000 7f7272731640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f726c111860 con 0x7f726c107d20 2024-08-20T01:30:09.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.199+0000 7f7272731640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f726c111b60 con 0x7f726c1073a0 2024-08-20T01:30:09.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.199+0000 7f726bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f726c101990 0x7f726c198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:09.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.199+0000 7f726bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f726c101990 0x7f726c198fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37484/0 (socket says 172.21.15.22:37484) 2024-08-20T01:30:09.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.199+0000 7f726bfff640 1 -- 172.21.15.22:0/3128132628 learned_addr learned my addr 172.21.15.22:0/3128132628 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:09.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.199+0000 7f726b7fe640 1 --2- 172.21.15.22:0/3128132628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f726c1073a0 0x7f726c199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:09.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.199+0000 7f7270cce640 1 --2- 172.21.15.22:0/3128132628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f726c107d20 0x7f726c19e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:09.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.200+0000 7f726bfff640 1 -- 172.21.15.22:0/3128132628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f726c1073a0 msgr2=0x7f726c199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:09.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.200+0000 7f726bfff640 1 --2- 172.21.15.22:0/3128132628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f726c1073a0 0x7f726c199500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:09.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.200+0000 7f726bfff640 1 -- 172.21.15.22:0/3128132628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f726c107d20 msgr2=0x7f726c19e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:09.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.200+0000 7f726bfff640 1 --2- 172.21.15.22:0/3128132628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f726c107d20 0x7f726c19e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:09.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.200+0000 7f726bfff640 1 -- 172.21.15.22:0/3128132628 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c19f070 con 0x7f726c101990 2024-08-20T01:30:09.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.200+0000 7f726bfff640 1 --2- 172.21.15.22:0/3128132628 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f726c101990 0x7f726c198fc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f725c00b4a0 tx=0x7f725c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:09.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.200+0000 7f72697fa640 1 -- 172.21.15.22:0/3128132628 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c014070 con 0x7f726c101990 2024-08-20T01:30:09.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.200+0000 7f72697fa640 1 -- 172.21.15.22:0/3128132628 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f725c010ac0 con 0x7f726c101990 2024-08-20T01:30:09.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.200+0000 7f7272731640 1 -- 172.21.15.22:0/3128132628 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726c19f360 con 0x7f726c101990 2024-08-20T01:30:09.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.200+0000 7f72697fa640 1 -- 172.21.15.22:0/3128132628 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c017c30 con 0x7f726c101990 2024-08-20T01:30:09.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.200+0000 7f7272731640 1 -- 172.21.15.22:0/3128132628 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726c1a5aa0 con 0x7f726c101990 2024-08-20T01:30:09.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.201+0000 7f7272731640 1 -- 172.21.15.22:0/3128132628 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f726c101d70 con 0x7f726c101990 2024-08-20T01:30:09.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.203+0000 7f72697fa640 1 -- 172.21.15.22:0/3128132628 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f725c017070 con 0x7f726c101990 2024-08-20T01:30:09.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.204+0000 7f72697fa640 1 --2- 172.21.15.22:0/3128132628 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f72540b3c60 0x7f72540b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:09.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.204+0000 7f726b7fe640 1 --2- 172.21.15.22:0/3128132628 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f72540b3c60 0x7f72540b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:09.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.204+0000 7f72697fa640 1 -- 172.21.15.22:0/3128132628 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f725c0e32d0 con 0x7f726c101990 2024-08-20T01:30:09.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.204+0000 7f726b7fe640 1 --2- 172.21.15.22:0/3128132628 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f72540b3c60 0x7f72540b6120 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f726c103bc0 tx=0x7f726000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:09.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.207+0000 7f72697fa640 1 -- 172.21.15.22:0/3128132628 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f725c0aa260 con 0x7f726c101990 2024-08-20T01:30:09.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:09 smithi077 ceph-mon[22251]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 4.9 KiB/s, 0 keys/s, 0 objects/s recovering 2024-08-20T01:30:09.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:09 smithi022 ceph-mon[18709]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 4.9 KiB/s, 0 keys/s, 0 objects/s recovering 2024-08-20T01:30:09.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.419+0000 7f7272731640 1 -- 172.21.15.22:0/3128132628 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f726c1a5e30 con 0x7f726c101990 2024-08-20T01:30:09.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.419+0000 7f72697fa640 1 -- 172.21.15.22:0/3128132628 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f725c0ae7b0 con 0x7f726c101990 2024-08-20T01:30:09.420 INFO:teuthology.orchestra.run.smithi022.stdout:249108103203 2024-08-20T01:30:09.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.421+0000 7f7272731640 1 -- 172.21.15.22:0/3128132628 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f72540b3c60 msgr2=0x7f72540b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:09.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.421+0000 7f7272731640 1 --2- 172.21.15.22:0/3128132628 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f72540b3c60 0x7f72540b6120 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f726c103bc0 tx=0x7f726000a2d0 comp rx=0 tx=0).stop 2024-08-20T01:30:09.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.421+0000 7f7272731640 1 -- 172.21.15.22:0/3128132628 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f726c101990 msgr2=0x7f726c198fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:09.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.421+0000 7f7272731640 1 --2- 172.21.15.22:0/3128132628 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f726c101990 0x7f726c198fc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f725c00b4a0 tx=0x7f725c00b960 comp rx=0 tx=0).stop 2024-08-20T01:30:09.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.422+0000 7f7272731640 1 -- 172.21.15.22:0/3128132628 shutdown_connections 2024-08-20T01:30:09.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.422+0000 7f7272731640 1 --2- 172.21.15.22:0/3128132628 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f72540b3c60 0x7f72540b6120 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:09.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.422+0000 7f7272731640 1 --2- 172.21.15.22:0/3128132628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f726c107d20 0x7f726c19e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:09.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.422+0000 7f7272731640 1 --2- 172.21.15.22:0/3128132628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f726c1073a0 0x7f726c199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:09.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.422+0000 7f7272731640 1 --2- 172.21.15.22:0/3128132628 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f726c101990 0x7f726c198fc0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:09.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.422+0000 7f7272731640 1 -- 172.21.15.22:0/3128132628 >> 172.21.15.22:0/3128132628 conn(0x7f726c0fd400 msgr2=0x7f726c06aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:09.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.422+0000 7f7272731640 1 -- 172.21.15.22:0/3128132628 shutdown_connections 2024-08-20T01:30:09.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:09.422+0000 7f7272731640 1 -- 172.21.15.22:0/3128132628 wait complete. 2024-08-20T01:30:09.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:09 smithi134 ceph-mon[22511]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 4.9 KiB/s, 0 keys/s, 0 objects/s recovering 2024-08-20T01:30:10.210 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:10 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3128132628' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-20T01:30:10.240 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103200 got 249108103203 for osd.9 2024-08-20T01:30:10.240 DEBUG:teuthology.parallel:result is None 2024-08-20T01:30:10.241 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-20T01:30:10.241 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-20T01:30:10.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:10 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3128132628' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-20T01:30:10.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:10 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3128132628' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-20T01:30:10.641 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:11.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.222+0000 7f79d578a640 1 -- 172.21.15.22:0/576659352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79d01039a0 msgr2=0x7f79d0103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:11.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.222+0000 7f79d578a640 1 --2- 172.21.15.22:0/576659352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79d01039a0 0x7f79d0103d80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f79c8009ca0 tx=0x7f79c802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:30:11.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.222+0000 7f79d578a640 1 -- 172.21.15.22:0/576659352 shutdown_connections 2024-08-20T01:30:11.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.222+0000 7f79d578a640 1 --2- 172.21.15.22:0/576659352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79d010ce00 0x7f79d010f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:11.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.222+0000 7f79d578a640 1 --2- 172.21.15.22:0/576659352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d01042c0 0x7f79d010c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:11.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.222+0000 7f79d578a640 1 --2- 172.21.15.22:0/576659352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79d01039a0 0x7f79d0103d80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:11.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.222+0000 7f79d578a640 1 -- 172.21.15.22:0/576659352 >> 172.21.15.22:0/576659352 conn(0x7f79d00fd400 msgr2=0x7f79d00ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:11.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.222+0000 7f79d578a640 1 -- 172.21.15.22:0/576659352 shutdown_connections 2024-08-20T01:30:11.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.222+0000 7f79d578a640 1 -- 172.21.15.22:0/576659352 wait complete. 2024-08-20T01:30:11.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.223+0000 7f79d578a640 1 Processor -- start 2024-08-20T01:30:11.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.223+0000 7f79d578a640 1 -- start start 2024-08-20T01:30:11.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.223+0000 7f79d578a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79d01039a0 0x7f79d019b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:11.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.223+0000 7f79d578a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79d01042c0 0x7f79d019b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:11.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.223+0000 7f79d578a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d010ce00 0x7f79d01a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:11.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.223+0000 7f79d578a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f79d0112ad0 con 0x7f79d01042c0 2024-08-20T01:30:11.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.223+0000 7f79d578a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f79d0112950 con 0x7f79d010ce00 2024-08-20T01:30:11.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.223+0000 7f79d578a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f79d0112c50 con 0x7f79d01039a0 2024-08-20T01:30:11.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.224+0000 7f79ce7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79d01042c0 0x7f79d019b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:11.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.224+0000 7f79ce7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79d01042c0 0x7f79d019b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49524/0 (socket says 172.21.15.22:49524) 2024-08-20T01:30:11.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.224+0000 7f79ce7fc640 1 -- 172.21.15.22:0/4098871675 learned_addr learned my addr 172.21.15.22:0/4098871675 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:11.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.224+0000 7f79ceffd640 1 --2- 172.21.15.22:0/4098871675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79d01039a0 0x7f79d019b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:11.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.224+0000 7f79cf7fe640 1 --2- 172.21.15.22:0/4098871675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d010ce00 0x7f79d01a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:11.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.224+0000 7f79ce7fc640 1 -- 172.21.15.22:0/4098871675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79d01039a0 msgr2=0x7f79d019b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:11.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.224+0000 7f79ce7fc640 1 --2- 172.21.15.22:0/4098871675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79d01039a0 0x7f79d019b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:11.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.224+0000 7f79ce7fc640 1 -- 172.21.15.22:0/4098871675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d010ce00 msgr2=0x7f79d01a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:11.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.224+0000 7f79ce7fc640 1 --2- 172.21.15.22:0/4098871675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d010ce00 0x7f79d01a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:11.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.224+0000 7f79ce7fc640 1 -- 172.21.15.22:0/4098871675 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d01a13a0 con 0x7f79d01042c0 2024-08-20T01:30:11.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.224+0000 7f79ce7fc640 1 --2- 172.21.15.22:0/4098871675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79d01042c0 0x7f79d019b830 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f79b800b3c0 tx=0x7f79b800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.224+0000 7f79c7fff640 1 -- 172.21.15.22:0/4098871675 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b8011830 con 0x7f79d01042c0 2024-08-20T01:30:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.224+0000 7f79c7fff640 1 -- 172.21.15.22:0/4098871675 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79b8016070 con 0x7f79d01042c0 2024-08-20T01:30:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.224+0000 7f79d578a640 1 -- 172.21.15.22:0/4098871675 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d01a1690 con 0x7f79d01042c0 2024-08-20T01:30:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.224+0000 7f79c7fff640 1 -- 172.21.15.22:0/4098871675 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b8010de0 con 0x7f79d01042c0 2024-08-20T01:30:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.224+0000 7f79d578a640 1 -- 172.21.15.22:0/4098871675 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d01a7d50 con 0x7f79d01042c0 2024-08-20T01:30:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.225+0000 7f79d578a640 1 -- 172.21.15.22:0/4098871675 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79d0103d80 con 0x7f79d01042c0 2024-08-20T01:30:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.227+0000 7f79c7fff640 1 -- 172.21.15.22:0/4098871675 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f79b80119d0 con 0x7f79d01042c0 2024-08-20T01:30:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.227+0000 7f79c7fff640 1 --2- 172.21.15.22:0/4098871675 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f79bc0b3c60 0x7f79bc0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.228+0000 7f79ceffd640 1 --2- 172.21.15.22:0/4098871675 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f79bc0b3c60 0x7f79bc0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.228+0000 7f79c7fff640 1 -- 172.21.15.22:0/4098871675 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f79b80e38e0 con 0x7f79d01042c0 2024-08-20T01:30:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.228+0000 7f79ceffd640 1 --2- 172.21.15.22:0/4098871675 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f79bc0b3c60 0x7f79bc0b6120 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f79c80098d0 tx=0x7f79c8009900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.230+0000 7f79c7fff640 1 -- 172.21.15.22:0/4098871675 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f79b80aaec0 con 0x7f79d01042c0 2024-08-20T01:30:11.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:11 smithi022 ceph-mon[18709]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:11.416 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:11 smithi134 ceph-mon[22511]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:11.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.433+0000 7f79d578a640 1 -- 172.21.15.22:0/4098871675 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f79d0102d60 con 0x7f79bc0b3c60 2024-08-20T01:30:11.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.438+0000 7f79c7fff640 1 -- 172.21.15.22:0/4098871675 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258977 (secure 0 0 0) 0x7f79d0102d60 con 0x7f79bc0b3c60 2024-08-20T01:30:11.441 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:11.443 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-08-20T01:30:11.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.441+0000 7f79d578a640 1 -- 172.21.15.22:0/4098871675 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f79bc0b3c60 msgr2=0x7f79bc0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:11.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.441+0000 7f79d578a640 1 --2- 172.21.15.22:0/4098871675 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f79bc0b3c60 0x7f79bc0b6120 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f79c80098d0 tx=0x7f79c8009900 comp rx=0 tx=0).stop 2024-08-20T01:30:11.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.441+0000 7f79d578a640 1 -- 172.21.15.22:0/4098871675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79d01042c0 msgr2=0x7f79d019b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:11.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.441+0000 7f79d578a640 1 --2- 172.21.15.22:0/4098871675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79d01042c0 0x7f79d019b830 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f79b800b3c0 tx=0x7f79b800b880 comp rx=0 tx=0).stop 2024-08-20T01:30:11.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.441+0000 7f79d578a640 1 -- 172.21.15.22:0/4098871675 shutdown_connections 2024-08-20T01:30:11.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.441+0000 7f79d578a640 1 --2- 172.21.15.22:0/4098871675 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f79bc0b3c60 0x7f79bc0b6120 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:11.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.441+0000 7f79d578a640 1 --2- 172.21.15.22:0/4098871675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d010ce00 0x7f79d01a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:11.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.441+0000 7f79d578a640 1 --2- 172.21.15.22:0/4098871675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79d01042c0 0x7f79d019b830 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:11.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.441+0000 7f79d578a640 1 --2- 172.21.15.22:0/4098871675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79d01039a0 0x7f79d019b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:11.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.441+0000 7f79d578a640 1 -- 172.21.15.22:0/4098871675 >> 172.21.15.22:0/4098871675 conn(0x7f79d00fd400 msgr2=0x7f79d010f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:11.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.442+0000 7f79d578a640 1 -- 172.21.15.22:0/4098871675 shutdown_connections 2024-08-20T01:30:11.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:11.442+0000 7f79d578a640 1 -- 172.21.15.22:0/4098871675 wait complete. 2024-08-20T01:30:11.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:11 smithi077 ceph-mon[22251]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:12.117 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-08-20T01:30:11.311686+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654365,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":426,"num_read_kb":307,"num_write":289,"num_write_kb":2261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":3011602,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363724,"kb_used_data":10228,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124578100,"statfs":{"total":1151940427776,"available":1151567974400,"internally_reserved":0,"allocated":10473472,"data_stored":6834255,"data_compressed":187808,"data_compressed_allocated":245760,"data_compressed_original":2023424,"omap_allocated":19139,"internal_metadata":361674045},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003335"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019956+0000","last_change":"2024-08-20T01:29:06.421092+0000","last_active":"2024-08-20T01:29:55.019956+0000","last_peered":"2024-08-20T01:29:55.019956+0000","last_clean":"2024-08-20T01:29:55.019956+0000","last_became_active":"2024-08-20T01:29:06.420484+0000","last_became_peered":"2024-08-20T01:29:06.420484+0000","last_unstale":"2024-08-20T01:29:55.019956+0000","last_undegraded":"2024-08-20T01:29:55.019956+0000","last_fullsized":"2024-08-20T01:29:55.019956+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:55:54.177863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255444+0000","last_change":"2024-08-20T01:29:06.414784+0000","last_active":"2024-08-20T01:29:55.255444+0000","last_peered":"2024-08-20T01:29:55.255444+0000","last_clean":"2024-08-20T01:29:55.255444+0000","last_became_active":"2024-08-20T01:29:06.414426+0000","last_became_peered":"2024-08-20T01:29:06.414426+0000","last_unstale":"2024-08-20T01:29:55.255444+0000","last_undegraded":"2024-08-20T01:29:55.255444+0000","last_fullsized":"2024-08-20T01:29:55.255444+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:13:45.634888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255373+0000","last_change":"2024-08-20T01:29:06.416876+0000","last_active":"2024-08-20T01:29:55.255373+0000","last_peered":"2024-08-20T01:29:55.255373+0000","last_clean":"2024-08-20T01:29:55.255373+0000","last_became_active":"2024-08-20T01:29:06.416548+0000","last_became_peered":"2024-08-20T01:29:06.416548+0000","last_unstale":"2024-08-20T01:29:55.255373+0000","last_undegraded":"2024-08-20T01:29:55.255373+0000","last_fullsized":"2024-08-20T01:29:55.255373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:16:23.092129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019553+0000","last_change":"2024-08-20T01:29:06.415474+0000","last_active":"2024-08-20T01:29:55.019553+0000","last_peered":"2024-08-20T01:29:55.019553+0000","last_clean":"2024-08-20T01:29:55.019553+0000","last_became_active":"2024-08-20T01:29:06.415120+0000","last_became_peered":"2024-08-20T01:29:06.415120+0000","last_unstale":"2024-08-20T01:29:55.019553+0000","last_undegraded":"2024-08-20T01:29:55.019553+0000","last_fullsized":"2024-08-20T01:29:55.019553+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:47.059173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.022520+0000","last_change":"2024-08-20T01:29:55.022459+0000","last_active":"2024-08-20T01:29:55.022520+0000","last_peered":"2024-08-20T01:29:55.022520+0000","last_clean":"2024-08-20T01:29:55.022520+0000","last_became_active":"2024-08-20T01:29:55.022110+0000","last_became_peered":"2024-08-20T01:29:55.022110+0000","last_unstale":"2024-08-20T01:29:55.022520+0000","last_undegraded":"2024-08-20T01:29:55.022520+0000","last_fullsized":"2024-08-20T01:29:55.022520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:56:44.318445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024716+0000","last_change":"2024-08-20T01:29:06.420995+0000","last_active":"2024-08-20T01:29:55.024716+0000","last_peered":"2024-08-20T01:29:55.024716+0000","last_clean":"2024-08-20T01:29:55.024716+0000","last_became_active":"2024-08-20T01:29:06.420703+0000","last_became_peered":"2024-08-20T01:29:06.420703+0000","last_unstale":"2024-08-20T01:29:55.024716+0000","last_undegraded":"2024-08-20T01:29:55.024716+0000","last_fullsized":"2024-08-20T01:29:55.024716+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:21:08.502158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376076+0000","last_change":"2024-08-20T01:29:06.411605+0000","last_active":"2024-08-20T01:29:55.376076+0000","last_peered":"2024-08-20T01:29:55.376076+0000","last_clean":"2024-08-20T01:29:55.376076+0000","last_became_active":"2024-08-20T01:29:06.411258+0000","last_became_peered":"2024-08-20T01:29:06.411258+0000","last_unstale":"2024-08-20T01:29:55.376076+0000","last_undegraded":"2024-08-20T01:29:55.376076+0000","last_fullsized":"2024-08-20T01:29:55.376076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:17:02.390707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017993+0000","last_change":"2024-08-20T01:29:06.418514+0000","last_active":"2024-08-20T01:29:55.017993+0000","last_peered":"2024-08-20T01:29:55.017993+0000","last_clean":"2024-08-20T01:29:55.017993+0000","last_became_active":"2024-08-20T01:29:06.417450+0000","last_became_peered":"2024-08-20T01:29:06.417450+0000","last_unstale":"2024-08-20T01:29:55.017993+0000","last_undegraded":"2024-08-20T01:29:55.017993+0000","last_fullsized":"2024-08-20T01:29:55.017993+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:13:15.485333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.028241+0000","last_change":"2024-08-20T01:29:06.425458+0000","last_active":"2024-08-20T01:29:55.028241+0000","last_peered":"2024-08-20T01:29:55.028241+0000","last_clean":"2024-08-20T01:29:55.028241+0000","last_became_active":"2024-08-20T01:29:06.425122+0000","last_became_peered":"2024-08-20T01:29:06.425122+0000","last_unstale":"2024-08-20T01:29:55.028241+0000","last_undegraded":"2024-08-20T01:29:55.028241+0000","last_fullsized":"2024-08-20T01:29:55.028241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:52:59.857195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.025175+0000","last_change":"2024-08-20T01:29:06.420258+0000","last_active":"2024-08-20T01:29:55.025175+0000","last_peered":"2024-08-20T01:29:55.025175+0000","last_clean":"2024-08-20T01:29:55.025175+0000","last_became_active":"2024-08-20T01:29:06.419982+0000","last_became_peered":"2024-08-20T01:29:06.419982+0000","last_unstale":"2024-08-20T01:29:55.025175+0000","last_undegraded":"2024-08-20T01:29:55.025175+0000","last_fullsized":"2024-08-20T01:29:55.025175+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:56:23.296739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376666+0000","last_change":"2024-08-20T01:29:06.421580+0000","last_active":"2024-08-20T01:29:55.376666+0000","last_peered":"2024-08-20T01:29:55.376666+0000","last_clean":"2024-08-20T01:29:55.376666+0000","last_became_active":"2024-08-20T01:29:06.421115+0000","last_became_peered":"2024-08-20T01:29:06.421115+0000","last_unstale":"2024-08-20T01:29:55.376666+0000","last_undegraded":"2024-08-20T01:29:55.376666+0000","last_fullsized":"2024-08-20T01:29:55.376666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:43:13.839230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019544+0000","last_change":"2024-08-20T01:29:06.416950+0000","last_active":"2024-08-20T01:29:55.019544+0000","last_peered":"2024-08-20T01:29:55.019544+0000","last_clean":"2024-08-20T01:29:55.019544+0000","last_became_active":"2024-08-20T01:29:06.415585+0000","last_became_peered":"2024-08-20T01:29:06.415585+0000","last_unstale":"2024-08-20T01:29:55.019544+0000","last_undegraded":"2024-08-20T01:29:55.019544+0000","last_fullsized":"2024-08-20T01:29:55.019544+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:47:54.132535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027677+0000","last_change":"2024-08-20T01:29:55.027622+0000","last_active":"2024-08-20T01:29:55.027677+0000","last_peered":"2024-08-20T01:29:55.027677+0000","last_clean":"2024-08-20T01:29:55.027677+0000","last_became_active":"2024-08-20T01:29:55.027246+0000","last_became_peered":"2024-08-20T01:29:55.027246+0000","last_unstale":"2024-08-20T01:29:55.027677+0000","last_undegraded":"2024-08-20T01:29:55.027677+0000","last_fullsized":"2024-08-20T01:29:55.027677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:30:25.209975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255506+0000","last_change":"2024-08-20T01:29:06.415494+0000","last_active":"2024-08-20T01:29:55.255506+0000","last_peered":"2024-08-20T01:29:55.255506+0000","last_clean":"2024-08-20T01:29:55.255506+0000","last_became_active":"2024-08-20T01:29:06.415099+0000","last_became_peered":"2024-08-20T01:29:06.415099+0000","last_unstale":"2024-08-20T01:29:55.255506+0000","last_undegraded":"2024-08-20T01:29:55.255506+0000","last_fullsized":"2024-08-20T01:29:55.255506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:07:01.946143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255184+0000","last_change":"2024-08-20T01:29:06.418233+0000","last_active":"2024-08-20T01:29:55.255184+0000","last_peered":"2024-08-20T01:29:55.255184+0000","last_clean":"2024-08-20T01:29:55.255184+0000","last_became_active":"2024-08-20T01:29:06.417929+0000","last_became_peered":"2024-08-20T01:29:06.417929+0000","last_unstale":"2024-08-20T01:29:55.255184+0000","last_undegraded":"2024-08-20T01:29:55.255184+0000","last_fullsized":"2024-08-20T01:29:55.255184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:44:08.548821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027280+0000","last_change":"2024-08-20T01:29:06.418819+0000","last_active":"2024-08-20T01:29:55.027280+0000","last_peered":"2024-08-20T01:29:55.027280+0000","last_clean":"2024-08-20T01:29:55.027280+0000","last_became_active":"2024-08-20T01:29:06.418378+0000","last_became_peered":"2024-08-20T01:29:06.418378+0000","last_unstale":"2024-08-20T01:29:55.027280+0000","last_undegraded":"2024-08-20T01:29:55.027280+0000","last_fullsized":"2024-08-20T01:29:55.027280+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:01.419539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.020071+0000","last_change":"2024-08-20T01:29:06.420804+0000","last_active":"2024-08-20T01:29:55.020071+0000","last_peered":"2024-08-20T01:29:55.020071+0000","last_clean":"2024-08-20T01:29:55.020071+0000","last_became_active":"2024-08-20T01:29:06.420027+0000","last_became_peered":"2024-08-20T01:29:06.420027+0000","last_unstale":"2024-08-20T01:29:55.020071+0000","last_undegraded":"2024-08-20T01:29:55.020071+0000","last_fullsized":"2024-08-20T01:29:55.020071+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:00:37.104792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015970+0000","last_change":"2024-08-20T01:29:06.411625+0000","last_active":"2024-08-20T01:29:55.015970+0000","last_peered":"2024-08-20T01:29:55.015970+0000","last_clean":"2024-08-20T01:29:55.015970+0000","last_became_active":"2024-08-20T01:29:06.411284+0000","last_became_peered":"2024-08-20T01:29:06.411284+0000","last_unstale":"2024-08-20T01:29:55.015970+0000","last_undegraded":"2024-08-20T01:29:55.015970+0000","last_fullsized":"2024-08-20T01:29:55.015970+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:12:08.510755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021766+0000","last_change":"2024-08-20T01:29:06.421276+0000","last_active":"2024-08-20T01:29:55.021766+0000","last_peered":"2024-08-20T01:29:55.021766+0000","last_clean":"2024-08-20T01:29:55.021766+0000","last_became_active":"2024-08-20T01:29:06.420916+0000","last_became_peered":"2024-08-20T01:29:06.420916+0000","last_unstale":"2024-08-20T01:29:55.021766+0000","last_undegraded":"2024-08-20T01:29:55.021766+0000","last_fullsized":"2024-08-20T01:29:55.021766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:04:59.399172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.020688+0000","last_change":"2024-08-20T01:29:06.420848+0000","last_active":"2024-08-20T01:29:55.020688+0000","last_peered":"2024-08-20T01:29:55.020688+0000","last_clean":"2024-08-20T01:29:55.020688+0000","last_became_active":"2024-08-20T01:29:06.420465+0000","last_became_peered":"2024-08-20T01:29:06.420465+0000","last_unstale":"2024-08-20T01:29:55.020688+0000","last_undegraded":"2024-08-20T01:29:55.020688+0000","last_fullsized":"2024-08-20T01:29:55.020688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:42:33.210813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019585+0000","last_change":"2024-08-20T01:29:06.407353+0000","last_active":"2024-08-20T01:29:55.019585+0000","last_peered":"2024-08-20T01:29:55.019585+0000","last_clean":"2024-08-20T01:29:55.019585+0000","last_became_active":"2024-08-20T01:29:06.406944+0000","last_became_peered":"2024-08-20T01:29:06.406944+0000","last_unstale":"2024-08-20T01:29:55.019585+0000","last_undegraded":"2024-08-20T01:29:55.019585+0000","last_fullsized":"2024-08-20T01:29:55.019585+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:49:22.324317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027678+0000","last_change":"2024-08-20T01:29:06.419757+0000","last_active":"2024-08-20T01:29:55.027678+0000","last_peered":"2024-08-20T01:29:55.027678+0000","last_clean":"2024-08-20T01:29:55.027678+0000","last_became_active":"2024-08-20T01:29:06.419433+0000","last_became_peered":"2024-08-20T01:29:06.419433+0000","last_unstale":"2024-08-20T01:29:55.027678+0000","last_undegraded":"2024-08-20T01:29:55.027678+0000","last_fullsized":"2024-08-20T01:29:55.027678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:22:36.968949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018072+0000","last_change":"2024-08-20T01:29:06.418110+0000","last_active":"2024-08-20T01:29:55.018072+0000","last_peered":"2024-08-20T01:29:55.018072+0000","last_clean":"2024-08-20T01:29:55.018072+0000","last_became_active":"2024-08-20T01:29:06.417776+0000","last_became_peered":"2024-08-20T01:29:06.417776+0000","last_unstale":"2024-08-20T01:29:55.018072+0000","last_undegraded":"2024-08-20T01:29:55.018072+0000","last_fullsized":"2024-08-20T01:29:55.018072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:55:55.105453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.016549+0000","last_change":"2024-08-20T01:29:06.414240+0000","last_active":"2024-08-20T01:29:55.016549+0000","last_peered":"2024-08-20T01:29:55.016549+0000","last_clean":"2024-08-20T01:29:55.016549+0000","last_became_active":"2024-08-20T01:29:06.413884+0000","last_became_peered":"2024-08-20T01:29:06.413884+0000","last_unstale":"2024-08-20T01:29:55.016549+0000","last_undegraded":"2024-08-20T01:29:55.016549+0000","last_fullsized":"2024-08-20T01:29:55.016549+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:00.042588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018340+0000","last_change":"2024-08-20T01:29:06.419344+0000","last_active":"2024-08-20T01:29:55.018340+0000","last_peered":"2024-08-20T01:29:55.018340+0000","last_clean":"2024-08-20T01:29:55.018340+0000","last_became_active":"2024-08-20T01:29:06.418689+0000","last_became_peered":"2024-08-20T01:29:06.418689+0000","last_unstale":"2024-08-20T01:29:55.018340+0000","last_undegraded":"2024-08-20T01:29:55.018340+0000","last_fullsized":"2024-08-20T01:29:55.018340+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:34:23.604213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.022077+0000","last_change":"2024-08-20T01:29:06.415161+0000","last_active":"2024-08-20T01:29:55.022077+0000","last_peered":"2024-08-20T01:29:55.022077+0000","last_clean":"2024-08-20T01:29:55.022077+0000","last_became_active":"2024-08-20T01:29:06.414812+0000","last_became_peered":"2024-08-20T01:29:06.414812+0000","last_unstale":"2024-08-20T01:29:55.022077+0000","last_undegraded":"2024-08-20T01:29:55.022077+0000","last_fullsized":"2024-08-20T01:29:55.022077+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:10:49.527635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021022+0000","last_change":"2024-08-20T01:29:06.416502+0000","last_active":"2024-08-20T01:29:55.021022+0000","last_peered":"2024-08-20T01:29:55.021022+0000","last_clean":"2024-08-20T01:29:55.021022+0000","last_became_active":"2024-08-20T01:29:06.416139+0000","last_became_peered":"2024-08-20T01:29:06.416139+0000","last_unstale":"2024-08-20T01:29:55.021022+0000","last_undegraded":"2024-08-20T01:29:55.021022+0000","last_fullsized":"2024-08-20T01:29:55.021022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:19:32.379867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019525+0000","last_change":"2024-08-20T01:29:06.412494+0000","last_active":"2024-08-20T01:29:55.019525+0000","last_peered":"2024-08-20T01:29:55.019525+0000","last_clean":"2024-08-20T01:29:55.019525+0000","last_became_active":"2024-08-20T01:29:06.412158+0000","last_became_peered":"2024-08-20T01:29:06.412158+0000","last_unstale":"2024-08-20T01:29:55.019525+0000","last_undegraded":"2024-08-20T01:29:55.019525+0000","last_fullsized":"2024-08-20T01:29:55.019525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:57:52.088445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255479+0000","last_change":"2024-08-20T01:29:06.412869+0000","last_active":"2024-08-20T01:29:55.255479+0000","last_peered":"2024-08-20T01:29:55.255479+0000","last_clean":"2024-08-20T01:29:55.255479+0000","last_became_active":"2024-08-20T01:29:06.412540+0000","last_became_peered":"2024-08-20T01:29:06.412540+0000","last_unstale":"2024-08-20T01:29:55.255479+0000","last_undegraded":"2024-08-20T01:29:55.255479+0000","last_fullsized":"2024-08-20T01:29:55.255479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:11:10.011252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.256428+0000","last_change":"2024-08-20T01:29:55.256345+0000","last_active":"2024-08-20T01:29:55.256428+0000","last_peered":"2024-08-20T01:29:55.256428+0000","last_clean":"2024-08-20T01:29:55.256428+0000","last_became_active":"2024-08-20T01:29:55.256001+0000","last_became_peered":"2024-08-20T01:29:55.256001+0000","last_unstale":"2024-08-20T01:29:55.256428+0000","last_undegraded":"2024-08-20T01:29:55.256428+0000","last_fullsized":"2024-08-20T01:29:55.256428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:02:02.453668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.022020+0000","last_change":"2024-08-20T01:29:06.423874+0000","last_active":"2024-08-20T01:29:55.022020+0000","last_peered":"2024-08-20T01:29:55.022020+0000","last_clean":"2024-08-20T01:29:55.022020+0000","last_became_active":"2024-08-20T01:29:06.423561+0000","last_became_peered":"2024-08-20T01:29:06.423561+0000","last_unstale":"2024-08-20T01:29:55.022020+0000","last_undegraded":"2024-08-20T01:29:55.022020+0000","last_fullsized":"2024-08-20T01:29:55.022020+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:13:53.654099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019575+0000","last_change":"2024-08-20T01:29:06.414212+0000","last_active":"2024-08-20T01:29:55.019575+0000","last_peered":"2024-08-20T01:29:55.019575+0000","last_clean":"2024-08-20T01:29:55.019575+0000","last_became_active":"2024-08-20T01:29:06.413848+0000","last_became_peered":"2024-08-20T01:29:06.413848+0000","last_unstale":"2024-08-20T01:29:55.019575+0000","last_undegraded":"2024-08-20T01:29:55.019575+0000","last_fullsized":"2024-08-20T01:29:55.019575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:00:29.005461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.377988+0000","last_change":"2024-08-20T01:29:55.377940+0000","last_active":"2024-08-20T01:29:55.377988+0000","last_peered":"2024-08-20T01:29:55.377988+0000","last_clean":"2024-08-20T01:29:55.377988+0000","last_became_active":"2024-08-20T01:29:55.377642+0000","last_became_peered":"2024-08-20T01:29:55.377642+0000","last_unstale":"2024-08-20T01:29:55.377988+0000","last_undegraded":"2024-08-20T01:29:55.377988+0000","last_fullsized":"2024-08-20T01:29:55.377988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:55:28.416610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":86,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:08.555282+0000","last_change":"2024-08-20T01:29:04.413482+0000","last_active":"2024-08-20T01:30:08.555282+0000","last_peered":"2024-08-20T01:30:08.555282+0000","last_clean":"2024-08-20T01:30:08.555282+0000","last_became_active":"2024-08-20T01:29:04.413096+0000","last_became_peered":"2024-08-20T01:29:04.413096+0000","last_unstale":"2024-08-20T01:30:08.555282+0000","last_undegraded":"2024-08-20T01:30:08.555282+0000","last_fullsized":"2024-08-20T01:30:08.555282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:26:05.947182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.022224+0000","last_change":"2024-08-20T01:29:55.022156+0000","last_active":"2024-08-20T01:29:55.022224+0000","last_peered":"2024-08-20T01:29:55.022224+0000","last_clean":"2024-08-20T01:29:55.022224+0000","last_became_active":"2024-08-20T01:29:55.021604+0000","last_became_peered":"2024-08-20T01:29:55.021604+0000","last_unstale":"2024-08-20T01:29:55.022224+0000","last_undegraded":"2024-08-20T01:29:55.022224+0000","last_fullsized":"2024-08-20T01:29:55.022224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:28:35.155390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024796+0000","last_change":"2024-08-20T01:29:04.409605+0000","last_active":"2024-08-20T01:29:55.024796+0000","last_peered":"2024-08-20T01:29:55.024796+0000","last_clean":"2024-08-20T01:29:55.024796+0000","last_became_active":"2024-08-20T01:29:04.409284+0000","last_became_peered":"2024-08-20T01:29:04.409284+0000","last_unstale":"2024-08-20T01:29:55.024796+0000","last_undegraded":"2024-08-20T01:29:55.024796+0000","last_fullsized":"2024-08-20T01:29:55.024796+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:29:27.471748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019177+0000","last_change":"2024-08-20T01:29:04.400635+0000","last_active":"2024-08-20T01:29:55.019177+0000","last_peered":"2024-08-20T01:29:55.019177+0000","last_clean":"2024-08-20T01:29:55.019177+0000","last_became_active":"2024-08-20T01:29:04.400234+0000","last_became_peered":"2024-08-20T01:29:04.400234+0000","last_unstale":"2024-08-20T01:29:55.019177+0000","last_undegraded":"2024-08-20T01:29:55.019177+0000","last_fullsized":"2024-08-20T01:29:55.019177+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:47:24.810916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018056+0000","last_change":"2024-08-20T01:29:06.411872+0000","last_active":"2024-08-20T01:29:55.018056+0000","last_peered":"2024-08-20T01:29:55.018056+0000","last_clean":"2024-08-20T01:29:55.018056+0000","last_became_active":"2024-08-20T01:29:06.411563+0000","last_became_peered":"2024-08-20T01:29:06.411563+0000","last_unstale":"2024-08-20T01:29:55.018056+0000","last_undegraded":"2024-08-20T01:29:55.018056+0000","last_fullsized":"2024-08-20T01:29:55.018056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:03:37.351529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017046+0000","last_change":"2024-08-20T01:29:04.407395+0000","last_active":"2024-08-20T01:29:55.017046+0000","last_peered":"2024-08-20T01:29:55.017046+0000","last_clean":"2024-08-20T01:29:55.017046+0000","last_became_active":"2024-08-20T01:29:04.407000+0000","last_became_peered":"2024-08-20T01:29:04.407000+0000","last_unstale":"2024-08-20T01:29:55.017046+0000","last_undegraded":"2024-08-20T01:29:55.017046+0000","last_fullsized":"2024-08-20T01:29:55.017046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:36:42.512450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015687+0000","last_change":"2024-08-20T01:29:06.410094+0000","last_active":"2024-08-20T01:29:55.015687+0000","last_peered":"2024-08-20T01:29:55.015687+0000","last_clean":"2024-08-20T01:29:55.015687+0000","last_became_active":"2024-08-20T01:29:06.409749+0000","last_became_peered":"2024-08-20T01:29:06.409749+0000","last_unstale":"2024-08-20T01:29:55.015687+0000","last_undegraded":"2024-08-20T01:29:55.015687+0000","last_fullsized":"2024-08-20T01:29:55.015687+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:52:51.072953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":81,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:09.556042+0000","last_change":"2024-08-20T01:29:04.406810+0000","last_active":"2024-08-20T01:30:09.556042+0000","last_peered":"2024-08-20T01:30:09.556042+0000","last_clean":"2024-08-20T01:30:09.556042+0000","last_became_active":"2024-08-20T01:29:04.406436+0000","last_became_peered":"2024-08-20T01:29:04.406436+0000","last_unstale":"2024-08-20T01:30:09.556042+0000","last_undegraded":"2024-08-20T01:30:09.556042+0000","last_fullsized":"2024-08-20T01:30:09.556042+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:49:57.305447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.028186+0000","last_change":"2024-08-20T01:29:06.424442+0000","last_active":"2024-08-20T01:29:55.028186+0000","last_peered":"2024-08-20T01:29:55.028186+0000","last_clean":"2024-08-20T01:29:55.028186+0000","last_became_active":"2024-08-20T01:29:06.424132+0000","last_became_peered":"2024-08-20T01:29:06.424132+0000","last_unstale":"2024-08-20T01:29:55.028186+0000","last_undegraded":"2024-08-20T01:29:55.028186+0000","last_fullsized":"2024-08-20T01:29:55.028186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:31:30.861113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376745+0000","last_change":"2024-08-20T01:29:04.412307+0000","last_active":"2024-08-20T01:29:55.376745+0000","last_peered":"2024-08-20T01:29:55.376745+0000","last_clean":"2024-08-20T01:29:55.376745+0000","last_became_active":"2024-08-20T01:29:04.411861+0000","last_became_peered":"2024-08-20T01:29:04.411861+0000","last_unstale":"2024-08-20T01:29:55.376745+0000","last_undegraded":"2024-08-20T01:29:55.376745+0000","last_fullsized":"2024-08-20T01:29:55.376745+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:56:51.356821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255721+0000","last_change":"2024-08-20T01:29:06.418525+0000","last_active":"2024-08-20T01:29:55.255721+0000","last_peered":"2024-08-20T01:29:55.255721+0000","last_clean":"2024-08-20T01:29:55.255721+0000","last_became_active":"2024-08-20T01:29:06.417902+0000","last_became_peered":"2024-08-20T01:29:06.417902+0000","last_unstale":"2024-08-20T01:29:55.255721+0000","last_undegraded":"2024-08-20T01:29:55.255721+0000","last_fullsized":"2024-08-20T01:29:55.255721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:28:23.017315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017602+0000","last_change":"2024-08-20T01:29:05.171538+0000","last_active":"2024-08-20T01:29:55.017602+0000","last_peered":"2024-08-20T01:29:55.017602+0000","last_clean":"2024-08-20T01:29:55.017602+0000","last_became_active":"2024-08-20T01:29:05.171172+0000","last_became_peered":"2024-08-20T01:29:05.171172+0000","last_unstale":"2024-08-20T01:29:55.017602+0000","last_undegraded":"2024-08-20T01:29:55.017602+0000","last_fullsized":"2024-08-20T01:29:55.017602+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:04:27.968049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027866+0000","last_change":"2024-08-20T01:29:06.426886+0000","last_active":"2024-08-20T01:29:55.027866+0000","last_peered":"2024-08-20T01:29:55.027866+0000","last_clean":"2024-08-20T01:29:55.027866+0000","last_became_active":"2024-08-20T01:29:06.426569+0000","last_became_peered":"2024-08-20T01:29:06.426569+0000","last_unstale":"2024-08-20T01:29:55.027866+0000","last_undegraded":"2024-08-20T01:29:55.027866+0000","last_fullsized":"2024-08-20T01:29:55.027866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:34:21.948591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'28","reported_seq":187,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:10.057722+0000","last_change":"2024-08-20T01:29:55.038445+0000","last_active":"2024-08-20T01:30:10.057722+0000","last_peered":"2024-08-20T01:30:10.057722+0000","last_clean":"2024-08-20T01:30:10.057722+0000","last_became_active":"2024-08-20T01:29:55.030683+0000","last_became_peered":"2024-08-20T01:29:55.030683+0000","last_unstale":"2024-08-20T01:30:10.057722+0000","last_undegraded":"2024-08-20T01:30:10.057722+0000","last_fullsized":"2024-08-20T01:30:10.057722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:07:42.592996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59762,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":114,"num_write":29,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":59762,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018478+0000","last_change":"2024-08-20T01:29:06.417097+0000","last_active":"2024-08-20T01:29:55.018478+0000","last_peered":"2024-08-20T01:29:55.018478+0000","last_clean":"2024-08-20T01:29:55.018478+0000","last_became_active":"2024-08-20T01:29:06.416491+0000","last_became_peered":"2024-08-20T01:29:06.416491+0000","last_unstale":"2024-08-20T01:29:55.018478+0000","last_undegraded":"2024-08-20T01:29:55.018478+0000","last_fullsized":"2024-08-20T01:29:55.018478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:30:16.071161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021546+0000","last_change":"2024-08-20T01:29:04.412071+0000","last_active":"2024-08-20T01:29:55.021546+0000","last_peered":"2024-08-20T01:29:55.021546+0000","last_clean":"2024-08-20T01:29:55.021546+0000","last_became_active":"2024-08-20T01:29:04.411741+0000","last_became_peered":"2024-08-20T01:29:04.411741+0000","last_unstale":"2024-08-20T01:29:55.021546+0000","last_undegraded":"2024-08-20T01:29:55.021546+0000","last_fullsized":"2024-08-20T01:29:55.021546+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:33:47.753754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019405+0000","last_change":"2024-08-20T01:29:06.408996+0000","last_active":"2024-08-20T01:29:55.019405+0000","last_peered":"2024-08-20T01:29:55.019405+0000","last_clean":"2024-08-20T01:29:55.019405+0000","last_became_active":"2024-08-20T01:29:06.408685+0000","last_became_peered":"2024-08-20T01:29:06.408685+0000","last_unstale":"2024-08-20T01:29:55.019405+0000","last_undegraded":"2024-08-20T01:29:55.019405+0000","last_fullsized":"2024-08-20T01:29:55.019405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:18:28.974108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017430+0000","last_change":"2024-08-20T01:29:04.407852+0000","last_active":"2024-08-20T01:29:55.017430+0000","last_peered":"2024-08-20T01:29:55.017430+0000","last_clean":"2024-08-20T01:29:55.017430+0000","last_became_active":"2024-08-20T01:29:04.406828+0000","last_became_peered":"2024-08-20T01:29:04.406828+0000","last_unstale":"2024-08-20T01:29:55.017430+0000","last_undegraded":"2024-08-20T01:29:55.017430+0000","last_fullsized":"2024-08-20T01:29:55.017430+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:36:03.641146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376676+0000","last_change":"2024-08-20T01:29:06.418652+0000","last_active":"2024-08-20T01:29:55.376676+0000","last_peered":"2024-08-20T01:29:55.376676+0000","last_clean":"2024-08-20T01:29:55.376676+0000","last_became_active":"2024-08-20T01:29:06.418340+0000","last_became_peered":"2024-08-20T01:29:06.418340+0000","last_unstale":"2024-08-20T01:29:55.376676+0000","last_undegraded":"2024-08-20T01:29:55.376676+0000","last_fullsized":"2024-08-20T01:29:55.376676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:56:30.194426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'3","reported_seq":82,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:08.570429+0000","last_change":"2024-08-20T01:29:04.405950+0000","last_active":"2024-08-20T01:30:08.570429+0000","last_peered":"2024-08-20T01:30:08.570429+0000","last_clean":"2024-08-20T01:30:08.570429+0000","last_became_active":"2024-08-20T01:29:04.405650+0000","last_became_peered":"2024-08-20T01:29:04.405650+0000","last_unstale":"2024-08-20T01:30:08.570429+0000","last_undegraded":"2024-08-20T01:30:08.570429+0000","last_fullsized":"2024-08-20T01:30:08.570429+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:12:01.752958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376068+0000","last_change":"2024-08-20T01:29:06.413967+0000","last_active":"2024-08-20T01:29:55.376068+0000","last_peered":"2024-08-20T01:29:55.376068+0000","last_clean":"2024-08-20T01:29:55.376068+0000","last_became_active":"2024-08-20T01:29:06.413628+0000","last_became_peered":"2024-08-20T01:29:06.413628+0000","last_unstale":"2024-08-20T01:29:55.376068+0000","last_undegraded":"2024-08-20T01:29:55.376068+0000","last_fullsized":"2024-08-20T01:29:55.376068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:09:16.394482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018723+0000","last_change":"2024-08-20T01:29:05.169872+0000","last_active":"2024-08-20T01:29:55.018723+0000","last_peered":"2024-08-20T01:29:55.018723+0000","last_clean":"2024-08-20T01:29:55.018723+0000","last_became_active":"2024-08-20T01:29:05.169186+0000","last_became_peered":"2024-08-20T01:29:05.169186+0000","last_unstale":"2024-08-20T01:29:55.018723+0000","last_undegraded":"2024-08-20T01:29:55.018723+0000","last_fullsized":"2024-08-20T01:29:55.018723+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:55:47.447959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.030862+0000","last_change":"2024-08-20T01:29:55.030761+0000","last_active":"2024-08-20T01:29:55.030862+0000","last_peered":"2024-08-20T01:29:55.030862+0000","last_clean":"2024-08-20T01:29:55.030862+0000","last_became_active":"2024-08-20T01:29:55.030308+0000","last_became_peered":"2024-08-20T01:29:55.030308+0000","last_unstale":"2024-08-20T01:29:55.030862+0000","last_undegraded":"2024-08-20T01:29:55.030862+0000","last_fullsized":"2024-08-20T01:29:55.030862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:27:57.082711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018547+0000","last_change":"2024-08-20T01:29:04.408188+0000","last_active":"2024-08-20T01:29:55.018547+0000","last_peered":"2024-08-20T01:29:55.018547+0000","last_clean":"2024-08-20T01:29:55.018547+0000","last_became_active":"2024-08-20T01:29:04.407794+0000","last_became_peered":"2024-08-20T01:29:04.407794+0000","last_unstale":"2024-08-20T01:29:55.018547+0000","last_undegraded":"2024-08-20T01:29:55.018547+0000","last_fullsized":"2024-08-20T01:29:55.018547+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:49:40.679218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024931+0000","last_change":"2024-08-20T01:29:55.024851+0000","last_active":"2024-08-20T01:29:55.024931+0000","last_peered":"2024-08-20T01:29:55.024931+0000","last_clean":"2024-08-20T01:29:55.024931+0000","last_became_active":"2024-08-20T01:29:55.024396+0000","last_became_peered":"2024-08-20T01:29:55.024396+0000","last_unstale":"2024-08-20T01:29:55.024931+0000","last_undegraded":"2024-08-20T01:29:55.024931+0000","last_fullsized":"2024-08-20T01:29:55.024931+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:44:03.846805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019416+0000","last_change":"2024-08-20T01:29:04.412178+0000","last_active":"2024-08-20T01:29:55.019416+0000","last_peered":"2024-08-20T01:29:55.019416+0000","last_clean":"2024-08-20T01:29:55.019416+0000","last_became_active":"2024-08-20T01:29:04.411819+0000","last_became_peered":"2024-08-20T01:29:04.411819+0000","last_unstale":"2024-08-20T01:29:55.019416+0000","last_undegraded":"2024-08-20T01:29:55.019416+0000","last_fullsized":"2024-08-20T01:29:55.019416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:03:11.524911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376922+0000","last_change":"2024-08-20T01:29:06.415697+0000","last_active":"2024-08-20T01:29:55.376922+0000","last_peered":"2024-08-20T01:29:55.376922+0000","last_clean":"2024-08-20T01:29:55.376922+0000","last_became_active":"2024-08-20T01:29:06.415180+0000","last_became_peered":"2024-08-20T01:29:06.415180+0000","last_unstale":"2024-08-20T01:29:55.376922+0000","last_undegraded":"2024-08-20T01:29:55.376922+0000","last_fullsized":"2024-08-20T01:29:55.376922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:55:50.810063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017390+0000","last_change":"2024-08-20T01:29:04.405961+0000","last_active":"2024-08-20T01:29:55.017390+0000","last_peered":"2024-08-20T01:29:55.017390+0000","last_clean":"2024-08-20T01:29:55.017390+0000","last_became_active":"2024-08-20T01:29:04.405633+0000","last_became_peered":"2024-08-20T01:29:04.405633+0000","last_unstale":"2024-08-20T01:29:55.017390+0000","last_undegraded":"2024-08-20T01:29:55.017390+0000","last_fullsized":"2024-08-20T01:29:55.017390+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:00:27.918313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376620+0000","last_change":"2024-08-20T01:29:06.417221+0000","last_active":"2024-08-20T01:29:55.376620+0000","last_peered":"2024-08-20T01:29:55.376620+0000","last_clean":"2024-08-20T01:29:55.376620+0000","last_became_active":"2024-08-20T01:29:06.416912+0000","last_became_peered":"2024-08-20T01:29:06.416912+0000","last_unstale":"2024-08-20T01:29:55.376620+0000","last_undegraded":"2024-08-20T01:29:55.376620+0000","last_fullsized":"2024-08-20T01:29:55.376620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:12:10.667134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.023090+0000","last_change":"2024-08-20T01:29:05.169494+0000","last_active":"2024-08-20T01:29:55.023090+0000","last_peered":"2024-08-20T01:29:55.023090+0000","last_clean":"2024-08-20T01:29:55.023090+0000","last_became_active":"2024-08-20T01:29:05.169059+0000","last_became_peered":"2024-08-20T01:29:05.169059+0000","last_unstale":"2024-08-20T01:29:55.023090+0000","last_undegraded":"2024-08-20T01:29:55.023090+0000","last_fullsized":"2024-08-20T01:29:55.023090+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:25:39.300668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376709+0000","last_change":"2024-08-20T01:29:06.424040+0000","last_active":"2024-08-20T01:29:55.376709+0000","last_peered":"2024-08-20T01:29:55.376709+0000","last_clean":"2024-08-20T01:29:55.376709+0000","last_became_active":"2024-08-20T01:29:06.421360+0000","last_became_peered":"2024-08-20T01:29:06.421360+0000","last_unstale":"2024-08-20T01:29:55.376709+0000","last_undegraded":"2024-08-20T01:29:55.376709+0000","last_fullsized":"2024-08-20T01:29:55.376709+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:24:50.497310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376261+0000","last_change":"2024-08-20T01:27:51.625696+0000","last_active":"2024-08-20T01:29:55.376261+0000","last_peered":"2024-08-20T01:29:55.376261+0000","last_clean":"2024-08-20T01:29:55.376261+0000","last_became_active":"2024-08-20T01:27:51.620833+0000","last_became_peered":"2024-08-20T01:27:51.620833+0000","last_unstale":"2024-08-20T01:29:55.376261+0000","last_undegraded":"2024-08-20T01:29:55.376261+0000","last_fullsized":"2024-08-20T01:29:55.376261+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:24:32.140649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:24:32.140649+0000","last_clean_scrub_stamp":"2024-08-20T01:24:32.140649+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:54:02.650548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019516+0000","last_change":"2024-08-20T01:29:04.405411+0000","last_active":"2024-08-20T01:29:55.019516+0000","last_peered":"2024-08-20T01:29:55.019516+0000","last_clean":"2024-08-20T01:29:55.019516+0000","last_became_active":"2024-08-20T01:29:04.404980+0000","last_became_peered":"2024-08-20T01:29:04.404980+0000","last_unstale":"2024-08-20T01:29:55.019516+0000","last_undegraded":"2024-08-20T01:29:55.019516+0000","last_fullsized":"2024-08-20T01:29:55.019516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:31:39.335857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018501+0000","last_change":"2024-08-20T01:29:06.420368+0000","last_active":"2024-08-20T01:29:55.018501+0000","last_peered":"2024-08-20T01:29:55.018501+0000","last_clean":"2024-08-20T01:29:55.018501+0000","last_became_active":"2024-08-20T01:29:06.419653+0000","last_became_peered":"2024-08-20T01:29:06.419653+0000","last_unstale":"2024-08-20T01:29:55.018501+0000","last_undegraded":"2024-08-20T01:29:55.018501+0000","last_fullsized":"2024-08-20T01:29:55.018501+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:48.771774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376170+0000","last_change":"2024-08-20T01:29:04.410302+0000","last_active":"2024-08-20T01:29:55.376170+0000","last_peered":"2024-08-20T01:29:55.376170+0000","last_clean":"2024-08-20T01:29:55.376170+0000","last_became_active":"2024-08-20T01:29:04.409977+0000","last_became_peered":"2024-08-20T01:29:04.409977+0000","last_unstale":"2024-08-20T01:29:55.376170+0000","last_undegraded":"2024-08-20T01:29:55.376170+0000","last_fullsized":"2024-08-20T01:29:55.376170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:57:21.593739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019623+0000","last_change":"2024-08-20T01:29:06.419798+0000","last_active":"2024-08-20T01:29:55.019623+0000","last_peered":"2024-08-20T01:29:55.019623+0000","last_clean":"2024-08-20T01:29:55.019623+0000","last_became_active":"2024-08-20T01:29:06.419546+0000","last_became_peered":"2024-08-20T01:29:06.419546+0000","last_unstale":"2024-08-20T01:29:55.019623+0000","last_undegraded":"2024-08-20T01:29:55.019623+0000","last_fullsized":"2024-08-20T01:29:55.019623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:51:31.848883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":82,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:09.571203+0000","last_change":"2024-08-20T01:29:05.169237+0000","last_active":"2024-08-20T01:30:09.571203+0000","last_peered":"2024-08-20T01:30:09.571203+0000","last_clean":"2024-08-20T01:30:09.571203+0000","last_became_active":"2024-08-20T01:29:05.168778+0000","last_became_peered":"2024-08-20T01:29:05.168778+0000","last_unstale":"2024-08-20T01:30:09.571203+0000","last_undegraded":"2024-08-20T01:30:09.571203+0000","last_fullsized":"2024-08-20T01:30:09.571203+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:04:48.847412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024435+0000","last_change":"2024-08-20T01:29:55.024339+0000","last_active":"2024-08-20T01:29:55.024435+0000","last_peered":"2024-08-20T01:29:55.024435+0000","last_clean":"2024-08-20T01:29:55.024435+0000","last_became_active":"2024-08-20T01:29:55.023944+0000","last_became_peered":"2024-08-20T01:29:55.023944+0000","last_unstale":"2024-08-20T01:29:55.024435+0000","last_undegraded":"2024-08-20T01:29:55.024435+0000","last_fullsized":"2024-08-20T01:29:55.024435+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:14:00.589422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376838+0000","last_change":"2024-08-20T01:29:04.404472+0000","last_active":"2024-08-20T01:29:55.376838+0000","last_peered":"2024-08-20T01:29:55.376838+0000","last_clean":"2024-08-20T01:29:55.376838+0000","last_became_active":"2024-08-20T01:29:04.404010+0000","last_became_peered":"2024-08-20T01:29:04.404010+0000","last_unstale":"2024-08-20T01:29:55.376838+0000","last_undegraded":"2024-08-20T01:29:55.376838+0000","last_fullsized":"2024-08-20T01:29:55.376838+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:53:04.263362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024682+0000","last_change":"2024-08-20T01:29:06.421875+0000","last_active":"2024-08-20T01:29:55.024682+0000","last_peered":"2024-08-20T01:29:55.024682+0000","last_clean":"2024-08-20T01:29:55.024682+0000","last_became_active":"2024-08-20T01:29:06.421542+0000","last_became_peered":"2024-08-20T01:29:06.421542+0000","last_unstale":"2024-08-20T01:29:55.024682+0000","last_undegraded":"2024-08-20T01:29:55.024682+0000","last_fullsized":"2024-08-20T01:29:55.024682+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:10:46.320252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015905+0000","last_change":"2024-08-20T01:29:05.169985+0000","last_active":"2024-08-20T01:29:55.015905+0000","last_peered":"2024-08-20T01:29:55.015905+0000","last_clean":"2024-08-20T01:29:55.015905+0000","last_became_active":"2024-08-20T01:29:05.169607+0000","last_became_peered":"2024-08-20T01:29:05.169607+0000","last_unstale":"2024-08-20T01:29:55.015905+0000","last_undegraded":"2024-08-20T01:29:55.015905+0000","last_fullsized":"2024-08-20T01:29:55.015905+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:03:23.278369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024870+0000","last_change":"2024-08-20T01:29:06.414862+0000","last_active":"2024-08-20T01:29:55.024870+0000","last_peered":"2024-08-20T01:29:55.024870+0000","last_clean":"2024-08-20T01:29:55.024870+0000","last_became_active":"2024-08-20T01:29:06.414527+0000","last_became_peered":"2024-08-20T01:29:06.414527+0000","last_unstale":"2024-08-20T01:29:55.024870+0000","last_undegraded":"2024-08-20T01:29:55.024870+0000","last_fullsized":"2024-08-20T01:29:55.024870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:14:20.884073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018713+0000","last_change":"2024-08-20T01:29:05.169638+0000","last_active":"2024-08-20T01:29:55.018713+0000","last_peered":"2024-08-20T01:29:55.018713+0000","last_clean":"2024-08-20T01:29:55.018713+0000","last_became_active":"2024-08-20T01:29:05.169202+0000","last_became_peered":"2024-08-20T01:29:05.169202+0000","last_unstale":"2024-08-20T01:29:55.018713+0000","last_undegraded":"2024-08-20T01:29:55.018713+0000","last_fullsized":"2024-08-20T01:29:55.018713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:05:39.645782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019554+0000","last_change":"2024-08-20T01:29:06.413839+0000","last_active":"2024-08-20T01:29:55.019554+0000","last_peered":"2024-08-20T01:29:55.019554+0000","last_clean":"2024-08-20T01:29:55.019554+0000","last_became_active":"2024-08-20T01:29:06.413488+0000","last_became_peered":"2024-08-20T01:29:06.413488+0000","last_unstale":"2024-08-20T01:29:55.019554+0000","last_undegraded":"2024-08-20T01:29:55.019554+0000","last_fullsized":"2024-08-20T01:29:55.019554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:35:04.007192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'12","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.028397+0000","last_change":"2024-08-20T01:29:55.028344+0000","last_active":"2024-08-20T01:29:55.028397+0000","last_peered":"2024-08-20T01:29:55.028397+0000","last_clean":"2024-08-20T01:29:55.028397+0000","last_became_active":"2024-08-20T01:29:55.023700+0000","last_became_peered":"2024-08-20T01:29:55.023700+0000","last_unstale":"2024-08-20T01:29:55.028397+0000","last_undegraded":"2024-08-20T01:29:55.028397+0000","last_fullsized":"2024-08-20T01:29:55.028397+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:48:39.513322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018444+0000","last_change":"2024-08-20T01:29:06.421024+0000","last_active":"2024-08-20T01:29:55.018444+0000","last_peered":"2024-08-20T01:29:55.018444+0000","last_clean":"2024-08-20T01:29:55.018444+0000","last_became_active":"2024-08-20T01:29:06.420631+0000","last_became_peered":"2024-08-20T01:29:06.420631+0000","last_unstale":"2024-08-20T01:29:55.018444+0000","last_undegraded":"2024-08-20T01:29:55.018444+0000","last_fullsized":"2024-08-20T01:29:55.018444+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:07:57.992230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019783+0000","last_change":"2024-08-20T01:29:04.835075+0000","last_active":"2024-08-20T01:29:55.019783+0000","last_peered":"2024-08-20T01:29:55.019783+0000","last_clean":"2024-08-20T01:29:55.019783+0000","last_became_active":"2024-08-20T01:29:04.834759+0000","last_became_peered":"2024-08-20T01:29:04.834759+0000","last_unstale":"2024-08-20T01:29:55.019783+0000","last_undegraded":"2024-08-20T01:29:55.019783+0000","last_fullsized":"2024-08-20T01:29:55.019783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:45:29.040626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255550+0000","last_change":"2024-08-20T01:29:06.418187+0000","last_active":"2024-08-20T01:29:55.255550+0000","last_peered":"2024-08-20T01:29:55.255550+0000","last_clean":"2024-08-20T01:29:55.255550+0000","last_became_active":"2024-08-20T01:29:06.417851+0000","last_became_peered":"2024-08-20T01:29:06.417851+0000","last_unstale":"2024-08-20T01:29:55.255550+0000","last_undegraded":"2024-08-20T01:29:55.255550+0000","last_fullsized":"2024-08-20T01:29:55.255550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:15:48.204455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027380+0000","last_change":"2024-08-20T01:29:05.169736+0000","last_active":"2024-08-20T01:29:55.027380+0000","last_peered":"2024-08-20T01:29:55.027380+0000","last_clean":"2024-08-20T01:29:55.027380+0000","last_became_active":"2024-08-20T01:29:05.169403+0000","last_became_peered":"2024-08-20T01:29:05.169403+0000","last_unstale":"2024-08-20T01:29:55.027380+0000","last_undegraded":"2024-08-20T01:29:55.027380+0000","last_fullsized":"2024-08-20T01:29:55.027380+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:43:43.500841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017870+0000","last_change":"2024-08-20T01:29:06.416433+0000","last_active":"2024-08-20T01:29:55.017870+0000","last_peered":"2024-08-20T01:29:55.017870+0000","last_clean":"2024-08-20T01:29:55.017870+0000","last_became_active":"2024-08-20T01:29:06.414708+0000","last_became_peered":"2024-08-20T01:29:06.414708+0000","last_unstale":"2024-08-20T01:29:55.017870+0000","last_undegraded":"2024-08-20T01:29:55.017870+0000","last_fullsized":"2024-08-20T01:29:55.017870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:17:15.461536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018260+0000","last_change":"2024-08-20T01:29:04.403090+0000","last_active":"2024-08-20T01:29:55.018260+0000","last_peered":"2024-08-20T01:29:55.018260+0000","last_clean":"2024-08-20T01:29:55.018260+0000","last_became_active":"2024-08-20T01:29:04.402697+0000","last_became_peered":"2024-08-20T01:29:04.402697+0000","last_unstale":"2024-08-20T01:29:55.018260+0000","last_undegraded":"2024-08-20T01:29:55.018260+0000","last_fullsized":"2024-08-20T01:29:55.018260+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:36:04.055868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.020556+0000","last_change":"2024-08-20T01:29:06.413427+0000","last_active":"2024-08-20T01:29:55.020556+0000","last_peered":"2024-08-20T01:29:55.020556+0000","last_clean":"2024-08-20T01:29:55.020556+0000","last_became_active":"2024-08-20T01:29:06.413058+0000","last_became_peered":"2024-08-20T01:29:06.413058+0000","last_unstale":"2024-08-20T01:29:55.020556+0000","last_undegraded":"2024-08-20T01:29:55.020556+0000","last_fullsized":"2024-08-20T01:29:55.020556+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:38:38.546701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021609+0000","last_change":"2024-08-20T01:29:04.409859+0000","last_active":"2024-08-20T01:29:55.021609+0000","last_peered":"2024-08-20T01:29:55.021609+0000","last_clean":"2024-08-20T01:29:55.021609+0000","last_became_active":"2024-08-20T01:29:04.409497+0000","last_became_peered":"2024-08-20T01:29:04.409497+0000","last_unstale":"2024-08-20T01:29:55.021609+0000","last_undegraded":"2024-08-20T01:29:55.021609+0000","last_fullsized":"2024-08-20T01:29:55.021609+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:23:43.548912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018397+0000","last_change":"2024-08-20T01:29:06.418428+0000","last_active":"2024-08-20T01:29:55.018397+0000","last_peered":"2024-08-20T01:29:55.018397+0000","last_clean":"2024-08-20T01:29:55.018397+0000","last_became_active":"2024-08-20T01:29:06.418033+0000","last_became_peered":"2024-08-20T01:29:06.418033+0000","last_unstale":"2024-08-20T01:29:55.018397+0000","last_undegraded":"2024-08-20T01:29:55.018397+0000","last_fullsized":"2024-08-20T01:29:55.018397+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:23.503977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017941+0000","last_change":"2024-08-20T01:29:04.412549+0000","last_active":"2024-08-20T01:29:55.017941+0000","last_peered":"2024-08-20T01:29:55.017941+0000","last_clean":"2024-08-20T01:29:55.017941+0000","last_became_active":"2024-08-20T01:29:04.412071+0000","last_became_peered":"2024-08-20T01:29:04.412071+0000","last_unstale":"2024-08-20T01:29:55.017941+0000","last_undegraded":"2024-08-20T01:29:55.017941+0000","last_fullsized":"2024-08-20T01:29:55.017941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:48:51.195295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376669+0000","last_change":"2024-08-20T01:29:06.421431+0000","last_active":"2024-08-20T01:29:55.376669+0000","last_peered":"2024-08-20T01:29:55.376669+0000","last_clean":"2024-08-20T01:29:55.376669+0000","last_became_active":"2024-08-20T01:29:06.420916+0000","last_became_peered":"2024-08-20T01:29:06.420916+0000","last_unstale":"2024-08-20T01:29:55.376669+0000","last_undegraded":"2024-08-20T01:29:55.376669+0000","last_fullsized":"2024-08-20T01:29:55.376669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:45.674530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017140+0000","last_change":"2024-08-20T01:29:06.418209+0000","last_active":"2024-08-20T01:29:55.017140+0000","last_peered":"2024-08-20T01:29:55.017140+0000","last_clean":"2024-08-20T01:29:55.017140+0000","last_became_active":"2024-08-20T01:29:06.417812+0000","last_became_peered":"2024-08-20T01:29:06.417812+0000","last_unstale":"2024-08-20T01:29:55.017140+0000","last_undegraded":"2024-08-20T01:29:55.017140+0000","last_fullsized":"2024-08-20T01:29:55.017140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:05:43.794281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018906+0000","last_change":"2024-08-20T01:29:04.408472+0000","last_active":"2024-08-20T01:29:55.018906+0000","last_peered":"2024-08-20T01:29:55.018906+0000","last_clean":"2024-08-20T01:29:55.018906+0000","last_became_active":"2024-08-20T01:29:04.408082+0000","last_became_peered":"2024-08-20T01:29:04.408082+0000","last_unstale":"2024-08-20T01:29:55.018906+0000","last_undegraded":"2024-08-20T01:29:55.018906+0000","last_fullsized":"2024-08-20T01:29:55.018906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:14:44.659672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027748+0000","last_change":"2024-08-20T01:29:06.423562+0000","last_active":"2024-08-20T01:29:55.027748+0000","last_peered":"2024-08-20T01:29:55.027748+0000","last_clean":"2024-08-20T01:29:55.027748+0000","last_became_active":"2024-08-20T01:29:06.423241+0000","last_became_peered":"2024-08-20T01:29:06.423241+0000","last_unstale":"2024-08-20T01:29:55.027748+0000","last_undegraded":"2024-08-20T01:29:55.027748+0000","last_fullsized":"2024-08-20T01:29:55.027748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:59:46.049449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018583+0000","last_change":"2024-08-20T01:29:04.412287+0000","last_active":"2024-08-20T01:29:55.018583+0000","last_peered":"2024-08-20T01:29:55.018583+0000","last_clean":"2024-08-20T01:29:55.018583+0000","last_became_active":"2024-08-20T01:29:04.411912+0000","last_became_peered":"2024-08-20T01:29:04.411912+0000","last_unstale":"2024-08-20T01:29:55.018583+0000","last_undegraded":"2024-08-20T01:29:55.018583+0000","last_fullsized":"2024-08-20T01:29:55.018583+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:19:25.816795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255713+0000","last_change":"2024-08-20T01:29:06.416899+0000","last_active":"2024-08-20T01:29:55.255713+0000","last_peered":"2024-08-20T01:29:55.255713+0000","last_clean":"2024-08-20T01:29:55.255713+0000","last_became_active":"2024-08-20T01:29:06.416594+0000","last_became_peered":"2024-08-20T01:29:06.416594+0000","last_unstale":"2024-08-20T01:29:55.255713+0000","last_undegraded":"2024-08-20T01:29:55.255713+0000","last_fullsized":"2024-08-20T01:29:55.255713+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:43.896728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018949+0000","last_change":"2024-08-20T01:29:05.169571+0000","last_active":"2024-08-20T01:29:55.018949+0000","last_peered":"2024-08-20T01:29:55.018949+0000","last_clean":"2024-08-20T01:29:55.018949+0000","last_became_active":"2024-08-20T01:29:05.169250+0000","last_became_peered":"2024-08-20T01:29:05.169250+0000","last_unstale":"2024-08-20T01:29:55.018949+0000","last_undegraded":"2024-08-20T01:29:55.018949+0000","last_fullsized":"2024-08-20T01:29:55.018949+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:32:04.555825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018626+0000","last_change":"2024-08-20T01:29:06.415582+0000","last_active":"2024-08-20T01:29:55.018626+0000","last_peered":"2024-08-20T01:29:55.018626+0000","last_clean":"2024-08-20T01:29:55.018626+0000","last_became_active":"2024-08-20T01:29:06.415284+0000","last_became_peered":"2024-08-20T01:29:06.415284+0000","last_unstale":"2024-08-20T01:29:55.018626+0000","last_undegraded":"2024-08-20T01:29:55.018626+0000","last_fullsized":"2024-08-20T01:29:55.018626+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:43:10.311792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015914+0000","last_change":"2024-08-20T01:29:04.409389+0000","last_active":"2024-08-20T01:29:55.015914+0000","last_peered":"2024-08-20T01:29:55.015914+0000","last_clean":"2024-08-20T01:29:55.015914+0000","last_became_active":"2024-08-20T01:29:04.409099+0000","last_became_peered":"2024-08-20T01:29:04.409099+0000","last_unstale":"2024-08-20T01:29:55.015914+0000","last_undegraded":"2024-08-20T01:29:55.015914+0000","last_fullsized":"2024-08-20T01:29:55.015914+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:19:30.156443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63763,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":350,"num_read_kb":243,"num_write":164,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":59762,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":372736,"data_stored":191289,"data_compressed":9608,"data_compressed_allocated":12288,"data_compressed_original":57344,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285456,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743451,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":831488,"data_stored":406512,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939680,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":983040,"data_stored":1057755,"data_compressed":42066,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103204,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":406748,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299432,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":847872,"data_stored":406668,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495662,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":998598,"data_compressed":42066,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659188,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":406137,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855417,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":909312,"data_stored":998282,"data_compressed":42066,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018942,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":864256,"data_stored":466336,"data_compressed":15386,"data_compressed_allocated":20480,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215170,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":851968,"data_stored":406448,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444103,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":851968,"data_stored":407671,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":465692,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":856064,"data_stored":407408,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":60406,"data_compressed":9608,"data_compressed_allocated":12288,"data_compressed_original":57344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T01:30:12.121 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-20T01:30:12.402 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:12.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.873+0000 7f2245cd7640 1 -- 172.21.15.22:0/1317415109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2240107d30 msgr2=0x7f224010e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:12.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.873+0000 7f2245cd7640 1 --2- 172.21.15.22:0/1317415109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2240107d30 0x7f224010e530 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2238009ca0 tx=0x7f223802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:30:12.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.873+0000 7f2245cd7640 1 -- 172.21.15.22:0/1317415109 shutdown_connections 2024-08-20T01:30:12.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.873+0000 7f2245cd7640 1 --2- 172.21.15.22:0/1317415109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2240107d30 0x7f224010e530 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:12.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.873+0000 7f2245cd7640 1 --2- 172.21.15.22:0/1317415109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22401073b0 0x7f22401077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:12.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.873+0000 7f2245cd7640 1 --2- 172.21.15.22:0/1317415109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22401019a0 0x7f2240101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:12.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.873+0000 7f2245cd7640 1 -- 172.21.15.22:0/1317415109 >> 172.21.15.22:0/1317415109 conn(0x7f22400fd3f0 msgr2=0x7f22400ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:12.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.873+0000 7f2245cd7640 1 -- 172.21.15.22:0/1317415109 shutdown_connections 2024-08-20T01:30:12.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.873+0000 7f2245cd7640 1 -- 172.21.15.22:0/1317415109 wait complete. 2024-08-20T01:30:12.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.873+0000 7f2245cd7640 1 Processor -- start 2024-08-20T01:30:12.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.873+0000 7f2245cd7640 1 -- start start 2024-08-20T01:30:12.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.874+0000 7f2245cd7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22401019a0 0x7f224019b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:12.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.874+0000 7f2245cd7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22401073b0 0x7f224019b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:12.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.874+0000 7f2245cd7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2240107d30 0x7f22401a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:12.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.874+0000 7f2245cd7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f22401119f0 con 0x7f22401019a0 2024-08-20T01:30:12.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.874+0000 7f2245cd7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2240111870 con 0x7f2240107d30 2024-08-20T01:30:12.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.874+0000 7f2245cd7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2240111b70 con 0x7f22401073b0 2024-08-20T01:30:12.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.874+0000 7f223f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22401019a0 0x7f224019b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:12.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.874+0000 7f223f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22401019a0 0x7f224019b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49536/0 (socket says 172.21.15.22:49536) 2024-08-20T01:30:12.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.874+0000 7f223f7fe640 1 -- 172.21.15.22:0/2458749585 learned_addr learned my addr 172.21.15.22:0/2458749585 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:12.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.874+0000 7f223ffff640 1 --2- 172.21.15.22:0/2458749585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2240107d30 0x7f22401a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:12.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.874+0000 7f2236ffd640 1 --2- 172.21.15.22:0/2458749585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22401073b0 0x7f224019b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:12.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.874+0000 7f223f7fe640 1 -- 172.21.15.22:0/2458749585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22401073b0 msgr2=0x7f224019b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:12.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.874+0000 7f223f7fe640 1 --2- 172.21.15.22:0/2458749585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22401073b0 0x7f224019b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:12.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.874+0000 7f223f7fe640 1 -- 172.21.15.22:0/2458749585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2240107d30 msgr2=0x7f22401a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:12.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.874+0000 7f223f7fe640 1 --2- 172.21.15.22:0/2458749585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2240107d30 0x7f22401a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:12.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.874+0000 7f223f7fe640 1 -- 172.21.15.22:0/2458749585 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22401a1220 con 0x7f22401019a0 2024-08-20T01:30:12.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.874+0000 7f223f7fe640 1 --2- 172.21.15.22:0/2458749585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22401019a0 0x7f224019b170 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f223000d950 tx=0x7f223000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:12.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.875+0000 7f223d7fa640 1 -- 172.21.15.22:0/2458749585 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2230017070 con 0x7f22401019a0 2024-08-20T01:30:12.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.875+0000 7f2245cd7640 1 -- 172.21.15.22:0/2458749585 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22401a1510 con 0x7f22401019a0 2024-08-20T01:30:12.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.875+0000 7f223d7fa640 1 -- 172.21.15.22:0/2458749585 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f223000de80 con 0x7f22401019a0 2024-08-20T01:30:12.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.875+0000 7f223d7fa640 1 -- 172.21.15.22:0/2458749585 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223000f620 con 0x7f22401019a0 2024-08-20T01:30:12.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.875+0000 7f2245cd7640 1 -- 172.21.15.22:0/2458749585 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22401a7da0 con 0x7f22401019a0 2024-08-20T01:30:12.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.876+0000 7f2245cd7640 1 -- 172.21.15.22:0/2458749585 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2240101d80 con 0x7f22401019a0 2024-08-20T01:30:12.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.877+0000 7f223d7fa640 1 -- 172.21.15.22:0/2458749585 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f2230009c30 con 0x7f22401019a0 2024-08-20T01:30:12.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.878+0000 7f223d7fa640 1 --2- 172.21.15.22:0/2458749585 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f222c0b3c60 0x7f222c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:12.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.878+0000 7f2236ffd640 1 --2- 172.21.15.22:0/2458749585 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f222c0b3c60 0x7f222c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:12.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.878+0000 7f223d7fa640 1 -- 172.21.15.22:0/2458749585 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f22300e3950 con 0x7f22401019a0 2024-08-20T01:30:12.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.878+0000 7f2236ffd640 1 --2- 172.21.15.22:0/2458749585 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f222c0b3c60 0x7f222c0b6120 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2240103d30 tx=0x7f2228009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:12.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:12.882+0000 7f223d7fa640 1 -- 172.21.15.22:0/2458749585 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f22300aae20 con 0x7f22401019a0 2024-08-20T01:30:13.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:13.064+0000 7f2245cd7640 1 -- 172.21.15.22:0/2458749585 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2240104170 con 0x7f222c0b3c60 2024-08-20T01:30:13.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:13.068+0000 7f223d7fa640 1 -- 172.21.15.22:0/2458749585 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258977 (secure 0 0 0) 0x7f2240104170 con 0x7f222c0b3c60 2024-08-20T01:30:13.071 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:13.072 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-08-20T01:30:13.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:13.071+0000 7f2245cd7640 1 -- 172.21.15.22:0/2458749585 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f222c0b3c60 msgr2=0x7f222c0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:13.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:13.071+0000 7f2245cd7640 1 --2- 172.21.15.22:0/2458749585 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f222c0b3c60 0x7f222c0b6120 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2240103d30 tx=0x7f2228009110 comp rx=0 tx=0).stop 2024-08-20T01:30:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:13.071+0000 7f2245cd7640 1 -- 172.21.15.22:0/2458749585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22401019a0 msgr2=0x7f224019b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:13.071+0000 7f2245cd7640 1 --2- 172.21.15.22:0/2458749585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22401019a0 0x7f224019b170 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f223000d950 tx=0x7f223000dd50 comp rx=0 tx=0).stop 2024-08-20T01:30:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:13.071+0000 7f2245cd7640 1 -- 172.21.15.22:0/2458749585 shutdown_connections 2024-08-20T01:30:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:13.071+0000 7f2245cd7640 1 --2- 172.21.15.22:0/2458749585 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f222c0b3c60 0x7f222c0b6120 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:13.071+0000 7f2245cd7640 1 --2- 172.21.15.22:0/2458749585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2240107d30 0x7f22401a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:13.071+0000 7f2245cd7640 1 --2- 172.21.15.22:0/2458749585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22401073b0 0x7f224019b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:13.071+0000 7f2245cd7640 1 --2- 172.21.15.22:0/2458749585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22401019a0 0x7f224019b170 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:13.071+0000 7f2245cd7640 1 -- 172.21.15.22:0/2458749585 >> 172.21.15.22:0/2458749585 conn(0x7f22400fd3f0 msgr2=0x7f224006ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:13.072+0000 7f2245cd7640 1 -- 172.21.15.22:0/2458749585 shutdown_connections 2024-08-20T01:30:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:13.072+0000 7f2245cd7640 1 -- 172.21.15.22:0/2458749585 wait complete. 2024-08-20T01:30:13.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:13 smithi022 ceph-mon[18709]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-20T01:30:13.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:13 smithi022 ceph-mon[18709]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:30:13.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:13 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:13.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:13 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:13.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:13 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:13.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:13 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:13.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:13 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:13.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:13 smithi134 ceph-mon[22511]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-20T01:30:13.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:13 smithi134 ceph-mon[22511]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:30:13.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:13 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:13.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:13 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:13.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:13 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:13.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:13 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:13.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:13 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:13.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:13 smithi077 ceph-mon[22251]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-20T01:30:13.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:13 smithi077 ceph-mon[22251]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:30:13.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:13 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:13.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:13 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:13.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:13 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:13.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:13 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:13.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:13 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:30:13.796 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-08-20T01:30:11.311686+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654365,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":426,"num_read_kb":307,"num_write":289,"num_write_kb":2261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":3011602,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363724,"kb_used_data":10228,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124578100,"statfs":{"total":1151940427776,"available":1151567974400,"internally_reserved":0,"allocated":10473472,"data_stored":6834255,"data_compressed":187808,"data_compressed_allocated":245760,"data_compressed_original":2023424,"omap_allocated":19139,"internal_metadata":361674045},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003335"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019956+0000","last_change":"2024-08-20T01:29:06.421092+0000","last_active":"2024-08-20T01:29:55.019956+0000","last_peered":"2024-08-20T01:29:55.019956+0000","last_clean":"2024-08-20T01:29:55.019956+0000","last_became_active":"2024-08-20T01:29:06.420484+0000","last_became_peered":"2024-08-20T01:29:06.420484+0000","last_unstale":"2024-08-20T01:29:55.019956+0000","last_undegraded":"2024-08-20T01:29:55.019956+0000","last_fullsized":"2024-08-20T01:29:55.019956+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:55:54.177863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255444+0000","last_change":"2024-08-20T01:29:06.414784+0000","last_active":"2024-08-20T01:29:55.255444+0000","last_peered":"2024-08-20T01:29:55.255444+0000","last_clean":"2024-08-20T01:29:55.255444+0000","last_became_active":"2024-08-20T01:29:06.414426+0000","last_became_peered":"2024-08-20T01:29:06.414426+0000","last_unstale":"2024-08-20T01:29:55.255444+0000","last_undegraded":"2024-08-20T01:29:55.255444+0000","last_fullsized":"2024-08-20T01:29:55.255444+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:13:45.634888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255373+0000","last_change":"2024-08-20T01:29:06.416876+0000","last_active":"2024-08-20T01:29:55.255373+0000","last_peered":"2024-08-20T01:29:55.255373+0000","last_clean":"2024-08-20T01:29:55.255373+0000","last_became_active":"2024-08-20T01:29:06.416548+0000","last_became_peered":"2024-08-20T01:29:06.416548+0000","last_unstale":"2024-08-20T01:29:55.255373+0000","last_undegraded":"2024-08-20T01:29:55.255373+0000","last_fullsized":"2024-08-20T01:29:55.255373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:16:23.092129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019553+0000","last_change":"2024-08-20T01:29:06.415474+0000","last_active":"2024-08-20T01:29:55.019553+0000","last_peered":"2024-08-20T01:29:55.019553+0000","last_clean":"2024-08-20T01:29:55.019553+0000","last_became_active":"2024-08-20T01:29:06.415120+0000","last_became_peered":"2024-08-20T01:29:06.415120+0000","last_unstale":"2024-08-20T01:29:55.019553+0000","last_undegraded":"2024-08-20T01:29:55.019553+0000","last_fullsized":"2024-08-20T01:29:55.019553+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:47.059173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.022520+0000","last_change":"2024-08-20T01:29:55.022459+0000","last_active":"2024-08-20T01:29:55.022520+0000","last_peered":"2024-08-20T01:29:55.022520+0000","last_clean":"2024-08-20T01:29:55.022520+0000","last_became_active":"2024-08-20T01:29:55.022110+0000","last_became_peered":"2024-08-20T01:29:55.022110+0000","last_unstale":"2024-08-20T01:29:55.022520+0000","last_undegraded":"2024-08-20T01:29:55.022520+0000","last_fullsized":"2024-08-20T01:29:55.022520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:56:44.318445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024716+0000","last_change":"2024-08-20T01:29:06.420995+0000","last_active":"2024-08-20T01:29:55.024716+0000","last_peered":"2024-08-20T01:29:55.024716+0000","last_clean":"2024-08-20T01:29:55.024716+0000","last_became_active":"2024-08-20T01:29:06.420703+0000","last_became_peered":"2024-08-20T01:29:06.420703+0000","last_unstale":"2024-08-20T01:29:55.024716+0000","last_undegraded":"2024-08-20T01:29:55.024716+0000","last_fullsized":"2024-08-20T01:29:55.024716+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:21:08.502158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376076+0000","last_change":"2024-08-20T01:29:06.411605+0000","last_active":"2024-08-20T01:29:55.376076+0000","last_peered":"2024-08-20T01:29:55.376076+0000","last_clean":"2024-08-20T01:29:55.376076+0000","last_became_active":"2024-08-20T01:29:06.411258+0000","last_became_peered":"2024-08-20T01:29:06.411258+0000","last_unstale":"2024-08-20T01:29:55.376076+0000","last_undegraded":"2024-08-20T01:29:55.376076+0000","last_fullsized":"2024-08-20T01:29:55.376076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:17:02.390707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017993+0000","last_change":"2024-08-20T01:29:06.418514+0000","last_active":"2024-08-20T01:29:55.017993+0000","last_peered":"2024-08-20T01:29:55.017993+0000","last_clean":"2024-08-20T01:29:55.017993+0000","last_became_active":"2024-08-20T01:29:06.417450+0000","last_became_peered":"2024-08-20T01:29:06.417450+0000","last_unstale":"2024-08-20T01:29:55.017993+0000","last_undegraded":"2024-08-20T01:29:55.017993+0000","last_fullsized":"2024-08-20T01:29:55.017993+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:13:15.485333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.028241+0000","last_change":"2024-08-20T01:29:06.425458+0000","last_active":"2024-08-20T01:29:55.028241+0000","last_peered":"2024-08-20T01:29:55.028241+0000","last_clean":"2024-08-20T01:29:55.028241+0000","last_became_active":"2024-08-20T01:29:06.425122+0000","last_became_peered":"2024-08-20T01:29:06.425122+0000","last_unstale":"2024-08-20T01:29:55.028241+0000","last_undegraded":"2024-08-20T01:29:55.028241+0000","last_fullsized":"2024-08-20T01:29:55.028241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:52:59.857195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.025175+0000","last_change":"2024-08-20T01:29:06.420258+0000","last_active":"2024-08-20T01:29:55.025175+0000","last_peered":"2024-08-20T01:29:55.025175+0000","last_clean":"2024-08-20T01:29:55.025175+0000","last_became_active":"2024-08-20T01:29:06.419982+0000","last_became_peered":"2024-08-20T01:29:06.419982+0000","last_unstale":"2024-08-20T01:29:55.025175+0000","last_undegraded":"2024-08-20T01:29:55.025175+0000","last_fullsized":"2024-08-20T01:29:55.025175+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:56:23.296739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376666+0000","last_change":"2024-08-20T01:29:06.421580+0000","last_active":"2024-08-20T01:29:55.376666+0000","last_peered":"2024-08-20T01:29:55.376666+0000","last_clean":"2024-08-20T01:29:55.376666+0000","last_became_active":"2024-08-20T01:29:06.421115+0000","last_became_peered":"2024-08-20T01:29:06.421115+0000","last_unstale":"2024-08-20T01:29:55.376666+0000","last_undegraded":"2024-08-20T01:29:55.376666+0000","last_fullsized":"2024-08-20T01:29:55.376666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:43:13.839230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019544+0000","last_change":"2024-08-20T01:29:06.416950+0000","last_active":"2024-08-20T01:29:55.019544+0000","last_peered":"2024-08-20T01:29:55.019544+0000","last_clean":"2024-08-20T01:29:55.019544+0000","last_became_active":"2024-08-20T01:29:06.415585+0000","last_became_peered":"2024-08-20T01:29:06.415585+0000","last_unstale":"2024-08-20T01:29:55.019544+0000","last_undegraded":"2024-08-20T01:29:55.019544+0000","last_fullsized":"2024-08-20T01:29:55.019544+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:47:54.132535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027677+0000","last_change":"2024-08-20T01:29:55.027622+0000","last_active":"2024-08-20T01:29:55.027677+0000","last_peered":"2024-08-20T01:29:55.027677+0000","last_clean":"2024-08-20T01:29:55.027677+0000","last_became_active":"2024-08-20T01:29:55.027246+0000","last_became_peered":"2024-08-20T01:29:55.027246+0000","last_unstale":"2024-08-20T01:29:55.027677+0000","last_undegraded":"2024-08-20T01:29:55.027677+0000","last_fullsized":"2024-08-20T01:29:55.027677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:30:25.209975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255506+0000","last_change":"2024-08-20T01:29:06.415494+0000","last_active":"2024-08-20T01:29:55.255506+0000","last_peered":"2024-08-20T01:29:55.255506+0000","last_clean":"2024-08-20T01:29:55.255506+0000","last_became_active":"2024-08-20T01:29:06.415099+0000","last_became_peered":"2024-08-20T01:29:06.415099+0000","last_unstale":"2024-08-20T01:29:55.255506+0000","last_undegraded":"2024-08-20T01:29:55.255506+0000","last_fullsized":"2024-08-20T01:29:55.255506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:07:01.946143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255184+0000","last_change":"2024-08-20T01:29:06.418233+0000","last_active":"2024-08-20T01:29:55.255184+0000","last_peered":"2024-08-20T01:29:55.255184+0000","last_clean":"2024-08-20T01:29:55.255184+0000","last_became_active":"2024-08-20T01:29:06.417929+0000","last_became_peered":"2024-08-20T01:29:06.417929+0000","last_unstale":"2024-08-20T01:29:55.255184+0000","last_undegraded":"2024-08-20T01:29:55.255184+0000","last_fullsized":"2024-08-20T01:29:55.255184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:44:08.548821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027280+0000","last_change":"2024-08-20T01:29:06.418819+0000","last_active":"2024-08-20T01:29:55.027280+0000","last_peered":"2024-08-20T01:29:55.027280+0000","last_clean":"2024-08-20T01:29:55.027280+0000","last_became_active":"2024-08-20T01:29:06.418378+0000","last_became_peered":"2024-08-20T01:29:06.418378+0000","last_unstale":"2024-08-20T01:29:55.027280+0000","last_undegraded":"2024-08-20T01:29:55.027280+0000","last_fullsized":"2024-08-20T01:29:55.027280+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:01.419539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.020071+0000","last_change":"2024-08-20T01:29:06.420804+0000","last_active":"2024-08-20T01:29:55.020071+0000","last_peered":"2024-08-20T01:29:55.020071+0000","last_clean":"2024-08-20T01:29:55.020071+0000","last_became_active":"2024-08-20T01:29:06.420027+0000","last_became_peered":"2024-08-20T01:29:06.420027+0000","last_unstale":"2024-08-20T01:29:55.020071+0000","last_undegraded":"2024-08-20T01:29:55.020071+0000","last_fullsized":"2024-08-20T01:29:55.020071+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:00:37.104792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015970+0000","last_change":"2024-08-20T01:29:06.411625+0000","last_active":"2024-08-20T01:29:55.015970+0000","last_peered":"2024-08-20T01:29:55.015970+0000","last_clean":"2024-08-20T01:29:55.015970+0000","last_became_active":"2024-08-20T01:29:06.411284+0000","last_became_peered":"2024-08-20T01:29:06.411284+0000","last_unstale":"2024-08-20T01:29:55.015970+0000","last_undegraded":"2024-08-20T01:29:55.015970+0000","last_fullsized":"2024-08-20T01:29:55.015970+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:12:08.510755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021766+0000","last_change":"2024-08-20T01:29:06.421276+0000","last_active":"2024-08-20T01:29:55.021766+0000","last_peered":"2024-08-20T01:29:55.021766+0000","last_clean":"2024-08-20T01:29:55.021766+0000","last_became_active":"2024-08-20T01:29:06.420916+0000","last_became_peered":"2024-08-20T01:29:06.420916+0000","last_unstale":"2024-08-20T01:29:55.021766+0000","last_undegraded":"2024-08-20T01:29:55.021766+0000","last_fullsized":"2024-08-20T01:29:55.021766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:04:59.399172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.020688+0000","last_change":"2024-08-20T01:29:06.420848+0000","last_active":"2024-08-20T01:29:55.020688+0000","last_peered":"2024-08-20T01:29:55.020688+0000","last_clean":"2024-08-20T01:29:55.020688+0000","last_became_active":"2024-08-20T01:29:06.420465+0000","last_became_peered":"2024-08-20T01:29:06.420465+0000","last_unstale":"2024-08-20T01:29:55.020688+0000","last_undegraded":"2024-08-20T01:29:55.020688+0000","last_fullsized":"2024-08-20T01:29:55.020688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:42:33.210813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019585+0000","last_change":"2024-08-20T01:29:06.407353+0000","last_active":"2024-08-20T01:29:55.019585+0000","last_peered":"2024-08-20T01:29:55.019585+0000","last_clean":"2024-08-20T01:29:55.019585+0000","last_became_active":"2024-08-20T01:29:06.406944+0000","last_became_peered":"2024-08-20T01:29:06.406944+0000","last_unstale":"2024-08-20T01:29:55.019585+0000","last_undegraded":"2024-08-20T01:29:55.019585+0000","last_fullsized":"2024-08-20T01:29:55.019585+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:49:22.324317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027678+0000","last_change":"2024-08-20T01:29:06.419757+0000","last_active":"2024-08-20T01:29:55.027678+0000","last_peered":"2024-08-20T01:29:55.027678+0000","last_clean":"2024-08-20T01:29:55.027678+0000","last_became_active":"2024-08-20T01:29:06.419433+0000","last_became_peered":"2024-08-20T01:29:06.419433+0000","last_unstale":"2024-08-20T01:29:55.027678+0000","last_undegraded":"2024-08-20T01:29:55.027678+0000","last_fullsized":"2024-08-20T01:29:55.027678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:22:36.968949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018072+0000","last_change":"2024-08-20T01:29:06.418110+0000","last_active":"2024-08-20T01:29:55.018072+0000","last_peered":"2024-08-20T01:29:55.018072+0000","last_clean":"2024-08-20T01:29:55.018072+0000","last_became_active":"2024-08-20T01:29:06.417776+0000","last_became_peered":"2024-08-20T01:29:06.417776+0000","last_unstale":"2024-08-20T01:29:55.018072+0000","last_undegraded":"2024-08-20T01:29:55.018072+0000","last_fullsized":"2024-08-20T01:29:55.018072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:55:55.105453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.016549+0000","last_change":"2024-08-20T01:29:06.414240+0000","last_active":"2024-08-20T01:29:55.016549+0000","last_peered":"2024-08-20T01:29:55.016549+0000","last_clean":"2024-08-20T01:29:55.016549+0000","last_became_active":"2024-08-20T01:29:06.413884+0000","last_became_peered":"2024-08-20T01:29:06.413884+0000","last_unstale":"2024-08-20T01:29:55.016549+0000","last_undegraded":"2024-08-20T01:29:55.016549+0000","last_fullsized":"2024-08-20T01:29:55.016549+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:00.042588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018340+0000","last_change":"2024-08-20T01:29:06.419344+0000","last_active":"2024-08-20T01:29:55.018340+0000","last_peered":"2024-08-20T01:29:55.018340+0000","last_clean":"2024-08-20T01:29:55.018340+0000","last_became_active":"2024-08-20T01:29:06.418689+0000","last_became_peered":"2024-08-20T01:29:06.418689+0000","last_unstale":"2024-08-20T01:29:55.018340+0000","last_undegraded":"2024-08-20T01:29:55.018340+0000","last_fullsized":"2024-08-20T01:29:55.018340+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:34:23.604213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.022077+0000","last_change":"2024-08-20T01:29:06.415161+0000","last_active":"2024-08-20T01:29:55.022077+0000","last_peered":"2024-08-20T01:29:55.022077+0000","last_clean":"2024-08-20T01:29:55.022077+0000","last_became_active":"2024-08-20T01:29:06.414812+0000","last_became_peered":"2024-08-20T01:29:06.414812+0000","last_unstale":"2024-08-20T01:29:55.022077+0000","last_undegraded":"2024-08-20T01:29:55.022077+0000","last_fullsized":"2024-08-20T01:29:55.022077+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:10:49.527635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021022+0000","last_change":"2024-08-20T01:29:06.416502+0000","last_active":"2024-08-20T01:29:55.021022+0000","last_peered":"2024-08-20T01:29:55.021022+0000","last_clean":"2024-08-20T01:29:55.021022+0000","last_became_active":"2024-08-20T01:29:06.416139+0000","last_became_peered":"2024-08-20T01:29:06.416139+0000","last_unstale":"2024-08-20T01:29:55.021022+0000","last_undegraded":"2024-08-20T01:29:55.021022+0000","last_fullsized":"2024-08-20T01:29:55.021022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:19:32.379867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019525+0000","last_change":"2024-08-20T01:29:06.412494+0000","last_active":"2024-08-20T01:29:55.019525+0000","last_peered":"2024-08-20T01:29:55.019525+0000","last_clean":"2024-08-20T01:29:55.019525+0000","last_became_active":"2024-08-20T01:29:06.412158+0000","last_became_peered":"2024-08-20T01:29:06.412158+0000","last_unstale":"2024-08-20T01:29:55.019525+0000","last_undegraded":"2024-08-20T01:29:55.019525+0000","last_fullsized":"2024-08-20T01:29:55.019525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:57:52.088445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255479+0000","last_change":"2024-08-20T01:29:06.412869+0000","last_active":"2024-08-20T01:29:55.255479+0000","last_peered":"2024-08-20T01:29:55.255479+0000","last_clean":"2024-08-20T01:29:55.255479+0000","last_became_active":"2024-08-20T01:29:06.412540+0000","last_became_peered":"2024-08-20T01:29:06.412540+0000","last_unstale":"2024-08-20T01:29:55.255479+0000","last_undegraded":"2024-08-20T01:29:55.255479+0000","last_fullsized":"2024-08-20T01:29:55.255479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:11:10.011252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.256428+0000","last_change":"2024-08-20T01:29:55.256345+0000","last_active":"2024-08-20T01:29:55.256428+0000","last_peered":"2024-08-20T01:29:55.256428+0000","last_clean":"2024-08-20T01:29:55.256428+0000","last_became_active":"2024-08-20T01:29:55.256001+0000","last_became_peered":"2024-08-20T01:29:55.256001+0000","last_unstale":"2024-08-20T01:29:55.256428+0000","last_undegraded":"2024-08-20T01:29:55.256428+0000","last_fullsized":"2024-08-20T01:29:55.256428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:02:02.453668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.022020+0000","last_change":"2024-08-20T01:29:06.423874+0000","last_active":"2024-08-20T01:29:55.022020+0000","last_peered":"2024-08-20T01:29:55.022020+0000","last_clean":"2024-08-20T01:29:55.022020+0000","last_became_active":"2024-08-20T01:29:06.423561+0000","last_became_peered":"2024-08-20T01:29:06.423561+0000","last_unstale":"2024-08-20T01:29:55.022020+0000","last_undegraded":"2024-08-20T01:29:55.022020+0000","last_fullsized":"2024-08-20T01:29:55.022020+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:13:53.654099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019575+0000","last_change":"2024-08-20T01:29:06.414212+0000","last_active":"2024-08-20T01:29:55.019575+0000","last_peered":"2024-08-20T01:29:55.019575+0000","last_clean":"2024-08-20T01:29:55.019575+0000","last_became_active":"2024-08-20T01:29:06.413848+0000","last_became_peered":"2024-08-20T01:29:06.413848+0000","last_unstale":"2024-08-20T01:29:55.019575+0000","last_undegraded":"2024-08-20T01:29:55.019575+0000","last_fullsized":"2024-08-20T01:29:55.019575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:00:29.005461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.377988+0000","last_change":"2024-08-20T01:29:55.377940+0000","last_active":"2024-08-20T01:29:55.377988+0000","last_peered":"2024-08-20T01:29:55.377988+0000","last_clean":"2024-08-20T01:29:55.377988+0000","last_became_active":"2024-08-20T01:29:55.377642+0000","last_became_peered":"2024-08-20T01:29:55.377642+0000","last_unstale":"2024-08-20T01:29:55.377988+0000","last_undegraded":"2024-08-20T01:29:55.377988+0000","last_fullsized":"2024-08-20T01:29:55.377988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:55:28.416610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":86,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:08.555282+0000","last_change":"2024-08-20T01:29:04.413482+0000","last_active":"2024-08-20T01:30:08.555282+0000","last_peered":"2024-08-20T01:30:08.555282+0000","last_clean":"2024-08-20T01:30:08.555282+0000","last_became_active":"2024-08-20T01:29:04.413096+0000","last_became_peered":"2024-08-20T01:29:04.413096+0000","last_unstale":"2024-08-20T01:30:08.555282+0000","last_undegraded":"2024-08-20T01:30:08.555282+0000","last_fullsized":"2024-08-20T01:30:08.555282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:26:05.947182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.022224+0000","last_change":"2024-08-20T01:29:55.022156+0000","last_active":"2024-08-20T01:29:55.022224+0000","last_peered":"2024-08-20T01:29:55.022224+0000","last_clean":"2024-08-20T01:29:55.022224+0000","last_became_active":"2024-08-20T01:29:55.021604+0000","last_became_peered":"2024-08-20T01:29:55.021604+0000","last_unstale":"2024-08-20T01:29:55.022224+0000","last_undegraded":"2024-08-20T01:29:55.022224+0000","last_fullsized":"2024-08-20T01:29:55.022224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:28:35.155390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024796+0000","last_change":"2024-08-20T01:29:04.409605+0000","last_active":"2024-08-20T01:29:55.024796+0000","last_peered":"2024-08-20T01:29:55.024796+0000","last_clean":"2024-08-20T01:29:55.024796+0000","last_became_active":"2024-08-20T01:29:04.409284+0000","last_became_peered":"2024-08-20T01:29:04.409284+0000","last_unstale":"2024-08-20T01:29:55.024796+0000","last_undegraded":"2024-08-20T01:29:55.024796+0000","last_fullsized":"2024-08-20T01:29:55.024796+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:29:27.471748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019177+0000","last_change":"2024-08-20T01:29:04.400635+0000","last_active":"2024-08-20T01:29:55.019177+0000","last_peered":"2024-08-20T01:29:55.019177+0000","last_clean":"2024-08-20T01:29:55.019177+0000","last_became_active":"2024-08-20T01:29:04.400234+0000","last_became_peered":"2024-08-20T01:29:04.400234+0000","last_unstale":"2024-08-20T01:29:55.019177+0000","last_undegraded":"2024-08-20T01:29:55.019177+0000","last_fullsized":"2024-08-20T01:29:55.019177+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:47:24.810916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018056+0000","last_change":"2024-08-20T01:29:06.411872+0000","last_active":"2024-08-20T01:29:55.018056+0000","last_peered":"2024-08-20T01:29:55.018056+0000","last_clean":"2024-08-20T01:29:55.018056+0000","last_became_active":"2024-08-20T01:29:06.411563+0000","last_became_peered":"2024-08-20T01:29:06.411563+0000","last_unstale":"2024-08-20T01:29:55.018056+0000","last_undegraded":"2024-08-20T01:29:55.018056+0000","last_fullsized":"2024-08-20T01:29:55.018056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:03:37.351529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017046+0000","last_change":"2024-08-20T01:29:04.407395+0000","last_active":"2024-08-20T01:29:55.017046+0000","last_peered":"2024-08-20T01:29:55.017046+0000","last_clean":"2024-08-20T01:29:55.017046+0000","last_became_active":"2024-08-20T01:29:04.407000+0000","last_became_peered":"2024-08-20T01:29:04.407000+0000","last_unstale":"2024-08-20T01:29:55.017046+0000","last_undegraded":"2024-08-20T01:29:55.017046+0000","last_fullsized":"2024-08-20T01:29:55.017046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:36:42.512450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015687+0000","last_change":"2024-08-20T01:29:06.410094+0000","last_active":"2024-08-20T01:29:55.015687+0000","last_peered":"2024-08-20T01:29:55.015687+0000","last_clean":"2024-08-20T01:29:55.015687+0000","last_became_active":"2024-08-20T01:29:06.409749+0000","last_became_peered":"2024-08-20T01:29:06.409749+0000","last_unstale":"2024-08-20T01:29:55.015687+0000","last_undegraded":"2024-08-20T01:29:55.015687+0000","last_fullsized":"2024-08-20T01:29:55.015687+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:52:51.072953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":81,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:09.556042+0000","last_change":"2024-08-20T01:29:04.406810+0000","last_active":"2024-08-20T01:30:09.556042+0000","last_peered":"2024-08-20T01:30:09.556042+0000","last_clean":"2024-08-20T01:30:09.556042+0000","last_became_active":"2024-08-20T01:29:04.406436+0000","last_became_peered":"2024-08-20T01:29:04.406436+0000","last_unstale":"2024-08-20T01:30:09.556042+0000","last_undegraded":"2024-08-20T01:30:09.556042+0000","last_fullsized":"2024-08-20T01:30:09.556042+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:49:57.305447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.028186+0000","last_change":"2024-08-20T01:29:06.424442+0000","last_active":"2024-08-20T01:29:55.028186+0000","last_peered":"2024-08-20T01:29:55.028186+0000","last_clean":"2024-08-20T01:29:55.028186+0000","last_became_active":"2024-08-20T01:29:06.424132+0000","last_became_peered":"2024-08-20T01:29:06.424132+0000","last_unstale":"2024-08-20T01:29:55.028186+0000","last_undegraded":"2024-08-20T01:29:55.028186+0000","last_fullsized":"2024-08-20T01:29:55.028186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:31:30.861113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376745+0000","last_change":"2024-08-20T01:29:04.412307+0000","last_active":"2024-08-20T01:29:55.376745+0000","last_peered":"2024-08-20T01:29:55.376745+0000","last_clean":"2024-08-20T01:29:55.376745+0000","last_became_active":"2024-08-20T01:29:04.411861+0000","last_became_peered":"2024-08-20T01:29:04.411861+0000","last_unstale":"2024-08-20T01:29:55.376745+0000","last_undegraded":"2024-08-20T01:29:55.376745+0000","last_fullsized":"2024-08-20T01:29:55.376745+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:56:51.356821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255721+0000","last_change":"2024-08-20T01:29:06.418525+0000","last_active":"2024-08-20T01:29:55.255721+0000","last_peered":"2024-08-20T01:29:55.255721+0000","last_clean":"2024-08-20T01:29:55.255721+0000","last_became_active":"2024-08-20T01:29:06.417902+0000","last_became_peered":"2024-08-20T01:29:06.417902+0000","last_unstale":"2024-08-20T01:29:55.255721+0000","last_undegraded":"2024-08-20T01:29:55.255721+0000","last_fullsized":"2024-08-20T01:29:55.255721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:28:23.017315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017602+0000","last_change":"2024-08-20T01:29:05.171538+0000","last_active":"2024-08-20T01:29:55.017602+0000","last_peered":"2024-08-20T01:29:55.017602+0000","last_clean":"2024-08-20T01:29:55.017602+0000","last_became_active":"2024-08-20T01:29:05.171172+0000","last_became_peered":"2024-08-20T01:29:05.171172+0000","last_unstale":"2024-08-20T01:29:55.017602+0000","last_undegraded":"2024-08-20T01:29:55.017602+0000","last_fullsized":"2024-08-20T01:29:55.017602+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:04:27.968049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027866+0000","last_change":"2024-08-20T01:29:06.426886+0000","last_active":"2024-08-20T01:29:55.027866+0000","last_peered":"2024-08-20T01:29:55.027866+0000","last_clean":"2024-08-20T01:29:55.027866+0000","last_became_active":"2024-08-20T01:29:06.426569+0000","last_became_peered":"2024-08-20T01:29:06.426569+0000","last_unstale":"2024-08-20T01:29:55.027866+0000","last_undegraded":"2024-08-20T01:29:55.027866+0000","last_fullsized":"2024-08-20T01:29:55.027866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:34:21.948591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'28","reported_seq":187,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:10.057722+0000","last_change":"2024-08-20T01:29:55.038445+0000","last_active":"2024-08-20T01:30:10.057722+0000","last_peered":"2024-08-20T01:30:10.057722+0000","last_clean":"2024-08-20T01:30:10.057722+0000","last_became_active":"2024-08-20T01:29:55.030683+0000","last_became_peered":"2024-08-20T01:29:55.030683+0000","last_unstale":"2024-08-20T01:30:10.057722+0000","last_undegraded":"2024-08-20T01:30:10.057722+0000","last_fullsized":"2024-08-20T01:30:10.057722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:07:42.592996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59762,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":114,"num_write":29,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":59762,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018478+0000","last_change":"2024-08-20T01:29:06.417097+0000","last_active":"2024-08-20T01:29:55.018478+0000","last_peered":"2024-08-20T01:29:55.018478+0000","last_clean":"2024-08-20T01:29:55.018478+0000","last_became_active":"2024-08-20T01:29:06.416491+0000","last_became_peered":"2024-08-20T01:29:06.416491+0000","last_unstale":"2024-08-20T01:29:55.018478+0000","last_undegraded":"2024-08-20T01:29:55.018478+0000","last_fullsized":"2024-08-20T01:29:55.018478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:30:16.071161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021546+0000","last_change":"2024-08-20T01:29:04.412071+0000","last_active":"2024-08-20T01:29:55.021546+0000","last_peered":"2024-08-20T01:29:55.021546+0000","last_clean":"2024-08-20T01:29:55.021546+0000","last_became_active":"2024-08-20T01:29:04.411741+0000","last_became_peered":"2024-08-20T01:29:04.411741+0000","last_unstale":"2024-08-20T01:29:55.021546+0000","last_undegraded":"2024-08-20T01:29:55.021546+0000","last_fullsized":"2024-08-20T01:29:55.021546+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:33:47.753754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019405+0000","last_change":"2024-08-20T01:29:06.408996+0000","last_active":"2024-08-20T01:29:55.019405+0000","last_peered":"2024-08-20T01:29:55.019405+0000","last_clean":"2024-08-20T01:29:55.019405+0000","last_became_active":"2024-08-20T01:29:06.408685+0000","last_became_peered":"2024-08-20T01:29:06.408685+0000","last_unstale":"2024-08-20T01:29:55.019405+0000","last_undegraded":"2024-08-20T01:29:55.019405+0000","last_fullsized":"2024-08-20T01:29:55.019405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:18:28.974108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017430+0000","last_change":"2024-08-20T01:29:04.407852+0000","last_active":"2024-08-20T01:29:55.017430+0000","last_peered":"2024-08-20T01:29:55.017430+0000","last_clean":"2024-08-20T01:29:55.017430+0000","last_became_active":"2024-08-20T01:29:04.406828+0000","last_became_peered":"2024-08-20T01:29:04.406828+0000","last_unstale":"2024-08-20T01:29:55.017430+0000","last_undegraded":"2024-08-20T01:29:55.017430+0000","last_fullsized":"2024-08-20T01:29:55.017430+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:36:03.641146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376676+0000","last_change":"2024-08-20T01:29:06.418652+0000","last_active":"2024-08-20T01:29:55.376676+0000","last_peered":"2024-08-20T01:29:55.376676+0000","last_clean":"2024-08-20T01:29:55.376676+0000","last_became_active":"2024-08-20T01:29:06.418340+0000","last_became_peered":"2024-08-20T01:29:06.418340+0000","last_unstale":"2024-08-20T01:29:55.376676+0000","last_undegraded":"2024-08-20T01:29:55.376676+0000","last_fullsized":"2024-08-20T01:29:55.376676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:56:30.194426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'3","reported_seq":82,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:08.570429+0000","last_change":"2024-08-20T01:29:04.405950+0000","last_active":"2024-08-20T01:30:08.570429+0000","last_peered":"2024-08-20T01:30:08.570429+0000","last_clean":"2024-08-20T01:30:08.570429+0000","last_became_active":"2024-08-20T01:29:04.405650+0000","last_became_peered":"2024-08-20T01:29:04.405650+0000","last_unstale":"2024-08-20T01:30:08.570429+0000","last_undegraded":"2024-08-20T01:30:08.570429+0000","last_fullsized":"2024-08-20T01:30:08.570429+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:12:01.752958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376068+0000","last_change":"2024-08-20T01:29:06.413967+0000","last_active":"2024-08-20T01:29:55.376068+0000","last_peered":"2024-08-20T01:29:55.376068+0000","last_clean":"2024-08-20T01:29:55.376068+0000","last_became_active":"2024-08-20T01:29:06.413628+0000","last_became_peered":"2024-08-20T01:29:06.413628+0000","last_unstale":"2024-08-20T01:29:55.376068+0000","last_undegraded":"2024-08-20T01:29:55.376068+0000","last_fullsized":"2024-08-20T01:29:55.376068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:09:16.394482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018723+0000","last_change":"2024-08-20T01:29:05.169872+0000","last_active":"2024-08-20T01:29:55.018723+0000","last_peered":"2024-08-20T01:29:55.018723+0000","last_clean":"2024-08-20T01:29:55.018723+0000","last_became_active":"2024-08-20T01:29:05.169186+0000","last_became_peered":"2024-08-20T01:29:05.169186+0000","last_unstale":"2024-08-20T01:29:55.018723+0000","last_undegraded":"2024-08-20T01:29:55.018723+0000","last_fullsized":"2024-08-20T01:29:55.018723+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:55:47.447959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.030862+0000","last_change":"2024-08-20T01:29:55.030761+0000","last_active":"2024-08-20T01:29:55.030862+0000","last_peered":"2024-08-20T01:29:55.030862+0000","last_clean":"2024-08-20T01:29:55.030862+0000","last_became_active":"2024-08-20T01:29:55.030308+0000","last_became_peered":"2024-08-20T01:29:55.030308+0000","last_unstale":"2024-08-20T01:29:55.030862+0000","last_undegraded":"2024-08-20T01:29:55.030862+0000","last_fullsized":"2024-08-20T01:29:55.030862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:27:57.082711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018547+0000","last_change":"2024-08-20T01:29:04.408188+0000","last_active":"2024-08-20T01:29:55.018547+0000","last_peered":"2024-08-20T01:29:55.018547+0000","last_clean":"2024-08-20T01:29:55.018547+0000","last_became_active":"2024-08-20T01:29:04.407794+0000","last_became_peered":"2024-08-20T01:29:04.407794+0000","last_unstale":"2024-08-20T01:29:55.018547+0000","last_undegraded":"2024-08-20T01:29:55.018547+0000","last_fullsized":"2024-08-20T01:29:55.018547+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:49:40.679218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024931+0000","last_change":"2024-08-20T01:29:55.024851+0000","last_active":"2024-08-20T01:29:55.024931+0000","last_peered":"2024-08-20T01:29:55.024931+0000","last_clean":"2024-08-20T01:29:55.024931+0000","last_became_active":"2024-08-20T01:29:55.024396+0000","last_became_peered":"2024-08-20T01:29:55.024396+0000","last_unstale":"2024-08-20T01:29:55.024931+0000","last_undegraded":"2024-08-20T01:29:55.024931+0000","last_fullsized":"2024-08-20T01:29:55.024931+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:44:03.846805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019416+0000","last_change":"2024-08-20T01:29:04.412178+0000","last_active":"2024-08-20T01:29:55.019416+0000","last_peered":"2024-08-20T01:29:55.019416+0000","last_clean":"2024-08-20T01:29:55.019416+0000","last_became_active":"2024-08-20T01:29:04.411819+0000","last_became_peered":"2024-08-20T01:29:04.411819+0000","last_unstale":"2024-08-20T01:29:55.019416+0000","last_undegraded":"2024-08-20T01:29:55.019416+0000","last_fullsized":"2024-08-20T01:29:55.019416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:03:11.524911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376922+0000","last_change":"2024-08-20T01:29:06.415697+0000","last_active":"2024-08-20T01:29:55.376922+0000","last_peered":"2024-08-20T01:29:55.376922+0000","last_clean":"2024-08-20T01:29:55.376922+0000","last_became_active":"2024-08-20T01:29:06.415180+0000","last_became_peered":"2024-08-20T01:29:06.415180+0000","last_unstale":"2024-08-20T01:29:55.376922+0000","last_undegraded":"2024-08-20T01:29:55.376922+0000","last_fullsized":"2024-08-20T01:29:55.376922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:55:50.810063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017390+0000","last_change":"2024-08-20T01:29:04.405961+0000","last_active":"2024-08-20T01:29:55.017390+0000","last_peered":"2024-08-20T01:29:55.017390+0000","last_clean":"2024-08-20T01:29:55.017390+0000","last_became_active":"2024-08-20T01:29:04.405633+0000","last_became_peered":"2024-08-20T01:29:04.405633+0000","last_unstale":"2024-08-20T01:29:55.017390+0000","last_undegraded":"2024-08-20T01:29:55.017390+0000","last_fullsized":"2024-08-20T01:29:55.017390+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:00:27.918313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376620+0000","last_change":"2024-08-20T01:29:06.417221+0000","last_active":"2024-08-20T01:29:55.376620+0000","last_peered":"2024-08-20T01:29:55.376620+0000","last_clean":"2024-08-20T01:29:55.376620+0000","last_became_active":"2024-08-20T01:29:06.416912+0000","last_became_peered":"2024-08-20T01:29:06.416912+0000","last_unstale":"2024-08-20T01:29:55.376620+0000","last_undegraded":"2024-08-20T01:29:55.376620+0000","last_fullsized":"2024-08-20T01:29:55.376620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:12:10.667134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.023090+0000","last_change":"2024-08-20T01:29:05.169494+0000","last_active":"2024-08-20T01:29:55.023090+0000","last_peered":"2024-08-20T01:29:55.023090+0000","last_clean":"2024-08-20T01:29:55.023090+0000","last_became_active":"2024-08-20T01:29:05.169059+0000","last_became_peered":"2024-08-20T01:29:05.169059+0000","last_unstale":"2024-08-20T01:29:55.023090+0000","last_undegraded":"2024-08-20T01:29:55.023090+0000","last_fullsized":"2024-08-20T01:29:55.023090+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:25:39.300668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376709+0000","last_change":"2024-08-20T01:29:06.424040+0000","last_active":"2024-08-20T01:29:55.376709+0000","last_peered":"2024-08-20T01:29:55.376709+0000","last_clean":"2024-08-20T01:29:55.376709+0000","last_became_active":"2024-08-20T01:29:06.421360+0000","last_became_peered":"2024-08-20T01:29:06.421360+0000","last_unstale":"2024-08-20T01:29:55.376709+0000","last_undegraded":"2024-08-20T01:29:55.376709+0000","last_fullsized":"2024-08-20T01:29:55.376709+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:24:50.497310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376261+0000","last_change":"2024-08-20T01:27:51.625696+0000","last_active":"2024-08-20T01:29:55.376261+0000","last_peered":"2024-08-20T01:29:55.376261+0000","last_clean":"2024-08-20T01:29:55.376261+0000","last_became_active":"2024-08-20T01:27:51.620833+0000","last_became_peered":"2024-08-20T01:27:51.620833+0000","last_unstale":"2024-08-20T01:29:55.376261+0000","last_undegraded":"2024-08-20T01:29:55.376261+0000","last_fullsized":"2024-08-20T01:29:55.376261+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:24:32.140649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:24:32.140649+0000","last_clean_scrub_stamp":"2024-08-20T01:24:32.140649+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:54:02.650548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019516+0000","last_change":"2024-08-20T01:29:04.405411+0000","last_active":"2024-08-20T01:29:55.019516+0000","last_peered":"2024-08-20T01:29:55.019516+0000","last_clean":"2024-08-20T01:29:55.019516+0000","last_became_active":"2024-08-20T01:29:04.404980+0000","last_became_peered":"2024-08-20T01:29:04.404980+0000","last_unstale":"2024-08-20T01:29:55.019516+0000","last_undegraded":"2024-08-20T01:29:55.019516+0000","last_fullsized":"2024-08-20T01:29:55.019516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:31:39.335857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018501+0000","last_change":"2024-08-20T01:29:06.420368+0000","last_active":"2024-08-20T01:29:55.018501+0000","last_peered":"2024-08-20T01:29:55.018501+0000","last_clean":"2024-08-20T01:29:55.018501+0000","last_became_active":"2024-08-20T01:29:06.419653+0000","last_became_peered":"2024-08-20T01:29:06.419653+0000","last_unstale":"2024-08-20T01:29:55.018501+0000","last_undegraded":"2024-08-20T01:29:55.018501+0000","last_fullsized":"2024-08-20T01:29:55.018501+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:48.771774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376170+0000","last_change":"2024-08-20T01:29:04.410302+0000","last_active":"2024-08-20T01:29:55.376170+0000","last_peered":"2024-08-20T01:29:55.376170+0000","last_clean":"2024-08-20T01:29:55.376170+0000","last_became_active":"2024-08-20T01:29:04.409977+0000","last_became_peered":"2024-08-20T01:29:04.409977+0000","last_unstale":"2024-08-20T01:29:55.376170+0000","last_undegraded":"2024-08-20T01:29:55.376170+0000","last_fullsized":"2024-08-20T01:29:55.376170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:57:21.593739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019623+0000","last_change":"2024-08-20T01:29:06.419798+0000","last_active":"2024-08-20T01:29:55.019623+0000","last_peered":"2024-08-20T01:29:55.019623+0000","last_clean":"2024-08-20T01:29:55.019623+0000","last_became_active":"2024-08-20T01:29:06.419546+0000","last_became_peered":"2024-08-20T01:29:06.419546+0000","last_unstale":"2024-08-20T01:29:55.019623+0000","last_undegraded":"2024-08-20T01:29:55.019623+0000","last_fullsized":"2024-08-20T01:29:55.019623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:51:31.848883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":82,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:09.571203+0000","last_change":"2024-08-20T01:29:05.169237+0000","last_active":"2024-08-20T01:30:09.571203+0000","last_peered":"2024-08-20T01:30:09.571203+0000","last_clean":"2024-08-20T01:30:09.571203+0000","last_became_active":"2024-08-20T01:29:05.168778+0000","last_became_peered":"2024-08-20T01:29:05.168778+0000","last_unstale":"2024-08-20T01:30:09.571203+0000","last_undegraded":"2024-08-20T01:30:09.571203+0000","last_fullsized":"2024-08-20T01:30:09.571203+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:04:48.847412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024435+0000","last_change":"2024-08-20T01:29:55.024339+0000","last_active":"2024-08-20T01:29:55.024435+0000","last_peered":"2024-08-20T01:29:55.024435+0000","last_clean":"2024-08-20T01:29:55.024435+0000","last_became_active":"2024-08-20T01:29:55.023944+0000","last_became_peered":"2024-08-20T01:29:55.023944+0000","last_unstale":"2024-08-20T01:29:55.024435+0000","last_undegraded":"2024-08-20T01:29:55.024435+0000","last_fullsized":"2024-08-20T01:29:55.024435+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:14:00.589422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376838+0000","last_change":"2024-08-20T01:29:04.404472+0000","last_active":"2024-08-20T01:29:55.376838+0000","last_peered":"2024-08-20T01:29:55.376838+0000","last_clean":"2024-08-20T01:29:55.376838+0000","last_became_active":"2024-08-20T01:29:04.404010+0000","last_became_peered":"2024-08-20T01:29:04.404010+0000","last_unstale":"2024-08-20T01:29:55.376838+0000","last_undegraded":"2024-08-20T01:29:55.376838+0000","last_fullsized":"2024-08-20T01:29:55.376838+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:53:04.263362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024682+0000","last_change":"2024-08-20T01:29:06.421875+0000","last_active":"2024-08-20T01:29:55.024682+0000","last_peered":"2024-08-20T01:29:55.024682+0000","last_clean":"2024-08-20T01:29:55.024682+0000","last_became_active":"2024-08-20T01:29:06.421542+0000","last_became_peered":"2024-08-20T01:29:06.421542+0000","last_unstale":"2024-08-20T01:29:55.024682+0000","last_undegraded":"2024-08-20T01:29:55.024682+0000","last_fullsized":"2024-08-20T01:29:55.024682+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:10:46.320252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015905+0000","last_change":"2024-08-20T01:29:05.169985+0000","last_active":"2024-08-20T01:29:55.015905+0000","last_peered":"2024-08-20T01:29:55.015905+0000","last_clean":"2024-08-20T01:29:55.015905+0000","last_became_active":"2024-08-20T01:29:05.169607+0000","last_became_peered":"2024-08-20T01:29:05.169607+0000","last_unstale":"2024-08-20T01:29:55.015905+0000","last_undegraded":"2024-08-20T01:29:55.015905+0000","last_fullsized":"2024-08-20T01:29:55.015905+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:03:23.278369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024870+0000","last_change":"2024-08-20T01:29:06.414862+0000","last_active":"2024-08-20T01:29:55.024870+0000","last_peered":"2024-08-20T01:29:55.024870+0000","last_clean":"2024-08-20T01:29:55.024870+0000","last_became_active":"2024-08-20T01:29:06.414527+0000","last_became_peered":"2024-08-20T01:29:06.414527+0000","last_unstale":"2024-08-20T01:29:55.024870+0000","last_undegraded":"2024-08-20T01:29:55.024870+0000","last_fullsized":"2024-08-20T01:29:55.024870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:14:20.884073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018713+0000","last_change":"2024-08-20T01:29:05.169638+0000","last_active":"2024-08-20T01:29:55.018713+0000","last_peered":"2024-08-20T01:29:55.018713+0000","last_clean":"2024-08-20T01:29:55.018713+0000","last_became_active":"2024-08-20T01:29:05.169202+0000","last_became_peered":"2024-08-20T01:29:05.169202+0000","last_unstale":"2024-08-20T01:29:55.018713+0000","last_undegraded":"2024-08-20T01:29:55.018713+0000","last_fullsized":"2024-08-20T01:29:55.018713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:05:39.645782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019554+0000","last_change":"2024-08-20T01:29:06.413839+0000","last_active":"2024-08-20T01:29:55.019554+0000","last_peered":"2024-08-20T01:29:55.019554+0000","last_clean":"2024-08-20T01:29:55.019554+0000","last_became_active":"2024-08-20T01:29:06.413488+0000","last_became_peered":"2024-08-20T01:29:06.413488+0000","last_unstale":"2024-08-20T01:29:55.019554+0000","last_undegraded":"2024-08-20T01:29:55.019554+0000","last_fullsized":"2024-08-20T01:29:55.019554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:35:04.007192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'12","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.028397+0000","last_change":"2024-08-20T01:29:55.028344+0000","last_active":"2024-08-20T01:29:55.028397+0000","last_peered":"2024-08-20T01:29:55.028397+0000","last_clean":"2024-08-20T01:29:55.028397+0000","last_became_active":"2024-08-20T01:29:55.023700+0000","last_became_peered":"2024-08-20T01:29:55.023700+0000","last_unstale":"2024-08-20T01:29:55.028397+0000","last_undegraded":"2024-08-20T01:29:55.028397+0000","last_fullsized":"2024-08-20T01:29:55.028397+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:48:39.513322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018444+0000","last_change":"2024-08-20T01:29:06.421024+0000","last_active":"2024-08-20T01:29:55.018444+0000","last_peered":"2024-08-20T01:29:55.018444+0000","last_clean":"2024-08-20T01:29:55.018444+0000","last_became_active":"2024-08-20T01:29:06.420631+0000","last_became_peered":"2024-08-20T01:29:06.420631+0000","last_unstale":"2024-08-20T01:29:55.018444+0000","last_undegraded":"2024-08-20T01:29:55.018444+0000","last_fullsized":"2024-08-20T01:29:55.018444+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:07:57.992230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019783+0000","last_change":"2024-08-20T01:29:04.835075+0000","last_active":"2024-08-20T01:29:55.019783+0000","last_peered":"2024-08-20T01:29:55.019783+0000","last_clean":"2024-08-20T01:29:55.019783+0000","last_became_active":"2024-08-20T01:29:04.834759+0000","last_became_peered":"2024-08-20T01:29:04.834759+0000","last_unstale":"2024-08-20T01:29:55.019783+0000","last_undegraded":"2024-08-20T01:29:55.019783+0000","last_fullsized":"2024-08-20T01:29:55.019783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:45:29.040626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255550+0000","last_change":"2024-08-20T01:29:06.418187+0000","last_active":"2024-08-20T01:29:55.255550+0000","last_peered":"2024-08-20T01:29:55.255550+0000","last_clean":"2024-08-20T01:29:55.255550+0000","last_became_active":"2024-08-20T01:29:06.417851+0000","last_became_peered":"2024-08-20T01:29:06.417851+0000","last_unstale":"2024-08-20T01:29:55.255550+0000","last_undegraded":"2024-08-20T01:29:55.255550+0000","last_fullsized":"2024-08-20T01:29:55.255550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:15:48.204455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027380+0000","last_change":"2024-08-20T01:29:05.169736+0000","last_active":"2024-08-20T01:29:55.027380+0000","last_peered":"2024-08-20T01:29:55.027380+0000","last_clean":"2024-08-20T01:29:55.027380+0000","last_became_active":"2024-08-20T01:29:05.169403+0000","last_became_peered":"2024-08-20T01:29:05.169403+0000","last_unstale":"2024-08-20T01:29:55.027380+0000","last_undegraded":"2024-08-20T01:29:55.027380+0000","last_fullsized":"2024-08-20T01:29:55.027380+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:43:43.500841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017870+0000","last_change":"2024-08-20T01:29:06.416433+0000","last_active":"2024-08-20T01:29:55.017870+0000","last_peered":"2024-08-20T01:29:55.017870+0000","last_clean":"2024-08-20T01:29:55.017870+0000","last_became_active":"2024-08-20T01:29:06.414708+0000","last_became_peered":"2024-08-20T01:29:06.414708+0000","last_unstale":"2024-08-20T01:29:55.017870+0000","last_undegraded":"2024-08-20T01:29:55.017870+0000","last_fullsized":"2024-08-20T01:29:55.017870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:17:15.461536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018260+0000","last_change":"2024-08-20T01:29:04.403090+0000","last_active":"2024-08-20T01:29:55.018260+0000","last_peered":"2024-08-20T01:29:55.018260+0000","last_clean":"2024-08-20T01:29:55.018260+0000","last_became_active":"2024-08-20T01:29:04.402697+0000","last_became_peered":"2024-08-20T01:29:04.402697+0000","last_unstale":"2024-08-20T01:29:55.018260+0000","last_undegraded":"2024-08-20T01:29:55.018260+0000","last_fullsized":"2024-08-20T01:29:55.018260+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:36:04.055868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.020556+0000","last_change":"2024-08-20T01:29:06.413427+0000","last_active":"2024-08-20T01:29:55.020556+0000","last_peered":"2024-08-20T01:29:55.020556+0000","last_clean":"2024-08-20T01:29:55.020556+0000","last_became_active":"2024-08-20T01:29:06.413058+0000","last_became_peered":"2024-08-20T01:29:06.413058+0000","last_unstale":"2024-08-20T01:29:55.020556+0000","last_undegraded":"2024-08-20T01:29:55.020556+0000","last_fullsized":"2024-08-20T01:29:55.020556+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:38:38.546701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021609+0000","last_change":"2024-08-20T01:29:04.409859+0000","last_active":"2024-08-20T01:29:55.021609+0000","last_peered":"2024-08-20T01:29:55.021609+0000","last_clean":"2024-08-20T01:29:55.021609+0000","last_became_active":"2024-08-20T01:29:04.409497+0000","last_became_peered":"2024-08-20T01:29:04.409497+0000","last_unstale":"2024-08-20T01:29:55.021609+0000","last_undegraded":"2024-08-20T01:29:55.021609+0000","last_fullsized":"2024-08-20T01:29:55.021609+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:23:43.548912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018397+0000","last_change":"2024-08-20T01:29:06.418428+0000","last_active":"2024-08-20T01:29:55.018397+0000","last_peered":"2024-08-20T01:29:55.018397+0000","last_clean":"2024-08-20T01:29:55.018397+0000","last_became_active":"2024-08-20T01:29:06.418033+0000","last_became_peered":"2024-08-20T01:29:06.418033+0000","last_unstale":"2024-08-20T01:29:55.018397+0000","last_undegraded":"2024-08-20T01:29:55.018397+0000","last_fullsized":"2024-08-20T01:29:55.018397+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:23.503977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017941+0000","last_change":"2024-08-20T01:29:04.412549+0000","last_active":"2024-08-20T01:29:55.017941+0000","last_peered":"2024-08-20T01:29:55.017941+0000","last_clean":"2024-08-20T01:29:55.017941+0000","last_became_active":"2024-08-20T01:29:04.412071+0000","last_became_peered":"2024-08-20T01:29:04.412071+0000","last_unstale":"2024-08-20T01:29:55.017941+0000","last_undegraded":"2024-08-20T01:29:55.017941+0000","last_fullsized":"2024-08-20T01:29:55.017941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:48:51.195295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376669+0000","last_change":"2024-08-20T01:29:06.421431+0000","last_active":"2024-08-20T01:29:55.376669+0000","last_peered":"2024-08-20T01:29:55.376669+0000","last_clean":"2024-08-20T01:29:55.376669+0000","last_became_active":"2024-08-20T01:29:06.420916+0000","last_became_peered":"2024-08-20T01:29:06.420916+0000","last_unstale":"2024-08-20T01:29:55.376669+0000","last_undegraded":"2024-08-20T01:29:55.376669+0000","last_fullsized":"2024-08-20T01:29:55.376669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:45.674530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017140+0000","last_change":"2024-08-20T01:29:06.418209+0000","last_active":"2024-08-20T01:29:55.017140+0000","last_peered":"2024-08-20T01:29:55.017140+0000","last_clean":"2024-08-20T01:29:55.017140+0000","last_became_active":"2024-08-20T01:29:06.417812+0000","last_became_peered":"2024-08-20T01:29:06.417812+0000","last_unstale":"2024-08-20T01:29:55.017140+0000","last_undegraded":"2024-08-20T01:29:55.017140+0000","last_fullsized":"2024-08-20T01:29:55.017140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:05:43.794281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018906+0000","last_change":"2024-08-20T01:29:04.408472+0000","last_active":"2024-08-20T01:29:55.018906+0000","last_peered":"2024-08-20T01:29:55.018906+0000","last_clean":"2024-08-20T01:29:55.018906+0000","last_became_active":"2024-08-20T01:29:04.408082+0000","last_became_peered":"2024-08-20T01:29:04.408082+0000","last_unstale":"2024-08-20T01:29:55.018906+0000","last_undegraded":"2024-08-20T01:29:55.018906+0000","last_fullsized":"2024-08-20T01:29:55.018906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:14:44.659672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027748+0000","last_change":"2024-08-20T01:29:06.423562+0000","last_active":"2024-08-20T01:29:55.027748+0000","last_peered":"2024-08-20T01:29:55.027748+0000","last_clean":"2024-08-20T01:29:55.027748+0000","last_became_active":"2024-08-20T01:29:06.423241+0000","last_became_peered":"2024-08-20T01:29:06.423241+0000","last_unstale":"2024-08-20T01:29:55.027748+0000","last_undegraded":"2024-08-20T01:29:55.027748+0000","last_fullsized":"2024-08-20T01:29:55.027748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:59:46.049449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018583+0000","last_change":"2024-08-20T01:29:04.412287+0000","last_active":"2024-08-20T01:29:55.018583+0000","last_peered":"2024-08-20T01:29:55.018583+0000","last_clean":"2024-08-20T01:29:55.018583+0000","last_became_active":"2024-08-20T01:29:04.411912+0000","last_became_peered":"2024-08-20T01:29:04.411912+0000","last_unstale":"2024-08-20T01:29:55.018583+0000","last_undegraded":"2024-08-20T01:29:55.018583+0000","last_fullsized":"2024-08-20T01:29:55.018583+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:19:25.816795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255713+0000","last_change":"2024-08-20T01:29:06.416899+0000","last_active":"2024-08-20T01:29:55.255713+0000","last_peered":"2024-08-20T01:29:55.255713+0000","last_clean":"2024-08-20T01:29:55.255713+0000","last_became_active":"2024-08-20T01:29:06.416594+0000","last_became_peered":"2024-08-20T01:29:06.416594+0000","last_unstale":"2024-08-20T01:29:55.255713+0000","last_undegraded":"2024-08-20T01:29:55.255713+0000","last_fullsized":"2024-08-20T01:29:55.255713+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:43.896728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018949+0000","last_change":"2024-08-20T01:29:05.169571+0000","last_active":"2024-08-20T01:29:55.018949+0000","last_peered":"2024-08-20T01:29:55.018949+0000","last_clean":"2024-08-20T01:29:55.018949+0000","last_became_active":"2024-08-20T01:29:05.169250+0000","last_became_peered":"2024-08-20T01:29:05.169250+0000","last_unstale":"2024-08-20T01:29:55.018949+0000","last_undegraded":"2024-08-20T01:29:55.018949+0000","last_fullsized":"2024-08-20T01:29:55.018949+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:32:04.555825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018626+0000","last_change":"2024-08-20T01:29:06.415582+0000","last_active":"2024-08-20T01:29:55.018626+0000","last_peered":"2024-08-20T01:29:55.018626+0000","last_clean":"2024-08-20T01:29:55.018626+0000","last_became_active":"2024-08-20T01:29:06.415284+0000","last_became_peered":"2024-08-20T01:29:06.415284+0000","last_unstale":"2024-08-20T01:29:55.018626+0000","last_undegraded":"2024-08-20T01:29:55.018626+0000","last_fullsized":"2024-08-20T01:29:55.018626+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:43:10.311792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015914+0000","last_change":"2024-08-20T01:29:04.409389+0000","last_active":"2024-08-20T01:29:55.015914+0000","last_peered":"2024-08-20T01:29:55.015914+0000","last_clean":"2024-08-20T01:29:55.015914+0000","last_became_active":"2024-08-20T01:29:04.409099+0000","last_became_peered":"2024-08-20T01:29:04.409099+0000","last_unstale":"2024-08-20T01:29:55.015914+0000","last_undegraded":"2024-08-20T01:29:55.015914+0000","last_fullsized":"2024-08-20T01:29:55.015914+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:19:30.156443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63763,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":350,"num_read_kb":243,"num_write":164,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":59762,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":372736,"data_stored":191289,"data_compressed":9608,"data_compressed_allocated":12288,"data_compressed_original":57344,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285456,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743451,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":831488,"data_stored":406512,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939680,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":983040,"data_stored":1057755,"data_compressed":42066,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103204,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":406748,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299432,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":847872,"data_stored":406668,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495662,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":998598,"data_compressed":42066,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659188,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":406137,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855417,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":909312,"data_stored":998282,"data_compressed":42066,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018942,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":864256,"data_stored":466336,"data_compressed":15386,"data_compressed_allocated":20480,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215170,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":851968,"data_stored":406448,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444103,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":851968,"data_stored":407671,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":465692,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":856064,"data_stored":407408,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":60406,"data_compressed":9608,"data_compressed_allocated":12288,"data_compressed_original":57344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T01:30:13.800 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-20T01:30:13.800 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-20T01:30:13.800 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-20T01:30:13.800 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph health --format=json 2024-08-20T01:30:14.063 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:14.340 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:14 smithi022 ceph-mon[18709]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:30:14.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:14 smithi134 ceph-mon[22511]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:30:14.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.522+0000 7f6c6a7ef640 1 -- 172.21.15.22:0/3551152579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c6410ce40 msgr2=0x7f6c6410f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:14.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.522+0000 7f6c6a7ef640 1 --2- 172.21.15.22:0/3551152579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c6410ce40 0x7f6c6410f2a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009ca0 tx=0x7f6c5c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:30:14.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.522+0000 7f6c6a7ef640 1 -- 172.21.15.22:0/3551152579 shutdown_connections 2024-08-20T01:30:14.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.522+0000 7f6c6a7ef640 1 --2- 172.21.15.22:0/3551152579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c6410ce40 0x7f6c6410f2a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:14.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.522+0000 7f6c6a7ef640 1 --2- 172.21.15.22:0/3551152579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c64104300 0x7f6c6410c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:14.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.522+0000 7f6c6a7ef640 1 --2- 172.21.15.22:0/3551152579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c641039e0 0x7f6c64103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:14.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.522+0000 7f6c6a7ef640 1 -- 172.21.15.22:0/3551152579 >> 172.21.15.22:0/3551152579 conn(0x7f6c640fd440 msgr2=0x7f6c640ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:14.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.522+0000 7f6c6a7ef640 1 -- 172.21.15.22:0/3551152579 shutdown_connections 2024-08-20T01:30:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.522+0000 7f6c6a7ef640 1 -- 172.21.15.22:0/3551152579 wait complete. 2024-08-20T01:30:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.523+0000 7f6c6a7ef640 1 Processor -- start 2024-08-20T01:30:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.523+0000 7f6c6a7ef640 1 -- start start 2024-08-20T01:30:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.523+0000 7f6c6a7ef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c641039e0 0x7f6c64198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.523+0000 7f6c6a7ef640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c64104300 0x7f6c641994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.523+0000 7f6c6a7ef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c6410ce40 0x7f6c6419e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.523+0000 7f6c6a7ef640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6c64112ab0 con 0x7f6c64104300 2024-08-20T01:30:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.523+0000 7f6c6a7ef640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6c64112930 con 0x7f6c641039e0 2024-08-20T01:30:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.523+0000 7f6c6a7ef640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6c64112c30 con 0x7f6c6410ce40 2024-08-20T01:30:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.523+0000 7f6c637fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c64104300 0x7f6c641994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.523+0000 7f6c637fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c64104300 0x7f6c641994e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49560/0 (socket says 172.21.15.22:49560) 2024-08-20T01:30:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.523+0000 7f6c637fe640 1 -- 172.21.15.22:0/3428665735 learned_addr learned my addr 172.21.15.22:0/3428665735 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.524+0000 7f6c63fff640 1 --2- 172.21.15.22:0/3428665735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c641039e0 0x7f6c64198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.524+0000 7f6c68d8c640 1 --2- 172.21.15.22:0/3428665735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c6410ce40 0x7f6c6419e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.524+0000 7f6c637fe640 1 -- 172.21.15.22:0/3428665735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c6410ce40 msgr2=0x7f6c6419e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.524+0000 7f6c637fe640 1 --2- 172.21.15.22:0/3428665735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c6410ce40 0x7f6c6419e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.524+0000 7f6c637fe640 1 -- 172.21.15.22:0/3428665735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c641039e0 msgr2=0x7f6c64198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.524+0000 7f6c637fe640 1 --2- 172.21.15.22:0/3428665735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c641039e0 0x7f6c64198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.524+0000 7f6c637fe640 1 -- 172.21.15.22:0/3428665735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6419f050 con 0x7f6c64104300 2024-08-20T01:30:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.524+0000 7f6c68d8c640 1 --2- 172.21.15.22:0/3428665735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c6410ce40 0x7f6c6419e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:30:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.524+0000 7f6c637fe640 1 --2- 172.21.15.22:0/3428665735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c64104300 0x7f6c641994e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800e9c0 tx=0x7f6c5800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.524+0000 7f6c617fa640 1 -- 172.21.15.22:0/3428665735 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5800ccc0 con 0x7f6c64104300 2024-08-20T01:30:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.524+0000 7f6c617fa640 1 -- 172.21.15.22:0/3428665735 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c580035f0 con 0x7f6c64104300 2024-08-20T01:30:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.524+0000 7f6c6a7ef640 1 -- 172.21.15.22:0/3428665735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6419f340 con 0x7f6c64104300 2024-08-20T01:30:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.524+0000 7f6c617fa640 1 -- 172.21.15.22:0/3428665735 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5800ce60 con 0x7f6c64104300 2024-08-20T01:30:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.524+0000 7f6c6a7ef640 1 -- 172.21.15.22:0/3428665735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c641a5a00 con 0x7f6c64104300 2024-08-20T01:30:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.525+0000 7f6c6a7ef640 1 -- 172.21.15.22:0/3428665735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c64103dc0 con 0x7f6c64104300 2024-08-20T01:30:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.526+0000 7f6c617fa640 1 -- 172.21.15.22:0/3428665735 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f6c58004000 con 0x7f6c64104300 2024-08-20T01:30:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.528+0000 7f6c617fa640 1 --2- 172.21.15.22:0/3428665735 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6c4c0b3c60 0x7f6c4c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:14.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.528+0000 7f6c63fff640 1 --2- 172.21.15.22:0/3428665735 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6c4c0b3c60 0x7f6c4c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:14.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.528+0000 7f6c617fa640 1 -- 172.21.15.22:0/3428665735 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f6c580e4250 con 0x7f6c64104300 2024-08-20T01:30:14.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.528+0000 7f6c63fff640 1 --2- 172.21.15.22:0/3428665735 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6c4c0b3c60 0x7f6c4c0b6120 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6c5400bbe0 tx=0x7f6c5400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:14.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.531+0000 7f6c617fa640 1 -- 172.21.15.22:0/3428665735 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f6c580ab6c0 con 0x7f6c64104300 2024-08-20T01:30:14.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:14 smithi077 ceph-mon[22251]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:30:14.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.755+0000 7f6c6a7ef640 1 -- 172.21.15.22:0/3428665735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6c641a5e30 con 0x7f6c64104300 2024-08-20T01:30:14.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.756+0000 7f6c617fa640 1 -- 172.21.15.22:0/3428665735 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f6c580aafc0 con 0x7f6c64104300 2024-08-20T01:30:14.757 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:14.757 INFO:teuthology.orchestra.run.smithi022.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-20T01:30:14.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.758+0000 7f6c6a7ef640 1 -- 172.21.15.22:0/3428665735 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6c4c0b3c60 msgr2=0x7f6c4c0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:14.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.758+0000 7f6c6a7ef640 1 --2- 172.21.15.22:0/3428665735 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6c4c0b3c60 0x7f6c4c0b6120 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6c5400bbe0 tx=0x7f6c5400b390 comp rx=0 tx=0).stop 2024-08-20T01:30:14.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.758+0000 7f6c6a7ef640 1 -- 172.21.15.22:0/3428665735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c64104300 msgr2=0x7f6c641994e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:14.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.758+0000 7f6c6a7ef640 1 --2- 172.21.15.22:0/3428665735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c64104300 0x7f6c641994e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800e9c0 tx=0x7f6c5800ee80 comp rx=0 tx=0).stop 2024-08-20T01:30:14.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.758+0000 7f6c6a7ef640 1 -- 172.21.15.22:0/3428665735 shutdown_connections 2024-08-20T01:30:14.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.758+0000 7f6c6a7ef640 1 --2- 172.21.15.22:0/3428665735 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6c4c0b3c60 0x7f6c4c0b6120 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:14.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.758+0000 7f6c6a7ef640 1 --2- 172.21.15.22:0/3428665735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c6410ce40 0x7f6c6419e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:14.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.758+0000 7f6c6a7ef640 1 --2- 172.21.15.22:0/3428665735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c64104300 0x7f6c641994e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:14.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.758+0000 7f6c6a7ef640 1 --2- 172.21.15.22:0/3428665735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c641039e0 0x7f6c64198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:14.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.758+0000 7f6c6a7ef640 1 -- 172.21.15.22:0/3428665735 >> 172.21.15.22:0/3428665735 conn(0x7f6c640fd440 msgr2=0x7f6c6410f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:14.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.758+0000 7f6c6a7ef640 1 -- 172.21.15.22:0/3428665735 shutdown_connections 2024-08-20T01:30:14.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:14.758+0000 7f6c6a7ef640 1 -- 172.21.15.22:0/3428665735 wait complete. 2024-08-20T01:30:15.356 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:15 smithi022 ceph-mon[18709]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:15.356 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:15 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3428665735' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-20T01:30:15.385 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-20T01:30:15.385 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:30:15.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:15 smithi134 ceph-mon[22511]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:15.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:15 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3428665735' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-20T01:30:15.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:15 smithi077 ceph-mon[22251]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:15.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:15 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3428665735' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-20T01:30:15.650 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.152+0000 7fc294a43640 1 -- 172.21.15.22:0/2577547741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc290107d20 msgr2=0x7fc29010e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.152+0000 7fc294a43640 1 --2- 172.21.15.22:0/2577547741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc290107d20 0x7fc29010e520 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc288009ca0 tx=0x7fc28802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:30:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.152+0000 7fc294a43640 1 -- 172.21.15.22:0/2577547741 shutdown_connections 2024-08-20T01:30:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.152+0000 7fc294a43640 1 --2- 172.21.15.22:0/2577547741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc290107d20 0x7fc29010e520 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.152+0000 7fc294a43640 1 --2- 172.21.15.22:0/2577547741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2901073a0 0x7fc2901077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.152+0000 7fc294a43640 1 --2- 172.21.15.22:0/2577547741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc290101990 0x7fc290101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.152+0000 7fc294a43640 1 -- 172.21.15.22:0/2577547741 >> 172.21.15.22:0/2577547741 conn(0x7fc2900fd400 msgr2=0x7fc2900ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.152+0000 7fc294a43640 1 -- 172.21.15.22:0/2577547741 shutdown_connections 2024-08-20T01:30:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.152+0000 7fc294a43640 1 -- 172.21.15.22:0/2577547741 wait complete. 2024-08-20T01:30:16.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.153+0000 7fc294a43640 1 Processor -- start 2024-08-20T01:30:16.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.153+0000 7fc294a43640 1 -- start start 2024-08-20T01:30:16.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.153+0000 7fc294a43640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc290101990 0x7fc290198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:16.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.153+0000 7fc294a43640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2901073a0 0x7fc290199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:16.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.153+0000 7fc294a43640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc290107d20 0x7fc29019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:16.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.153+0000 7fc294a43640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc2901119e0 con 0x7fc2901073a0 2024-08-20T01:30:16.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.153+0000 7fc294a43640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc290111860 con 0x7fc290107d20 2024-08-20T01:30:16.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.153+0000 7fc294a43640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc290111b60 con 0x7fc290101990 2024-08-20T01:30:16.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.153+0000 7fc28dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2901073a0 0x7fc290199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:16.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.153+0000 7fc28dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2901073a0 0x7fc290199520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49578/0 (socket says 172.21.15.22:49578) 2024-08-20T01:30:16.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.153+0000 7fc28dd9b640 1 -- 172.21.15.22:0/2146896343 learned_addr learned my addr 172.21.15.22:0/2146896343 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:16.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.153+0000 7fc28ed9d640 1 --2- 172.21.15.22:0/2146896343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc290107d20 0x7fc29019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:16.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.154+0000 7fc28e59c640 1 --2- 172.21.15.22:0/2146896343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc290101990 0x7fc290198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:16.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.154+0000 7fc28dd9b640 1 -- 172.21.15.22:0/2146896343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc290101990 msgr2=0x7fc290198fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:16.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.154+0000 7fc28dd9b640 1 --2- 172.21.15.22:0/2146896343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc290101990 0x7fc290198fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:16.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.154+0000 7fc28dd9b640 1 -- 172.21.15.22:0/2146896343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc290107d20 msgr2=0x7fc29019e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:16.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.154+0000 7fc28dd9b640 1 --2- 172.21.15.22:0/2146896343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc290107d20 0x7fc29019e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:16.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.154+0000 7fc28dd9b640 1 -- 172.21.15.22:0/2146896343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29019f090 con 0x7fc2901073a0 2024-08-20T01:30:16.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.154+0000 7fc28dd9b640 1 --2- 172.21.15.22:0/2146896343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2901073a0 0x7fc290199520 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc28000b4a0 tx=0x7fc28000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:16.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.154+0000 7fc2877fe640 1 -- 172.21.15.22:0/2146896343 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc280014070 con 0x7fc2901073a0 2024-08-20T01:30:16.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.154+0000 7fc294a43640 1 -- 172.21.15.22:0/2146896343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc29019f380 con 0x7fc2901073a0 2024-08-20T01:30:16.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.154+0000 7fc2877fe640 1 -- 172.21.15.22:0/2146896343 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc280010ac0 con 0x7fc2901073a0 2024-08-20T01:30:16.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.154+0000 7fc2877fe640 1 -- 172.21.15.22:0/2146896343 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc280017c30 con 0x7fc2901073a0 2024-08-20T01:30:16.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.154+0000 7fc294a43640 1 -- 172.21.15.22:0/2146896343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2901a5ac0 con 0x7fc2901073a0 2024-08-20T01:30:16.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.155+0000 7fc294a43640 1 -- 172.21.15.22:0/2146896343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc290101d70 con 0x7fc2901073a0 2024-08-20T01:30:16.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.157+0000 7fc2877fe640 1 -- 172.21.15.22:0/2146896343 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fc280017070 con 0x7fc2901073a0 2024-08-20T01:30:16.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.158+0000 7fc2877fe640 1 --2- 172.21.15.22:0/2146896343 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc27c0b3c60 0x7fc27c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:16.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.158+0000 7fc28e59c640 1 --2- 172.21.15.22:0/2146896343 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc27c0b3c60 0x7fc27c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:16.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.158+0000 7fc2877fe640 1 -- 172.21.15.22:0/2146896343 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7fc2800e32d0 con 0x7fc2901073a0 2024-08-20T01:30:16.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.158+0000 7fc28e59c640 1 --2- 172.21.15.22:0/2146896343 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc27c0b3c60 0x7fc27c0b6120 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc2780058c0 tx=0x7fc27800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:16.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.161+0000 7fc2877fe640 1 -- 172.21.15.22:0/2146896343 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fc2800aa260 con 0x7fc2901073a0 2024-08-20T01:30:16.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.382+0000 7fc294a43640 1 -- 172.21.15.22:0/2146896343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2901a5de0 con 0x7fc2901073a0 2024-08-20T01:30:16.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.383+0000 7fc2877fe640 1 -- 172.21.15.22:0/2146896343 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11906 (secure 0 0 0) 0x7fc2800ae7b0 con 0x7fc2901073a0 2024-08-20T01:30:16.384 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:16.384 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"btime":"2024-08-20T01:29:18:472908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:29:18.048623+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24565,24575,24586]},"id":1}]} 2024-08-20T01:30:16.384 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 24 2024-08-20T01:30:16.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.386+0000 7fc294a43640 1 -- 172.21.15.22:0/2146896343 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc27c0b3c60 msgr2=0x7fc27c0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:16.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.386+0000 7fc294a43640 1 --2- 172.21.15.22:0/2146896343 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc27c0b3c60 0x7fc27c0b6120 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc2780058c0 tx=0x7fc27800a2d0 comp rx=0 tx=0).stop 2024-08-20T01:30:16.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.386+0000 7fc294a43640 1 -- 172.21.15.22:0/2146896343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2901073a0 msgr2=0x7fc290199520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:16.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.386+0000 7fc294a43640 1 --2- 172.21.15.22:0/2146896343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2901073a0 0x7fc290199520 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc28000b4a0 tx=0x7fc28000b960 comp rx=0 tx=0).stop 2024-08-20T01:30:16.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.386+0000 7fc294a43640 1 -- 172.21.15.22:0/2146896343 shutdown_connections 2024-08-20T01:30:16.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.386+0000 7fc294a43640 1 --2- 172.21.15.22:0/2146896343 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc27c0b3c60 0x7fc27c0b6120 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:16.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.386+0000 7fc294a43640 1 --2- 172.21.15.22:0/2146896343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc290107d20 0x7fc29019e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:16.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.386+0000 7fc294a43640 1 --2- 172.21.15.22:0/2146896343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2901073a0 0x7fc290199520 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:16.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.386+0000 7fc294a43640 1 --2- 172.21.15.22:0/2146896343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc290101990 0x7fc290198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:16.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.386+0000 7fc294a43640 1 -- 172.21.15.22:0/2146896343 >> 172.21.15.22:0/2146896343 conn(0x7fc2900fd400 msgr2=0x7fc290104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:16.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.386+0000 7fc294a43640 1 -- 172.21.15.22:0/2146896343 shutdown_connections 2024-08-20T01:30:16.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:16.386+0000 7fc294a43640 1 -- 172.21.15.22:0/2146896343 wait complete. 2024-08-20T01:30:17.035 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:30:17.297 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:17.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:17 smithi022 ceph-mon[18709]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-20T01:30:17.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:17 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2146896343' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:17.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:17 smithi134 ceph-mon[22511]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-20T01:30:17.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:17 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2146896343' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:17.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:17 smithi077 ceph-mon[22251]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-20T01:30:17.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:17 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2146896343' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:17.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.741+0000 7f797eb7b640 1 -- 172.21.15.22:0/3447570716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f797810f120 msgr2=0x7f7978111510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:17.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.741+0000 7f797eb7b640 1 --2- 172.21.15.22:0/3447570716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f797810f120 0x7f7978111510 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7970009ca0 tx=0x7f797002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:30:17.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.741+0000 7f797eb7b640 1 -- 172.21.15.22:0/3447570716 shutdown_connections 2024-08-20T01:30:17.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.741+0000 7f797eb7b640 1 --2- 172.21.15.22:0/3447570716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f797810f120 0x7f7978111510 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:17.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.741+0000 7f797eb7b640 1 --2- 172.21.15.22:0/3447570716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7978101e90 0x7f797810ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:17.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.741+0000 7f797eb7b640 1 --2- 172.21.15.22:0/3447570716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7978101570 0x7f7978101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:17.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.741+0000 7f797eb7b640 1 -- 172.21.15.22:0/3447570716 >> 172.21.15.22:0/3447570716 conn(0x7f79780fd440 msgr2=0x7f79780ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:17.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.741+0000 7f797eb7b640 1 -- 172.21.15.22:0/3447570716 shutdown_connections 2024-08-20T01:30:17.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.741+0000 7f797eb7b640 1 -- 172.21.15.22:0/3447570716 wait complete. 2024-08-20T01:30:17.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.742+0000 7f797eb7b640 1 Processor -- start 2024-08-20T01:30:17.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.742+0000 7f797eb7b640 1 -- start start 2024-08-20T01:30:17.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.743+0000 7f797eb7b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7978101570 0x7f797819b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:17.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.743+0000 7f797eb7b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7978101e90 0x7f797819b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:17.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.743+0000 7f797eb7b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f797810f120 0x7f79781a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:17.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.743+0000 7f797eb7b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7978114ca0 con 0x7f797810f120 2024-08-20T01:30:17.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.743+0000 7f797eb7b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7978114b20 con 0x7f7978101e90 2024-08-20T01:30:17.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.743+0000 7f797eb7b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7978114e20 con 0x7f7978101570 2024-08-20T01:30:17.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.743+0000 7f797d118640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f797810f120 0x7f79781a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:17.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.743+0000 7f797d118640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f797810f120 0x7f79781a09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49606/0 (socket says 172.21.15.22:49606) 2024-08-20T01:30:17.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.743+0000 7f797d118640 1 -- 172.21.15.22:0/1354890616 learned_addr learned my addr 172.21.15.22:0/1354890616 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:17.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.743+0000 7f7977fff640 1 --2- 172.21.15.22:0/1354890616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7978101e90 0x7f797819b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:17.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.743+0000 7f797c917640 1 --2- 172.21.15.22:0/1354890616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7978101570 0x7f797819b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:17.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.743+0000 7f797d118640 1 -- 172.21.15.22:0/1354890616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7978101570 msgr2=0x7f797819b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:17.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.743+0000 7f797d118640 1 --2- 172.21.15.22:0/1354890616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7978101570 0x7f797819b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:17.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.743+0000 7f797d118640 1 -- 172.21.15.22:0/1354890616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7978101e90 msgr2=0x7f797819b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:17.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.743+0000 7f797d118640 1 --2- 172.21.15.22:0/1354890616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7978101e90 0x7f797819b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:17.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.743+0000 7f797d118640 1 -- 172.21.15.22:0/1354890616 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79781a1190 con 0x7f797810f120 2024-08-20T01:30:17.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.743+0000 7f797d118640 1 --2- 172.21.15.22:0/1354890616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f797810f120 0x7f79781a09c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7970009430 tx=0x7f79700316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:17.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.744+0000 7f7975ffb640 1 -- 172.21.15.22:0/1354890616 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7970003b70 con 0x7f797810f120 2024-08-20T01:30:17.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.744+0000 7f7975ffb640 1 -- 172.21.15.22:0/1354890616 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7970003d10 con 0x7f797810f120 2024-08-20T01:30:17.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.744+0000 7f797eb7b640 1 -- 172.21.15.22:0/1354890616 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79781a1420 con 0x7f797810f120 2024-08-20T01:30:17.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.744+0000 7f7975ffb640 1 -- 172.21.15.22:0/1354890616 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797002fb20 con 0x7f797810f120 2024-08-20T01:30:17.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.744+0000 7f797eb7b640 1 -- 172.21.15.22:0/1354890616 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79781a7b40 con 0x7f797810f120 2024-08-20T01:30:17.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.745+0000 7f797eb7b640 1 -- 172.21.15.22:0/1354890616 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7978101950 con 0x7f797810f120 2024-08-20T01:30:17.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.746+0000 7f7975ffb640 1 -- 172.21.15.22:0/1354890616 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f7970004580 con 0x7f797810f120 2024-08-20T01:30:17.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.747+0000 7f7975ffb640 1 --2- 172.21.15.22:0/1354890616 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f79680b3c60 0x7f79680b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:17.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.747+0000 7f7975ffb640 1 -- 172.21.15.22:0/1354890616 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f7970105310 con 0x7f797810f120 2024-08-20T01:30:17.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.747+0000 7f797c917640 1 --2- 172.21.15.22:0/1354890616 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f79680b3c60 0x7f79680b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:17.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.748+0000 7f797c917640 1 --2- 172.21.15.22:0/1354890616 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f79680b3c60 0x7f79680b6120 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f796c005e10 tx=0x7f796c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:17.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.750+0000 7f7975ffb640 1 -- 172.21.15.22:0/1354890616 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f79700cc890 con 0x7f797810f120 2024-08-20T01:30:17.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.973+0000 7f797eb7b640 1 -- 172.21.15.22:0/1354890616 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79781a7e00 con 0x7f797810f120 2024-08-20T01:30:17.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.973+0000 7f7975ffb640 1 -- 172.21.15.22:0/1354890616 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11906 (secure 0 0 0) 0x7f79700cc190 con 0x7f797810f120 2024-08-20T01:30:17.975 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:17.975 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"btime":"2024-08-20T01:29:18:472908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:29:18.048623+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24565,24575,24586]},"id":1}]} 2024-08-20T01:30:17.975 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 24 2024-08-20T01:30:17.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.976+0000 7f797eb7b640 1 -- 172.21.15.22:0/1354890616 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f79680b3c60 msgr2=0x7f79680b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:17.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.976+0000 7f797eb7b640 1 --2- 172.21.15.22:0/1354890616 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f79680b3c60 0x7f79680b6120 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f796c005e10 tx=0x7f796c005da0 comp rx=0 tx=0).stop 2024-08-20T01:30:17.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.976+0000 7f797eb7b640 1 -- 172.21.15.22:0/1354890616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f797810f120 msgr2=0x7f79781a09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:17.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.976+0000 7f797eb7b640 1 --2- 172.21.15.22:0/1354890616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f797810f120 0x7f79781a09c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7970009430 tx=0x7f79700316f0 comp rx=0 tx=0).stop 2024-08-20T01:30:17.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.976+0000 7f797eb7b640 1 -- 172.21.15.22:0/1354890616 shutdown_connections 2024-08-20T01:30:17.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.976+0000 7f797eb7b640 1 --2- 172.21.15.22:0/1354890616 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f79680b3c60 0x7f79680b6120 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:17.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.976+0000 7f797eb7b640 1 --2- 172.21.15.22:0/1354890616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f797810f120 0x7f79781a09c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:17.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.976+0000 7f797eb7b640 1 --2- 172.21.15.22:0/1354890616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7978101e90 0x7f797819b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:17.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.976+0000 7f797eb7b640 1 --2- 172.21.15.22:0/1354890616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7978101570 0x7f797819b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:17.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.976+0000 7f797eb7b640 1 -- 172.21.15.22:0/1354890616 >> 172.21.15.22:0/1354890616 conn(0x7f79780fd440 msgr2=0x7f7978111310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:17.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.976+0000 7f797eb7b640 1 -- 172.21.15.22:0/1354890616 shutdown_connections 2024-08-20T01:30:17.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:17.976+0000 7f797eb7b640 1 -- 172.21.15.22:0/1354890616 wait complete. 2024-08-20T01:30:18.339 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:18 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1354890616' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:18.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:18 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1354890616' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:18.563 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:18 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1354890616' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:18.649 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:30:18.912 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:19.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:19 smithi022 ceph-mon[18709]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-20T01:30:19.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.377+0000 7f919e940640 1 -- 172.21.15.22:0/3533024653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91981039e0 msgr2=0x7f9198103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:19.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.377+0000 7f919e940640 1 --2- 172.21.15.22:0/3533024653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91981039e0 0x7f9198103dc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9188009900 tx=0x7f918802a410 comp rx=0 tx=0).stop 2024-08-20T01:30:19.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.377+0000 7f919e940640 1 -- 172.21.15.22:0/3533024653 shutdown_connections 2024-08-20T01:30:19.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.377+0000 7f919e940640 1 --2- 172.21.15.22:0/3533024653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f919810ce40 0x7f919810f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:19.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.377+0000 7f919e940640 1 --2- 172.21.15.22:0/3533024653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9198104300 0x7f919810c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:19.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.377+0000 7f919e940640 1 --2- 172.21.15.22:0/3533024653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91981039e0 0x7f9198103dc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:19.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.377+0000 7f919e940640 1 -- 172.21.15.22:0/3533024653 >> 172.21.15.22:0/3533024653 conn(0x7f91980fd440 msgr2=0x7f91980ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:19.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.377+0000 7f919e940640 1 -- 172.21.15.22:0/3533024653 shutdown_connections 2024-08-20T01:30:19.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.377+0000 7f919e940640 1 -- 172.21.15.22:0/3533024653 wait complete. 2024-08-20T01:30:19.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.378+0000 7f919e940640 1 Processor -- start 2024-08-20T01:30:19.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.378+0000 7f919e940640 1 -- start start 2024-08-20T01:30:19.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.378+0000 7f919e940640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91981039e0 0x7f9198101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:19.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.378+0000 7f919e940640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9198104300 0x7f9198101bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:19.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.378+0000 7f919e940640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f919810ce40 0x7f9198102110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:19.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.378+0000 7f919e940640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9198112b10 con 0x7f919810ce40 2024-08-20T01:30:19.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.378+0000 7f919e940640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9198112990 con 0x7f91981039e0 2024-08-20T01:30:19.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.378+0000 7f919e940640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9198112c90 con 0x7f9198104300 2024-08-20T01:30:19.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.378+0000 7f919cedd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f919810ce40 0x7f9198102110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:19.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.378+0000 7f919cedd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f919810ce40 0x7f9198102110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49638/0 (socket says 172.21.15.22:49638) 2024-08-20T01:30:19.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.378+0000 7f919cedd640 1 -- 172.21.15.22:0/495293863 learned_addr learned my addr 172.21.15.22:0/495293863 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:19.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.378+0000 7f9197fff640 1 --2- 172.21.15.22:0/495293863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91981039e0 0x7f9198101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:19.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.378+0000 7f91977fe640 1 --2- 172.21.15.22:0/495293863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9198104300 0x7f9198101bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:19.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.379+0000 7f919cedd640 1 -- 172.21.15.22:0/495293863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9198104300 msgr2=0x7f9198101bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:19.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.379+0000 7f919cedd640 1 --2- 172.21.15.22:0/495293863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9198104300 0x7f9198101bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:19.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.379+0000 7f919cedd640 1 -- 172.21.15.22:0/495293863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91981039e0 msgr2=0x7f9198101690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:19.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.379+0000 7f919cedd640 1 --2- 172.21.15.22:0/495293863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91981039e0 0x7f9198101690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:19.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.379+0000 7f919cedd640 1 -- 172.21.15.22:0/495293863 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91981a7440 con 0x7f919810ce40 2024-08-20T01:30:19.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.379+0000 7f919cedd640 1 --2- 172.21.15.22:0/495293863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f919810ce40 0x7f9198102110 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f919000b970 tx=0x7f919000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:19.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.379+0000 7f91957fa640 1 -- 172.21.15.22:0/495293863 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9190019070 con 0x7f919810ce40 2024-08-20T01:30:19.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.379+0000 7f91957fa640 1 -- 172.21.15.22:0/495293863 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9190014440 con 0x7f919810ce40 2024-08-20T01:30:19.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.379+0000 7f919e940640 1 -- 172.21.15.22:0/495293863 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91981a7730 con 0x7f919810ce40 2024-08-20T01:30:19.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.379+0000 7f91957fa640 1 -- 172.21.15.22:0/495293863 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91900075d0 con 0x7f919810ce40 2024-08-20T01:30:19.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.379+0000 7f919e940640 1 -- 172.21.15.22:0/495293863 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91981a7ca0 con 0x7f919810ce40 2024-08-20T01:30:19.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.380+0000 7f919e940640 1 -- 172.21.15.22:0/495293863 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9198103dc0 con 0x7f919810ce40 2024-08-20T01:30:19.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.381+0000 7f91957fa640 1 -- 172.21.15.22:0/495293863 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f919001c070 con 0x7f919810ce40 2024-08-20T01:30:19.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.382+0000 7f91957fa640 1 --2- 172.21.15.22:0/495293863 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f91800b3c60 0x7f91800b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:19.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.382+0000 7f9197fff640 1 --2- 172.21.15.22:0/495293863 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f91800b3c60 0x7f91800b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:19.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.383+0000 7f91957fa640 1 -- 172.21.15.22:0/495293863 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f91900e32a0 con 0x7f919810ce40 2024-08-20T01:30:19.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.383+0000 7f9197fff640 1 --2- 172.21.15.22:0/495293863 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f91800b3c60 0x7f91800b6120 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9188031440 tx=0x7f9188005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:19.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.387+0000 7f91957fa640 1 -- 172.21.15.22:0/495293863 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f91900aa230 con 0x7f919810ce40 2024-08-20T01:30:19.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:19 smithi134 ceph-mon[22511]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-20T01:30:19.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:19 smithi077 ceph-mon[22251]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-20T01:30:19.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.574+0000 7f919e940640 1 -- 172.21.15.22:0/495293863 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91981a80b0 con 0x7f919810ce40 2024-08-20T01:30:19.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.575+0000 7f91957fa640 1 -- 172.21.15.22:0/495293863 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22700 (secure 0 0 0) 0x7f91900ae780 con 0x7f919810ce40 2024-08-20T01:30:19.576 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:19.576 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":77,"fsid":"586fd06c-5e92-11ef-bccf-c7b262605968","created":"2024-08-20T01:20:55.065729+0000","modified":"2024-08-20T01:29:55.012566+0000","last_up_change":"2024-08-20T01:28:14.752931+0000","last_in_change":"2024-08-20T01:27:51.812525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:24:31.674035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:29:02.800545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:29:04.951975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b67a59af-5eea-4073-a4b2-604a1b7b8f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6803","nonce":812056903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6805","nonce":812056903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6809","nonce":812056903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6807","nonce":812056903}]},"public_addr":"172.21.15.22:6803/812056903","cluster_addr":"172.21.15.22:6805/812056903","heartbeat_back_addr":"172.21.15.22:6809/812056903","heartbeat_front_addr":"172.21.15.22:6807/812056903","state":["exists","up"]},{"osd":1,"uuid":"9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6801","nonce":823882511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6803","nonce":823882511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6807","nonce":823882511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6805","nonce":823882511}]},"public_addr":"172.21.15.77:6801/823882511","cluster_addr":"172.21.15.77:6803/823882511","heartbeat_back_addr":"172.21.15.77:6807/823882511","heartbeat_front_addr":"172.21.15.77:6805/823882511","state":["exists","up"]},{"osd":2,"uuid":"71e3c019-a3e0-4632-81a8-27ac31279f7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6801","nonce":3873702897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6803","nonce":3873702897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6807","nonce":3873702897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6805","nonce":3873702897}]},"public_addr":"172.21.15.134:6801/3873702897","cluster_addr":"172.21.15.134:6803/3873702897","heartbeat_back_addr":"172.21.15.134:6807/3873702897","heartbeat_front_addr":"172.21.15.134:6805/3873702897","state":["exists","up"]},{"osd":3,"uuid":"a60de748-aa65-477d-864e-6281db1261ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6811","nonce":1775946906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6813","nonce":1775946906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6817","nonce":1775946906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6815","nonce":1775946906}]},"public_addr":"172.21.15.22:6811/1775946906","cluster_addr":"172.21.15.22:6813/1775946906","heartbeat_back_addr":"172.21.15.22:6817/1775946906","heartbeat_front_addr":"172.21.15.22:6815/1775946906","state":["exists","up"]},{"osd":4,"uuid":"07d99671-2ece-471c-ad69-fc9043d917f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6809","nonce":1954209322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6811","nonce":1954209322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6815","nonce":1954209322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6813","nonce":1954209322}]},"public_addr":"172.21.15.77:6809/1954209322","cluster_addr":"172.21.15.77:6811/1954209322","heartbeat_back_addr":"172.21.15.77:6815/1954209322","heartbeat_front_addr":"172.21.15.77:6813/1954209322","state":["exists","up"]},{"osd":5,"uuid":"971cac33-0b98-49b1-b4b2-27354fc0ab90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6809","nonce":2805488123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6811","nonce":2805488123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6815","nonce":2805488123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6813","nonce":2805488123}]},"public_addr":"172.21.15.134:6809/2805488123","cluster_addr":"172.21.15.134:6811/2805488123","heartbeat_back_addr":"172.21.15.134:6815/2805488123","heartbeat_front_addr":"172.21.15.134:6813/2805488123","state":["exists","up"]},{"osd":6,"uuid":"48d90292-8511-47d6-8093-330bd13ae70e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6819","nonce":3804882416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6821","nonce":3804882416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6825","nonce":3804882416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6823","nonce":3804882416}]},"public_addr":"172.21.15.22:6819/3804882416","cluster_addr":"172.21.15.22:6821/3804882416","heartbeat_back_addr":"172.21.15.22:6825/3804882416","heartbeat_front_addr":"172.21.15.22:6823/3804882416","state":["exists","up"]},{"osd":7,"uuid":"e217112d-9f56-4a48-93bf-6eb052ce540a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6817","nonce":700318902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6819","nonce":700318902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6823","nonce":700318902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6821","nonce":700318902}]},"public_addr":"172.21.15.77:6817/700318902","cluster_addr":"172.21.15.77:6819/700318902","heartbeat_back_addr":"172.21.15.77:6823/700318902","heartbeat_front_addr":"172.21.15.77:6821/700318902","state":["exists","up"]},{"osd":8,"uuid":"1786747c-6ff6-4e00-bcf6-a8176215847f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6817","nonce":1635473481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6819","nonce":1635473481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6823","nonce":1635473481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6821","nonce":1635473481}]},"public_addr":"172.21.15.134:6817/1635473481","cluster_addr":"172.21.15.134:6819/1635473481","heartbeat_back_addr":"172.21.15.134:6823/1635473481","heartbeat_front_addr":"172.21.15.134:6821/1635473481","state":["exists","up"]},{"osd":9,"uuid":"708f7390-1b51-4397-a92a-8ff3f4a5bc45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6827","nonce":3899297933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6829","nonce":3899297933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6833","nonce":3899297933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6831","nonce":3899297933}]},"public_addr":"172.21.15.22:6827/3899297933","cluster_addr":"172.21.15.22:6829/3899297933","heartbeat_back_addr":"172.21.15.22:6833/3899297933","heartbeat_front_addr":"172.21.15.22:6831/3899297933","state":["exists","up"]},{"osd":10,"uuid":"d15b0acd-dd08-431d-88aa-756b6420987d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6825","nonce":2765589872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6827","nonce":2765589872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6831","nonce":2765589872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6829","nonce":2765589872}]},"public_addr":"172.21.15.77:6825/2765589872","cluster_addr":"172.21.15.77:6827/2765589872","heartbeat_back_addr":"172.21.15.77:6831/2765589872","heartbeat_front_addr":"172.21.15.77:6829/2765589872","state":["exists","up"]},{"osd":11,"uuid":"d15017fa-3c3d-4096-a35d-275cd54bb9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6825","nonce":964533669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6827","nonce":964533669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6831","nonce":964533669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6829","nonce":964533669}]},"public_addr":"172.21.15.134:6825/964533669","cluster_addr":"172.21.15.134:6827/964533669","heartbeat_back_addr":"172.21.15.134:6831/964533669","heartbeat_front_addr":"172.21.15.134:6829/964533669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:23:40.839725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:05.141389+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:28.340737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:52.028949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:17.029913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:42.092826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:07.831100+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:33.380447+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:58.772655+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:23.017208+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:47.966711+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:28:13.123047+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/416470260":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6800/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/1142422661":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:6800/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/2093308719":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/3772866379":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3424402756":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3864772624":"2024-08-21T01:21:28.981981+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:30:19.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.578+0000 7f919e940640 1 -- 172.21.15.22:0/495293863 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f91800b3c60 msgr2=0x7f91800b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:19.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.578+0000 7f919e940640 1 --2- 172.21.15.22:0/495293863 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f91800b3c60 0x7f91800b6120 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9188031440 tx=0x7f9188005e80 comp rx=0 tx=0).stop 2024-08-20T01:30:19.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.578+0000 7f919e940640 1 -- 172.21.15.22:0/495293863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f919810ce40 msgr2=0x7f9198102110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:19.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.578+0000 7f919e940640 1 --2- 172.21.15.22:0/495293863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f919810ce40 0x7f9198102110 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f919000b970 tx=0x7f919000be30 comp rx=0 tx=0).stop 2024-08-20T01:30:19.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.578+0000 7f919e940640 1 -- 172.21.15.22:0/495293863 shutdown_connections 2024-08-20T01:30:19.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.578+0000 7f919e940640 1 --2- 172.21.15.22:0/495293863 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f91800b3c60 0x7f91800b6120 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:19.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.578+0000 7f919e940640 1 --2- 172.21.15.22:0/495293863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f919810ce40 0x7f9198102110 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:19.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.578+0000 7f919e940640 1 --2- 172.21.15.22:0/495293863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9198104300 0x7f9198101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:19.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.578+0000 7f919e940640 1 --2- 172.21.15.22:0/495293863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91981039e0 0x7f9198101690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:19.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.579+0000 7f919e940640 1 -- 172.21.15.22:0/495293863 >> 172.21.15.22:0/495293863 conn(0x7f91980fd440 msgr2=0x7f919810f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:19.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.579+0000 7f919e940640 1 -- 172.21.15.22:0/495293863 shutdown_connections 2024-08-20T01:30:19.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:19.579+0000 7f919e940640 1 -- 172.21.15.22:0/495293863 wait complete. 2024-08-20T01:30:20.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:20 smithi022 ceph-mon[18709]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:20.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:20 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/495293863' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:30:20.179 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:30:20.440 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:20.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:20 smithi134 ceph-mon[22511]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:20.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:20 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/495293863' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:30:20.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:20 smithi077 ceph-mon[22251]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:20.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:20 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/495293863' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:30:20.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.918+0000 7f2c02ad1640 1 -- 172.21.15.22:0/677694670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bfc10ce60 msgr2=0x7f2bfc10f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:20.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.918+0000 7f2c02ad1640 1 --2- 172.21.15.22:0/677694670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bfc10ce60 0x7f2bfc10f290 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009ca0 tx=0x7f2bf402a8e0 comp rx=0 tx=0).stop 2024-08-20T01:30:20.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.918+0000 7f2c02ad1640 1 -- 172.21.15.22:0/677694670 shutdown_connections 2024-08-20T01:30:20.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.918+0000 7f2c02ad1640 1 --2- 172.21.15.22:0/677694670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bfc10ce60 0x7f2bfc10f290 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:20.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.918+0000 7f2c02ad1640 1 --2- 172.21.15.22:0/677694670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bfc1042b0 0x7f2bfc10c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:20.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.918+0000 7f2c02ad1640 1 --2- 172.21.15.22:0/677694670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bfc1038b0 0x7f2bfc103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:20.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.918+0000 7f2c02ad1640 1 -- 172.21.15.22:0/677694670 >> 172.21.15.22:0/677694670 conn(0x7f2bfc0fd440 msgr2=0x7f2bfc0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:20.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.918+0000 7f2c02ad1640 1 -- 172.21.15.22:0/677694670 shutdown_connections 2024-08-20T01:30:20.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.918+0000 7f2c02ad1640 1 -- 172.21.15.22:0/677694670 wait complete. 2024-08-20T01:30:20.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.919+0000 7f2c02ad1640 1 Processor -- start 2024-08-20T01:30:20.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.919+0000 7f2c02ad1640 1 -- start start 2024-08-20T01:30:20.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.919+0000 7f2c02ad1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bfc1038b0 0x7f2bfc199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:20.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.919+0000 7f2c02ad1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bfc1042b0 0x7f2bfc1995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:20.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.919+0000 7f2c02ad1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bfc10ce60 0x7f2bfc19e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:20.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.919+0000 7f2c02ad1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc112b00 con 0x7f2bfc10ce60 2024-08-20T01:30:20.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.919+0000 7f2c02ad1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc112980 con 0x7f2bfc1038b0 2024-08-20T01:30:20.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.919+0000 7f2c02ad1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc112c80 con 0x7f2bfc1042b0 2024-08-20T01:30:20.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.919+0000 7f2c0106e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bfc10ce60 0x7f2bfc19e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:20.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.919+0000 7f2c0106e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bfc10ce60 0x7f2bfc19e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36958/0 (socket says 172.21.15.22:36958) 2024-08-20T01:30:20.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.919+0000 7f2c0106e640 1 -- 172.21.15.22:0/3596517188 learned_addr learned my addr 172.21.15.22:0/3596517188 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:20.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.919+0000 7f2c0086d640 1 --2- 172.21.15.22:0/3596517188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bfc1038b0 0x7f2bfc199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:20.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.919+0000 7f2c0106e640 1 -- 172.21.15.22:0/3596517188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bfc1042b0 msgr2=0x7f2bfc1995b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T01:30:20.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.919+0000 7f2c0106e640 1 --2- 172.21.15.22:0/3596517188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bfc1042b0 0x7f2bfc1995b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:20.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.919+0000 7f2c0106e640 1 -- 172.21.15.22:0/3596517188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bfc1038b0 msgr2=0x7f2bfc199070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:20.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.919+0000 7f2c0106e640 1 --2- 172.21.15.22:0/3596517188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bfc1038b0 0x7f2bfc199070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:20.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.919+0000 7f2c0106e640 1 -- 172.21.15.22:0/3596517188 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bfc19f120 con 0x7f2bfc10ce60 2024-08-20T01:30:20.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.920+0000 7f2c0106e640 1 --2- 172.21.15.22:0/3596517188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bfc10ce60 0x7f2bfc19e950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4005cc0 tx=0x7f2bf4031e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:20.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.920+0000 7f2bf9ffb640 1 -- 172.21.15.22:0/3596517188 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4003cf0 con 0x7f2bfc10ce60 2024-08-20T01:30:20.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.920+0000 7f2c02ad1640 1 -- 172.21.15.22:0/3596517188 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bfc19f3b0 con 0x7f2bfc10ce60 2024-08-20T01:30:20.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.920+0000 7f2bf9ffb640 1 -- 172.21.15.22:0/3596517188 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bf40044f0 con 0x7f2bfc10ce60 2024-08-20T01:30:20.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.920+0000 7f2bf9ffb640 1 -- 172.21.15.22:0/3596517188 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4030c60 con 0x7f2bfc10ce60 2024-08-20T01:30:20.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.920+0000 7f2c02ad1640 1 -- 172.21.15.22:0/3596517188 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bfc1a5ad0 con 0x7f2bfc10ce60 2024-08-20T01:30:20.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.921+0000 7f2c02ad1640 1 -- 172.21.15.22:0/3596517188 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bfc103c90 con 0x7f2bfc10ce60 2024-08-20T01:30:20.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.922+0000 7f2bf9ffb640 1 -- 172.21.15.22:0/3596517188 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f2bf4004040 con 0x7f2bfc10ce60 2024-08-20T01:30:20.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.923+0000 7f2bf9ffb640 1 --2- 172.21.15.22:0/3596517188 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2bec0b3c60 0x7f2bec0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:20.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.923+0000 7f2c0086d640 1 --2- 172.21.15.22:0/3596517188 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2bec0b3c60 0x7f2bec0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:20.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.923+0000 7f2bf9ffb640 1 -- 172.21.15.22:0/3596517188 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f2bf4105050 con 0x7f2bfc10ce60 2024-08-20T01:30:20.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.924+0000 7f2c0086d640 1 --2- 172.21.15.22:0/3596517188 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2bec0b3c60 0x7f2bec0b6120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0006fd0 tx=0x7f2bf0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:20.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:20.927+0000 7f2bf9ffb640 1 -- 172.21.15.22:0/3596517188 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f2bf40cc5d0 con 0x7f2bfc10ce60 2024-08-20T01:30:21.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:21.153+0000 7f2c02ad1640 1 -- 172.21.15.22:0/3596517188 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2bfc1a5df0 con 0x7f2bfc10ce60 2024-08-20T01:30:21.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:21.154+0000 7f2bf9ffb640 1 -- 172.21.15.22:0/3596517188 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11906 (secure 0 0 0) 0x7f2bf40cbed0 con 0x7f2bfc10ce60 2024-08-20T01:30:21.155 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:21.155 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"btime":"2024-08-20T01:29:18:472908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:29:18.048623+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24565,24575,24586]},"id":1}]} 2024-08-20T01:30:21.155 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 24 2024-08-20T01:30:21.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:21.156+0000 7f2c02ad1640 1 -- 172.21.15.22:0/3596517188 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2bec0b3c60 msgr2=0x7f2bec0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:21.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:21.156+0000 7f2c02ad1640 1 --2- 172.21.15.22:0/3596517188 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2bec0b3c60 0x7f2bec0b6120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0006fd0 tx=0x7f2bf0008040 comp rx=0 tx=0).stop 2024-08-20T01:30:21.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:21.156+0000 7f2c02ad1640 1 -- 172.21.15.22:0/3596517188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bfc10ce60 msgr2=0x7f2bfc19e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:21.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:21.156+0000 7f2c02ad1640 1 --2- 172.21.15.22:0/3596517188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bfc10ce60 0x7f2bfc19e950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4005cc0 tx=0x7f2bf4031e40 comp rx=0 tx=0).stop 2024-08-20T01:30:21.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:21.156+0000 7f2c02ad1640 1 -- 172.21.15.22:0/3596517188 shutdown_connections 2024-08-20T01:30:21.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:21.156+0000 7f2c02ad1640 1 --2- 172.21.15.22:0/3596517188 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2bec0b3c60 0x7f2bec0b6120 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:21.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:21.156+0000 7f2c02ad1640 1 --2- 172.21.15.22:0/3596517188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bfc10ce60 0x7f2bfc19e950 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:21.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:21.156+0000 7f2c02ad1640 1 --2- 172.21.15.22:0/3596517188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bfc1042b0 0x7f2bfc1995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:21.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:21.156+0000 7f2c02ad1640 1 --2- 172.21.15.22:0/3596517188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bfc1038b0 0x7f2bfc199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:21.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:21.156+0000 7f2c02ad1640 1 -- 172.21.15.22:0/3596517188 >> 172.21.15.22:0/3596517188 conn(0x7f2bfc0fd440 msgr2=0x7f2bfc10f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:21.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:21.156+0000 7f2c02ad1640 1 -- 172.21.15.22:0/3596517188 shutdown_connections 2024-08-20T01:30:21.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:21.156+0000 7f2c02ad1640 1 -- 172.21.15.22:0/3596517188 wait complete. 2024-08-20T01:30:21.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:21 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3596517188' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:21.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:21 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3596517188' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:21.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:21 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3596517188' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:21.791 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-20T01:29:07.003058+0000', 'modified': '2024-08-20T01:29:18.048623+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24586, 'mds_1': 24575, 'mds_2': 24565}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24527': {'gid': 24527, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.77:6835/1109505305', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6834', 'nonce': 1109505305}, {'type': 'v1', 'addr': '172.21.15.77:6835', 'nonce': 1109505305}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24548': {'gid': 24548, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.77:6837/259148624', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6836', 'nonce': 259148624}, {'type': 'v1', 'addr': '172.21.15.77:6837', 'nonce': 259148624}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24559': {'gid': 24559, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.134:6835/3018668202', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 3018668202}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 3018668202}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24565': {'gid': 24565, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.134:6837/2260901499', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6836', 'nonce': 2260901499}, {'type': 'v1', 'addr': '172.21.15.134:6837', 'nonce': 2260901499}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24575': {'gid': 24575, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.77:6839/49188248', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6838', 'nonce': 49188248}, {'type': 'v1', 'addr': '172.21.15.77:6839', 'nonce': 49188248}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24586': {'gid': 24586, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.134:6839/2873888279', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6838', 'nonce': 2873888279}, {'type': 'v1', 'addr': '172.21.15.134:6839', 'nonce': 2873888279}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24586, 'qdb_cluster': [24565, 24575, 24586]} 2024-08-20T01:30:21.792 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-20T01:30:21.792 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.c status 2024-08-20T01:30:22.051 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:22.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:22 smithi022 ceph-mon[18709]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-20T01:30:22.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:22 smithi134 ceph-mon[22511]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-20T01:30:22.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:22 smithi077 ceph-mon[22251]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-20T01:30:22.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.546+0000 7fa14b820640 1 -- 172.21.15.22:0/2677499099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa144101e90 msgr2=0x7fa14410ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:22.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.546+0000 7fa14b820640 1 --2- 172.21.15.22:0/2677499099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa144101e90 0x7fa14410ebe0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa134009900 tx=0x7fa13402a480 comp rx=0 tx=0).stop 2024-08-20T01:30:22.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.546+0000 7fa14b820640 1 -- 172.21.15.22:0/2677499099 shutdown_connections 2024-08-20T01:30:22.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.546+0000 7fa14b820640 1 --2- 172.21.15.22:0/2677499099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa14410f120 0x7fa144111510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.546+0000 7fa14b820640 1 --2- 172.21.15.22:0/2677499099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa144101e90 0x7fa14410ebe0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.546+0000 7fa14b820640 1 --2- 172.21.15.22:0/2677499099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa144101570 0x7fa144101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.546+0000 7fa14b820640 1 -- 172.21.15.22:0/2677499099 >> 172.21.15.22:0/2677499099 conn(0x7fa1440fd440 msgr2=0x7fa1440ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:22.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.546+0000 7fa14b820640 1 -- 172.21.15.22:0/2677499099 shutdown_connections 2024-08-20T01:30:22.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.546+0000 7fa14b820640 1 -- 172.21.15.22:0/2677499099 wait complete. 2024-08-20T01:30:22.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.547+0000 7fa14b820640 1 Processor -- start 2024-08-20T01:30:22.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.547+0000 7fa14b820640 1 -- start start 2024-08-20T01:30:22.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.547+0000 7fa14b820640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa144101570 0x7fa14419b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:22.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.547+0000 7fa14b820640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa144101e90 0x7fa14419b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:22.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.547+0000 7fa14b820640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa14410f120 0x7fa1441a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:22.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.547+0000 7fa14b820640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa144114ce0 con 0x7fa14410f120 2024-08-20T01:30:22.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.547+0000 7fa14b820640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa144114b60 con 0x7fa144101570 2024-08-20T01:30:22.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.547+0000 7fa14b820640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa144114e60 con 0x7fa144101e90 2024-08-20T01:30:22.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.547+0000 7fa149dbd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa14410f120 0x7fa1441a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:22.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.547+0000 7fa149dbd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa14410f120 0x7fa1441a0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36972/0 (socket says 172.21.15.22:36972) 2024-08-20T01:30:22.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.547+0000 7fa149dbd640 1 -- 172.21.15.22:0/2860370032 learned_addr learned my addr 172.21.15.22:0/2860370032 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:22.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.547+0000 7fa1495bc640 1 --2- 172.21.15.22:0/2860370032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa144101570 0x7fa14419b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:22.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.547+0000 7fa148dbb640 1 --2- 172.21.15.22:0/2860370032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa144101e90 0x7fa14419b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:22.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.547+0000 7fa149dbd640 1 -- 172.21.15.22:0/2860370032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa144101e90 msgr2=0x7fa14419b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:22.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.547+0000 7fa149dbd640 1 --2- 172.21.15.22:0/2860370032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa144101e90 0x7fa14419b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.547+0000 7fa149dbd640 1 -- 172.21.15.22:0/2860370032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa144101570 msgr2=0x7fa14419b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:22.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.547+0000 7fa149dbd640 1 --2- 172.21.15.22:0/2860370032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa144101570 0x7fa14419b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.547+0000 7fa149dbd640 1 -- 172.21.15.22:0/2860370032 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1441a12e0 con 0x7fa14410f120 2024-08-20T01:30:22.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.548+0000 7fa149dbd640 1 --2- 172.21.15.22:0/2860370032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa14410f120 0x7fa1441a0b10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa13c00b970 tx=0x7fa13c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:22.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.548+0000 7fa13a7fc640 1 -- 172.21.15.22:0/2860370032 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c019070 con 0x7fa14410f120 2024-08-20T01:30:22.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.548+0000 7fa13a7fc640 1 -- 172.21.15.22:0/2860370032 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa13c014440 con 0x7fa14410f120 2024-08-20T01:30:22.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.548+0000 7fa14b820640 1 -- 172.21.15.22:0/2860370032 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1441a15d0 con 0x7fa14410f120 2024-08-20T01:30:22.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.548+0000 7fa13a7fc640 1 -- 172.21.15.22:0/2860370032 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c0075d0 con 0x7fa14410f120 2024-08-20T01:30:22.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.548+0000 7fa14b820640 1 -- 172.21.15.22:0/2860370032 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1441a7c90 con 0x7fa14410f120 2024-08-20T01:30:22.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.551+0000 7fa14dc19740 1 Processor -- start 2024-08-20T01:30:22.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.551+0000 7fa13a7fc640 1 -- 172.21.15.22:0/2860370032 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fa13c01c070 con 0x7fa14410f120 2024-08-20T01:30:22.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.551+0000 7fa14dc19740 1 -- start start 2024-08-20T01:30:22.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.551+0000 7fa14dc19740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64894bf0 0x558c64894fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:22.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.551+0000 7fa14dc19740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c64895510 0x558c648a0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:22.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.551+0000 7fa14dc19740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c648a14a0 0x558c648a3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:22.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.551+0000 7fa14dc19740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558c6480b6a0 con 0x558c64894bf0 2024-08-20T01:30:22.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.551+0000 7fa14dc19740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558c647faba0 con 0x558c64895510 2024-08-20T01:30:22.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.551+0000 7fa14dc19740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558c647febe0 con 0x558c648a14a0 2024-08-20T01:30:22.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.551+0000 7fa148dbb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64894bf0 0x558c64894fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:22.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.551+0000 7fa148dbb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64894bf0 0x558c64894fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36978/0 (socket says 172.21.15.22:36978) 2024-08-20T01:30:22.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.551+0000 7fa148dbb640 1 -- 172.21.15.22:0/4274409881 learned_addr learned my addr 172.21.15.22:0/4274409881 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:22.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.551+0000 7fa1495bc640 1 --2- 172.21.15.22:0/4274409881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c64895510 0x558c648a0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:22.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.551+0000 7fa148dbb640 1 --2- 172.21.15.22:0/4274409881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c648a14a0 0x558c648a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:22.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.551+0000 7fa148dbb640 1 -- 172.21.15.22:0/4274409881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c648a14a0 msgr2=0x558c648a3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:22.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.551+0000 7fa148dbb640 1 --2- 172.21.15.22:0/4274409881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c648a14a0 0x558c648a3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.551+0000 7fa148dbb640 1 -- 172.21.15.22:0/4274409881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c64895510 msgr2=0x558c648a0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:22.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.551+0000 7fa148dbb640 1 --2- 172.21.15.22:0/4274409881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c64895510 0x558c648a0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.551+0000 7fa148dbb640 1 -- 172.21.15.22:0/4274409881 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c6455a540 con 0x558c64894bf0 2024-08-20T01:30:22.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.552+0000 7fa148dbb640 1 --2- 172.21.15.22:0/4274409881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64894bf0 0x558c64894fd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa13402a9a0 tx=0x7fa1340058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21dba6a5afc5825e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:22.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.552+0000 7fa12f7fe640 1 -- 172.21.15.22:0/4274409881 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa134043020 con 0x558c64894bf0 2024-08-20T01:30:22.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.552+0000 7fa13a7fc640 1 --2- 172.21.15.22:0/2860370032 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa1300b3c60 0x7fa1300b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:22.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.552+0000 7fa12f7fe640 1 -- 172.21.15.22:0/4274409881 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa134031870 con 0x558c64894bf0 2024-08-20T01:30:22.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.552+0000 7fa12f7fe640 1 -- 172.21.15.22:0/4274409881 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa134035050 con 0x558c64894bf0 2024-08-20T01:30:22.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.552+0000 7fa1495bc640 1 --2- 172.21.15.22:0/2860370032 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa1300b3c60 0x7fa1300b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:22.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.552+0000 7fa13a7fc640 1 -- 172.21.15.22:0/2860370032 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7fa13c0e3300 con 0x7fa14410f120 2024-08-20T01:30:22.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.553+0000 7fa14dc19740 1 -- 172.21.15.22:0/4274409881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64894bf0 msgr2=0x558c64894fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:22.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.553+0000 7fa14dc19740 1 --2- 172.21.15.22:0/4274409881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64894bf0 0x558c64894fd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa13402a9a0 tx=0x7fa1340058b0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.553+0000 7fa1495bc640 1 --2- 172.21.15.22:0/2860370032 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa1300b3c60 0x7fa1300b6120 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x558c64897d70 tx=0x7fa14000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:22.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.553+0000 7fa14dc19740 1 -- 172.21.15.22:0/4274409881 shutdown_connections 2024-08-20T01:30:22.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.553+0000 7fa14dc19740 1 --2- 172.21.15.22:0/4274409881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c648a14a0 0x558c648a3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.553+0000 7fa14dc19740 1 --2- 172.21.15.22:0/4274409881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c64895510 0x558c648a0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.553+0000 7fa14dc19740 1 --2- 172.21.15.22:0/4274409881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64894bf0 0x558c64894fd0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.553+0000 7fa14dc19740 1 -- 172.21.15.22:0/4274409881 >> 172.21.15.22:0/4274409881 conn(0x558c64892a20 msgr2=0x558c64893bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:22.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.553+0000 7fa14dc19740 1 -- 172.21.15.22:0/4274409881 shutdown_connections 2024-08-20T01:30:22.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.553+0000 7fa14dc19740 1 -- 172.21.15.22:0/4274409881 wait complete. 2024-08-20T01:30:22.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.553+0000 7fa14dc19740 1 -- start start 2024-08-20T01:30:22.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.553+0000 7fa14dc19740 1 Processor -- start 2024-08-20T01:30:22.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa14dc19740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c64894bf0 0x558c6489e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:22.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa14dc19740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 0x558c6489e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:22.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa14dc19740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c648a14a0 0x558c6489eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:22.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa14dc19740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558c6465d5f0 con 0x558c64895510 2024-08-20T01:30:22.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa14dc19740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558c647816c0 con 0x558c64894bf0 2024-08-20T01:30:22.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa14dc19740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558c648a40f0 con 0x558c648a14a0 2024-08-20T01:30:22.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa14dc19740 10 client.0 _ll_register_callbacks cb 0x558c647be1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:30:22.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa148dbb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 0x558c6489e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:22.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa148dbb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 0x558c6489e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36994/0 (socket says 172.21.15.22:36994) 2024-08-20T01:30:22.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa148dbb640 1 -- 172.21.15.22:0/2704486736 learned_addr learned my addr 172.21.15.22:0/2704486736 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:22.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa1495bc640 1 --2- 172.21.15.22:0/2704486736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c64894bf0 0x558c6489e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:22.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa148dbb640 1 -- 172.21.15.22:0/2704486736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c648a14a0 msgr2=0x558c6489eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:22.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa148dbb640 1 --2- 172.21.15.22:0/2704486736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c648a14a0 0x558c6489eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa148dbb640 1 -- 172.21.15.22:0/2704486736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c64894bf0 msgr2=0x558c6489e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:22.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa148dbb640 1 --2- 172.21.15.22:0/2704486736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c64894bf0 0x558c6489e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa148dbb640 1 -- 172.21.15.22:0/2704486736 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c648ad500 con 0x558c64895510 2024-08-20T01:30:22.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa1495bc640 1 --2- 172.21.15.22:0/2704486736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c64894bf0 0x558c6489e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:30:22.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa148dbb640 1 --2- 172.21.15.22:0/2704486736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 0x558c6489e960 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa134004ad0 tx=0x7fa13402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d4d7ac0fe71894 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:22.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa12cff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:30:22.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.554+0000 7fa12cff9640 1 -- 172.21.15.22:0/2704486736 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa134043070 con 0x558c64895510 2024-08-20T01:30:22.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.555+0000 7fa12cff9640 1 -- 172.21.15.22:0/2704486736 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7fa13403a480 con 0x558c64895510 2024-08-20T01:30:22.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.555+0000 7fa14dc19740 1 -- 172.21.15.22:0/2704486736 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa134031870 con 0x558c64895510 2024-08-20T01:30:22.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.555+0000 7fa12cff9640 1 -- 172.21.15.22:0/2704486736 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa134035040 con 0x558c64895510 2024-08-20T01:30:22.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.555+0000 7fa14dc19740 10 client.15096 fetch_fsmap learned FSMap version 24 2024-08-20T01:30:22.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.555+0000 7fa14dc19740 1 -- 172.21.15.22:0/2704486736 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558c648afe90 con 0x558c64895510 2024-08-20T01:30:22.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.555+0000 7fa12cff9640 1 -- 172.21.15.22:0/2704486736 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa134031870 con 0x558c64895510 2024-08-20T01:30:22.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.555+0000 7fa12cff9640 1 -- 172.21.15.22:0/2704486736 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa13403d450 con 0x558c64895510 2024-08-20T01:30:22.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.555+0000 7fa14dc19740 10 client.15096 fetch_fsmap finished waiting for FSMap version 24 2024-08-20T01:30:22.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.555+0000 7fa14dc19740 10 client.15096 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-20T01:30:22.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.555+0000 7fa14dc19740 20 client.15096 populate_metadata read hostname 'smithi022' 2024-08-20T01:30:22.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.555+0000 7fa14dc19740 1 --2- 172.21.15.22:0/2704486736 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x558c648b2010 0x558c648b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:22.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.555+0000 7fa14dc19740 4 client.15096 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:30:22.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.555+0000 7fa14dc19740 1 -- 172.21.15.22:0/2704486736 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c6480d5f0 con 0x558c648b2010 2024-08-20T01:30:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.555+0000 7fa1495bc640 1 --2- 172.21.15.22:0/2704486736 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x558c648b2010 0x558c648b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.556+0000 7fa1495bc640 1 --2- 172.21.15.22:0/2704486736 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x558c648b2010 0x558c648b3480 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=65ffdbaf6962001a server_cookie=e0488e82f5e9b16a in_seq=0 out_seq=0 2024-08-20T01:30:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.556+0000 7fa12cff9640 10 client.15096 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:30:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.557+0000 7fa12cff9640 1 -- 172.21.15.22:0/2704486736 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c6480d5f0 con 0x558c648b2010 2024-08-20T01:30:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.557+0000 7fa12cff9640 10 client.15096 handle_command_reply: tid=0 2024-08-20T01:30:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.557+0000 7fa14dc19740 1 client.15096 shutdown 2024-08-20T01:30:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.557+0000 7fa14dc19740 1 -- 172.21.15.22:0/2704486736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 msgr2=0x558c6489e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.557+0000 7fa14dc19740 1 --2- 172.21.15.22:0/2704486736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 0x558c6489e960 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa134004ad0 tx=0x7fa13402a480 comp rx=0 tx=0).stop 2024-08-20T01:30:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.557+0000 7fa14dc19740 1 -- 172.21.15.22:0/2704486736 shutdown_connections 2024-08-20T01:30:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.557+0000 7fa14dc19740 1 --2- 172.21.15.22:0/2704486736 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x558c648b2010 0x558c648b3480 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.557+0000 7fa14dc19740 1 --2- 172.21.15.22:0/2704486736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c648a14a0 0x558c6489eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.557+0000 7fa14dc19740 1 --2- 172.21.15.22:0/2704486736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 0x558c6489e960 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.557+0000 7fa14dc19740 1 --2- 172.21.15.22:0/2704486736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c64894bf0 0x558c6489e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.557+0000 7fa14dc19740 1 -- 172.21.15.22:0/2704486736 >> 172.21.15.22:0/2704486736 conn(0x558c64892a20 msgr2=0x558c648985c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:22.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.557+0000 7fa12cff9640 0 client.15096 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:30:22.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.557+0000 7fa14dc19740 1 -- 172.21.15.22:0/2704486736 shutdown_connections 2024-08-20T01:30:22.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.557+0000 7fa14dc19740 1 -- 172.21.15.22:0/2704486736 wait complete. 2024-08-20T01:30:22.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.557+0000 7fa14dc19740 20 client.15096 trim_cache size 0 max 16384 2024-08-20T01:30:22.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.575+0000 7fa14dc19740 1 Processor -- start 2024-08-20T01:30:22.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.575+0000 7fa14dc19740 1 -- start start 2024-08-20T01:30:22.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.576+0000 7fa14dc19740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c64894bf0 0x558c648b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:22.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.576+0000 7fa14dc19740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 0x558c648bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:22.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.576+0000 7fa14dc19740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c648a14a0 0x558c648bbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:22.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.576+0000 7fa14dc19740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558c648b17c0 con 0x558c64895510 2024-08-20T01:30:22.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.576+0000 7fa14dc19740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558c648b1e90 con 0x558c648a14a0 2024-08-20T01:30:22.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.576+0000 7fa14dc19740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558c648b2560 con 0x558c64894bf0 2024-08-20T01:30:22.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.576+0000 7fa148dbb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 0x558c648bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:22.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.576+0000 7fa148dbb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 0x558c648bb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36998/0 (socket says 172.21.15.22:36998) 2024-08-20T01:30:22.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.576+0000 7fa148dbb640 1 -- 172.21.15.22:0/2037960389 learned_addr learned my addr 172.21.15.22:0/2037960389 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:22.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.576+0000 7fa1495bc640 1 --2- 172.21.15.22:0/2037960389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c64894bf0 0x558c648b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:22.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.576+0000 7fa148dbb640 1 -- 172.21.15.22:0/2037960389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c64894bf0 msgr2=0x558c648b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:22.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.576+0000 7fa148dbb640 1 --2- 172.21.15.22:0/2037960389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c64894bf0 0x558c648b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.576+0000 7fa148dbb640 1 -- 172.21.15.22:0/2037960389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c648a14a0 msgr2=0x558c648bbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:22.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.576+0000 7fa148dbb640 1 --2- 172.21.15.22:0/2037960389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c648a14a0 0x558c648bbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.576+0000 7fa148dbb640 1 -- 172.21.15.22:0/2037960389 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c64893700 con 0x558c64895510 2024-08-20T01:30:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.576+0000 7fa148dbb640 1 --2- 172.21.15.22:0/2037960389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 0x558c648bb760 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa13403d8f0 tx=0x7fa134005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303979f3da05d14c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.576+0000 7fa12effd640 1 -- 172.21.15.22:0/2037960389 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa134043040 con 0x558c64895510 2024-08-20T01:30:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.576+0000 7fa12effd640 1 -- 172.21.15.22:0/2037960389 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa13404c070 con 0x558c64895510 2024-08-20T01:30:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.576+0000 7fa12effd640 1 -- 172.21.15.22:0/2037960389 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13403a480 con 0x558c64895510 2024-08-20T01:30:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.577+0000 7fa14dc19740 1 -- 172.21.15.22:0/2037960389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 msgr2=0x558c648bb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.577+0000 7fa14dc19740 1 --2- 172.21.15.22:0/2037960389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 0x558c648bb760 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa13403d8f0 tx=0x7fa134005fd0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.577+0000 7fa14dc19740 1 -- 172.21.15.22:0/2037960389 shutdown_connections 2024-08-20T01:30:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.577+0000 7fa14dc19740 1 --2- 172.21.15.22:0/2037960389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c648a14a0 0x558c648bbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.577+0000 7fa14dc19740 1 --2- 172.21.15.22:0/2037960389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 0x558c648bb760 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.577+0000 7fa14dc19740 1 --2- 172.21.15.22:0/2037960389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c64894bf0 0x558c648b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.577+0000 7fa14dc19740 1 -- 172.21.15.22:0/2037960389 >> 172.21.15.22:0/2037960389 conn(0x558c64892a20 msgr2=0x558c6489ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:22.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.577+0000 7fa14dc19740 1 -- 172.21.15.22:0/2037960389 shutdown_connections 2024-08-20T01:30:22.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.577+0000 7fa14dc19740 1 -- 172.21.15.22:0/2037960389 wait complete. 2024-08-20T01:30:22.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.577+0000 7fa14dc19740 1 -- start start 2024-08-20T01:30:22.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.578+0000 7fa14dc19740 1 Processor -- start 2024-08-20T01:30:22.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.578+0000 7fa14dc19740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c64894bf0 0x558c648b6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:22.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.578+0000 7fa14dc19740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 0x558c648b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:22.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.578+0000 7fa14dc19740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c648a14a0 0x558c648b72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:22.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.578+0000 7fa14dc19740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558c648b3300 con 0x558c64895510 2024-08-20T01:30:22.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.578+0000 7fa14dc19740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558c648b2c30 con 0x558c648a14a0 2024-08-20T01:30:22.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.578+0000 7fa14dc19740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558c648b39d0 con 0x558c64894bf0 2024-08-20T01:30:22.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.578+0000 7fa14dc19740 10 client.0 _ll_register_callbacks cb 0x7fa1340314a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:30:22.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.578+0000 7fa148dbb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 0x558c648b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:22.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.578+0000 7fa148dbb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 0x558c648b6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37008/0 (socket says 172.21.15.22:37008) 2024-08-20T01:30:22.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.578+0000 7fa148dbb640 1 -- 172.21.15.22:0/3875473614 learned_addr learned my addr 172.21.15.22:0/3875473614 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:22.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.578+0000 7fa1495bc640 1 --2- 172.21.15.22:0/3875473614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c64894bf0 0x558c648b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:22.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.578+0000 7fa149dbd640 1 --2- 172.21.15.22:0/3875473614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c648a14a0 0x558c648b72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:22.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.578+0000 7fa148dbb640 1 -- 172.21.15.22:0/3875473614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c64894bf0 msgr2=0x558c648b6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:22.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.578+0000 7fa148dbb640 1 --2- 172.21.15.22:0/3875473614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c64894bf0 0x558c648b6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.578+0000 7fa148dbb640 1 -- 172.21.15.22:0/3875473614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c648a14a0 msgr2=0x558c648b72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:22.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.578+0000 7fa148dbb640 1 --2- 172.21.15.22:0/3875473614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c648a14a0 0x558c648b72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.579+0000 7fa148dbb640 1 -- 172.21.15.22:0/3875473614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c6491aa00 con 0x558c64895510 2024-08-20T01:30:22.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.579+0000 7fa1495bc640 1 --2- 172.21.15.22:0/3875473614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c64894bf0 0x558c648b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:30:22.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.579+0000 7fa148dbb640 1 --2- 172.21.15.22:0/3875473614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 0x558c648b6d50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa13403d700 tx=0x7fa134031720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9838bd518949d5be server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:22.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.579+0000 7fa12cff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:30:22.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.579+0000 7fa12cff9640 1 -- 172.21.15.22:0/3875473614 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa134068060 con 0x558c64895510 2024-08-20T01:30:22.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.579+0000 7fa12cff9640 1 -- 172.21.15.22:0/3875473614 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7fa13403db60 con 0x558c64895510 2024-08-20T01:30:22.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.579+0000 7fa14dc19740 1 -- 172.21.15.22:0/3875473614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa13404c070 con 0x558c64895510 2024-08-20T01:30:22.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.579+0000 7fa12cff9640 1 -- 172.21.15.22:0/3875473614 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa134043040 con 0x558c64895510 2024-08-20T01:30:22.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.579+0000 7fa14dc19740 10 client.15102 fetch_fsmap learned FSMap version 24 2024-08-20T01:30:22.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.579+0000 7fa14dc19740 1 -- 172.21.15.22:0/3875473614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558c6491bd00 con 0x558c64895510 2024-08-20T01:30:22.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.579+0000 7fa12cff9640 1 -- 172.21.15.22:0/3875473614 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa13404c070 con 0x558c64895510 2024-08-20T01:30:22.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.579+0000 7fa12cff9640 1 -- 172.21.15.22:0/3875473614 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa13403a870 con 0x558c64895510 2024-08-20T01:30:22.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.580+0000 7fa14dc19740 10 client.15102 fetch_fsmap finished waiting for FSMap version 24 2024-08-20T01:30:22.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.580+0000 7fa14dc19740 10 client.15102 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-20T01:30:22.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.580+0000 7fa14dc19740 20 client.15102 populate_metadata read hostname 'smithi022' 2024-08-20T01:30:22.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.580+0000 7fa14dc19740 1 --2- 172.21.15.22:0/3875473614 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x558c64920490 0x558c6491f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:22.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.580+0000 7fa14dc19740 4 client.15102 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T01:30:22.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.580+0000 7fa14dc19740 1 -- 172.21.15.22:0/3875473614 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "status"}) -- 0x558c64809090 con 0x558c64920490 2024-08-20T01:30:22.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.580+0000 7fa1495bc640 1 --2- 172.21.15.22:0/3875473614 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x558c64920490 0x558c6491f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:22.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.580+0000 7fa12cff9640 10 client.15102 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:30:22.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.580+0000 7fa1495bc640 1 --2- 172.21.15.22:0/3875473614 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x558c64920490 0x558c6491f1a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5dcab5f257b51667 server_cookie=69f472c5b765f284 in_seq=0 out_seq=0 2024-08-20T01:30:22.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.580+0000 7fa12cff9640 1 -- 172.21.15.22:0/3875473614 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x558c64809090 con 0x558c64920490 2024-08-20T01:30:22.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.580+0000 7fa12cff9640 10 client.15102 handle_command_reply: tid=0 2024-08-20T01:30:22.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.581+0000 7fa14dc19740 1 client.15102 shutdown 2024-08-20T01:30:22.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.581+0000 7fa14dc19740 1 -- 172.21.15.22:0/3875473614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 msgr2=0x558c648b6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:22.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.581+0000 7fa14dc19740 1 --2- 172.21.15.22:0/3875473614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 0x558c648b6d50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa13403d700 tx=0x7fa134031720 comp rx=0 tx=0).stop 2024-08-20T01:30:22.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.581+0000 7fa14dc19740 1 -- 172.21.15.22:0/3875473614 shutdown_connections 2024-08-20T01:30:22.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.581+0000 7fa14dc19740 1 --2- 172.21.15.22:0/3875473614 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x558c64920490 0x558c6491f1a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.581+0000 7fa14dc19740 1 --2- 172.21.15.22:0/3875473614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558c648a14a0 0x558c648b72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.581+0000 7fa14dc19740 1 --2- 172.21.15.22:0/3875473614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c64895510 0x558c648b6d50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.581+0000 7fa12cff9640 0 client.15102 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:30:22.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.581+0000 7fa14dc19740 1 --2- 172.21.15.22:0/3875473614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c64894bf0 0x558c648b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.581+0000 7fa14dc19740 1 -- 172.21.15.22:0/3875473614 >> 172.21.15.22:0/3875473614 conn(0x558c64892a20 msgr2=0x558c64897da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:22.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.581+0000 7fa14dc19740 1 -- 172.21.15.22:0/3875473614 shutdown_connections 2024-08-20T01:30:22.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.581+0000 7fa14dc19740 1 -- 172.21.15.22:0/3875473614 wait complete. 2024-08-20T01:30:22.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.581+0000 7fa14dc19740 20 client.15102 trim_cache size 0 max 16384 2024-08-20T01:30:22.587 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:30:22.587 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "586fd06c-5e92-11ef-bccf-c7b262605968", 2024-08-20T01:30:22.587 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 2, 2024-08-20T01:30:22.587 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24565, 2024-08-20T01:30:22.588 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-08-20T01:30:22.588 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-08-20T01:30:22.588 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-08-20T01:30:22.588 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 67.115853066, 2024-08-20T01:30:22.588 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 24, 2024-08-20T01:30:22.588 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 77, 2024-08-20T01:30:22.588 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 75, 2024-08-20T01:30:22.588 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 100.180256597 2024-08-20T01:30:22.588 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:30:22.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.581+0000 7fa14b820640 1 -- 172.21.15.22:0/2860370032 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa1300b3c60 msgr2=0x7fa1300b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:22.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.581+0000 7fa14b820640 1 --2- 172.21.15.22:0/2860370032 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa1300b3c60 0x7fa1300b6120 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x558c64897d70 tx=0x7fa14000a2d0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.581+0000 7fa14b820640 1 -- 172.21.15.22:0/2860370032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa14410f120 msgr2=0x7fa1441a0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:22.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.581+0000 7fa14b820640 1 --2- 172.21.15.22:0/2860370032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa14410f120 0x7fa1441a0b10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa13c00b970 tx=0x7fa13c00be30 comp rx=0 tx=0).stop 2024-08-20T01:30:22.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.582+0000 7fa14b820640 1 -- 172.21.15.22:0/2860370032 shutdown_connections 2024-08-20T01:30:22.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.582+0000 7fa14b820640 1 --2- 172.21.15.22:0/2860370032 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa1300b3c60 0x7fa1300b6120 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.582+0000 7fa14b820640 1 --2- 172.21.15.22:0/2860370032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa14410f120 0x7fa1441a0b10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.582+0000 7fa14b820640 1 --2- 172.21.15.22:0/2860370032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa144101e90 0x7fa14419b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.582+0000 7fa14b820640 1 --2- 172.21.15.22:0/2860370032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa144101570 0x7fa14419b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:22.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.582+0000 7fa14b820640 1 -- 172.21.15.22:0/2860370032 >> 172.21.15.22:0/2860370032 conn(0x7fa1440fd440 msgr2=0x7fa144110430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:22.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.582+0000 7fa14b820640 1 -- 172.21.15.22:0/2860370032 shutdown_connections 2024-08-20T01:30:22.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:22.582+0000 7fa14b820640 1 -- 172.21.15.22:0/2860370032 wait complete. 2024-08-20T01:30:23.290 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.b status 2024-08-20T01:30:23.546 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:23.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.971+0000 7fc0c3658640 1 -- 172.21.15.22:0/2834941260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0bc101ea0 msgr2=0x7fc0bc107090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:23.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.971+0000 7fc0c3658640 1 --2- 172.21.15.22:0/2834941260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0bc101ea0 0x7fc0bc107090 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009ca0 tx=0x7fc0b402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:30:23.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.972+0000 7fc0c3658640 1 -- 172.21.15.22:0/2834941260 shutdown_connections 2024-08-20T01:30:23.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.972+0000 7fc0c3658640 1 --2- 172.21.15.22:0/2834941260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0bc101ea0 0x7fc0bc107090 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:23.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.972+0000 7fc0c3658640 1 --2- 172.21.15.22:0/2834941260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0bc101a60 0x7fc0bc106b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:23.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.972+0000 7fc0c3658640 1 --2- 172.21.15.22:0/2834941260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0bc06a900 0x7fc0bc101520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:23.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.972+0000 7fc0c3658640 1 -- 172.21.15.22:0/2834941260 >> 172.21.15.22:0/2834941260 conn(0x7fc0bc076c80 msgr2=0x7fc0bc077090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:23.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.972+0000 7fc0c3658640 1 -- 172.21.15.22:0/2834941260 shutdown_connections 2024-08-20T01:30:23.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.972+0000 7fc0c3658640 1 -- 172.21.15.22:0/2834941260 wait complete. 2024-08-20T01:30:23.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.972+0000 7fc0c3658640 1 Processor -- start 2024-08-20T01:30:23.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.972+0000 7fc0c3658640 1 -- start start 2024-08-20T01:30:23.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c3658640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0bc06a900 0x7fc0bc1990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:23.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c3658640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0bc101a60 0x7fc0bc1995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:23.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c3658640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0bc101ea0 0x7fc0bc19e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:23.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c3658640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc111a00 con 0x7fc0bc06a900 2024-08-20T01:30:23.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c3658640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc111880 con 0x7fc0bc101a60 2024-08-20T01:30:23.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c3658640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc111b80 con 0x7fc0bc101ea0 2024-08-20T01:30:23.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c13f4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0bc06a900 0x7fc0bc1990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:23.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c13f4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0bc06a900 0x7fc0bc1990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37022/0 (socket says 172.21.15.22:37022) 2024-08-20T01:30:23.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c13f4640 1 -- 172.21.15.22:0/2360148096 learned_addr learned my addr 172.21.15.22:0/2360148096 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:23.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c1bf5640 1 --2- 172.21.15.22:0/2360148096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0bc101ea0 0x7fc0bc19e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:23.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c0bf3640 1 --2- 172.21.15.22:0/2360148096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0bc101a60 0x7fc0bc1995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:23.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c13f4640 1 -- 172.21.15.22:0/2360148096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0bc101ea0 msgr2=0x7fc0bc19e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:23.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c13f4640 1 --2- 172.21.15.22:0/2360148096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0bc101ea0 0x7fc0bc19e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:23.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c13f4640 1 -- 172.21.15.22:0/2360148096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0bc101a60 msgr2=0x7fc0bc1995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:23.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c13f4640 1 --2- 172.21.15.22:0/2360148096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0bc101a60 0x7fc0bc1995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:23.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c13f4640 1 -- 172.21.15.22:0/2360148096 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0bc19f150 con 0x7fc0bc06a900 2024-08-20T01:30:23.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c0bf3640 1 --2- 172.21.15.22:0/2360148096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0bc101a60 0x7fc0bc1995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:30:23.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c1bf5640 1 --2- 172.21.15.22:0/2360148096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0bc101ea0 0x7fc0bc19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:23.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c13f4640 1 --2- 172.21.15.22:0/2360148096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0bc06a900 0x7fc0bc1990a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800b4a0 tx=0x7fc0b800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:23.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0b27fc640 1 -- 172.21.15.22:0/2360148096 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8014070 con 0x7fc0bc06a900 2024-08-20T01:30:23.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.973+0000 7fc0c3658640 1 -- 172.21.15.22:0/2360148096 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0bc19f440 con 0x7fc0bc06a900 2024-08-20T01:30:23.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.974+0000 7fc0b27fc640 1 -- 172.21.15.22:0/2360148096 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0b8010ac0 con 0x7fc0bc06a900 2024-08-20T01:30:23.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.974+0000 7fc0b27fc640 1 -- 172.21.15.22:0/2360148096 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8017c30 con 0x7fc0bc06a900 2024-08-20T01:30:23.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.974+0000 7fc0c3658640 1 -- 172.21.15.22:0/2360148096 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0bc1a5b80 con 0x7fc0bc06a900 2024-08-20T01:30:23.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.976+0000 7fc0b27fc640 1 -- 172.21.15.22:0/2360148096 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fc0b8017070 con 0x7fc0bc06a900 2024-08-20T01:30:23.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.976+0000 7fc0c5a51740 1 Processor -- start 2024-08-20T01:30:23.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.976+0000 7fc0c5a51740 1 -- start start 2024-08-20T01:30:23.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0c5a51740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e26bf0 0x557237e26fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:23.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0c5a51740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e27510 0x557237e37370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:23.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0c5a51740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557237e378b0 0x557237e39ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:23.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0c5a51740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557237d9d6a0 con 0x557237e27510 2024-08-20T01:30:23.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0c5a51740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557237d8cba0 con 0x557237e26bf0 2024-08-20T01:30:23.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0c5a51740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557237d90be0 con 0x557237e378b0 2024-08-20T01:30:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0c13f4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e27510 0x557237e37370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0c13f4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e27510 0x557237e37370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37028/0 (socket says 172.21.15.22:37028) 2024-08-20T01:30:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0c13f4640 1 -- 172.21.15.22:0/1269945814 learned_addr learned my addr 172.21.15.22:0/1269945814 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0c1bf5640 1 --2- 172.21.15.22:0/1269945814 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e26bf0 0x557237e26fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0c0bf3640 1 --2- 172.21.15.22:0/1269945814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557237e378b0 0x557237e39ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0c13f4640 1 -- 172.21.15.22:0/1269945814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557237e378b0 msgr2=0x557237e39ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0c13f4640 1 --2- 172.21.15.22:0/1269945814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557237e378b0 0x557237e39ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0c13f4640 1 -- 172.21.15.22:0/1269945814 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e26bf0 msgr2=0x557237e26fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0c13f4640 1 --2- 172.21.15.22:0/1269945814 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e26bf0 0x557237e26fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0c13f4640 1 -- 172.21.15.22:0/1269945814 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557237aec540 con 0x557237e27510 2024-08-20T01:30:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0c1bf5640 1 --2- 172.21.15.22:0/1269945814 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e26bf0 0x557237e26fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0b27fc640 1 --2- 172.21.15.22:0/2360148096 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc0a80b3c60 0x7fc0a80b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0c13f4640 1 --2- 172.21.15.22:0/1269945814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e27510 0x557237e37370 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80e9630 tx=0x7fc0b80e9720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de3e5cda27af2fd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.977+0000 7fc0c1bf5640 1 --2- 172.21.15.22:0/2360148096 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc0a80b3c60 0x7fc0a80b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.978+0000 7fc0b27fc640 1 -- 172.21.15.22:0/2360148096 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7fc0b80e34c0 con 0x7fc0bc06a900 2024-08-20T01:30:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.978+0000 7fc0a77fe640 1 -- 172.21.15.22:0/1269945814 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b80a6200 con 0x557237e27510 2024-08-20T01:30:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.978+0000 7fc0a77fe640 1 -- 172.21.15.22:0/1269945814 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0b8017360 con 0x557237e27510 2024-08-20T01:30:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.978+0000 7fc0a77fe640 1 -- 172.21.15.22:0/1269945814 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b80a9ab0 con 0x557237e27510 2024-08-20T01:30:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.978+0000 7fc0c5a51740 1 -- 172.21.15.22:0/1269945814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e27510 msgr2=0x557237e37370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.978+0000 7fc0c1bf5640 1 --2- 172.21.15.22:0/2360148096 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc0a80b3c60 0x7fc0a80b6120 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4006010 tx=0x7fc0b402f480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.978+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/1269945814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e27510 0x557237e37370 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80e9630 tx=0x7fc0b80e9720 comp rx=0 tx=0).stop 2024-08-20T01:30:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.978+0000 7fc0c5a51740 1 -- 172.21.15.22:0/1269945814 shutdown_connections 2024-08-20T01:30:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.978+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/1269945814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557237e378b0 0x557237e39ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.978+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/1269945814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e27510 0x557237e37370 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.978+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/1269945814 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e26bf0 0x557237e26fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.978+0000 7fc0c5a51740 1 -- 172.21.15.22:0/1269945814 >> 172.21.15.22:0/1269945814 conn(0x557237e24a20 msgr2=0x557237e25bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.979+0000 7fc0c5a51740 1 -- 172.21.15.22:0/1269945814 shutdown_connections 2024-08-20T01:30:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.979+0000 7fc0c5a51740 1 -- 172.21.15.22:0/1269945814 wait complete. 2024-08-20T01:30:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.979+0000 7fc0c5a51740 1 -- start start 2024-08-20T01:30:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.979+0000 7fc0c5a51740 1 Processor -- start 2024-08-20T01:30:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.979+0000 7fc0c5a51740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e26bf0 0x557237e347e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.979+0000 7fc0c5a51740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e27510 0x557237e34d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.979+0000 7fc0c5a51740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557237e378b0 0x557237e35260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.979+0000 7fc0c5a51740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557237bef5f0 con 0x557237e27510 2024-08-20T01:30:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.979+0000 7fc0c5a51740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557237d136c0 con 0x557237e26bf0 2024-08-20T01:30:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.979+0000 7fc0c5a51740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557237e3a560 con 0x557237e378b0 2024-08-20T01:30:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.979+0000 7fc0c5a51740 10 client.0 _ll_register_callbacks cb 0x557237d501e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:30:23.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.980+0000 7fc0c0bf3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e27510 0x557237e34d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:23.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.980+0000 7fc0c0bf3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e27510 0x557237e34d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37030/0 (socket says 172.21.15.22:37030) 2024-08-20T01:30:23.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.980+0000 7fc0c0bf3640 1 -- 172.21.15.22:0/273780297 learned_addr learned my addr 172.21.15.22:0/273780297 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:23.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.980+0000 7fc0c13f4640 1 --2- 172.21.15.22:0/273780297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e26bf0 0x557237e347e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:23.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.980+0000 7fc0c0bf3640 1 -- 172.21.15.22:0/273780297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557237e378b0 msgr2=0x557237e35260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:23.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.980+0000 7fc0c0bf3640 1 --2- 172.21.15.22:0/273780297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557237e378b0 0x557237e35260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:23.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.980+0000 7fc0c0bf3640 1 -- 172.21.15.22:0/273780297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e26bf0 msgr2=0x557237e347e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:23.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.980+0000 7fc0c0bf3640 1 --2- 172.21.15.22:0/273780297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e26bf0 0x557237e347e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:23.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.980+0000 7fc0c0bf3640 1 -- 172.21.15.22:0/273780297 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557237e438f0 con 0x557237e27510 2024-08-20T01:30:23.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.980+0000 7fc0c13f4640 1 --2- 172.21.15.22:0/273780297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e26bf0 0x557237e347e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:23.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.980+0000 7fc0c0bf3640 1 --2- 172.21.15.22:0/273780297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e27510 0x557237e34d20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00dc70 tx=0x7fc0ac00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e299fb7c4ce169 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:23.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.980+0000 7fc0a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:30:23.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.980+0000 7fc0a4ff9640 1 -- 172.21.15.22:0/273780297 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac011640 con 0x557237e27510 2024-08-20T01:30:23.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.980+0000 7fc0a4ff9640 1 -- 172.21.15.22:0/273780297 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7fc0ac0117e0 con 0x557237e27510 2024-08-20T01:30:23.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.980+0000 7fc0c5a51740 1 -- 172.21.15.22:0/273780297 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557237d9f5f0 con 0x557237e27510 2024-08-20T01:30:23.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.981+0000 7fc0a4ff9640 1 -- 172.21.15.22:0/273780297 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc0ac0119e0 con 0x557237e27510 2024-08-20T01:30:23.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.981+0000 7fc0c5a51740 10 client.15114 fetch_fsmap learned FSMap version 24 2024-08-20T01:30:23.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.981+0000 7fc0c5a51740 1 -- 172.21.15.22:0/273780297 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557237e462e0 con 0x557237e27510 2024-08-20T01:30:23.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.981+0000 7fc0a4ff9640 1 -- 172.21.15.22:0/273780297 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0ac011b80 con 0x557237e27510 2024-08-20T01:30:23.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.981+0000 7fc0a4ff9640 1 -- 172.21.15.22:0/273780297 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc0ac0183d0 con 0x557237e27510 2024-08-20T01:30:23.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.981+0000 7fc0c5a51740 10 client.15114 fetch_fsmap finished waiting for FSMap version 24 2024-08-20T01:30:23.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.981+0000 7fc0c5a51740 10 client.15114 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-20T01:30:23.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.981+0000 7fc0c5a51740 20 client.15114 populate_metadata read hostname 'smithi022' 2024-08-20T01:30:23.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.981+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/273780297 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x557237e48960 0x557237e49dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:23.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.981+0000 7fc0c5a51740 4 client.15114 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:30:23.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.981+0000 7fc0c5a51740 1 -- 172.21.15.22:0/273780297 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557237d9f5f0 con 0x557237e48960 2024-08-20T01:30:23.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.981+0000 7fc0c13f4640 1 --2- 172.21.15.22:0/273780297 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x557237e48960 0x557237e49dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:23.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.982+0000 7fc0a4ff9640 10 client.15114 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:30:23.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.982+0000 7fc0c13f4640 1 --2- 172.21.15.22:0/273780297 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x557237e48960 0x557237e49dd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=439c49e104fcc9fd server_cookie=e8bab487505d04e1 in_seq=0 out_seq=0 2024-08-20T01:30:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.983+0000 7fc0a4ff9640 1 -- 172.21.15.22:0/273780297 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557237d9f5f0 con 0x557237e48960 2024-08-20T01:30:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.983+0000 7fc0a4ff9640 10 client.15114 handle_command_reply: tid=0 2024-08-20T01:30:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.983+0000 7fc0c5a51740 1 client.15114 shutdown 2024-08-20T01:30:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.983+0000 7fc0c5a51740 1 -- 172.21.15.22:0/273780297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e27510 msgr2=0x557237e34d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.983+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/273780297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e27510 0x557237e34d20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00dc70 tx=0x7fc0ac00f730 comp rx=0 tx=0).stop 2024-08-20T01:30:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.983+0000 7fc0c5a51740 1 -- 172.21.15.22:0/273780297 shutdown_connections 2024-08-20T01:30:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.983+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/273780297 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x557237e48960 0x557237e49dd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.983+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/273780297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557237e378b0 0x557237e35260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.983+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/273780297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e27510 0x557237e34d20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.983+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/273780297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e26bf0 0x557237e347e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.983+0000 7fc0c5a51740 1 -- 172.21.15.22:0/273780297 >> 172.21.15.22:0/273780297 conn(0x557237e24a20 msgr2=0x557237e2a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.983+0000 7fc0a4ff9640 0 client.15114 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:30:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.983+0000 7fc0c5a51740 1 -- 172.21.15.22:0/273780297 shutdown_connections 2024-08-20T01:30:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.983+0000 7fc0c5a51740 1 -- 172.21.15.22:0/273780297 wait complete. 2024-08-20T01:30:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:23.983+0000 7fc0c5a51740 20 client.15114 trim_cache size 0 max 16384 2024-08-20T01:30:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.001+0000 7fc0c5a51740 1 Processor -- start 2024-08-20T01:30:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.001+0000 7fc0c5a51740 1 -- start start 2024-08-20T01:30:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.002+0000 7fc0c5a51740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e26bf0 0x557237e32340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.002+0000 7fc0c5a51740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557237e378b0 0x557237e477a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.002+0000 7fc0c5a51740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e47ce0 0x557237e38900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.002+0000 7fc0c5a51740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557237e48110 con 0x557237e26bf0 2024-08-20T01:30:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.002+0000 7fc0c5a51740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557237e487e0 con 0x557237e47ce0 2024-08-20T01:30:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.002+0000 7fc0c5a51740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557237e48eb0 con 0x557237e378b0 2024-08-20T01:30:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.002+0000 7fc0c13f4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e26bf0 0x557237e32340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.002+0000 7fc0c13f4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e26bf0 0x557237e32340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37034/0 (socket says 172.21.15.22:37034) 2024-08-20T01:30:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.002+0000 7fc0c13f4640 1 -- 172.21.15.22:0/2129670182 learned_addr learned my addr 172.21.15.22:0/2129670182 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.002+0000 7fc0c0bf3640 1 --2- 172.21.15.22:0/2129670182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557237e378b0 0x557237e477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.002+0000 7fc0c13f4640 1 -- 172.21.15.22:0/2129670182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557237e378b0 msgr2=0x557237e477a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.002+0000 7fc0c13f4640 1 --2- 172.21.15.22:0/2129670182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557237e378b0 0x557237e477a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.002+0000 7fc0c13f4640 1 -- 172.21.15.22:0/2129670182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e47ce0 msgr2=0x557237e38900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.002+0000 7fc0c13f4640 1 --2- 172.21.15.22:0/2129670182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e47ce0 0x557237e38900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.002+0000 7fc0c13f4640 1 -- 172.21.15.22:0/2129670182 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557237e2cd50 con 0x557237e26bf0 2024-08-20T01:30:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.002+0000 7fc0c13f4640 1 --2- 172.21.15.22:0/2129670182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e26bf0 0x557237e32340 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80093d0 tx=0x7fc0b80e6aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8724d6606a5baf90 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:24.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.002+0000 7fc0a6ffd640 1 -- 172.21.15.22:0/2129670182 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b801e040 con 0x557237e26bf0 2024-08-20T01:30:24.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.002+0000 7fc0a6ffd640 1 -- 172.21.15.22:0/2129670182 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0b80a9e50 con 0x557237e26bf0 2024-08-20T01:30:24.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.002+0000 7fc0a6ffd640 1 -- 172.21.15.22:0/2129670182 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b80a9c90 con 0x557237e26bf0 2024-08-20T01:30:24.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.003+0000 7fc0c5a51740 1 -- 172.21.15.22:0/2129670182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e26bf0 msgr2=0x557237e32340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:24.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.003+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/2129670182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e26bf0 0x557237e32340 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80093d0 tx=0x7fc0b80e6aa0 comp rx=0 tx=0).stop 2024-08-20T01:30:24.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.003+0000 7fc0c5a51740 1 -- 172.21.15.22:0/2129670182 shutdown_connections 2024-08-20T01:30:24.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.003+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/2129670182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e47ce0 0x557237e38900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:24.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.003+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/2129670182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557237e378b0 0x557237e477a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:24.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.003+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/2129670182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e26bf0 0x557237e32340 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:24.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.003+0000 7fc0c5a51740 1 -- 172.21.15.22:0/2129670182 >> 172.21.15.22:0/2129670182 conn(0x557237e24a20 msgr2=0x557237e34020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:24.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.003+0000 7fc0c5a51740 1 -- 172.21.15.22:0/2129670182 shutdown_connections 2024-08-20T01:30:24.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.003+0000 7fc0c5a51740 1 -- 172.21.15.22:0/2129670182 wait complete. 2024-08-20T01:30:24.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.003+0000 7fc0c5a51740 1 -- start start 2024-08-20T01:30:24.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.003+0000 7fc0c5a51740 1 Processor -- start 2024-08-20T01:30:24.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.004+0000 7fc0c5a51740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e26bf0 0x557237e232c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:24.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.004+0000 7fc0c5a51740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557237e378b0 0x557237e23800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:24.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.004+0000 7fc0c5a51740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e47ce0 0x557237e23d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:24.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.004+0000 7fc0c5a51740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557237e49c50 con 0x557237e47ce0 2024-08-20T01:30:24.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.004+0000 7fc0c5a51740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557237e49580 con 0x557237e26bf0 2024-08-20T01:30:24.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.004+0000 7fc0c5a51740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557237e4a320 con 0x557237e378b0 2024-08-20T01:30:24.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.004+0000 7fc0c5a51740 10 client.0 _ll_register_callbacks cb 0x7fc0ac005eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:30:24.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.004+0000 7fc0c1bf5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e47ce0 0x557237e23d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:24.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.004+0000 7fc0c1bf5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e47ce0 0x557237e23d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37038/0 (socket says 172.21.15.22:37038) 2024-08-20T01:30:24.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.004+0000 7fc0c1bf5640 1 -- 172.21.15.22:0/1610672443 learned_addr learned my addr 172.21.15.22:0/1610672443 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:24.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.004+0000 7fc0c0bf3640 1 --2- 172.21.15.22:0/1610672443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557237e378b0 0x557237e23800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:24.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.004+0000 7fc0c13f4640 1 --2- 172.21.15.22:0/1610672443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e26bf0 0x557237e232c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:24.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.004+0000 7fc0c1bf5640 1 -- 172.21.15.22:0/1610672443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557237e378b0 msgr2=0x557237e23800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:24.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.004+0000 7fc0c1bf5640 1 --2- 172.21.15.22:0/1610672443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557237e378b0 0x557237e23800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:24.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.004+0000 7fc0c1bf5640 1 -- 172.21.15.22:0/1610672443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e26bf0 msgr2=0x557237e232c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:24.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.004+0000 7fc0c1bf5640 1 --2- 172.21.15.22:0/1610672443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e26bf0 0x557237e232c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:24.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.004+0000 7fc0c1bf5640 1 -- 172.21.15.22:0/1610672443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557237e51050 con 0x557237e47ce0 2024-08-20T01:30:24.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.005+0000 7fc0c1bf5640 1 --2- 172.21.15.22:0/1610672443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e47ce0 0x557237e23d40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4035000 tx=0x7fc0b4009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ea540352bd3fe server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:24.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.005+0000 7fc0a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:30:24.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.005+0000 7fc0a4ff9640 1 -- 172.21.15.22:0/1610672443 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b404f070 con 0x557237e47ce0 2024-08-20T01:30:24.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.005+0000 7fc0a4ff9640 1 -- 172.21.15.22:0/1610672443 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7fc0b4004450 con 0x557237e47ce0 2024-08-20T01:30:24.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.005+0000 7fc0c5a51740 1 -- 172.21.15.22:0/1610672443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0b80a9e50 con 0x557237e47ce0 2024-08-20T01:30:24.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.005+0000 7fc0a4ff9640 1 -- 172.21.15.22:0/1610672443 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc0b4004650 con 0x557237e47ce0 2024-08-20T01:30:24.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.005+0000 7fc0c5a51740 10 client.15120 fetch_fsmap learned FSMap version 24 2024-08-20T01:30:24.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.005+0000 7fc0c5a51740 1 -- 172.21.15.22:0/1610672443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557237e52330 con 0x557237e47ce0 2024-08-20T01:30:24.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.005+0000 7fc0a4ff9640 1 -- 172.21.15.22:0/1610672443 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0b80a9e50 con 0x557237e47ce0 2024-08-20T01:30:24.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.005+0000 7fc0a4ff9640 1 -- 172.21.15.22:0/1610672443 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc0b4044040 con 0x557237e47ce0 2024-08-20T01:30:24.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.005+0000 7fc0c5a51740 10 client.15120 fetch_fsmap finished waiting for FSMap version 24 2024-08-20T01:30:24.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.005+0000 7fc0c5a51740 10 client.15120 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-20T01:30:24.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.005+0000 7fc0c5a51740 20 client.15120 populate_metadata read hostname 'smithi022' 2024-08-20T01:30:24.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.005+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/1610672443 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x557237eb70a0 0x557237eb5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:24.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.005+0000 7fc0c5a51740 4 client.15120 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T01:30:24.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.005+0000 7fc0c5a51740 1 -- 172.21.15.22:0/1610672443 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "status"}) -- 0x557237d9b090 con 0x557237eb70a0 2024-08-20T01:30:24.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.006+0000 7fc0c13f4640 1 --2- 172.21.15.22:0/1610672443 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x557237eb70a0 0x557237eb5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:24.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.006+0000 7fc0a4ff9640 10 client.15120 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:30:24.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.006+0000 7fc0c13f4640 1 --2- 172.21.15.22:0/1610672443 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x557237eb70a0 0x557237eb5db0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4747f1bb6b80226a server_cookie=42c233e2acb1320c in_seq=0 out_seq=0 2024-08-20T01:30:24.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.006+0000 7fc0a4ff9640 1 -- 172.21.15.22:0/1610672443 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557237d9b090 con 0x557237eb70a0 2024-08-20T01:30:24.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.006+0000 7fc0a4ff9640 10 client.15120 handle_command_reply: tid=0 2024-08-20T01:30:24.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.006+0000 7fc0c5a51740 1 client.15120 shutdown 2024-08-20T01:30:24.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.007+0000 7fc0c5a51740 1 -- 172.21.15.22:0/1610672443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e47ce0 msgr2=0x557237e23d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:24.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.007+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/1610672443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e47ce0 0x557237e23d40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4035000 tx=0x7fc0b4009360 comp rx=0 tx=0).stop 2024-08-20T01:30:24.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.007+0000 7fc0c5a51740 1 -- 172.21.15.22:0/1610672443 shutdown_connections 2024-08-20T01:30:24.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.007+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/1610672443 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x557237eb70a0 0x557237eb5db0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:24.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.007+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/1610672443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557237e47ce0 0x557237e23d40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:24.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.007+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/1610672443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557237e378b0 0x557237e23800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:24.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.007+0000 7fc0a4ff9640 0 client.15120 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:30:24.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.007+0000 7fc0c5a51740 1 --2- 172.21.15.22:0/1610672443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557237e26bf0 0x557237e232c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:24.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.007+0000 7fc0c5a51740 1 -- 172.21.15.22:0/1610672443 >> 172.21.15.22:0/1610672443 conn(0x557237e24a20 msgr2=0x557237e38900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:24.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.007+0000 7fc0c5a51740 1 -- 172.21.15.22:0/1610672443 shutdown_connections 2024-08-20T01:30:24.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.007+0000 7fc0c5a51740 1 -- 172.21.15.22:0/1610672443 wait complete. 2024-08-20T01:30:24.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.007+0000 7fc0c5a51740 20 client.15120 trim_cache size 0 max 16384 2024-08-20T01:30:24.013 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:30:24.014 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "586fd06c-5e92-11ef-bccf-c7b262605968", 2024-08-20T01:30:24.014 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 1, 2024-08-20T01:30:24.014 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24575, 2024-08-20T01:30:24.014 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-08-20T01:30:24.014 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-08-20T01:30:24.014 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-08-20T01:30:24.014 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 69.552673120999998, 2024-08-20T01:30:24.014 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 24, 2024-08-20T01:30:24.014 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 77, 2024-08-20T01:30:24.014 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 75, 2024-08-20T01:30:24.014 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 87.961440456000005 2024-08-20T01:30:24.014 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:30:24.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.007+0000 7fc0c3658640 1 -- 172.21.15.22:0/2360148096 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc0a80b3c60 msgr2=0x7fc0a80b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:24.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.007+0000 7fc0c3658640 1 --2- 172.21.15.22:0/2360148096 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc0a80b3c60 0x7fc0a80b6120 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4006010 tx=0x7fc0b402f480 comp rx=0 tx=0).stop 2024-08-20T01:30:24.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.007+0000 7fc0c3658640 1 -- 172.21.15.22:0/2360148096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0bc06a900 msgr2=0x7fc0bc1990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:24.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.007+0000 7fc0c3658640 1 --2- 172.21.15.22:0/2360148096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0bc06a900 0x7fc0bc1990a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800b4a0 tx=0x7fc0b800b960 comp rx=0 tx=0).stop 2024-08-20T01:30:24.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.008+0000 7fc0c3658640 1 -- 172.21.15.22:0/2360148096 shutdown_connections 2024-08-20T01:30:24.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.008+0000 7fc0c3658640 1 --2- 172.21.15.22:0/2360148096 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc0a80b3c60 0x7fc0a80b6120 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:24.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.008+0000 7fc0c3658640 1 --2- 172.21.15.22:0/2360148096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0bc101ea0 0x7fc0bc19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:24.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.008+0000 7fc0c3658640 1 --2- 172.21.15.22:0/2360148096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0bc101a60 0x7fc0bc1995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:24.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.008+0000 7fc0c3658640 1 --2- 172.21.15.22:0/2360148096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0bc06a900 0x7fc0bc1990a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:24.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.008+0000 7fc0c3658640 1 -- 172.21.15.22:0/2360148096 >> 172.21.15.22:0/2360148096 conn(0x7fc0bc076c80 msgr2=0x7fc0bc107ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:24.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.008+0000 7fc0c3658640 1 -- 172.21.15.22:0/2360148096 shutdown_connections 2024-08-20T01:30:24.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:24.008+0000 7fc0c3658640 1 -- 172.21.15.22:0/2360148096 wait complete. 2024-08-20T01:30:24.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:24 smithi022 ceph-mon[18709]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:24.640 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.i status 2024-08-20T01:30:24.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:24 smithi134 ceph-mon[22511]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:24.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:24 smithi077 ceph-mon[22251]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:24.898 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:25.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.380+0000 7f8d2c10a640 1 -- 172.21.15.22:0/988246389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d2410ce40 msgr2=0x7f8d2410f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:25.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.380+0000 7f8d2c10a640 1 --2- 172.21.15.22:0/988246389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d2410ce40 0x7f8d2410f290 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c009ca0 tx=0x7f8d1c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.380+0000 7f8d2c10a640 1 -- 172.21.15.22:0/988246389 shutdown_connections 2024-08-20T01:30:25.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.380+0000 7f8d2c10a640 1 --2- 172.21.15.22:0/988246389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d2410ce40 0x7f8d2410f290 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.380+0000 7f8d2c10a640 1 --2- 172.21.15.22:0/988246389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d24104290 0x7f8d2410c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.380+0000 7f8d2c10a640 1 --2- 172.21.15.22:0/988246389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d24103890 0x7f8d24103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.380+0000 7f8d2c10a640 1 -- 172.21.15.22:0/988246389 >> 172.21.15.22:0/988246389 conn(0x7f8d240fd440 msgr2=0x7f8d240ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:25.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.380+0000 7f8d2c10a640 1 -- 172.21.15.22:0/988246389 shutdown_connections 2024-08-20T01:30:25.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.380+0000 7f8d2c10a640 1 -- 172.21.15.22:0/988246389 wait complete. 2024-08-20T01:30:25.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.381+0000 7f8d2c10a640 1 Processor -- start 2024-08-20T01:30:25.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.381+0000 7f8d2c10a640 1 -- start start 2024-08-20T01:30:25.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.381+0000 7f8d2c10a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d24103890 0x7f8d24198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:25.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.381+0000 7f8d2c10a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d24104290 0x7f8d241994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:25.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.381+0000 7f8d2c10a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d2410ce40 0x7f8d2419e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:25.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.381+0000 7f8d2c10a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8d24112ae0 con 0x7f8d24103890 2024-08-20T01:30:25.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.381+0000 7f8d2c10a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8d24112960 con 0x7f8d2410ce40 2024-08-20T01:30:25.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.381+0000 7f8d2c10a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d24112c60 con 0x7f8d24104290 2024-08-20T01:30:25.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.381+0000 7f8d29ea6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d24103890 0x7f8d24198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:25.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.381+0000 7f8d29ea6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d24103890 0x7f8d24198f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37064/0 (socket says 172.21.15.22:37064) 2024-08-20T01:30:25.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.381+0000 7f8d29ea6640 1 -- 172.21.15.22:0/1266905049 learned_addr learned my addr 172.21.15.22:0/1266905049 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:25.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.381+0000 7f8d2a6a7640 1 --2- 172.21.15.22:0/1266905049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d2410ce40 0x7f8d2419e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:25.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.381+0000 7f8d296a5640 1 --2- 172.21.15.22:0/1266905049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d24104290 0x7f8d241994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:25.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.382+0000 7f8d29ea6640 1 -- 172.21.15.22:0/1266905049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d24104290 msgr2=0x7f8d241994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:25.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.382+0000 7f8d29ea6640 1 --2- 172.21.15.22:0/1266905049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d24104290 0x7f8d241994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.382+0000 7f8d29ea6640 1 -- 172.21.15.22:0/1266905049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d2410ce40 msgr2=0x7f8d2419e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:25.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.382+0000 7f8d29ea6640 1 --2- 172.21.15.22:0/1266905049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d2410ce40 0x7f8d2419e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.382+0000 7f8d29ea6640 1 -- 172.21.15.22:0/1266905049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2419f040 con 0x7f8d24103890 2024-08-20T01:30:25.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.382+0000 7f8d29ea6640 1 --2- 172.21.15.22:0/1266905049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d24103890 0x7f8d24198f90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8d2000b4a0 tx=0x7f8d2000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:25.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.382+0000 7f8d1affd640 1 -- 172.21.15.22:0/1266905049 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20014070 con 0x7f8d24103890 2024-08-20T01:30:25.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.382+0000 7f8d1affd640 1 -- 172.21.15.22:0/1266905049 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d20010ac0 con 0x7f8d24103890 2024-08-20T01:30:25.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.382+0000 7f8d2c10a640 1 -- 172.21.15.22:0/1266905049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d2419f330 con 0x7f8d24103890 2024-08-20T01:30:25.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.382+0000 7f8d1affd640 1 -- 172.21.15.22:0/1266905049 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20017c30 con 0x7f8d24103890 2024-08-20T01:30:25.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.382+0000 7f8d2c10a640 1 -- 172.21.15.22:0/1266905049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d241a5a70 con 0x7f8d24103890 2024-08-20T01:30:25.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.384+0000 7f8d2e503740 1 Processor -- start 2024-08-20T01:30:25.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.385+0000 7f8d2e503740 1 -- start start 2024-08-20T01:30:25.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.385+0000 7f8d1affd640 1 -- 172.21.15.22:0/1266905049 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f8d20017070 con 0x7f8d24103890 2024-08-20T01:30:25.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.385+0000 7f8d2e503740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 0x55df2f8c0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:25.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.385+0000 7f8d2e503740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55df2f8c1510 0x55df2f8ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:25.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.385+0000 7f8d2e503740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8cd4a0 0x55df2f8cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:25.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.385+0000 7f8d2e503740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55df2f8376a0 con 0x55df2f8c0bf0 2024-08-20T01:30:25.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.385+0000 7f8d2e503740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55df2f826ba0 con 0x55df2f8cd4a0 2024-08-20T01:30:25.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.385+0000 7f8d2e503740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55df2f82abe0 con 0x55df2f8c1510 2024-08-20T01:30:25.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.385+0000 7f8d2a6a7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 0x55df2f8c0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:25.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.385+0000 7f8d2a6a7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 0x55df2f8c0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37076/0 (socket says 172.21.15.22:37076) 2024-08-20T01:30:25.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.385+0000 7f8d2a6a7640 1 -- 172.21.15.22:0/4211796326 learned_addr learned my addr 172.21.15.22:0/4211796326 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:25.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.385+0000 7f8d29ea6640 1 --2- 172.21.15.22:0/4211796326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55df2f8c1510 0x55df2f8ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:25.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.385+0000 7f8d296a5640 1 --2- 172.21.15.22:0/4211796326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8cd4a0 0x55df2f8cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:25.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.385+0000 7f8d2a6a7640 1 -- 172.21.15.22:0/4211796326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55df2f8c1510 msgr2=0x55df2f8ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:25.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.385+0000 7f8d2a6a7640 1 --2- 172.21.15.22:0/4211796326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55df2f8c1510 0x55df2f8ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.385+0000 7f8d2a6a7640 1 -- 172.21.15.22:0/4211796326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8cd4a0 msgr2=0x55df2f8cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:25.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.385+0000 7f8d2a6a7640 1 --2- 172.21.15.22:0/4211796326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8cd4a0 0x55df2f8cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.385+0000 7f8d2a6a7640 1 -- 172.21.15.22:0/4211796326 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df2f586540 con 0x55df2f8c0bf0 2024-08-20T01:30:25.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.386+0000 7f8d2a6a7640 1 --2- 172.21.15.22:0/4211796326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 0x55df2f8c0fd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0098e0 tx=0x7f8d1c009910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c734b5ad8e40a33 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:25.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.386+0000 7f8d1affd640 1 --2- 172.21.15.22:0/1266905049 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d100b3ce0 0x7f8d100b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:25.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.386+0000 7f8d0ffff640 1 -- 172.21.15.22:0/4211796326 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c031710 con 0x55df2f8c0bf0 2024-08-20T01:30:25.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.386+0000 7f8d0ffff640 1 -- 172.21.15.22:0/4211796326 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d1c036070 con 0x55df2f8c0bf0 2024-08-20T01:30:25.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.386+0000 7f8d0ffff640 1 -- 172.21.15.22:0/4211796326 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c004790 con 0x55df2f8c0bf0 2024-08-20T01:30:25.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.386+0000 7f8d29ea6640 1 --2- 172.21.15.22:0/1266905049 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d100b3ce0 0x7f8d100b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:25.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.386+0000 7f8d1affd640 1 -- 172.21.15.22:0/1266905049 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f8d200e2ff0 con 0x7f8d24103890 2024-08-20T01:30:25.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.387+0000 7f8d2e503740 1 -- 172.21.15.22:0/4211796326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 msgr2=0x55df2f8c0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.387+0000 7f8d29ea6640 1 --2- 172.21.15.22:0/1266905049 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d100b3ce0 0x7f8d100b61a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55df2f8c3d70 tx=0x7f8d20010f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.387+0000 7f8d2e503740 1 --2- 172.21.15.22:0/4211796326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 0x55df2f8c0fd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0098e0 tx=0x7f8d1c009910 comp rx=0 tx=0).stop 2024-08-20T01:30:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.387+0000 7f8d2e503740 1 -- 172.21.15.22:0/4211796326 shutdown_connections 2024-08-20T01:30:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.387+0000 7f8d2e503740 1 --2- 172.21.15.22:0/4211796326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8cd4a0 0x55df2f8cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.387+0000 7f8d2e503740 1 --2- 172.21.15.22:0/4211796326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55df2f8c1510 0x55df2f8ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.387+0000 7f8d2e503740 1 --2- 172.21.15.22:0/4211796326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 0x55df2f8c0fd0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.387+0000 7f8d2e503740 1 -- 172.21.15.22:0/4211796326 >> 172.21.15.22:0/4211796326 conn(0x55df2f8bea20 msgr2=0x55df2f8bfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.387+0000 7f8d2e503740 1 -- 172.21.15.22:0/4211796326 shutdown_connections 2024-08-20T01:30:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.387+0000 7f8d2e503740 1 -- 172.21.15.22:0/4211796326 wait complete. 2024-08-20T01:30:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.387+0000 7f8d2e503740 1 -- start start 2024-08-20T01:30:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.387+0000 7f8d2e503740 1 Processor -- start 2024-08-20T01:30:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.388+0000 7f8d2e503740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8c0bf0 0x55df2f8ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.388+0000 7f8d2e503740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55df2f8c1510 0x55df2f8ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.388+0000 7f8d2e503740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8cd4a0 0x55df2f8caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.388+0000 7f8d2e503740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55df2f6895f0 con 0x55df2f8cd4a0 2024-08-20T01:30:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.388+0000 7f8d2e503740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55df2f7ad6c0 con 0x55df2f8c0bf0 2024-08-20T01:30:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.388+0000 7f8d2e503740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55df2f8d4380 con 0x55df2f8c1510 2024-08-20T01:30:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.388+0000 7f8d2e503740 10 client.0 _ll_register_callbacks cb 0x55df2f7ea1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:30:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.388+0000 7f8d2a6a7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8cd4a0 0x55df2f8caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.388+0000 7f8d2a6a7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8cd4a0 0x55df2f8caeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37090/0 (socket says 172.21.15.22:37090) 2024-08-20T01:30:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.388+0000 7f8d2a6a7640 1 -- 172.21.15.22:0/3311579191 learned_addr learned my addr 172.21.15.22:0/3311579191 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.388+0000 7f8d296a5640 1 --2- 172.21.15.22:0/3311579191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55df2f8c1510 0x55df2f8ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.388+0000 7f8d2a6a7640 1 --2- 172.21.15.22:0/3311579191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8c0bf0 0x55df2f8ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.388+0000 7f8d2a6a7640 1 -- 172.21.15.22:0/3311579191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55df2f8c1510 msgr2=0x55df2f8ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.388+0000 7f8d2a6a7640 1 --2- 172.21.15.22:0/3311579191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55df2f8c1510 0x55df2f8ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.388+0000 7f8d2a6a7640 1 -- 172.21.15.22:0/3311579191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8c0bf0 msgr2=0x55df2f8ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.388+0000 7f8d2a6a7640 1 --2- 172.21.15.22:0/3311579191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8c0bf0 0x55df2f8ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.388+0000 7f8d2a6a7640 1 -- 172.21.15.22:0/3311579191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df2f8dd790 con 0x55df2f8cd4a0 2024-08-20T01:30:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.388+0000 7f8d2a6a7640 1 --2- 172.21.15.22:0/3311579191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8cd4a0 0x55df2f8caeb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c006010 tx=0x7f8d1c049040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80275a43ae92f102 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.388+0000 7f8d0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:30:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.389+0000 7f8d0d7fa640 1 -- 172.21.15.22:0/3311579191 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c003970 con 0x55df2f8cd4a0 2024-08-20T01:30:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.389+0000 7f8d2e503740 1 -- 172.21.15.22:0/3311579191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d1c036070 con 0x55df2f8cd4a0 2024-08-20T01:30:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.389+0000 7f8d0d7fa640 1 -- 172.21.15.22:0/3311579191 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f8d1c003b10 con 0x55df2f8cd4a0 2024-08-20T01:30:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.389+0000 7f8d0d7fa640 1 -- 172.21.15.22:0/3311579191 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8d1c003d10 con 0x55df2f8cd4a0 2024-08-20T01:30:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.389+0000 7f8d2e503740 10 client.15132 fetch_fsmap learned FSMap version 24 2024-08-20T01:30:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.389+0000 7f8d2e503740 1 -- 172.21.15.22:0/3311579191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55df2f8e0140 con 0x55df2f8cd4a0 2024-08-20T01:30:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.389+0000 7f8d0d7fa640 1 -- 172.21.15.22:0/3311579191 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d1c036070 con 0x55df2f8cd4a0 2024-08-20T01:30:25.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.389+0000 7f8d0d7fa640 1 -- 172.21.15.22:0/3311579191 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8d1c043020 con 0x55df2f8cd4a0 2024-08-20T01:30:25.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.389+0000 7f8d2e503740 10 client.15132 fetch_fsmap finished waiting for FSMap version 24 2024-08-20T01:30:25.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.389+0000 7f8d2e503740 10 client.15132 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-20T01:30:25.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.389+0000 7f8d2e503740 20 client.15132 populate_metadata read hostname 'smithi022' 2024-08-20T01:30:25.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.389+0000 7f8d2e503740 1 --2- 172.21.15.22:0/3311579191 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55df2f8e23d0 0x55df2f8e3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:25.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.389+0000 7f8d2e503740 4 client.15132 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:30:25.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.389+0000 7f8d2e503740 1 -- 172.21.15.22:0/3311579191 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df2f8395f0 con 0x55df2f8e23d0 2024-08-20T01:30:25.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.390+0000 7f8d296a5640 1 --2- 172.21.15.22:0/3311579191 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55df2f8e23d0 0x55df2f8e3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:25.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.390+0000 7f8d296a5640 1 --2- 172.21.15.22:0/3311579191 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55df2f8e23d0 0x55df2f8e3840 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f50a0c9f79611217 server_cookie=e8145b4c809e49ce in_seq=0 out_seq=0 2024-08-20T01:30:25.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.390+0000 7f8d0d7fa640 10 client.15132 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:30:25.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.391+0000 7f8d0d7fa640 1 -- 172.21.15.22:0/3311579191 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55df2f8395f0 con 0x55df2f8e23d0 2024-08-20T01:30:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.391+0000 7f8d0d7fa640 10 client.15132 handle_command_reply: tid=0 2024-08-20T01:30:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.391+0000 7f8d2e503740 1 client.15132 shutdown 2024-08-20T01:30:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.391+0000 7f8d2e503740 1 -- 172.21.15.22:0/3311579191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8cd4a0 msgr2=0x55df2f8caeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.391+0000 7f8d2e503740 1 --2- 172.21.15.22:0/3311579191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8cd4a0 0x55df2f8caeb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c006010 tx=0x7f8d1c049040 comp rx=0 tx=0).stop 2024-08-20T01:30:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.391+0000 7f8d2e503740 1 -- 172.21.15.22:0/3311579191 shutdown_connections 2024-08-20T01:30:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.391+0000 7f8d2e503740 1 --2- 172.21.15.22:0/3311579191 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55df2f8e23d0 0x55df2f8e3840 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.391+0000 7f8d2e503740 1 --2- 172.21.15.22:0/3311579191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8cd4a0 0x55df2f8caeb0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.391+0000 7f8d2e503740 1 --2- 172.21.15.22:0/3311579191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55df2f8c1510 0x55df2f8ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.391+0000 7f8d0d7fa640 0 client.15132 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:30:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.391+0000 7f8d2e503740 1 --2- 172.21.15.22:0/3311579191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8c0bf0 0x55df2f8ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.391+0000 7f8d2e503740 1 -- 172.21.15.22:0/3311579191 >> 172.21.15.22:0/3311579191 conn(0x55df2f8bea20 msgr2=0x55df2f8c45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.391+0000 7f8d2e503740 1 -- 172.21.15.22:0/3311579191 shutdown_connections 2024-08-20T01:30:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.391+0000 7f8d2e503740 1 -- 172.21.15.22:0/3311579191 wait complete. 2024-08-20T01:30:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.391+0000 7f8d2e503740 20 client.15132 trim_cache size 0 max 16384 2024-08-20T01:30:25.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.409+0000 7f8d2e503740 1 Processor -- start 2024-08-20T01:30:25.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.409+0000 7f8d2e503740 1 -- start start 2024-08-20T01:30:25.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.410+0000 7f8d2e503740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 0x55df2f8dcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:25.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.410+0000 7f8d2e503740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55df2f8c1510 0x55df2f8c9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:25.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.410+0000 7f8d2e503740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8cd4a0 0x55df2f8c7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:25.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.410+0000 7f8d2e503740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55df2f8e1b80 con 0x55df2f8c0bf0 2024-08-20T01:30:25.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.410+0000 7f8d2e503740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55df2f8e2250 con 0x55df2f8cd4a0 2024-08-20T01:30:25.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.410+0000 7f8d2e503740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55df2f8e2920 con 0x55df2f8c1510 2024-08-20T01:30:25.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.410+0000 7f8d2a6a7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 0x55df2f8dcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:25.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.410+0000 7f8d2a6a7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 0x55df2f8dcd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37102/0 (socket says 172.21.15.22:37102) 2024-08-20T01:30:25.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.410+0000 7f8d2a6a7640 1 -- 172.21.15.22:0/693865961 learned_addr learned my addr 172.21.15.22:0/693865961 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:25.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.410+0000 7f8d2a6a7640 1 --2- 172.21.15.22:0/693865961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8cd4a0 0x55df2f8c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:25.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.410+0000 7f8d2a6a7640 1 -- 172.21.15.22:0/693865961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55df2f8c1510 msgr2=0x55df2f8c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:25.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.410+0000 7f8d2a6a7640 1 --2- 172.21.15.22:0/693865961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55df2f8c1510 0x55df2f8c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.410+0000 7f8d2a6a7640 1 -- 172.21.15.22:0/693865961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8cd4a0 msgr2=0x55df2f8c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:25.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.410+0000 7f8d2a6a7640 1 --2- 172.21.15.22:0/693865961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8cd4a0 0x55df2f8c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.410+0000 7f8d2a6a7640 1 -- 172.21.15.22:0/693865961 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df2f8be810 con 0x55df2f8c0bf0 2024-08-20T01:30:25.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.410+0000 7f8d2a6a7640 1 --2- 172.21.15.22:0/693865961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 0x55df2f8dcd80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0049d0 tx=0x7f8d1c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f587616540214ff server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:25.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.410+0000 7f8d0f7fe640 1 -- 172.21.15.22:0/693865961 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0098b0 con 0x55df2f8c0bf0 2024-08-20T01:30:25.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.410+0000 7f8d0f7fe640 1 -- 172.21.15.22:0/693865961 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d1c036040 con 0x55df2f8c0bf0 2024-08-20T01:30:25.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.410+0000 7f8d0f7fe640 1 -- 172.21.15.22:0/693865961 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c003970 con 0x55df2f8c0bf0 2024-08-20T01:30:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.411+0000 7f8d2e503740 1 -- 172.21.15.22:0/693865961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 msgr2=0x55df2f8dcd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.411+0000 7f8d2e503740 1 --2- 172.21.15.22:0/693865961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 0x55df2f8dcd80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0049d0 tx=0x7f8d1c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.411+0000 7f8d2e503740 1 -- 172.21.15.22:0/693865961 shutdown_connections 2024-08-20T01:30:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.411+0000 7f8d2e503740 1 --2- 172.21.15.22:0/693865961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8cd4a0 0x55df2f8c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.411+0000 7f8d2e503740 1 --2- 172.21.15.22:0/693865961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55df2f8c1510 0x55df2f8c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.411+0000 7f8d2e503740 1 --2- 172.21.15.22:0/693865961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 0x55df2f8dcd80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.411+0000 7f8d2e503740 1 -- 172.21.15.22:0/693865961 >> 172.21.15.22:0/693865961 conn(0x55df2f8bea20 msgr2=0x55df2f8dc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.411+0000 7f8d2e503740 1 -- 172.21.15.22:0/693865961 shutdown_connections 2024-08-20T01:30:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.411+0000 7f8d2e503740 1 -- 172.21.15.22:0/693865961 wait complete. 2024-08-20T01:30:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.411+0000 7f8d2e503740 1 -- start start 2024-08-20T01:30:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.412+0000 7f8d2e503740 1 Processor -- start 2024-08-20T01:30:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.412+0000 7f8d2e503740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 0x55df2f8e5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.412+0000 7f8d2e503740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8c1510 0x55df2f8e55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.412+0000 7f8d2e503740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55df2f8cd4a0 0x55df2f8ea4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.412+0000 7f8d2e503740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55df2f8e36c0 con 0x55df2f8c0bf0 2024-08-20T01:30:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.412+0000 7f8d2e503740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55df2f8e2ff0 con 0x55df2f8c1510 2024-08-20T01:30:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.412+0000 7f8d2e503740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55df2f8e3d90 con 0x55df2f8cd4a0 2024-08-20T01:30:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.412+0000 7f8d2a6a7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 0x55df2f8e5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.412+0000 7f8d2a6a7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 0x55df2f8e5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37104/0 (socket says 172.21.15.22:37104) 2024-08-20T01:30:25.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.412+0000 7f8d2a6a7640 1 -- 172.21.15.22:0/3147176238 learned_addr learned my addr 172.21.15.22:0/3147176238 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:25.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.412+0000 7f8d2e503740 10 client.0 _ll_register_callbacks cb 0x7f8d1c009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:30:25.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.412+0000 7f8d296a5640 1 --2- 172.21.15.22:0/3147176238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8c1510 0x55df2f8e55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:25.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.412+0000 7f8d2a6a7640 1 -- 172.21.15.22:0/3147176238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55df2f8cd4a0 msgr2=0x55df2f8ea4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:25.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.412+0000 7f8d2a6a7640 1 --2- 172.21.15.22:0/3147176238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55df2f8cd4a0 0x55df2f8ea4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.412+0000 7f8d2a6a7640 1 -- 172.21.15.22:0/3147176238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8c1510 msgr2=0x55df2f8e55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:25.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.412+0000 7f8d2a6a7640 1 --2- 172.21.15.22:0/3147176238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8c1510 0x55df2f8e55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.412+0000 7f8d2a6a7640 1 -- 172.21.15.22:0/3147176238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df2f8eabf0 con 0x55df2f8c0bf0 2024-08-20T01:30:25.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.412+0000 7f8d296a5640 1 --2- 172.21.15.22:0/3147176238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8c1510 0x55df2f8e55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:30:25.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.413+0000 7f8d2a6a7640 1 --2- 172.21.15.22:0/3147176238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 0x55df2f8e5050 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c030730 tx=0x7f8d1c0043e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199ac9021b9abe24 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:25.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.413+0000 7f8d0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:30:25.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.413+0000 7f8d0d7fa640 1 -- 172.21.15.22:0/3147176238 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c049070 con 0x55df2f8c0bf0 2024-08-20T01:30:25.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.413+0000 7f8d0d7fa640 1 -- 172.21.15.22:0/3147176238 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f8d1c02f660 con 0x55df2f8c0bf0 2024-08-20T01:30:25.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.413+0000 7f8d2e503740 1 -- 172.21.15.22:0/3147176238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d1c036040 con 0x55df2f8c0bf0 2024-08-20T01:30:25.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.413+0000 7f8d0d7fa640 1 -- 172.21.15.22:0/3147176238 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8d1c0098b0 con 0x55df2f8c0bf0 2024-08-20T01:30:25.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.413+0000 7f8d2e503740 10 client.15138 fetch_fsmap learned FSMap version 24 2024-08-20T01:30:25.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.413+0000 7f8d2e503740 1 -- 172.21.15.22:0/3147176238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55df2f8ec030 con 0x55df2f8c0bf0 2024-08-20T01:30:25.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.413+0000 7f8d0d7fa640 1 -- 172.21.15.22:0/3147176238 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d1c036040 con 0x55df2f8c0bf0 2024-08-20T01:30:25.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.413+0000 7f8d0d7fa640 1 -- 172.21.15.22:0/3147176238 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8d1c043040 con 0x55df2f8c0bf0 2024-08-20T01:30:25.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.413+0000 7f8d2e503740 10 client.15138 fetch_fsmap finished waiting for FSMap version 24 2024-08-20T01:30:25.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.413+0000 7f8d2e503740 10 client.15138 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-20T01:30:25.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.413+0000 7f8d2e503740 20 client.15138 populate_metadata read hostname 'smithi022' 2024-08-20T01:30:25.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.413+0000 7f8d2e503740 1 --2- 172.21.15.22:0/3147176238 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55df2f950860 0x55df2f94f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:25.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.413+0000 7f8d2e503740 4 client.15138 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T01:30:25.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.413+0000 7f8d2e503740 1 -- 172.21.15.22:0/3147176238 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "status"}) -- 0x55df2f835090 con 0x55df2f950860 2024-08-20T01:30:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.414+0000 7f8d296a5640 1 --2- 172.21.15.22:0/3147176238 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55df2f950860 0x55df2f94f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.414+0000 7f8d0d7fa640 10 client.15138 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:30:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.414+0000 7f8d296a5640 1 --2- 172.21.15.22:0/3147176238 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55df2f950860 0x55df2f94f570 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e045e2a1972fdf5e server_cookie=dd96cb7937b97168 in_seq=0 out_seq=0 2024-08-20T01:30:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.414+0000 7f8d0d7fa640 1 -- 172.21.15.22:0/3147176238 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55df2f835090 con 0x55df2f950860 2024-08-20T01:30:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.414+0000 7f8d0d7fa640 10 client.15138 handle_command_reply: tid=0 2024-08-20T01:30:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.414+0000 7f8d2e503740 1 client.15138 shutdown 2024-08-20T01:30:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.414+0000 7f8d2e503740 1 -- 172.21.15.22:0/3147176238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 msgr2=0x55df2f8e5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.414+0000 7f8d2e503740 1 --2- 172.21.15.22:0/3147176238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 0x55df2f8e5050 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c030730 tx=0x7f8d1c0043e0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d2e503740 1 -- 172.21.15.22:0/3147176238 shutdown_connections 2024-08-20T01:30:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d2e503740 1 --2- 172.21.15.22:0/3147176238 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55df2f950860 0x55df2f94f570 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d2e503740 1 --2- 172.21.15.22:0/3147176238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55df2f8cd4a0 0x55df2f8ea4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d2e503740 1 --2- 172.21.15.22:0/3147176238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55df2f8c1510 0x55df2f8e55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d2e503740 1 --2- 172.21.15.22:0/3147176238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df2f8c0bf0 0x55df2f8e5050 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d0d7fa640 0 client.15138 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:30:25.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d2e503740 1 -- 172.21.15.22:0/3147176238 >> 172.21.15.22:0/3147176238 conn(0x55df2f8bea20 msgr2=0x55df2f8cc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:25.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d2e503740 1 -- 172.21.15.22:0/3147176238 shutdown_connections 2024-08-20T01:30:25.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d2e503740 1 -- 172.21.15.22:0/3147176238 wait complete. 2024-08-20T01:30:25.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d2e503740 20 client.15138 trim_cache size 0 max 16384 2024-08-20T01:30:25.421 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:30:25.421 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "586fd06c-5e92-11ef-bccf-c7b262605968", 2024-08-20T01:30:25.421 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2024-08-20T01:30:25.421 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24586, 2024-08-20T01:30:25.422 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-08-20T01:30:25.422 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-08-20T01:30:25.422 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-08-20T01:30:25.422 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 77.985778073000006, 2024-08-20T01:30:25.422 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 24, 2024-08-20T01:30:25.422 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 77, 2024-08-20T01:30:25.422 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 75, 2024-08-20T01:30:25.422 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 97.684940931 2024-08-20T01:30:25.422 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:30:25.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d2c10a640 1 -- 172.21.15.22:0/1266905049 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d100b3ce0 msgr2=0x7f8d100b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:25.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d2c10a640 1 --2- 172.21.15.22:0/1266905049 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d100b3ce0 0x7f8d100b61a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55df2f8c3d70 tx=0x7f8d20010f90 comp rx=0 tx=0).stop 2024-08-20T01:30:25.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d2c10a640 1 -- 172.21.15.22:0/1266905049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d24103890 msgr2=0x7f8d24198f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:25.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d2c10a640 1 --2- 172.21.15.22:0/1266905049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d24103890 0x7f8d24198f90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8d2000b4a0 tx=0x7f8d2000b960 comp rx=0 tx=0).stop 2024-08-20T01:30:25.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d2c10a640 1 -- 172.21.15.22:0/1266905049 shutdown_connections 2024-08-20T01:30:25.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d2c10a640 1 --2- 172.21.15.22:0/1266905049 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d100b3ce0 0x7f8d100b61a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d2c10a640 1 --2- 172.21.15.22:0/1266905049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d2410ce40 0x7f8d2419e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d2c10a640 1 --2- 172.21.15.22:0/1266905049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d24104290 0x7f8d241994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d2c10a640 1 --2- 172.21.15.22:0/1266905049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d24103890 0x7f8d24198f90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.415+0000 7f8d2c10a640 1 -- 172.21.15.22:0/1266905049 >> 172.21.15.22:0/1266905049 conn(0x7f8d240fd440 msgr2=0x7f8d2410f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:25.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.416+0000 7f8d2c10a640 1 -- 172.21.15.22:0/1266905049 shutdown_connections 2024-08-20T01:30:25.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:25.416+0000 7f8d2c10a640 1 -- 172.21.15.22:0/1266905049 wait complete. 2024-08-20T01:30:26.125 INFO:tasks.cephadm:Setup complete, yielding 2024-08-20T01:30:26.125 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-20T01:30:26.135 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-08-20T01:30:26.136 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- bash -c 'ceph orch status' 2024-08-20T01:30:26.394 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:26.630 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:26 smithi022 ceph-mon[18709]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-20T01:30:26.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:26 smithi134 ceph-mon[22511]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-20T01:30:26.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:26 smithi077 ceph-mon[22251]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-20T01:30:26.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.823+0000 7f5de5755640 1 -- 172.21.15.22:0/687269113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de0104260 msgr2=0x7f5de010abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:26.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.823+0000 7f5de5755640 1 --2- 172.21.15.22:0/687269113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de0104260 0x7f5de010abe0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8009cd0 tx=0x7f5dd802a8e0 comp rx=0 tx=0).stop 2024-08-20T01:30:26.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.823+0000 7f5de5755640 1 -- 172.21.15.22:0/687269113 shutdown_connections 2024-08-20T01:30:26.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.823+0000 7f5de5755640 1 --2- 172.21.15.22:0/687269113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de0104260 0x7f5de010abe0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:26.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.823+0000 7f5de5755640 1 --2- 172.21.15.22:0/687269113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5de01038a0 0x7f5de0103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:26.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.823+0000 7f5de5755640 1 --2- 172.21.15.22:0/687269113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5de0102740 0x7f5de0102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:26.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.823+0000 7f5de5755640 1 -- 172.21.15.22:0/687269113 >> 172.21.15.22:0/687269113 conn(0x7f5de00fdff0 msgr2=0x7f5de0100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:26.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.823+0000 7f5de5755640 1 -- 172.21.15.22:0/687269113 shutdown_connections 2024-08-20T01:30:26.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.823+0000 7f5de5755640 1 -- 172.21.15.22:0/687269113 wait complete. 2024-08-20T01:30:26.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.823+0000 7f5de5755640 1 Processor -- start 2024-08-20T01:30:26.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.823+0000 7f5de5755640 1 -- start start 2024-08-20T01:30:26.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.823+0000 7f5de5755640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5de0102740 0x7f5de0076a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:26.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.823+0000 7f5de5755640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5de01038a0 0x7f5de0075270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:26.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5de5755640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de0104260 0x7f5de00757b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:26.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5de5755640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5de010e420 con 0x7f5de0104260 2024-08-20T01:30:26.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5de5755640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5de010e2a0 con 0x7f5de01038a0 2024-08-20T01:30:26.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5de5755640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5de010e5a0 con 0x7f5de0102740 2024-08-20T01:30:26.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5ddf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de0104260 0x7f5de00757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:26.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5ddf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de0104260 0x7f5de00757b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37132/0 (socket says 172.21.15.22:37132) 2024-08-20T01:30:26.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5ddf7fe640 1 -- 172.21.15.22:0/1733995084 learned_addr learned my addr 172.21.15.22:0/1733995084 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:26.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5dd7fff640 1 --2- 172.21.15.22:0/1733995084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5de01038a0 0x7f5de0075270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:26.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5ddeffd640 1 --2- 172.21.15.22:0/1733995084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5de0102740 0x7f5de0076a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:26.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5ddf7fe640 1 -- 172.21.15.22:0/1733995084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5de0102740 msgr2=0x7f5de0076a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:26.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5ddf7fe640 1 --2- 172.21.15.22:0/1733995084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5de0102740 0x7f5de0076a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:26.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5ddf7fe640 1 -- 172.21.15.22:0/1733995084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5de01038a0 msgr2=0x7f5de0075270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:26.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5ddf7fe640 1 --2- 172.21.15.22:0/1733995084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5de01038a0 0x7f5de0075270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:26.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5ddf7fe640 1 -- 172.21.15.22:0/1733995084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de0076070 con 0x7f5de0104260 2024-08-20T01:30:26.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5ddf7fe640 1 --2- 172.21.15.22:0/1733995084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de0104260 0x7f5de00757b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5dd80317d0 tx=0x7f5dd8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:26.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5ddcff9640 1 -- 172.21.15.22:0/1733995084 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8004450 con 0x7f5de0104260 2024-08-20T01:30:26.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5ddcff9640 1 -- 172.21.15.22:0/1733995084 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dd80045f0 con 0x7f5de0104260 2024-08-20T01:30:26.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5de5755640 1 -- 172.21.15.22:0/1733995084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de01a2bf0 con 0x7f5de0104260 2024-08-20T01:30:26.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5ddcff9640 1 -- 172.21.15.22:0/1733995084 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd803b660 con 0x7f5de0104260 2024-08-20T01:30:26.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.824+0000 7f5de5755640 1 -- 172.21.15.22:0/1733995084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de01a3100 con 0x7f5de0104260 2024-08-20T01:30:26.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.825+0000 7f5de5755640 1 -- 172.21.15.22:0/1733995084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de0109a60 con 0x7f5de0104260 2024-08-20T01:30:26.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.827+0000 7f5ddcff9640 1 -- 172.21.15.22:0/1733995084 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f5dd8043020 con 0x7f5de0104260 2024-08-20T01:30:26.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.828+0000 7f5ddcff9640 1 --2- 172.21.15.22:0/1733995084 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5dcc0b3c60 0x7f5dcc0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:26.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.828+0000 7f5ddeffd640 1 --2- 172.21.15.22:0/1733995084 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5dcc0b3c60 0x7f5dcc0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:26.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.828+0000 7f5ddcff9640 1 -- 172.21.15.22:0/1733995084 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f5dd802e030 con 0x7f5de0104260 2024-08-20T01:30:26.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.828+0000 7f5ddeffd640 1 --2- 172.21.15.22:0/1733995084 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5dcc0b3c60 0x7f5dcc0b6120 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00058c0 tx=0x7f5dd0005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:26.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:26.831+0000 7f5ddcff9640 1 -- 172.21.15.22:0/1733995084 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f5dd80047a0 con 0x7f5de0104260 2024-08-20T01:30:27.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:27.031+0000 7f5de5755640 1 -- 172.21.15.22:0/1733995084 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f5de00632c0 con 0x7f5dcc0b3c60 2024-08-20T01:30:27.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:27.032+0000 7f5ddcff9640 1 -- 172.21.15.22:0/1733995084 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f5de00632c0 con 0x7f5dcc0b3c60 2024-08-20T01:30:27.033 INFO:teuthology.orchestra.run.smithi022.stdout:Backend: cephadm 2024-08-20T01:30:27.033 INFO:teuthology.orchestra.run.smithi022.stdout:Available: Yes 2024-08-20T01:30:27.034 INFO:teuthology.orchestra.run.smithi022.stdout:Paused: No 2024-08-20T01:30:27.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:27.034+0000 7f5de5755640 1 -- 172.21.15.22:0/1733995084 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5dcc0b3c60 msgr2=0x7f5dcc0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:27.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:27.034+0000 7f5de5755640 1 --2- 172.21.15.22:0/1733995084 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5dcc0b3c60 0x7f5dcc0b6120 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00058c0 tx=0x7f5dd0005c60 comp rx=0 tx=0).stop 2024-08-20T01:30:27.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:27.034+0000 7f5de5755640 1 -- 172.21.15.22:0/1733995084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de0104260 msgr2=0x7f5de00757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:27.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:27.034+0000 7f5de5755640 1 --2- 172.21.15.22:0/1733995084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de0104260 0x7f5de00757b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5dd80317d0 tx=0x7f5dd8003f10 comp rx=0 tx=0).stop 2024-08-20T01:30:27.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:27.035+0000 7f5de5755640 1 -- 172.21.15.22:0/1733995084 shutdown_connections 2024-08-20T01:30:27.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:27.035+0000 7f5de5755640 1 --2- 172.21.15.22:0/1733995084 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5dcc0b3c60 0x7f5dcc0b6120 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:27.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:27.035+0000 7f5de5755640 1 --2- 172.21.15.22:0/1733995084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de0104260 0x7f5de00757b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:27.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:27.035+0000 7f5de5755640 1 --2- 172.21.15.22:0/1733995084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5de01038a0 0x7f5de0075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:27.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:27.035+0000 7f5de5755640 1 --2- 172.21.15.22:0/1733995084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5de0102740 0x7f5de0076a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:27.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:27.035+0000 7f5de5755640 1 -- 172.21.15.22:0/1733995084 >> 172.21.15.22:0/1733995084 conn(0x7f5de00fdff0 msgr2=0x7f5de0106c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:27.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:27.035+0000 7f5de5755640 1 -- 172.21.15.22:0/1733995084 shutdown_connections 2024-08-20T01:30:27.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:27.035+0000 7f5de5755640 1 -- 172.21.15.22:0/1733995084 wait complete. 2024-08-20T01:30:27.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:27 smithi022 ceph-mon[18709]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:27.711 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- bash -c 'ceph orch ps' 2024-08-20T01:30:27.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:27 smithi134 ceph-mon[22511]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:27.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:27 smithi077 ceph-mon[22251]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:27.971 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:28.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.440+0000 7fb2dd527640 1 -- 172.21.15.22:0/2486156111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2d8104260 msgr2=0x7fb2d810abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:28.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.440+0000 7fb2dd527640 1 --2- 172.21.15.22:0/2486156111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2d8104260 0x7fb2d810abe0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009930 tx=0x7fb2d002a420 comp rx=0 tx=0).stop 2024-08-20T01:30:28.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.440+0000 7fb2dd527640 1 -- 172.21.15.22:0/2486156111 shutdown_connections 2024-08-20T01:30:28.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.440+0000 7fb2dd527640 1 --2- 172.21.15.22:0/2486156111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2d8104260 0x7fb2d810abe0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:28.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.440+0000 7fb2dd527640 1 --2- 172.21.15.22:0/2486156111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2d81038a0 0x7fb2d8103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.440+0000 7fb2dd527640 1 --2- 172.21.15.22:0/2486156111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2d8102740 0x7fb2d8102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.440+0000 7fb2dd527640 1 -- 172.21.15.22:0/2486156111 >> 172.21.15.22:0/2486156111 conn(0x7fb2d80fdff0 msgr2=0x7fb2d8100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.440+0000 7fb2dd527640 1 -- 172.21.15.22:0/2486156111 shutdown_connections 2024-08-20T01:30:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.440+0000 7fb2dd527640 1 -- 172.21.15.22:0/2486156111 wait complete. 2024-08-20T01:30:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.440+0000 7fb2dd527640 1 Processor -- start 2024-08-20T01:30:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.441+0000 7fb2dd527640 1 -- start start 2024-08-20T01:30:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.441+0000 7fb2dd527640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2d8102740 0x7fb2d8076a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.441+0000 7fb2dd527640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2d81038a0 0x7fb2d8075270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.441+0000 7fb2dd527640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2d8104260 0x7fb2d80757b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.441+0000 7fb2dd527640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d810e3a0 con 0x7fb2d8102740 2024-08-20T01:30:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.441+0000 7fb2dd527640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d810e220 con 0x7fb2d8104260 2024-08-20T01:30:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.441+0000 7fb2dd527640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d810e520 con 0x7fb2d81038a0 2024-08-20T01:30:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.441+0000 7fb2d6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2d8102740 0x7fb2d8076a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:28.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.441+0000 7fb2d6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2d8102740 0x7fb2d8076a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37164/0 (socket says 172.21.15.22:37164) 2024-08-20T01:30:28.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.441+0000 7fb2d6ffd640 1 -- 172.21.15.22:0/370253515 learned_addr learned my addr 172.21.15.22:0/370253515 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:28.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.441+0000 7fb2d77fe640 1 --2- 172.21.15.22:0/370253515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2d8104260 0x7fb2d80757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:28.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.441+0000 7fb2d67fc640 1 --2- 172.21.15.22:0/370253515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2d81038a0 0x7fb2d8075270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:28.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.441+0000 7fb2d6ffd640 1 -- 172.21.15.22:0/370253515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2d81038a0 msgr2=0x7fb2d8075270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:28.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.441+0000 7fb2d6ffd640 1 --2- 172.21.15.22:0/370253515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2d81038a0 0x7fb2d8075270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:28.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.441+0000 7fb2d6ffd640 1 -- 172.21.15.22:0/370253515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2d8104260 msgr2=0x7fb2d80757b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:28.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.441+0000 7fb2d6ffd640 1 --2- 172.21.15.22:0/370253515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2d8104260 0x7fb2d80757b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:28.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.441+0000 7fb2d6ffd640 1 -- 172.21.15.22:0/370253515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d8076070 con 0x7fb2d8102740 2024-08-20T01:30:28.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.441+0000 7fb2d77fe640 1 --2- 172.21.15.22:0/370253515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2d8104260 0x7fb2d80757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:28.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.441+0000 7fb2d6ffd640 1 --2- 172.21.15.22:0/370253515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2d8102740 0x7fb2d8076a00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800eab0 tx=0x7fb2c800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:28.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.442+0000 7fb2bffff640 1 -- 172.21.15.22:0/370253515 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800ce40 con 0x7fb2d8102740 2024-08-20T01:30:28.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.442+0000 7fb2dd527640 1 -- 172.21.15.22:0/370253515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d81a2ac0 con 0x7fb2d8102740 2024-08-20T01:30:28.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.442+0000 7fb2bffff640 1 -- 172.21.15.22:0/370253515 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2c8011920 con 0x7fb2d8102740 2024-08-20T01:30:28.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.442+0000 7fb2bffff640 1 -- 172.21.15.22:0/370253515 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8010a30 con 0x7fb2d8102740 2024-08-20T01:30:28.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.442+0000 7fb2dd527640 1 -- 172.21.15.22:0/370253515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d81a2fd0 con 0x7fb2d8102740 2024-08-20T01:30:28.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.443+0000 7fb2dd527640 1 -- 172.21.15.22:0/370253515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d8102b40 con 0x7fb2d8102740 2024-08-20T01:30:28.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.444+0000 7fb2bffff640 1 -- 172.21.15.22:0/370253515 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fb2c8010bd0 con 0x7fb2d8102740 2024-08-20T01:30:28.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.445+0000 7fb2bffff640 1 --2- 172.21.15.22:0/370253515 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb2c00b3c60 0x7fb2c00b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:28.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.445+0000 7fb2d67fc640 1 --2- 172.21.15.22:0/370253515 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb2c00b3c60 0x7fb2c00b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:28.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.445+0000 7fb2bffff640 1 -- 172.21.15.22:0/370253515 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7fb2c80e4480 con 0x7fb2d8102740 2024-08-20T01:30:28.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.445+0000 7fb2d67fc640 1 --2- 172.21.15.22:0/370253515 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb2c00b3c60 0x7fb2c00b6120 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc005e10 tx=0x7fb2cc005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:28.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.449+0000 7fb2bffff640 1 -- 172.21.15.22:0/370253515 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fb2c8016030 con 0x7fb2d8102740 2024-08-20T01:30:28.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:28 smithi022 ceph-mon[18709]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-20T01:30:28.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.641+0000 7fb2dd527640 1 -- 172.21.15.22:0/370253515 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb2d80632c0 con 0x7fb2c00b3c60 2024-08-20T01:30:28.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.653+0000 7fb2bffff640 1 -- 172.21.15.22:0/370253515 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7fb2d80632c0 con 0x7fb2c00b3c60 2024-08-20T01:30:28.654 INFO:teuthology.orchestra.run.smithi022.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-20T01:30:28.654 INFO:teuthology.orchestra.run.smithi022.stdout:mds.a smithi022 running (95s) 16s ago 95s 14.4M - 19.0.0-5872-gef427541 9f5c88d94bb6 4aa136384356 2024-08-20T01:30:28.654 INFO:teuthology.orchestra.run.smithi022.stdout:mds.b smithi077 running (93s) 27s ago 92s 18.6M - 19.0.0-5872-gef427541 9f5c88d94bb6 a87d0327515b 2024-08-20T01:30:28.654 INFO:teuthology.orchestra.run.smithi022.stdout:mds.c smithi134 running (106s) 27s ago 106s 18.1M - 19.0.0-5872-gef427541 9f5c88d94bb6 e98800c94a75 2024-08-20T01:30:28.654 INFO:teuthology.orchestra.run.smithi022.stdout:mds.d smithi022 running (114s) 16s ago 113s 13.7M - 19.0.0-5872-gef427541 9f5c88d94bb6 e42dcee1c9e6 2024-08-20T01:30:28.655 INFO:teuthology.orchestra.run.smithi022.stdout:mds.e smithi077 running (111s) 27s ago 111s 18.7M - 19.0.0-5872-gef427541 9f5c88d94bb6 2c996ac9a7d5 2024-08-20T01:30:28.655 INFO:teuthology.orchestra.run.smithi022.stdout:mds.f smithi134 running (109s) 27s ago 108s 17.3M - 19.0.0-5872-gef427541 9f5c88d94bb6 79057991df98 2024-08-20T01:30:28.655 INFO:teuthology.orchestra.run.smithi022.stdout:mds.g smithi022 running (98s) 16s ago 98s 14.6M - 19.0.0-5872-gef427541 9f5c88d94bb6 b4f278ca1b86 2024-08-20T01:30:28.655 INFO:teuthology.orchestra.run.smithi022.stdout:mds.h smithi077 running (103s) 27s ago 103s 18.6M - 19.0.0-5872-gef427541 9f5c88d94bb6 9220438b8c1e 2024-08-20T01:30:28.655 INFO:teuthology.orchestra.run.smithi022.stdout:mds.i smithi134 running (101s) 27s ago 100s 26.8M - 19.0.0-5872-gef427541 9f5c88d94bb6 3d48e08222eb 2024-08-20T01:30:28.655 INFO:teuthology.orchestra.run.smithi022.stdout:mds.j smithi022 running (117s) 16s ago 117s 16.1M - 19.0.0-5872-gef427541 9f5c88d94bb6 084e5c2c28ed 2024-08-20T01:30:28.655 INFO:teuthology.orchestra.run.smithi022.stdout:mds.k smithi077 running (2m) 27s ago 2m 16.1M - 19.0.0-5872-gef427541 9f5c88d94bb6 5bf61e15f6e9 2024-08-20T01:30:28.655 INFO:teuthology.orchestra.run.smithi022.stdout:mds.l smithi134 running (2m) 27s ago 2m 16.9M - 19.0.0-5872-gef427541 9f5c88d94bb6 c777c662cbb9 2024-08-20T01:30:28.655 INFO:teuthology.orchestra.run.smithi022.stdout:mgr.x smithi022 *:9283,8765 running (9m) 16s ago 9m 521M - 19.0.0-5872-gef427541 9f5c88d94bb6 f47d219dda4d 2024-08-20T01:30:28.655 INFO:teuthology.orchestra.run.smithi022.stdout:mgr.y smithi077 *:8443,8765 running (7m) 27s ago 7m 457M - 19.0.0-5872-gef427541 9f5c88d94bb6 566078ee7cb6 2024-08-20T01:30:28.655 INFO:teuthology.orchestra.run.smithi022.stdout:mgr.z smithi134 *:8443,8765 running (7m) 27s ago 7m 456M - 19.0.0-5872-gef427541 9f5c88d94bb6 125dd5d7faf0 2024-08-20T01:30:28.655 INFO:teuthology.orchestra.run.smithi022.stdout:mon.a smithi022 running (9m) 16s ago 9m 53.0M 2048M 19.0.0-5872-gef427541 9f5c88d94bb6 932e0d46c08c 2024-08-20T01:30:28.655 INFO:teuthology.orchestra.run.smithi022.stdout:mon.b smithi077 running (7m) 27s ago 7m 44.4M 2048M 19.0.0-5872-gef427541 9f5c88d94bb6 6fa4dc818e4b 2024-08-20T01:30:28.655 INFO:teuthology.orchestra.run.smithi022.stdout:mon.c smithi134 running (7m) 27s ago 7m 41.5M 2048M 19.0.0-5872-gef427541 9f5c88d94bb6 a037ee075142 2024-08-20T01:30:28.656 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0 smithi022 running (6m) 16s ago 6m 45.0M 4273M 19.0.0-5872-gef427541 9f5c88d94bb6 0ae11be4b131 2024-08-20T01:30:28.656 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1 smithi077 running (6m) 27s ago 6m 56.7M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 a53b422e485f 2024-08-20T01:30:28.656 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2 smithi134 running (6m) 27s ago 6m 45.5M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 6cf75d1a9987 2024-08-20T01:30:28.656 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3 smithi022 running (5m) 16s ago 5m 56.2M 4273M 19.0.0-5872-gef427541 9f5c88d94bb6 05b68dd45930 2024-08-20T01:30:28.656 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4 smithi077 running (5m) 27s ago 5m 56.0M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 770780a9f2c4 2024-08-20T01:30:28.656 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5 smithi134 running (4m) 27s ago 4m 45.4M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 1dda9a0fa8c0 2024-08-20T01:30:28.656 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6 smithi022 running (4m) 16s ago 4m 42.5M 4273M 19.0.0-5872-gef427541 9f5c88d94bb6 b64f1fc285ba 2024-08-20T01:30:28.656 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7 smithi077 running (4m) 27s ago 4m 52.4M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 ce140e47899b 2024-08-20T01:30:28.656 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8 smithi134 running (3m) 27s ago 3m 52.9M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 b17439176632 2024-08-20T01:30:28.656 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9 smithi022 running (3m) 16s ago 3m 42.2M 4273M 19.0.0-5872-gef427541 9f5c88d94bb6 dcb0989e0a42 2024-08-20T01:30:28.656 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10 smithi077 running (2m) 27s ago 2m 43.4M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 9f7cbc147492 2024-08-20T01:30:28.656 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11 smithi134 running (2m) 27s ago 2m 54.5M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 a12f05d4c623 2024-08-20T01:30:28.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.656+0000 7fb2dd527640 1 -- 172.21.15.22:0/370253515 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb2c00b3c60 msgr2=0x7fb2c00b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:28.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.656+0000 7fb2dd527640 1 --2- 172.21.15.22:0/370253515 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb2c00b3c60 0x7fb2c00b6120 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc005e10 tx=0x7fb2cc005da0 comp rx=0 tx=0).stop 2024-08-20T01:30:28.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.656+0000 7fb2dd527640 1 -- 172.21.15.22:0/370253515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2d8102740 msgr2=0x7fb2d8076a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:28.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.656+0000 7fb2dd527640 1 --2- 172.21.15.22:0/370253515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2d8102740 0x7fb2d8076a00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800eab0 tx=0x7fb2c800ef70 comp rx=0 tx=0).stop 2024-08-20T01:30:28.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.656+0000 7fb2dd527640 1 -- 172.21.15.22:0/370253515 shutdown_connections 2024-08-20T01:30:28.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.656+0000 7fb2dd527640 1 --2- 172.21.15.22:0/370253515 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb2c00b3c60 0x7fb2c00b6120 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:28.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.656+0000 7fb2dd527640 1 --2- 172.21.15.22:0/370253515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2d8104260 0x7fb2d80757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:28.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.656+0000 7fb2dd527640 1 --2- 172.21.15.22:0/370253515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2d81038a0 0x7fb2d8075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:28.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.656+0000 7fb2dd527640 1 --2- 172.21.15.22:0/370253515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2d8102740 0x7fb2d8076a00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:28.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.656+0000 7fb2dd527640 1 -- 172.21.15.22:0/370253515 >> 172.21.15.22:0/370253515 conn(0x7fb2d80fdff0 msgr2=0x7fb2d8106bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:28.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.656+0000 7fb2dd527640 1 -- 172.21.15.22:0/370253515 shutdown_connections 2024-08-20T01:30:28.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:28.656+0000 7fb2dd527640 1 -- 172.21.15.22:0/370253515 wait complete. 2024-08-20T01:30:28.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:28 smithi134 ceph-mon[22511]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-20T01:30:28.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:28 smithi077 ceph-mon[22251]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-20T01:30:29.327 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- bash -c 'ceph orch ls' 2024-08-20T01:30:29.593 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:29.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:29 smithi022 ceph-mon[18709]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:29.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:29 smithi134 ceph-mon[22511]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:29.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:29 smithi077 ceph-mon[22251]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.066+0000 7fe88752a640 1 -- 172.21.15.22:0/3520985346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8801046c0 msgr2=0x7fe880100800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.066+0000 7fe88752a640 1 --2- 172.21.15.22:0/3520985346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8801046c0 0x7fe880100800 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe874009930 tx=0x7fe87402a420 comp rx=0 tx=0).stop 2024-08-20T01:30:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.066+0000 7fe88752a640 1 -- 172.21.15.22:0/3520985346 shutdown_connections 2024-08-20T01:30:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.066+0000 7fe88752a640 1 --2- 172.21.15.22:0/3520985346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe880100f20 0x7fe88010ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.066+0000 7fe88752a640 1 --2- 172.21.15.22:0/3520985346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8801046c0 0x7fe880100800 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.066+0000 7fe88752a640 1 --2- 172.21.15.22:0/3520985346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe880103d80 0x7fe880104180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.066+0000 7fe88752a640 1 -- 172.21.15.22:0/3520985346 >> 172.21.15.22:0/3520985346 conn(0x7fe8800fc690 msgr2=0x7fe8800fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.066+0000 7fe88752a640 1 -- 172.21.15.22:0/3520985346 shutdown_connections 2024-08-20T01:30:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.066+0000 7fe88752a640 1 -- 172.21.15.22:0/3520985346 wait complete. 2024-08-20T01:30:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.067+0000 7fe88752a640 1 Processor -- start 2024-08-20T01:30:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.067+0000 7fe88752a640 1 -- start start 2024-08-20T01:30:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.067+0000 7fe88752a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe880100f20 0x7fe880103260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.067+0000 7fe88752a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe880103d80 0x7fe880101ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.067+0000 7fe88752a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8801046c0 0x7fe880102010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.067+0000 7fe88752a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe88010e4b0 con 0x7fe880100f20 2024-08-20T01:30:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.067+0000 7fe88752a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe88010e330 con 0x7fe8801046c0 2024-08-20T01:30:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.067+0000 7fe88752a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe88010e630 con 0x7fe880103d80 2024-08-20T01:30:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.067+0000 7fe8852c6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe880100f20 0x7fe880103260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.067+0000 7fe8852c6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe880100f20 0x7fe880103260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48102/0 (socket says 172.21.15.22:48102) 2024-08-20T01:30:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.067+0000 7fe8852c6640 1 -- 172.21.15.22:0/59657368 learned_addr learned my addr 172.21.15.22:0/59657368 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.067+0000 7fe885ac7640 1 --2- 172.21.15.22:0/59657368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8801046c0 0x7fe880102010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.067+0000 7fe884ac5640 1 --2- 172.21.15.22:0/59657368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe880103d80 0x7fe880101ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.067+0000 7fe8852c6640 1 -- 172.21.15.22:0/59657368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe880103d80 msgr2=0x7fe880101ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.067+0000 7fe8852c6640 1 --2- 172.21.15.22:0/59657368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe880103d80 0x7fe880101ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.067+0000 7fe8852c6640 1 -- 172.21.15.22:0/59657368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8801046c0 msgr2=0x7fe880102010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.067+0000 7fe8852c6640 1 --2- 172.21.15.22:0/59657368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8801046c0 0x7fe880102010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.067+0000 7fe8852c6640 1 -- 172.21.15.22:0/59657368 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8801028d0 con 0x7fe880100f20 2024-08-20T01:30:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.067+0000 7fe8852c6640 1 --2- 172.21.15.22:0/59657368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe880100f20 0x7fe880103260 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00b4a0 tx=0x7fe87c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.068+0000 7fe8727fc640 1 -- 172.21.15.22:0/59657368 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c014070 con 0x7fe880100f20 2024-08-20T01:30:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.068+0000 7fe8727fc640 1 -- 172.21.15.22:0/59657368 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe87c010ac0 con 0x7fe880100f20 2024-08-20T01:30:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.068+0000 7fe88752a640 1 -- 172.21.15.22:0/59657368 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8801a2da0 con 0x7fe880100f20 2024-08-20T01:30:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.068+0000 7fe8727fc640 1 -- 172.21.15.22:0/59657368 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c017c30 con 0x7fe880100f20 2024-08-20T01:30:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.068+0000 7fe88752a640 1 -- 172.21.15.22:0/59657368 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8801a3220 con 0x7fe880100f20 2024-08-20T01:30:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.069+0000 7fe88752a640 1 -- 172.21.15.22:0/59657368 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe880109d20 con 0x7fe880100f20 2024-08-20T01:30:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.070+0000 7fe8727fc640 1 -- 172.21.15.22:0/59657368 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fe87c017070 con 0x7fe880100f20 2024-08-20T01:30:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.071+0000 7fe8727fc640 1 --2- 172.21.15.22:0/59657368 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe86c0b3c60 0x7fe86c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.071+0000 7fe884ac5640 1 --2- 172.21.15.22:0/59657368 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe86c0b3c60 0x7fe86c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.071+0000 7fe8727fc640 1 -- 172.21.15.22:0/59657368 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7fe87c0e3420 con 0x7fe880100f20 2024-08-20T01:30:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.071+0000 7fe884ac5640 1 --2- 172.21.15.22:0/59657368 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe86c0b3c60 0x7fe86c0b6120 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe874009900 tx=0x7fe874031c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.074+0000 7fe8727fc640 1 -- 172.21.15.22:0/59657368 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe87c0aaa00 con 0x7fe880100f20 2024-08-20T01:30:30.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.268+0000 7fe88752a640 1 -- 172.21.15.22:0/59657368 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fe8800632c0 con 0x7fe86c0b3c60 2024-08-20T01:30:30.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.274+0000 7fe8727fc640 1 -- 172.21.15.22:0/59657368 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fe8800632c0 con 0x7fe86c0b3c60 2024-08-20T01:30:30.275 INFO:teuthology.orchestra.run.smithi022.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-08-20T01:30:30.275 INFO:teuthology.orchestra.run.smithi022.stdout:mds.all 12/12 28s ago 2m smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l;count:12 2024-08-20T01:30:30.276 INFO:teuthology.orchestra.run.smithi022.stdout:mgr 3/3 28s ago 7m smithi022=x;smithi077=y;smithi134=z;count:3 2024-08-20T01:30:30.276 INFO:teuthology.orchestra.run.smithi022.stdout:mon 3/3 28s ago 8m smithi022:172.21.15.22=a;smithi077:172.21.15.77=b;smithi134:172.21.15.134=c;count:3 2024-08-20T01:30:30.276 INFO:teuthology.orchestra.run.smithi022.stdout:osd 12 28s ago - 2024-08-20T01:30:30.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.277+0000 7fe88752a640 1 -- 172.21.15.22:0/59657368 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe86c0b3c60 msgr2=0x7fe86c0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:30.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.277+0000 7fe88752a640 1 --2- 172.21.15.22:0/59657368 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe86c0b3c60 0x7fe86c0b6120 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe874009900 tx=0x7fe874031c30 comp rx=0 tx=0).stop 2024-08-20T01:30:30.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.277+0000 7fe88752a640 1 -- 172.21.15.22:0/59657368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe880100f20 msgr2=0x7fe880103260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:30.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.277+0000 7fe88752a640 1 --2- 172.21.15.22:0/59657368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe880100f20 0x7fe880103260 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00b4a0 tx=0x7fe87c00b960 comp rx=0 tx=0).stop 2024-08-20T01:30:30.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.277+0000 7fe88752a640 1 -- 172.21.15.22:0/59657368 shutdown_connections 2024-08-20T01:30:30.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.277+0000 7fe88752a640 1 --2- 172.21.15.22:0/59657368 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe86c0b3c60 0x7fe86c0b6120 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:30.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.277+0000 7fe88752a640 1 --2- 172.21.15.22:0/59657368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8801046c0 0x7fe880102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:30.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.277+0000 7fe88752a640 1 --2- 172.21.15.22:0/59657368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe880103d80 0x7fe880101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:30.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.277+0000 7fe88752a640 1 --2- 172.21.15.22:0/59657368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe880100f20 0x7fe880103260 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:30.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.277+0000 7fe88752a640 1 -- 172.21.15.22:0/59657368 >> 172.21.15.22:0/59657368 conn(0x7fe8800fc690 msgr2=0x7fe880106ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:30.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.277+0000 7fe88752a640 1 -- 172.21.15.22:0/59657368 shutdown_connections 2024-08-20T01:30:30.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:30.277+0000 7fe88752a640 1 -- 172.21.15.22:0/59657368 wait complete. 2024-08-20T01:30:30.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:30 smithi022 ceph-mon[18709]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:30.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:30 smithi134 ceph-mon[22511]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:30.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:30 smithi077 ceph-mon[22251]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:30.988 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- bash -c 'ceph orch host ls' 2024-08-20T01:30:31.249 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:31.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:31 smithi022 ceph-mon[18709]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:31.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:31 smithi134 ceph-mon[22511]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:31.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.746+0000 7ffaf96cc640 1 -- 172.21.15.22:0/182473372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffaf41058f0 msgr2=0x7ffaf4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:31.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.746+0000 7ffaf96cc640 1 --2- 172.21.15.22:0/182473372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffaf41058f0 0x7ffaf4107ce0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ffadc009900 tx=0x7ffadc02a410 comp rx=0 tx=0).stop 2024-08-20T01:30:31.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.746+0000 7ffaf96cc640 1 -- 172.21.15.22:0/182473372 shutdown_connections 2024-08-20T01:30:31.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.746+0000 7ffaf96cc640 1 --2- 172.21.15.22:0/182473372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffaf4108420 0x7ffaf410a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:31.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.746+0000 7ffaf96cc640 1 --2- 172.21.15.22:0/182473372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffaf41058f0 0x7ffaf4107ce0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:31.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.746+0000 7ffaf96cc640 1 --2- 172.21.15.22:0/182473372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaf406b320 0x7ffaf41053b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:31.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.746+0000 7ffaf96cc640 1 -- 172.21.15.22:0/182473372 >> 172.21.15.22:0/182473372 conn(0x7ffaf40fcee0 msgr2=0x7ffaf40ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:31.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.746+0000 7ffaf96cc640 1 -- 172.21.15.22:0/182473372 shutdown_connections 2024-08-20T01:30:31.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.746+0000 7ffaf96cc640 1 -- 172.21.15.22:0/182473372 wait complete. 2024-08-20T01:30:31.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.747+0000 7ffaf96cc640 1 Processor -- start 2024-08-20T01:30:31.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.747+0000 7ffaf96cc640 1 -- start start 2024-08-20T01:30:31.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.747+0000 7ffaf96cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffaf406b320 0x7ffaf4198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:31.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.747+0000 7ffaf96cc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaf41058f0 0x7ffaf41990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:31.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.747+0000 7ffaf96cc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffaf4108420 0x7ffaf4199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:31.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.747+0000 7ffaf96cc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf410e370 con 0x7ffaf406b320 2024-08-20T01:30:31.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.747+0000 7ffaf96cc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf410e1f0 con 0x7ffaf4108420 2024-08-20T01:30:31.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.747+0000 7ffaf96cc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf410e4f0 con 0x7ffaf41058f0 2024-08-20T01:30:31.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.747+0000 7ffaf2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffaf406b320 0x7ffaf4198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:31.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.747+0000 7ffaf2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffaf406b320 0x7ffaf4198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48122/0 (socket says 172.21.15.22:48122) 2024-08-20T01:30:31.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.747+0000 7ffaf2ffd640 1 -- 172.21.15.22:0/3235866889 learned_addr learned my addr 172.21.15.22:0/3235866889 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:31.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.747+0000 7ffaebfff640 1 --2- 172.21.15.22:0/3235866889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaf41058f0 0x7ffaf41990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:31.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.747+0000 7ffaf37fe640 1 --2- 172.21.15.22:0/3235866889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffaf4108420 0x7ffaf4199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:31.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.748+0000 7ffaf2ffd640 1 -- 172.21.15.22:0/3235866889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaf41058f0 msgr2=0x7ffaf41990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:31.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.748+0000 7ffaf2ffd640 1 --2- 172.21.15.22:0/3235866889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaf41058f0 0x7ffaf41990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:31.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.748+0000 7ffaf2ffd640 1 -- 172.21.15.22:0/3235866889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffaf4108420 msgr2=0x7ffaf4199cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.748+0000 7ffaf2ffd640 1 --2- 172.21.15.22:0/3235866889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffaf4108420 0x7ffaf4199cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.748+0000 7ffaf2ffd640 1 -- 172.21.15.22:0/3235866889 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf419a590 con 0x7ffaf406b320 2024-08-20T01:30:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.748+0000 7ffaebfff640 1 --2- 172.21.15.22:0/3235866889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaf41058f0 0x7ffaf41990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.748+0000 7ffaf2ffd640 1 --2- 172.21.15.22:0/3235866889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffaf406b320 0x7ffaf4198a60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ffae400c970 tx=0x7ffae400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.748+0000 7ffaf0ff9640 1 -- 172.21.15.22:0/3235866889 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae4007bb0 con 0x7ffaf406b320 2024-08-20T01:30:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.748+0000 7ffaf96cc640 1 -- 172.21.15.22:0/3235866889 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf419a880 con 0x7ffaf406b320 2024-08-20T01:30:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.748+0000 7ffaf0ff9640 1 -- 172.21.15.22:0/3235866889 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffae4007d50 con 0x7ffaf406b320 2024-08-20T01:30:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.748+0000 7ffaf0ff9640 1 -- 172.21.15.22:0/3235866889 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae400f450 con 0x7ffaf406b320 2024-08-20T01:30:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.748+0000 7ffaf96cc640 1 -- 172.21.15.22:0/3235866889 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf41a0f60 con 0x7ffaf406b320 2024-08-20T01:30:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.749+0000 7ffaf96cc640 1 -- 172.21.15.22:0/3235866889 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaf40fe9d0 con 0x7ffaf406b320 2024-08-20T01:30:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.751+0000 7ffaf0ff9640 1 -- 172.21.15.22:0/3235866889 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7ffae4004f00 con 0x7ffaf406b320 2024-08-20T01:30:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.751+0000 7ffaf0ff9640 1 --2- 172.21.15.22:0/3235866889 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ffae00b3c60 0x7ffae00b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.751+0000 7ffaebfff640 1 --2- 172.21.15.22:0/3235866889 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ffae00b3c60 0x7ffae00b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.751+0000 7ffaf0ff9640 1 -- 172.21.15.22:0/3235866889 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7ffae40e3fc0 con 0x7ffaf406b320 2024-08-20T01:30:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.752+0000 7ffaebfff640 1 --2- 172.21.15.22:0/3235866889 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ffae00b3c60 0x7ffae00b6120 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffadc000c00 tx=0x7ffadc0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.754+0000 7ffaf0ff9640 1 -- 172.21.15.22:0/3235866889 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ffae4014030 con 0x7ffaf406b320 2024-08-20T01:30:31.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:31 smithi077 ceph-mon[22251]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:31.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.944+0000 7ffaf96cc640 1 -- 172.21.15.22:0/3235866889 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7ffaf40632c0 con 0x7ffae00b3c60 2024-08-20T01:30:31.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.946+0000 7ffaf0ff9640 1 -- 172.21.15.22:0/3235866889 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7ffaf40632c0 con 0x7ffae00b3c60 2024-08-20T01:30:31.947 INFO:teuthology.orchestra.run.smithi022.stdout:HOST ADDR LABELS STATUS 2024-08-20T01:30:31.947 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022 172.21.15.22 2024-08-20T01:30:31.947 INFO:teuthology.orchestra.run.smithi022.stdout:smithi077 172.21.15.77 2024-08-20T01:30:31.947 INFO:teuthology.orchestra.run.smithi022.stdout:smithi134 172.21.15.134 2024-08-20T01:30:31.947 INFO:teuthology.orchestra.run.smithi022.stdout:3 hosts in cluster 2024-08-20T01:30:31.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.948+0000 7ffaf96cc640 1 -- 172.21.15.22:0/3235866889 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ffae00b3c60 msgr2=0x7ffae00b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:31.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.948+0000 7ffaf96cc640 1 --2- 172.21.15.22:0/3235866889 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ffae00b3c60 0x7ffae00b6120 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffadc000c00 tx=0x7ffadc0314a0 comp rx=0 tx=0).stop 2024-08-20T01:30:31.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.948+0000 7ffaf96cc640 1 -- 172.21.15.22:0/3235866889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffaf406b320 msgr2=0x7ffaf4198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:31.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.948+0000 7ffaf96cc640 1 --2- 172.21.15.22:0/3235866889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffaf406b320 0x7ffaf4198a60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ffae400c970 tx=0x7ffae400ce30 comp rx=0 tx=0).stop 2024-08-20T01:30:31.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.948+0000 7ffaf96cc640 1 -- 172.21.15.22:0/3235866889 shutdown_connections 2024-08-20T01:30:31.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.948+0000 7ffaf96cc640 1 --2- 172.21.15.22:0/3235866889 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ffae00b3c60 0x7ffae00b6120 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:31.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.948+0000 7ffaf96cc640 1 --2- 172.21.15.22:0/3235866889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffaf4108420 0x7ffaf4199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:31.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.948+0000 7ffaf96cc640 1 --2- 172.21.15.22:0/3235866889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaf41058f0 0x7ffaf41990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:31.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.948+0000 7ffaf96cc640 1 --2- 172.21.15.22:0/3235866889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffaf406b320 0x7ffaf4198a60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:31.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.948+0000 7ffaf96cc640 1 -- 172.21.15.22:0/3235866889 >> 172.21.15.22:0/3235866889 conn(0x7ffaf40fcee0 msgr2=0x7ffaf4103bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:31.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.948+0000 7ffaf96cc640 1 -- 172.21.15.22:0/3235866889 shutdown_connections 2024-08-20T01:30:31.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:31.948+0000 7ffaf96cc640 1 -- 172.21.15.22:0/3235866889 wait complete. 2024-08-20T01:30:32.540 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:32 smithi022 ceph-mon[18709]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-20T01:30:32.540 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:32 smithi022 ceph-mon[18709]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:32.568 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- bash -c 'ceph orch device ls' 2024-08-20T01:30:32.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:32 smithi134 ceph-mon[22511]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-20T01:30:32.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:32 smithi134 ceph-mon[22511]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:32.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:32 smithi077 ceph-mon[22251]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-20T01:30:32.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:32 smithi077 ceph-mon[22251]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:32.824 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:33.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.301+0000 7f6cf20b2640 1 -- 172.21.15.22:0/3996333109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cec102740 msgr2=0x7f6cec102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:33.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.301+0000 7f6cf20b2640 1 --2- 172.21.15.22:0/3996333109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cec102740 0x7f6cec102b40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc009930 tx=0x7f6cdc02a420 comp rx=0 tx=0).stop 2024-08-20T01:30:33.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.301+0000 7f6cf20b2640 1 -- 172.21.15.22:0/3996333109 shutdown_connections 2024-08-20T01:30:33.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.301+0000 7f6cf20b2640 1 --2- 172.21.15.22:0/3996333109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cec104260 0x7f6cec10abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:33.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.301+0000 7f6cf20b2640 1 --2- 172.21.15.22:0/3996333109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cec1038a0 0x7f6cec103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:33.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.301+0000 7f6cf20b2640 1 --2- 172.21.15.22:0/3996333109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cec102740 0x7f6cec102b40 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:33.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.301+0000 7f6cf20b2640 1 -- 172.21.15.22:0/3996333109 >> 172.21.15.22:0/3996333109 conn(0x7f6cec0fdff0 msgr2=0x7f6cec100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:33.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.301+0000 7f6cf20b2640 1 -- 172.21.15.22:0/3996333109 shutdown_connections 2024-08-20T01:30:33.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.301+0000 7f6cf20b2640 1 -- 172.21.15.22:0/3996333109 wait complete. 2024-08-20T01:30:33.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.302+0000 7f6cf20b2640 1 Processor -- start 2024-08-20T01:30:33.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.302+0000 7f6cf20b2640 1 -- start start 2024-08-20T01:30:33.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.302+0000 7f6cf20b2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cec102740 0x7f6cec19ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:33.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.302+0000 7f6cf20b2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cec1038a0 0x7f6cec19b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:33.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.302+0000 7f6cf20b2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cec104260 0x7f6cec19bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:33.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.302+0000 7f6cf20b2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6cec10e420 con 0x7f6cec102740 2024-08-20T01:30:33.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.302+0000 7f6cf20b2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6cec10e2a0 con 0x7f6cec104260 2024-08-20T01:30:33.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.302+0000 7f6cf20b2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6cec10e5a0 con 0x7f6cec1038a0 2024-08-20T01:30:33.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.302+0000 7f6ceb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cec102740 0x7f6cec19ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:33.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.302+0000 7f6ceb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cec102740 0x7f6cec19ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48132/0 (socket says 172.21.15.22:48132) 2024-08-20T01:30:33.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.302+0000 7f6ceb7fe640 1 -- 172.21.15.22:0/2914908352 learned_addr learned my addr 172.21.15.22:0/2914908352 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:33.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.302+0000 7f6cebfff640 1 --2- 172.21.15.22:0/2914908352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cec104260 0x7f6cec19bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:33.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.302+0000 7f6ceaffd640 1 --2- 172.21.15.22:0/2914908352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cec1038a0 0x7f6cec19b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:33.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.302+0000 7f6ceb7fe640 1 -- 172.21.15.22:0/2914908352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cec1038a0 msgr2=0x7f6cec19b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:33.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.302+0000 7f6ceb7fe640 1 --2- 172.21.15.22:0/2914908352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cec1038a0 0x7f6cec19b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:33.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.302+0000 7f6ceb7fe640 1 -- 172.21.15.22:0/2914908352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cec104260 msgr2=0x7f6cec19bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:33.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.302+0000 7f6ceb7fe640 1 --2- 172.21.15.22:0/2914908352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cec104260 0x7f6cec19bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:33.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.302+0000 7f6ceb7fe640 1 -- 172.21.15.22:0/2914908352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cec19c870 con 0x7f6cec102740 2024-08-20T01:30:33.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.303+0000 7f6ceb7fe640 1 --2- 172.21.15.22:0/2914908352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cec102740 0x7f6cec19ad40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc005ec0 tx=0x7f6cdc004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:33.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.303+0000 7f6ce8ff9640 1 -- 172.21.15.22:0/2914908352 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc03f030 con 0x7f6cec102740 2024-08-20T01:30:33.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.303+0000 7f6ce8ff9640 1 -- 172.21.15.22:0/2914908352 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cdc003cb0 con 0x7f6cec102740 2024-08-20T01:30:33.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.303+0000 7f6cf20b2640 1 -- 172.21.15.22:0/2914908352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cec19cb00 con 0x7f6cec102740 2024-08-20T01:30:33.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.303+0000 7f6ce8ff9640 1 -- 172.21.15.22:0/2914908352 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc035070 con 0x7f6cec102740 2024-08-20T01:30:33.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.303+0000 7f6cf20b2640 1 -- 172.21.15.22:0/2914908352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cec1a3070 con 0x7f6cec102740 2024-08-20T01:30:33.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.304+0000 7f6cf20b2640 1 -- 172.21.15.22:0/2914908352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cec1a32d0 con 0x7f6cec102740 2024-08-20T01:30:33.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.305+0000 7f6ce8ff9640 1 -- 172.21.15.22:0/2914908352 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f6cdc042030 con 0x7f6cec102740 2024-08-20T01:30:33.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.306+0000 7f6ce8ff9640 1 --2- 172.21.15.22:0/2914908352 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6cd40b3c60 0x7f6cd40b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:33.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.306+0000 7f6ceaffd640 1 --2- 172.21.15.22:0/2914908352 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6cd40b3c60 0x7f6cd40b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:33.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.306+0000 7f6ce8ff9640 1 -- 172.21.15.22:0/2914908352 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f6cdc104920 con 0x7f6cec102740 2024-08-20T01:30:33.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.307+0000 7f6ceaffd640 1 --2- 172.21.15.22:0/2914908352 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6cd40b3c60 0x7f6cd40b6120 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6ce00058c0 tx=0x7f6ce000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:33.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.309+0000 7f6ce8ff9640 1 -- 172.21.15.22:0/2914908352 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f6cdc0cb740 con 0x7f6cec102740 2024-08-20T01:30:33.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.503+0000 7f6cf20b2640 1 -- 172.21.15.22:0/2914908352 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f6cec1a34a0 con 0x7f6cd40b3c60 2024-08-20T01:30:33.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.505+0000 7f6ce8ff9640 1 -- 172.21.15.22:0/2914908352 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f6cec1a34a0 con 0x7f6cd40b3c60 2024-08-20T01:30:33.506 INFO:teuthology.orchestra.run.smithi022.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-08-20T01:30:33.506 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747402EC480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-08-20T01:30:33.506 INFO:teuthology.orchestra.run.smithi022.stdout:smithi077 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400ZJ400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-08-20T01:30:33.506 INFO:teuthology.orchestra.run.smithi022.stdout:smithi134 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62420002400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-08-20T01:30:33.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.508+0000 7f6cf20b2640 1 -- 172.21.15.22:0/2914908352 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6cd40b3c60 msgr2=0x7f6cd40b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:33.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.508+0000 7f6cf20b2640 1 --2- 172.21.15.22:0/2914908352 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6cd40b3c60 0x7f6cd40b6120 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6ce00058c0 tx=0x7f6ce000a2d0 comp rx=0 tx=0).stop 2024-08-20T01:30:33.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.508+0000 7f6cf20b2640 1 -- 172.21.15.22:0/2914908352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cec102740 msgr2=0x7f6cec19ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:33.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.508+0000 7f6cf20b2640 1 --2- 172.21.15.22:0/2914908352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cec102740 0x7f6cec19ad40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc005ec0 tx=0x7f6cdc004360 comp rx=0 tx=0).stop 2024-08-20T01:30:33.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.508+0000 7f6cf20b2640 1 -- 172.21.15.22:0/2914908352 shutdown_connections 2024-08-20T01:30:33.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.508+0000 7f6cf20b2640 1 --2- 172.21.15.22:0/2914908352 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6cd40b3c60 0x7f6cd40b6120 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:33.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.508+0000 7f6cf20b2640 1 --2- 172.21.15.22:0/2914908352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cec104260 0x7f6cec19bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:33.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.508+0000 7f6cf20b2640 1 --2- 172.21.15.22:0/2914908352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cec1038a0 0x7f6cec19b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:33.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.508+0000 7f6cf20b2640 1 --2- 172.21.15.22:0/2914908352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cec102740 0x7f6cec19ad40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:33.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.508+0000 7f6cf20b2640 1 -- 172.21.15.22:0/2914908352 >> 172.21.15.22:0/2914908352 conn(0x7f6cec0fdff0 msgr2=0x7f6cec108fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:33.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.508+0000 7f6cf20b2640 1 -- 172.21.15.22:0/2914908352 shutdown_connections 2024-08-20T01:30:33.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:33.508+0000 7f6cf20b2640 1 -- 172.21.15.22:0/2914908352 wait complete. 2024-08-20T01:30:34.127 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-20T01:30:34.136 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-08-20T01:30:34.137 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-20T01:30:34.394 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:34.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:34 smithi022 ceph-mon[18709]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:34.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:34 smithi022 ceph-mon[18709]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:34.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:34 smithi134 ceph-mon[22511]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:34.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:34 smithi134 ceph-mon[22511]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:34.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:34 smithi077 ceph-mon[22251]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:34.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:34 smithi077 ceph-mon[22251]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:34.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.866+0000 7f3be5ac1640 1 -- 172.21.15.22:0/3704823967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3be01038a0 msgr2=0x7f3be0103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:34.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.866+0000 7f3be5ac1640 1 --2- 172.21.15.22:0/3704823967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3be01038a0 0x7f3be0103d20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8009930 tx=0x7f3bc802a420 comp rx=0 tx=0).stop 2024-08-20T01:30:34.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.866+0000 7f3be5ac1640 1 -- 172.21.15.22:0/3704823967 shutdown_connections 2024-08-20T01:30:34.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.866+0000 7f3be5ac1640 1 --2- 172.21.15.22:0/3704823967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3be0104260 0x7f3be010abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:34.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.866+0000 7f3be5ac1640 1 --2- 172.21.15.22:0/3704823967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3be01038a0 0x7f3be0103d20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:34.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.866+0000 7f3be5ac1640 1 --2- 172.21.15.22:0/3704823967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be0102740 0x7f3be0102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:34.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.866+0000 7f3be5ac1640 1 -- 172.21.15.22:0/3704823967 >> 172.21.15.22:0/3704823967 conn(0x7f3be00fdff0 msgr2=0x7f3be0100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:34.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.866+0000 7f3be5ac1640 1 -- 172.21.15.22:0/3704823967 shutdown_connections 2024-08-20T01:30:34.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.866+0000 7f3be5ac1640 1 -- 172.21.15.22:0/3704823967 wait complete. 2024-08-20T01:30:34.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.866+0000 7f3be5ac1640 1 Processor -- start 2024-08-20T01:30:34.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.866+0000 7f3be5ac1640 1 -- start start 2024-08-20T01:30:34.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.867+0000 7f3be5ac1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be0102740 0x7f3be0076a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:34.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.867+0000 7f3be5ac1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3be01038a0 0x7f3be0075270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:34.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.867+0000 7f3be5ac1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3be0104260 0x7f3be00757b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:34.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.867+0000 7f3be5ac1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3be010e3a0 con 0x7f3be01038a0 2024-08-20T01:30:34.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.867+0000 7f3be5ac1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3be010e220 con 0x7f3be0102740 2024-08-20T01:30:34.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.867+0000 7f3be5ac1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3be010e520 con 0x7f3be0104260 2024-08-20T01:30:34.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.867+0000 7f3bd6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3be01038a0 0x7f3be0075270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:34.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.867+0000 7f3bd6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3be01038a0 0x7f3be0075270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48152/0 (socket says 172.21.15.22:48152) 2024-08-20T01:30:34.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.867+0000 7f3bd6ffd640 1 -- 172.21.15.22:0/415865119 learned_addr learned my addr 172.21.15.22:0/415865119 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:34.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.867+0000 7f3bdffff640 1 --2- 172.21.15.22:0/415865119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3be0104260 0x7f3be00757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:34.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.867+0000 7f3bdf7fe640 1 --2- 172.21.15.22:0/415865119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be0102740 0x7f3be0076a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:34.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.867+0000 7f3bd6ffd640 1 -- 172.21.15.22:0/415865119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3be0104260 msgr2=0x7f3be00757b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:34.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.867+0000 7f3bd6ffd640 1 --2- 172.21.15.22:0/415865119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3be0104260 0x7f3be00757b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:34.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.867+0000 7f3bd6ffd640 1 -- 172.21.15.22:0/415865119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be0102740 msgr2=0x7f3be0076a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:34.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.867+0000 7f3bd6ffd640 1 --2- 172.21.15.22:0/415865119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be0102740 0x7f3be0076a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:34.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.867+0000 7f3bd6ffd640 1 -- 172.21.15.22:0/415865119 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be0076070 con 0x7f3be01038a0 2024-08-20T01:30:34.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.867+0000 7f3bdffff640 1 --2- 172.21.15.22:0/415865119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3be0104260 0x7f3be00757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:34.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.867+0000 7f3bd6ffd640 1 --2- 172.21.15.22:0/415865119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3be01038a0 0x7f3be0075270 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8005ab0 tx=0x7f3bc80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:34.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.868+0000 7f3bdd7fa640 1 -- 172.21.15.22:0/415865119 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc803f030 con 0x7f3be01038a0 2024-08-20T01:30:34.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.868+0000 7f3bdd7fa640 1 -- 172.21.15.22:0/415865119 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bc8003cb0 con 0x7f3be01038a0 2024-08-20T01:30:34.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.868+0000 7f3be5ac1640 1 -- 172.21.15.22:0/415865119 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3be01a2b20 con 0x7f3be01038a0 2024-08-20T01:30:34.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.868+0000 7f3bdd7fa640 1 -- 172.21.15.22:0/415865119 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8035070 con 0x7f3be01038a0 2024-08-20T01:30:34.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.868+0000 7f3be5ac1640 1 -- 172.21.15.22:0/415865119 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3be01a2fd0 con 0x7f3be01038a0 2024-08-20T01:30:34.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.869+0000 7f3be5ac1640 1 -- 172.21.15.22:0/415865119 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3be01099f0 con 0x7f3be01038a0 2024-08-20T01:30:34.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.870+0000 7f3bdd7fa640 1 -- 172.21.15.22:0/415865119 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f3bc8042030 con 0x7f3be01038a0 2024-08-20T01:30:34.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.871+0000 7f3bdd7fa640 1 --2- 172.21.15.22:0/415865119 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3bcc0b3c60 0x7f3bcc0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:34.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.871+0000 7f3bdf7fe640 1 --2- 172.21.15.22:0/415865119 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3bcc0b3c60 0x7f3bcc0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:34.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.871+0000 7f3bdd7fa640 1 -- 172.21.15.22:0/415865119 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f3bc8104860 con 0x7f3be01038a0 2024-08-20T01:30:34.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.872+0000 7f3bdf7fe640 1 --2- 172.21.15.22:0/415865119 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3bcc0b3c60 0x7f3bcc0b6120 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0005e10 tx=0x7f3bd0005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:34.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:34.874+0000 7f3bdd7fa640 1 -- 172.21.15.22:0/415865119 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f3bc80cbd30 con 0x7f3be01038a0 2024-08-20T01:30:35.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:35.096+0000 7f3be5ac1640 1 -- 172.21.15.22:0/415865119 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3be002e340 con 0x7f3be01038a0 2024-08-20T01:30:35.099 INFO:teuthology.orchestra.run.smithi022.stdout:e24 2024-08-20T01:30:35.099 INFO:teuthology.orchestra.run.smithi022.stdout:btime 2024-08-20T01:29:18:472908+0000 2024-08-20T01:30:35.099 INFO:teuthology.orchestra.run.smithi022.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-20T01:30:35.099 INFO:teuthology.orchestra.run.smithi022.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-20T01:30:35.099 INFO:teuthology.orchestra.run.smithi022.stdout:legacy client fscid: 1 2024-08-20T01:30:35.099 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:35.099 INFO:teuthology.orchestra.run.smithi022.stdout:Filesystem 'cephfs' (1) 2024-08-20T01:30:35.099 INFO:teuthology.orchestra.run.smithi022.stdout:fs_name cephfs 2024-08-20T01:30:35.100 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 24 2024-08-20T01:30:35.100 INFO:teuthology.orchestra.run.smithi022.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-20T01:30:35.100 INFO:teuthology.orchestra.run.smithi022.stdout:created 2024-08-20T01:29:07.003058+0000 2024-08-20T01:30:35.100 INFO:teuthology.orchestra.run.smithi022.stdout:modified 2024-08-20T01:29:18.048623+0000 2024-08-20T01:30:35.100 INFO:teuthology.orchestra.run.smithi022.stdout:tableserver 0 2024-08-20T01:30:35.100 INFO:teuthology.orchestra.run.smithi022.stdout:root 0 2024-08-20T01:30:35.100 INFO:teuthology.orchestra.run.smithi022.stdout:session_timeout 300 2024-08-20T01:30:35.100 INFO:teuthology.orchestra.run.smithi022.stdout:session_autoclose 300 2024-08-20T01:30:35.100 INFO:teuthology.orchestra.run.smithi022.stdout:max_file_size 1099511627776 2024-08-20T01:30:35.100 INFO:teuthology.orchestra.run.smithi022.stdout:max_xattr_size 65536 2024-08-20T01:30:35.100 INFO:teuthology.orchestra.run.smithi022.stdout:required_client_features {} 2024-08-20T01:30:35.100 INFO:teuthology.orchestra.run.smithi022.stdout:last_failure 0 2024-08-20T01:30:35.100 INFO:teuthology.orchestra.run.smithi022.stdout:last_failure_osd_epoch 0 2024-08-20T01:30:35.100 INFO:teuthology.orchestra.run.smithi022.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-20T01:30:35.101 INFO:teuthology.orchestra.run.smithi022.stdout:max_mds 3 2024-08-20T01:30:35.101 INFO:teuthology.orchestra.run.smithi022.stdout:in 0,1,2 2024-08-20T01:30:35.101 INFO:teuthology.orchestra.run.smithi022.stdout:up {0=24586,1=24575,2=24565} 2024-08-20T01:30:35.101 INFO:teuthology.orchestra.run.smithi022.stdout:failed 2024-08-20T01:30:35.101 INFO:teuthology.orchestra.run.smithi022.stdout:damaged 2024-08-20T01:30:35.101 INFO:teuthology.orchestra.run.smithi022.stdout:stopped 2024-08-20T01:30:35.101 INFO:teuthology.orchestra.run.smithi022.stdout:data_pools [3] 2024-08-20T01:30:35.101 INFO:teuthology.orchestra.run.smithi022.stdout:metadata_pool 2 2024-08-20T01:30:35.101 INFO:teuthology.orchestra.run.smithi022.stdout:inline_data disabled 2024-08-20T01:30:35.101 INFO:teuthology.orchestra.run.smithi022.stdout:balancer 2024-08-20T01:30:35.101 INFO:teuthology.orchestra.run.smithi022.stdout:bal_rank_mask -1 2024-08-20T01:30:35.101 INFO:teuthology.orchestra.run.smithi022.stdout:standby_count_wanted 0 2024-08-20T01:30:35.102 INFO:teuthology.orchestra.run.smithi022.stdout:qdb_cluster leader: 24586 members: 24565,24575,24586 2024-08-20T01:30:35.102 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.i{0:24586} state up:active seq 6 addr [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:30:35.102 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.f{0:24559} state up:standby-replay seq 1 addr [v2:172.21.15.134:6834/3018668202,v1:172.21.15.134:6835/3018668202] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:30:35.102 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.b{1:24575} state up:active seq 6 addr [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:30:35.102 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.h{1:24548} state up:standby-replay seq 1 addr [v2:172.21.15.77:6836/259148624,v1:172.21.15.77:6837/259148624] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:30:35.102 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.c{2:24565} state up:active seq 10 addr [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:30:35.102 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.e{2:24527} state up:standby-replay seq 1 addr [v2:172.21.15.77:6834/1109505305,v1:172.21.15.77:6835/1109505305] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:30:35.102 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:35.102 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:35.102 INFO:teuthology.orchestra.run.smithi022.stdout:Standby daemons: 2024-08-20T01:30:35.102 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:35.102 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.j{-1:14664} state up:standby seq 1 addr [v2:172.21.15.22:6834/2832768009,v1:172.21.15.22:6835/2832768009] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:30:35.102 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.d{-1:14676} state up:standby seq 1 addr [v2:172.21.15.22:6836/2398926267,v1:172.21.15.22:6837/2398926267] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:30:35.103 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.g{-1:14721} state up:standby seq 1 addr [v2:172.21.15.22:6838/1257333272,v1:172.21.15.22:6839/1257333272] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:30:35.103 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.a{-1:14733} state up:standby seq 1 addr [v2:172.21.15.22:6840/3674086354,v1:172.21.15.22:6841/3674086354] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:30:35.103 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.k{-1:24509} state up:standby seq 1 addr [v2:172.21.15.77:6832/2545210984,v1:172.21.15.77:6833/2545210984] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:30:35.103 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.l{-1:24520} state up:standby seq 1 addr [v2:172.21.15.134:6832/3278477669,v1:172.21.15.134:6833/3278477669] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:30:35.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:35.097+0000 7f3bdd7fa640 1 -- 172.21.15.22:0/415865119 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3083 (secure 0 0 0) 0x7f3bc80cb630 con 0x7f3be01038a0 2024-08-20T01:30:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 24 2024-08-20T01:30:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:35.099+0000 7f3be5ac1640 1 -- 172.21.15.22:0/415865119 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3bcc0b3c60 msgr2=0x7f3bcc0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:35.099+0000 7f3be5ac1640 1 --2- 172.21.15.22:0/415865119 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3bcc0b3c60 0x7f3bcc0b6120 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0005e10 tx=0x7f3bd0005da0 comp rx=0 tx=0).stop 2024-08-20T01:30:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:35.099+0000 7f3be5ac1640 1 -- 172.21.15.22:0/415865119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3be01038a0 msgr2=0x7f3be0075270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:35.099+0000 7f3be5ac1640 1 --2- 172.21.15.22:0/415865119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3be01038a0 0x7f3be0075270 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8005ab0 tx=0x7f3bc80042f0 comp rx=0 tx=0).stop 2024-08-20T01:30:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:35.099+0000 7f3be5ac1640 1 -- 172.21.15.22:0/415865119 shutdown_connections 2024-08-20T01:30:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:35.099+0000 7f3be5ac1640 1 --2- 172.21.15.22:0/415865119 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3bcc0b3c60 0x7f3bcc0b6120 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:35.099+0000 7f3be5ac1640 1 --2- 172.21.15.22:0/415865119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3be0104260 0x7f3be00757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:35.099+0000 7f3be5ac1640 1 --2- 172.21.15.22:0/415865119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3be01038a0 0x7f3be0075270 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:35.099+0000 7f3be5ac1640 1 --2- 172.21.15.22:0/415865119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be0102740 0x7f3be0076a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:35.099+0000 7f3be5ac1640 1 -- 172.21.15.22:0/415865119 >> 172.21.15.22:0/415865119 conn(0x7f3be00fdff0 msgr2=0x7f3be0106bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:35.100+0000 7f3be5ac1640 1 -- 172.21.15.22:0/415865119 shutdown_connections 2024-08-20T01:30:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:35.100+0000 7f3be5ac1640 1 -- 172.21.15.22:0/415865119 wait complete. 2024-08-20T01:30:35.757 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:35 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/415865119' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-20T01:30:35.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:35 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/415865119' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-20T01:30:35.788 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- bash -c 'ceph osd dump' 2024-08-20T01:30:35.813 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:35 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/415865119' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-20T01:30:36.049 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:36.436 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:36 smithi022 ceph-mon[18709]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-20T01:30:36.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.517+0000 7fe9277ef640 1 -- 172.21.15.22:0/3032060929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9201058f0 msgr2=0x7fe920107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:36.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.517+0000 7fe9277ef640 1 --2- 172.21.15.22:0/3032060929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9201058f0 0x7fe920107ce0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe910009900 tx=0x7fe91002a410 comp rx=0 tx=0).stop 2024-08-20T01:30:36.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.517+0000 7fe9277ef640 1 -- 172.21.15.22:0/3032060929 shutdown_connections 2024-08-20T01:30:36.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.517+0000 7fe9277ef640 1 --2- 172.21.15.22:0/3032060929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe920108420 0x7fe92010a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:36.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.517+0000 7fe9277ef640 1 --2- 172.21.15.22:0/3032060929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9201058f0 0x7fe920107ce0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:36.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.517+0000 7fe9277ef640 1 --2- 172.21.15.22:0/3032060929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe92006b320 0x7fe9201053b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:36.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.517+0000 7fe9277ef640 1 -- 172.21.15.22:0/3032060929 >> 172.21.15.22:0/3032060929 conn(0x7fe9200fcee0 msgr2=0x7fe9200ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:36.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.517+0000 7fe9277ef640 1 -- 172.21.15.22:0/3032060929 shutdown_connections 2024-08-20T01:30:36.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.517+0000 7fe9277ef640 1 -- 172.21.15.22:0/3032060929 wait complete. 2024-08-20T01:30:36.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.517+0000 7fe9277ef640 1 Processor -- start 2024-08-20T01:30:36.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe9277ef640 1 -- start start 2024-08-20T01:30:36.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe9277ef640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe92006b320 0x7fe920198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:36.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe9277ef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9201058f0 0x7fe920199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:36.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe9277ef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe920108420 0x7fe920199dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:36.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe9277ef640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe92010e3f0 con 0x7fe92006b320 2024-08-20T01:30:36.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe9277ef640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe92010e270 con 0x7fe920108420 2024-08-20T01:30:36.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe9277ef640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe92010e570 con 0x7fe9201058f0 2024-08-20T01:30:36.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe92558b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe92006b320 0x7fe920198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:36.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe92558b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe92006b320 0x7fe920198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48166/0 (socket says 172.21.15.22:48166) 2024-08-20T01:30:36.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe92558b640 1 -- 172.21.15.22:0/273104496 learned_addr learned my addr 172.21.15.22:0/273104496 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:36.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe924d8a640 1 --2- 172.21.15.22:0/273104496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9201058f0 0x7fe920199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:36.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe925d8c640 1 --2- 172.21.15.22:0/273104496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe920108420 0x7fe920199dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:36.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe92558b640 1 -- 172.21.15.22:0/273104496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9201058f0 msgr2=0x7fe920199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:36.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe92558b640 1 --2- 172.21.15.22:0/273104496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9201058f0 0x7fe920199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:36.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe92558b640 1 -- 172.21.15.22:0/273104496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe920108420 msgr2=0x7fe920199dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:36.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe92558b640 1 --2- 172.21.15.22:0/273104496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe920108420 0x7fe920199dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:36.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe92558b640 1 -- 172.21.15.22:0/273104496 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92019a670 con 0x7fe92006b320 2024-08-20T01:30:36.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe925d8c640 1 --2- 172.21.15.22:0/273104496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe920108420 0x7fe920199dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:30:36.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe924d8a640 1 --2- 172.21.15.22:0/273104496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9201058f0 0x7fe920199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:36.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.518+0000 7fe92558b640 1 --2- 172.21.15.22:0/273104496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe92006b320 0x7fe920198b40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00d770 tx=0x7fe91c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:36.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.519+0000 7fe9167fc640 1 -- 172.21.15.22:0/273104496 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c017070 con 0x7fe92006b320 2024-08-20T01:30:36.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.519+0000 7fe9277ef640 1 -- 172.21.15.22:0/273104496 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe92019a960 con 0x7fe92006b320 2024-08-20T01:30:36.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.519+0000 7fe9167fc640 1 -- 172.21.15.22:0/273104496 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe91c0054d0 con 0x7fe92006b320 2024-08-20T01:30:36.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.519+0000 7fe9167fc640 1 -- 172.21.15.22:0/273104496 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c004c30 con 0x7fe92006b320 2024-08-20T01:30:36.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.519+0000 7fe9277ef640 1 -- 172.21.15.22:0/273104496 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9201a1040 con 0x7fe92006b320 2024-08-20T01:30:36.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.520+0000 7fe9277ef640 1 -- 172.21.15.22:0/273104496 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe920105cd0 con 0x7fe92006b320 2024-08-20T01:30:36.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.521+0000 7fe9167fc640 1 -- 172.21.15.22:0/273104496 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fe91c004e10 con 0x7fe92006b320 2024-08-20T01:30:36.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.522+0000 7fe9167fc640 1 --2- 172.21.15.22:0/273104496 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe90c0b3c60 0x7fe90c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:36.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.522+0000 7fe924d8a640 1 --2- 172.21.15.22:0/273104496 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe90c0b3c60 0x7fe90c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:36.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.522+0000 7fe9167fc640 1 -- 172.21.15.22:0/273104496 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7fe91c0e3990 con 0x7fe92006b320 2024-08-20T01:30:36.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.523+0000 7fe924d8a640 1 --2- 172.21.15.22:0/273104496 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe90c0b3c60 0x7fe90c0b6120 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe910000c00 tx=0x7fe9100314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:36.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.526+0000 7fe9167fc640 1 -- 172.21.15.22:0/273104496 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe91c0aae00 con 0x7fe92006b320 2024-08-20T01:30:36.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.711+0000 7fe9277ef640 1 -- 172.21.15.22:0/273104496 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fe920063a80 con 0x7fe92006b320 2024-08-20T01:30:36.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.712+0000 7fe9167fc640 1 -- 172.21.15.22:0/273104496 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v77) ==== 56+0+5313 (secure 0 0 0) 0x7fe91c0a4e20 con 0x7fe92006b320 2024-08-20T01:30:36.714 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 77 2024-08-20T01:30:36.715 INFO:teuthology.orchestra.run.smithi022.stdout:fsid 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:30:36.715 INFO:teuthology.orchestra.run.smithi022.stdout:created 2024-08-20T01:20:55.065729+0000 2024-08-20T01:30:36.715 INFO:teuthology.orchestra.run.smithi022.stdout:modified 2024-08-20T01:29:55.012566+0000 2024-08-20T01:30:36.715 INFO:teuthology.orchestra.run.smithi022.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-08-20T01:30:36.715 INFO:teuthology.orchestra.run.smithi022.stdout:crush_version 26 2024-08-20T01:30:36.715 INFO:teuthology.orchestra.run.smithi022.stdout:full_ratio 0.95 2024-08-20T01:30:36.715 INFO:teuthology.orchestra.run.smithi022.stdout:backfillfull_ratio 0.9 2024-08-20T01:30:36.715 INFO:teuthology.orchestra.run.smithi022.stdout:nearfull_ratio 0.85 2024-08-20T01:30:36.715 INFO:teuthology.orchestra.run.smithi022.stdout:require_min_compat_client luminous 2024-08-20T01:30:36.715 INFO:teuthology.orchestra.run.smithi022.stdout:min_compat_client luminous 2024-08-20T01:30:36.715 INFO:teuthology.orchestra.run.smithi022.stdout:require_osd_release squid 2024-08-20T01:30:36.715 INFO:teuthology.orchestra.run.smithi022.stdout:stretch_mode_enabled false 2024-08-20T01:30:36.715 INFO:teuthology.orchestra.run.smithi022.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-08-20T01:30:36.716 INFO:teuthology.orchestra.run.smithi022.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-08-20T01:30:36.716 INFO:teuthology.orchestra.run.smithi022.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-08-20T01:30:36.716 INFO:teuthology.orchestra.run.smithi022.stdout:max_osd 12 2024-08-20T01:30:36.716 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0 up in weight 1 up_from 8 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6802/812056903,v1:172.21.15.22:6803/812056903] [v2:172.21.15.22:6804/812056903,v1:172.21.15.22:6805/812056903] exists,up b67a59af-5eea-4073-a4b2-604a1b7b8f82 2024-08-20T01:30:36.716 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1 up in weight 1 up_from 13 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6800/823882511,v1:172.21.15.77:6801/823882511] [v2:172.21.15.77:6802/823882511,v1:172.21.15.77:6803/823882511] exists,up 9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c 2024-08-20T01:30:36.716 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2 up in weight 1 up_from 17 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6800/3873702897,v1:172.21.15.134:6801/3873702897] [v2:172.21.15.134:6802/3873702897,v1:172.21.15.134:6803/3873702897] exists,up 71e3c019-a3e0-4632-81a8-27ac31279f7d 2024-08-20T01:30:36.716 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3 up in weight 1 up_from 24 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6810/1775946906,v1:172.21.15.22:6811/1775946906] [v2:172.21.15.22:6812/1775946906,v1:172.21.15.22:6813/1775946906] exists,up a60de748-aa65-477d-864e-6281db1261ee 2024-08-20T01:30:36.716 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4 up in weight 1 up_from 30 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6808/1954209322,v1:172.21.15.77:6809/1954209322] [v2:172.21.15.77:6810/1954209322,v1:172.21.15.77:6811/1954209322] exists,up 07d99671-2ece-471c-ad69-fc9043d917f4 2024-08-20T01:30:36.716 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5 up in weight 1 up_from 35 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6808/2805488123,v1:172.21.15.134:6809/2805488123] [v2:172.21.15.134:6810/2805488123,v1:172.21.15.134:6811/2805488123] exists,up 971cac33-0b98-49b1-b4b2-27354fc0ab90 2024-08-20T01:30:36.716 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6 up in weight 1 up_from 41 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6818/3804882416,v1:172.21.15.22:6819/3804882416] [v2:172.21.15.22:6820/3804882416,v1:172.21.15.22:6821/3804882416] exists,up 48d90292-8511-47d6-8093-330bd13ae70e 2024-08-20T01:30:36.716 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7 up in weight 1 up_from 46 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6816/700318902,v1:172.21.15.77:6817/700318902] [v2:172.21.15.77:6818/700318902,v1:172.21.15.77:6819/700318902] exists,up e217112d-9f56-4a48-93bf-6eb052ce540a 2024-08-20T01:30:36.716 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8 up in weight 1 up_from 52 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6816/1635473481,v1:172.21.15.134:6817/1635473481] [v2:172.21.15.134:6818/1635473481,v1:172.21.15.134:6819/1635473481] exists,up 1786747c-6ff6-4e00-bcf6-a8176215847f 2024-08-20T01:30:36.716 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9 up in weight 1 up_from 58 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6826/3899297933,v1:172.21.15.22:6827/3899297933] [v2:172.21.15.22:6828/3899297933,v1:172.21.15.22:6829/3899297933] exists,up 708f7390-1b51-4397-a92a-8ff3f4a5bc45 2024-08-20T01:30:36.716 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10 up in weight 1 up_from 63 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6824/2765589872,v1:172.21.15.77:6825/2765589872] [v2:172.21.15.77:6826/2765589872,v1:172.21.15.77:6827/2765589872] exists,up d15b0acd-dd08-431d-88aa-756b6420987d 2024-08-20T01:30:36.717 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11 up in weight 1 up_from 69 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6824/964533669,v1:172.21.15.134:6825/964533669] [v2:172.21.15.134:6826/964533669,v1:172.21.15.134:6827/964533669] exists,up d15017fa-3c3d-4096-a35d-275cd54bb9e9 2024-08-20T01:30:36.717 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 2.6 [8,11] 2024-08-20T01:30:36.717 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 2.14 [2,4] 2024-08-20T01:30:36.717 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.0 [4,6] 2024-08-20T01:30:36.717 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.e [4,6] 2024-08-20T01:30:36.717 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.11 [4,8] 2024-08-20T01:30:36.717 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.1a [5,7] 2024-08-20T01:30:36.717 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.1b [4,8] 2024-08-20T01:30:36.717 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.22 [3,9] 2024-08-20T01:30:36.717 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.33 [5,9] 2024-08-20T01:30:36.717 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.3b [3,9] 2024-08-20T01:30:36.717 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/416470260 expires 2024-08-21T01:21:53.209795+0000 2024-08-20T01:30:36.717 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6801/760844170 expires 2024-08-21T01:21:53.209795+0000 2024-08-20T01:30:36.717 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6800/760844170 expires 2024-08-21T01:21:53.209795+0000 2024-08-20T01:30:36.718 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/1142422661 expires 2024-08-21T01:21:53.209795+0000 2024-08-20T01:30:36.718 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6801/1099138788 expires 2024-08-21T01:21:28.981981+0000 2024-08-20T01:30:36.718 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6800/1099138788 expires 2024-08-21T01:21:28.981981+0000 2024-08-20T01:30:36.718 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/2093308719 expires 2024-08-21T01:21:53.209795+0000 2024-08-20T01:30:36.718 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/3772866379 expires 2024-08-21T01:21:28.981981+0000 2024-08-20T01:30:36.718 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/3424402756 expires 2024-08-21T01:21:28.981981+0000 2024-08-20T01:30:36.718 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/3864772624 expires 2024-08-21T01:21:28.981981+0000 2024-08-20T01:30:36.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.714+0000 7fe9277ef640 1 -- 172.21.15.22:0/273104496 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe90c0b3c60 msgr2=0x7fe90c0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:36.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.714+0000 7fe9277ef640 1 --2- 172.21.15.22:0/273104496 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe90c0b3c60 0x7fe90c0b6120 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe910000c00 tx=0x7fe9100314a0 comp rx=0 tx=0).stop 2024-08-20T01:30:36.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.714+0000 7fe9277ef640 1 -- 172.21.15.22:0/273104496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe92006b320 msgr2=0x7fe920198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:36.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.714+0000 7fe9277ef640 1 --2- 172.21.15.22:0/273104496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe92006b320 0x7fe920198b40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00d770 tx=0x7fe91c00dc30 comp rx=0 tx=0).stop 2024-08-20T01:30:36.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.714+0000 7fe9277ef640 1 -- 172.21.15.22:0/273104496 shutdown_connections 2024-08-20T01:30:36.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.714+0000 7fe9277ef640 1 --2- 172.21.15.22:0/273104496 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe90c0b3c60 0x7fe90c0b6120 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:36.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.714+0000 7fe9277ef640 1 --2- 172.21.15.22:0/273104496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe920108420 0x7fe920199dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:36.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.714+0000 7fe9277ef640 1 --2- 172.21.15.22:0/273104496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9201058f0 0x7fe920199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:36.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.714+0000 7fe9277ef640 1 --2- 172.21.15.22:0/273104496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe92006b320 0x7fe920198b40 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:36.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.714+0000 7fe9277ef640 1 -- 172.21.15.22:0/273104496 >> 172.21.15.22:0/273104496 conn(0x7fe9200fcee0 msgr2=0x7fe920103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:36.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.715+0000 7fe9277ef640 1 -- 172.21.15.22:0/273104496 shutdown_connections 2024-08-20T01:30:36.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:36.715+0000 7fe9277ef640 1 -- 172.21.15.22:0/273104496 wait complete. 2024-08-20T01:30:36.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:36 smithi134 ceph-mon[22511]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-20T01:30:36.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:36 smithi077 ceph-mon[22251]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-20T01:30:37.320 INFO:teuthology.run_tasks:Running task fs.ready... 2024-08-20T01:30:37.331 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:30:37.591 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:37.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:37 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/273104496' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-20T01:30:37.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:37 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/273104496' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-20T01:30:37.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:37 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/273104496' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-20T01:30:38.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.066+0000 7faab18ba640 1 -- 172.21.15.22:0/792202809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaac101520 msgr2=0x7faaac101900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:38.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.066+0000 7faab18ba640 1 --2- 172.21.15.22:0/792202809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaac101520 0x7faaac101900 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009900 tx=0x7faa9c02a410 comp rx=0 tx=0).stop 2024-08-20T01:30:38.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.066+0000 7faab18ba640 1 -- 172.21.15.22:0/792202809 shutdown_connections 2024-08-20T01:30:38.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.066+0000 7faab18ba640 1 --2- 172.21.15.22:0/792202809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaac10cf60 0x7faaac10f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:38.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.066+0000 7faab18ba640 1 --2- 172.21.15.22:0/792202809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaac10a630 0x7faaac10ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:38.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.066+0000 7faab18ba640 1 --2- 172.21.15.22:0/792202809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaac101520 0x7faaac101900 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:38.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.066+0000 7faab18ba640 1 -- 172.21.15.22:0/792202809 >> 172.21.15.22:0/792202809 conn(0x7faaac076c80 msgr2=0x7faaac077090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:38.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.066+0000 7faab18ba640 1 -- 172.21.15.22:0/792202809 shutdown_connections 2024-08-20T01:30:38.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.066+0000 7faab18ba640 1 -- 172.21.15.22:0/792202809 wait complete. 2024-08-20T01:30:38.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.067+0000 7faab18ba640 1 Processor -- start 2024-08-20T01:30:38.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.067+0000 7faab18ba640 1 -- start start 2024-08-20T01:30:38.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faab18ba640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaac101520 0x7faaac198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:38.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faab18ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaac10a630 0x7faaac1994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:38.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faab18ba640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaac10cf60 0x7faaac19e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:38.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faab18ba640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faaac112a60 con 0x7faaac10cf60 2024-08-20T01:30:38.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faab18ba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faaac1128e0 con 0x7faaac10a630 2024-08-20T01:30:38.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faab18ba640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faaac112be0 con 0x7faaac101520 2024-08-20T01:30:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faaab7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaac10cf60 0x7faaac19e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faaab7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaac10cf60 0x7faaac19e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48182/0 (socket says 172.21.15.22:48182) 2024-08-20T01:30:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faaab7fe640 1 -- 172.21.15.22:0/1048665895 learned_addr learned my addr 172.21.15.22:0/1048665895 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faaaaffd640 1 --2- 172.21.15.22:0/1048665895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaac101520 0x7faaac198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faaaa7fc640 1 --2- 172.21.15.22:0/1048665895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaac10a630 0x7faaac1994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faaab7fe640 1 -- 172.21.15.22:0/1048665895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaac101520 msgr2=0x7faaac198f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faaab7fe640 1 --2- 172.21.15.22:0/1048665895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaac101520 0x7faaac198f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faaab7fe640 1 -- 172.21.15.22:0/1048665895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaac10a630 msgr2=0x7faaac1994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faaab7fe640 1 --2- 172.21.15.22:0/1048665895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaac10a630 0x7faaac1994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faaab7fe640 1 -- 172.21.15.22:0/1048665895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaac19f020 con 0x7faaac10cf60 2024-08-20T01:30:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faaaa7fc640 1 --2- 172.21.15.22:0/1048665895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaac10a630 0x7faaac1994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:30:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faaab7fe640 1 --2- 172.21.15.22:0/1048665895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaac10cf60 0x7faaac19e850 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7faaa400eaa0 tx=0x7faaa400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faab08b8640 1 -- 172.21.15.22:0/1048665895 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa400cdb0 con 0x7faaac10cf60 2024-08-20T01:30:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faab08b8640 1 -- 172.21.15.22:0/1048665895 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faaa4005020 con 0x7faaac10cf60 2024-08-20T01:30:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faab18ba640 1 -- 172.21.15.22:0/1048665895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaac19f310 con 0x7faaac10cf60 2024-08-20T01:30:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faab08b8640 1 -- 172.21.15.22:0/1048665895 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa40116d0 con 0x7faaac10cf60 2024-08-20T01:30:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.068+0000 7faab18ba640 1 -- 172.21.15.22:0/1048665895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaac1a59d0 con 0x7faaac10cf60 2024-08-20T01:30:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.069+0000 7faab18ba640 1 -- 172.21.15.22:0/1048665895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaac101900 con 0x7faaac10cf60 2024-08-20T01:30:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.072+0000 7faab08b8640 1 -- 172.21.15.22:0/1048665895 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7faaa40051d0 con 0x7faaac10cf60 2024-08-20T01:30:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.072+0000 7faab08b8640 1 --2- 172.21.15.22:0/1048665895 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faa940b3ce0 0x7faa940b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.072+0000 7faaaaffd640 1 --2- 172.21.15.22:0/1048665895 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faa940b3ce0 0x7faa940b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.072+0000 7faab08b8640 1 -- 172.21.15.22:0/1048665895 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7faaa40e4310 con 0x7faaac10cf60 2024-08-20T01:30:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.073+0000 7faaaaffd640 1 --2- 172.21.15.22:0/1048665895 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faa940b3ce0 0x7faa940b61a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faa9c031440 tx=0x7faa9c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.075+0000 7faab08b8640 1 -- 172.21.15.22:0/1048665895 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7faaa4016030 con 0x7faaac10cf60 2024-08-20T01:30:38.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.297+0000 7faab18ba640 1 -- 172.21.15.22:0/1048665895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faaac19a0a0 con 0x7faaac10cf60 2024-08-20T01:30:38.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.298+0000 7faab08b8640 1 -- 172.21.15.22:0/1048665895 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11906 (secure 0 0 0) 0x7faaa40ab860 con 0x7faaac10cf60 2024-08-20T01:30:38.300 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:38.301 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"btime":"2024-08-20T01:29:18:472908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:29:18.048623+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24565,24575,24586]},"id":1}]} 2024-08-20T01:30:38.301 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 24 2024-08-20T01:30:38.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.301+0000 7faab18ba640 1 -- 172.21.15.22:0/1048665895 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faa940b3ce0 msgr2=0x7faa940b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.301+0000 7faab18ba640 1 --2- 172.21.15.22:0/1048665895 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faa940b3ce0 0x7faa940b61a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faa9c031440 tx=0x7faa9c005b50 comp rx=0 tx=0).stop 2024-08-20T01:30:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.301+0000 7faab18ba640 1 -- 172.21.15.22:0/1048665895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaac10cf60 msgr2=0x7faaac19e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.301+0000 7faab18ba640 1 --2- 172.21.15.22:0/1048665895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaac10cf60 0x7faaac19e850 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7faaa400eaa0 tx=0x7faaa400ef60 comp rx=0 tx=0).stop 2024-08-20T01:30:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.301+0000 7faab18ba640 1 -- 172.21.15.22:0/1048665895 shutdown_connections 2024-08-20T01:30:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.301+0000 7faab18ba640 1 --2- 172.21.15.22:0/1048665895 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faa940b3ce0 0x7faa940b61a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.301+0000 7faab18ba640 1 --2- 172.21.15.22:0/1048665895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaac10cf60 0x7faaac19e850 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.301+0000 7faab18ba640 1 --2- 172.21.15.22:0/1048665895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaac10a630 0x7faaac1994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.301+0000 7faab18ba640 1 --2- 172.21.15.22:0/1048665895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaac101520 0x7faaac198f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.301+0000 7faab18ba640 1 -- 172.21.15.22:0/1048665895 >> 172.21.15.22:0/1048665895 conn(0x7faaac076c80 msgr2=0x7faaac1002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.301+0000 7faab18ba640 1 -- 172.21.15.22:0/1048665895 shutdown_connections 2024-08-20T01:30:38.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:38.301+0000 7faab18ba640 1 -- 172.21.15.22:0/1048665895 wait complete. 2024-08-20T01:30:38.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:38 smithi022 ceph-mon[18709]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-20T01:30:38.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:38 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1048665895' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:38.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:38 smithi134 ceph-mon[22511]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-20T01:30:38.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:38 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1048665895' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:38.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:38 smithi077 ceph-mon[22251]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-20T01:30:38.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:38 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1048665895' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:38.956 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:30:39.215 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:39.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.675+0000 7f5a647e5640 1 -- 172.21.15.22:0/2586442661 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a5c104300 msgr2=0x7f5a5c10c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:39.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.675+0000 7f5a647e5640 1 --2- 172.21.15.22:0/2586442661 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a5c104300 0x7f5a5c10c7f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009900 tx=0x7f5a5002a410 comp rx=0 tx=0).stop 2024-08-20T01:30:39.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.675+0000 7f5a647e5640 1 -- 172.21.15.22:0/2586442661 shutdown_connections 2024-08-20T01:30:39.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.675+0000 7f5a647e5640 1 --2- 172.21.15.22:0/2586442661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c10ce40 0x7f5a5c10f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:39.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.675+0000 7f5a647e5640 1 --2- 172.21.15.22:0/2586442661 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a5c104300 0x7f5a5c10c7f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:39.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.675+0000 7f5a647e5640 1 --2- 172.21.15.22:0/2586442661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a5c1039e0 0x7f5a5c103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:39.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.675+0000 7f5a647e5640 1 -- 172.21.15.22:0/2586442661 >> 172.21.15.22:0/2586442661 conn(0x7f5a5c0fd440 msgr2=0x7f5a5c0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:39.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.675+0000 7f5a647e5640 1 -- 172.21.15.22:0/2586442661 shutdown_connections 2024-08-20T01:30:39.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.675+0000 7f5a647e5640 1 -- 172.21.15.22:0/2586442661 wait complete. 2024-08-20T01:30:39.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.676+0000 7f5a647e5640 1 Processor -- start 2024-08-20T01:30:39.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.676+0000 7f5a647e5640 1 -- start start 2024-08-20T01:30:39.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.676+0000 7f5a647e5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a5c1039e0 0x7f5a5c101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:39.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.676+0000 7f5a647e5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c104300 0x7f5a5c101bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:39.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.676+0000 7f5a647e5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a5c10ce40 0x7f5a5c102110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:39.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.676+0000 7f5a647e5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c112af0 con 0x7f5a5c1039e0 2024-08-20T01:30:39.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.676+0000 7f5a647e5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c112970 con 0x7f5a5c10ce40 2024-08-20T01:30:39.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.676+0000 7f5a647e5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c112c70 con 0x7f5a5c104300 2024-08-20T01:30:39.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.676+0000 7f5a62581640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a5c1039e0 0x7f5a5c101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:39.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.676+0000 7f5a62581640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a5c1039e0 0x7f5a5c101690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52602/0 (socket says 172.21.15.22:52602) 2024-08-20T01:30:39.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.676+0000 7f5a62581640 1 -- 172.21.15.22:0/1916039803 learned_addr learned my addr 172.21.15.22:0/1916039803 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:39.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.676+0000 7f5a62d82640 1 --2- 172.21.15.22:0/1916039803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a5c10ce40 0x7f5a5c102110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:39.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.676+0000 7f5a61d80640 1 --2- 172.21.15.22:0/1916039803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c104300 0x7f5a5c101bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.676+0000 7f5a62581640 1 -- 172.21.15.22:0/1916039803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c104300 msgr2=0x7f5a5c101bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.676+0000 7f5a62581640 1 --2- 172.21.15.22:0/1916039803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c104300 0x7f5a5c101bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.676+0000 7f5a62581640 1 -- 172.21.15.22:0/1916039803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a5c10ce40 msgr2=0x7f5a5c102110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.676+0000 7f5a62581640 1 --2- 172.21.15.22:0/1916039803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a5c10ce40 0x7f5a5c102110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.676+0000 7f5a62581640 1 -- 172.21.15.22:0/1916039803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5c1a7460 con 0x7f5a5c1039e0 2024-08-20T01:30:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.676+0000 7f5a62d82640 1 --2- 172.21.15.22:0/1916039803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a5c10ce40 0x7f5a5c102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.677+0000 7f5a62581640 1 --2- 172.21.15.22:0/1916039803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a5c1039e0 0x7f5a5c101690 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800d950 tx=0x7f5a5800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.677+0000 7f5a4f7fe640 1 -- 172.21.15.22:0/1916039803 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a58017070 con 0x7f5a5c1039e0 2024-08-20T01:30:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.677+0000 7f5a647e5640 1 -- 172.21.15.22:0/1916039803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a5c1a7750 con 0x7f5a5c1039e0 2024-08-20T01:30:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.677+0000 7f5a4f7fe640 1 -- 172.21.15.22:0/1916039803 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a58009c30 con 0x7f5a5c1039e0 2024-08-20T01:30:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.677+0000 7f5a4f7fe640 1 -- 172.21.15.22:0/1916039803 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5800f620 con 0x7f5a5c1039e0 2024-08-20T01:30:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.677+0000 7f5a647e5640 1 -- 172.21.15.22:0/1916039803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a5c1a7ce0 con 0x7f5a5c1039e0 2024-08-20T01:30:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.678+0000 7f5a647e5640 1 -- 172.21.15.22:0/1916039803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a5c103dc0 con 0x7f5a5c1039e0 2024-08-20T01:30:39.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.680+0000 7f5a4f7fe640 1 -- 172.21.15.22:0/1916039803 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f5a58010460 con 0x7f5a5c1039e0 2024-08-20T01:30:39.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.681+0000 7f5a4f7fe640 1 --2- 172.21.15.22:0/1916039803 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5a480b3c60 0x7f5a480b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:39.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.681+0000 7f5a61d80640 1 --2- 172.21.15.22:0/1916039803 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5a480b3c60 0x7f5a480b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:39.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.681+0000 7f5a4f7fe640 1 -- 172.21.15.22:0/1916039803 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f5a580e3ae0 con 0x7f5a5c1039e0 2024-08-20T01:30:39.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.681+0000 7f5a61d80640 1 --2- 172.21.15.22:0/1916039803 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5a480b3c60 0x7f5a480b6120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5a50000c00 tx=0x7f5a50031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:39.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.684+0000 7f5a4f7fe640 1 -- 172.21.15.22:0/1916039803 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f5a580aaf50 con 0x7f5a5c1039e0 2024-08-20T01:30:39.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.909+0000 7f5a647e5640 1 -- 172.21.15.22:0/1916039803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a5c102990 con 0x7f5a5c1039e0 2024-08-20T01:30:39.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.910+0000 7f5a4f7fe640 1 -- 172.21.15.22:0/1916039803 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11906 (secure 0 0 0) 0x7f5a58009de0 con 0x7f5a5c1039e0 2024-08-20T01:30:39.912 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:39.912 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"btime":"2024-08-20T01:29:18:472908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:29:18.048623+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24565,24575,24586]},"id":1}]} 2024-08-20T01:30:39.913 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 24 2024-08-20T01:30:39.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.912+0000 7f5a647e5640 1 -- 172.21.15.22:0/1916039803 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5a480b3c60 msgr2=0x7f5a480b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:39.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.912+0000 7f5a647e5640 1 --2- 172.21.15.22:0/1916039803 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5a480b3c60 0x7f5a480b6120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5a50000c00 tx=0x7f5a50031400 comp rx=0 tx=0).stop 2024-08-20T01:30:39.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.912+0000 7f5a647e5640 1 -- 172.21.15.22:0/1916039803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a5c1039e0 msgr2=0x7f5a5c101690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:39.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.912+0000 7f5a647e5640 1 --2- 172.21.15.22:0/1916039803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a5c1039e0 0x7f5a5c101690 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800d950 tx=0x7f5a5800de10 comp rx=0 tx=0).stop 2024-08-20T01:30:39.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.912+0000 7f5a647e5640 1 -- 172.21.15.22:0/1916039803 shutdown_connections 2024-08-20T01:30:39.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.912+0000 7f5a647e5640 1 --2- 172.21.15.22:0/1916039803 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5a480b3c60 0x7f5a480b6120 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:39.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.912+0000 7f5a647e5640 1 --2- 172.21.15.22:0/1916039803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a5c10ce40 0x7f5a5c102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:39.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.912+0000 7f5a647e5640 1 --2- 172.21.15.22:0/1916039803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c104300 0x7f5a5c101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:39.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.912+0000 7f5a647e5640 1 --2- 172.21.15.22:0/1916039803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a5c1039e0 0x7f5a5c101690 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:39.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.912+0000 7f5a647e5640 1 -- 172.21.15.22:0/1916039803 >> 172.21.15.22:0/1916039803 conn(0x7f5a5c0fd440 msgr2=0x7f5a5c10f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:39.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.912+0000 7f5a647e5640 1 -- 172.21.15.22:0/1916039803 shutdown_connections 2024-08-20T01:30:39.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:39.913+0000 7f5a647e5640 1 -- 172.21.15.22:0/1916039803 wait complete. 2024-08-20T01:30:40.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:40 smithi022 ceph-mon[18709]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:40.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:40 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1916039803' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:40.696 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:30:40.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:40 smithi134 ceph-mon[22511]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:40.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:40 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1916039803' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:40.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:40 smithi077 ceph-mon[22251]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:40.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:40 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1916039803' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:40.953 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:41.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.367+0000 7f7148ead640 1 -- 172.21.15.22:0/3077588754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71441039e0 msgr2=0x7f7144103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:41.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.367+0000 7f7148ead640 1 --2- 172.21.15.22:0/3077588754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71441039e0 0x7f7144103dc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7134009900 tx=0x7f713402a410 comp rx=0 tx=0).stop 2024-08-20T01:30:41.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.367+0000 7f7148ead640 1 -- 172.21.15.22:0/3077588754 shutdown_connections 2024-08-20T01:30:41.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.367+0000 7f7148ead640 1 --2- 172.21.15.22:0/3077588754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f714410ce40 0x7f714410f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:41.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.367+0000 7f7148ead640 1 --2- 172.21.15.22:0/3077588754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7144104300 0x7f714410c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:41.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.367+0000 7f7148ead640 1 --2- 172.21.15.22:0/3077588754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71441039e0 0x7f7144103dc0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:41.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.367+0000 7f7148ead640 1 -- 172.21.15.22:0/3077588754 >> 172.21.15.22:0/3077588754 conn(0x7f71440fd440 msgr2=0x7f71440ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:41.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.367+0000 7f7148ead640 1 -- 172.21.15.22:0/3077588754 shutdown_connections 2024-08-20T01:30:41.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.367+0000 7f7148ead640 1 -- 172.21.15.22:0/3077588754 wait complete. 2024-08-20T01:30:41.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.368+0000 7f7148ead640 1 Processor -- start 2024-08-20T01:30:41.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.368+0000 7f7148ead640 1 -- start start 2024-08-20T01:30:41.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.369+0000 7f7148ead640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71441039e0 0x7f7144199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:41.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.369+0000 7f7148ead640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7144104300 0x7f7144199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:41.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.369+0000 7f7148ead640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f714410ce40 0x7f714419e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:41.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.369+0000 7f7148ead640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7144112b90 con 0x7f714410ce40 2024-08-20T01:30:41.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.369+0000 7f7148ead640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7144112a10 con 0x7f7144104300 2024-08-20T01:30:41.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.369+0000 7f7148ead640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7144112d10 con 0x7f71441039e0 2024-08-20T01:30:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.369+0000 7f7142d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f714410ce40 0x7f714419e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.369+0000 7f7142d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f714410ce40 0x7f714419e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52618/0 (socket says 172.21.15.22:52618) 2024-08-20T01:30:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.369+0000 7f7142d9d640 1 -- 172.21.15.22:0/1012552169 learned_addr learned my addr 172.21.15.22:0/1012552169 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.369+0000 7f7141d9b640 1 --2- 172.21.15.22:0/1012552169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7144104300 0x7f7144199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.369+0000 7f714259c640 1 --2- 172.21.15.22:0/1012552169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71441039e0 0x7f7144199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.369+0000 7f7142d9d640 1 -- 172.21.15.22:0/1012552169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71441039e0 msgr2=0x7f7144199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.369+0000 7f7142d9d640 1 --2- 172.21.15.22:0/1012552169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71441039e0 0x7f7144199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.369+0000 7f7142d9d640 1 -- 172.21.15.22:0/1012552169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7144104300 msgr2=0x7f7144199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.369+0000 7f7142d9d640 1 --2- 172.21.15.22:0/1012552169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7144104300 0x7f7144199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.369+0000 7f7142d9d640 1 -- 172.21.15.22:0/1012552169 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714419f1b0 con 0x7f714410ce40 2024-08-20T01:30:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.369+0000 7f7142d9d640 1 --2- 172.21.15.22:0/1012552169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f714410ce40 0x7f714419e9e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f713c00b970 tx=0x7f713c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.370+0000 7f713b7fe640 1 -- 172.21.15.22:0/1012552169 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c019070 con 0x7f714410ce40 2024-08-20T01:30:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.370+0000 7f7148ead640 1 -- 172.21.15.22:0/1012552169 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f714419f4a0 con 0x7f714410ce40 2024-08-20T01:30:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.370+0000 7f713b7fe640 1 -- 172.21.15.22:0/1012552169 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f713c014440 con 0x7f714410ce40 2024-08-20T01:30:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.370+0000 7f713b7fe640 1 -- 172.21.15.22:0/1012552169 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c0075d0 con 0x7f714410ce40 2024-08-20T01:30:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.370+0000 7f7148ead640 1 -- 172.21.15.22:0/1012552169 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71441a5be0 con 0x7f714410ce40 2024-08-20T01:30:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.371+0000 7f7148ead640 1 -- 172.21.15.22:0/1012552169 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7144103e40 con 0x7f714410ce40 2024-08-20T01:30:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.372+0000 7f713b7fe640 1 -- 172.21.15.22:0/1012552169 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f713c01c070 con 0x7f714410ce40 2024-08-20T01:30:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.373+0000 7f713b7fe640 1 --2- 172.21.15.22:0/1012552169 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f71300b3c60 0x7f71300b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.373+0000 7f714259c640 1 --2- 172.21.15.22:0/1012552169 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f71300b3c60 0x7f71300b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.373+0000 7f713b7fe640 1 -- 172.21.15.22:0/1012552169 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f713c0e36e0 con 0x7f714410ce40 2024-08-20T01:30:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.373+0000 7f714259c640 1 --2- 172.21.15.22:0/1012552169 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f71300b3c60 0x7f71300b6120 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7134031440 tx=0x7f7134005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.376+0000 7f713b7fe640 1 -- 172.21.15.22:0/1012552169 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f713c0aa670 con 0x7f714410ce40 2024-08-20T01:30:41.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.562+0000 7f7148ead640 1 -- 172.21.15.22:0/1012552169 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71441a5ed0 con 0x7f714410ce40 2024-08-20T01:30:41.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.564+0000 7f713b7fe640 1 -- 172.21.15.22:0/1012552169 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22700 (secure 0 0 0) 0x7f713c0aebc0 con 0x7f714410ce40 2024-08-20T01:30:41.566 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:41.566 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":77,"fsid":"586fd06c-5e92-11ef-bccf-c7b262605968","created":"2024-08-20T01:20:55.065729+0000","modified":"2024-08-20T01:29:55.012566+0000","last_up_change":"2024-08-20T01:28:14.752931+0000","last_in_change":"2024-08-20T01:27:51.812525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:24:31.674035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:29:02.800545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:29:04.951975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b67a59af-5eea-4073-a4b2-604a1b7b8f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6803","nonce":812056903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6805","nonce":812056903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6809","nonce":812056903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6807","nonce":812056903}]},"public_addr":"172.21.15.22:6803/812056903","cluster_addr":"172.21.15.22:6805/812056903","heartbeat_back_addr":"172.21.15.22:6809/812056903","heartbeat_front_addr":"172.21.15.22:6807/812056903","state":["exists","up"]},{"osd":1,"uuid":"9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6801","nonce":823882511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6803","nonce":823882511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6807","nonce":823882511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6805","nonce":823882511}]},"public_addr":"172.21.15.77:6801/823882511","cluster_addr":"172.21.15.77:6803/823882511","heartbeat_back_addr":"172.21.15.77:6807/823882511","heartbeat_front_addr":"172.21.15.77:6805/823882511","state":["exists","up"]},{"osd":2,"uuid":"71e3c019-a3e0-4632-81a8-27ac31279f7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6801","nonce":3873702897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6803","nonce":3873702897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6807","nonce":3873702897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6805","nonce":3873702897}]},"public_addr":"172.21.15.134:6801/3873702897","cluster_addr":"172.21.15.134:6803/3873702897","heartbeat_back_addr":"172.21.15.134:6807/3873702897","heartbeat_front_addr":"172.21.15.134:6805/3873702897","state":["exists","up"]},{"osd":3,"uuid":"a60de748-aa65-477d-864e-6281db1261ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6811","nonce":1775946906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6813","nonce":1775946906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6817","nonce":1775946906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6815","nonce":1775946906}]},"public_addr":"172.21.15.22:6811/1775946906","cluster_addr":"172.21.15.22:6813/1775946906","heartbeat_back_addr":"172.21.15.22:6817/1775946906","heartbeat_front_addr":"172.21.15.22:6815/1775946906","state":["exists","up"]},{"osd":4,"uuid":"07d99671-2ece-471c-ad69-fc9043d917f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6809","nonce":1954209322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6811","nonce":1954209322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6815","nonce":1954209322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6813","nonce":1954209322}]},"public_addr":"172.21.15.77:6809/1954209322","cluster_addr":"172.21.15.77:6811/1954209322","heartbeat_back_addr":"172.21.15.77:6815/1954209322","heartbeat_front_addr":"172.21.15.77:6813/1954209322","state":["exists","up"]},{"osd":5,"uuid":"971cac33-0b98-49b1-b4b2-27354fc0ab90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6809","nonce":2805488123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6811","nonce":2805488123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6815","nonce":2805488123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6813","nonce":2805488123}]},"public_addr":"172.21.15.134:6809/2805488123","cluster_addr":"172.21.15.134:6811/2805488123","heartbeat_back_addr":"172.21.15.134:6815/2805488123","heartbeat_front_addr":"172.21.15.134:6813/2805488123","state":["exists","up"]},{"osd":6,"uuid":"48d90292-8511-47d6-8093-330bd13ae70e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6819","nonce":3804882416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6821","nonce":3804882416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6825","nonce":3804882416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6823","nonce":3804882416}]},"public_addr":"172.21.15.22:6819/3804882416","cluster_addr":"172.21.15.22:6821/3804882416","heartbeat_back_addr":"172.21.15.22:6825/3804882416","heartbeat_front_addr":"172.21.15.22:6823/3804882416","state":["exists","up"]},{"osd":7,"uuid":"e217112d-9f56-4a48-93bf-6eb052ce540a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6817","nonce":700318902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6819","nonce":700318902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6823","nonce":700318902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6821","nonce":700318902}]},"public_addr":"172.21.15.77:6817/700318902","cluster_addr":"172.21.15.77:6819/700318902","heartbeat_back_addr":"172.21.15.77:6823/700318902","heartbeat_front_addr":"172.21.15.77:6821/700318902","state":["exists","up"]},{"osd":8,"uuid":"1786747c-6ff6-4e00-bcf6-a8176215847f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6817","nonce":1635473481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6819","nonce":1635473481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6823","nonce":1635473481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6821","nonce":1635473481}]},"public_addr":"172.21.15.134:6817/1635473481","cluster_addr":"172.21.15.134:6819/1635473481","heartbeat_back_addr":"172.21.15.134:6823/1635473481","heartbeat_front_addr":"172.21.15.134:6821/1635473481","state":["exists","up"]},{"osd":9,"uuid":"708f7390-1b51-4397-a92a-8ff3f4a5bc45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6827","nonce":3899297933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6829","nonce":3899297933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6833","nonce":3899297933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6831","nonce":3899297933}]},"public_addr":"172.21.15.22:6827/3899297933","cluster_addr":"172.21.15.22:6829/3899297933","heartbeat_back_addr":"172.21.15.22:6833/3899297933","heartbeat_front_addr":"172.21.15.22:6831/3899297933","state":["exists","up"]},{"osd":10,"uuid":"d15b0acd-dd08-431d-88aa-756b6420987d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6825","nonce":2765589872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6827","nonce":2765589872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6831","nonce":2765589872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6829","nonce":2765589872}]},"public_addr":"172.21.15.77:6825/2765589872","cluster_addr":"172.21.15.77:6827/2765589872","heartbeat_back_addr":"172.21.15.77:6831/2765589872","heartbeat_front_addr":"172.21.15.77:6829/2765589872","state":["exists","up"]},{"osd":11,"uuid":"d15017fa-3c3d-4096-a35d-275cd54bb9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6825","nonce":964533669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6827","nonce":964533669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6831","nonce":964533669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6829","nonce":964533669}]},"public_addr":"172.21.15.134:6825/964533669","cluster_addr":"172.21.15.134:6827/964533669","heartbeat_back_addr":"172.21.15.134:6831/964533669","heartbeat_front_addr":"172.21.15.134:6829/964533669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:23:40.839725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:05.141389+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:28.340737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:52.028949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:17.029913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:42.092826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:07.831100+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:33.380447+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:58.772655+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:23.017208+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:47.966711+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:28:13.123047+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/416470260":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6800/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/1142422661":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:6800/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/2093308719":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/3772866379":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3424402756":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3864772624":"2024-08-21T01:21:28.981981+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:30:41.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.566+0000 7f7148ead640 1 -- 172.21.15.22:0/1012552169 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f71300b3c60 msgr2=0x7f71300b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:41.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.566+0000 7f7148ead640 1 --2- 172.21.15.22:0/1012552169 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f71300b3c60 0x7f71300b6120 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7134031440 tx=0x7f7134005e80 comp rx=0 tx=0).stop 2024-08-20T01:30:41.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.566+0000 7f7148ead640 1 -- 172.21.15.22:0/1012552169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f714410ce40 msgr2=0x7f714419e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:41.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.566+0000 7f7148ead640 1 --2- 172.21.15.22:0/1012552169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f714410ce40 0x7f714419e9e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f713c00b970 tx=0x7f713c00be30 comp rx=0 tx=0).stop 2024-08-20T01:30:41.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.566+0000 7f7148ead640 1 -- 172.21.15.22:0/1012552169 shutdown_connections 2024-08-20T01:30:41.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.566+0000 7f7148ead640 1 --2- 172.21.15.22:0/1012552169 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f71300b3c60 0x7f71300b6120 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:41.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.566+0000 7f7148ead640 1 --2- 172.21.15.22:0/1012552169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f714410ce40 0x7f714419e9e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:41.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.566+0000 7f7148ead640 1 --2- 172.21.15.22:0/1012552169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7144104300 0x7f7144199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:41.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.566+0000 7f7148ead640 1 --2- 172.21.15.22:0/1012552169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71441039e0 0x7f7144199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:41.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.566+0000 7f7148ead640 1 -- 172.21.15.22:0/1012552169 >> 172.21.15.22:0/1012552169 conn(0x7f71440fd440 msgr2=0x7f71440fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:41.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.566+0000 7f7148ead640 1 -- 172.21.15.22:0/1012552169 shutdown_connections 2024-08-20T01:30:41.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:41.566+0000 7f7148ead640 1 -- 172.21.15.22:0/1012552169 wait complete. 2024-08-20T01:30:42.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-20T01:29:07.003058+0000', 'modified': '2024-08-20T01:29:18.048623+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24586, 'mds_1': 24575, 'mds_2': 24565}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24527': {'gid': 24527, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.77:6835/1109505305', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6834', 'nonce': 1109505305}, {'type': 'v1', 'addr': '172.21.15.77:6835', 'nonce': 1109505305}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24548': {'gid': 24548, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.77:6837/259148624', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6836', 'nonce': 259148624}, {'type': 'v1', 'addr': '172.21.15.77:6837', 'nonce': 259148624}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24559': {'gid': 24559, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.134:6835/3018668202', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 3018668202}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 3018668202}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24565': {'gid': 24565, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.134:6837/2260901499', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6836', 'nonce': 2260901499}, {'type': 'v1', 'addr': '172.21.15.134:6837', 'nonce': 2260901499}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24575': {'gid': 24575, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.77:6839/49188248', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6838', 'nonce': 49188248}, {'type': 'v1', 'addr': '172.21.15.77:6839', 'nonce': 49188248}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24586': {'gid': 24586, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.134:6839/2873888279', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6838', 'nonce': 2873888279}, {'type': 'v1', 'addr': '172.21.15.134:6839', 'nonce': 2873888279}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24586, 'qdb_cluster': [24565, 24575, 24586]} 2024-08-20T01:30:42.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-20T01:30:42.389 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.c status 2024-08-20T01:30:42.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:42 smithi022 ceph-mon[18709]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-20T01:30:42.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:42 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1012552169' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:30:42.655 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:42.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:42 smithi134 ceph-mon[22511]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-20T01:30:42.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:42 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1012552169' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:30:42.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:42 smithi077 ceph-mon[22251]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-20T01:30:42.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:42 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1012552169' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:30:43.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.069+0000 7f76716b4640 1 -- 172.21.15.22:0/1229085655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f766c108e60 msgr2=0x7f766c10f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:43.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.069+0000 7f76716b4640 1 --2- 172.21.15.22:0/1229085655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f766c108e60 0x7f766c10f660 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7664009ca0 tx=0x7f766402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.069+0000 7f76716b4640 1 -- 172.21.15.22:0/1229085655 shutdown_connections 2024-08-20T01:30:43.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.069+0000 7f76716b4640 1 --2- 172.21.15.22:0/1229085655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f766c108e60 0x7f766c10f660 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.069+0000 7f76716b4640 1 --2- 172.21.15.22:0/1229085655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c1084e0 0x7f766c108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.069+0000 7f76716b4640 1 --2- 172.21.15.22:0/1229085655 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766c102ad0 0x7f766c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.069+0000 7f76716b4640 1 -- 172.21.15.22:0/1229085655 >> 172.21.15.22:0/1229085655 conn(0x7f766c0fe540 msgr2=0x7f766c100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:43.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.069+0000 7f76716b4640 1 -- 172.21.15.22:0/1229085655 shutdown_connections 2024-08-20T01:30:43.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.069+0000 7f76716b4640 1 -- 172.21.15.22:0/1229085655 wait complete. 2024-08-20T01:30:43.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.070+0000 7f76716b4640 1 Processor -- start 2024-08-20T01:30:43.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.070+0000 7f76716b4640 1 -- start start 2024-08-20T01:30:43.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.071+0000 7f76716b4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f766c102ad0 0x7f766c19b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:43.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.071+0000 7f76716b4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c1084e0 0x7f766c19b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:43.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.071+0000 7f76716b4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766c108e60 0x7f766c1a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:43.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.071+0000 7f76716b4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f766c112ae0 con 0x7f766c102ad0 2024-08-20T01:30:43.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.071+0000 7f76716b4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f766c112960 con 0x7f766c1084e0 2024-08-20T01:30:43.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.071+0000 7f76716b4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f766c112c60 con 0x7f766c108e60 2024-08-20T01:30:43.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.071+0000 7f766affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f766c102ad0 0x7f766c19b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:43.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.071+0000 7f766affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f766c102ad0 0x7f766c19b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52638/0 (socket says 172.21.15.22:52638) 2024-08-20T01:30:43.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.071+0000 7f766affd640 1 -- 172.21.15.22:0/3855839609 learned_addr learned my addr 172.21.15.22:0/3855839609 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:43.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.071+0000 7f766a7fc640 1 --2- 172.21.15.22:0/3855839609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c1084e0 0x7f766c19b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:43.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.071+0000 7f766b7fe640 1 --2- 172.21.15.22:0/3855839609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766c108e60 0x7f766c1a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:43.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.071+0000 7f766affd640 1 -- 172.21.15.22:0/3855839609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766c108e60 msgr2=0x7f766c1a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:43.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.071+0000 7f766affd640 1 --2- 172.21.15.22:0/3855839609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766c108e60 0x7f766c1a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.071+0000 7f766affd640 1 -- 172.21.15.22:0/3855839609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c1084e0 msgr2=0x7f766c19b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:43.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.071+0000 7f766affd640 1 --2- 172.21.15.22:0/3855839609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c1084e0 0x7f766c19b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.071+0000 7f766affd640 1 -- 172.21.15.22:0/3855839609 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f766c1a1260 con 0x7f766c102ad0 2024-08-20T01:30:43.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.071+0000 7f766b7fe640 1 --2- 172.21.15.22:0/3855839609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766c108e60 0x7f766c1a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:43.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.071+0000 7f766affd640 1 --2- 172.21.15.22:0/3855839609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f766c102ad0 0x7f766c19b1b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f765c00d950 tx=0x7f765c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:43.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.071+0000 7f7653fff640 1 -- 172.21.15.22:0/3855839609 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c017070 con 0x7f766c102ad0 2024-08-20T01:30:43.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.072+0000 7f76716b4640 1 -- 172.21.15.22:0/3855839609 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f766c1a1550 con 0x7f766c102ad0 2024-08-20T01:30:43.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.072+0000 7f7653fff640 1 -- 172.21.15.22:0/3855839609 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f765c009c30 con 0x7f766c102ad0 2024-08-20T01:30:43.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.072+0000 7f7653fff640 1 -- 172.21.15.22:0/3855839609 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c00f620 con 0x7f766c102ad0 2024-08-20T01:30:43.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.072+0000 7f76716b4640 1 -- 172.21.15.22:0/3855839609 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f766c1a7de0 con 0x7f766c102ad0 2024-08-20T01:30:43.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.074+0000 7f7653fff640 1 -- 172.21.15.22:0/3855839609 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f765c010460 con 0x7f766c102ad0 2024-08-20T01:30:43.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.074+0000 7f7673aad740 1 Processor -- start 2024-08-20T01:30:43.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.074+0000 7f7673aad740 1 -- start start 2024-08-20T01:30:43.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.074+0000 7f7673aad740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff921abf0 0x555ff921afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:43.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.074+0000 7f7673aad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff921b510 0x555ff9226f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:43.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.074+0000 7f7673aad740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff92274a0 0x555ff9229890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:43.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.074+0000 7f7673aad740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555ff91916a0 con 0x555ff921b510 2024-08-20T01:30:43.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.074+0000 7f7673aad740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555ff9180ba0 con 0x555ff921abf0 2024-08-20T01:30:43.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.074+0000 7f7673aad740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555ff9184be0 con 0x555ff92274a0 2024-08-20T01:30:43.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.074+0000 7f766affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff921b510 0x555ff9226f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:43.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.075+0000 7f766affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff921b510 0x555ff9226f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52650/0 (socket says 172.21.15.22:52650) 2024-08-20T01:30:43.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.075+0000 7f766affd640 1 -- 172.21.15.22:0/1328301426 learned_addr learned my addr 172.21.15.22:0/1328301426 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:43.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.075+0000 7f766b7fe640 1 --2- 172.21.15.22:0/1328301426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff921abf0 0x555ff921afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:43.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.075+0000 7f766a7fc640 1 --2- 172.21.15.22:0/1328301426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff92274a0 0x555ff9229890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:43.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.075+0000 7f766affd640 1 -- 172.21.15.22:0/1328301426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff92274a0 msgr2=0x555ff9229890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:43.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.075+0000 7f766affd640 1 --2- 172.21.15.22:0/1328301426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff92274a0 0x555ff9229890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.075+0000 7f766affd640 1 -- 172.21.15.22:0/1328301426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff921abf0 msgr2=0x555ff921afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:43.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.075+0000 7f766affd640 1 --2- 172.21.15.22:0/1328301426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff921abf0 0x555ff921afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.075+0000 7f766affd640 1 -- 172.21.15.22:0/1328301426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ff8ee0540 con 0x555ff921b510 2024-08-20T01:30:43.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.075+0000 7f7653fff640 1 --2- 172.21.15.22:0/3855839609 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f76540b3c60 0x7f76540b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:43.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.075+0000 7f766affd640 1 --2- 172.21.15.22:0/1328301426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff921b510 0x555ff9226f60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f765c0e7c50 tx=0x7f765c0ec5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca06b5c354f6b315 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:43.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.075+0000 7f766b7fe640 1 --2- 172.21.15.22:0/3855839609 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f76540b3c60 0x7f76540b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:43.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.075+0000 7f76517fa640 1 -- 172.21.15.22:0/1328301426 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c0f4020 con 0x555ff921b510 2024-08-20T01:30:43.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.075+0000 7f7653fff640 1 -- 172.21.15.22:0/3855839609 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f765c0e3a40 con 0x7f766c102ad0 2024-08-20T01:30:43.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.075+0000 7f76517fa640 1 -- 172.21.15.22:0/1328301426 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f765c0aa320 con 0x555ff921b510 2024-08-20T01:30:43.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.075+0000 7f76517fa640 1 -- 172.21.15.22:0/1328301426 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c0a66d0 con 0x555ff921b510 2024-08-20T01:30:43.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.076+0000 7f7673aad740 1 -- 172.21.15.22:0/1328301426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff921b510 msgr2=0x555ff9226f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:43.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.076+0000 7f766b7fe640 1 --2- 172.21.15.22:0/3855839609 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f76540b3c60 0x7f76540b6120 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7664004af0 tx=0x7f7664005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:43.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.076+0000 7f7673aad740 1 --2- 172.21.15.22:0/1328301426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff921b510 0x555ff9226f60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f765c0e7c50 tx=0x7f765c0ec5a0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.076+0000 7f7673aad740 1 -- 172.21.15.22:0/1328301426 shutdown_connections 2024-08-20T01:30:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.076+0000 7f7673aad740 1 --2- 172.21.15.22:0/1328301426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff92274a0 0x555ff9229890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.076+0000 7f7673aad740 1 --2- 172.21.15.22:0/1328301426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff921b510 0x555ff9226f60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.076+0000 7f7673aad740 1 --2- 172.21.15.22:0/1328301426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff921abf0 0x555ff921afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.076+0000 7f7673aad740 1 -- 172.21.15.22:0/1328301426 >> 172.21.15.22:0/1328301426 conn(0x555ff9218a20 msgr2=0x555ff9219bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.076+0000 7f7673aad740 1 -- 172.21.15.22:0/1328301426 shutdown_connections 2024-08-20T01:30:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.076+0000 7f7673aad740 1 -- 172.21.15.22:0/1328301426 wait complete. 2024-08-20T01:30:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.076+0000 7f7673aad740 1 -- start start 2024-08-20T01:30:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.077+0000 7f7673aad740 1 Processor -- start 2024-08-20T01:30:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.077+0000 7f7673aad740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff921abf0 0x555ff9224400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.077+0000 7f7673aad740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff921b510 0x555ff9224940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.077+0000 7f7673aad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff92274a0 0x555ff9224e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:43.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.077+0000 7f7673aad740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555ff8fe35f0 con 0x555ff92274a0 2024-08-20T01:30:43.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.077+0000 7f7673aad740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555ff91076c0 con 0x555ff921b510 2024-08-20T01:30:43.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.077+0000 7f7673aad740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555ff922a150 con 0x555ff921abf0 2024-08-20T01:30:43.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.077+0000 7f7673aad740 10 client.0 _ll_register_callbacks cb 0x555ff91441e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:30:43.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.077+0000 7f766b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff92274a0 0x555ff9224e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:43.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.077+0000 7f766a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff921b510 0x555ff9224940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:43.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.077+0000 7f766b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff92274a0 0x555ff9224e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52664/0 (socket says 172.21.15.22:52664) 2024-08-20T01:30:43.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.077+0000 7f766b7fe640 1 -- 172.21.15.22:0/3646504809 learned_addr learned my addr 172.21.15.22:0/3646504809 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:43.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.077+0000 7f766affd640 1 --2- 172.21.15.22:0/3646504809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff921abf0 0x555ff9224400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:43.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.077+0000 7f766b7fe640 1 -- 172.21.15.22:0/3646504809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff921abf0 msgr2=0x555ff9224400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:43.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.077+0000 7f766b7fe640 1 --2- 172.21.15.22:0/3646504809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff921abf0 0x555ff9224400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.077+0000 7f766b7fe640 1 -- 172.21.15.22:0/3646504809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff921b510 msgr2=0x555ff9224940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:43.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.077+0000 7f766b7fe640 1 --2- 172.21.15.22:0/3646504809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff921b510 0x555ff9224940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.077+0000 7f766b7fe640 1 -- 172.21.15.22:0/3646504809 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ff92334d0 con 0x555ff92274a0 2024-08-20T01:30:43.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.078+0000 7f766a7fc640 1 --2- 172.21.15.22:0/3646504809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff921b510 0x555ff9224940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:30:43.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.078+0000 7f766b7fe640 1 --2- 172.21.15.22:0/3646504809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff92274a0 0x555ff9224e80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7664005fa0 tx=0x7f766402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1badca696ed0dd0a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:43.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.078+0000 7f764eff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:30:43.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.078+0000 7f764eff5640 1 -- 172.21.15.22:0/3646504809 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7664003c40 con 0x555ff92274a0 2024-08-20T01:30:43.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.078+0000 7f7673aad740 1 -- 172.21.15.22:0/3646504809 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f765c0aa320 con 0x555ff92274a0 2024-08-20T01:30:43.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.078+0000 7f764eff5640 1 -- 172.21.15.22:0/3646504809 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f7664003de0 con 0x555ff92274a0 2024-08-20T01:30:43.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.078+0000 7f764eff5640 1 -- 172.21.15.22:0/3646504809 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7664059070 con 0x555ff92274a0 2024-08-20T01:30:43.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.078+0000 7f7673aad740 10 client.15210 fetch_fsmap learned FSMap version 24 2024-08-20T01:30:43.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.078+0000 7f7673aad740 1 -- 172.21.15.22:0/3646504809 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555ff9235e80 con 0x555ff92274a0 2024-08-20T01:30:43.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.078+0000 7f764eff5640 1 -- 172.21.15.22:0/3646504809 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f765c0aa320 con 0x555ff92274a0 2024-08-20T01:30:43.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.079+0000 7f764eff5640 1 -- 172.21.15.22:0/3646504809 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7664051020 con 0x555ff92274a0 2024-08-20T01:30:43.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.079+0000 7f7673aad740 10 client.15210 fetch_fsmap finished waiting for FSMap version 24 2024-08-20T01:30:43.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.079+0000 7f7673aad740 10 client.15210 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-20T01:30:43.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.079+0000 7f7673aad740 20 client.15210 populate_metadata read hostname 'smithi022' 2024-08-20T01:30:43.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.079+0000 7f7673aad740 1 --2- 172.21.15.22:0/3646504809 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x555ff9238560 0x555ff92399d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:43.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.079+0000 7f7673aad740 4 client.15210 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:30:43.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.079+0000 7f7673aad740 1 -- 172.21.15.22:0/3646504809 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ff91935f0 con 0x555ff9238560 2024-08-20T01:30:43.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.079+0000 7f766affd640 1 --2- 172.21.15.22:0/3646504809 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x555ff9238560 0x555ff92399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:43.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.080+0000 7f764eff5640 10 client.15210 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:30:43.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.080+0000 7f766affd640 1 --2- 172.21.15.22:0/3646504809 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x555ff9238560 0x555ff92399d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=87d0e987a9e62e86 server_cookie=aa5b0c29d58d7c6d in_seq=0 out_seq=0 2024-08-20T01:30:43.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.080+0000 7f764eff5640 1 -- 172.21.15.22:0/3646504809 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555ff91935f0 con 0x555ff9238560 2024-08-20T01:30:43.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.080+0000 7f764eff5640 10 client.15210 handle_command_reply: tid=0 2024-08-20T01:30:43.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.080+0000 7f7673aad740 1 client.15210 shutdown 2024-08-20T01:30:43.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.081+0000 7f7673aad740 1 -- 172.21.15.22:0/3646504809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff92274a0 msgr2=0x555ff9224e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:43.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.081+0000 7f7673aad740 1 --2- 172.21.15.22:0/3646504809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff92274a0 0x555ff9224e80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7664005fa0 tx=0x7f766402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.081+0000 7f7673aad740 1 -- 172.21.15.22:0/3646504809 shutdown_connections 2024-08-20T01:30:43.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.081+0000 7f7673aad740 1 --2- 172.21.15.22:0/3646504809 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x555ff9238560 0x555ff92399d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.081+0000 7f7673aad740 1 --2- 172.21.15.22:0/3646504809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff92274a0 0x555ff9224e80 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.081+0000 7f7673aad740 1 --2- 172.21.15.22:0/3646504809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff921b510 0x555ff9224940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.081+0000 7f7673aad740 1 --2- 172.21.15.22:0/3646504809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff921abf0 0x555ff9224400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.081+0000 7f7673aad740 1 -- 172.21.15.22:0/3646504809 >> 172.21.15.22:0/3646504809 conn(0x555ff9218a20 msgr2=0x555ff921e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:43.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.081+0000 7f764eff5640 0 client.15210 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:30:43.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.081+0000 7f7673aad740 1 -- 172.21.15.22:0/3646504809 shutdown_connections 2024-08-20T01:30:43.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.081+0000 7f7673aad740 1 -- 172.21.15.22:0/3646504809 wait complete. 2024-08-20T01:30:43.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.081+0000 7f7673aad740 20 client.15210 trim_cache size 0 max 16384 2024-08-20T01:30:43.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.100+0000 7f7673aad740 1 Processor -- start 2024-08-20T01:30:43.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.100+0000 7f7673aad740 1 -- start start 2024-08-20T01:30:43.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.100+0000 7f7673aad740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff921abf0 0x555ff921eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:43.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.100+0000 7f7673aad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff921b510 0x555ff9224900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:43.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.100+0000 7f7673aad740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff92274a0 0x555ff9224e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:43.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.100+0000 7f7673aad740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555ff9237d10 con 0x555ff921b510 2024-08-20T01:30:43.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.100+0000 7f7673aad740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555ff92383e0 con 0x555ff92274a0 2024-08-20T01:30:43.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.100+0000 7f7673aad740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555ff9238ab0 con 0x555ff921abf0 2024-08-20T01:30:43.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.100+0000 7f766a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff921b510 0x555ff9224900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:43.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.101+0000 7f766a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff921b510 0x555ff9224900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52670/0 (socket says 172.21.15.22:52670) 2024-08-20T01:30:43.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.101+0000 7f766a7fc640 1 -- 172.21.15.22:0/3093837112 learned_addr learned my addr 172.21.15.22:0/3093837112 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:43.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.101+0000 7f766affd640 1 --2- 172.21.15.22:0/3093837112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff921abf0 0x555ff921eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:43.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.101+0000 7f766b7fe640 1 --2- 172.21.15.22:0/3093837112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff92274a0 0x555ff9224e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:43.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.101+0000 7f766a7fc640 1 -- 172.21.15.22:0/3093837112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff921abf0 msgr2=0x555ff921eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:43.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.101+0000 7f766a7fc640 1 --2- 172.21.15.22:0/3093837112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff921abf0 0x555ff921eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.101+0000 7f766a7fc640 1 -- 172.21.15.22:0/3093837112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff92274a0 msgr2=0x555ff9224e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:43.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.101+0000 7f766a7fc640 1 --2- 172.21.15.22:0/3093837112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff92274a0 0x555ff9224e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.101+0000 7f766a7fc640 1 -- 172.21.15.22:0/3093837112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ff9218850 con 0x555ff921b510 2024-08-20T01:30:43.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.101+0000 7f766b7fe640 1 --2- 172.21.15.22:0/3093837112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff92274a0 0x555ff9224e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:30:43.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.101+0000 7f766affd640 1 --2- 172.21.15.22:0/3093837112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff921abf0 0x555ff921eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:43.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.101+0000 7f766a7fc640 1 --2- 172.21.15.22:0/3093837112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff921b510 0x555ff9224900 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f76600124b0 tx=0x7f7660005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f4d5ddce3931f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:43.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.101+0000 7f7650ff9640 1 -- 172.21.15.22:0/3093837112 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7660022070 con 0x555ff921b510 2024-08-20T01:30:43.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.101+0000 7f7650ff9640 1 -- 172.21.15.22:0/3093837112 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76600035f0 con 0x555ff921b510 2024-08-20T01:30:43.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.101+0000 7f7650ff9640 1 -- 172.21.15.22:0/3093837112 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766001d6c0 con 0x555ff921b510 2024-08-20T01:30:43.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.102+0000 7f7673aad740 1 -- 172.21.15.22:0/3093837112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff921b510 msgr2=0x555ff9224900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:43.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.102+0000 7f7673aad740 1 --2- 172.21.15.22:0/3093837112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff921b510 0x555ff9224900 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f76600124b0 tx=0x7f7660005f90 comp rx=0 tx=0).stop 2024-08-20T01:30:43.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.102+0000 7f7673aad740 1 -- 172.21.15.22:0/3093837112 shutdown_connections 2024-08-20T01:30:43.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.102+0000 7f7673aad740 1 --2- 172.21.15.22:0/3093837112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff92274a0 0x555ff9224e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.102+0000 7f7673aad740 1 --2- 172.21.15.22:0/3093837112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff921b510 0x555ff9224900 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.102+0000 7f7673aad740 1 --2- 172.21.15.22:0/3093837112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff921abf0 0x555ff921eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.102+0000 7f7673aad740 1 -- 172.21.15.22:0/3093837112 >> 172.21.15.22:0/3093837112 conn(0x555ff9218a20 msgr2=0x555ff9219b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.102+0000 7f7673aad740 1 -- 172.21.15.22:0/3093837112 shutdown_connections 2024-08-20T01:30:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.102+0000 7f7673aad740 1 -- 172.21.15.22:0/3093837112 wait complete. 2024-08-20T01:30:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.102+0000 7f7673aad740 1 -- start start 2024-08-20T01:30:43.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.102+0000 7f7673aad740 1 Processor -- start 2024-08-20T01:30:43.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f7673aad740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff921abf0 0x555ff92422c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:43.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f7673aad740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff921b510 0x555ff923aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:43.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f7673aad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff92274a0 0x555ff923af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:43.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f7673aad740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555ff9239850 con 0x555ff92274a0 2024-08-20T01:30:43.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f7673aad740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555ff9239180 con 0x555ff921abf0 2024-08-20T01:30:43.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f7673aad740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555ff9239f20 con 0x555ff921b510 2024-08-20T01:30:43.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f7673aad740 10 client.0 _ll_register_callbacks cb 0x7f7664009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:30:43.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f766b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff92274a0 0x555ff923af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:43.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f766b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff92274a0 0x555ff923af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52680/0 (socket says 172.21.15.22:52680) 2024-08-20T01:30:43.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f766b7fe640 1 -- 172.21.15.22:0/543821437 learned_addr learned my addr 172.21.15.22:0/543821437 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:43.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f766affd640 1 --2- 172.21.15.22:0/543821437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff921abf0 0x555ff92422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:43.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f766a7fc640 1 --2- 172.21.15.22:0/543821437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff921b510 0x555ff923aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:43.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f766b7fe640 1 -- 172.21.15.22:0/543821437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff921b510 msgr2=0x555ff923aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:43.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f766b7fe640 1 --2- 172.21.15.22:0/543821437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff921b510 0x555ff923aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f766b7fe640 1 -- 172.21.15.22:0/543821437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff921abf0 msgr2=0x555ff92422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:43.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f766b7fe640 1 --2- 172.21.15.22:0/543821437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff921abf0 0x555ff92422c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f766b7fe640 1 -- 172.21.15.22:0/543821437 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ff923b780 con 0x555ff92274a0 2024-08-20T01:30:43.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f766b7fe640 1 --2- 172.21.15.22:0/543821437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff92274a0 0x555ff923af50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f766402fc10 tx=0x7f766402f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d228da3a277e2ad3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:43.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f764eff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:30:43.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f764eff5640 1 -- 172.21.15.22:0/543821437 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7664063060 con 0x555ff92274a0 2024-08-20T01:30:43.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f764eff5640 1 -- 172.21.15.22:0/543821437 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f7664004d40 con 0x555ff92274a0 2024-08-20T01:30:43.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.103+0000 7f7673aad740 1 -- 172.21.15.22:0/543821437 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76600035f0 con 0x555ff92274a0 2024-08-20T01:30:43.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.104+0000 7f764eff5640 1 -- 172.21.15.22:0/543821437 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f766402fea0 con 0x555ff92274a0 2024-08-20T01:30:43.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.104+0000 7f7673aad740 10 client.15216 fetch_fsmap learned FSMap version 24 2024-08-20T01:30:43.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.104+0000 7f7673aad740 1 -- 172.21.15.22:0/543821437 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555ff92a1ba0 con 0x555ff92274a0 2024-08-20T01:30:43.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.104+0000 7f764eff5640 1 -- 172.21.15.22:0/543821437 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76600035f0 con 0x555ff92274a0 2024-08-20T01:30:43.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.104+0000 7f764eff5640 1 -- 172.21.15.22:0/543821437 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7664051070 con 0x555ff92274a0 2024-08-20T01:30:43.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.104+0000 7f7673aad740 10 client.15216 fetch_fsmap finished waiting for FSMap version 24 2024-08-20T01:30:43.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.104+0000 7f7673aad740 10 client.15216 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-20T01:30:43.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.104+0000 7f7673aad740 20 client.15216 populate_metadata read hostname 'smithi022' 2024-08-20T01:30:43.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.104+0000 7f7673aad740 1 --2- 172.21.15.22:0/543821437 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x555ff92a67e0 0x555ff92a54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:43.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.104+0000 7f7673aad740 4 client.15216 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T01:30:43.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.104+0000 7f7673aad740 1 -- 172.21.15.22:0/543821437 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "status"}) -- 0x555ff918f090 con 0x555ff92a67e0 2024-08-20T01:30:43.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.104+0000 7f766affd640 1 --2- 172.21.15.22:0/543821437 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x555ff92a67e0 0x555ff92a54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:43.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.105+0000 7f766affd640 1 --2- 172.21.15.22:0/543821437 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x555ff92a67e0 0x555ff92a54f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5107fe2d83621b5e server_cookie=989b21e67f332835 in_seq=0 out_seq=0 2024-08-20T01:30:43.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.105+0000 7f764eff5640 10 client.15216 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:30:43.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.105+0000 7f764eff5640 1 -- 172.21.15.22:0/543821437 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x555ff918f090 con 0x555ff92a67e0 2024-08-20T01:30:43.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.105+0000 7f764eff5640 10 client.15216 handle_command_reply: tid=0 2024-08-20T01:30:43.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.105+0000 7f7673aad740 1 client.15216 shutdown 2024-08-20T01:30:43.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.105+0000 7f7673aad740 1 -- 172.21.15.22:0/543821437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff92274a0 msgr2=0x555ff923af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:43.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.105+0000 7f7673aad740 1 --2- 172.21.15.22:0/543821437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff92274a0 0x555ff923af50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f766402fc10 tx=0x7f766402f700 comp rx=0 tx=0).stop 2024-08-20T01:30:43.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.105+0000 7f7673aad740 1 -- 172.21.15.22:0/543821437 shutdown_connections 2024-08-20T01:30:43.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.105+0000 7f7673aad740 1 --2- 172.21.15.22:0/543821437 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x555ff92a67e0 0x555ff92a54f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.105+0000 7f7673aad740 1 --2- 172.21.15.22:0/543821437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ff92274a0 0x555ff923af50 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.105+0000 7f7673aad740 1 --2- 172.21.15.22:0/543821437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555ff921b510 0x555ff923aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.105+0000 7f764eff5640 0 client.15216 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:30:43.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.105+0000 7f7673aad740 1 --2- 172.21.15.22:0/543821437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ff921abf0 0x555ff92422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.105+0000 7f7673aad740 1 -- 172.21.15.22:0/543821437 >> 172.21.15.22:0/543821437 conn(0x555ff9218a20 msgr2=0x555ff9225a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:43.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.105+0000 7f7673aad740 1 -- 172.21.15.22:0/543821437 shutdown_connections 2024-08-20T01:30:43.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.105+0000 7f7673aad740 1 -- 172.21.15.22:0/543821437 wait complete. 2024-08-20T01:30:43.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.105+0000 7f7673aad740 20 client.15216 trim_cache size 0 max 16384 2024-08-20T01:30:43.114 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:30:43.114 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "586fd06c-5e92-11ef-bccf-c7b262605968", 2024-08-20T01:30:43.114 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 2, 2024-08-20T01:30:43.114 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24565, 2024-08-20T01:30:43.115 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-08-20T01:30:43.115 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-08-20T01:30:43.115 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-08-20T01:30:43.115 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 87.641267772000006, 2024-08-20T01:30:43.115 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 24, 2024-08-20T01:30:43.115 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 77, 2024-08-20T01:30:43.115 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 75, 2024-08-20T01:30:43.115 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 120.705674191 2024-08-20T01:30:43.115 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:30:43.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.106+0000 7f76716b4640 1 -- 172.21.15.22:0/3855839609 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f76540b3c60 msgr2=0x7f76540b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:43.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.106+0000 7f76716b4640 1 --2- 172.21.15.22:0/3855839609 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f76540b3c60 0x7f76540b6120 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7664004af0 tx=0x7f7664005c30 comp rx=0 tx=0).stop 2024-08-20T01:30:43.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.106+0000 7f76716b4640 1 -- 172.21.15.22:0/3855839609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f766c102ad0 msgr2=0x7f766c19b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:43.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.106+0000 7f76716b4640 1 --2- 172.21.15.22:0/3855839609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f766c102ad0 0x7f766c19b1b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f765c00d950 tx=0x7f765c00de10 comp rx=0 tx=0).stop 2024-08-20T01:30:43.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.106+0000 7f76716b4640 1 -- 172.21.15.22:0/3855839609 shutdown_connections 2024-08-20T01:30:43.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.106+0000 7f76716b4640 1 --2- 172.21.15.22:0/3855839609 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f76540b3c60 0x7f76540b6120 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.106+0000 7f76716b4640 1 --2- 172.21.15.22:0/3855839609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766c108e60 0x7f766c1a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.106+0000 7f76716b4640 1 --2- 172.21.15.22:0/3855839609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c1084e0 0x7f766c19b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.106+0000 7f76716b4640 1 --2- 172.21.15.22:0/3855839609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f766c102ad0 0x7f766c19b1b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:43.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.106+0000 7f76716b4640 1 -- 172.21.15.22:0/3855839609 >> 172.21.15.22:0/3855839609 conn(0x7f766c0fe540 msgr2=0x7f766c0750e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:43.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.106+0000 7f76716b4640 1 -- 172.21.15.22:0/3855839609 shutdown_connections 2024-08-20T01:30:43.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:43.106+0000 7f76716b4640 1 -- 172.21.15.22:0/3855839609 wait complete. 2024-08-20T01:30:43.754 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.b status 2024-08-20T01:30:44.019 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:44.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.487+0000 7fd101af2640 1 -- 172.21.15.22:0/176009534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0fc102ad0 msgr2=0x7fd0fc102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:44.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.487+0000 7fd101af2640 1 --2- 172.21.15.22:0/176009534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0fc102ad0 0x7fd0fc102eb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009900 tx=0x7fd0ec02a410 comp rx=0 tx=0).stop 2024-08-20T01:30:44.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.487+0000 7fd101af2640 1 -- 172.21.15.22:0/176009534 shutdown_connections 2024-08-20T01:30:44.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.487+0000 7fd101af2640 1 --2- 172.21.15.22:0/176009534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0fc108e60 0x7fd0fc10f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.487+0000 7fd101af2640 1 --2- 172.21.15.22:0/176009534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0fc1084e0 0x7fd0fc108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.487+0000 7fd101af2640 1 --2- 172.21.15.22:0/176009534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0fc102ad0 0x7fd0fc102eb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.487+0000 7fd101af2640 1 -- 172.21.15.22:0/176009534 >> 172.21.15.22:0/176009534 conn(0x7fd0fc0fe540 msgr2=0x7fd0fc100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:44.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.487+0000 7fd101af2640 1 -- 172.21.15.22:0/176009534 shutdown_connections 2024-08-20T01:30:44.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.487+0000 7fd101af2640 1 -- 172.21.15.22:0/176009534 wait complete. 2024-08-20T01:30:44.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.488+0000 7fd101af2640 1 Processor -- start 2024-08-20T01:30:44.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.488+0000 7fd101af2640 1 -- start start 2024-08-20T01:30:44.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.488+0000 7fd101af2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0fc102ad0 0x7fd0fc198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:44.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.488+0000 7fd101af2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0fc1084e0 0x7fd0fc1994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:44.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.488+0000 7fd101af2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0fc108e60 0x7fd0fc19e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:44.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.488+0000 7fd101af2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc112b20 con 0x7fd0fc1084e0 2024-08-20T01:30:44.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.488+0000 7fd101af2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc1129a0 con 0x7fd0fc108e60 2024-08-20T01:30:44.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.488+0000 7fd101af2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc112ca0 con 0x7fd0fc102ad0 2024-08-20T01:30:44.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.488+0000 7fd0f2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0fc1084e0 0x7fd0fc1994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:44.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.488+0000 7fd0f2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0fc1084e0 0x7fd0fc1994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52698/0 (socket says 172.21.15.22:52698) 2024-08-20T01:30:44.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.488+0000 7fd0f2ffd640 1 -- 172.21.15.22:0/292609708 learned_addr learned my addr 172.21.15.22:0/292609708 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:44.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.488+0000 7fd0fb7fe640 1 --2- 172.21.15.22:0/292609708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0fc102ad0 0x7fd0fc198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:44.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.489+0000 7fd0fbfff640 1 --2- 172.21.15.22:0/292609708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0fc108e60 0x7fd0fc19e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:44.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.489+0000 7fd0f2ffd640 1 -- 172.21.15.22:0/292609708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0fc102ad0 msgr2=0x7fd0fc198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:44.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.489+0000 7fd0f2ffd640 1 --2- 172.21.15.22:0/292609708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0fc102ad0 0x7fd0fc198fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.489+0000 7fd0f2ffd640 1 -- 172.21.15.22:0/292609708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0fc108e60 msgr2=0x7fd0fc19e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:44.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.489+0000 7fd0f2ffd640 1 --2- 172.21.15.22:0/292609708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0fc108e60 0x7fd0fc19e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.489+0000 7fd0f2ffd640 1 -- 172.21.15.22:0/292609708 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0fc19f060 con 0x7fd0fc1084e0 2024-08-20T01:30:44.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.489+0000 7fd0fbfff640 1 --2- 172.21.15.22:0/292609708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0fc108e60 0x7fd0fc19e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:44.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.489+0000 7fd0f2ffd640 1 --2- 172.21.15.22:0/292609708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0fc1084e0 0x7fd0fc1994f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd0e400c890 tx=0x7fd0e400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:44.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.489+0000 7fd0f97fa640 1 -- 172.21.15.22:0/292609708 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4004220 con 0x7fd0fc1084e0 2024-08-20T01:30:44.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.489+0000 7fd0f97fa640 1 -- 172.21.15.22:0/292609708 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0e40043c0 con 0x7fd0fc1084e0 2024-08-20T01:30:44.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.489+0000 7fd101af2640 1 -- 172.21.15.22:0/292609708 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0fc19f350 con 0x7fd0fc1084e0 2024-08-20T01:30:44.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.489+0000 7fd0f97fa640 1 -- 172.21.15.22:0/292609708 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4004a00 con 0x7fd0fc1084e0 2024-08-20T01:30:44.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.489+0000 7fd101af2640 1 -- 172.21.15.22:0/292609708 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0fc1a5a10 con 0x7fd0fc1084e0 2024-08-20T01:30:44.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.491+0000 7fd103eeb740 1 Processor -- start 2024-08-20T01:30:44.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd103eeb740 1 -- start start 2024-08-20T01:30:44.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd0f97fa640 1 -- 172.21.15.22:0/292609708 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fd0e40079b0 con 0x7fd0fc1084e0 2024-08-20T01:30:44.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd103eeb740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddb90bf0 0x55b5ddb90fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:44.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd103eeb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb91510 0x55b5ddba1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:44.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd103eeb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddba18b0 0x55b5ddba3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:44.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd103eeb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b5ddb076a0 con 0x55b5ddb91510 2024-08-20T01:30:44.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd103eeb740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b5ddaf6ba0 con 0x55b5ddb90bf0 2024-08-20T01:30:44.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd103eeb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b5ddafabe0 con 0x55b5ddba18b0 2024-08-20T01:30:44.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd0fb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb91510 0x55b5ddba1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:44.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd0fb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb91510 0x55b5ddba1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52710/0 (socket says 172.21.15.22:52710) 2024-08-20T01:30:44.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd0fb7fe640 1 -- 172.21.15.22:0/2487446315 learned_addr learned my addr 172.21.15.22:0/2487446315 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:44.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd0fbfff640 1 --2- 172.21.15.22:0/2487446315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddb90bf0 0x55b5ddb90fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:44.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd0f2ffd640 1 --2- 172.21.15.22:0/2487446315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddba18b0 0x55b5ddba3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:44.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd0fb7fe640 1 -- 172.21.15.22:0/2487446315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddba18b0 msgr2=0x55b5ddba3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:44.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd0fb7fe640 1 --2- 172.21.15.22:0/2487446315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddba18b0 0x55b5ddba3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd0fb7fe640 1 -- 172.21.15.22:0/2487446315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddb90bf0 msgr2=0x55b5ddb90fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:44.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd0fb7fe640 1 --2- 172.21.15.22:0/2487446315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddb90bf0 0x55b5ddb90fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd0fb7fe640 1 -- 172.21.15.22:0/2487446315 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5dd856540 con 0x55b5ddb91510 2024-08-20T01:30:44.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd0f2ffd640 1 --2- 172.21.15.22:0/2487446315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddba18b0 0x55b5ddba3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:30:44.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.492+0000 7fd0fb7fe640 1 --2- 172.21.15.22:0/2487446315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb91510 0x55b5ddba1370 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009900 tx=0x7fd0ec031de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730a360c7a9dc35c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:44.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.493+0000 7fd0f1ffb640 1 -- 172.21.15.22:0/2487446315 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec040070 con 0x55b5ddb91510 2024-08-20T01:30:44.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.493+0000 7fd0f1ffb640 1 -- 172.21.15.22:0/2487446315 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0ec0316a0 con 0x55b5ddb91510 2024-08-20T01:30:44.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.493+0000 7fd0f1ffb640 1 -- 172.21.15.22:0/2487446315 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec035040 con 0x55b5ddb91510 2024-08-20T01:30:44.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.493+0000 7fd0f97fa640 1 --2- 172.21.15.22:0/292609708 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd0e80b3c60 0x7fd0e80b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:44.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.493+0000 7fd0fbfff640 1 --2- 172.21.15.22:0/292609708 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd0e80b3c60 0x7fd0e80b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:44.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.493+0000 7fd0f97fa640 1 -- 172.21.15.22:0/292609708 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7fd0e40e3b20 con 0x7fd0fc1084e0 2024-08-20T01:30:44.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.493+0000 7fd103eeb740 1 -- 172.21.15.22:0/2487446315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb91510 msgr2=0x55b5ddba1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:44.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.493+0000 7fd0fbfff640 1 --2- 172.21.15.22:0/292609708 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd0e80b3c60 0x7fd0e80b6120 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4007f10 tx=0x7fd0f40076a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:44.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.493+0000 7fd103eeb740 1 --2- 172.21.15.22:0/2487446315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb91510 0x55b5ddba1370 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009900 tx=0x7fd0ec031de0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.493+0000 7fd103eeb740 1 -- 172.21.15.22:0/2487446315 shutdown_connections 2024-08-20T01:30:44.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.493+0000 7fd103eeb740 1 --2- 172.21.15.22:0/2487446315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddba18b0 0x55b5ddba3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.493+0000 7fd103eeb740 1 --2- 172.21.15.22:0/2487446315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb91510 0x55b5ddba1370 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.493+0000 7fd103eeb740 1 --2- 172.21.15.22:0/2487446315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddb90bf0 0x55b5ddb90fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.494+0000 7fd103eeb740 1 -- 172.21.15.22:0/2487446315 >> 172.21.15.22:0/2487446315 conn(0x55b5ddb8ea20 msgr2=0x55b5ddb8fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:44.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.494+0000 7fd103eeb740 1 -- 172.21.15.22:0/2487446315 shutdown_connections 2024-08-20T01:30:44.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.494+0000 7fd103eeb740 1 -- 172.21.15.22:0/2487446315 wait complete. 2024-08-20T01:30:44.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.494+0000 7fd103eeb740 1 -- start start 2024-08-20T01:30:44.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.494+0000 7fd103eeb740 1 Processor -- start 2024-08-20T01:30:44.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.494+0000 7fd103eeb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddb90bf0 0x55b5ddb9e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:44.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.494+0000 7fd103eeb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb91510 0x55b5ddb9ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:44.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.494+0000 7fd103eeb740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddba18b0 0x55b5ddb9f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:44.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.494+0000 7fd103eeb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b5dd9595f0 con 0x55b5ddb91510 2024-08-20T01:30:44.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.494+0000 7fd103eeb740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b5dda7d6c0 con 0x55b5ddba18b0 2024-08-20T01:30:44.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.494+0000 7fd103eeb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b5ddba44d0 con 0x55b5ddb90bf0 2024-08-20T01:30:44.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.494+0000 7fd103eeb740 10 client.0 _ll_register_callbacks cb 0x55b5ddaba1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:30:44.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.495+0000 7fd0f2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb91510 0x55b5ddb9ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:44.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.495+0000 7fd0f2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb91510 0x55b5ddb9ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52718/0 (socket says 172.21.15.22:52718) 2024-08-20T01:30:44.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.495+0000 7fd0f2ffd640 1 -- 172.21.15.22:0/3768385368 learned_addr learned my addr 172.21.15.22:0/3768385368 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:44.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.495+0000 7fd0fbfff640 1 --2- 172.21.15.22:0/3768385368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddba18b0 0x55b5ddb9f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:44.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.495+0000 7fd0fb7fe640 1 --2- 172.21.15.22:0/3768385368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddb90bf0 0x55b5ddb9e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:44.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.495+0000 7fd0f2ffd640 1 -- 172.21.15.22:0/3768385368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddb90bf0 msgr2=0x55b5ddb9e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:44.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.495+0000 7fd0f2ffd640 1 --2- 172.21.15.22:0/3768385368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddb90bf0 0x55b5ddb9e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.495+0000 7fd0f2ffd640 1 -- 172.21.15.22:0/3768385368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddba18b0 msgr2=0x55b5ddb9f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:44.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.495+0000 7fd0f2ffd640 1 --2- 172.21.15.22:0/3768385368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddba18b0 0x55b5ddb9f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.495+0000 7fd0f2ffd640 1 -- 172.21.15.22:0/3768385368 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5ddbad890 con 0x55b5ddb91510 2024-08-20T01:30:44.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.495+0000 7fd0fbfff640 1 --2- 172.21.15.22:0/3768385368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddba18b0 0x55b5ddb9f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:30:44.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.495+0000 7fd0f2ffd640 1 --2- 172.21.15.22:0/3768385368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb91510 0x55b5ddb9ed30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40a6970 tx=0x7fd0e40e1930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be87518651eb70b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:44.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.495+0000 7fd0daffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:30:44.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.495+0000 7fd0daffd640 1 -- 172.21.15.22:0/3768385368 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e401d040 con 0x55b5ddb91510 2024-08-20T01:30:44.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.495+0000 7fd0daffd640 1 -- 172.21.15.22:0/3768385368 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7fd0e4007ca0 con 0x55b5ddb91510 2024-08-20T01:30:44.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.495+0000 7fd103eeb740 1 -- 172.21.15.22:0/3768385368 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0ec0316a0 con 0x55b5ddb91510 2024-08-20T01:30:44.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.495+0000 7fd0daffd640 1 -- 172.21.15.22:0/3768385368 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd0e40aa400 con 0x55b5ddb91510 2024-08-20T01:30:44.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.495+0000 7fd103eeb740 10 client.15228 fetch_fsmap learned FSMap version 24 2024-08-20T01:30:44.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.495+0000 7fd103eeb740 1 -- 172.21.15.22:0/3768385368 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b5ddbb01b0 con 0x55b5ddb91510 2024-08-20T01:30:44.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.496+0000 7fd0daffd640 1 -- 172.21.15.22:0/3768385368 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0ec0316a0 con 0x55b5ddb91510 2024-08-20T01:30:44.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.496+0000 7fd0daffd640 1 -- 172.21.15.22:0/3768385368 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd0e40a6260 con 0x55b5ddb91510 2024-08-20T01:30:44.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.496+0000 7fd103eeb740 10 client.15228 fetch_fsmap finished waiting for FSMap version 24 2024-08-20T01:30:44.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.496+0000 7fd103eeb740 10 client.15228 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-20T01:30:44.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.496+0000 7fd103eeb740 20 client.15228 populate_metadata read hostname 'smithi022' 2024-08-20T01:30:44.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.496+0000 7fd103eeb740 1 --2- 172.21.15.22:0/3768385368 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55b5ddbb2730 0x55b5ddbb3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:44.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.496+0000 7fd103eeb740 4 client.15228 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:30:44.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.496+0000 7fd103eeb740 1 -- 172.21.15.22:0/3768385368 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5ddb095f0 con 0x55b5ddbb2730 2024-08-20T01:30:44.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.496+0000 7fd0fb7fe640 1 --2- 172.21.15.22:0/3768385368 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55b5ddbb2730 0x55b5ddbb3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:44.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.497+0000 7fd0fb7fe640 1 --2- 172.21.15.22:0/3768385368 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55b5ddbb2730 0x55b5ddbb3ba0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3b9fa3336ca947d8 server_cookie=c44756813de764c in_seq=0 out_seq=0 2024-08-20T01:30:44.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.497+0000 7fd0daffd640 10 client.15228 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:30:44.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.497+0000 7fd0daffd640 1 -- 172.21.15.22:0/3768385368 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5ddb095f0 con 0x55b5ddbb2730 2024-08-20T01:30:44.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.497+0000 7fd0daffd640 10 client.15228 handle_command_reply: tid=0 2024-08-20T01:30:44.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.497+0000 7fd103eeb740 1 client.15228 shutdown 2024-08-20T01:30:44.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.497+0000 7fd103eeb740 1 -- 172.21.15.22:0/3768385368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb91510 msgr2=0x55b5ddb9ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:44.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.497+0000 7fd103eeb740 1 --2- 172.21.15.22:0/3768385368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb91510 0x55b5ddb9ed30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40a6970 tx=0x7fd0e40e1930 comp rx=0 tx=0).stop 2024-08-20T01:30:44.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.498+0000 7fd103eeb740 1 -- 172.21.15.22:0/3768385368 shutdown_connections 2024-08-20T01:30:44.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.498+0000 7fd103eeb740 1 --2- 172.21.15.22:0/3768385368 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55b5ddbb2730 0x55b5ddbb3ba0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.498+0000 7fd103eeb740 1 --2- 172.21.15.22:0/3768385368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddba18b0 0x55b5ddb9f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.498+0000 7fd103eeb740 1 --2- 172.21.15.22:0/3768385368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb91510 0x55b5ddb9ed30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.498+0000 7fd0daffd640 0 client.15228 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:30:44.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.498+0000 7fd103eeb740 1 --2- 172.21.15.22:0/3768385368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddb90bf0 0x55b5ddb9e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.498+0000 7fd103eeb740 1 -- 172.21.15.22:0/3768385368 >> 172.21.15.22:0/3768385368 conn(0x55b5ddb8ea20 msgr2=0x55b5ddb945c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:44.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.498+0000 7fd103eeb740 1 -- 172.21.15.22:0/3768385368 shutdown_connections 2024-08-20T01:30:44.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.498+0000 7fd103eeb740 1 -- 172.21.15.22:0/3768385368 wait complete. 2024-08-20T01:30:44.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.498+0000 7fd103eeb740 20 client.15228 trim_cache size 0 max 16384 2024-08-20T01:30:44.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.516+0000 7fd103eeb740 1 Processor -- start 2024-08-20T01:30:44.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.516+0000 7fd103eeb740 1 -- start start 2024-08-20T01:30:44.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.516+0000 7fd103eeb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb90bf0 0x55b5ddb9c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:44.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.516+0000 7fd103eeb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddb91510 0x55b5ddba38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:44.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.516+0000 7fd103eeb740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddba18b0 0x55b5ddb8f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:44.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.516+0000 7fd103eeb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b5ddbb1ee0 con 0x55b5ddb90bf0 2024-08-20T01:30:44.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.516+0000 7fd103eeb740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b5ddbb25b0 con 0x55b5ddba18b0 2024-08-20T01:30:44.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.516+0000 7fd103eeb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b5ddbb2c80 con 0x55b5ddb91510 2024-08-20T01:30:44.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.516+0000 7fd0fb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb90bf0 0x55b5ddb9c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:44.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.516+0000 7fd0fb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb90bf0 0x55b5ddb9c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52720/0 (socket says 172.21.15.22:52720) 2024-08-20T01:30:44.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.516+0000 7fd0fb7fe640 1 -- 172.21.15.22:0/610808805 learned_addr learned my addr 172.21.15.22:0/610808805 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:44.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.516+0000 7fd0f2ffd640 1 --2- 172.21.15.22:0/610808805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddb91510 0x55b5ddba38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.516+0000 7fd0fbfff640 1 --2- 172.21.15.22:0/610808805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddba18b0 0x55b5ddb8f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.517+0000 7fd0fb7fe640 1 -- 172.21.15.22:0/610808805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddb91510 msgr2=0x55b5ddba38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.517+0000 7fd0fb7fe640 1 --2- 172.21.15.22:0/610808805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddb91510 0x55b5ddba38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.517+0000 7fd0fb7fe640 1 -- 172.21.15.22:0/610808805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddba18b0 msgr2=0x55b5ddb8f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.517+0000 7fd0fb7fe640 1 --2- 172.21.15.22:0/610808805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddba18b0 0x55b5ddb8f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.517+0000 7fd0fb7fe640 1 -- 172.21.15.22:0/610808805 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5ddba0ed0 con 0x55b5ddb90bf0 2024-08-20T01:30:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.517+0000 7fd0fb7fe640 1 --2- 172.21.15.22:0/610808805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb90bf0 0x55b5ddb9c340 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009900 tx=0x7fd0ec031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91387f85e3e3f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.517+0000 7fd0f17fa640 1 -- 172.21.15.22:0/610808805 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec040040 con 0x55b5ddb90bf0 2024-08-20T01:30:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.517+0000 7fd0f17fa640 1 -- 172.21.15.22:0/610808805 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0ec0035f0 con 0x55b5ddb90bf0 2024-08-20T01:30:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.517+0000 7fd0f17fa640 1 -- 172.21.15.22:0/610808805 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec035040 con 0x55b5ddb90bf0 2024-08-20T01:30:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.518+0000 7fd103eeb740 1 -- 172.21.15.22:0/610808805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb90bf0 msgr2=0x55b5ddb9c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.518+0000 7fd103eeb740 1 --2- 172.21.15.22:0/610808805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb90bf0 0x55b5ddb9c340 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009900 tx=0x7fd0ec031400 comp rx=0 tx=0).stop 2024-08-20T01:30:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.518+0000 7fd103eeb740 1 -- 172.21.15.22:0/610808805 shutdown_connections 2024-08-20T01:30:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.518+0000 7fd103eeb740 1 --2- 172.21.15.22:0/610808805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddba18b0 0x55b5ddb8f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.518+0000 7fd103eeb740 1 --2- 172.21.15.22:0/610808805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddb91510 0x55b5ddba38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.518+0000 7fd103eeb740 1 --2- 172.21.15.22:0/610808805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddb90bf0 0x55b5ddb9c340 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.518+0000 7fd103eeb740 1 -- 172.21.15.22:0/610808805 >> 172.21.15.22:0/610808805 conn(0x55b5ddb8ea20 msgr2=0x55b5ddbb15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.518+0000 7fd103eeb740 1 -- 172.21.15.22:0/610808805 shutdown_connections 2024-08-20T01:30:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.518+0000 7fd103eeb740 1 -- 172.21.15.22:0/610808805 wait complete. 2024-08-20T01:30:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.518+0000 7fd103eeb740 1 -- start start 2024-08-20T01:30:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.518+0000 7fd103eeb740 1 Processor -- start 2024-08-20T01:30:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.518+0000 7fd103eeb740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddb90bf0 0x55b5ddbbc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd103eeb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddb91510 0x55b5ddbb9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd103eeb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddba18b0 0x55b5ddbba440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd103eeb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b5ddbb3a20 con 0x55b5ddba18b0 2024-08-20T01:30:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd103eeb740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b5ddbb3350 con 0x55b5ddb90bf0 2024-08-20T01:30:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd103eeb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b5ddbb40f0 con 0x55b5ddb91510 2024-08-20T01:30:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd103eeb740 10 client.0 _ll_register_callbacks cb 0x7fd0e4004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:30:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd0fbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddba18b0 0x55b5ddbba440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd0fb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddb90bf0 0x55b5ddbbc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd0fbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddba18b0 0x55b5ddbba440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52730/0 (socket says 172.21.15.22:52730) 2024-08-20T01:30:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd0fbfff640 1 -- 172.21.15.22:0/313495905 learned_addr learned my addr 172.21.15.22:0/313495905 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd0f2ffd640 1 --2- 172.21.15.22:0/313495905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddb91510 0x55b5ddbb9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd0fb7fe640 1 -- 172.21.15.22:0/313495905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddb91510 msgr2=0x55b5ddbb9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd0fb7fe640 1 --2- 172.21.15.22:0/313495905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddb91510 0x55b5ddbb9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd0fb7fe640 1 -- 172.21.15.22:0/313495905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddba18b0 msgr2=0x55b5ddbba440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd0fb7fe640 1 --2- 172.21.15.22:0/313495905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddba18b0 0x55b5ddbba440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd0fb7fe640 1 -- 172.21.15.22:0/313495905 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5ddbbabb0 con 0x55b5ddb90bf0 2024-08-20T01:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd0fbfff640 1 --2- 172.21.15.22:0/313495905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddba18b0 0x55b5ddbba440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd0fb7fe640 1 --2- 172.21.15.22:0/313495905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddb90bf0 0x55b5ddbbc450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec050ff0 tx=0x7fd0ec005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61c1b00ddf1578eb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd0daffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd0daffd640 1 -- 172.21.15.22:0/313495905 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec05c060 con 0x55b5ddb90bf0 2024-08-20T01:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd103eeb740 1 -- 172.21.15.22:0/313495905 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0ec0035f0 con 0x55b5ddb90bf0 2024-08-20T01:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.519+0000 7fd0daffd640 1 -- 172.21.15.22:0/313495905 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7fd0ec0047a0 con 0x55b5ddb90bf0 2024-08-20T01:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.520+0000 7fd0daffd640 1 -- 172.21.15.22:0/313495905 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd0ec040030 con 0x55b5ddb90bf0 2024-08-20T01:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.520+0000 7fd103eeb740 10 client.24923 fetch_fsmap learned FSMap version 24 2024-08-20T01:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.520+0000 7fd103eeb740 1 -- 172.21.15.22:0/313495905 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b5ddc1bdd0 con 0x55b5ddb90bf0 2024-08-20T01:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.520+0000 7fd0daffd640 1 -- 172.21.15.22:0/313495905 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0ec0035f0 con 0x55b5ddb90bf0 2024-08-20T01:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.520+0000 7fd0daffd640 1 -- 172.21.15.22:0/313495905 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd0ec04d070 con 0x55b5ddb90bf0 2024-08-20T01:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.520+0000 7fd103eeb740 10 client.24923 fetch_fsmap finished waiting for FSMap version 24 2024-08-20T01:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.520+0000 7fd103eeb740 10 client.24923 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-20T01:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.520+0000 7fd103eeb740 20 client.24923 populate_metadata read hostname 'smithi022' 2024-08-20T01:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.520+0000 7fd103eeb740 1 --2- 172.21.15.22:0/313495905 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55b5ddc20280 0x55b5ddc1ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.520+0000 7fd103eeb740 4 client.24923 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T01:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.520+0000 7fd103eeb740 1 -- 172.21.15.22:0/313495905 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "status"}) -- 0x55b5ddb05090 con 0x55b5ddc20280 2024-08-20T01:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.520+0000 7fd0f2ffd640 1 --2- 172.21.15.22:0/313495905 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55b5ddc20280 0x55b5ddc1ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.521+0000 7fd0daffd640 10 client.24923 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.521+0000 7fd0f2ffd640 1 --2- 172.21.15.22:0/313495905 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55b5ddc20280 0x55b5ddc1ef90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d7fea140bc224dd6 server_cookie=ec3af4b47446de20 in_seq=0 out_seq=0 2024-08-20T01:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.521+0000 7fd0daffd640 1 -- 172.21.15.22:0/313495905 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55b5ddb05090 con 0x55b5ddc20280 2024-08-20T01:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.521+0000 7fd0daffd640 10 client.24923 handle_command_reply: tid=0 2024-08-20T01:30:44.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.521+0000 7fd103eeb740 1 client.24923 shutdown 2024-08-20T01:30:44.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.521+0000 7fd103eeb740 1 -- 172.21.15.22:0/313495905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddb90bf0 msgr2=0x55b5ddbbc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:44.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.521+0000 7fd103eeb740 1 --2- 172.21.15.22:0/313495905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddb90bf0 0x55b5ddbbc450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec050ff0 tx=0x7fd0ec005e80 comp rx=0 tx=0).stop 2024-08-20T01:30:44.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.521+0000 7fd103eeb740 1 -- 172.21.15.22:0/313495905 shutdown_connections 2024-08-20T01:30:44.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.521+0000 7fd103eeb740 1 --2- 172.21.15.22:0/313495905 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55b5ddc20280 0x55b5ddc1ef90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.521+0000 7fd103eeb740 1 --2- 172.21.15.22:0/313495905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5ddba18b0 0x55b5ddbba440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.521+0000 7fd103eeb740 1 --2- 172.21.15.22:0/313495905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b5ddb91510 0x55b5ddbb9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.521+0000 7fd0daffd640 0 client.24923 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:30:44.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.521+0000 7fd103eeb740 1 --2- 172.21.15.22:0/313495905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5ddb90bf0 0x55b5ddbbc450 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.521+0000 7fd103eeb740 1 -- 172.21.15.22:0/313495905 >> 172.21.15.22:0/313495905 conn(0x55b5ddb8ea20 msgr2=0x55b5ddb8f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:44.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.521+0000 7fd103eeb740 1 -- 172.21.15.22:0/313495905 shutdown_connections 2024-08-20T01:30:44.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.521+0000 7fd103eeb740 1 -- 172.21.15.22:0/313495905 wait complete. 2024-08-20T01:30:44.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.521+0000 7fd103eeb740 20 client.24923 trim_cache size 0 max 16384 2024-08-20T01:30:44.536 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:30:44.536 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "586fd06c-5e92-11ef-bccf-c7b262605968", 2024-08-20T01:30:44.536 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 1, 2024-08-20T01:30:44.536 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24575, 2024-08-20T01:30:44.536 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-08-20T01:30:44.536 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-08-20T01:30:44.536 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-08-20T01:30:44.536 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 90.068171784, 2024-08-20T01:30:44.536 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 24, 2024-08-20T01:30:44.536 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 77, 2024-08-20T01:30:44.536 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 75, 2024-08-20T01:30:44.537 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 108.476938816 2024-08-20T01:30:44.537 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:30:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.522+0000 7fd101af2640 1 -- 172.21.15.22:0/292609708 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd0e80b3c60 msgr2=0x7fd0e80b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.522+0000 7fd101af2640 1 --2- 172.21.15.22:0/292609708 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd0e80b3c60 0x7fd0e80b6120 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4007f10 tx=0x7fd0f40076a0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.522+0000 7fd101af2640 1 -- 172.21.15.22:0/292609708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0fc1084e0 msgr2=0x7fd0fc1994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.522+0000 7fd101af2640 1 --2- 172.21.15.22:0/292609708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0fc1084e0 0x7fd0fc1994f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd0e400c890 tx=0x7fd0e400cd50 comp rx=0 tx=0).stop 2024-08-20T01:30:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.522+0000 7fd101af2640 1 -- 172.21.15.22:0/292609708 shutdown_connections 2024-08-20T01:30:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.522+0000 7fd101af2640 1 --2- 172.21.15.22:0/292609708 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd0e80b3c60 0x7fd0e80b6120 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.522+0000 7fd101af2640 1 --2- 172.21.15.22:0/292609708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0fc108e60 0x7fd0fc19e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.522+0000 7fd101af2640 1 --2- 172.21.15.22:0/292609708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0fc1084e0 0x7fd0fc1994f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.522+0000 7fd101af2640 1 --2- 172.21.15.22:0/292609708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0fc102ad0 0x7fd0fc198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.522+0000 7fd101af2640 1 -- 172.21.15.22:0/292609708 >> 172.21.15.22:0/292609708 conn(0x7fd0fc0fe540 msgr2=0x7fd0fc0ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.522+0000 7fd101af2640 1 -- 172.21.15.22:0/292609708 shutdown_connections 2024-08-20T01:30:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:44.522+0000 7fd101af2640 1 -- 172.21.15.22:0/292609708 wait complete. 2024-08-20T01:30:44.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:44 smithi134 ceph-mon[22511]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:44.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:44 smithi077 ceph-mon[22251]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:44.877 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:44 smithi022 ceph-mon[18709]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:45.344 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.i status 2024-08-20T01:30:45.610 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:46.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.099+0000 7f9e3f66c640 1 -- 172.21.15.22:0/2624855154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e38104290 msgr2=0x7f9e3810c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:46.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.099+0000 7f9e3f66c640 1 --2- 172.21.15.22:0/2624855154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e38104290 0x7f9e3810c870 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009900 tx=0x7f9e2802a410 comp rx=0 tx=0).stop 2024-08-20T01:30:46.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.099+0000 7f9e3f66c640 1 -- 172.21.15.22:0/2624855154 shutdown_connections 2024-08-20T01:30:46.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.099+0000 7f9e3f66c640 1 --2- 172.21.15.22:0/2624855154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e3810ce40 0x7f9e3810f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.099+0000 7f9e3f66c640 1 --2- 172.21.15.22:0/2624855154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e38104290 0x7f9e3810c870 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.099+0000 7f9e3f66c640 1 --2- 172.21.15.22:0/2624855154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e38103890 0x7f9e38103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.099+0000 7f9e3f66c640 1 -- 172.21.15.22:0/2624855154 >> 172.21.15.22:0/2624855154 conn(0x7f9e380fd400 msgr2=0x7f9e380ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:46.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.099+0000 7f9e3f66c640 1 -- 172.21.15.22:0/2624855154 shutdown_connections 2024-08-20T01:30:46.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.099+0000 7f9e3f66c640 1 -- 172.21.15.22:0/2624855154 wait complete. 2024-08-20T01:30:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.100+0000 7f9e3f66c640 1 Processor -- start 2024-08-20T01:30:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.100+0000 7f9e3f66c640 1 -- start start 2024-08-20T01:30:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.100+0000 7f9e3f66c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e38103890 0x7f9e38199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.100+0000 7f9e3f66c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e38104290 0x7f9e38199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.100+0000 7f9e3f66c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e3810ce40 0x7f9e3819e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.100+0000 7f9e3f66c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9e38112ac0 con 0x7f9e38104290 2024-08-20T01:30:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.100+0000 7f9e3f66c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9e38112940 con 0x7f9e3810ce40 2024-08-20T01:30:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.100+0000 7f9e3f66c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9e38112c40 con 0x7f9e38103890 2024-08-20T01:30:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.101+0000 7f9e3cc07640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e38104290 0x7f9e38199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.101+0000 7f9e3cc07640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e38104290 0x7f9e38199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52748/0 (socket says 172.21.15.22:52748) 2024-08-20T01:30:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.101+0000 7f9e3cc07640 1 -- 172.21.15.22:0/4162122950 learned_addr learned my addr 172.21.15.22:0/4162122950 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.101+0000 7f9e3d408640 1 --2- 172.21.15.22:0/4162122950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e38103890 0x7f9e38199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:46.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.101+0000 7f9e3cc07640 1 -- 172.21.15.22:0/4162122950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e38103890 msgr2=0x7f9e38199030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.101+0000 7f9e3dc09640 1 --2- 172.21.15.22:0/4162122950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e3810ce40 0x7f9e3819e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.101+0000 7f9e3cc07640 1 --2- 172.21.15.22:0/4162122950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e38103890 0x7f9e38199030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.101+0000 7f9e3cc07640 1 -- 172.21.15.22:0/4162122950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e3810ce40 msgr2=0x7f9e3819e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.101+0000 7f9e3cc07640 1 --2- 172.21.15.22:0/4162122950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e3810ce40 0x7f9e3819e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.101+0000 7f9e3cc07640 1 -- 172.21.15.22:0/4162122950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e3819f0e0 con 0x7f9e38104290 2024-08-20T01:30:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.101+0000 7f9e3dc09640 1 --2- 172.21.15.22:0/4162122950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e3810ce40 0x7f9e3819e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:30:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.101+0000 7f9e3cc07640 1 --2- 172.21.15.22:0/4162122950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e38104290 0x7f9e38199570 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9e28006010 tx=0x7f9e280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.101+0000 7f9e2e7fc640 1 -- 172.21.15.22:0/4162122950 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2803f030 con 0x7f9e38104290 2024-08-20T01:30:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.101+0000 7f9e3f66c640 1 -- 172.21.15.22:0/4162122950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e3819f370 con 0x7f9e38104290 2024-08-20T01:30:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.101+0000 7f9e2e7fc640 1 -- 172.21.15.22:0/4162122950 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e28003800 con 0x7f9e38104290 2024-08-20T01:30:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.101+0000 7f9e2e7fc640 1 -- 172.21.15.22:0/4162122950 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28035070 con 0x7f9e38104290 2024-08-20T01:30:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.101+0000 7f9e3f66c640 1 -- 172.21.15.22:0/4162122950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e381a5a90 con 0x7f9e38104290 2024-08-20T01:30:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.104+0000 7f9e2e7fc640 1 -- 172.21.15.22:0/4162122950 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f9e28003cb0 con 0x7f9e38104290 2024-08-20T01:30:46.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.105+0000 7f9e2e7fc640 1 --2- 172.21.15.22:0/4162122950 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9e240b3c60 0x7f9e240b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.105+0000 7f9e41a65740 1 Processor -- start 2024-08-20T01:30:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.105+0000 7f9e41a65740 1 -- start start 2024-08-20T01:30:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.105+0000 7f9e3d408640 1 --2- 172.21.15.22:0/4162122950 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9e240b3c60 0x7f9e240b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.105+0000 7f9e2e7fc640 1 -- 172.21.15.22:0/4162122950 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f9e28104150 con 0x7f9e38104290 2024-08-20T01:30:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.105+0000 7f9e41a65740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d9317bf0 0x55d2d9317fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.105+0000 7f9e41a65740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d9318510 0x55d2d9323f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.105+0000 7f9e41a65740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d93244a0 0x55d2d9326890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.105+0000 7f9e41a65740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d2d928e6a0 con 0x55d2d93244a0 2024-08-20T01:30:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.105+0000 7f9e41a65740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d2d927dba0 con 0x55d2d9317bf0 2024-08-20T01:30:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.105+0000 7f9e41a65740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d2d9281be0 con 0x55d2d9318510 2024-08-20T01:30:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.106+0000 7f9e3dc09640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d93244a0 0x55d2d9326890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.106+0000 7f9e3dc09640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d93244a0 0x55d2d9326890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52758/0 (socket says 172.21.15.22:52758) 2024-08-20T01:30:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.106+0000 7f9e3dc09640 1 -- 172.21.15.22:0/430370090 learned_addr learned my addr 172.21.15.22:0/430370090 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:46.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.106+0000 7f9e3d408640 1 --2- 172.21.15.22:0/4162122950 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9e240b3c60 0x7f9e240b6120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9e340098e0 tx=0x7f9e34008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.106+0000 7f9e3d408640 1 --2- 172.21.15.22:0/430370090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d9317bf0 0x55d2d9317fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.106+0000 7f9e3cc07640 1 --2- 172.21.15.22:0/430370090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d9318510 0x55d2d9323f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.106+0000 7f9e3dc09640 1 -- 172.21.15.22:0/430370090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d9318510 msgr2=0x55d2d9323f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.106+0000 7f9e3dc09640 1 --2- 172.21.15.22:0/430370090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d9318510 0x55d2d9323f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.106+0000 7f9e3dc09640 1 -- 172.21.15.22:0/430370090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d9317bf0 msgr2=0x55d2d9317fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.106+0000 7f9e3dc09640 1 --2- 172.21.15.22:0/430370090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d9317bf0 0x55d2d9317fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.106+0000 7f9e3dc09640 1 -- 172.21.15.22:0/430370090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2d8fdd540 con 0x55d2d93244a0 2024-08-20T01:30:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.106+0000 7f9e3d408640 1 --2- 172.21.15.22:0/430370090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d9317bf0 0x55d2d9317fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.106+0000 7f9e3cc07640 1 --2- 172.21.15.22:0/430370090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d9318510 0x55d2d9323f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:30:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.106+0000 7f9e3dc09640 1 --2- 172.21.15.22:0/430370090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d93244a0 0x55d2d9326890 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9e30008e60 tx=0x7f9e3000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b55fe8cc81ecdfc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.106+0000 7f9e237fe640 1 -- 172.21.15.22:0/430370090 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000f830 con 0x55d2d93244a0 2024-08-20T01:30:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.106+0000 7f9e237fe640 1 -- 172.21.15.22:0/430370090 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e30018480 con 0x55d2d93244a0 2024-08-20T01:30:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.106+0000 7f9e237fe640 1 -- 172.21.15.22:0/430370090 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000e610 con 0x55d2d93244a0 2024-08-20T01:30:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.107+0000 7f9e41a65740 1 -- 172.21.15.22:0/430370090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d93244a0 msgr2=0x55d2d9326890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.107+0000 7f9e41a65740 1 --2- 172.21.15.22:0/430370090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d93244a0 0x55d2d9326890 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9e30008e60 tx=0x7f9e3000d710 comp rx=0 tx=0).stop 2024-08-20T01:30:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.107+0000 7f9e41a65740 1 -- 172.21.15.22:0/430370090 shutdown_connections 2024-08-20T01:30:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.107+0000 7f9e41a65740 1 --2- 172.21.15.22:0/430370090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d93244a0 0x55d2d9326890 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.107+0000 7f9e41a65740 1 --2- 172.21.15.22:0/430370090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d9318510 0x55d2d9323f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.107+0000 7f9e41a65740 1 --2- 172.21.15.22:0/430370090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d9317bf0 0x55d2d9317fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.107+0000 7f9e41a65740 1 -- 172.21.15.22:0/430370090 >> 172.21.15.22:0/430370090 conn(0x55d2d9315a20 msgr2=0x55d2d9316bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.107+0000 7f9e41a65740 1 -- 172.21.15.22:0/430370090 shutdown_connections 2024-08-20T01:30:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.107+0000 7f9e41a65740 1 -- 172.21.15.22:0/430370090 wait complete. 2024-08-20T01:30:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.107+0000 7f9e41a65740 1 -- start start 2024-08-20T01:30:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.108+0000 7f9e41a65740 1 Processor -- start 2024-08-20T01:30:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.108+0000 7f9e41a65740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d9317bf0 0x55d2d93213e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.108+0000 7f9e41a65740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 0x55d2d9321920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.108+0000 7f9e41a65740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d93244a0 0x55d2d9321e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.108+0000 7f9e41a65740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d2d90e05f0 con 0x55d2d9318510 2024-08-20T01:30:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.108+0000 7f9e41a65740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d2d92046c0 con 0x55d2d93244a0 2024-08-20T01:30:46.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.108+0000 7f9e41a65740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d2d9327150 con 0x55d2d9317bf0 2024-08-20T01:30:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.108+0000 7f9e41a65740 10 client.0 _ll_register_callbacks cb 0x55d2d92411e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:30:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.108+0000 7f9e3cc07640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 0x55d2d9321920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.108+0000 7f9e3cc07640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 0x55d2d9321920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52762/0 (socket says 172.21.15.22:52762) 2024-08-20T01:30:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.108+0000 7f9e3cc07640 1 -- 172.21.15.22:0/3125416157 learned_addr learned my addr 172.21.15.22:0/3125416157 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.108+0000 7f9e3d408640 1 --2- 172.21.15.22:0/3125416157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d9317bf0 0x55d2d93213e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.108+0000 7f9e3dc09640 1 --2- 172.21.15.22:0/3125416157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d93244a0 0x55d2d9321e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.109+0000 7f9e3cc07640 1 -- 172.21.15.22:0/3125416157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d9317bf0 msgr2=0x55d2d93213e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.109+0000 7f9e3cc07640 1 --2- 172.21.15.22:0/3125416157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d9317bf0 0x55d2d93213e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.109+0000 7f9e3cc07640 1 -- 172.21.15.22:0/3125416157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d93244a0 msgr2=0x55d2d9321e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.109+0000 7f9e3cc07640 1 --2- 172.21.15.22:0/3125416157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d93244a0 0x55d2d9321e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.109+0000 7f9e3cc07640 1 -- 172.21.15.22:0/3125416157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2d93304e0 con 0x55d2d9318510 2024-08-20T01:30:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.109+0000 7f9e3dc09640 1 --2- 172.21.15.22:0/3125416157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d93244a0 0x55d2d9321e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.109+0000 7f9e3cc07640 1 --2- 172.21.15.22:0/3125416157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 0x55d2d9321920 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009000 tx=0x7f9e280ca720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e63b3e20de0b0dd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.109+0000 7f9e20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:30:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.109+0000 7f9e20ff9640 1 -- 172.21.15.22:0/3125416157 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e280e5060 con 0x55d2d9318510 2024-08-20T01:30:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.109+0000 7f9e20ff9640 1 -- 172.21.15.22:0/3125416157 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f9e280cb120 con 0x55d2d9318510 2024-08-20T01:30:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.109+0000 7f9e41a65740 1 -- 172.21.15.22:0/3125416157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e30018480 con 0x55d2d9318510 2024-08-20T01:30:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.109+0000 7f9e20ff9640 1 -- 172.21.15.22:0/3125416157 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9e28049040 con 0x55d2d9318510 2024-08-20T01:30:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.109+0000 7f9e41a65740 10 client.15246 fetch_fsmap learned FSMap version 24 2024-08-20T01:30:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.109+0000 7f9e41a65740 1 -- 172.21.15.22:0/3125416157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d2d9332e00 con 0x55d2d9318510 2024-08-20T01:30:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.109+0000 7f9e20ff9640 1 -- 172.21.15.22:0/3125416157 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e30018480 con 0x55d2d9318510 2024-08-20T01:30:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.109+0000 7f9e20ff9640 1 -- 172.21.15.22:0/3125416157 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9e280cf070 con 0x55d2d9318510 2024-08-20T01:30:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.109+0000 7f9e41a65740 10 client.15246 fetch_fsmap finished waiting for FSMap version 24 2024-08-20T01:30:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.110+0000 7f9e41a65740 10 client.15246 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-20T01:30:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.110+0000 7f9e41a65740 20 client.15246 populate_metadata read hostname 'smithi022' 2024-08-20T01:30:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.110+0000 7f9e41a65740 1 --2- 172.21.15.22:0/3125416157 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d2d93353c0 0x55d2d9336830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.110+0000 7f9e41a65740 4 client.15246 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:30:46.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.110+0000 7f9e41a65740 1 -- 172.21.15.22:0/3125416157 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2d92905f0 con 0x55d2d93353c0 2024-08-20T01:30:46.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.110+0000 7f9e3d408640 1 --2- 172.21.15.22:0/3125416157 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d2d93353c0 0x55d2d9336830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:46.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.110+0000 7f9e3d408640 1 --2- 172.21.15.22:0/3125416157 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d2d93353c0 0x55d2d9336830 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97f466fdfd5c26d5 server_cookie=b4680da66512ebdf in_seq=0 out_seq=0 2024-08-20T01:30:46.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.110+0000 7f9e20ff9640 10 client.15246 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:30:46.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.111+0000 7f9e20ff9640 1 -- 172.21.15.22:0/3125416157 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d2d92905f0 con 0x55d2d93353c0 2024-08-20T01:30:46.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.111+0000 7f9e20ff9640 10 client.15246 handle_command_reply: tid=0 2024-08-20T01:30:46.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.111+0000 7f9e41a65740 1 client.15246 shutdown 2024-08-20T01:30:46.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.111+0000 7f9e41a65740 1 -- 172.21.15.22:0/3125416157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 msgr2=0x55d2d9321920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:46.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.111+0000 7f9e41a65740 1 --2- 172.21.15.22:0/3125416157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 0x55d2d9321920 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009000 tx=0x7f9e280ca720 comp rx=0 tx=0).stop 2024-08-20T01:30:46.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.111+0000 7f9e41a65740 1 -- 172.21.15.22:0/3125416157 shutdown_connections 2024-08-20T01:30:46.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.111+0000 7f9e41a65740 1 --2- 172.21.15.22:0/3125416157 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d2d93353c0 0x55d2d9336830 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.111+0000 7f9e41a65740 1 --2- 172.21.15.22:0/3125416157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d93244a0 0x55d2d9321e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.111+0000 7f9e41a65740 1 --2- 172.21.15.22:0/3125416157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 0x55d2d9321920 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.111+0000 7f9e41a65740 1 --2- 172.21.15.22:0/3125416157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d9317bf0 0x55d2d93213e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.111+0000 7f9e41a65740 1 -- 172.21.15.22:0/3125416157 >> 172.21.15.22:0/3125416157 conn(0x55d2d9315a20 msgr2=0x55d2d931b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:46.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.111+0000 7f9e20ff9640 0 client.15246 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:30:46.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.111+0000 7f9e41a65740 1 -- 172.21.15.22:0/3125416157 shutdown_connections 2024-08-20T01:30:46.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.111+0000 7f9e41a65740 1 -- 172.21.15.22:0/3125416157 wait complete. 2024-08-20T01:30:46.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.112+0000 7f9e41a65740 20 client.15246 trim_cache size 0 max 16384 2024-08-20T01:30:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.130+0000 7f9e41a65740 1 Processor -- start 2024-08-20T01:30:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.130+0000 7f9e41a65740 1 -- start start 2024-08-20T01:30:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.130+0000 7f9e41a65740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d9317bf0 0x55d2d931bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.130+0000 7f9e41a65740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 0x55d2d93218e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.130+0000 7f9e41a65740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d93244a0 0x55d2d9321e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.130+0000 7f9e41a65740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d2d9334b70 con 0x55d2d9318510 2024-08-20T01:30:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.130+0000 7f9e41a65740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d2d9335240 con 0x55d2d93244a0 2024-08-20T01:30:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.130+0000 7f9e41a65740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d2d9335910 con 0x55d2d9317bf0 2024-08-20T01:30:46.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.130+0000 7f9e3cc07640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 0x55d2d93218e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:46.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.130+0000 7f9e3cc07640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 0x55d2d93218e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52764/0 (socket says 172.21.15.22:52764) 2024-08-20T01:30:46.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.130+0000 7f9e3cc07640 1 -- 172.21.15.22:0/1701530565 learned_addr learned my addr 172.21.15.22:0/1701530565 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:46.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.130+0000 7f9e3dc09640 1 --2- 172.21.15.22:0/1701530565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d93244a0 0x55d2d9321e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:46.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.130+0000 7f9e3d408640 1 --2- 172.21.15.22:0/1701530565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d9317bf0 0x55d2d931bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:46.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.130+0000 7f9e3cc07640 1 -- 172.21.15.22:0/1701530565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d9317bf0 msgr2=0x55d2d931bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:46.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.130+0000 7f9e3cc07640 1 --2- 172.21.15.22:0/1701530565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d9317bf0 0x55d2d931bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.131+0000 7f9e3cc07640 1 -- 172.21.15.22:0/1701530565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d93244a0 msgr2=0x55d2d9321e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:46.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.131+0000 7f9e3cc07640 1 --2- 172.21.15.22:0/1701530565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d93244a0 0x55d2d9321e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.131+0000 7f9e3cc07640 1 -- 172.21.15.22:0/1701530565 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2d93164a0 con 0x55d2d9318510 2024-08-20T01:30:46.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.131+0000 7f9e3dc09640 1 --2- 172.21.15.22:0/1701530565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d93244a0 0x55d2d9321e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:46.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.131+0000 7f9e3cc07640 1 --2- 172.21.15.22:0/1701530565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 0x55d2d93218e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9e28005ec0 tx=0x7f9e28031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e5af4f711bbc3d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:46.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.131+0000 7f9e22ffd640 1 -- 172.21.15.22:0/1701530565 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e280c6d80 con 0x55d2d9318510 2024-08-20T01:30:46.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.131+0000 7f9e22ffd640 1 -- 172.21.15.22:0/1701530565 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e280cf4c0 con 0x55d2d9318510 2024-08-20T01:30:46.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.131+0000 7f9e22ffd640 1 -- 172.21.15.22:0/1701530565 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e280cb120 con 0x55d2d9318510 2024-08-20T01:30:46.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.132+0000 7f9e41a65740 1 -- 172.21.15.22:0/1701530565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 msgr2=0x55d2d93218e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:46.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.132+0000 7f9e41a65740 1 --2- 172.21.15.22:0/1701530565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 0x55d2d93218e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9e28005ec0 tx=0x7f9e28031400 comp rx=0 tx=0).stop 2024-08-20T01:30:46.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.132+0000 7f9e41a65740 1 -- 172.21.15.22:0/1701530565 shutdown_connections 2024-08-20T01:30:46.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.132+0000 7f9e41a65740 1 --2- 172.21.15.22:0/1701530565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d93244a0 0x55d2d9321e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.132+0000 7f9e41a65740 1 --2- 172.21.15.22:0/1701530565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 0x55d2d93218e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.132+0000 7f9e41a65740 1 --2- 172.21.15.22:0/1701530565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d9317bf0 0x55d2d931bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.132+0000 7f9e41a65740 1 -- 172.21.15.22:0/1701530565 >> 172.21.15.22:0/1701530565 conn(0x55d2d9315a20 msgr2=0x55d2d9316b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:46.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.132+0000 7f9e41a65740 1 -- 172.21.15.22:0/1701530565 shutdown_connections 2024-08-20T01:30:46.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.132+0000 7f9e41a65740 1 -- 172.21.15.22:0/1701530565 wait complete. 2024-08-20T01:30:46.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.132+0000 7f9e41a65740 1 -- start start 2024-08-20T01:30:46.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.133+0000 7f9e41a65740 1 Processor -- start 2024-08-20T01:30:46.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.133+0000 7f9e41a65740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d9317bf0 0x55d2d9337df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:46.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.133+0000 7f9e41a65740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 0x55d2d9338370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:46.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.133+0000 7f9e41a65740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d93244a0 0x55d2d933d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:46.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.133+0000 7f9e41a65740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d2d93366b0 con 0x55d2d9318510 2024-08-20T01:30:46.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.133+0000 7f9e41a65740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d2d9335fe0 con 0x55d2d9317bf0 2024-08-20T01:30:46.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.133+0000 7f9e41a65740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d2d9336d80 con 0x55d2d93244a0 2024-08-20T01:30:46.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.133+0000 7f9e41a65740 10 client.0 _ll_register_callbacks cb 0x7f9e280095e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:30:46.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.133+0000 7f9e3cc07640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 0x55d2d9338370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:46.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.133+0000 7f9e3cc07640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 0x55d2d9338370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52766/0 (socket says 172.21.15.22:52766) 2024-08-20T01:30:46.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.133+0000 7f9e3cc07640 1 -- 172.21.15.22:0/505665199 learned_addr learned my addr 172.21.15.22:0/505665199 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:46.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.134+0000 7f9e3d408640 1 --2- 172.21.15.22:0/505665199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d9317bf0 0x55d2d9337df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:46.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.134+0000 7f9e3dc09640 1 --2- 172.21.15.22:0/505665199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d93244a0 0x55d2d933d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:46.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.134+0000 7f9e3cc07640 1 -- 172.21.15.22:0/505665199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d93244a0 msgr2=0x55d2d933d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:46.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.134+0000 7f9e3cc07640 1 --2- 172.21.15.22:0/505665199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d93244a0 0x55d2d933d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.134+0000 7f9e3cc07640 1 -- 172.21.15.22:0/505665199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d9317bf0 msgr2=0x55d2d9337df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:46.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.134+0000 7f9e3cc07640 1 --2- 172.21.15.22:0/505665199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d9317bf0 0x55d2d9337df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.134+0000 7f9e3cc07640 1 -- 172.21.15.22:0/505665199 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2d933db20 con 0x55d2d9318510 2024-08-20T01:30:46.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.134+0000 7f9e3d408640 1 --2- 172.21.15.22:0/505665199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d9317bf0 0x55d2d9337df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:46.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.134+0000 7f9e3cc07640 1 --2- 172.21.15.22:0/505665199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 0x55d2d9338370 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9e28047040 tx=0x7f9e28031df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a0e9e90039aa8b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:46.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.134+0000 7f9e20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:30:46.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.134+0000 7f9e20ff9640 1 -- 172.21.15.22:0/505665199 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e280c6d80 con 0x55d2d9318510 2024-08-20T01:30:46.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.134+0000 7f9e20ff9640 1 -- 172.21.15.22:0/505665199 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f9e280ca330 con 0x55d2d9318510 2024-08-20T01:30:46.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.134+0000 7f9e41a65740 1 -- 172.21.15.22:0/505665199 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e280cf4c0 con 0x55d2d9318510 2024-08-20T01:30:46.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.134+0000 7f9e20ff9640 1 -- 172.21.15.22:0/505665199 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9e280d3b80 con 0x55d2d9318510 2024-08-20T01:30:46.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.134+0000 7f9e41a65740 10 client.15252 fetch_fsmap learned FSMap version 24 2024-08-20T01:30:46.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.134+0000 7f9e41a65740 1 -- 172.21.15.22:0/505665199 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d2d933db20 con 0x55d2d9318510 2024-08-20T01:30:46.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.135+0000 7f9e20ff9640 1 -- 172.21.15.22:0/505665199 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e280cf4c0 con 0x55d2d9318510 2024-08-20T01:30:46.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.136+0000 7f9e20ff9640 1 -- 172.21.15.22:0/505665199 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9e280cf040 con 0x55d2d9318510 2024-08-20T01:30:46.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.136+0000 7f9e41a65740 10 client.15252 fetch_fsmap finished waiting for FSMap version 24 2024-08-20T01:30:46.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.136+0000 7f9e41a65740 10 client.15252 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-20T01:30:46.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.136+0000 7f9e41a65740 20 client.15252 populate_metadata read hostname 'smithi022' 2024-08-20T01:30:46.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.136+0000 7f9e41a65740 1 --2- 172.21.15.22:0/505665199 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d2d93a3620 0x55d2d93a2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:46.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.136+0000 7f9e41a65740 4 client.15252 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T01:30:46.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.136+0000 7f9e41a65740 1 -- 172.21.15.22:0/505665199 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "status"}) -- 0x55d2d928c090 con 0x55d2d93a3620 2024-08-20T01:30:46.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.136+0000 7f9e3d408640 1 --2- 172.21.15.22:0/505665199 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d2d93a3620 0x55d2d93a2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:46.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.137+0000 7f9e20ff9640 10 client.15252 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:30:46.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.137+0000 7f9e3d408640 1 --2- 172.21.15.22:0/505665199 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d2d93a3620 0x55d2d93a2330 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dfcbd62dff9be36 server_cookie=52948e25e3afe44a in_seq=0 out_seq=0 2024-08-20T01:30:46.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.137+0000 7f9e20ff9640 1 -- 172.21.15.22:0/505665199 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55d2d928c090 con 0x55d2d93a3620 2024-08-20T01:30:46.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.137+0000 7f9e20ff9640 10 client.15252 handle_command_reply: tid=0 2024-08-20T01:30:46.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.137+0000 7f9e41a65740 1 client.15252 shutdown 2024-08-20T01:30:46.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.137+0000 7f9e41a65740 1 -- 172.21.15.22:0/505665199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 msgr2=0x55d2d9338370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:46.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.137+0000 7f9e41a65740 1 --2- 172.21.15.22:0/505665199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 0x55d2d9338370 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9e28047040 tx=0x7f9e28031df0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.137+0000 7f9e41a65740 1 -- 172.21.15.22:0/505665199 shutdown_connections 2024-08-20T01:30:46.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.137+0000 7f9e41a65740 1 --2- 172.21.15.22:0/505665199 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d2d93a3620 0x55d2d93a2330 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.137+0000 7f9e41a65740 1 --2- 172.21.15.22:0/505665199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2d93244a0 0x55d2d933d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.137+0000 7f9e41a65740 1 --2- 172.21.15.22:0/505665199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2d9318510 0x55d2d9338370 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.137+0000 7f9e41a65740 1 --2- 172.21.15.22:0/505665199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2d9317bf0 0x55d2d9337df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.137+0000 7f9e41a65740 1 -- 172.21.15.22:0/505665199 >> 172.21.15.22:0/505665199 conn(0x55d2d9315a20 msgr2=0x55d2d931fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:46.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.137+0000 7f9e20ff9640 0 client.15252 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:30:46.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.137+0000 7f9e41a65740 1 -- 172.21.15.22:0/505665199 shutdown_connections 2024-08-20T01:30:46.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.138+0000 7f9e41a65740 1 -- 172.21.15.22:0/505665199 wait complete. 2024-08-20T01:30:46.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.138+0000 7f9e41a65740 20 client.15252 trim_cache size 0 max 16384 2024-08-20T01:30:46.142 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:30:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "586fd06c-5e92-11ef-bccf-c7b262605968", 2024-08-20T01:30:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2024-08-20T01:30:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24586, 2024-08-20T01:30:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-08-20T01:30:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-08-20T01:30:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-08-20T01:30:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 98.709298425, 2024-08-20T01:30:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 24, 2024-08-20T01:30:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 77, 2024-08-20T01:30:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 75, 2024-08-20T01:30:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 118.408459855 2024-08-20T01:30:46.143 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:30:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.138+0000 7f9e3f66c640 1 -- 172.21.15.22:0/4162122950 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9e240b3c60 msgr2=0x7f9e240b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.138+0000 7f9e3f66c640 1 --2- 172.21.15.22:0/4162122950 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9e240b3c60 0x7f9e240b6120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9e340098e0 tx=0x7f9e34008040 comp rx=0 tx=0).stop 2024-08-20T01:30:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.138+0000 7f9e3f66c640 1 -- 172.21.15.22:0/4162122950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e38104290 msgr2=0x7f9e38199570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.138+0000 7f9e3f66c640 1 --2- 172.21.15.22:0/4162122950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e38104290 0x7f9e38199570 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9e28006010 tx=0x7f9e280042f0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.138+0000 7f9e3f66c640 1 -- 172.21.15.22:0/4162122950 shutdown_connections 2024-08-20T01:30:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.138+0000 7f9e3f66c640 1 --2- 172.21.15.22:0/4162122950 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9e240b3c60 0x7f9e240b6120 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.138+0000 7f9e3f66c640 1 --2- 172.21.15.22:0/4162122950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e3810ce40 0x7f9e3819e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.138+0000 7f9e3f66c640 1 --2- 172.21.15.22:0/4162122950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e38104290 0x7f9e38199570 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.138+0000 7f9e3f66c640 1 --2- 172.21.15.22:0/4162122950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e38103890 0x7f9e38199030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:46.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.138+0000 7f9e3f66c640 1 -- 172.21.15.22:0/4162122950 >> 172.21.15.22:0/4162122950 conn(0x7f9e380fd400 msgr2=0x7f9e380fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:46.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.139+0000 7f9e3f66c640 1 -- 172.21.15.22:0/4162122950 shutdown_connections 2024-08-20T01:30:46.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:46.139+0000 7f9e3f66c640 1 -- 172.21.15.22:0/4162122950 wait complete. 2024-08-20T01:30:46.749 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:46 smithi022 ceph-mon[18709]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-20T01:30:46.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:46 smithi134 ceph-mon[22511]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-20T01:30:46.790 INFO:teuthology.run_tasks:Running task sequential... 2024-08-20T01:30:46.802 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-08-20T01:30:46.802 INFO:teuthology.task.sequential:In sequential, running task print... 2024-08-20T01:30:46.802 INFO:teuthology.task.print:Enabling mgr modules 2024-08-20T01:30:46.802 INFO:teuthology.run_tasks:Running task kclient... 2024-08-20T01:30:46.841 INFO:tasks.kclient:Mounting kernel clients... 2024-08-20T01:30:46.841 INFO:tasks.kclient:config is {'client.0': {}} 2024-08-20T01:30:46.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:30:46.841 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-08-20T01:30:46.842 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:46 smithi077 ceph-mon[22251]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-20T01:30:46.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:30:46.860 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2024-08-20T01:30:46.929 INFO:teuthology.orchestra.run.smithi022.stderr:Cannot find device "ceph-brx" 2024-08-20T01:30:46.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T01:30:46.930 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-08-20T01:30:46.931 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-20T01:30:46.931 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-20T01:30:46.931 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs ls 2024-08-20T01:30:47.228 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:47.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.689+0000 7fd05afa0640 1 -- 172.21.15.22:0/675891730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0541019b0 msgr2=0x7fd054101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:47.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.689+0000 7fd05afa0640 1 --2- 172.21.15.22:0/675891730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0541019b0 0x7fd054101d90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd048009900 tx=0x7fd04802a410 comp rx=0 tx=0).stop 2024-08-20T01:30:47.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.689+0000 7fd05afa0640 1 -- 172.21.15.22:0/675891730 shutdown_connections 2024-08-20T01:30:47.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.689+0000 7fd05afa0640 1 --2- 172.21.15.22:0/675891730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd054107d40 0x7fd05410e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.689+0000 7fd05afa0640 1 --2- 172.21.15.22:0/675891730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0541073c0 0x7fd054107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.689+0000 7fd05afa0640 1 --2- 172.21.15.22:0/675891730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0541019b0 0x7fd054101d90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.689+0000 7fd05afa0640 1 -- 172.21.15.22:0/675891730 >> 172.21.15.22:0/675891730 conn(0x7fd0540fd420 msgr2=0x7fd0540ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.690+0000 7fd05afa0640 1 -- 172.21.15.22:0/675891730 shutdown_connections 2024-08-20T01:30:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.690+0000 7fd05afa0640 1 -- 172.21.15.22:0/675891730 wait complete. 2024-08-20T01:30:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.690+0000 7fd05afa0640 1 Processor -- start 2024-08-20T01:30:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.690+0000 7fd05afa0640 1 -- start start 2024-08-20T01:30:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.690+0000 7fd05afa0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0541019b0 0x7fd05419b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.690+0000 7fd05afa0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0541073c0 0x7fd05419b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.690+0000 7fd05afa0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd054107d40 0x7fd0541a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.691+0000 7fd05afa0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd054111a00 con 0x7fd0541073c0 2024-08-20T01:30:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.691+0000 7fd05afa0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd054111880 con 0x7fd054107d40 2024-08-20T01:30:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.691+0000 7fd05afa0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd054111b80 con 0x7fd0541019b0 2024-08-20T01:30:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.691+0000 7fd053fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0541073c0 0x7fd05419b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.691+0000 7fd053fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0541073c0 0x7fd05419b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52786/0 (socket says 172.21.15.22:52786) 2024-08-20T01:30:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.691+0000 7fd053fff640 1 -- 172.21.15.22:0/3564829490 learned_addr learned my addr 172.21.15.22:0/3564829490 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.691+0000 7fd058d3c640 1 --2- 172.21.15.22:0/3564829490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0541019b0 0x7fd05419b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.691+0000 7fd05953d640 1 --2- 172.21.15.22:0/3564829490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd054107d40 0x7fd0541a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.691+0000 7fd053fff640 1 -- 172.21.15.22:0/3564829490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0541019b0 msgr2=0x7fd05419b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.691+0000 7fd053fff640 1 --2- 172.21.15.22:0/3564829490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0541019b0 0x7fd05419b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.691+0000 7fd053fff640 1 -- 172.21.15.22:0/3564829490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd054107d40 msgr2=0x7fd0541a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.691+0000 7fd053fff640 1 --2- 172.21.15.22:0/3564829490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd054107d40 0x7fd0541a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.691+0000 7fd053fff640 1 -- 172.21.15.22:0/3564829490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0541a12d0 con 0x7fd0541073c0 2024-08-20T01:30:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.691+0000 7fd05953d640 1 --2- 172.21.15.22:0/3564829490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd054107d40 0x7fd0541a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.691+0000 7fd053fff640 1 --2- 172.21.15.22:0/3564829490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0541073c0 0x7fd05419b760 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd04000d950 tx=0x7fd04000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.691+0000 7fd051ffb640 1 -- 172.21.15.22:0/3564829490 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040017070 con 0x7fd0541073c0 2024-08-20T01:30:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.691+0000 7fd051ffb640 1 -- 172.21.15.22:0/3564829490 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd040009c30 con 0x7fd0541073c0 2024-08-20T01:30:47.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.691+0000 7fd05afa0640 1 -- 172.21.15.22:0/3564829490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0541a15c0 con 0x7fd0541073c0 2024-08-20T01:30:47.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.691+0000 7fd051ffb640 1 -- 172.21.15.22:0/3564829490 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04000f620 con 0x7fd0541073c0 2024-08-20T01:30:47.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.692+0000 7fd05afa0640 1 -- 172.21.15.22:0/3564829490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0541a7d00 con 0x7fd0541073c0 2024-08-20T01:30:47.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.693+0000 7fd05afa0640 1 -- 172.21.15.22:0/3564829490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd054101d90 con 0x7fd0541073c0 2024-08-20T01:30:47.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.694+0000 7fd051ffb640 1 -- 172.21.15.22:0/3564829490 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fd040010460 con 0x7fd0541073c0 2024-08-20T01:30:47.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.695+0000 7fd051ffb640 1 --2- 172.21.15.22:0/3564829490 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd0440b3c60 0x7fd0440b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:47.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.695+0000 7fd058d3c640 1 --2- 172.21.15.22:0/3564829490 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd0440b3c60 0x7fd0440b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:47.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.695+0000 7fd051ffb640 1 -- 172.21.15.22:0/3564829490 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7fd0400e39e0 con 0x7fd0541073c0 2024-08-20T01:30:47.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.695+0000 7fd058d3c640 1 --2- 172.21.15.22:0/3564829490 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd0440b3c60 0x7fd0440b6120 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd048031440 tx=0x7fd048005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:47.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.699+0000 7fd051ffb640 1 -- 172.21.15.22:0/3564829490 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd0400aaeb0 con 0x7fd0541073c0 2024-08-20T01:30:47.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.922+0000 7fd05afa0640 1 -- 172.21.15.22:0/3564829490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd0541a7ff0 con 0x7fd0541073c0 2024-08-20T01:30:47.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.923+0000 7fd051ffb640 1 -- 172.21.15.22:0/3564829490 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7fd040009de0 con 0x7fd0541073c0 2024-08-20T01:30:47.924 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-20T01:30:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.925+0000 7fd05afa0640 1 -- 172.21.15.22:0/3564829490 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd0440b3c60 msgr2=0x7fd0440b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.925+0000 7fd05afa0640 1 --2- 172.21.15.22:0/3564829490 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd0440b3c60 0x7fd0440b6120 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd048031440 tx=0x7fd048005b50 comp rx=0 tx=0).stop 2024-08-20T01:30:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.925+0000 7fd05afa0640 1 -- 172.21.15.22:0/3564829490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0541073c0 msgr2=0x7fd05419b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.925+0000 7fd05afa0640 1 --2- 172.21.15.22:0/3564829490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0541073c0 0x7fd05419b760 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd04000d950 tx=0x7fd04000de10 comp rx=0 tx=0).stop 2024-08-20T01:30:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.925+0000 7fd05afa0640 1 -- 172.21.15.22:0/3564829490 shutdown_connections 2024-08-20T01:30:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.925+0000 7fd05afa0640 1 --2- 172.21.15.22:0/3564829490 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd0440b3c60 0x7fd0440b6120 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.925+0000 7fd05afa0640 1 --2- 172.21.15.22:0/3564829490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd054107d40 0x7fd0541a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.925+0000 7fd05afa0640 1 --2- 172.21.15.22:0/3564829490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0541073c0 0x7fd05419b760 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:47.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.925+0000 7fd05afa0640 1 --2- 172.21.15.22:0/3564829490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0541019b0 0x7fd05419b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:47.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.925+0000 7fd05afa0640 1 -- 172.21.15.22:0/3564829490 >> 172.21.15.22:0/3564829490 conn(0x7fd0540fd420 msgr2=0x7fd05406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:47.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.925+0000 7fd05afa0640 1 -- 172.21.15.22:0/3564829490 shutdown_connections 2024-08-20T01:30:47.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:47.925+0000 7fd05afa0640 1 -- 172.21.15.22:0/3564829490 wait complete. 2024-08-20T01:30:48.462 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:48 smithi022 ceph-mon[18709]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-20T01:30:48.462 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:48 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3564829490' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-20T01:30:48.492 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-20T01:30:48.492 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-20T01:30:48.492 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2024-08-20T01:30:48.492 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-20T01:30:48.492 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-20T01:30:48.492 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-20T01:30:48.492 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-20T01:30:48.492 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-20T01:30:48.492 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-20T01:30:48.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:30:48.492 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2024-08-20T01:30:48.509 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-20T01:30:48.510 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-20T01:30:48.510 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2024-08-20T01:30:48.510 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-08-20T01:30:48.510 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2024-08-20T01:30:48.510 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-08-20T01:30:48.510 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-20T01:30:48.510 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2024-08-20T01:30:48.510 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2024-08-20T01:30:48.510 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-20T01:30:48.510 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2024-08-20T01:30:48.510 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2024-08-20T01:30:48.510 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-20T01:30:48.511 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2024-08-20T01:30:48.511 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2024-08-20T01:30:48.511 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-20T01:30:48.511 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42210sec preferred_lft 42210sec 2024-08-20T01:30:48.511 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link noprefixroute 2024-08-20T01:30:48.511 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-08-20T01:30:48.511 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-20T01:30:48.511 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2024-08-20T01:30:48.511 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2024-08-20T01:30:48.511 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-20T01:30:48.512 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T01:30:48.512 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-08-20T01:30:48.512 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add name ceph-brx type bridge 2024-08-20T01:30:48.512 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr flush dev ceph-brx 2024-08-20T01:30:48.512 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set ceph-brx up 2024-08-20T01:30:48.512 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-20T01:30:48.512 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-08-20T01:30:48.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T01:30:48.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T01:30:48.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:30:48.715 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-20T01:30:48.742 INFO:teuthology.orchestra.run.smithi022.stdout:1 2024-08-20T01:30:48.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:30:48.743 DEBUG:teuthology.orchestra.run.smithi022:> route 2024-08-20T01:30:48.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:48 smithi134 ceph-mon[22511]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-20T01:30:48.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:48 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3564829490' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-20T01:30:48.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:48 smithi077 ceph-mon[22251]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-20T01:30:48.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:48 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3564829490' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-20T01:30:48.817 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2024-08-20T01:30:48.818 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-20T01:30:48.818 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-20T01:30:48.818 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-20T01:30:48.818 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-20T01:30:48.818 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T01:30:48.818 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-08-20T01:30:48.819 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-20T01:30:48.819 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-20T01:30:48.819 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-20T01:30:48.819 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-08-20T01:30:48.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T01:30:49.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T01:30:49.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:30:49.143 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-08-20T01:30:49.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:30:49.159 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list-id 2024-08-20T01:30:49.216 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T01:30:49.216 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-08-20T01:30:49.216 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-20T01:30:49.216 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-20T01:30:49.216 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-08-20T01:30:49.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T01:30:49.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T01:30:49.336 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-20T01:30:49.336 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T01:30:49.337 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-08-20T01:30:49.337 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-20T01:30:49.337 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-20T01:30:49.337 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-20T01:30:49.337 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-20T01:30:49.337 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-20T01:30:49.337 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-08-20T01:30:49.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T01:30:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T01:30:49.464 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T01:30:49.464 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-08-20T01:30:49.464 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2024-08-20T01:30:49.464 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set dev brx.0 master ceph-brx 2024-08-20T01:30:49.464 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-08-20T01:30:49.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T01:30:49.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T01:30:49.543 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-20T01:30:49.543 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-20T01:30:49.559 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-20T01:30:49.559 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-20T01:30:49.559 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-20T01:30:49.615 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-08-20T01:30:49.615 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-08-20T01:30:49.615 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd 2024-08-20T01:30:49.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:30:49.616 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-08-20T01:30:49.738 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-08-20T01:30:49.738 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2024-08-20T01:30:49.866 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-08-20T01:30:49.867 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2024-08-20T01:30:49.867 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.77:6789,172.21.15.134:6789" 2024-08-20T01:30:49.867 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@586fd06c-5e92-11ef-bccf-c7b262605968.cephfs=/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd 2024-08-20T01:30:49.867 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync,name=0,key=0,mon_addr=172.21.15.22:6789/172.21.15.77:6789/172.21.15.134:6789" will pass to kernel 2024-08-20T01:30:49.868 INFO:teuthology.orchestra.run.smithi022.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-20T01:30:49.868 INFO:teuthology.orchestra.run.smithi022.stdout: You just mounted a file system that supports labels which does not 2024-08-20T01:30:49.868 INFO:teuthology.orchestra.run.smithi022.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-20T01:30:49.868 INFO:teuthology.orchestra.run.smithi022.stdout: applications will generate AVC messages and not be allowed access to 2024-08-20T01:30:49.868 INFO:teuthology.orchestra.run.smithi022.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-20T01:30:49.869 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-20T01:30:49.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:30:49.870 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-20T01:30:49.898 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-20T01:30:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-20T01:30:49.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T01:30:50.005 INFO:teuthology.orchestra.run.smithi022.stdout:client24937 2024-08-20T01:30:50.005 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-08-20T01:30:50.005 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-20T01:30:50.023 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-20T01:30:50.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-20T01:30:50.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T01:30:50.129 INFO:teuthology.orchestra.run.smithi022.stdout:client24937 2024-08-20T01:30:50.129 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-20T01:30:50.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-20T01:30:50.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T01:30:50.196 INFO:teuthology.orchestra.run.smithi022.stdout:client24937 2024-08-20T01:30:50.196 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/586fd06c-5e92-11ef-bccf-c7b262605968.client24937/status') 2024-08-20T01:30:50.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T01:30:50.264 INFO:teuthology.orchestra.run.smithi022.stdout:instance: client.24937 (3)172.21.15.22:0/2015295414 2024-08-20T01:30:50.264 INFO:teuthology.orchestra.run.smithi022.stdout:blocklisted: false 2024-08-20T01:30:50.264 INFO:teuthology.orchestra.run.smithi022.stderr:0+1 records in 2024-08-20T01:30:50.264 INFO:teuthology.orchestra.run.smithi022.stderr:0+1 records out 2024-08-20T01:30:50.264 INFO:teuthology.orchestra.run.smithi022.stderr:71 bytes copied, 2.3647e-05 s, 3.0 MB/s 2024-08-20T01:30:50.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T01:30:50.271 INFO:teuthology.run_tasks:Running task exec... 2024-08-20T01:30:50.280 INFO:teuthology.task.exec:Executing custom commands... 2024-08-20T01:30:50.280 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-08-20T01:30:50.280 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-08-20T01:30:50.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.384+0000 7fc4e87e1640 1 -- 172.21.15.22:0/1290599089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4e01015a0 msgr2=0x7fc4e01019a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.384+0000 7fc4e87e1640 1 --2- 172.21.15.22:0/1290599089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4e01015a0 0x7fc4e01019a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009930 tx=0x7fc4dc02a420 comp rx=0 tx=0).stop 2024-08-20T01:30:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.384+0000 7fc4e87e1640 1 -- 172.21.15.22:0/1290599089 shutdown_connections 2024-08-20T01:30:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.384+0000 7fc4e87e1640 1 --2- 172.21.15.22:0/1290599089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4e01030b0 0x7fc4e0109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.384+0000 7fc4e87e1640 1 --2- 172.21.15.22:0/1290599089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4e01026f0 0x7fc4e0102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.384+0000 7fc4e87e1640 1 --2- 172.21.15.22:0/1290599089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4e01015a0 0x7fc4e01019a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.384+0000 7fc4e87e1640 1 -- 172.21.15.22:0/1290599089 >> 172.21.15.22:0/1290599089 conn(0x7fc4e00fce60 msgr2=0x7fc4e00ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.384+0000 7fc4e87e1640 1 -- 172.21.15.22:0/1290599089 shutdown_connections 2024-08-20T01:30:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.384+0000 7fc4e87e1640 1 -- 172.21.15.22:0/1290599089 wait complete. 2024-08-20T01:30:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.384+0000 7fc4e87e1640 1 Processor -- start 2024-08-20T01:30:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.385+0000 7fc4e87e1640 1 -- start start 2024-08-20T01:30:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.385+0000 7fc4e87e1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4e01015a0 0x7fc4e0198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.385+0000 7fc4e87e1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4e01026f0 0x7fc4e0199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.385+0000 7fc4e87e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4e01030b0 0x7fc4e0199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.385+0000 7fc4e87e1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e010d1f0 con 0x7fc4e01026f0 2024-08-20T01:30:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.385+0000 7fc4e87e1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e010d070 con 0x7fc4e01030b0 2024-08-20T01:30:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.385+0000 7fc4e87e1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e010d370 con 0x7fc4e01015a0 2024-08-20T01:30:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.385+0000 7fc4e5d7c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4e01026f0 0x7fc4e0199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.385+0000 7fc4e5d7c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4e01026f0 0x7fc4e0199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43100/0 (socket says 172.21.15.22:43100) 2024-08-20T01:30:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.385+0000 7fc4e5d7c640 1 -- 172.21.15.22:0/4106865226 learned_addr learned my addr 172.21.15.22:0/4106865226 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.385+0000 7fc4e6d7e640 1 --2- 172.21.15.22:0/4106865226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4e01030b0 0x7fc4e0199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.385+0000 7fc4e657d640 1 --2- 172.21.15.22:0/4106865226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4e01015a0 0x7fc4e0198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.385+0000 7fc4e5d7c640 1 -- 172.21.15.22:0/4106865226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4e01015a0 msgr2=0x7fc4e0198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.385+0000 7fc4e5d7c640 1 --2- 172.21.15.22:0/4106865226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4e01015a0 0x7fc4e0198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.385+0000 7fc4e5d7c640 1 -- 172.21.15.22:0/4106865226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4e01030b0 msgr2=0x7fc4e0199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.385+0000 7fc4e5d7c640 1 --2- 172.21.15.22:0/4106865226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4e01030b0 0x7fc4e0199dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:50.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.385+0000 7fc4e5d7c640 1 -- 172.21.15.22:0/4106865226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e019a680 con 0x7fc4e01026f0 2024-08-20T01:30:50.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.385+0000 7fc4e657d640 1 --2- 172.21.15.22:0/4106865226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4e01015a0 0x7fc4e0198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:50.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.385+0000 7fc4e5d7c640 1 --2- 172.21.15.22:0/4106865226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4e01026f0 0x7fc4e0199190 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000d950 tx=0x7fc4d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:50.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.386+0000 7fc4d77fe640 1 -- 172.21.15.22:0/4106865226 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0017070 con 0x7fc4e01026f0 2024-08-20T01:30:50.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.386+0000 7fc4d77fe640 1 -- 172.21.15.22:0/4106865226 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4d0009c30 con 0x7fc4e01026f0 2024-08-20T01:30:50.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.386+0000 7fc4e87e1640 1 -- 172.21.15.22:0/4106865226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e019a970 con 0x7fc4e01026f0 2024-08-20T01:30:50.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.386+0000 7fc4d77fe640 1 -- 172.21.15.22:0/4106865226 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d000f620 con 0x7fc4e01026f0 2024-08-20T01:30:50.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.386+0000 7fc4e87e1640 1 -- 172.21.15.22:0/4106865226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e01a1040 con 0x7fc4e01026f0 2024-08-20T01:30:50.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.387+0000 7fc4e87e1640 1 -- 172.21.15.22:0/4106865226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4e01a1210 con 0x7fc4e01026f0 2024-08-20T01:30:50.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.388+0000 7fc4d77fe640 1 -- 172.21.15.22:0/4106865226 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fc4d0005030 con 0x7fc4e01026f0 2024-08-20T01:30:50.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.389+0000 7fc4d77fe640 1 --2- 172.21.15.22:0/4106865226 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc4cc0b3ce0 0x7fc4cc0b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:50.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.389+0000 7fc4e657d640 1 --2- 172.21.15.22:0/4106865226 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc4cc0b3ce0 0x7fc4cc0b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:50.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.389+0000 7fc4d77fe640 1 -- 172.21.15.22:0/4106865226 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7fc4d00e39f0 con 0x7fc4e01026f0 2024-08-20T01:30:50.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.389+0000 7fc4e657d640 1 --2- 172.21.15.22:0/4106865226 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc4cc0b3ce0 0x7fc4cc0b61a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc000c00 tx=0x7fc4dc0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:50.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.391+0000 7fc4d77fe640 1 -- 172.21.15.22:0/4106865226 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fc4d00aaf40 con 0x7fc4e01026f0 2024-08-20T01:30:50.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:50.621+0000 7fc4e87e1640 1 -- 172.21.15.22:0/4106865226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fc4e01a13e0 con 0x7fc4e01026f0 2024-08-20T01:30:50.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:50 smithi022 ceph-mon[18709]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:50.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:50 smithi134 ceph-mon[22511]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:50.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:50 smithi077 ceph-mon[22251]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:30:51.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.495+0000 7fc4d77fe640 1 -- 172.21.15.22:0/4106865226 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7fc4d0009de0 con 0x7fc4e01026f0 2024-08-20T01:30:51.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.498+0000 7fc4e87e1640 1 -- 172.21.15.22:0/4106865226 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc4cc0b3ce0 msgr2=0x7fc4cc0b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:51.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.498+0000 7fc4e87e1640 1 --2- 172.21.15.22:0/4106865226 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc4cc0b3ce0 0x7fc4cc0b61a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc000c00 tx=0x7fc4dc0314a0 comp rx=0 tx=0).stop 2024-08-20T01:30:51.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.498+0000 7fc4e87e1640 1 -- 172.21.15.22:0/4106865226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4e01026f0 msgr2=0x7fc4e0199190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:51.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.498+0000 7fc4e87e1640 1 --2- 172.21.15.22:0/4106865226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4e01026f0 0x7fc4e0199190 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000d950 tx=0x7fc4d000de10 comp rx=0 tx=0).stop 2024-08-20T01:30:51.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.498+0000 7fc4e87e1640 1 -- 172.21.15.22:0/4106865226 shutdown_connections 2024-08-20T01:30:51.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.498+0000 7fc4e87e1640 1 --2- 172.21.15.22:0/4106865226 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc4cc0b3ce0 0x7fc4cc0b61a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:51.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.498+0000 7fc4e87e1640 1 --2- 172.21.15.22:0/4106865226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4e01030b0 0x7fc4e0199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:51.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.498+0000 7fc4e87e1640 1 --2- 172.21.15.22:0/4106865226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4e01026f0 0x7fc4e0199190 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:51.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.498+0000 7fc4e87e1640 1 --2- 172.21.15.22:0/4106865226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4e01015a0 0x7fc4e0198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:51.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.498+0000 7fc4e87e1640 1 -- 172.21.15.22:0/4106865226 >> 172.21.15.22:0/4106865226 conn(0x7fc4e00fce60 msgr2=0x7fc4e00fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:51.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.498+0000 7fc4e87e1640 1 -- 172.21.15.22:0/4106865226 shutdown_connections 2024-08-20T01:30:51.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.498+0000 7fc4e87e1640 1 -- 172.21.15.22:0/4106865226 wait complete. 2024-08-20T01:30:51.513 INFO:teuthology.run_tasks:Running task check-counter... 2024-08-20T01:30:51.524 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-08-20T01:30:51.536 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-20T01:30:51.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.646+0000 7ff91aaa8640 1 -- 172.21.15.22:0/3951860112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9141015b0 msgr2=0x7ff9141019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.646+0000 7ff91aaa8640 1 --2- 172.21.15.22:0/3951860112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9141015b0 0x7ff9141019b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff910009930 tx=0x7ff91002a420 comp rx=0 tx=0).stop 2024-08-20T01:30:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.646+0000 7ff91aaa8640 1 -- 172.21.15.22:0/3951860112 shutdown_connections 2024-08-20T01:30:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.646+0000 7ff91aaa8640 1 --2- 172.21.15.22:0/3951860112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9141030c0 0x7ff914109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.646+0000 7ff91aaa8640 1 --2- 172.21.15.22:0/3951860112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff914102700 0x7ff914102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.646+0000 7ff91aaa8640 1 --2- 172.21.15.22:0/3951860112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9141015b0 0x7ff9141019b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.646+0000 7ff91aaa8640 1 -- 172.21.15.22:0/3951860112 >> 172.21.15.22:0/3951860112 conn(0x7ff9140fce50 msgr2=0x7ff9140ff290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.646+0000 7ff91aaa8640 1 -- 172.21.15.22:0/3951860112 shutdown_connections 2024-08-20T01:30:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.646+0000 7ff91aaa8640 1 -- 172.21.15.22:0/3951860112 wait complete. 2024-08-20T01:30:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.647+0000 7ff91aaa8640 1 Processor -- start 2024-08-20T01:30:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.647+0000 7ff91aaa8640 1 -- start start 2024-08-20T01:30:51.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.647+0000 7ff91aaa8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9141015b0 0x7ff91406b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:51.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.647+0000 7ff91aaa8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff914102700 0x7ff91419d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:51.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.647+0000 7ff91aaa8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9141030c0 0x7ff91419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:51.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.647+0000 7ff91aaa8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff91410d250 con 0x7ff9141015b0 2024-08-20T01:30:51.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.647+0000 7ff91aaa8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff91410d0d0 con 0x7ff9141030c0 2024-08-20T01:30:51.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.647+0000 7ff91aaa8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff91410d3d0 con 0x7ff914102700 2024-08-20T01:30:51.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.647+0000 7ff918844640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9141015b0 0x7ff91406b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:51.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.647+0000 7ff918844640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9141015b0 0x7ff91406b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43106/0 (socket says 172.21.15.22:43106) 2024-08-20T01:30:51.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.647+0000 7ff918844640 1 -- 172.21.15.22:0/327743624 learned_addr learned my addr 172.21.15.22:0/327743624 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:51.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.647+0000 7ff90bfff640 1 --2- 172.21.15.22:0/327743624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff914102700 0x7ff91419d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:51.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.647+0000 7ff918844640 1 -- 172.21.15.22:0/327743624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff914102700 msgr2=0x7ff91419d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:51.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.648+0000 7ff918844640 1 --2- 172.21.15.22:0/327743624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff914102700 0x7ff91419d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:51.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.648+0000 7ff919045640 1 --2- 172.21.15.22:0/327743624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9141030c0 0x7ff91419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:51.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.648+0000 7ff918844640 1 -- 172.21.15.22:0/327743624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9141030c0 msgr2=0x7ff91419fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:51.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.648+0000 7ff918844640 1 --2- 172.21.15.22:0/327743624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9141030c0 0x7ff91419fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:51.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.648+0000 7ff918844640 1 -- 172.21.15.22:0/327743624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9141a06a0 con 0x7ff9141015b0 2024-08-20T01:30:51.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.648+0000 7ff90bfff640 1 --2- 172.21.15.22:0/327743624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff914102700 0x7ff91419d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:30:51.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.648+0000 7ff918844640 1 --2- 172.21.15.22:0/327743624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9141015b0 0x7ff91406b8d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff910031440 tx=0x7ff910003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:51.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.648+0000 7ff909ffb640 1 -- 172.21.15.22:0/327743624 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91003f070 con 0x7ff9141015b0 2024-08-20T01:30:51.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.648+0000 7ff91aaa8640 1 -- 172.21.15.22:0/327743624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9141a0930 con 0x7ff9141015b0 2024-08-20T01:30:51.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.648+0000 7ff909ffb640 1 -- 172.21.15.22:0/327743624 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff91003b460 con 0x7ff9141015b0 2024-08-20T01:30:51.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.648+0000 7ff909ffb640 1 -- 172.21.15.22:0/327743624 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff910035030 con 0x7ff9141015b0 2024-08-20T01:30:51.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.648+0000 7ff91aaa8640 1 -- 172.21.15.22:0/327743624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9141a0e20 con 0x7ff9141015b0 2024-08-20T01:30:51.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.649+0000 7ff91aaa8640 1 -- 172.21.15.22:0/327743624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9141088c0 con 0x7ff9141015b0 2024-08-20T01:30:51.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.651+0000 7ff909ffb640 1 -- 172.21.15.22:0/327743624 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7ff910042070 con 0x7ff9141015b0 2024-08-20T01:30:51.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.651+0000 7ff909ffb640 1 --2- 172.21.15.22:0/327743624 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff8fc0b3c60 0x7ff8fc0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:51.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.651+0000 7ff909ffb640 1 -- 172.21.15.22:0/327743624 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7ff910104c10 con 0x7ff9141015b0 2024-08-20T01:30:51.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.651+0000 7ff90bfff640 1 --2- 172.21.15.22:0/327743624 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff8fc0b3c60 0x7ff8fc0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:51.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.652+0000 7ff90bfff640 1 --2- 172.21.15.22:0/327743624 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff8fc0b3c60 0x7ff8fc0b6120 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff90400baa0 tx=0x7ff904005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:51.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.654+0000 7ff909ffb640 1 -- 172.21.15.22:0/327743624 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff9100cc0e0 con 0x7ff9141015b0 2024-08-20T01:30:51.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:51 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/4106865226' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-20T01:30:51.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:51 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/4106865226' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-20T01:30:51.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.842+0000 7ff91aaa8640 1 -- 172.21.15.22:0/327743624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff91402e5d0 con 0x7ff9141015b0 2024-08-20T01:30:51.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.843+0000 7ff909ffb640 1 -- 172.21.15.22:0/327743624 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22700 (secure 0 0 0) 0x7ff9100cb9e0 con 0x7ff9141015b0 2024-08-20T01:30:51.845 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:51.846 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":77,"fsid":"586fd06c-5e92-11ef-bccf-c7b262605968","created":"2024-08-20T01:20:55.065729+0000","modified":"2024-08-20T01:29:55.012566+0000","last_up_change":"2024-08-20T01:28:14.752931+0000","last_in_change":"2024-08-20T01:27:51.812525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:24:31.674035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:29:02.800545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:29:04.951975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b67a59af-5eea-4073-a4b2-604a1b7b8f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6803","nonce":812056903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6805","nonce":812056903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6809","nonce":812056903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6807","nonce":812056903}]},"public_addr":"172.21.15.22:6803/812056903","cluster_addr":"172.21.15.22:6805/812056903","heartbeat_back_addr":"172.21.15.22:6809/812056903","heartbeat_front_addr":"172.21.15.22:6807/812056903","state":["exists","up"]},{"osd":1,"uuid":"9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6801","nonce":823882511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6803","nonce":823882511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6807","nonce":823882511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6805","nonce":823882511}]},"public_addr":"172.21.15.77:6801/823882511","cluster_addr":"172.21.15.77:6803/823882511","heartbeat_back_addr":"172.21.15.77:6807/823882511","heartbeat_front_addr":"172.21.15.77:6805/823882511","state":["exists","up"]},{"osd":2,"uuid":"71e3c019-a3e0-4632-81a8-27ac31279f7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6801","nonce":3873702897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6803","nonce":3873702897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6807","nonce":3873702897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6805","nonce":3873702897}]},"public_addr":"172.21.15.134:6801/3873702897","cluster_addr":"172.21.15.134:6803/3873702897","heartbeat_back_addr":"172.21.15.134:6807/3873702897","heartbeat_front_addr":"172.21.15.134:6805/3873702897","state":["exists","up"]},{"osd":3,"uuid":"a60de748-aa65-477d-864e-6281db1261ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6811","nonce":1775946906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6813","nonce":1775946906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6817","nonce":1775946906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6815","nonce":1775946906}]},"public_addr":"172.21.15.22:6811/1775946906","cluster_addr":"172.21.15.22:6813/1775946906","heartbeat_back_addr":"172.21.15.22:6817/1775946906","heartbeat_front_addr":"172.21.15.22:6815/1775946906","state":["exists","up"]},{"osd":4,"uuid":"07d99671-2ece-471c-ad69-fc9043d917f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6809","nonce":1954209322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6811","nonce":1954209322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6815","nonce":1954209322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6813","nonce":1954209322}]},"public_addr":"172.21.15.77:6809/1954209322","cluster_addr":"172.21.15.77:6811/1954209322","heartbeat_back_addr":"172.21.15.77:6815/1954209322","heartbeat_front_addr":"172.21.15.77:6813/1954209322","state":["exists","up"]},{"osd":5,"uuid":"971cac33-0b98-49b1-b4b2-27354fc0ab90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6809","nonce":2805488123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6811","nonce":2805488123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6815","nonce":2805488123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6813","nonce":2805488123}]},"public_addr":"172.21.15.134:6809/2805488123","cluster_addr":"172.21.15.134:6811/2805488123","heartbeat_back_addr":"172.21.15.134:6815/2805488123","heartbeat_front_addr":"172.21.15.134:6813/2805488123","state":["exists","up"]},{"osd":6,"uuid":"48d90292-8511-47d6-8093-330bd13ae70e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6819","nonce":3804882416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6821","nonce":3804882416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6825","nonce":3804882416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6823","nonce":3804882416}]},"public_addr":"172.21.15.22:6819/3804882416","cluster_addr":"172.21.15.22:6821/3804882416","heartbeat_back_addr":"172.21.15.22:6825/3804882416","heartbeat_front_addr":"172.21.15.22:6823/3804882416","state":["exists","up"]},{"osd":7,"uuid":"e217112d-9f56-4a48-93bf-6eb052ce540a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6817","nonce":700318902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6819","nonce":700318902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6823","nonce":700318902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6821","nonce":700318902}]},"public_addr":"172.21.15.77:6817/700318902","cluster_addr":"172.21.15.77:6819/700318902","heartbeat_back_addr":"172.21.15.77:6823/700318902","heartbeat_front_addr":"172.21.15.77:6821/700318902","state":["exists","up"]},{"osd":8,"uuid":"1786747c-6ff6-4e00-bcf6-a8176215847f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6817","nonce":1635473481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6819","nonce":1635473481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6823","nonce":1635473481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6821","nonce":1635473481}]},"public_addr":"172.21.15.134:6817/1635473481","cluster_addr":"172.21.15.134:6819/1635473481","heartbeat_back_addr":"172.21.15.134:6823/1635473481","heartbeat_front_addr":"172.21.15.134:6821/1635473481","state":["exists","up"]},{"osd":9,"uuid":"708f7390-1b51-4397-a92a-8ff3f4a5bc45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6827","nonce":3899297933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6829","nonce":3899297933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6833","nonce":3899297933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6831","nonce":3899297933}]},"public_addr":"172.21.15.22:6827/3899297933","cluster_addr":"172.21.15.22:6829/3899297933","heartbeat_back_addr":"172.21.15.22:6833/3899297933","heartbeat_front_addr":"172.21.15.22:6831/3899297933","state":["exists","up"]},{"osd":10,"uuid":"d15b0acd-dd08-431d-88aa-756b6420987d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6825","nonce":2765589872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6827","nonce":2765589872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6831","nonce":2765589872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6829","nonce":2765589872}]},"public_addr":"172.21.15.77:6825/2765589872","cluster_addr":"172.21.15.77:6827/2765589872","heartbeat_back_addr":"172.21.15.77:6831/2765589872","heartbeat_front_addr":"172.21.15.77:6829/2765589872","state":["exists","up"]},{"osd":11,"uuid":"d15017fa-3c3d-4096-a35d-275cd54bb9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6825","nonce":964533669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6827","nonce":964533669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6831","nonce":964533669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6829","nonce":964533669}]},"public_addr":"172.21.15.134:6825/964533669","cluster_addr":"172.21.15.134:6827/964533669","heartbeat_back_addr":"172.21.15.134:6831/964533669","heartbeat_front_addr":"172.21.15.134:6829/964533669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:23:40.839725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:05.141389+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:28.340737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:52.028949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:17.029913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:42.092826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:07.831100+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:33.380447+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:58.772655+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:23.017208+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:47.966711+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:28:13.123047+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/416470260":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6800/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/1142422661":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:6800/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/2093308719":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/3772866379":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3424402756":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3864772624":"2024-08-21T01:21:28.981981+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:30:51.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.846+0000 7ff91aaa8640 1 -- 172.21.15.22:0/327743624 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff8fc0b3c60 msgr2=0x7ff8fc0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:51.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.846+0000 7ff91aaa8640 1 --2- 172.21.15.22:0/327743624 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff8fc0b3c60 0x7ff8fc0b6120 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff90400baa0 tx=0x7ff904005d90 comp rx=0 tx=0).stop 2024-08-20T01:30:51.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.846+0000 7ff91aaa8640 1 -- 172.21.15.22:0/327743624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9141015b0 msgr2=0x7ff91406b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:51.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.846+0000 7ff91aaa8640 1 --2- 172.21.15.22:0/327743624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9141015b0 0x7ff91406b8d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff910031440 tx=0x7ff910003d50 comp rx=0 tx=0).stop 2024-08-20T01:30:51.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.846+0000 7ff91aaa8640 1 -- 172.21.15.22:0/327743624 shutdown_connections 2024-08-20T01:30:51.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.846+0000 7ff91aaa8640 1 --2- 172.21.15.22:0/327743624 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff8fc0b3c60 0x7ff8fc0b6120 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:51.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.846+0000 7ff91aaa8640 1 --2- 172.21.15.22:0/327743624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9141030c0 0x7ff91419fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:51.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.846+0000 7ff91aaa8640 1 --2- 172.21.15.22:0/327743624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff914102700 0x7ff91419d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:51.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.846+0000 7ff91aaa8640 1 --2- 172.21.15.22:0/327743624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9141015b0 0x7ff91406b8d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:51.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.846+0000 7ff91aaa8640 1 -- 172.21.15.22:0/327743624 >> 172.21.15.22:0/327743624 conn(0x7ff9140fce50 msgr2=0x7ff914105a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:51.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.846+0000 7ff91aaa8640 1 -- 172.21.15.22:0/327743624 shutdown_connections 2024-08-20T01:30:51.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.846+0000 7ff91aaa8640 1 -- 172.21.15.22:0/327743624 wait complete. 2024-08-20T01:30:51.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:51 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/4106865226' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-20T01:30:51.859 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-20T01:24:31.674035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-20T01:29:02.800545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-20T01:29:04.951975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-20T01:30:51.860 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-20T01:30:51.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.967+0000 7ff186c51640 1 -- 172.21.15.22:0/498741307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1801026f0 msgr2=0x7ff180102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:51.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.967+0000 7ff186c51640 1 --2- 172.21.15.22:0/498741307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1801026f0 0x7ff180102b70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009930 tx=0x7ff16c02a420 comp rx=0 tx=0).stop 2024-08-20T01:30:51.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.967+0000 7ff186c51640 1 -- 172.21.15.22:0/498741307 shutdown_connections 2024-08-20T01:30:51.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.967+0000 7ff186c51640 1 --2- 172.21.15.22:0/498741307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1801030b0 0x7ff180109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:51.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.967+0000 7ff186c51640 1 --2- 172.21.15.22:0/498741307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1801026f0 0x7ff180102b70 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:51.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.967+0000 7ff186c51640 1 --2- 172.21.15.22:0/498741307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1801015a0 0x7ff1801019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:51.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.967+0000 7ff186c51640 1 -- 172.21.15.22:0/498741307 >> 172.21.15.22:0/498741307 conn(0x7ff1800fce40 msgr2=0x7ff1800ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:51.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.967+0000 7ff186c51640 1 -- 172.21.15.22:0/498741307 shutdown_connections 2024-08-20T01:30:51.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.967+0000 7ff186c51640 1 -- 172.21.15.22:0/498741307 wait complete. 2024-08-20T01:30:51.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.968+0000 7ff186c51640 1 Processor -- start 2024-08-20T01:30:51.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.968+0000 7ff186c51640 1 -- start start 2024-08-20T01:30:51.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.968+0000 7ff186c51640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1801015a0 0x7ff180198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:51.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.968+0000 7ff186c51640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1801026f0 0x7ff180199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:51.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.968+0000 7ff186c51640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1801030b0 0x7ff180199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:51.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.968+0000 7ff186c51640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff18010d260 con 0x7ff1801030b0 2024-08-20T01:30:51.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.968+0000 7ff186c51640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff18010d0e0 con 0x7ff1801026f0 2024-08-20T01:30:51.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.968+0000 7ff186c51640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff18010d3e0 con 0x7ff1801015a0 2024-08-20T01:30:51.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.968+0000 7ff1851ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1801030b0 0x7ff180199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:51.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.968+0000 7ff1849ed640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1801015a0 0x7ff180198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:51.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.968+0000 7ff1851ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1801030b0 0x7ff180199d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43126/0 (socket says 172.21.15.22:43126) 2024-08-20T01:30:51.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.968+0000 7ff1851ee640 1 -- 172.21.15.22:0/407335498 learned_addr learned my addr 172.21.15.22:0/407335498 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:51.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.968+0000 7ff17ffff640 1 --2- 172.21.15.22:0/407335498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1801026f0 0x7ff180199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:51.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.968+0000 7ff1851ee640 1 -- 172.21.15.22:0/407335498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1801015a0 msgr2=0x7ff180198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:51.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.968+0000 7ff1851ee640 1 --2- 172.21.15.22:0/407335498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1801015a0 0x7ff180198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:51.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.968+0000 7ff1851ee640 1 -- 172.21.15.22:0/407335498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1801026f0 msgr2=0x7ff180199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:51.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.968+0000 7ff1851ee640 1 --2- 172.21.15.22:0/407335498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1801026f0 0x7ff180199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:51.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.968+0000 7ff1851ee640 1 -- 172.21.15.22:0/407335498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18019a620 con 0x7ff1801030b0 2024-08-20T01:30:51.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.969+0000 7ff1851ee640 1 --2- 172.21.15.22:0/407335498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1801030b0 0x7ff180199d60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff17800eb10 tx=0x7ff17800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:51.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.969+0000 7ff17dffb640 1 -- 172.21.15.22:0/407335498 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178004b20 con 0x7ff1801030b0 2024-08-20T01:30:51.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.969+0000 7ff186c51640 1 -- 172.21.15.22:0/407335498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18019a910 con 0x7ff1801030b0 2024-08-20T01:30:51.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.969+0000 7ff17dffb640 1 -- 172.21.15.22:0/407335498 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff178004cc0 con 0x7ff1801030b0 2024-08-20T01:30:51.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.969+0000 7ff17dffb640 1 -- 172.21.15.22:0/407335498 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178010670 con 0x7ff1801030b0 2024-08-20T01:30:51.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.969+0000 7ff186c51640 1 -- 172.21.15.22:0/407335498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1801a0fe0 con 0x7ff1801030b0 2024-08-20T01:30:51.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.970+0000 7ff186c51640 1 -- 172.21.15.22:0/407335498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1801a11b0 con 0x7ff1801030b0 2024-08-20T01:30:51.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.971+0000 7ff17dffb640 1 -- 172.21.15.22:0/407335498 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7ff178005020 con 0x7ff1801030b0 2024-08-20T01:30:51.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.972+0000 7ff17dffb640 1 --2- 172.21.15.22:0/407335498 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff1700b3c60 0x7ff1700b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:51.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.972+0000 7ff1849ed640 1 --2- 172.21.15.22:0/407335498 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff1700b3c60 0x7ff1700b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:51.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.972+0000 7ff17dffb640 1 -- 172.21.15.22:0/407335498 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7ff1780e43c0 con 0x7ff1801030b0 2024-08-20T01:30:51.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.972+0000 7ff1849ed640 1 --2- 172.21.15.22:0/407335498 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff1700b3c60 0x7ff1700b6120 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff174005fd0 tx=0x7ff17400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:51.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:51.976+0000 7ff17dffb640 1 -- 172.21.15.22:0/407335498 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff1780ab830 con 0x7ff1801030b0 2024-08-20T01:30:52.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.161+0000 7ff186c51640 1 -- 172.21.15.22:0/407335498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff1801a1380 con 0x7ff1801030b0 2024-08-20T01:30:52.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.161+0000 7ff17dffb640 1 -- 172.21.15.22:0/407335498 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7ff1780ab130 con 0x7ff1801030b0 2024-08-20T01:30:52.162 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-08-20T01:30:52.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.164+0000 7ff186c51640 1 -- 172.21.15.22:0/407335498 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff1700b3c60 msgr2=0x7ff1700b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:52.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.164+0000 7ff186c51640 1 --2- 172.21.15.22:0/407335498 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff1700b3c60 0x7ff1700b6120 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff174005fd0 tx=0x7ff17400b390 comp rx=0 tx=0).stop 2024-08-20T01:30:52.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.164+0000 7ff186c51640 1 -- 172.21.15.22:0/407335498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1801030b0 msgr2=0x7ff180199d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:52.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.164+0000 7ff186c51640 1 --2- 172.21.15.22:0/407335498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1801030b0 0x7ff180199d60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff17800eb10 tx=0x7ff17800c2d0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.164+0000 7ff186c51640 1 -- 172.21.15.22:0/407335498 shutdown_connections 2024-08-20T01:30:52.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.164+0000 7ff186c51640 1 --2- 172.21.15.22:0/407335498 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff1700b3c60 0x7ff1700b6120 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.164+0000 7ff186c51640 1 --2- 172.21.15.22:0/407335498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1801030b0 0x7ff180199d60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.164+0000 7ff186c51640 1 --2- 172.21.15.22:0/407335498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1801026f0 0x7ff180199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.164+0000 7ff186c51640 1 --2- 172.21.15.22:0/407335498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1801015a0 0x7ff180198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.164+0000 7ff186c51640 1 -- 172.21.15.22:0/407335498 >> 172.21.15.22:0/407335498 conn(0x7ff1800fce40 msgr2=0x7ff1800fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:52.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.164+0000 7ff186c51640 1 -- 172.21.15.22:0/407335498 shutdown_connections 2024-08-20T01:30:52.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.164+0000 7ff186c51640 1 -- 172.21.15.22:0/407335498 wait complete. 2024-08-20T01:30:52.176 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-20T01:30:52.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.281+0000 7f7505cee640 1 -- 172.21.15.22:0/2064190691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7500107bc0 msgr2=0x7f7500109fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:52.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.281+0000 7f7505cee640 1 --2- 172.21.15.22:0/2064190691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7500107bc0 0x7f7500109fb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009900 tx=0x7f74e802a410 comp rx=0 tx=0).stop 2024-08-20T01:30:52.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.281+0000 7f7505cee640 1 -- 172.21.15.22:0/2064190691 shutdown_connections 2024-08-20T01:30:52.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.281+0000 7f7505cee640 1 --2- 172.21.15.22:0/2064190691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f750010a5d0 0x7f750010ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.281+0000 7f7505cee640 1 --2- 172.21.15.22:0/2064190691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7500107bc0 0x7f7500109fb0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.281+0000 7f7505cee640 1 --2- 172.21.15.22:0/2064190691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f750006ab70 0x7f7500107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.281+0000 7f7505cee640 1 -- 172.21.15.22:0/2064190691 >> 172.21.15.22:0/2064190691 conn(0x7f75000fce50 msgr2=0x7f75000ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:52.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.281+0000 7f7505cee640 1 -- 172.21.15.22:0/2064190691 shutdown_connections 2024-08-20T01:30:52.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.281+0000 7f7505cee640 1 -- 172.21.15.22:0/2064190691 wait complete. 2024-08-20T01:30:52.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.282+0000 7f7505cee640 1 Processor -- start 2024-08-20T01:30:52.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.282+0000 7f7505cee640 1 -- start start 2024-08-20T01:30:52.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.282+0000 7f7505cee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f750006ab70 0x7f750019aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:52.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.282+0000 7f7505cee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7500107bc0 0x7f750019b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:52.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.282+0000 7f7505cee640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f750010a5d0 0x7f750019bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:52.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.282+0000 7f7505cee640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f75001104f0 con 0x7f750006ab70 2024-08-20T01:30:52.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.282+0000 7f7505cee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7500110370 con 0x7f7500107bc0 2024-08-20T01:30:52.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.282+0000 7f7505cee640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7500110670 con 0x7f750010a5d0 2024-08-20T01:30:52.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.282+0000 7f74ff7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f750006ab70 0x7f750019aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:52.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.282+0000 7f74ff7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f750006ab70 0x7f750019aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43142/0 (socket says 172.21.15.22:43142) 2024-08-20T01:30:52.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.282+0000 7f74ff7fe640 1 -- 172.21.15.22:0/3172360157 learned_addr learned my addr 172.21.15.22:0/3172360157 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:52.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.282+0000 7f74feffd640 1 --2- 172.21.15.22:0/3172360157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7500107bc0 0x7f750019b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:52.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.282+0000 7f74fffff640 1 --2- 172.21.15.22:0/3172360157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f750010a5d0 0x7f750019bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:52.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.282+0000 7f74ff7fe640 1 -- 172.21.15.22:0/3172360157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f750010a5d0 msgr2=0x7f750019bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:52.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.282+0000 7f74ff7fe640 1 --2- 172.21.15.22:0/3172360157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f750010a5d0 0x7f750019bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.282+0000 7f74ff7fe640 1 -- 172.21.15.22:0/3172360157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7500107bc0 msgr2=0x7f750019b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:52.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.282+0000 7f74ff7fe640 1 --2- 172.21.15.22:0/3172360157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7500107bc0 0x7f750019b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.282+0000 7f74ff7fe640 1 -- 172.21.15.22:0/3172360157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f750019c7e0 con 0x7f750006ab70 2024-08-20T01:30:52.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.282+0000 7f74fffff640 1 --2- 172.21.15.22:0/3172360157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f750010a5d0 0x7f750019bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:30:52.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.283+0000 7f74ff7fe640 1 --2- 172.21.15.22:0/3172360157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f750006ab70 0x7f750019aca0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f74f000d950 tx=0x7f74f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:52.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.283+0000 7f74fcff9640 1 -- 172.21.15.22:0/3172360157 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f0017030 con 0x7f750006ab70 2024-08-20T01:30:52.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.283+0000 7f74fcff9640 1 -- 172.21.15.22:0/3172360157 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74f0004020 con 0x7f750006ab70 2024-08-20T01:30:52.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.283+0000 7f74fcff9640 1 -- 172.21.15.22:0/3172360157 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f00047a0 con 0x7f750006ab70 2024-08-20T01:30:52.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.283+0000 7f7505cee640 1 -- 172.21.15.22:0/3172360157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f750019cad0 con 0x7f750006ab70 2024-08-20T01:30:52.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.283+0000 7f7505cee640 1 -- 172.21.15.22:0/3172360157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75001a31a0 con 0x7f750006ab70 2024-08-20T01:30:52.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.284+0000 7f7505cee640 1 -- 172.21.15.22:0/3172360157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7500107680 con 0x7f750006ab70 2024-08-20T01:30:52.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.285+0000 7f74fcff9640 1 -- 172.21.15.22:0/3172360157 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f74f0009a30 con 0x7f750006ab70 2024-08-20T01:30:52.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.286+0000 7f74fcff9640 1 --2- 172.21.15.22:0/3172360157 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f74ec0b3c60 0x7f74ec0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:52.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.286+0000 7f74fcff9640 1 -- 172.21.15.22:0/3172360157 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f74f00e3ed0 con 0x7f750006ab70 2024-08-20T01:30:52.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.286+0000 7f74feffd640 1 --2- 172.21.15.22:0/3172360157 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f74ec0b3c60 0x7f74ec0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:52.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.287+0000 7f74feffd640 1 --2- 172.21.15.22:0/3172360157 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f74ec0b3c60 0x7f74ec0b6120 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009230 tx=0x7f74e80314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:52.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.289+0000 7f74fcff9640 1 -- 172.21.15.22:0/3172360157 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f74f00ab3a0 con 0x7f750006ab70 2024-08-20T01:30:52.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.476+0000 7f7505cee640 1 -- 172.21.15.22:0/3172360157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f750002e340 con 0x7f750006ab70 2024-08-20T01:30:52.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.476+0000 7f74fcff9640 1 -- 172.21.15.22:0/3172360157 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) ==== 104+0+11 (secure 0 0 0) 0x7f74f00aaca0 con 0x7f750006ab70 2024-08-20T01:30:52.477 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-08-20T01:30:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.478+0000 7f7505cee640 1 -- 172.21.15.22:0/3172360157 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f74ec0b3c60 msgr2=0x7f74ec0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.478+0000 7f7505cee640 1 --2- 172.21.15.22:0/3172360157 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f74ec0b3c60 0x7f74ec0b6120 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009230 tx=0x7f74e80314a0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.478+0000 7f7505cee640 1 -- 172.21.15.22:0/3172360157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f750006ab70 msgr2=0x7f750019aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.478+0000 7f7505cee640 1 --2- 172.21.15.22:0/3172360157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f750006ab70 0x7f750019aca0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f74f000d950 tx=0x7f74f000de10 comp rx=0 tx=0).stop 2024-08-20T01:30:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.478+0000 7f7505cee640 1 -- 172.21.15.22:0/3172360157 shutdown_connections 2024-08-20T01:30:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.478+0000 7f7505cee640 1 --2- 172.21.15.22:0/3172360157 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f74ec0b3c60 0x7f74ec0b6120 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.478+0000 7f7505cee640 1 --2- 172.21.15.22:0/3172360157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f750010a5d0 0x7f750019bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.478+0000 7f7505cee640 1 --2- 172.21.15.22:0/3172360157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7500107bc0 0x7f750019b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.478+0000 7f7505cee640 1 --2- 172.21.15.22:0/3172360157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f750006ab70 0x7f750019aca0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.478+0000 7f7505cee640 1 -- 172.21.15.22:0/3172360157 >> 172.21.15.22:0/3172360157 conn(0x7f75000fce50 msgr2=0x7f75001087c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.478+0000 7f7505cee640 1 -- 172.21.15.22:0/3172360157 shutdown_connections 2024-08-20T01:30:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.478+0000 7f7505cee640 1 -- 172.21.15.22:0/3172360157 wait complete. 2024-08-20T01:30:52.490 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-20T01:30:52.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.596+0000 7f028392a640 1 -- 172.21.15.22:0/4138003698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f027c1026c0 msgr2=0x7f027c102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:52.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.596+0000 7f028392a640 1 --2- 172.21.15.22:0/4138003698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f027c1026c0 0x7f027c102b40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f026c009930 tx=0x7f026c02a420 comp rx=0 tx=0).stop 2024-08-20T01:30:52.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.596+0000 7f028392a640 1 -- 172.21.15.22:0/4138003698 shutdown_connections 2024-08-20T01:30:52.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.596+0000 7f028392a640 1 --2- 172.21.15.22:0/4138003698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f027c103080 0x7f027c109a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.596+0000 7f028392a640 1 --2- 172.21.15.22:0/4138003698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f027c1026c0 0x7f027c102b40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.596+0000 7f028392a640 1 --2- 172.21.15.22:0/4138003698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f027c101570 0x7f027c101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.596+0000 7f028392a640 1 -- 172.21.15.22:0/4138003698 >> 172.21.15.22:0/4138003698 conn(0x7f027c0fce50 msgr2=0x7f027c0ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:52.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.596+0000 7f028392a640 1 -- 172.21.15.22:0/4138003698 shutdown_connections 2024-08-20T01:30:52.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.596+0000 7f028392a640 1 -- 172.21.15.22:0/4138003698 wait complete. 2024-08-20T01:30:52.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.596+0000 7f028392a640 1 Processor -- start 2024-08-20T01:30:52.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.597+0000 7f028392a640 1 -- start start 2024-08-20T01:30:52.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.597+0000 7f028392a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f027c101570 0x7f027c198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:52.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.597+0000 7f028392a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f027c1026c0 0x7f027c199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:52.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.597+0000 7f028392a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f027c103080 0x7f027c199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:52.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.597+0000 7f028392a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f027c10d1e0 con 0x7f027c103080 2024-08-20T01:30:52.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.597+0000 7f028392a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f027c10d060 con 0x7f027c1026c0 2024-08-20T01:30:52.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.597+0000 7f028392a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f027c10d360 con 0x7f027c101570 2024-08-20T01:30:52.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.597+0000 7f0281ec7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f027c103080 0x7f027c199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:52.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.597+0000 7f0281ec7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f027c103080 0x7f027c199d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43158/0 (socket says 172.21.15.22:43158) 2024-08-20T01:30:52.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.597+0000 7f0281ec7640 1 -- 172.21.15.22:0/1274084061 learned_addr learned my addr 172.21.15.22:0/1274084061 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:52.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.597+0000 7f0280ec5640 1 --2- 172.21.15.22:0/1274084061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f027c1026c0 0x7f027c199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:52.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.597+0000 7f02816c6640 1 --2- 172.21.15.22:0/1274084061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f027c101570 0x7f027c198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:52.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.597+0000 7f0281ec7640 1 -- 172.21.15.22:0/1274084061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f027c101570 msgr2=0x7f027c198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:52.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.597+0000 7f0281ec7640 1 --2- 172.21.15.22:0/1274084061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f027c101570 0x7f027c198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.597+0000 7f0281ec7640 1 -- 172.21.15.22:0/1274084061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f027c1026c0 msgr2=0x7f027c199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:52.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.597+0000 7f0281ec7640 1 --2- 172.21.15.22:0/1274084061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f027c1026c0 0x7f027c199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.597+0000 7f0281ec7640 1 -- 172.21.15.22:0/1274084061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027c19a5f0 con 0x7f027c103080 2024-08-20T01:30:52.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.597+0000 7f0281ec7640 1 --2- 172.21.15.22:0/1274084061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f027c103080 0x7f027c199d30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f027400eb10 tx=0x7f027400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:52.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.597+0000 7f02727fc640 1 -- 172.21.15.22:0/1274084061 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0274004b20 con 0x7f027c103080 2024-08-20T01:30:52.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.598+0000 7f028392a640 1 -- 172.21.15.22:0/1274084061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f027c19a8e0 con 0x7f027c103080 2024-08-20T01:30:52.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.598+0000 7f02727fc640 1 -- 172.21.15.22:0/1274084061 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0274004cc0 con 0x7f027c103080 2024-08-20T01:30:52.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.598+0000 7f02727fc640 1 -- 172.21.15.22:0/1274084061 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0274010670 con 0x7f027c103080 2024-08-20T01:30:52.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.598+0000 7f028392a640 1 -- 172.21.15.22:0/1274084061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f027c1a0fb0 con 0x7f027c103080 2024-08-20T01:30:52.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.598+0000 7f028392a640 1 -- 172.21.15.22:0/1274084061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f027c1a1180 con 0x7f027c103080 2024-08-20T01:30:52.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.601+0000 7f02727fc640 1 -- 172.21.15.22:0/1274084061 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f0274005000 con 0x7f027c103080 2024-08-20T01:30:52.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.601+0000 7f02727fc640 1 --2- 172.21.15.22:0/1274084061 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f02680b3c60 0x7f02680b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:52.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.602+0000 7f02816c6640 1 --2- 172.21.15.22:0/1274084061 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f02680b3c60 0x7f02680b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:52.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.602+0000 7f02727fc640 1 -- 172.21.15.22:0/1274084061 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f02740e4500 con 0x7f027c103080 2024-08-20T01:30:52.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.602+0000 7f02816c6640 1 --2- 172.21.15.22:0/1274084061 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f02680b3c60 0x7f02680b6120 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0278005fd0 tx=0x7f027800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:52.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.604+0000 7f02727fc640 1 -- 172.21.15.22:0/1274084061 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f0274055e20 con 0x7f027c103080 2024-08-20T01:30:52.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:52 smithi134 ceph-mon[22511]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-20T01:30:52.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:52 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/4106865226' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-20T01:30:52.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:52 smithi134 ceph-mon[22511]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:30:52.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:52 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/327743624' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:30:52.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:52 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/407335498' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T01:30:52.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:52 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3172360157' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-20T01:30:52.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.791+0000 7f028392a640 1 -- 172.21.15.22:0/1274084061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f027c1a1350 con 0x7f027c103080 2024-08-20T01:30:52.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.792+0000 7f02727fc640 1 -- 172.21.15.22:0/1274084061 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) ==== 100+0+11 (secure 0 0 0) 0x7f02740ab9d0 con 0x7f027c103080 2024-08-20T01:30:52.793 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-08-20T01:30:52.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.794+0000 7f028392a640 1 -- 172.21.15.22:0/1274084061 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f02680b3c60 msgr2=0x7f02680b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:52.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.794+0000 7f028392a640 1 --2- 172.21.15.22:0/1274084061 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f02680b3c60 0x7f02680b6120 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0278005fd0 tx=0x7f027800b390 comp rx=0 tx=0).stop 2024-08-20T01:30:52.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.794+0000 7f028392a640 1 -- 172.21.15.22:0/1274084061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f027c103080 msgr2=0x7f027c199d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:52.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.794+0000 7f028392a640 1 --2- 172.21.15.22:0/1274084061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f027c103080 0x7f027c199d30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f027400eb10 tx=0x7f027400c2d0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.794+0000 7f028392a640 1 -- 172.21.15.22:0/1274084061 shutdown_connections 2024-08-20T01:30:52.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.794+0000 7f028392a640 1 --2- 172.21.15.22:0/1274084061 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f02680b3c60 0x7f02680b6120 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.794+0000 7f028392a640 1 --2- 172.21.15.22:0/1274084061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f027c103080 0x7f027c199d30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.794+0000 7f028392a640 1 --2- 172.21.15.22:0/1274084061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f027c1026c0 0x7f027c199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.794+0000 7f028392a640 1 --2- 172.21.15.22:0/1274084061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f027c101570 0x7f027c198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:52.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.794+0000 7f028392a640 1 -- 172.21.15.22:0/1274084061 >> 172.21.15.22:0/1274084061 conn(0x7f027c0fce50 msgr2=0x7f027c0fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:52.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.794+0000 7f028392a640 1 -- 172.21.15.22:0/1274084061 shutdown_connections 2024-08-20T01:30:52.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:52.794+0000 7f028392a640 1 -- 172.21.15.22:0/1274084061 wait complete. 2024-08-20T01:30:52.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:52 smithi022 ceph-mon[18709]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-20T01:30:52.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:52 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/4106865226' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-20T01:30:52.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:52 smithi022 ceph-mon[18709]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:30:52.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:52 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/327743624' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:30:52.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:52 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/407335498' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T01:30:52.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:52 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3172360157' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-20T01:30:52.806 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-08-20T01:30:52.806 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:30:52.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:52 smithi077 ceph-mon[22251]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-20T01:30:52.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:52 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/4106865226' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-20T01:30:52.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:52 smithi077 ceph-mon[22251]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:30:52.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:52 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/327743624' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:30:52.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:52 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/407335498' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T01:30:52.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:52 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3172360157' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-20T01:30:53.064 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:53.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.552+0000 7f5e0fbe0640 1 -- 172.21.15.22:0/4180070965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e08107d60 msgr2=0x7f5e0810e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:53.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.552+0000 7f5e0fbe0640 1 --2- 172.21.15.22:0/4180070965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e08107d60 0x7f5e0810e560 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009ca0 tx=0x7f5e0002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:30:53.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.552+0000 7f5e0fbe0640 1 -- 172.21.15.22:0/4180070965 shutdown_connections 2024-08-20T01:30:53.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.552+0000 7f5e0fbe0640 1 --2- 172.21.15.22:0/4180070965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e08107d60 0x7f5e0810e560 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:53.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.552+0000 7f5e0fbe0640 1 --2- 172.21.15.22:0/4180070965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e081073e0 0x7f5e08107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:53.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.552+0000 7f5e0fbe0640 1 --2- 172.21.15.22:0/4180070965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e081019d0 0x7f5e08101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:53.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.552+0000 7f5e0fbe0640 1 -- 172.21.15.22:0/4180070965 >> 172.21.15.22:0/4180070965 conn(0x7f5e080fd440 msgr2=0x7f5e080ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:53.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.552+0000 7f5e0fbe0640 1 -- 172.21.15.22:0/4180070965 shutdown_connections 2024-08-20T01:30:53.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.552+0000 7f5e0fbe0640 1 -- 172.21.15.22:0/4180070965 wait complete. 2024-08-20T01:30:53.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.553+0000 7f5e0fbe0640 1 Processor -- start 2024-08-20T01:30:53.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.553+0000 7f5e0fbe0640 1 -- start start 2024-08-20T01:30:53.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.553+0000 7f5e0fbe0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e081019d0 0x7f5e08198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:53.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.553+0000 7f5e0fbe0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e081073e0 0x7f5e08199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:53.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.553+0000 7f5e0fbe0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e08107d60 0x7f5e0819e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:53.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.553+0000 7f5e0fbe0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5e081119e0 con 0x7f5e081019d0 2024-08-20T01:30:53.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.553+0000 7f5e0fbe0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5e08111860 con 0x7f5e08107d60 2024-08-20T01:30:53.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.553+0000 7f5e0fbe0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5e08111b60 con 0x7f5e081073e0 2024-08-20T01:30:53.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.553+0000 7f5e0d97c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e081019d0 0x7f5e08198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:53.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.553+0000 7f5e0d97c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e081019d0 0x7f5e08198f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43176/0 (socket says 172.21.15.22:43176) 2024-08-20T01:30:53.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.553+0000 7f5e0d97c640 1 -- 172.21.15.22:0/2089176525 learned_addr learned my addr 172.21.15.22:0/2089176525 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:53.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.554+0000 7f5e0e17d640 1 --2- 172.21.15.22:0/2089176525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e08107d60 0x7f5e0819e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:53.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.554+0000 7f5e0d17b640 1 --2- 172.21.15.22:0/2089176525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e081073e0 0x7f5e08199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:53.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.554+0000 7f5e0d97c640 1 -- 172.21.15.22:0/2089176525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e081073e0 msgr2=0x7f5e08199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:53.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.554+0000 7f5e0d97c640 1 --2- 172.21.15.22:0/2089176525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e081073e0 0x7f5e08199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:53.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.554+0000 7f5e0d97c640 1 -- 172.21.15.22:0/2089176525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e08107d60 msgr2=0x7f5e0819e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:53.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.554+0000 7f5e0d97c640 1 --2- 172.21.15.22:0/2089176525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e08107d60 0x7f5e0819e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:53.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.554+0000 7f5e0d97c640 1 -- 172.21.15.22:0/2089176525 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0819eff0 con 0x7f5e081019d0 2024-08-20T01:30:53.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.554+0000 7f5e0d97c640 1 --2- 172.21.15.22:0/2089176525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e081019d0 0x7f5e08198f40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400d950 tx=0x7f5e0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:53.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.554+0000 7f5dfeffd640 1 -- 172.21.15.22:0/2089176525 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04017070 con 0x7f5e081019d0 2024-08-20T01:30:53.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.554+0000 7f5e0fbe0640 1 -- 172.21.15.22:0/2089176525 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e0819f2e0 con 0x7f5e081019d0 2024-08-20T01:30:53.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.554+0000 7f5dfeffd640 1 -- 172.21.15.22:0/2089176525 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e04009c30 con 0x7f5e081019d0 2024-08-20T01:30:53.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.554+0000 7f5dfeffd640 1 -- 172.21.15.22:0/2089176525 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400f620 con 0x7f5e081019d0 2024-08-20T01:30:53.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.554+0000 7f5e0fbe0640 1 -- 172.21.15.22:0/2089176525 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e081a5b70 con 0x7f5e081019d0 2024-08-20T01:30:53.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.555+0000 7f5e0fbe0640 1 -- 172.21.15.22:0/2089176525 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e08101db0 con 0x7f5e081019d0 2024-08-20T01:30:53.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.556+0000 7f5dfeffd640 1 -- 172.21.15.22:0/2089176525 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f5e04010460 con 0x7f5e081019d0 2024-08-20T01:30:53.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.557+0000 7f5dfeffd640 1 --2- 172.21.15.22:0/2089176525 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5df40b3c60 0x7f5df40b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:53.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.557+0000 7f5e0d17b640 1 --2- 172.21.15.22:0/2089176525 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5df40b3c60 0x7f5df40b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:53.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.557+0000 7f5dfeffd640 1 -- 172.21.15.22:0/2089176525 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8269+0+0 (secure 0 0 0) 0x7f5e040e3af0 con 0x7f5e081019d0 2024-08-20T01:30:53.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.558+0000 7f5e0d17b640 1 --2- 172.21.15.22:0/2089176525 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5df40b3c60 0x7f5df40b6120 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5df8005fd0 tx=0x7f5df8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:53.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.561+0000 7f5dfeffd640 1 -- 172.21.15.22:0/2089176525 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f5e040aaf60 con 0x7f5e081019d0 2024-08-20T01:30:53.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:53 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1274084061' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-20T01:30:53.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.812+0000 7f5e0fbe0640 1 -- 172.21.15.22:0/2089176525 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e081a5d40 con 0x7f5e081019d0 2024-08-20T01:30:53.813 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:53 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1274084061' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-20T01:30:53.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.812+0000 7f5dfeffd640 1 -- 172.21.15.22:0/2089176525 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11906 (secure 0 0 0) 0x7f5e04009de0 con 0x7f5e081019d0 2024-08-20T01:30:53.813 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:53.814 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"btime":"2024-08-20T01:30:51:488019+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:30:50.622248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24586,24575,24565]},"id":1}]} 2024-08-20T01:30:53.814 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 25 2024-08-20T01:30:53.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:53 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1274084061' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-20T01:30:53.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.814+0000 7f5e0fbe0640 1 -- 172.21.15.22:0/2089176525 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5df40b3c60 msgr2=0x7f5df40b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:53.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.814+0000 7f5e0fbe0640 1 --2- 172.21.15.22:0/2089176525 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5df40b3c60 0x7f5df40b6120 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5df8005fd0 tx=0x7f5df8005850 comp rx=0 tx=0).stop 2024-08-20T01:30:53.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.814+0000 7f5e0fbe0640 1 -- 172.21.15.22:0/2089176525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e081019d0 msgr2=0x7f5e08198f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:53.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.814+0000 7f5e0fbe0640 1 --2- 172.21.15.22:0/2089176525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e081019d0 0x7f5e08198f40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400d950 tx=0x7f5e0400de10 comp rx=0 tx=0).stop 2024-08-20T01:30:53.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.814+0000 7f5e0fbe0640 1 -- 172.21.15.22:0/2089176525 shutdown_connections 2024-08-20T01:30:53.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.814+0000 7f5e0fbe0640 1 --2- 172.21.15.22:0/2089176525 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5df40b3c60 0x7f5df40b6120 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:53.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.814+0000 7f5e0fbe0640 1 --2- 172.21.15.22:0/2089176525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e08107d60 0x7f5e0819e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:53.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.814+0000 7f5e0fbe0640 1 --2- 172.21.15.22:0/2089176525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e081073e0 0x7f5e08199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:53.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.814+0000 7f5e0fbe0640 1 --2- 172.21.15.22:0/2089176525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e081019d0 0x7f5e08198f40 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:53.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.814+0000 7f5e0fbe0640 1 -- 172.21.15.22:0/2089176525 >> 172.21.15.22:0/2089176525 conn(0x7f5e080fd440 msgr2=0x7f5e081057c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:53.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.814+0000 7f5e0fbe0640 1 -- 172.21.15.22:0/2089176525 shutdown_connections 2024-08-20T01:30:53.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:53.814+0000 7f5e0fbe0640 1 -- 172.21.15.22:0/2089176525 wait complete. 2024-08-20T01:30:54.606 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-08-20T01:30:54.606 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-08-20T01:30:54.606 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-20T01:30:54.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.717+0000 7f360a323640 1 -- 172.21.15.22:0/494155401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3604102700 msgr2=0x7f3604102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:54.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.717+0000 7f360a323640 1 --2- 172.21.15.22:0/494155401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3604102700 0x7f3604102b80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f35f8009930 tx=0x7f35f802a420 comp rx=0 tx=0).stop 2024-08-20T01:30:54.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.717+0000 7f360a323640 1 -- 172.21.15.22:0/494155401 shutdown_connections 2024-08-20T01:30:54.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.717+0000 7f360a323640 1 --2- 172.21.15.22:0/494155401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36041030c0 0x7f3604109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:54.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.717+0000 7f360a323640 1 --2- 172.21.15.22:0/494155401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3604102700 0x7f3604102b80 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:54.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.717+0000 7f360a323640 1 --2- 172.21.15.22:0/494155401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36041015b0 0x7f36041019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:54.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.717+0000 7f360a323640 1 -- 172.21.15.22:0/494155401 >> 172.21.15.22:0/494155401 conn(0x7f36040fce50 msgr2=0x7f36040ff290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:54.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.717+0000 7f360a323640 1 -- 172.21.15.22:0/494155401 shutdown_connections 2024-08-20T01:30:54.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.717+0000 7f360a323640 1 -- 172.21.15.22:0/494155401 wait complete. 2024-08-20T01:30:54.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.717+0000 7f360a323640 1 Processor -- start 2024-08-20T01:30:54.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.718+0000 7f360a323640 1 -- start start 2024-08-20T01:30:54.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.718+0000 7f360a323640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36041015b0 0x7f360406b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:54.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.718+0000 7f360a323640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3604102700 0x7f360419d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:54.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.718+0000 7f360a323640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36041030c0 0x7f360419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:54.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.718+0000 7f360a323640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f360410d220 con 0x7f3604102700 2024-08-20T01:30:54.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.718+0000 7f360a323640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f360410d0a0 con 0x7f36041030c0 2024-08-20T01:30:54.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.718+0000 7f360a323640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f360410d3a0 con 0x7f36041015b0 2024-08-20T01:30:54.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.718+0000 7f36037fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3604102700 0x7f360419d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:54.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.718+0000 7f36037fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3604102700 0x7f360419d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43204/0 (socket says 172.21.15.22:43204) 2024-08-20T01:30:54.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.718+0000 7f36037fe640 1 -- 172.21.15.22:0/2644444712 learned_addr learned my addr 172.21.15.22:0/2644444712 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:54.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.718+0000 7f36088c0640 1 --2- 172.21.15.22:0/2644444712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36041030c0 0x7f360419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:54.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.718+0000 7f3603fff640 1 --2- 172.21.15.22:0/2644444712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36041015b0 0x7f360406b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:54.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.718+0000 7f36037fe640 1 -- 172.21.15.22:0/2644444712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36041015b0 msgr2=0x7f360406b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:54.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.718+0000 7f36037fe640 1 --2- 172.21.15.22:0/2644444712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36041015b0 0x7f360406b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:54.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.718+0000 7f36037fe640 1 -- 172.21.15.22:0/2644444712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36041030c0 msgr2=0x7f360419fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:54.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.718+0000 7f36037fe640 1 --2- 172.21.15.22:0/2644444712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36041030c0 0x7f360419fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:54.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.718+0000 7f36037fe640 1 -- 172.21.15.22:0/2644444712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36041a0610 con 0x7f3604102700 2024-08-20T01:30:54.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.719+0000 7f36037fe640 1 --2- 172.21.15.22:0/2644444712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3604102700 0x7f360419d7a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f35f8009a50 tx=0x7f35f80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:54.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.719+0000 7f36017fa640 1 -- 172.21.15.22:0/2644444712 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f803f030 con 0x7f3604102700 2024-08-20T01:30:54.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.719+0000 7f36017fa640 1 -- 172.21.15.22:0/2644444712 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35f8003cb0 con 0x7f3604102700 2024-08-20T01:30:54.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.719+0000 7f360a323640 1 -- 172.21.15.22:0/2644444712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36041a08a0 con 0x7f3604102700 2024-08-20T01:30:54.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.719+0000 7f36017fa640 1 -- 172.21.15.22:0/2644444712 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8035070 con 0x7f3604102700 2024-08-20T01:30:54.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.719+0000 7f360a323640 1 -- 172.21.15.22:0/2644444712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36041a0d90 con 0x7f3604102700 2024-08-20T01:30:54.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.720+0000 7f360a323640 1 -- 172.21.15.22:0/2644444712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36041088c0 con 0x7f3604102700 2024-08-20T01:30:54.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.721+0000 7f36017fa640 1 -- 172.21.15.22:0/2644444712 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f35f8042030 con 0x7f3604102700 2024-08-20T01:30:54.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.722+0000 7f36017fa640 1 --2- 172.21.15.22:0/2644444712 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f35ec0b3c60 0x7f35ec0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:54.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.722+0000 7f3603fff640 1 --2- 172.21.15.22:0/2644444712 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f35ec0b3c60 0x7f35ec0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:54.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.722+0000 7f36017fa640 1 -- 172.21.15.22:0/2644444712 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8298+0+0 (secure 0 0 0) 0x7f35f8104670 con 0x7f3604102700 2024-08-20T01:30:54.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.723+0000 7f3603fff640 1 --2- 172.21.15.22:0/2644444712 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f35ec0b3c60 0x7f35ec0b6120 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f35f400abe0 tx=0x7f35f400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:54.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.725+0000 7f36017fa640 1 -- 172.21.15.22:0/2644444712 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f35f80cbb20 con 0x7f3604102700 2024-08-20T01:30:54.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:54 smithi134 ceph-mon[22511]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-20T01:30:54.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:54 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2089176525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:54.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:54 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-08-20T01:30:54.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:54 smithi077 ceph-mon[22251]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-20T01:30:54.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:54 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2089176525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:54.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:54 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-08-20T01:30:54.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:54 smithi022 ceph-mon[18709]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-20T01:30:54.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:54 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2089176525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:54.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:54 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-08-20T01:30:54.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.908+0000 7f360a323640 1 -- 172.21.15.22:0/2644444712 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f36040632c0 con 0x7f35ec0b3c60 2024-08-20T01:30:54.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.913+0000 7f36017fa640 1 -- 172.21.15.22:0/2644444712 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259060 (secure 0 0 0) 0x7f36040632c0 con 0x7f35ec0b3c60 2024-08-20T01:30:54.916 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:54.917 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-08-20T01:30:54.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.915+0000 7f360a323640 1 -- 172.21.15.22:0/2644444712 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f35ec0b3c60 msgr2=0x7f35ec0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:54.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.915+0000 7f360a323640 1 --2- 172.21.15.22:0/2644444712 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f35ec0b3c60 0x7f35ec0b6120 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f35f400abe0 tx=0x7f35f400a2d0 comp rx=0 tx=0).stop 2024-08-20T01:30:54.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.916+0000 7f360a323640 1 -- 172.21.15.22:0/2644444712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3604102700 msgr2=0x7f360419d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:54.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.916+0000 7f360a323640 1 --2- 172.21.15.22:0/2644444712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3604102700 0x7f360419d7a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f35f8009a50 tx=0x7f35f80042f0 comp rx=0 tx=0).stop 2024-08-20T01:30:54.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.916+0000 7f360a323640 1 -- 172.21.15.22:0/2644444712 shutdown_connections 2024-08-20T01:30:54.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.916+0000 7f360a323640 1 --2- 172.21.15.22:0/2644444712 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f35ec0b3c60 0x7f35ec0b6120 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:54.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.916+0000 7f360a323640 1 --2- 172.21.15.22:0/2644444712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36041030c0 0x7f360419fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:54.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.916+0000 7f360a323640 1 --2- 172.21.15.22:0/2644444712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3604102700 0x7f360419d7a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:54.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.916+0000 7f360a323640 1 --2- 172.21.15.22:0/2644444712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36041015b0 0x7f360406b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:54.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.916+0000 7f360a323640 1 -- 172.21.15.22:0/2644444712 >> 172.21.15.22:0/2644444712 conn(0x7f36040fce50 msgr2=0x7f3604105a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:54.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.916+0000 7f360a323640 1 -- 172.21.15.22:0/2644444712 shutdown_connections 2024-08-20T01:30:54.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:54.916+0000 7f360a323640 1 -- 172.21.15.22:0/2644444712 wait complete. 2024-08-20T01:30:54.928 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-08-20T01:30:54.503896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654981,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":667,"num_read_kb":428,"num_write":293,"num_write_kb":2265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":3011602,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":298,"ondisk_log_size":298,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363708,"kb_used_data":10228,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124578116,"statfs":{"total":1151940427776,"available":1151567990784,"internally_reserved":0,"allocated":10473472,"data_stored":6835487,"data_compressed":187808,"data_compressed_allocated":245760,"data_compressed_original":2023424,"omap_allocated":19139,"internal_metadata":361674045},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,4,6,17,18],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":31,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.184302"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019956+0000","last_change":"2024-08-20T01:29:06.421092+0000","last_active":"2024-08-20T01:29:55.019956+0000","last_peered":"2024-08-20T01:29:55.019956+0000","last_clean":"2024-08-20T01:29:55.019956+0000","last_became_active":"2024-08-20T01:29:06.420484+0000","last_became_peered":"2024-08-20T01:29:06.420484+0000","last_unstale":"2024-08-20T01:29:55.019956+0000","last_undegraded":"2024-08-20T01:29:55.019956+0000","last_fullsized":"2024-08-20T01:29:55.019956+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:55:54.177863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255444+0000","last_change":"2024-08-20T01:29:06.414784+0000","last_active":"2024-08-20T01:29:55.255444+0000","last_peered":"2024-08-20T01:29:55.255444+0000","last_clean":"2024-08-20T01:29:55.255444+0000","last_became_active":"2024-08-20T01:29:06.414426+0000","last_became_peered":"2024-08-20T01:29:06.414426+0000","last_unstale":"2024-08-20T01:29:55.255444+0000","last_undegraded":"2024-08-20T01:29:55.255444+0000","last_fullsized":"2024-08-20T01:29:55.255444+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:13:45.634888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255426+0000","last_change":"2024-08-20T01:29:06.416876+0000","last_active":"2024-08-20T01:29:55.255426+0000","last_peered":"2024-08-20T01:29:55.255426+0000","last_clean":"2024-08-20T01:29:55.255426+0000","last_became_active":"2024-08-20T01:29:06.416548+0000","last_became_peered":"2024-08-20T01:29:06.416548+0000","last_unstale":"2024-08-20T01:29:55.255426+0000","last_undegraded":"2024-08-20T01:29:55.255426+0000","last_fullsized":"2024-08-20T01:29:55.255426+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:16:23.092129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019553+0000","last_change":"2024-08-20T01:29:06.415474+0000","last_active":"2024-08-20T01:29:55.019553+0000","last_peered":"2024-08-20T01:29:55.019553+0000","last_clean":"2024-08-20T01:29:55.019553+0000","last_became_active":"2024-08-20T01:29:06.415120+0000","last_became_peered":"2024-08-20T01:29:06.415120+0000","last_unstale":"2024-08-20T01:29:55.019553+0000","last_undegraded":"2024-08-20T01:29:55.019553+0000","last_fullsized":"2024-08-20T01:29:55.019553+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:47.059173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.022520+0000","last_change":"2024-08-20T01:29:55.022459+0000","last_active":"2024-08-20T01:29:55.022520+0000","last_peered":"2024-08-20T01:29:55.022520+0000","last_clean":"2024-08-20T01:29:55.022520+0000","last_became_active":"2024-08-20T01:29:55.022110+0000","last_became_peered":"2024-08-20T01:29:55.022110+0000","last_unstale":"2024-08-20T01:29:55.022520+0000","last_undegraded":"2024-08-20T01:29:55.022520+0000","last_fullsized":"2024-08-20T01:29:55.022520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:56:44.318445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024716+0000","last_change":"2024-08-20T01:29:06.420995+0000","last_active":"2024-08-20T01:29:55.024716+0000","last_peered":"2024-08-20T01:29:55.024716+0000","last_clean":"2024-08-20T01:29:55.024716+0000","last_became_active":"2024-08-20T01:29:06.420703+0000","last_became_peered":"2024-08-20T01:29:06.420703+0000","last_unstale":"2024-08-20T01:29:55.024716+0000","last_undegraded":"2024-08-20T01:29:55.024716+0000","last_fullsized":"2024-08-20T01:29:55.024716+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:21:08.502158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376076+0000","last_change":"2024-08-20T01:29:06.411605+0000","last_active":"2024-08-20T01:29:55.376076+0000","last_peered":"2024-08-20T01:29:55.376076+0000","last_clean":"2024-08-20T01:29:55.376076+0000","last_became_active":"2024-08-20T01:29:06.411258+0000","last_became_peered":"2024-08-20T01:29:06.411258+0000","last_unstale":"2024-08-20T01:29:55.376076+0000","last_undegraded":"2024-08-20T01:29:55.376076+0000","last_fullsized":"2024-08-20T01:29:55.376076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:17:02.390707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.699603+0000","last_change":"2024-08-20T01:29:06.418514+0000","last_active":"2024-08-20T01:30:53.699603+0000","last_peered":"2024-08-20T01:30:53.699603+0000","last_clean":"2024-08-20T01:30:53.699603+0000","last_became_active":"2024-08-20T01:29:06.417450+0000","last_became_peered":"2024-08-20T01:29:06.417450+0000","last_unstale":"2024-08-20T01:30:53.699603+0000","last_undegraded":"2024-08-20T01:30:53.699603+0000","last_fullsized":"2024-08-20T01:30:53.699603+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:13:15.485333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.028241+0000","last_change":"2024-08-20T01:29:06.425458+0000","last_active":"2024-08-20T01:29:55.028241+0000","last_peered":"2024-08-20T01:29:55.028241+0000","last_clean":"2024-08-20T01:29:55.028241+0000","last_became_active":"2024-08-20T01:29:06.425122+0000","last_became_peered":"2024-08-20T01:29:06.425122+0000","last_unstale":"2024-08-20T01:29:55.028241+0000","last_undegraded":"2024-08-20T01:29:55.028241+0000","last_fullsized":"2024-08-20T01:29:55.028241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:52:59.857195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.025175+0000","last_change":"2024-08-20T01:29:06.420258+0000","last_active":"2024-08-20T01:29:55.025175+0000","last_peered":"2024-08-20T01:29:55.025175+0000","last_clean":"2024-08-20T01:29:55.025175+0000","last_became_active":"2024-08-20T01:29:06.419982+0000","last_became_peered":"2024-08-20T01:29:06.419982+0000","last_unstale":"2024-08-20T01:29:55.025175+0000","last_undegraded":"2024-08-20T01:29:55.025175+0000","last_fullsized":"2024-08-20T01:29:55.025175+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:56:23.296739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376666+0000","last_change":"2024-08-20T01:29:06.421580+0000","last_active":"2024-08-20T01:29:55.376666+0000","last_peered":"2024-08-20T01:29:55.376666+0000","last_clean":"2024-08-20T01:29:55.376666+0000","last_became_active":"2024-08-20T01:29:06.421115+0000","last_became_peered":"2024-08-20T01:29:06.421115+0000","last_unstale":"2024-08-20T01:29:55.376666+0000","last_undegraded":"2024-08-20T01:29:55.376666+0000","last_fullsized":"2024-08-20T01:29:55.376666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:43:13.839230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019544+0000","last_change":"2024-08-20T01:29:06.416950+0000","last_active":"2024-08-20T01:29:55.019544+0000","last_peered":"2024-08-20T01:29:55.019544+0000","last_clean":"2024-08-20T01:29:55.019544+0000","last_became_active":"2024-08-20T01:29:06.415585+0000","last_became_peered":"2024-08-20T01:29:06.415585+0000","last_unstale":"2024-08-20T01:29:55.019544+0000","last_undegraded":"2024-08-20T01:29:55.019544+0000","last_fullsized":"2024-08-20T01:29:55.019544+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:47:54.132535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027677+0000","last_change":"2024-08-20T01:29:55.027622+0000","last_active":"2024-08-20T01:29:55.027677+0000","last_peered":"2024-08-20T01:29:55.027677+0000","last_clean":"2024-08-20T01:29:55.027677+0000","last_became_active":"2024-08-20T01:29:55.027246+0000","last_became_peered":"2024-08-20T01:29:55.027246+0000","last_unstale":"2024-08-20T01:29:55.027677+0000","last_undegraded":"2024-08-20T01:29:55.027677+0000","last_fullsized":"2024-08-20T01:29:55.027677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:30:25.209975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255506+0000","last_change":"2024-08-20T01:29:06.415494+0000","last_active":"2024-08-20T01:29:55.255506+0000","last_peered":"2024-08-20T01:29:55.255506+0000","last_clean":"2024-08-20T01:29:55.255506+0000","last_became_active":"2024-08-20T01:29:06.415099+0000","last_became_peered":"2024-08-20T01:29:06.415099+0000","last_unstale":"2024-08-20T01:29:55.255506+0000","last_undegraded":"2024-08-20T01:29:55.255506+0000","last_fullsized":"2024-08-20T01:29:55.255506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:07:01.946143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'3","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255243+0000","last_change":"2024-08-20T01:29:06.418233+0000","last_active":"2024-08-20T01:29:55.255243+0000","last_peered":"2024-08-20T01:29:55.255243+0000","last_clean":"2024-08-20T01:29:55.255243+0000","last_became_active":"2024-08-20T01:29:06.417929+0000","last_became_peered":"2024-08-20T01:29:06.417929+0000","last_unstale":"2024-08-20T01:29:55.255243+0000","last_undegraded":"2024-08-20T01:29:55.255243+0000","last_fullsized":"2024-08-20T01:29:55.255243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:44:08.548821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027280+0000","last_change":"2024-08-20T01:29:06.418819+0000","last_active":"2024-08-20T01:29:55.027280+0000","last_peered":"2024-08-20T01:29:55.027280+0000","last_clean":"2024-08-20T01:29:55.027280+0000","last_became_active":"2024-08-20T01:29:06.418378+0000","last_became_peered":"2024-08-20T01:29:06.418378+0000","last_unstale":"2024-08-20T01:29:55.027280+0000","last_undegraded":"2024-08-20T01:29:55.027280+0000","last_fullsized":"2024-08-20T01:29:55.027280+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:01.419539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.020071+0000","last_change":"2024-08-20T01:29:06.420804+0000","last_active":"2024-08-20T01:29:55.020071+0000","last_peered":"2024-08-20T01:29:55.020071+0000","last_clean":"2024-08-20T01:29:55.020071+0000","last_became_active":"2024-08-20T01:29:06.420027+0000","last_became_peered":"2024-08-20T01:29:06.420027+0000","last_unstale":"2024-08-20T01:29:55.020071+0000","last_undegraded":"2024-08-20T01:29:55.020071+0000","last_fullsized":"2024-08-20T01:29:55.020071+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:00:37.104792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015970+0000","last_change":"2024-08-20T01:29:06.411625+0000","last_active":"2024-08-20T01:29:55.015970+0000","last_peered":"2024-08-20T01:29:55.015970+0000","last_clean":"2024-08-20T01:29:55.015970+0000","last_became_active":"2024-08-20T01:29:06.411284+0000","last_became_peered":"2024-08-20T01:29:06.411284+0000","last_unstale":"2024-08-20T01:29:55.015970+0000","last_undegraded":"2024-08-20T01:29:55.015970+0000","last_fullsized":"2024-08-20T01:29:55.015970+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:12:08.510755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021766+0000","last_change":"2024-08-20T01:29:06.421276+0000","last_active":"2024-08-20T01:29:55.021766+0000","last_peered":"2024-08-20T01:29:55.021766+0000","last_clean":"2024-08-20T01:29:55.021766+0000","last_became_active":"2024-08-20T01:29:06.420916+0000","last_became_peered":"2024-08-20T01:29:06.420916+0000","last_unstale":"2024-08-20T01:29:55.021766+0000","last_undegraded":"2024-08-20T01:29:55.021766+0000","last_fullsized":"2024-08-20T01:29:55.021766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:04:59.399172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.020688+0000","last_change":"2024-08-20T01:29:06.420848+0000","last_active":"2024-08-20T01:29:55.020688+0000","last_peered":"2024-08-20T01:29:55.020688+0000","last_clean":"2024-08-20T01:29:55.020688+0000","last_became_active":"2024-08-20T01:29:06.420465+0000","last_became_peered":"2024-08-20T01:29:06.420465+0000","last_unstale":"2024-08-20T01:29:55.020688+0000","last_undegraded":"2024-08-20T01:29:55.020688+0000","last_fullsized":"2024-08-20T01:29:55.020688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:42:33.210813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019585+0000","last_change":"2024-08-20T01:29:06.407353+0000","last_active":"2024-08-20T01:29:55.019585+0000","last_peered":"2024-08-20T01:29:55.019585+0000","last_clean":"2024-08-20T01:29:55.019585+0000","last_became_active":"2024-08-20T01:29:06.406944+0000","last_became_peered":"2024-08-20T01:29:06.406944+0000","last_unstale":"2024-08-20T01:29:55.019585+0000","last_undegraded":"2024-08-20T01:29:55.019585+0000","last_fullsized":"2024-08-20T01:29:55.019585+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:49:22.324317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027678+0000","last_change":"2024-08-20T01:29:06.419757+0000","last_active":"2024-08-20T01:29:55.027678+0000","last_peered":"2024-08-20T01:29:55.027678+0000","last_clean":"2024-08-20T01:29:55.027678+0000","last_became_active":"2024-08-20T01:29:06.419433+0000","last_became_peered":"2024-08-20T01:29:06.419433+0000","last_unstale":"2024-08-20T01:29:55.027678+0000","last_undegraded":"2024-08-20T01:29:55.027678+0000","last_fullsized":"2024-08-20T01:29:55.027678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:22:36.968949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.695425+0000","last_change":"2024-08-20T01:29:06.418110+0000","last_active":"2024-08-20T01:30:53.695425+0000","last_peered":"2024-08-20T01:30:53.695425+0000","last_clean":"2024-08-20T01:30:53.695425+0000","last_became_active":"2024-08-20T01:29:06.417776+0000","last_became_peered":"2024-08-20T01:29:06.417776+0000","last_unstale":"2024-08-20T01:30:53.695425+0000","last_undegraded":"2024-08-20T01:30:53.695425+0000","last_fullsized":"2024-08-20T01:30:53.695425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:55:55.105453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.016549+0000","last_change":"2024-08-20T01:29:06.414240+0000","last_active":"2024-08-20T01:29:55.016549+0000","last_peered":"2024-08-20T01:29:55.016549+0000","last_clean":"2024-08-20T01:29:55.016549+0000","last_became_active":"2024-08-20T01:29:06.413884+0000","last_became_peered":"2024-08-20T01:29:06.413884+0000","last_unstale":"2024-08-20T01:29:55.016549+0000","last_undegraded":"2024-08-20T01:29:55.016549+0000","last_fullsized":"2024-08-20T01:29:55.016549+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:00.042588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.694275+0000","last_change":"2024-08-20T01:29:06.419344+0000","last_active":"2024-08-20T01:30:53.694275+0000","last_peered":"2024-08-20T01:30:53.694275+0000","last_clean":"2024-08-20T01:30:53.694275+0000","last_became_active":"2024-08-20T01:29:06.418689+0000","last_became_peered":"2024-08-20T01:29:06.418689+0000","last_unstale":"2024-08-20T01:30:53.694275+0000","last_undegraded":"2024-08-20T01:30:53.694275+0000","last_fullsized":"2024-08-20T01:30:53.694275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:34:23.604213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.022077+0000","last_change":"2024-08-20T01:29:06.415161+0000","last_active":"2024-08-20T01:29:55.022077+0000","last_peered":"2024-08-20T01:29:55.022077+0000","last_clean":"2024-08-20T01:29:55.022077+0000","last_became_active":"2024-08-20T01:29:06.414812+0000","last_became_peered":"2024-08-20T01:29:06.414812+0000","last_unstale":"2024-08-20T01:29:55.022077+0000","last_undegraded":"2024-08-20T01:29:55.022077+0000","last_fullsized":"2024-08-20T01:29:55.022077+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:10:49.527635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021022+0000","last_change":"2024-08-20T01:29:06.416502+0000","last_active":"2024-08-20T01:29:55.021022+0000","last_peered":"2024-08-20T01:29:55.021022+0000","last_clean":"2024-08-20T01:29:55.021022+0000","last_became_active":"2024-08-20T01:29:06.416139+0000","last_became_peered":"2024-08-20T01:29:06.416139+0000","last_unstale":"2024-08-20T01:29:55.021022+0000","last_undegraded":"2024-08-20T01:29:55.021022+0000","last_fullsized":"2024-08-20T01:29:55.021022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:19:32.379867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019525+0000","last_change":"2024-08-20T01:29:06.412494+0000","last_active":"2024-08-20T01:29:55.019525+0000","last_peered":"2024-08-20T01:29:55.019525+0000","last_clean":"2024-08-20T01:29:55.019525+0000","last_became_active":"2024-08-20T01:29:06.412158+0000","last_became_peered":"2024-08-20T01:29:06.412158+0000","last_unstale":"2024-08-20T01:29:55.019525+0000","last_undegraded":"2024-08-20T01:29:55.019525+0000","last_fullsized":"2024-08-20T01:29:55.019525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:57:52.088445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'4","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255526+0000","last_change":"2024-08-20T01:29:06.412869+0000","last_active":"2024-08-20T01:29:55.255526+0000","last_peered":"2024-08-20T01:29:55.255526+0000","last_clean":"2024-08-20T01:29:55.255526+0000","last_became_active":"2024-08-20T01:29:06.412540+0000","last_became_peered":"2024-08-20T01:29:06.412540+0000","last_unstale":"2024-08-20T01:29:55.255526+0000","last_undegraded":"2024-08-20T01:29:55.255526+0000","last_fullsized":"2024-08-20T01:29:55.255526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:11:10.011252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.256428+0000","last_change":"2024-08-20T01:29:55.256345+0000","last_active":"2024-08-20T01:29:55.256428+0000","last_peered":"2024-08-20T01:29:55.256428+0000","last_clean":"2024-08-20T01:29:55.256428+0000","last_became_active":"2024-08-20T01:29:55.256001+0000","last_became_peered":"2024-08-20T01:29:55.256001+0000","last_unstale":"2024-08-20T01:29:55.256428+0000","last_undegraded":"2024-08-20T01:29:55.256428+0000","last_fullsized":"2024-08-20T01:29:55.256428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:02:02.453668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.022020+0000","last_change":"2024-08-20T01:29:06.423874+0000","last_active":"2024-08-20T01:29:55.022020+0000","last_peered":"2024-08-20T01:29:55.022020+0000","last_clean":"2024-08-20T01:29:55.022020+0000","last_became_active":"2024-08-20T01:29:06.423561+0000","last_became_peered":"2024-08-20T01:29:06.423561+0000","last_unstale":"2024-08-20T01:29:55.022020+0000","last_undegraded":"2024-08-20T01:29:55.022020+0000","last_fullsized":"2024-08-20T01:29:55.022020+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:13:53.654099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019575+0000","last_change":"2024-08-20T01:29:06.414212+0000","last_active":"2024-08-20T01:29:55.019575+0000","last_peered":"2024-08-20T01:29:55.019575+0000","last_clean":"2024-08-20T01:29:55.019575+0000","last_became_active":"2024-08-20T01:29:06.413848+0000","last_became_peered":"2024-08-20T01:29:06.413848+0000","last_unstale":"2024-08-20T01:29:55.019575+0000","last_undegraded":"2024-08-20T01:29:55.019575+0000","last_fullsized":"2024-08-20T01:29:55.019575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:00:29.005461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.377988+0000","last_change":"2024-08-20T01:29:55.377940+0000","last_active":"2024-08-20T01:29:55.377988+0000","last_peered":"2024-08-20T01:29:55.377988+0000","last_clean":"2024-08-20T01:29:55.377988+0000","last_became_active":"2024-08-20T01:29:55.377642+0000","last_became_peered":"2024-08-20T01:29:55.377642+0000","last_unstale":"2024-08-20T01:29:55.377988+0000","last_undegraded":"2024-08-20T01:29:55.377988+0000","last_fullsized":"2024-08-20T01:29:55.377988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:55:28.416610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":126,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:48.615104+0000","last_change":"2024-08-20T01:29:04.413482+0000","last_active":"2024-08-20T01:30:48.615104+0000","last_peered":"2024-08-20T01:30:48.615104+0000","last_clean":"2024-08-20T01:30:48.615104+0000","last_became_active":"2024-08-20T01:29:04.413096+0000","last_became_peered":"2024-08-20T01:29:04.413096+0000","last_unstale":"2024-08-20T01:30:48.615104+0000","last_undegraded":"2024-08-20T01:30:48.615104+0000","last_fullsized":"2024-08-20T01:30:48.615104+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:26:05.947182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.022224+0000","last_change":"2024-08-20T01:29:55.022156+0000","last_active":"2024-08-20T01:29:55.022224+0000","last_peered":"2024-08-20T01:29:55.022224+0000","last_clean":"2024-08-20T01:29:55.022224+0000","last_became_active":"2024-08-20T01:29:55.021604+0000","last_became_peered":"2024-08-20T01:29:55.021604+0000","last_unstale":"2024-08-20T01:29:55.022224+0000","last_undegraded":"2024-08-20T01:29:55.022224+0000","last_fullsized":"2024-08-20T01:29:55.022224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:28:35.155390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024796+0000","last_change":"2024-08-20T01:29:04.409605+0000","last_active":"2024-08-20T01:29:55.024796+0000","last_peered":"2024-08-20T01:29:55.024796+0000","last_clean":"2024-08-20T01:29:55.024796+0000","last_became_active":"2024-08-20T01:29:04.409284+0000","last_became_peered":"2024-08-20T01:29:04.409284+0000","last_unstale":"2024-08-20T01:29:55.024796+0000","last_undegraded":"2024-08-20T01:29:55.024796+0000","last_fullsized":"2024-08-20T01:29:55.024796+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:29:27.471748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019177+0000","last_change":"2024-08-20T01:29:04.400635+0000","last_active":"2024-08-20T01:29:55.019177+0000","last_peered":"2024-08-20T01:29:55.019177+0000","last_clean":"2024-08-20T01:29:55.019177+0000","last_became_active":"2024-08-20T01:29:04.400234+0000","last_became_peered":"2024-08-20T01:29:04.400234+0000","last_unstale":"2024-08-20T01:29:55.019177+0000","last_undegraded":"2024-08-20T01:29:55.019177+0000","last_fullsized":"2024-08-20T01:29:55.019177+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:47:24.810916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.697781+0000","last_change":"2024-08-20T01:29:06.411872+0000","last_active":"2024-08-20T01:30:53.697781+0000","last_peered":"2024-08-20T01:30:53.697781+0000","last_clean":"2024-08-20T01:30:53.697781+0000","last_became_active":"2024-08-20T01:29:06.411563+0000","last_became_peered":"2024-08-20T01:29:06.411563+0000","last_unstale":"2024-08-20T01:30:53.697781+0000","last_undegraded":"2024-08-20T01:30:53.697781+0000","last_fullsized":"2024-08-20T01:30:53.697781+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:03:37.351529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017046+0000","last_change":"2024-08-20T01:29:04.407395+0000","last_active":"2024-08-20T01:29:55.017046+0000","last_peered":"2024-08-20T01:29:55.017046+0000","last_clean":"2024-08-20T01:29:55.017046+0000","last_became_active":"2024-08-20T01:29:04.407000+0000","last_became_peered":"2024-08-20T01:29:04.407000+0000","last_unstale":"2024-08-20T01:29:55.017046+0000","last_undegraded":"2024-08-20T01:29:55.017046+0000","last_fullsized":"2024-08-20T01:29:55.017046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:36:42.512450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015687+0000","last_change":"2024-08-20T01:29:06.410094+0000","last_active":"2024-08-20T01:29:55.015687+0000","last_peered":"2024-08-20T01:29:55.015687+0000","last_clean":"2024-08-20T01:29:55.015687+0000","last_became_active":"2024-08-20T01:29:06.409749+0000","last_became_peered":"2024-08-20T01:29:06.409749+0000","last_unstale":"2024-08-20T01:29:55.015687+0000","last_undegraded":"2024-08-20T01:29:55.015687+0000","last_fullsized":"2024-08-20T01:29:55.015687+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:52:51.072953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":121,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:49.615938+0000","last_change":"2024-08-20T01:29:04.406810+0000","last_active":"2024-08-20T01:30:49.615938+0000","last_peered":"2024-08-20T01:30:49.615938+0000","last_clean":"2024-08-20T01:30:49.615938+0000","last_became_active":"2024-08-20T01:29:04.406436+0000","last_became_peered":"2024-08-20T01:29:04.406436+0000","last_unstale":"2024-08-20T01:30:49.615938+0000","last_undegraded":"2024-08-20T01:30:49.615938+0000","last_fullsized":"2024-08-20T01:30:49.615938+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:49:57.305447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.028186+0000","last_change":"2024-08-20T01:29:06.424442+0000","last_active":"2024-08-20T01:29:55.028186+0000","last_peered":"2024-08-20T01:29:55.028186+0000","last_clean":"2024-08-20T01:29:55.028186+0000","last_became_active":"2024-08-20T01:29:06.424132+0000","last_became_peered":"2024-08-20T01:29:06.424132+0000","last_unstale":"2024-08-20T01:29:55.028186+0000","last_undegraded":"2024-08-20T01:29:55.028186+0000","last_fullsized":"2024-08-20T01:29:55.028186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:31:30.861113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376745+0000","last_change":"2024-08-20T01:29:04.412307+0000","last_active":"2024-08-20T01:29:55.376745+0000","last_peered":"2024-08-20T01:29:55.376745+0000","last_clean":"2024-08-20T01:29:55.376745+0000","last_became_active":"2024-08-20T01:29:04.411861+0000","last_became_peered":"2024-08-20T01:29:04.411861+0000","last_unstale":"2024-08-20T01:29:55.376745+0000","last_undegraded":"2024-08-20T01:29:55.376745+0000","last_fullsized":"2024-08-20T01:29:55.376745+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:56:51.356821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255721+0000","last_change":"2024-08-20T01:29:06.418525+0000","last_active":"2024-08-20T01:29:55.255721+0000","last_peered":"2024-08-20T01:29:55.255721+0000","last_clean":"2024-08-20T01:29:55.255721+0000","last_became_active":"2024-08-20T01:29:06.417902+0000","last_became_peered":"2024-08-20T01:29:06.417902+0000","last_unstale":"2024-08-20T01:29:55.255721+0000","last_undegraded":"2024-08-20T01:29:55.255721+0000","last_fullsized":"2024-08-20T01:29:55.255721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:28:23.017315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017602+0000","last_change":"2024-08-20T01:29:05.171538+0000","last_active":"2024-08-20T01:29:55.017602+0000","last_peered":"2024-08-20T01:29:55.017602+0000","last_clean":"2024-08-20T01:29:55.017602+0000","last_became_active":"2024-08-20T01:29:05.171172+0000","last_became_peered":"2024-08-20T01:29:05.171172+0000","last_unstale":"2024-08-20T01:29:55.017602+0000","last_undegraded":"2024-08-20T01:29:55.017602+0000","last_fullsized":"2024-08-20T01:29:55.017602+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:04:27.968049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027866+0000","last_change":"2024-08-20T01:29:06.426886+0000","last_active":"2024-08-20T01:29:55.027866+0000","last_peered":"2024-08-20T01:29:55.027866+0000","last_clean":"2024-08-20T01:29:55.027866+0000","last_became_active":"2024-08-20T01:29:06.426569+0000","last_became_peered":"2024-08-20T01:29:06.426569+0000","last_unstale":"2024-08-20T01:29:55.027866+0000","last_undegraded":"2024-08-20T01:29:55.027866+0000","last_fullsized":"2024-08-20T01:29:55.027866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:34:21.948591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'30","reported_seq":270,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:50.124736+0000","last_change":"2024-08-20T01:29:55.038445+0000","last_active":"2024-08-20T01:30:50.124736+0000","last_peered":"2024-08-20T01:30:50.124736+0000","last_clean":"2024-08-20T01:30:50.124736+0000","last_became_active":"2024-08-20T01:29:55.030683+0000","last_became_peered":"2024-08-20T01:29:55.030683+0000","last_unstale":"2024-08-20T01:30:50.124736+0000","last_undegraded":"2024-08-20T01:30:50.124736+0000","last_fullsized":"2024-08-20T01:30:50.124736+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:07:42.592996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60070,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":194,"num_read_kb":155,"num_write":31,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":59762,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018478+0000","last_change":"2024-08-20T01:29:06.417097+0000","last_active":"2024-08-20T01:29:55.018478+0000","last_peered":"2024-08-20T01:29:55.018478+0000","last_clean":"2024-08-20T01:29:55.018478+0000","last_became_active":"2024-08-20T01:29:06.416491+0000","last_became_peered":"2024-08-20T01:29:06.416491+0000","last_unstale":"2024-08-20T01:29:55.018478+0000","last_undegraded":"2024-08-20T01:29:55.018478+0000","last_fullsized":"2024-08-20T01:29:55.018478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:30:16.071161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021546+0000","last_change":"2024-08-20T01:29:04.412071+0000","last_active":"2024-08-20T01:29:55.021546+0000","last_peered":"2024-08-20T01:29:55.021546+0000","last_clean":"2024-08-20T01:29:55.021546+0000","last_became_active":"2024-08-20T01:29:04.411741+0000","last_became_peered":"2024-08-20T01:29:04.411741+0000","last_unstale":"2024-08-20T01:29:55.021546+0000","last_undegraded":"2024-08-20T01:29:55.021546+0000","last_fullsized":"2024-08-20T01:29:55.021546+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:33:47.753754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019405+0000","last_change":"2024-08-20T01:29:06.408996+0000","last_active":"2024-08-20T01:29:55.019405+0000","last_peered":"2024-08-20T01:29:55.019405+0000","last_clean":"2024-08-20T01:29:55.019405+0000","last_became_active":"2024-08-20T01:29:06.408685+0000","last_became_peered":"2024-08-20T01:29:06.408685+0000","last_unstale":"2024-08-20T01:29:55.019405+0000","last_undegraded":"2024-08-20T01:29:55.019405+0000","last_fullsized":"2024-08-20T01:29:55.019405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:18:28.974108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017430+0000","last_change":"2024-08-20T01:29:04.407852+0000","last_active":"2024-08-20T01:29:55.017430+0000","last_peered":"2024-08-20T01:29:55.017430+0000","last_clean":"2024-08-20T01:29:55.017430+0000","last_became_active":"2024-08-20T01:29:04.406828+0000","last_became_peered":"2024-08-20T01:29:04.406828+0000","last_unstale":"2024-08-20T01:29:55.017430+0000","last_undegraded":"2024-08-20T01:29:55.017430+0000","last_fullsized":"2024-08-20T01:29:55.017430+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:36:03.641146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376676+0000","last_change":"2024-08-20T01:29:06.418652+0000","last_active":"2024-08-20T01:29:55.376676+0000","last_peered":"2024-08-20T01:29:55.376676+0000","last_clean":"2024-08-20T01:29:55.376676+0000","last_became_active":"2024-08-20T01:29:06.418340+0000","last_became_peered":"2024-08-20T01:29:06.418340+0000","last_unstale":"2024-08-20T01:29:55.376676+0000","last_undegraded":"2024-08-20T01:29:55.376676+0000","last_fullsized":"2024-08-20T01:29:55.376676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:56:30.194426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'4","reported_seq":123,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:49.629604+0000","last_change":"2024-08-20T01:29:04.405950+0000","last_active":"2024-08-20T01:30:49.629604+0000","last_peered":"2024-08-20T01:30:49.629604+0000","last_clean":"2024-08-20T01:30:49.629604+0000","last_became_active":"2024-08-20T01:29:04.405650+0000","last_became_peered":"2024-08-20T01:29:04.405650+0000","last_unstale":"2024-08-20T01:30:49.629604+0000","last_undegraded":"2024-08-20T01:30:49.629604+0000","last_fullsized":"2024-08-20T01:30:49.629604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:12:01.752958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376068+0000","last_change":"2024-08-20T01:29:06.413967+0000","last_active":"2024-08-20T01:29:55.376068+0000","last_peered":"2024-08-20T01:29:55.376068+0000","last_clean":"2024-08-20T01:29:55.376068+0000","last_became_active":"2024-08-20T01:29:06.413628+0000","last_became_peered":"2024-08-20T01:29:06.413628+0000","last_unstale":"2024-08-20T01:29:55.376068+0000","last_undegraded":"2024-08-20T01:29:55.376068+0000","last_fullsized":"2024-08-20T01:29:55.376068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:09:16.394482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018723+0000","last_change":"2024-08-20T01:29:05.169872+0000","last_active":"2024-08-20T01:29:55.018723+0000","last_peered":"2024-08-20T01:29:55.018723+0000","last_clean":"2024-08-20T01:29:55.018723+0000","last_became_active":"2024-08-20T01:29:05.169186+0000","last_became_peered":"2024-08-20T01:29:05.169186+0000","last_unstale":"2024-08-20T01:29:55.018723+0000","last_undegraded":"2024-08-20T01:29:55.018723+0000","last_fullsized":"2024-08-20T01:29:55.018723+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:55:47.447959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.030862+0000","last_change":"2024-08-20T01:29:55.030761+0000","last_active":"2024-08-20T01:29:55.030862+0000","last_peered":"2024-08-20T01:29:55.030862+0000","last_clean":"2024-08-20T01:29:55.030862+0000","last_became_active":"2024-08-20T01:29:55.030308+0000","last_became_peered":"2024-08-20T01:29:55.030308+0000","last_unstale":"2024-08-20T01:29:55.030862+0000","last_undegraded":"2024-08-20T01:29:55.030862+0000","last_fullsized":"2024-08-20T01:29:55.030862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:27:57.082711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018547+0000","last_change":"2024-08-20T01:29:04.408188+0000","last_active":"2024-08-20T01:29:55.018547+0000","last_peered":"2024-08-20T01:29:55.018547+0000","last_clean":"2024-08-20T01:29:55.018547+0000","last_became_active":"2024-08-20T01:29:04.407794+0000","last_became_peered":"2024-08-20T01:29:04.407794+0000","last_unstale":"2024-08-20T01:29:55.018547+0000","last_undegraded":"2024-08-20T01:29:55.018547+0000","last_fullsized":"2024-08-20T01:29:55.018547+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:49:40.679218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024931+0000","last_change":"2024-08-20T01:29:55.024851+0000","last_active":"2024-08-20T01:29:55.024931+0000","last_peered":"2024-08-20T01:29:55.024931+0000","last_clean":"2024-08-20T01:29:55.024931+0000","last_became_active":"2024-08-20T01:29:55.024396+0000","last_became_peered":"2024-08-20T01:29:55.024396+0000","last_unstale":"2024-08-20T01:29:55.024931+0000","last_undegraded":"2024-08-20T01:29:55.024931+0000","last_fullsized":"2024-08-20T01:29:55.024931+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:44:03.846805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019416+0000","last_change":"2024-08-20T01:29:04.412178+0000","last_active":"2024-08-20T01:29:55.019416+0000","last_peered":"2024-08-20T01:29:55.019416+0000","last_clean":"2024-08-20T01:29:55.019416+0000","last_became_active":"2024-08-20T01:29:04.411819+0000","last_became_peered":"2024-08-20T01:29:04.411819+0000","last_unstale":"2024-08-20T01:29:55.019416+0000","last_undegraded":"2024-08-20T01:29:55.019416+0000","last_fullsized":"2024-08-20T01:29:55.019416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:03:11.524911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376922+0000","last_change":"2024-08-20T01:29:06.415697+0000","last_active":"2024-08-20T01:29:55.376922+0000","last_peered":"2024-08-20T01:29:55.376922+0000","last_clean":"2024-08-20T01:29:55.376922+0000","last_became_active":"2024-08-20T01:29:06.415180+0000","last_became_peered":"2024-08-20T01:29:06.415180+0000","last_unstale":"2024-08-20T01:29:55.376922+0000","last_undegraded":"2024-08-20T01:29:55.376922+0000","last_fullsized":"2024-08-20T01:29:55.376922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:55:50.810063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017390+0000","last_change":"2024-08-20T01:29:04.405961+0000","last_active":"2024-08-20T01:29:55.017390+0000","last_peered":"2024-08-20T01:29:55.017390+0000","last_clean":"2024-08-20T01:29:55.017390+0000","last_became_active":"2024-08-20T01:29:04.405633+0000","last_became_peered":"2024-08-20T01:29:04.405633+0000","last_unstale":"2024-08-20T01:29:55.017390+0000","last_undegraded":"2024-08-20T01:29:55.017390+0000","last_fullsized":"2024-08-20T01:29:55.017390+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:00:27.918313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376620+0000","last_change":"2024-08-20T01:29:06.417221+0000","last_active":"2024-08-20T01:29:55.376620+0000","last_peered":"2024-08-20T01:29:55.376620+0000","last_clean":"2024-08-20T01:29:55.376620+0000","last_became_active":"2024-08-20T01:29:06.416912+0000","last_became_peered":"2024-08-20T01:29:06.416912+0000","last_unstale":"2024-08-20T01:29:55.376620+0000","last_undegraded":"2024-08-20T01:29:55.376620+0000","last_fullsized":"2024-08-20T01:29:55.376620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:12:10.667134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.023090+0000","last_change":"2024-08-20T01:29:05.169494+0000","last_active":"2024-08-20T01:29:55.023090+0000","last_peered":"2024-08-20T01:29:55.023090+0000","last_clean":"2024-08-20T01:29:55.023090+0000","last_became_active":"2024-08-20T01:29:05.169059+0000","last_became_peered":"2024-08-20T01:29:05.169059+0000","last_unstale":"2024-08-20T01:29:55.023090+0000","last_undegraded":"2024-08-20T01:29:55.023090+0000","last_fullsized":"2024-08-20T01:29:55.023090+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:25:39.300668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376709+0000","last_change":"2024-08-20T01:29:06.424040+0000","last_active":"2024-08-20T01:29:55.376709+0000","last_peered":"2024-08-20T01:29:55.376709+0000","last_clean":"2024-08-20T01:29:55.376709+0000","last_became_active":"2024-08-20T01:29:06.421360+0000","last_became_peered":"2024-08-20T01:29:06.421360+0000","last_unstale":"2024-08-20T01:29:55.376709+0000","last_undegraded":"2024-08-20T01:29:55.376709+0000","last_fullsized":"2024-08-20T01:29:55.376709+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:24:50.497310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":99,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376310+0000","last_change":"2024-08-20T01:27:51.625696+0000","last_active":"2024-08-20T01:29:55.376310+0000","last_peered":"2024-08-20T01:29:55.376310+0000","last_clean":"2024-08-20T01:29:55.376310+0000","last_became_active":"2024-08-20T01:27:51.620833+0000","last_became_peered":"2024-08-20T01:27:51.620833+0000","last_unstale":"2024-08-20T01:29:55.376310+0000","last_undegraded":"2024-08-20T01:29:55.376310+0000","last_fullsized":"2024-08-20T01:29:55.376310+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:24:32.140649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:24:32.140649+0000","last_clean_scrub_stamp":"2024-08-20T01:24:32.140649+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:54:02.650548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019516+0000","last_change":"2024-08-20T01:29:04.405411+0000","last_active":"2024-08-20T01:29:55.019516+0000","last_peered":"2024-08-20T01:29:55.019516+0000","last_clean":"2024-08-20T01:29:55.019516+0000","last_became_active":"2024-08-20T01:29:04.404980+0000","last_became_peered":"2024-08-20T01:29:04.404980+0000","last_unstale":"2024-08-20T01:29:55.019516+0000","last_undegraded":"2024-08-20T01:29:55.019516+0000","last_fullsized":"2024-08-20T01:29:55.019516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:31:39.335857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.701767+0000","last_change":"2024-08-20T01:29:06.420368+0000","last_active":"2024-08-20T01:30:53.701767+0000","last_peered":"2024-08-20T01:30:53.701767+0000","last_clean":"2024-08-20T01:30:53.701767+0000","last_became_active":"2024-08-20T01:29:06.419653+0000","last_became_peered":"2024-08-20T01:29:06.419653+0000","last_unstale":"2024-08-20T01:30:53.701767+0000","last_undegraded":"2024-08-20T01:30:53.701767+0000","last_fullsized":"2024-08-20T01:30:53.701767+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:48.771774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376170+0000","last_change":"2024-08-20T01:29:04.410302+0000","last_active":"2024-08-20T01:29:55.376170+0000","last_peered":"2024-08-20T01:29:55.376170+0000","last_clean":"2024-08-20T01:29:55.376170+0000","last_became_active":"2024-08-20T01:29:04.409977+0000","last_became_peered":"2024-08-20T01:29:04.409977+0000","last_unstale":"2024-08-20T01:29:55.376170+0000","last_undegraded":"2024-08-20T01:29:55.376170+0000","last_fullsized":"2024-08-20T01:29:55.376170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:57:21.593739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019623+0000","last_change":"2024-08-20T01:29:06.419798+0000","last_active":"2024-08-20T01:29:55.019623+0000","last_peered":"2024-08-20T01:29:55.019623+0000","last_clean":"2024-08-20T01:29:55.019623+0000","last_became_active":"2024-08-20T01:29:06.419546+0000","last_became_peered":"2024-08-20T01:29:06.419546+0000","last_unstale":"2024-08-20T01:29:55.019623+0000","last_undegraded":"2024-08-20T01:29:55.019623+0000","last_fullsized":"2024-08-20T01:29:55.019623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:51:31.848883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'5","reported_seq":123,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:49.861551+0000","last_change":"2024-08-20T01:29:05.169237+0000","last_active":"2024-08-20T01:30:49.861551+0000","last_peered":"2024-08-20T01:30:49.861551+0000","last_clean":"2024-08-20T01:30:49.861551+0000","last_became_active":"2024-08-20T01:29:05.168778+0000","last_became_peered":"2024-08-20T01:29:05.168778+0000","last_unstale":"2024-08-20T01:30:49.861551+0000","last_undegraded":"2024-08-20T01:30:49.861551+0000","last_fullsized":"2024-08-20T01:30:49.861551+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:04:48.847412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024435+0000","last_change":"2024-08-20T01:29:55.024339+0000","last_active":"2024-08-20T01:29:55.024435+0000","last_peered":"2024-08-20T01:29:55.024435+0000","last_clean":"2024-08-20T01:29:55.024435+0000","last_became_active":"2024-08-20T01:29:55.023944+0000","last_became_peered":"2024-08-20T01:29:55.023944+0000","last_unstale":"2024-08-20T01:29:55.024435+0000","last_undegraded":"2024-08-20T01:29:55.024435+0000","last_fullsized":"2024-08-20T01:29:55.024435+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:14:00.589422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376838+0000","last_change":"2024-08-20T01:29:04.404472+0000","last_active":"2024-08-20T01:29:55.376838+0000","last_peered":"2024-08-20T01:29:55.376838+0000","last_clean":"2024-08-20T01:29:55.376838+0000","last_became_active":"2024-08-20T01:29:04.404010+0000","last_became_peered":"2024-08-20T01:29:04.404010+0000","last_unstale":"2024-08-20T01:29:55.376838+0000","last_undegraded":"2024-08-20T01:29:55.376838+0000","last_fullsized":"2024-08-20T01:29:55.376838+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:53:04.263362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024682+0000","last_change":"2024-08-20T01:29:06.421875+0000","last_active":"2024-08-20T01:29:55.024682+0000","last_peered":"2024-08-20T01:29:55.024682+0000","last_clean":"2024-08-20T01:29:55.024682+0000","last_became_active":"2024-08-20T01:29:06.421542+0000","last_became_peered":"2024-08-20T01:29:06.421542+0000","last_unstale":"2024-08-20T01:29:55.024682+0000","last_undegraded":"2024-08-20T01:29:55.024682+0000","last_fullsized":"2024-08-20T01:29:55.024682+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:10:46.320252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015905+0000","last_change":"2024-08-20T01:29:05.169985+0000","last_active":"2024-08-20T01:29:55.015905+0000","last_peered":"2024-08-20T01:29:55.015905+0000","last_clean":"2024-08-20T01:29:55.015905+0000","last_became_active":"2024-08-20T01:29:05.169607+0000","last_became_peered":"2024-08-20T01:29:05.169607+0000","last_unstale":"2024-08-20T01:29:55.015905+0000","last_undegraded":"2024-08-20T01:29:55.015905+0000","last_fullsized":"2024-08-20T01:29:55.015905+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:03:23.278369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024870+0000","last_change":"2024-08-20T01:29:06.414862+0000","last_active":"2024-08-20T01:29:55.024870+0000","last_peered":"2024-08-20T01:29:55.024870+0000","last_clean":"2024-08-20T01:29:55.024870+0000","last_became_active":"2024-08-20T01:29:06.414527+0000","last_became_peered":"2024-08-20T01:29:06.414527+0000","last_unstale":"2024-08-20T01:29:55.024870+0000","last_undegraded":"2024-08-20T01:29:55.024870+0000","last_fullsized":"2024-08-20T01:29:55.024870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:14:20.884073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018713+0000","last_change":"2024-08-20T01:29:05.169638+0000","last_active":"2024-08-20T01:29:55.018713+0000","last_peered":"2024-08-20T01:29:55.018713+0000","last_clean":"2024-08-20T01:29:55.018713+0000","last_became_active":"2024-08-20T01:29:05.169202+0000","last_became_peered":"2024-08-20T01:29:05.169202+0000","last_unstale":"2024-08-20T01:29:55.018713+0000","last_undegraded":"2024-08-20T01:29:55.018713+0000","last_fullsized":"2024-08-20T01:29:55.018713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:05:39.645782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019554+0000","last_change":"2024-08-20T01:29:06.413839+0000","last_active":"2024-08-20T01:29:55.019554+0000","last_peered":"2024-08-20T01:29:55.019554+0000","last_clean":"2024-08-20T01:29:55.019554+0000","last_became_active":"2024-08-20T01:29:06.413488+0000","last_became_peered":"2024-08-20T01:29:06.413488+0000","last_unstale":"2024-08-20T01:29:55.019554+0000","last_undegraded":"2024-08-20T01:29:55.019554+0000","last_fullsized":"2024-08-20T01:29:55.019554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:35:04.007192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'12","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.028397+0000","last_change":"2024-08-20T01:29:55.028344+0000","last_active":"2024-08-20T01:29:55.028397+0000","last_peered":"2024-08-20T01:29:55.028397+0000","last_clean":"2024-08-20T01:29:55.028397+0000","last_became_active":"2024-08-20T01:29:55.023700+0000","last_became_peered":"2024-08-20T01:29:55.023700+0000","last_unstale":"2024-08-20T01:29:55.028397+0000","last_undegraded":"2024-08-20T01:29:55.028397+0000","last_fullsized":"2024-08-20T01:29:55.028397+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:48:39.513322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.693961+0000","last_change":"2024-08-20T01:29:06.421024+0000","last_active":"2024-08-20T01:30:53.693961+0000","last_peered":"2024-08-20T01:30:53.693961+0000","last_clean":"2024-08-20T01:30:53.693961+0000","last_became_active":"2024-08-20T01:29:06.420631+0000","last_became_peered":"2024-08-20T01:29:06.420631+0000","last_unstale":"2024-08-20T01:30:53.693961+0000","last_undegraded":"2024-08-20T01:30:53.693961+0000","last_fullsized":"2024-08-20T01:30:53.693961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:07:57.992230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019783+0000","last_change":"2024-08-20T01:29:04.835075+0000","last_active":"2024-08-20T01:29:55.019783+0000","last_peered":"2024-08-20T01:29:55.019783+0000","last_clean":"2024-08-20T01:29:55.019783+0000","last_became_active":"2024-08-20T01:29:04.834759+0000","last_became_peered":"2024-08-20T01:29:04.834759+0000","last_unstale":"2024-08-20T01:29:55.019783+0000","last_undegraded":"2024-08-20T01:29:55.019783+0000","last_fullsized":"2024-08-20T01:29:55.019783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:45:29.040626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255550+0000","last_change":"2024-08-20T01:29:06.418187+0000","last_active":"2024-08-20T01:29:55.255550+0000","last_peered":"2024-08-20T01:29:55.255550+0000","last_clean":"2024-08-20T01:29:55.255550+0000","last_became_active":"2024-08-20T01:29:06.417851+0000","last_became_peered":"2024-08-20T01:29:06.417851+0000","last_unstale":"2024-08-20T01:29:55.255550+0000","last_undegraded":"2024-08-20T01:29:55.255550+0000","last_fullsized":"2024-08-20T01:29:55.255550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:15:48.204455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027380+0000","last_change":"2024-08-20T01:29:05.169736+0000","last_active":"2024-08-20T01:29:55.027380+0000","last_peered":"2024-08-20T01:29:55.027380+0000","last_clean":"2024-08-20T01:29:55.027380+0000","last_became_active":"2024-08-20T01:29:05.169403+0000","last_became_peered":"2024-08-20T01:29:05.169403+0000","last_unstale":"2024-08-20T01:29:55.027380+0000","last_undegraded":"2024-08-20T01:29:55.027380+0000","last_fullsized":"2024-08-20T01:29:55.027380+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:43:43.500841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017870+0000","last_change":"2024-08-20T01:29:06.416433+0000","last_active":"2024-08-20T01:29:55.017870+0000","last_peered":"2024-08-20T01:29:55.017870+0000","last_clean":"2024-08-20T01:29:55.017870+0000","last_became_active":"2024-08-20T01:29:06.414708+0000","last_became_peered":"2024-08-20T01:29:06.414708+0000","last_unstale":"2024-08-20T01:29:55.017870+0000","last_undegraded":"2024-08-20T01:29:55.017870+0000","last_fullsized":"2024-08-20T01:29:55.017870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:17:15.461536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018260+0000","last_change":"2024-08-20T01:29:04.403090+0000","last_active":"2024-08-20T01:29:55.018260+0000","last_peered":"2024-08-20T01:29:55.018260+0000","last_clean":"2024-08-20T01:29:55.018260+0000","last_became_active":"2024-08-20T01:29:04.402697+0000","last_became_peered":"2024-08-20T01:29:04.402697+0000","last_unstale":"2024-08-20T01:29:55.018260+0000","last_undegraded":"2024-08-20T01:29:55.018260+0000","last_fullsized":"2024-08-20T01:29:55.018260+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:36:04.055868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.020556+0000","last_change":"2024-08-20T01:29:06.413427+0000","last_active":"2024-08-20T01:29:55.020556+0000","last_peered":"2024-08-20T01:29:55.020556+0000","last_clean":"2024-08-20T01:29:55.020556+0000","last_became_active":"2024-08-20T01:29:06.413058+0000","last_became_peered":"2024-08-20T01:29:06.413058+0000","last_unstale":"2024-08-20T01:29:55.020556+0000","last_undegraded":"2024-08-20T01:29:55.020556+0000","last_fullsized":"2024-08-20T01:29:55.020556+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:38:38.546701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021609+0000","last_change":"2024-08-20T01:29:04.409859+0000","last_active":"2024-08-20T01:29:55.021609+0000","last_peered":"2024-08-20T01:29:55.021609+0000","last_clean":"2024-08-20T01:29:55.021609+0000","last_became_active":"2024-08-20T01:29:04.409497+0000","last_became_peered":"2024-08-20T01:29:04.409497+0000","last_unstale":"2024-08-20T01:29:55.021609+0000","last_undegraded":"2024-08-20T01:29:55.021609+0000","last_fullsized":"2024-08-20T01:29:55.021609+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:23:43.548912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.696726+0000","last_change":"2024-08-20T01:29:06.418428+0000","last_active":"2024-08-20T01:30:53.696726+0000","last_peered":"2024-08-20T01:30:53.696726+0000","last_clean":"2024-08-20T01:30:53.696726+0000","last_became_active":"2024-08-20T01:29:06.418033+0000","last_became_peered":"2024-08-20T01:29:06.418033+0000","last_unstale":"2024-08-20T01:30:53.696726+0000","last_undegraded":"2024-08-20T01:30:53.696726+0000","last_fullsized":"2024-08-20T01:30:53.696726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:23.503977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017941+0000","last_change":"2024-08-20T01:29:04.412549+0000","last_active":"2024-08-20T01:29:55.017941+0000","last_peered":"2024-08-20T01:29:55.017941+0000","last_clean":"2024-08-20T01:29:55.017941+0000","last_became_active":"2024-08-20T01:29:04.412071+0000","last_became_peered":"2024-08-20T01:29:04.412071+0000","last_unstale":"2024-08-20T01:29:55.017941+0000","last_undegraded":"2024-08-20T01:29:55.017941+0000","last_fullsized":"2024-08-20T01:29:55.017941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:48:51.195295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376669+0000","last_change":"2024-08-20T01:29:06.421431+0000","last_active":"2024-08-20T01:29:55.376669+0000","last_peered":"2024-08-20T01:29:55.376669+0000","last_clean":"2024-08-20T01:29:55.376669+0000","last_became_active":"2024-08-20T01:29:06.420916+0000","last_became_peered":"2024-08-20T01:29:06.420916+0000","last_unstale":"2024-08-20T01:29:55.376669+0000","last_undegraded":"2024-08-20T01:29:55.376669+0000","last_fullsized":"2024-08-20T01:29:55.376669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:45.674530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017140+0000","last_change":"2024-08-20T01:29:06.418209+0000","last_active":"2024-08-20T01:29:55.017140+0000","last_peered":"2024-08-20T01:29:55.017140+0000","last_clean":"2024-08-20T01:29:55.017140+0000","last_became_active":"2024-08-20T01:29:06.417812+0000","last_became_peered":"2024-08-20T01:29:06.417812+0000","last_unstale":"2024-08-20T01:29:55.017140+0000","last_undegraded":"2024-08-20T01:29:55.017140+0000","last_fullsized":"2024-08-20T01:29:55.017140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:05:43.794281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018906+0000","last_change":"2024-08-20T01:29:04.408472+0000","last_active":"2024-08-20T01:29:55.018906+0000","last_peered":"2024-08-20T01:29:55.018906+0000","last_clean":"2024-08-20T01:29:55.018906+0000","last_became_active":"2024-08-20T01:29:04.408082+0000","last_became_peered":"2024-08-20T01:29:04.408082+0000","last_unstale":"2024-08-20T01:29:55.018906+0000","last_undegraded":"2024-08-20T01:29:55.018906+0000","last_fullsized":"2024-08-20T01:29:55.018906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:14:44.659672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027748+0000","last_change":"2024-08-20T01:29:06.423562+0000","last_active":"2024-08-20T01:29:55.027748+0000","last_peered":"2024-08-20T01:29:55.027748+0000","last_clean":"2024-08-20T01:29:55.027748+0000","last_became_active":"2024-08-20T01:29:06.423241+0000","last_became_peered":"2024-08-20T01:29:06.423241+0000","last_unstale":"2024-08-20T01:29:55.027748+0000","last_undegraded":"2024-08-20T01:29:55.027748+0000","last_fullsized":"2024-08-20T01:29:55.027748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:59:46.049449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018583+0000","last_change":"2024-08-20T01:29:04.412287+0000","last_active":"2024-08-20T01:29:55.018583+0000","last_peered":"2024-08-20T01:29:55.018583+0000","last_clean":"2024-08-20T01:29:55.018583+0000","last_became_active":"2024-08-20T01:29:04.411912+0000","last_became_peered":"2024-08-20T01:29:04.411912+0000","last_unstale":"2024-08-20T01:29:55.018583+0000","last_undegraded":"2024-08-20T01:29:55.018583+0000","last_fullsized":"2024-08-20T01:29:55.018583+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:19:25.816795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255713+0000","last_change":"2024-08-20T01:29:06.416899+0000","last_active":"2024-08-20T01:29:55.255713+0000","last_peered":"2024-08-20T01:29:55.255713+0000","last_clean":"2024-08-20T01:29:55.255713+0000","last_became_active":"2024-08-20T01:29:06.416594+0000","last_became_peered":"2024-08-20T01:29:06.416594+0000","last_unstale":"2024-08-20T01:29:55.255713+0000","last_undegraded":"2024-08-20T01:29:55.255713+0000","last_fullsized":"2024-08-20T01:29:55.255713+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:43.896728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018949+0000","last_change":"2024-08-20T01:29:05.169571+0000","last_active":"2024-08-20T01:29:55.018949+0000","last_peered":"2024-08-20T01:29:55.018949+0000","last_clean":"2024-08-20T01:29:55.018949+0000","last_became_active":"2024-08-20T01:29:05.169250+0000","last_became_peered":"2024-08-20T01:29:05.169250+0000","last_unstale":"2024-08-20T01:29:55.018949+0000","last_undegraded":"2024-08-20T01:29:55.018949+0000","last_fullsized":"2024-08-20T01:29:55.018949+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:32:04.555825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.698335+0000","last_change":"2024-08-20T01:29:06.415582+0000","last_active":"2024-08-20T01:30:53.698335+0000","last_peered":"2024-08-20T01:30:53.698335+0000","last_clean":"2024-08-20T01:30:53.698335+0000","last_became_active":"2024-08-20T01:29:06.415284+0000","last_became_peered":"2024-08-20T01:29:06.415284+0000","last_unstale":"2024-08-20T01:30:53.698335+0000","last_undegraded":"2024-08-20T01:30:53.698335+0000","last_fullsized":"2024-08-20T01:30:53.698335+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:43:10.311792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015914+0000","last_change":"2024-08-20T01:29:04.409389+0000","last_active":"2024-08-20T01:29:55.015914+0000","last_peered":"2024-08-20T01:29:55.015914+0000","last_clean":"2024-08-20T01:29:55.015914+0000","last_became_active":"2024-08-20T01:29:04.409099+0000","last_became_peered":"2024-08-20T01:29:04.409099+0000","last_unstale":"2024-08-20T01:29:55.015914+0000","last_undegraded":"2024-08-20T01:29:55.015914+0000","last_fullsized":"2024-08-20T01:29:55.015914+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:19:30.156443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63,"ondisk_log_size":63,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64379,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":591,"num_read_kb":364,"num_write":168,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":59762,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":197451,"data_compressed":9608,"data_compressed_allocated":12288,"data_compressed_original":57344,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285456,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743459,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":831488,"data_stored":406512,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939688,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1058371,"data_compressed":42066,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103212,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":406748,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":847872,"data_stored":406668,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495670,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":998906,"data_compressed":42066,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659196,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":406137,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855425,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":909312,"data_stored":998282,"data_compressed":42066,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":864256,"data_stored":466336,"data_compressed":15386,"data_compressed_allocated":20480,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215179,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":851968,"data_stored":406448,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,4,6,17,18],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":851968,"data_stored":407671,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":466000,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":856064,"data_stored":407408,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":61022,"data_compressed":9608,"data_compressed_allocated":12288,"data_compressed_original":57344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T01:30:54.932 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-20T01:30:55.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.071+0000 7fca4064f640 1 -- 172.21.15.22:0/324271256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca381030c0 msgr2=0x7fca38109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:55.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.071+0000 7fca4064f640 1 --2- 172.21.15.22:0/324271256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca381030c0 0x7fca38109a40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fca30009cd0 tx=0x7fca3002a8e0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.071+0000 7fca4064f640 1 -- 172.21.15.22:0/324271256 shutdown_connections 2024-08-20T01:30:55.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.071+0000 7fca4064f640 1 --2- 172.21.15.22:0/324271256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca381030c0 0x7fca38109a40 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.071+0000 7fca4064f640 1 --2- 172.21.15.22:0/324271256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca38102700 0x7fca38102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.071+0000 7fca4064f640 1 --2- 172.21.15.22:0/324271256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca381015b0 0x7fca381019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.071+0000 7fca4064f640 1 -- 172.21.15.22:0/324271256 >> 172.21.15.22:0/324271256 conn(0x7fca380fce50 msgr2=0x7fca380ff290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:55.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.071+0000 7fca4064f640 1 -- 172.21.15.22:0/324271256 shutdown_connections 2024-08-20T01:30:55.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.071+0000 7fca4064f640 1 -- 172.21.15.22:0/324271256 wait complete. 2024-08-20T01:30:55.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.072+0000 7fca4064f640 1 Processor -- start 2024-08-20T01:30:55.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.072+0000 7fca4064f640 1 -- start start 2024-08-20T01:30:55.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.072+0000 7fca4064f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca381015b0 0x7fca38198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:55.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.072+0000 7fca4064f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca38102700 0x7fca38199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:55.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.072+0000 7fca4064f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca381030c0 0x7fca38199ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:55.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.072+0000 7fca4064f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fca3810d250 con 0x7fca381015b0 2024-08-20T01:30:55.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.072+0000 7fca4064f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fca3810d0d0 con 0x7fca381030c0 2024-08-20T01:30:55.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.072+0000 7fca4064f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fca3810d3d0 con 0x7fca38102700 2024-08-20T01:30:55.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.072+0000 7fca3e3eb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca381015b0 0x7fca38198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:55.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.072+0000 7fca3e3eb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca381015b0 0x7fca38198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43224/0 (socket says 172.21.15.22:43224) 2024-08-20T01:30:55.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.072+0000 7fca3e3eb640 1 -- 172.21.15.22:0/2803153834 learned_addr learned my addr 172.21.15.22:0/2803153834 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:55.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.072+0000 7fca3ebec640 1 --2- 172.21.15.22:0/2803153834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca381030c0 0x7fca38199ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:55.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.072+0000 7fca3dbea640 1 --2- 172.21.15.22:0/2803153834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca38102700 0x7fca38199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.072+0000 7fca3e3eb640 1 -- 172.21.15.22:0/2803153834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca38102700 msgr2=0x7fca38199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.072+0000 7fca3e3eb640 1 --2- 172.21.15.22:0/2803153834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca38102700 0x7fca38199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.072+0000 7fca3e3eb640 1 -- 172.21.15.22:0/2803153834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca381030c0 msgr2=0x7fca38199ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.072+0000 7fca3e3eb640 1 --2- 172.21.15.22:0/2803153834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca381030c0 0x7fca38199ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.072+0000 7fca3e3eb640 1 -- 172.21.15.22:0/2803153834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3819a5a0 con 0x7fca381015b0 2024-08-20T01:30:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.073+0000 7fca3dbea640 1 --2- 172.21.15.22:0/2803153834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca38102700 0x7fca38199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.073+0000 7fca3e3eb640 1 --2- 172.21.15.22:0/2803153834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca381015b0 0x7fca38198ad0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fca3400d950 tx=0x7fca3400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.073+0000 7fca2f7fe640 1 -- 172.21.15.22:0/2803153834 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34017070 con 0x7fca381015b0 2024-08-20T01:30:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.073+0000 7fca2f7fe640 1 -- 172.21.15.22:0/2803153834 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca34009c30 con 0x7fca381015b0 2024-08-20T01:30:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.073+0000 7fca4064f640 1 -- 172.21.15.22:0/2803153834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca3819a890 con 0x7fca381015b0 2024-08-20T01:30:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.073+0000 7fca2f7fe640 1 -- 172.21.15.22:0/2803153834 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3400f620 con 0x7fca381015b0 2024-08-20T01:30:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.073+0000 7fca4064f640 1 -- 172.21.15.22:0/2803153834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca381a0f60 con 0x7fca381015b0 2024-08-20T01:30:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.074+0000 7fca4064f640 1 -- 172.21.15.22:0/2803153834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca381019b0 con 0x7fca381015b0 2024-08-20T01:30:55.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.075+0000 7fca2f7fe640 1 -- 172.21.15.22:0/2803153834 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fca34010460 con 0x7fca381015b0 2024-08-20T01:30:55.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.076+0000 7fca2f7fe640 1 --2- 172.21.15.22:0/2803153834 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fca240b3ce0 0x7fca240b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:55.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.076+0000 7fca3dbea640 1 --2- 172.21.15.22:0/2803153834 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fca240b3ce0 0x7fca240b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:55.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.076+0000 7fca2f7fe640 1 -- 172.21.15.22:0/2803153834 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8298+0+0 (secure 0 0 0) 0x7fca340e39d0 con 0x7fca381015b0 2024-08-20T01:30:55.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.077+0000 7fca3dbea640 1 --2- 172.21.15.22:0/2803153834 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fca240b3ce0 0x7fca240b61a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fca280058c0 tx=0x7fca28005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:55.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.079+0000 7fca2f7fe640 1 -- 172.21.15.22:0/2803153834 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fca340aaea0 con 0x7fca381015b0 2024-08-20T01:30:55.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.259+0000 7fca4064f640 1 -- 172.21.15.22:0/2803153834 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fca3806b690 con 0x7fca240b3ce0 2024-08-20T01:30:55.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.263+0000 7fca2f7fe640 1 -- 172.21.15.22:0/2803153834 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259060 (secure 0 0 0) 0x7fca3806b690 con 0x7fca240b3ce0 2024-08-20T01:30:55.267 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:55.268 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-08-20T01:30:55.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.267+0000 7fca4064f640 1 -- 172.21.15.22:0/2803153834 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fca240b3ce0 msgr2=0x7fca240b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:55.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.267+0000 7fca4064f640 1 --2- 172.21.15.22:0/2803153834 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fca240b3ce0 0x7fca240b61a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fca280058c0 tx=0x7fca28005850 comp rx=0 tx=0).stop 2024-08-20T01:30:55.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.267+0000 7fca4064f640 1 -- 172.21.15.22:0/2803153834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca381015b0 msgr2=0x7fca38198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:55.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.267+0000 7fca4064f640 1 --2- 172.21.15.22:0/2803153834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca381015b0 0x7fca38198ad0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fca3400d950 tx=0x7fca3400de10 comp rx=0 tx=0).stop 2024-08-20T01:30:55.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.267+0000 7fca4064f640 1 -- 172.21.15.22:0/2803153834 shutdown_connections 2024-08-20T01:30:55.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.267+0000 7fca4064f640 1 --2- 172.21.15.22:0/2803153834 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fca240b3ce0 0x7fca240b61a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.267+0000 7fca4064f640 1 --2- 172.21.15.22:0/2803153834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca381030c0 0x7fca38199ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.267+0000 7fca4064f640 1 --2- 172.21.15.22:0/2803153834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca38102700 0x7fca38199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.267+0000 7fca4064f640 1 --2- 172.21.15.22:0/2803153834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca381015b0 0x7fca38198ad0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.267+0000 7fca4064f640 1 -- 172.21.15.22:0/2803153834 >> 172.21.15.22:0/2803153834 conn(0x7fca380fce50 msgr2=0x7fca3806af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:55.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.267+0000 7fca4064f640 1 -- 172.21.15.22:0/2803153834 shutdown_connections 2024-08-20T01:30:55.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.267+0000 7fca4064f640 1 -- 172.21.15.22:0/2803153834 wait complete. 2024-08-20T01:30:55.278 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-08-20T01:30:54.503896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654981,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":667,"num_read_kb":428,"num_write":293,"num_write_kb":2265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":3011602,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":298,"ondisk_log_size":298,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363708,"kb_used_data":10228,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124578116,"statfs":{"total":1151940427776,"available":1151567990784,"internally_reserved":0,"allocated":10473472,"data_stored":6835487,"data_compressed":187808,"data_compressed_allocated":245760,"data_compressed_original":2023424,"omap_allocated":19139,"internal_metadata":361674045},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,4,6,17,18],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":31,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.184302"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019956+0000","last_change":"2024-08-20T01:29:06.421092+0000","last_active":"2024-08-20T01:29:55.019956+0000","last_peered":"2024-08-20T01:29:55.019956+0000","last_clean":"2024-08-20T01:29:55.019956+0000","last_became_active":"2024-08-20T01:29:06.420484+0000","last_became_peered":"2024-08-20T01:29:06.420484+0000","last_unstale":"2024-08-20T01:29:55.019956+0000","last_undegraded":"2024-08-20T01:29:55.019956+0000","last_fullsized":"2024-08-20T01:29:55.019956+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:55:54.177863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255444+0000","last_change":"2024-08-20T01:29:06.414784+0000","last_active":"2024-08-20T01:29:55.255444+0000","last_peered":"2024-08-20T01:29:55.255444+0000","last_clean":"2024-08-20T01:29:55.255444+0000","last_became_active":"2024-08-20T01:29:06.414426+0000","last_became_peered":"2024-08-20T01:29:06.414426+0000","last_unstale":"2024-08-20T01:29:55.255444+0000","last_undegraded":"2024-08-20T01:29:55.255444+0000","last_fullsized":"2024-08-20T01:29:55.255444+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:13:45.634888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255426+0000","last_change":"2024-08-20T01:29:06.416876+0000","last_active":"2024-08-20T01:29:55.255426+0000","last_peered":"2024-08-20T01:29:55.255426+0000","last_clean":"2024-08-20T01:29:55.255426+0000","last_became_active":"2024-08-20T01:29:06.416548+0000","last_became_peered":"2024-08-20T01:29:06.416548+0000","last_unstale":"2024-08-20T01:29:55.255426+0000","last_undegraded":"2024-08-20T01:29:55.255426+0000","last_fullsized":"2024-08-20T01:29:55.255426+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:16:23.092129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019553+0000","last_change":"2024-08-20T01:29:06.415474+0000","last_active":"2024-08-20T01:29:55.019553+0000","last_peered":"2024-08-20T01:29:55.019553+0000","last_clean":"2024-08-20T01:29:55.019553+0000","last_became_active":"2024-08-20T01:29:06.415120+0000","last_became_peered":"2024-08-20T01:29:06.415120+0000","last_unstale":"2024-08-20T01:29:55.019553+0000","last_undegraded":"2024-08-20T01:29:55.019553+0000","last_fullsized":"2024-08-20T01:29:55.019553+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:47.059173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.022520+0000","last_change":"2024-08-20T01:29:55.022459+0000","last_active":"2024-08-20T01:29:55.022520+0000","last_peered":"2024-08-20T01:29:55.022520+0000","last_clean":"2024-08-20T01:29:55.022520+0000","last_became_active":"2024-08-20T01:29:55.022110+0000","last_became_peered":"2024-08-20T01:29:55.022110+0000","last_unstale":"2024-08-20T01:29:55.022520+0000","last_undegraded":"2024-08-20T01:29:55.022520+0000","last_fullsized":"2024-08-20T01:29:55.022520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:56:44.318445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024716+0000","last_change":"2024-08-20T01:29:06.420995+0000","last_active":"2024-08-20T01:29:55.024716+0000","last_peered":"2024-08-20T01:29:55.024716+0000","last_clean":"2024-08-20T01:29:55.024716+0000","last_became_active":"2024-08-20T01:29:06.420703+0000","last_became_peered":"2024-08-20T01:29:06.420703+0000","last_unstale":"2024-08-20T01:29:55.024716+0000","last_undegraded":"2024-08-20T01:29:55.024716+0000","last_fullsized":"2024-08-20T01:29:55.024716+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:21:08.502158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376076+0000","last_change":"2024-08-20T01:29:06.411605+0000","last_active":"2024-08-20T01:29:55.376076+0000","last_peered":"2024-08-20T01:29:55.376076+0000","last_clean":"2024-08-20T01:29:55.376076+0000","last_became_active":"2024-08-20T01:29:06.411258+0000","last_became_peered":"2024-08-20T01:29:06.411258+0000","last_unstale":"2024-08-20T01:29:55.376076+0000","last_undegraded":"2024-08-20T01:29:55.376076+0000","last_fullsized":"2024-08-20T01:29:55.376076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:17:02.390707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.699603+0000","last_change":"2024-08-20T01:29:06.418514+0000","last_active":"2024-08-20T01:30:53.699603+0000","last_peered":"2024-08-20T01:30:53.699603+0000","last_clean":"2024-08-20T01:30:53.699603+0000","last_became_active":"2024-08-20T01:29:06.417450+0000","last_became_peered":"2024-08-20T01:29:06.417450+0000","last_unstale":"2024-08-20T01:30:53.699603+0000","last_undegraded":"2024-08-20T01:30:53.699603+0000","last_fullsized":"2024-08-20T01:30:53.699603+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:13:15.485333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.028241+0000","last_change":"2024-08-20T01:29:06.425458+0000","last_active":"2024-08-20T01:29:55.028241+0000","last_peered":"2024-08-20T01:29:55.028241+0000","last_clean":"2024-08-20T01:29:55.028241+0000","last_became_active":"2024-08-20T01:29:06.425122+0000","last_became_peered":"2024-08-20T01:29:06.425122+0000","last_unstale":"2024-08-20T01:29:55.028241+0000","last_undegraded":"2024-08-20T01:29:55.028241+0000","last_fullsized":"2024-08-20T01:29:55.028241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:52:59.857195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.025175+0000","last_change":"2024-08-20T01:29:06.420258+0000","last_active":"2024-08-20T01:29:55.025175+0000","last_peered":"2024-08-20T01:29:55.025175+0000","last_clean":"2024-08-20T01:29:55.025175+0000","last_became_active":"2024-08-20T01:29:06.419982+0000","last_became_peered":"2024-08-20T01:29:06.419982+0000","last_unstale":"2024-08-20T01:29:55.025175+0000","last_undegraded":"2024-08-20T01:29:55.025175+0000","last_fullsized":"2024-08-20T01:29:55.025175+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:56:23.296739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376666+0000","last_change":"2024-08-20T01:29:06.421580+0000","last_active":"2024-08-20T01:29:55.376666+0000","last_peered":"2024-08-20T01:29:55.376666+0000","last_clean":"2024-08-20T01:29:55.376666+0000","last_became_active":"2024-08-20T01:29:06.421115+0000","last_became_peered":"2024-08-20T01:29:06.421115+0000","last_unstale":"2024-08-20T01:29:55.376666+0000","last_undegraded":"2024-08-20T01:29:55.376666+0000","last_fullsized":"2024-08-20T01:29:55.376666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:43:13.839230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019544+0000","last_change":"2024-08-20T01:29:06.416950+0000","last_active":"2024-08-20T01:29:55.019544+0000","last_peered":"2024-08-20T01:29:55.019544+0000","last_clean":"2024-08-20T01:29:55.019544+0000","last_became_active":"2024-08-20T01:29:06.415585+0000","last_became_peered":"2024-08-20T01:29:06.415585+0000","last_unstale":"2024-08-20T01:29:55.019544+0000","last_undegraded":"2024-08-20T01:29:55.019544+0000","last_fullsized":"2024-08-20T01:29:55.019544+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:47:54.132535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027677+0000","last_change":"2024-08-20T01:29:55.027622+0000","last_active":"2024-08-20T01:29:55.027677+0000","last_peered":"2024-08-20T01:29:55.027677+0000","last_clean":"2024-08-20T01:29:55.027677+0000","last_became_active":"2024-08-20T01:29:55.027246+0000","last_became_peered":"2024-08-20T01:29:55.027246+0000","last_unstale":"2024-08-20T01:29:55.027677+0000","last_undegraded":"2024-08-20T01:29:55.027677+0000","last_fullsized":"2024-08-20T01:29:55.027677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:30:25.209975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255506+0000","last_change":"2024-08-20T01:29:06.415494+0000","last_active":"2024-08-20T01:29:55.255506+0000","last_peered":"2024-08-20T01:29:55.255506+0000","last_clean":"2024-08-20T01:29:55.255506+0000","last_became_active":"2024-08-20T01:29:06.415099+0000","last_became_peered":"2024-08-20T01:29:06.415099+0000","last_unstale":"2024-08-20T01:29:55.255506+0000","last_undegraded":"2024-08-20T01:29:55.255506+0000","last_fullsized":"2024-08-20T01:29:55.255506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:07:01.946143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'3","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255243+0000","last_change":"2024-08-20T01:29:06.418233+0000","last_active":"2024-08-20T01:29:55.255243+0000","last_peered":"2024-08-20T01:29:55.255243+0000","last_clean":"2024-08-20T01:29:55.255243+0000","last_became_active":"2024-08-20T01:29:06.417929+0000","last_became_peered":"2024-08-20T01:29:06.417929+0000","last_unstale":"2024-08-20T01:29:55.255243+0000","last_undegraded":"2024-08-20T01:29:55.255243+0000","last_fullsized":"2024-08-20T01:29:55.255243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:44:08.548821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027280+0000","last_change":"2024-08-20T01:29:06.418819+0000","last_active":"2024-08-20T01:29:55.027280+0000","last_peered":"2024-08-20T01:29:55.027280+0000","last_clean":"2024-08-20T01:29:55.027280+0000","last_became_active":"2024-08-20T01:29:06.418378+0000","last_became_peered":"2024-08-20T01:29:06.418378+0000","last_unstale":"2024-08-20T01:29:55.027280+0000","last_undegraded":"2024-08-20T01:29:55.027280+0000","last_fullsized":"2024-08-20T01:29:55.027280+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:01.419539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.020071+0000","last_change":"2024-08-20T01:29:06.420804+0000","last_active":"2024-08-20T01:29:55.020071+0000","last_peered":"2024-08-20T01:29:55.020071+0000","last_clean":"2024-08-20T01:29:55.020071+0000","last_became_active":"2024-08-20T01:29:06.420027+0000","last_became_peered":"2024-08-20T01:29:06.420027+0000","last_unstale":"2024-08-20T01:29:55.020071+0000","last_undegraded":"2024-08-20T01:29:55.020071+0000","last_fullsized":"2024-08-20T01:29:55.020071+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:00:37.104792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015970+0000","last_change":"2024-08-20T01:29:06.411625+0000","last_active":"2024-08-20T01:29:55.015970+0000","last_peered":"2024-08-20T01:29:55.015970+0000","last_clean":"2024-08-20T01:29:55.015970+0000","last_became_active":"2024-08-20T01:29:06.411284+0000","last_became_peered":"2024-08-20T01:29:06.411284+0000","last_unstale":"2024-08-20T01:29:55.015970+0000","last_undegraded":"2024-08-20T01:29:55.015970+0000","last_fullsized":"2024-08-20T01:29:55.015970+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:12:08.510755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021766+0000","last_change":"2024-08-20T01:29:06.421276+0000","last_active":"2024-08-20T01:29:55.021766+0000","last_peered":"2024-08-20T01:29:55.021766+0000","last_clean":"2024-08-20T01:29:55.021766+0000","last_became_active":"2024-08-20T01:29:06.420916+0000","last_became_peered":"2024-08-20T01:29:06.420916+0000","last_unstale":"2024-08-20T01:29:55.021766+0000","last_undegraded":"2024-08-20T01:29:55.021766+0000","last_fullsized":"2024-08-20T01:29:55.021766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:04:59.399172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.020688+0000","last_change":"2024-08-20T01:29:06.420848+0000","last_active":"2024-08-20T01:29:55.020688+0000","last_peered":"2024-08-20T01:29:55.020688+0000","last_clean":"2024-08-20T01:29:55.020688+0000","last_became_active":"2024-08-20T01:29:06.420465+0000","last_became_peered":"2024-08-20T01:29:06.420465+0000","last_unstale":"2024-08-20T01:29:55.020688+0000","last_undegraded":"2024-08-20T01:29:55.020688+0000","last_fullsized":"2024-08-20T01:29:55.020688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:42:33.210813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019585+0000","last_change":"2024-08-20T01:29:06.407353+0000","last_active":"2024-08-20T01:29:55.019585+0000","last_peered":"2024-08-20T01:29:55.019585+0000","last_clean":"2024-08-20T01:29:55.019585+0000","last_became_active":"2024-08-20T01:29:06.406944+0000","last_became_peered":"2024-08-20T01:29:06.406944+0000","last_unstale":"2024-08-20T01:29:55.019585+0000","last_undegraded":"2024-08-20T01:29:55.019585+0000","last_fullsized":"2024-08-20T01:29:55.019585+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:49:22.324317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027678+0000","last_change":"2024-08-20T01:29:06.419757+0000","last_active":"2024-08-20T01:29:55.027678+0000","last_peered":"2024-08-20T01:29:55.027678+0000","last_clean":"2024-08-20T01:29:55.027678+0000","last_became_active":"2024-08-20T01:29:06.419433+0000","last_became_peered":"2024-08-20T01:29:06.419433+0000","last_unstale":"2024-08-20T01:29:55.027678+0000","last_undegraded":"2024-08-20T01:29:55.027678+0000","last_fullsized":"2024-08-20T01:29:55.027678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:22:36.968949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.695425+0000","last_change":"2024-08-20T01:29:06.418110+0000","last_active":"2024-08-20T01:30:53.695425+0000","last_peered":"2024-08-20T01:30:53.695425+0000","last_clean":"2024-08-20T01:30:53.695425+0000","last_became_active":"2024-08-20T01:29:06.417776+0000","last_became_peered":"2024-08-20T01:29:06.417776+0000","last_unstale":"2024-08-20T01:30:53.695425+0000","last_undegraded":"2024-08-20T01:30:53.695425+0000","last_fullsized":"2024-08-20T01:30:53.695425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:55:55.105453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.016549+0000","last_change":"2024-08-20T01:29:06.414240+0000","last_active":"2024-08-20T01:29:55.016549+0000","last_peered":"2024-08-20T01:29:55.016549+0000","last_clean":"2024-08-20T01:29:55.016549+0000","last_became_active":"2024-08-20T01:29:06.413884+0000","last_became_peered":"2024-08-20T01:29:06.413884+0000","last_unstale":"2024-08-20T01:29:55.016549+0000","last_undegraded":"2024-08-20T01:29:55.016549+0000","last_fullsized":"2024-08-20T01:29:55.016549+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:00.042588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.694275+0000","last_change":"2024-08-20T01:29:06.419344+0000","last_active":"2024-08-20T01:30:53.694275+0000","last_peered":"2024-08-20T01:30:53.694275+0000","last_clean":"2024-08-20T01:30:53.694275+0000","last_became_active":"2024-08-20T01:29:06.418689+0000","last_became_peered":"2024-08-20T01:29:06.418689+0000","last_unstale":"2024-08-20T01:30:53.694275+0000","last_undegraded":"2024-08-20T01:30:53.694275+0000","last_fullsized":"2024-08-20T01:30:53.694275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:34:23.604213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.022077+0000","last_change":"2024-08-20T01:29:06.415161+0000","last_active":"2024-08-20T01:29:55.022077+0000","last_peered":"2024-08-20T01:29:55.022077+0000","last_clean":"2024-08-20T01:29:55.022077+0000","last_became_active":"2024-08-20T01:29:06.414812+0000","last_became_peered":"2024-08-20T01:29:06.414812+0000","last_unstale":"2024-08-20T01:29:55.022077+0000","last_undegraded":"2024-08-20T01:29:55.022077+0000","last_fullsized":"2024-08-20T01:29:55.022077+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:10:49.527635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021022+0000","last_change":"2024-08-20T01:29:06.416502+0000","last_active":"2024-08-20T01:29:55.021022+0000","last_peered":"2024-08-20T01:29:55.021022+0000","last_clean":"2024-08-20T01:29:55.021022+0000","last_became_active":"2024-08-20T01:29:06.416139+0000","last_became_peered":"2024-08-20T01:29:06.416139+0000","last_unstale":"2024-08-20T01:29:55.021022+0000","last_undegraded":"2024-08-20T01:29:55.021022+0000","last_fullsized":"2024-08-20T01:29:55.021022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:19:32.379867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019525+0000","last_change":"2024-08-20T01:29:06.412494+0000","last_active":"2024-08-20T01:29:55.019525+0000","last_peered":"2024-08-20T01:29:55.019525+0000","last_clean":"2024-08-20T01:29:55.019525+0000","last_became_active":"2024-08-20T01:29:06.412158+0000","last_became_peered":"2024-08-20T01:29:06.412158+0000","last_unstale":"2024-08-20T01:29:55.019525+0000","last_undegraded":"2024-08-20T01:29:55.019525+0000","last_fullsized":"2024-08-20T01:29:55.019525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:57:52.088445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'4","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255526+0000","last_change":"2024-08-20T01:29:06.412869+0000","last_active":"2024-08-20T01:29:55.255526+0000","last_peered":"2024-08-20T01:29:55.255526+0000","last_clean":"2024-08-20T01:29:55.255526+0000","last_became_active":"2024-08-20T01:29:06.412540+0000","last_became_peered":"2024-08-20T01:29:06.412540+0000","last_unstale":"2024-08-20T01:29:55.255526+0000","last_undegraded":"2024-08-20T01:29:55.255526+0000","last_fullsized":"2024-08-20T01:29:55.255526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:11:10.011252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.256428+0000","last_change":"2024-08-20T01:29:55.256345+0000","last_active":"2024-08-20T01:29:55.256428+0000","last_peered":"2024-08-20T01:29:55.256428+0000","last_clean":"2024-08-20T01:29:55.256428+0000","last_became_active":"2024-08-20T01:29:55.256001+0000","last_became_peered":"2024-08-20T01:29:55.256001+0000","last_unstale":"2024-08-20T01:29:55.256428+0000","last_undegraded":"2024-08-20T01:29:55.256428+0000","last_fullsized":"2024-08-20T01:29:55.256428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:02:02.453668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.022020+0000","last_change":"2024-08-20T01:29:06.423874+0000","last_active":"2024-08-20T01:29:55.022020+0000","last_peered":"2024-08-20T01:29:55.022020+0000","last_clean":"2024-08-20T01:29:55.022020+0000","last_became_active":"2024-08-20T01:29:06.423561+0000","last_became_peered":"2024-08-20T01:29:06.423561+0000","last_unstale":"2024-08-20T01:29:55.022020+0000","last_undegraded":"2024-08-20T01:29:55.022020+0000","last_fullsized":"2024-08-20T01:29:55.022020+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:13:53.654099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019575+0000","last_change":"2024-08-20T01:29:06.414212+0000","last_active":"2024-08-20T01:29:55.019575+0000","last_peered":"2024-08-20T01:29:55.019575+0000","last_clean":"2024-08-20T01:29:55.019575+0000","last_became_active":"2024-08-20T01:29:06.413848+0000","last_became_peered":"2024-08-20T01:29:06.413848+0000","last_unstale":"2024-08-20T01:29:55.019575+0000","last_undegraded":"2024-08-20T01:29:55.019575+0000","last_fullsized":"2024-08-20T01:29:55.019575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:00:29.005461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.377988+0000","last_change":"2024-08-20T01:29:55.377940+0000","last_active":"2024-08-20T01:29:55.377988+0000","last_peered":"2024-08-20T01:29:55.377988+0000","last_clean":"2024-08-20T01:29:55.377988+0000","last_became_active":"2024-08-20T01:29:55.377642+0000","last_became_peered":"2024-08-20T01:29:55.377642+0000","last_unstale":"2024-08-20T01:29:55.377988+0000","last_undegraded":"2024-08-20T01:29:55.377988+0000","last_fullsized":"2024-08-20T01:29:55.377988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:55:28.416610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":126,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:48.615104+0000","last_change":"2024-08-20T01:29:04.413482+0000","last_active":"2024-08-20T01:30:48.615104+0000","last_peered":"2024-08-20T01:30:48.615104+0000","last_clean":"2024-08-20T01:30:48.615104+0000","last_became_active":"2024-08-20T01:29:04.413096+0000","last_became_peered":"2024-08-20T01:29:04.413096+0000","last_unstale":"2024-08-20T01:30:48.615104+0000","last_undegraded":"2024-08-20T01:30:48.615104+0000","last_fullsized":"2024-08-20T01:30:48.615104+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:26:05.947182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.022224+0000","last_change":"2024-08-20T01:29:55.022156+0000","last_active":"2024-08-20T01:29:55.022224+0000","last_peered":"2024-08-20T01:29:55.022224+0000","last_clean":"2024-08-20T01:29:55.022224+0000","last_became_active":"2024-08-20T01:29:55.021604+0000","last_became_peered":"2024-08-20T01:29:55.021604+0000","last_unstale":"2024-08-20T01:29:55.022224+0000","last_undegraded":"2024-08-20T01:29:55.022224+0000","last_fullsized":"2024-08-20T01:29:55.022224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:28:35.155390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024796+0000","last_change":"2024-08-20T01:29:04.409605+0000","last_active":"2024-08-20T01:29:55.024796+0000","last_peered":"2024-08-20T01:29:55.024796+0000","last_clean":"2024-08-20T01:29:55.024796+0000","last_became_active":"2024-08-20T01:29:04.409284+0000","last_became_peered":"2024-08-20T01:29:04.409284+0000","last_unstale":"2024-08-20T01:29:55.024796+0000","last_undegraded":"2024-08-20T01:29:55.024796+0000","last_fullsized":"2024-08-20T01:29:55.024796+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:29:27.471748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019177+0000","last_change":"2024-08-20T01:29:04.400635+0000","last_active":"2024-08-20T01:29:55.019177+0000","last_peered":"2024-08-20T01:29:55.019177+0000","last_clean":"2024-08-20T01:29:55.019177+0000","last_became_active":"2024-08-20T01:29:04.400234+0000","last_became_peered":"2024-08-20T01:29:04.400234+0000","last_unstale":"2024-08-20T01:29:55.019177+0000","last_undegraded":"2024-08-20T01:29:55.019177+0000","last_fullsized":"2024-08-20T01:29:55.019177+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:47:24.810916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.697781+0000","last_change":"2024-08-20T01:29:06.411872+0000","last_active":"2024-08-20T01:30:53.697781+0000","last_peered":"2024-08-20T01:30:53.697781+0000","last_clean":"2024-08-20T01:30:53.697781+0000","last_became_active":"2024-08-20T01:29:06.411563+0000","last_became_peered":"2024-08-20T01:29:06.411563+0000","last_unstale":"2024-08-20T01:30:53.697781+0000","last_undegraded":"2024-08-20T01:30:53.697781+0000","last_fullsized":"2024-08-20T01:30:53.697781+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:03:37.351529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017046+0000","last_change":"2024-08-20T01:29:04.407395+0000","last_active":"2024-08-20T01:29:55.017046+0000","last_peered":"2024-08-20T01:29:55.017046+0000","last_clean":"2024-08-20T01:29:55.017046+0000","last_became_active":"2024-08-20T01:29:04.407000+0000","last_became_peered":"2024-08-20T01:29:04.407000+0000","last_unstale":"2024-08-20T01:29:55.017046+0000","last_undegraded":"2024-08-20T01:29:55.017046+0000","last_fullsized":"2024-08-20T01:29:55.017046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:36:42.512450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015687+0000","last_change":"2024-08-20T01:29:06.410094+0000","last_active":"2024-08-20T01:29:55.015687+0000","last_peered":"2024-08-20T01:29:55.015687+0000","last_clean":"2024-08-20T01:29:55.015687+0000","last_became_active":"2024-08-20T01:29:06.409749+0000","last_became_peered":"2024-08-20T01:29:06.409749+0000","last_unstale":"2024-08-20T01:29:55.015687+0000","last_undegraded":"2024-08-20T01:29:55.015687+0000","last_fullsized":"2024-08-20T01:29:55.015687+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:52:51.072953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":121,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:49.615938+0000","last_change":"2024-08-20T01:29:04.406810+0000","last_active":"2024-08-20T01:30:49.615938+0000","last_peered":"2024-08-20T01:30:49.615938+0000","last_clean":"2024-08-20T01:30:49.615938+0000","last_became_active":"2024-08-20T01:29:04.406436+0000","last_became_peered":"2024-08-20T01:29:04.406436+0000","last_unstale":"2024-08-20T01:30:49.615938+0000","last_undegraded":"2024-08-20T01:30:49.615938+0000","last_fullsized":"2024-08-20T01:30:49.615938+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:49:57.305447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.028186+0000","last_change":"2024-08-20T01:29:06.424442+0000","last_active":"2024-08-20T01:29:55.028186+0000","last_peered":"2024-08-20T01:29:55.028186+0000","last_clean":"2024-08-20T01:29:55.028186+0000","last_became_active":"2024-08-20T01:29:06.424132+0000","last_became_peered":"2024-08-20T01:29:06.424132+0000","last_unstale":"2024-08-20T01:29:55.028186+0000","last_undegraded":"2024-08-20T01:29:55.028186+0000","last_fullsized":"2024-08-20T01:29:55.028186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:31:30.861113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376745+0000","last_change":"2024-08-20T01:29:04.412307+0000","last_active":"2024-08-20T01:29:55.376745+0000","last_peered":"2024-08-20T01:29:55.376745+0000","last_clean":"2024-08-20T01:29:55.376745+0000","last_became_active":"2024-08-20T01:29:04.411861+0000","last_became_peered":"2024-08-20T01:29:04.411861+0000","last_unstale":"2024-08-20T01:29:55.376745+0000","last_undegraded":"2024-08-20T01:29:55.376745+0000","last_fullsized":"2024-08-20T01:29:55.376745+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:56:51.356821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255721+0000","last_change":"2024-08-20T01:29:06.418525+0000","last_active":"2024-08-20T01:29:55.255721+0000","last_peered":"2024-08-20T01:29:55.255721+0000","last_clean":"2024-08-20T01:29:55.255721+0000","last_became_active":"2024-08-20T01:29:06.417902+0000","last_became_peered":"2024-08-20T01:29:06.417902+0000","last_unstale":"2024-08-20T01:29:55.255721+0000","last_undegraded":"2024-08-20T01:29:55.255721+0000","last_fullsized":"2024-08-20T01:29:55.255721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:28:23.017315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017602+0000","last_change":"2024-08-20T01:29:05.171538+0000","last_active":"2024-08-20T01:29:55.017602+0000","last_peered":"2024-08-20T01:29:55.017602+0000","last_clean":"2024-08-20T01:29:55.017602+0000","last_became_active":"2024-08-20T01:29:05.171172+0000","last_became_peered":"2024-08-20T01:29:05.171172+0000","last_unstale":"2024-08-20T01:29:55.017602+0000","last_undegraded":"2024-08-20T01:29:55.017602+0000","last_fullsized":"2024-08-20T01:29:55.017602+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:04:27.968049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027866+0000","last_change":"2024-08-20T01:29:06.426886+0000","last_active":"2024-08-20T01:29:55.027866+0000","last_peered":"2024-08-20T01:29:55.027866+0000","last_clean":"2024-08-20T01:29:55.027866+0000","last_became_active":"2024-08-20T01:29:06.426569+0000","last_became_peered":"2024-08-20T01:29:06.426569+0000","last_unstale":"2024-08-20T01:29:55.027866+0000","last_undegraded":"2024-08-20T01:29:55.027866+0000","last_fullsized":"2024-08-20T01:29:55.027866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:34:21.948591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'30","reported_seq":270,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:50.124736+0000","last_change":"2024-08-20T01:29:55.038445+0000","last_active":"2024-08-20T01:30:50.124736+0000","last_peered":"2024-08-20T01:30:50.124736+0000","last_clean":"2024-08-20T01:30:50.124736+0000","last_became_active":"2024-08-20T01:29:55.030683+0000","last_became_peered":"2024-08-20T01:29:55.030683+0000","last_unstale":"2024-08-20T01:30:50.124736+0000","last_undegraded":"2024-08-20T01:30:50.124736+0000","last_fullsized":"2024-08-20T01:30:50.124736+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:07:42.592996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60070,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":194,"num_read_kb":155,"num_write":31,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":59762,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018478+0000","last_change":"2024-08-20T01:29:06.417097+0000","last_active":"2024-08-20T01:29:55.018478+0000","last_peered":"2024-08-20T01:29:55.018478+0000","last_clean":"2024-08-20T01:29:55.018478+0000","last_became_active":"2024-08-20T01:29:06.416491+0000","last_became_peered":"2024-08-20T01:29:06.416491+0000","last_unstale":"2024-08-20T01:29:55.018478+0000","last_undegraded":"2024-08-20T01:29:55.018478+0000","last_fullsized":"2024-08-20T01:29:55.018478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:30:16.071161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021546+0000","last_change":"2024-08-20T01:29:04.412071+0000","last_active":"2024-08-20T01:29:55.021546+0000","last_peered":"2024-08-20T01:29:55.021546+0000","last_clean":"2024-08-20T01:29:55.021546+0000","last_became_active":"2024-08-20T01:29:04.411741+0000","last_became_peered":"2024-08-20T01:29:04.411741+0000","last_unstale":"2024-08-20T01:29:55.021546+0000","last_undegraded":"2024-08-20T01:29:55.021546+0000","last_fullsized":"2024-08-20T01:29:55.021546+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:33:47.753754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019405+0000","last_change":"2024-08-20T01:29:06.408996+0000","last_active":"2024-08-20T01:29:55.019405+0000","last_peered":"2024-08-20T01:29:55.019405+0000","last_clean":"2024-08-20T01:29:55.019405+0000","last_became_active":"2024-08-20T01:29:06.408685+0000","last_became_peered":"2024-08-20T01:29:06.408685+0000","last_unstale":"2024-08-20T01:29:55.019405+0000","last_undegraded":"2024-08-20T01:29:55.019405+0000","last_fullsized":"2024-08-20T01:29:55.019405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:18:28.974108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017430+0000","last_change":"2024-08-20T01:29:04.407852+0000","last_active":"2024-08-20T01:29:55.017430+0000","last_peered":"2024-08-20T01:29:55.017430+0000","last_clean":"2024-08-20T01:29:55.017430+0000","last_became_active":"2024-08-20T01:29:04.406828+0000","last_became_peered":"2024-08-20T01:29:04.406828+0000","last_unstale":"2024-08-20T01:29:55.017430+0000","last_undegraded":"2024-08-20T01:29:55.017430+0000","last_fullsized":"2024-08-20T01:29:55.017430+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:36:03.641146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376676+0000","last_change":"2024-08-20T01:29:06.418652+0000","last_active":"2024-08-20T01:29:55.376676+0000","last_peered":"2024-08-20T01:29:55.376676+0000","last_clean":"2024-08-20T01:29:55.376676+0000","last_became_active":"2024-08-20T01:29:06.418340+0000","last_became_peered":"2024-08-20T01:29:06.418340+0000","last_unstale":"2024-08-20T01:29:55.376676+0000","last_undegraded":"2024-08-20T01:29:55.376676+0000","last_fullsized":"2024-08-20T01:29:55.376676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:56:30.194426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'4","reported_seq":123,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:49.629604+0000","last_change":"2024-08-20T01:29:04.405950+0000","last_active":"2024-08-20T01:30:49.629604+0000","last_peered":"2024-08-20T01:30:49.629604+0000","last_clean":"2024-08-20T01:30:49.629604+0000","last_became_active":"2024-08-20T01:29:04.405650+0000","last_became_peered":"2024-08-20T01:29:04.405650+0000","last_unstale":"2024-08-20T01:30:49.629604+0000","last_undegraded":"2024-08-20T01:30:49.629604+0000","last_fullsized":"2024-08-20T01:30:49.629604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:12:01.752958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376068+0000","last_change":"2024-08-20T01:29:06.413967+0000","last_active":"2024-08-20T01:29:55.376068+0000","last_peered":"2024-08-20T01:29:55.376068+0000","last_clean":"2024-08-20T01:29:55.376068+0000","last_became_active":"2024-08-20T01:29:06.413628+0000","last_became_peered":"2024-08-20T01:29:06.413628+0000","last_unstale":"2024-08-20T01:29:55.376068+0000","last_undegraded":"2024-08-20T01:29:55.376068+0000","last_fullsized":"2024-08-20T01:29:55.376068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:09:16.394482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018723+0000","last_change":"2024-08-20T01:29:05.169872+0000","last_active":"2024-08-20T01:29:55.018723+0000","last_peered":"2024-08-20T01:29:55.018723+0000","last_clean":"2024-08-20T01:29:55.018723+0000","last_became_active":"2024-08-20T01:29:05.169186+0000","last_became_peered":"2024-08-20T01:29:05.169186+0000","last_unstale":"2024-08-20T01:29:55.018723+0000","last_undegraded":"2024-08-20T01:29:55.018723+0000","last_fullsized":"2024-08-20T01:29:55.018723+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:55:47.447959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.030862+0000","last_change":"2024-08-20T01:29:55.030761+0000","last_active":"2024-08-20T01:29:55.030862+0000","last_peered":"2024-08-20T01:29:55.030862+0000","last_clean":"2024-08-20T01:29:55.030862+0000","last_became_active":"2024-08-20T01:29:55.030308+0000","last_became_peered":"2024-08-20T01:29:55.030308+0000","last_unstale":"2024-08-20T01:29:55.030862+0000","last_undegraded":"2024-08-20T01:29:55.030862+0000","last_fullsized":"2024-08-20T01:29:55.030862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:27:57.082711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018547+0000","last_change":"2024-08-20T01:29:04.408188+0000","last_active":"2024-08-20T01:29:55.018547+0000","last_peered":"2024-08-20T01:29:55.018547+0000","last_clean":"2024-08-20T01:29:55.018547+0000","last_became_active":"2024-08-20T01:29:04.407794+0000","last_became_peered":"2024-08-20T01:29:04.407794+0000","last_unstale":"2024-08-20T01:29:55.018547+0000","last_undegraded":"2024-08-20T01:29:55.018547+0000","last_fullsized":"2024-08-20T01:29:55.018547+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:49:40.679218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024931+0000","last_change":"2024-08-20T01:29:55.024851+0000","last_active":"2024-08-20T01:29:55.024931+0000","last_peered":"2024-08-20T01:29:55.024931+0000","last_clean":"2024-08-20T01:29:55.024931+0000","last_became_active":"2024-08-20T01:29:55.024396+0000","last_became_peered":"2024-08-20T01:29:55.024396+0000","last_unstale":"2024-08-20T01:29:55.024931+0000","last_undegraded":"2024-08-20T01:29:55.024931+0000","last_fullsized":"2024-08-20T01:29:55.024931+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:44:03.846805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019416+0000","last_change":"2024-08-20T01:29:04.412178+0000","last_active":"2024-08-20T01:29:55.019416+0000","last_peered":"2024-08-20T01:29:55.019416+0000","last_clean":"2024-08-20T01:29:55.019416+0000","last_became_active":"2024-08-20T01:29:04.411819+0000","last_became_peered":"2024-08-20T01:29:04.411819+0000","last_unstale":"2024-08-20T01:29:55.019416+0000","last_undegraded":"2024-08-20T01:29:55.019416+0000","last_fullsized":"2024-08-20T01:29:55.019416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:03:11.524911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376922+0000","last_change":"2024-08-20T01:29:06.415697+0000","last_active":"2024-08-20T01:29:55.376922+0000","last_peered":"2024-08-20T01:29:55.376922+0000","last_clean":"2024-08-20T01:29:55.376922+0000","last_became_active":"2024-08-20T01:29:06.415180+0000","last_became_peered":"2024-08-20T01:29:06.415180+0000","last_unstale":"2024-08-20T01:29:55.376922+0000","last_undegraded":"2024-08-20T01:29:55.376922+0000","last_fullsized":"2024-08-20T01:29:55.376922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:55:50.810063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017390+0000","last_change":"2024-08-20T01:29:04.405961+0000","last_active":"2024-08-20T01:29:55.017390+0000","last_peered":"2024-08-20T01:29:55.017390+0000","last_clean":"2024-08-20T01:29:55.017390+0000","last_became_active":"2024-08-20T01:29:04.405633+0000","last_became_peered":"2024-08-20T01:29:04.405633+0000","last_unstale":"2024-08-20T01:29:55.017390+0000","last_undegraded":"2024-08-20T01:29:55.017390+0000","last_fullsized":"2024-08-20T01:29:55.017390+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:00:27.918313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376620+0000","last_change":"2024-08-20T01:29:06.417221+0000","last_active":"2024-08-20T01:29:55.376620+0000","last_peered":"2024-08-20T01:29:55.376620+0000","last_clean":"2024-08-20T01:29:55.376620+0000","last_became_active":"2024-08-20T01:29:06.416912+0000","last_became_peered":"2024-08-20T01:29:06.416912+0000","last_unstale":"2024-08-20T01:29:55.376620+0000","last_undegraded":"2024-08-20T01:29:55.376620+0000","last_fullsized":"2024-08-20T01:29:55.376620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:12:10.667134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.023090+0000","last_change":"2024-08-20T01:29:05.169494+0000","last_active":"2024-08-20T01:29:55.023090+0000","last_peered":"2024-08-20T01:29:55.023090+0000","last_clean":"2024-08-20T01:29:55.023090+0000","last_became_active":"2024-08-20T01:29:05.169059+0000","last_became_peered":"2024-08-20T01:29:05.169059+0000","last_unstale":"2024-08-20T01:29:55.023090+0000","last_undegraded":"2024-08-20T01:29:55.023090+0000","last_fullsized":"2024-08-20T01:29:55.023090+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:25:39.300668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376709+0000","last_change":"2024-08-20T01:29:06.424040+0000","last_active":"2024-08-20T01:29:55.376709+0000","last_peered":"2024-08-20T01:29:55.376709+0000","last_clean":"2024-08-20T01:29:55.376709+0000","last_became_active":"2024-08-20T01:29:06.421360+0000","last_became_peered":"2024-08-20T01:29:06.421360+0000","last_unstale":"2024-08-20T01:29:55.376709+0000","last_undegraded":"2024-08-20T01:29:55.376709+0000","last_fullsized":"2024-08-20T01:29:55.376709+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:24:50.497310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":99,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376310+0000","last_change":"2024-08-20T01:27:51.625696+0000","last_active":"2024-08-20T01:29:55.376310+0000","last_peered":"2024-08-20T01:29:55.376310+0000","last_clean":"2024-08-20T01:29:55.376310+0000","last_became_active":"2024-08-20T01:27:51.620833+0000","last_became_peered":"2024-08-20T01:27:51.620833+0000","last_unstale":"2024-08-20T01:29:55.376310+0000","last_undegraded":"2024-08-20T01:29:55.376310+0000","last_fullsized":"2024-08-20T01:29:55.376310+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:24:32.140649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:24:32.140649+0000","last_clean_scrub_stamp":"2024-08-20T01:24:32.140649+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:54:02.650548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019516+0000","last_change":"2024-08-20T01:29:04.405411+0000","last_active":"2024-08-20T01:29:55.019516+0000","last_peered":"2024-08-20T01:29:55.019516+0000","last_clean":"2024-08-20T01:29:55.019516+0000","last_became_active":"2024-08-20T01:29:04.404980+0000","last_became_peered":"2024-08-20T01:29:04.404980+0000","last_unstale":"2024-08-20T01:29:55.019516+0000","last_undegraded":"2024-08-20T01:29:55.019516+0000","last_fullsized":"2024-08-20T01:29:55.019516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:31:39.335857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.701767+0000","last_change":"2024-08-20T01:29:06.420368+0000","last_active":"2024-08-20T01:30:53.701767+0000","last_peered":"2024-08-20T01:30:53.701767+0000","last_clean":"2024-08-20T01:30:53.701767+0000","last_became_active":"2024-08-20T01:29:06.419653+0000","last_became_peered":"2024-08-20T01:29:06.419653+0000","last_unstale":"2024-08-20T01:30:53.701767+0000","last_undegraded":"2024-08-20T01:30:53.701767+0000","last_fullsized":"2024-08-20T01:30:53.701767+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:48.771774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376170+0000","last_change":"2024-08-20T01:29:04.410302+0000","last_active":"2024-08-20T01:29:55.376170+0000","last_peered":"2024-08-20T01:29:55.376170+0000","last_clean":"2024-08-20T01:29:55.376170+0000","last_became_active":"2024-08-20T01:29:04.409977+0000","last_became_peered":"2024-08-20T01:29:04.409977+0000","last_unstale":"2024-08-20T01:29:55.376170+0000","last_undegraded":"2024-08-20T01:29:55.376170+0000","last_fullsized":"2024-08-20T01:29:55.376170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:57:21.593739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019623+0000","last_change":"2024-08-20T01:29:06.419798+0000","last_active":"2024-08-20T01:29:55.019623+0000","last_peered":"2024-08-20T01:29:55.019623+0000","last_clean":"2024-08-20T01:29:55.019623+0000","last_became_active":"2024-08-20T01:29:06.419546+0000","last_became_peered":"2024-08-20T01:29:06.419546+0000","last_unstale":"2024-08-20T01:29:55.019623+0000","last_undegraded":"2024-08-20T01:29:55.019623+0000","last_fullsized":"2024-08-20T01:29:55.019623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:51:31.848883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'5","reported_seq":123,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:49.861551+0000","last_change":"2024-08-20T01:29:05.169237+0000","last_active":"2024-08-20T01:30:49.861551+0000","last_peered":"2024-08-20T01:30:49.861551+0000","last_clean":"2024-08-20T01:30:49.861551+0000","last_became_active":"2024-08-20T01:29:05.168778+0000","last_became_peered":"2024-08-20T01:29:05.168778+0000","last_unstale":"2024-08-20T01:30:49.861551+0000","last_undegraded":"2024-08-20T01:30:49.861551+0000","last_fullsized":"2024-08-20T01:30:49.861551+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:04:48.847412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024435+0000","last_change":"2024-08-20T01:29:55.024339+0000","last_active":"2024-08-20T01:29:55.024435+0000","last_peered":"2024-08-20T01:29:55.024435+0000","last_clean":"2024-08-20T01:29:55.024435+0000","last_became_active":"2024-08-20T01:29:55.023944+0000","last_became_peered":"2024-08-20T01:29:55.023944+0000","last_unstale":"2024-08-20T01:29:55.024435+0000","last_undegraded":"2024-08-20T01:29:55.024435+0000","last_fullsized":"2024-08-20T01:29:55.024435+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:14:00.589422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376838+0000","last_change":"2024-08-20T01:29:04.404472+0000","last_active":"2024-08-20T01:29:55.376838+0000","last_peered":"2024-08-20T01:29:55.376838+0000","last_clean":"2024-08-20T01:29:55.376838+0000","last_became_active":"2024-08-20T01:29:04.404010+0000","last_became_peered":"2024-08-20T01:29:04.404010+0000","last_unstale":"2024-08-20T01:29:55.376838+0000","last_undegraded":"2024-08-20T01:29:55.376838+0000","last_fullsized":"2024-08-20T01:29:55.376838+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:53:04.263362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024682+0000","last_change":"2024-08-20T01:29:06.421875+0000","last_active":"2024-08-20T01:29:55.024682+0000","last_peered":"2024-08-20T01:29:55.024682+0000","last_clean":"2024-08-20T01:29:55.024682+0000","last_became_active":"2024-08-20T01:29:06.421542+0000","last_became_peered":"2024-08-20T01:29:06.421542+0000","last_unstale":"2024-08-20T01:29:55.024682+0000","last_undegraded":"2024-08-20T01:29:55.024682+0000","last_fullsized":"2024-08-20T01:29:55.024682+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:10:46.320252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015905+0000","last_change":"2024-08-20T01:29:05.169985+0000","last_active":"2024-08-20T01:29:55.015905+0000","last_peered":"2024-08-20T01:29:55.015905+0000","last_clean":"2024-08-20T01:29:55.015905+0000","last_became_active":"2024-08-20T01:29:05.169607+0000","last_became_peered":"2024-08-20T01:29:05.169607+0000","last_unstale":"2024-08-20T01:29:55.015905+0000","last_undegraded":"2024-08-20T01:29:55.015905+0000","last_fullsized":"2024-08-20T01:29:55.015905+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:03:23.278369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024870+0000","last_change":"2024-08-20T01:29:06.414862+0000","last_active":"2024-08-20T01:29:55.024870+0000","last_peered":"2024-08-20T01:29:55.024870+0000","last_clean":"2024-08-20T01:29:55.024870+0000","last_became_active":"2024-08-20T01:29:06.414527+0000","last_became_peered":"2024-08-20T01:29:06.414527+0000","last_unstale":"2024-08-20T01:29:55.024870+0000","last_undegraded":"2024-08-20T01:29:55.024870+0000","last_fullsized":"2024-08-20T01:29:55.024870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:14:20.884073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018713+0000","last_change":"2024-08-20T01:29:05.169638+0000","last_active":"2024-08-20T01:29:55.018713+0000","last_peered":"2024-08-20T01:29:55.018713+0000","last_clean":"2024-08-20T01:29:55.018713+0000","last_became_active":"2024-08-20T01:29:05.169202+0000","last_became_peered":"2024-08-20T01:29:05.169202+0000","last_unstale":"2024-08-20T01:29:55.018713+0000","last_undegraded":"2024-08-20T01:29:55.018713+0000","last_fullsized":"2024-08-20T01:29:55.018713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:05:39.645782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019554+0000","last_change":"2024-08-20T01:29:06.413839+0000","last_active":"2024-08-20T01:29:55.019554+0000","last_peered":"2024-08-20T01:29:55.019554+0000","last_clean":"2024-08-20T01:29:55.019554+0000","last_became_active":"2024-08-20T01:29:06.413488+0000","last_became_peered":"2024-08-20T01:29:06.413488+0000","last_unstale":"2024-08-20T01:29:55.019554+0000","last_undegraded":"2024-08-20T01:29:55.019554+0000","last_fullsized":"2024-08-20T01:29:55.019554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:35:04.007192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'12","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.028397+0000","last_change":"2024-08-20T01:29:55.028344+0000","last_active":"2024-08-20T01:29:55.028397+0000","last_peered":"2024-08-20T01:29:55.028397+0000","last_clean":"2024-08-20T01:29:55.028397+0000","last_became_active":"2024-08-20T01:29:55.023700+0000","last_became_peered":"2024-08-20T01:29:55.023700+0000","last_unstale":"2024-08-20T01:29:55.028397+0000","last_undegraded":"2024-08-20T01:29:55.028397+0000","last_fullsized":"2024-08-20T01:29:55.028397+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:48:39.513322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.693961+0000","last_change":"2024-08-20T01:29:06.421024+0000","last_active":"2024-08-20T01:30:53.693961+0000","last_peered":"2024-08-20T01:30:53.693961+0000","last_clean":"2024-08-20T01:30:53.693961+0000","last_became_active":"2024-08-20T01:29:06.420631+0000","last_became_peered":"2024-08-20T01:29:06.420631+0000","last_unstale":"2024-08-20T01:30:53.693961+0000","last_undegraded":"2024-08-20T01:30:53.693961+0000","last_fullsized":"2024-08-20T01:30:53.693961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:07:57.992230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019783+0000","last_change":"2024-08-20T01:29:04.835075+0000","last_active":"2024-08-20T01:29:55.019783+0000","last_peered":"2024-08-20T01:29:55.019783+0000","last_clean":"2024-08-20T01:29:55.019783+0000","last_became_active":"2024-08-20T01:29:04.834759+0000","last_became_peered":"2024-08-20T01:29:04.834759+0000","last_unstale":"2024-08-20T01:29:55.019783+0000","last_undegraded":"2024-08-20T01:29:55.019783+0000","last_fullsized":"2024-08-20T01:29:55.019783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:45:29.040626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255550+0000","last_change":"2024-08-20T01:29:06.418187+0000","last_active":"2024-08-20T01:29:55.255550+0000","last_peered":"2024-08-20T01:29:55.255550+0000","last_clean":"2024-08-20T01:29:55.255550+0000","last_became_active":"2024-08-20T01:29:06.417851+0000","last_became_peered":"2024-08-20T01:29:06.417851+0000","last_unstale":"2024-08-20T01:29:55.255550+0000","last_undegraded":"2024-08-20T01:29:55.255550+0000","last_fullsized":"2024-08-20T01:29:55.255550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:15:48.204455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027380+0000","last_change":"2024-08-20T01:29:05.169736+0000","last_active":"2024-08-20T01:29:55.027380+0000","last_peered":"2024-08-20T01:29:55.027380+0000","last_clean":"2024-08-20T01:29:55.027380+0000","last_became_active":"2024-08-20T01:29:05.169403+0000","last_became_peered":"2024-08-20T01:29:05.169403+0000","last_unstale":"2024-08-20T01:29:55.027380+0000","last_undegraded":"2024-08-20T01:29:55.027380+0000","last_fullsized":"2024-08-20T01:29:55.027380+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:43:43.500841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017870+0000","last_change":"2024-08-20T01:29:06.416433+0000","last_active":"2024-08-20T01:29:55.017870+0000","last_peered":"2024-08-20T01:29:55.017870+0000","last_clean":"2024-08-20T01:29:55.017870+0000","last_became_active":"2024-08-20T01:29:06.414708+0000","last_became_peered":"2024-08-20T01:29:06.414708+0000","last_unstale":"2024-08-20T01:29:55.017870+0000","last_undegraded":"2024-08-20T01:29:55.017870+0000","last_fullsized":"2024-08-20T01:29:55.017870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:17:15.461536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018260+0000","last_change":"2024-08-20T01:29:04.403090+0000","last_active":"2024-08-20T01:29:55.018260+0000","last_peered":"2024-08-20T01:29:55.018260+0000","last_clean":"2024-08-20T01:29:55.018260+0000","last_became_active":"2024-08-20T01:29:04.402697+0000","last_became_peered":"2024-08-20T01:29:04.402697+0000","last_unstale":"2024-08-20T01:29:55.018260+0000","last_undegraded":"2024-08-20T01:29:55.018260+0000","last_fullsized":"2024-08-20T01:29:55.018260+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:36:04.055868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.020556+0000","last_change":"2024-08-20T01:29:06.413427+0000","last_active":"2024-08-20T01:29:55.020556+0000","last_peered":"2024-08-20T01:29:55.020556+0000","last_clean":"2024-08-20T01:29:55.020556+0000","last_became_active":"2024-08-20T01:29:06.413058+0000","last_became_peered":"2024-08-20T01:29:06.413058+0000","last_unstale":"2024-08-20T01:29:55.020556+0000","last_undegraded":"2024-08-20T01:29:55.020556+0000","last_fullsized":"2024-08-20T01:29:55.020556+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:38:38.546701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021609+0000","last_change":"2024-08-20T01:29:04.409859+0000","last_active":"2024-08-20T01:29:55.021609+0000","last_peered":"2024-08-20T01:29:55.021609+0000","last_clean":"2024-08-20T01:29:55.021609+0000","last_became_active":"2024-08-20T01:29:04.409497+0000","last_became_peered":"2024-08-20T01:29:04.409497+0000","last_unstale":"2024-08-20T01:29:55.021609+0000","last_undegraded":"2024-08-20T01:29:55.021609+0000","last_fullsized":"2024-08-20T01:29:55.021609+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:23:43.548912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.696726+0000","last_change":"2024-08-20T01:29:06.418428+0000","last_active":"2024-08-20T01:30:53.696726+0000","last_peered":"2024-08-20T01:30:53.696726+0000","last_clean":"2024-08-20T01:30:53.696726+0000","last_became_active":"2024-08-20T01:29:06.418033+0000","last_became_peered":"2024-08-20T01:29:06.418033+0000","last_unstale":"2024-08-20T01:30:53.696726+0000","last_undegraded":"2024-08-20T01:30:53.696726+0000","last_fullsized":"2024-08-20T01:30:53.696726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:23.503977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017941+0000","last_change":"2024-08-20T01:29:04.412549+0000","last_active":"2024-08-20T01:29:55.017941+0000","last_peered":"2024-08-20T01:29:55.017941+0000","last_clean":"2024-08-20T01:29:55.017941+0000","last_became_active":"2024-08-20T01:29:04.412071+0000","last_became_peered":"2024-08-20T01:29:04.412071+0000","last_unstale":"2024-08-20T01:29:55.017941+0000","last_undegraded":"2024-08-20T01:29:55.017941+0000","last_fullsized":"2024-08-20T01:29:55.017941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:48:51.195295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376669+0000","last_change":"2024-08-20T01:29:06.421431+0000","last_active":"2024-08-20T01:29:55.376669+0000","last_peered":"2024-08-20T01:29:55.376669+0000","last_clean":"2024-08-20T01:29:55.376669+0000","last_became_active":"2024-08-20T01:29:06.420916+0000","last_became_peered":"2024-08-20T01:29:06.420916+0000","last_unstale":"2024-08-20T01:29:55.376669+0000","last_undegraded":"2024-08-20T01:29:55.376669+0000","last_fullsized":"2024-08-20T01:29:55.376669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:45.674530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017140+0000","last_change":"2024-08-20T01:29:06.418209+0000","last_active":"2024-08-20T01:29:55.017140+0000","last_peered":"2024-08-20T01:29:55.017140+0000","last_clean":"2024-08-20T01:29:55.017140+0000","last_became_active":"2024-08-20T01:29:06.417812+0000","last_became_peered":"2024-08-20T01:29:06.417812+0000","last_unstale":"2024-08-20T01:29:55.017140+0000","last_undegraded":"2024-08-20T01:29:55.017140+0000","last_fullsized":"2024-08-20T01:29:55.017140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:05:43.794281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018906+0000","last_change":"2024-08-20T01:29:04.408472+0000","last_active":"2024-08-20T01:29:55.018906+0000","last_peered":"2024-08-20T01:29:55.018906+0000","last_clean":"2024-08-20T01:29:55.018906+0000","last_became_active":"2024-08-20T01:29:04.408082+0000","last_became_peered":"2024-08-20T01:29:04.408082+0000","last_unstale":"2024-08-20T01:29:55.018906+0000","last_undegraded":"2024-08-20T01:29:55.018906+0000","last_fullsized":"2024-08-20T01:29:55.018906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:14:44.659672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027748+0000","last_change":"2024-08-20T01:29:06.423562+0000","last_active":"2024-08-20T01:29:55.027748+0000","last_peered":"2024-08-20T01:29:55.027748+0000","last_clean":"2024-08-20T01:29:55.027748+0000","last_became_active":"2024-08-20T01:29:06.423241+0000","last_became_peered":"2024-08-20T01:29:06.423241+0000","last_unstale":"2024-08-20T01:29:55.027748+0000","last_undegraded":"2024-08-20T01:29:55.027748+0000","last_fullsized":"2024-08-20T01:29:55.027748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:59:46.049449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018583+0000","last_change":"2024-08-20T01:29:04.412287+0000","last_active":"2024-08-20T01:29:55.018583+0000","last_peered":"2024-08-20T01:29:55.018583+0000","last_clean":"2024-08-20T01:29:55.018583+0000","last_became_active":"2024-08-20T01:29:04.411912+0000","last_became_peered":"2024-08-20T01:29:04.411912+0000","last_unstale":"2024-08-20T01:29:55.018583+0000","last_undegraded":"2024-08-20T01:29:55.018583+0000","last_fullsized":"2024-08-20T01:29:55.018583+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:19:25.816795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255713+0000","last_change":"2024-08-20T01:29:06.416899+0000","last_active":"2024-08-20T01:29:55.255713+0000","last_peered":"2024-08-20T01:29:55.255713+0000","last_clean":"2024-08-20T01:29:55.255713+0000","last_became_active":"2024-08-20T01:29:06.416594+0000","last_became_peered":"2024-08-20T01:29:06.416594+0000","last_unstale":"2024-08-20T01:29:55.255713+0000","last_undegraded":"2024-08-20T01:29:55.255713+0000","last_fullsized":"2024-08-20T01:29:55.255713+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:43.896728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018949+0000","last_change":"2024-08-20T01:29:05.169571+0000","last_active":"2024-08-20T01:29:55.018949+0000","last_peered":"2024-08-20T01:29:55.018949+0000","last_clean":"2024-08-20T01:29:55.018949+0000","last_became_active":"2024-08-20T01:29:05.169250+0000","last_became_peered":"2024-08-20T01:29:05.169250+0000","last_unstale":"2024-08-20T01:29:55.018949+0000","last_undegraded":"2024-08-20T01:29:55.018949+0000","last_fullsized":"2024-08-20T01:29:55.018949+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:32:04.555825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.698335+0000","last_change":"2024-08-20T01:29:06.415582+0000","last_active":"2024-08-20T01:30:53.698335+0000","last_peered":"2024-08-20T01:30:53.698335+0000","last_clean":"2024-08-20T01:30:53.698335+0000","last_became_active":"2024-08-20T01:29:06.415284+0000","last_became_peered":"2024-08-20T01:29:06.415284+0000","last_unstale":"2024-08-20T01:30:53.698335+0000","last_undegraded":"2024-08-20T01:30:53.698335+0000","last_fullsized":"2024-08-20T01:30:53.698335+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:43:10.311792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015914+0000","last_change":"2024-08-20T01:29:04.409389+0000","last_active":"2024-08-20T01:29:55.015914+0000","last_peered":"2024-08-20T01:29:55.015914+0000","last_clean":"2024-08-20T01:29:55.015914+0000","last_became_active":"2024-08-20T01:29:04.409099+0000","last_became_peered":"2024-08-20T01:29:04.409099+0000","last_unstale":"2024-08-20T01:29:55.015914+0000","last_undegraded":"2024-08-20T01:29:55.015914+0000","last_fullsized":"2024-08-20T01:29:55.015914+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:19:30.156443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63,"ondisk_log_size":63,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64379,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":591,"num_read_kb":364,"num_write":168,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":59762,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":197451,"data_compressed":9608,"data_compressed_allocated":12288,"data_compressed_original":57344,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285456,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743459,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":831488,"data_stored":406512,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939688,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1058371,"data_compressed":42066,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103212,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":406748,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":847872,"data_stored":406668,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495670,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":998906,"data_compressed":42066,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659196,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":406137,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855425,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":909312,"data_stored":998282,"data_compressed":42066,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":864256,"data_stored":466336,"data_compressed":15386,"data_compressed_allocated":20480,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215179,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":851968,"data_stored":406448,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,4,6,17,18],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":851968,"data_stored":407671,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":466000,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":856064,"data_stored":407408,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":61022,"data_compressed":9608,"data_compressed_allocated":12288,"data_compressed_original":57344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T01:30:55.282 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-08-20T01:30:55.283 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-20T01:30:55.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.421+0000 7f18847e1640 1 -- 172.21.15.22:0/3305783874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f187c1026e0 msgr2=0x7f187c102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:55.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.421+0000 7f18847e1640 1 --2- 172.21.15.22:0/3305783874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f187c1026e0 0x7f187c102b60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1870009930 tx=0x7f187002a420 comp rx=0 tx=0).stop 2024-08-20T01:30:55.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.422+0000 7f18847e1640 1 -- 172.21.15.22:0/3305783874 shutdown_connections 2024-08-20T01:30:55.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.422+0000 7f18847e1640 1 --2- 172.21.15.22:0/3305783874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f187c1030a0 0x7f187c109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.422+0000 7f18847e1640 1 --2- 172.21.15.22:0/3305783874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f187c1026e0 0x7f187c102b60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.422+0000 7f18847e1640 1 --2- 172.21.15.22:0/3305783874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187c101590 0x7f187c101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.422+0000 7f18847e1640 1 -- 172.21.15.22:0/3305783874 >> 172.21.15.22:0/3305783874 conn(0x7f187c0fce70 msgr2=0x7f187c0ff290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:55.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.422+0000 7f18847e1640 1 -- 172.21.15.22:0/3305783874 shutdown_connections 2024-08-20T01:30:55.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.422+0000 7f18847e1640 1 -- 172.21.15.22:0/3305783874 wait complete. 2024-08-20T01:30:55.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.422+0000 7f18847e1640 1 Processor -- start 2024-08-20T01:30:55.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.422+0000 7f18847e1640 1 -- start start 2024-08-20T01:30:55.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.422+0000 7f18847e1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f187c101590 0x7f187c197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:55.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.422+0000 7f18847e1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187c1026e0 0x7f187c197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:55.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.422+0000 7f18847e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f187c1030a0 0x7f187c198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:55.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.422+0000 7f18847e1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f187c10d1e0 con 0x7f187c101590 2024-08-20T01:30:55.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.422+0000 7f18847e1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f187c10d060 con 0x7f187c1030a0 2024-08-20T01:30:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.422+0000 7f18847e1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f187c10d360 con 0x7f187c1026e0 2024-08-20T01:30:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.422+0000 7f188257d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f187c101590 0x7f187c197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.423+0000 7f188257d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f187c101590 0x7f187c197960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43250/0 (socket says 172.21.15.22:43250) 2024-08-20T01:30:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.423+0000 7f188257d640 1 -- 172.21.15.22:0/4196395994 learned_addr learned my addr 172.21.15.22:0/4196395994 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.423+0000 7f1882d7e640 1 --2- 172.21.15.22:0/4196395994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f187c1030a0 0x7f187c198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.423+0000 7f1881d7c640 1 --2- 172.21.15.22:0/4196395994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187c1026e0 0x7f187c197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.423+0000 7f188257d640 1 -- 172.21.15.22:0/4196395994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187c1026e0 msgr2=0x7f187c197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.423+0000 7f188257d640 1 --2- 172.21.15.22:0/4196395994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187c1026e0 0x7f187c197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.423+0000 7f188257d640 1 -- 172.21.15.22:0/4196395994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f187c1030a0 msgr2=0x7f187c198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.423+0000 7f188257d640 1 --2- 172.21.15.22:0/4196395994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f187c1030a0 0x7f187c198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.423+0000 7f188257d640 1 -- 172.21.15.22:0/4196395994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f187c1994a0 con 0x7f187c101590 2024-08-20T01:30:55.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.423+0000 7f1882d7e640 1 --2- 172.21.15.22:0/4196395994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f187c1030a0 0x7f187c198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:55.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.423+0000 7f188257d640 1 --2- 172.21.15.22:0/4196395994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f187c101590 0x7f187c197960 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1874009970 tx=0x7f1874009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:55.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.423+0000 7f187b7fe640 1 -- 172.21.15.22:0/4196395994 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187400d020 con 0x7f187c101590 2024-08-20T01:30:55.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.423+0000 7f187b7fe640 1 -- 172.21.15.22:0/4196395994 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f187400d1c0 con 0x7f187c101590 2024-08-20T01:30:55.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.423+0000 7f18847e1640 1 -- 172.21.15.22:0/4196395994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f187c199790 con 0x7f187c101590 2024-08-20T01:30:55.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.423+0000 7f187b7fe640 1 -- 172.21.15.22:0/4196395994 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187400cc50 con 0x7f187c101590 2024-08-20T01:30:55.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.423+0000 7f18847e1640 1 -- 172.21.15.22:0/4196395994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f187c06a260 con 0x7f187c101590 2024-08-20T01:30:55.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.424+0000 7f18847e1640 1 -- 172.21.15.22:0/4196395994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f187c101990 con 0x7f187c101590 2024-08-20T01:30:55.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.426+0000 7f187b7fe640 1 -- 172.21.15.22:0/4196395994 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f1874007860 con 0x7f187c101590 2024-08-20T01:30:55.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.426+0000 7f187b7fe640 1 --2- 172.21.15.22:0/4196395994 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18640b3c60 0x7f18640b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:55.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.426+0000 7f1881d7c640 1 --2- 172.21.15.22:0/4196395994 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18640b3c60 0x7f18640b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:55.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.426+0000 7f187b7fe640 1 -- 172.21.15.22:0/4196395994 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8298+0+0 (secure 0 0 0) 0x7f18740e5730 con 0x7f187c101590 2024-08-20T01:30:55.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.427+0000 7f1881d7c640 1 --2- 172.21.15.22:0/4196395994 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18640b3c60 0x7f18640b6120 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1870000c00 tx=0x7f18700314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:55.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.429+0000 7f187b7fe640 1 -- 172.21.15.22:0/4196395994 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f18740acbe0 con 0x7f187c101590 2024-08-20T01:30:55.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.525+0000 7f187b7fe640 1 -- 172.21.15.22:0/4196395994 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f18740e32f0 con 0x7f187c101590 2024-08-20T01:30:55.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.618+0000 7f18847e1640 1 -- 172.21.15.22:0/4196395994 --> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f187c108560 con 0x7f18640b3c60 2024-08-20T01:30:55.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.622+0000 7f187b7fe640 1 -- 172.21.15.22:0/4196395994 <== mgr.14150 v2:172.21.15.22:6800/2987254321 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259098 (secure 0 0 0) 0x7f187c108560 con 0x7f18640b3c60 2024-08-20T01:30:55.625 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:55.627 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-08-20T01:30:55.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.625+0000 7f18847e1640 1 -- 172.21.15.22:0/4196395994 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18640b3c60 msgr2=0x7f18640b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:55.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.625+0000 7f18847e1640 1 --2- 172.21.15.22:0/4196395994 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18640b3c60 0x7f18640b6120 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1870000c00 tx=0x7f18700314a0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.625+0000 7f18847e1640 1 -- 172.21.15.22:0/4196395994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f187c101590 msgr2=0x7f187c197960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:55.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.625+0000 7f18847e1640 1 --2- 172.21.15.22:0/4196395994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f187c101590 0x7f187c197960 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1874009970 tx=0x7f1874009e30 comp rx=0 tx=0).stop 2024-08-20T01:30:55.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.625+0000 7f18847e1640 1 -- 172.21.15.22:0/4196395994 shutdown_connections 2024-08-20T01:30:55.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.625+0000 7f18847e1640 1 --2- 172.21.15.22:0/4196395994 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18640b3c60 0x7f18640b6120 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.625+0000 7f18847e1640 1 --2- 172.21.15.22:0/4196395994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f187c1030a0 0x7f187c198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.625+0000 7f18847e1640 1 --2- 172.21.15.22:0/4196395994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f187c1026e0 0x7f187c197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.625+0000 7f18847e1640 1 --2- 172.21.15.22:0/4196395994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f187c101590 0x7f187c197960 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:55.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.625+0000 7f18847e1640 1 -- 172.21.15.22:0/4196395994 >> 172.21.15.22:0/4196395994 conn(0x7f187c0fce70 msgr2=0x7f187c105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:55.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.626+0000 7f18847e1640 1 -- 172.21.15.22:0/4196395994 shutdown_connections 2024-08-20T01:30:55.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:55.626+0000 7f18847e1640 1 -- 172.21.15.22:0/4196395994 wait complete. 2024-08-20T01:30:55.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:55 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-08-20T01:30:55.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:55 smithi022 ceph-mon[18709]: osdmap e78: 12 total, 12 up, 12 in 2024-08-20T01:30:55.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:55 smithi022 ceph-mon[18709]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:30:55.637 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-08-20T01:30:55.322318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655122,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":679,"num_read_kb":430,"num_write":294,"num_write_kb":2266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":3011602,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":357,"ondisk_log_size":357,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363700,"kb_used_data":10232,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124578124,"statfs":{"total":1151940427776,"available":1151567998976,"internally_reserved":0,"allocated":10477568,"data_stored":6840807,"data_compressed":187808,"data_compressed_allocated":245760,"data_compressed_original":2023424,"omap_allocated":19139,"internal_metadata":361674045},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,4,6,17,18],"upper_bound":64},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":757,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":33,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002357"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019956+0000","last_change":"2024-08-20T01:29:06.421092+0000","last_active":"2024-08-20T01:29:55.019956+0000","last_peered":"2024-08-20T01:29:55.019956+0000","last_clean":"2024-08-20T01:29:55.019956+0000","last_became_active":"2024-08-20T01:29:06.420484+0000","last_became_peered":"2024-08-20T01:29:06.420484+0000","last_unstale":"2024-08-20T01:29:55.019956+0000","last_undegraded":"2024-08-20T01:29:55.019956+0000","last_fullsized":"2024-08-20T01:29:55.019956+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:55:54.177863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255444+0000","last_change":"2024-08-20T01:29:06.414784+0000","last_active":"2024-08-20T01:29:55.255444+0000","last_peered":"2024-08-20T01:29:55.255444+0000","last_clean":"2024-08-20T01:29:55.255444+0000","last_became_active":"2024-08-20T01:29:06.414426+0000","last_became_peered":"2024-08-20T01:29:06.414426+0000","last_unstale":"2024-08-20T01:29:55.255444+0000","last_undegraded":"2024-08-20T01:29:55.255444+0000","last_fullsized":"2024-08-20T01:29:55.255444+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:13:45.634888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255426+0000","last_change":"2024-08-20T01:29:06.416876+0000","last_active":"2024-08-20T01:29:55.255426+0000","last_peered":"2024-08-20T01:29:55.255426+0000","last_clean":"2024-08-20T01:29:55.255426+0000","last_became_active":"2024-08-20T01:29:06.416548+0000","last_became_peered":"2024-08-20T01:29:06.416548+0000","last_unstale":"2024-08-20T01:29:55.255426+0000","last_undegraded":"2024-08-20T01:29:55.255426+0000","last_fullsized":"2024-08-20T01:29:55.255426+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:16:23.092129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"77'8","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-20T01:30:54.506895+0000","last_change":"2024-08-20T01:29:06.415474+0000","last_active":"2024-08-20T01:30:54.506895+0000","last_peered":"2024-08-20T01:30:54.506895+0000","last_clean":"2024-08-20T01:30:54.506895+0000","last_became_active":"2024-08-20T01:29:06.415120+0000","last_became_peered":"2024-08-20T01:29:06.415120+0000","last_unstale":"2024-08-20T01:30:54.506895+0000","last_undegraded":"2024-08-20T01:30:54.506895+0000","last_fullsized":"2024-08-20T01:30:54.506895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:47.059173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.022520+0000","last_change":"2024-08-20T01:29:55.022459+0000","last_active":"2024-08-20T01:29:55.022520+0000","last_peered":"2024-08-20T01:29:55.022520+0000","last_clean":"2024-08-20T01:29:55.022520+0000","last_became_active":"2024-08-20T01:29:55.022110+0000","last_became_peered":"2024-08-20T01:29:55.022110+0000","last_unstale":"2024-08-20T01:29:55.022520+0000","last_undegraded":"2024-08-20T01:29:55.022520+0000","last_fullsized":"2024-08-20T01:29:55.022520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:56:44.318445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024716+0000","last_change":"2024-08-20T01:29:06.420995+0000","last_active":"2024-08-20T01:29:55.024716+0000","last_peered":"2024-08-20T01:29:55.024716+0000","last_clean":"2024-08-20T01:29:55.024716+0000","last_became_active":"2024-08-20T01:29:06.420703+0000","last_became_peered":"2024-08-20T01:29:06.420703+0000","last_unstale":"2024-08-20T01:29:55.024716+0000","last_undegraded":"2024-08-20T01:29:55.024716+0000","last_fullsized":"2024-08-20T01:29:55.024716+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:21:08.502158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376076+0000","last_change":"2024-08-20T01:29:06.411605+0000","last_active":"2024-08-20T01:29:55.376076+0000","last_peered":"2024-08-20T01:29:55.376076+0000","last_clean":"2024-08-20T01:29:55.376076+0000","last_became_active":"2024-08-20T01:29:06.411258+0000","last_became_peered":"2024-08-20T01:29:06.411258+0000","last_unstale":"2024-08-20T01:29:55.376076+0000","last_undegraded":"2024-08-20T01:29:55.376076+0000","last_fullsized":"2024-08-20T01:29:55.376076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:17:02.390707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.699603+0000","last_change":"2024-08-20T01:29:06.418514+0000","last_active":"2024-08-20T01:30:53.699603+0000","last_peered":"2024-08-20T01:30:53.699603+0000","last_clean":"2024-08-20T01:30:53.699603+0000","last_became_active":"2024-08-20T01:29:06.417450+0000","last_became_peered":"2024-08-20T01:29:06.417450+0000","last_unstale":"2024-08-20T01:30:53.699603+0000","last_undegraded":"2024-08-20T01:30:53.699603+0000","last_fullsized":"2024-08-20T01:30:53.699603+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:13:15.485333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.028241+0000","last_change":"2024-08-20T01:29:06.425458+0000","last_active":"2024-08-20T01:29:55.028241+0000","last_peered":"2024-08-20T01:29:55.028241+0000","last_clean":"2024-08-20T01:29:55.028241+0000","last_became_active":"2024-08-20T01:29:06.425122+0000","last_became_peered":"2024-08-20T01:29:06.425122+0000","last_unstale":"2024-08-20T01:29:55.028241+0000","last_undegraded":"2024-08-20T01:29:55.028241+0000","last_fullsized":"2024-08-20T01:29:55.028241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:52:59.857195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.025175+0000","last_change":"2024-08-20T01:29:06.420258+0000","last_active":"2024-08-20T01:29:55.025175+0000","last_peered":"2024-08-20T01:29:55.025175+0000","last_clean":"2024-08-20T01:29:55.025175+0000","last_became_active":"2024-08-20T01:29:06.419982+0000","last_became_peered":"2024-08-20T01:29:06.419982+0000","last_unstale":"2024-08-20T01:29:55.025175+0000","last_undegraded":"2024-08-20T01:29:55.025175+0000","last_fullsized":"2024-08-20T01:29:55.025175+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:56:23.296739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376666+0000","last_change":"2024-08-20T01:29:06.421580+0000","last_active":"2024-08-20T01:29:55.376666+0000","last_peered":"2024-08-20T01:29:55.376666+0000","last_clean":"2024-08-20T01:29:55.376666+0000","last_became_active":"2024-08-20T01:29:06.421115+0000","last_became_peered":"2024-08-20T01:29:06.421115+0000","last_unstale":"2024-08-20T01:29:55.376666+0000","last_undegraded":"2024-08-20T01:29:55.376666+0000","last_fullsized":"2024-08-20T01:29:55.376666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:43:13.839230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"77'7","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-20T01:30:54.506901+0000","last_change":"2024-08-20T01:29:06.416950+0000","last_active":"2024-08-20T01:30:54.506901+0000","last_peered":"2024-08-20T01:30:54.506901+0000","last_clean":"2024-08-20T01:30:54.506901+0000","last_became_active":"2024-08-20T01:29:06.415585+0000","last_became_peered":"2024-08-20T01:29:06.415585+0000","last_unstale":"2024-08-20T01:30:54.506901+0000","last_undegraded":"2024-08-20T01:30:54.506901+0000","last_fullsized":"2024-08-20T01:30:54.506901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:47:54.132535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027677+0000","last_change":"2024-08-20T01:29:55.027622+0000","last_active":"2024-08-20T01:29:55.027677+0000","last_peered":"2024-08-20T01:29:55.027677+0000","last_clean":"2024-08-20T01:29:55.027677+0000","last_became_active":"2024-08-20T01:29:55.027246+0000","last_became_peered":"2024-08-20T01:29:55.027246+0000","last_unstale":"2024-08-20T01:29:55.027677+0000","last_undegraded":"2024-08-20T01:29:55.027677+0000","last_fullsized":"2024-08-20T01:29:55.027677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:30:25.209975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255506+0000","last_change":"2024-08-20T01:29:06.415494+0000","last_active":"2024-08-20T01:29:55.255506+0000","last_peered":"2024-08-20T01:29:55.255506+0000","last_clean":"2024-08-20T01:29:55.255506+0000","last_became_active":"2024-08-20T01:29:06.415099+0000","last_became_peered":"2024-08-20T01:29:06.415099+0000","last_unstale":"2024-08-20T01:29:55.255506+0000","last_undegraded":"2024-08-20T01:29:55.255506+0000","last_fullsized":"2024-08-20T01:29:55.255506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:07:01.946143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'3","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255243+0000","last_change":"2024-08-20T01:29:06.418233+0000","last_active":"2024-08-20T01:29:55.255243+0000","last_peered":"2024-08-20T01:29:55.255243+0000","last_clean":"2024-08-20T01:29:55.255243+0000","last_became_active":"2024-08-20T01:29:06.417929+0000","last_became_peered":"2024-08-20T01:29:06.417929+0000","last_unstale":"2024-08-20T01:29:55.255243+0000","last_undegraded":"2024-08-20T01:29:55.255243+0000","last_fullsized":"2024-08-20T01:29:55.255243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:44:08.548821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027280+0000","last_change":"2024-08-20T01:29:06.418819+0000","last_active":"2024-08-20T01:29:55.027280+0000","last_peered":"2024-08-20T01:29:55.027280+0000","last_clean":"2024-08-20T01:29:55.027280+0000","last_became_active":"2024-08-20T01:29:06.418378+0000","last_became_peered":"2024-08-20T01:29:06.418378+0000","last_unstale":"2024-08-20T01:29:55.027280+0000","last_undegraded":"2024-08-20T01:29:55.027280+0000","last_fullsized":"2024-08-20T01:29:55.027280+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:01.419539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.020071+0000","last_change":"2024-08-20T01:29:06.420804+0000","last_active":"2024-08-20T01:29:55.020071+0000","last_peered":"2024-08-20T01:29:55.020071+0000","last_clean":"2024-08-20T01:29:55.020071+0000","last_became_active":"2024-08-20T01:29:06.420027+0000","last_became_peered":"2024-08-20T01:29:06.420027+0000","last_unstale":"2024-08-20T01:29:55.020071+0000","last_undegraded":"2024-08-20T01:29:55.020071+0000","last_fullsized":"2024-08-20T01:29:55.020071+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:00:37.104792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015970+0000","last_change":"2024-08-20T01:29:06.411625+0000","last_active":"2024-08-20T01:29:55.015970+0000","last_peered":"2024-08-20T01:29:55.015970+0000","last_clean":"2024-08-20T01:29:55.015970+0000","last_became_active":"2024-08-20T01:29:06.411284+0000","last_became_peered":"2024-08-20T01:29:06.411284+0000","last_unstale":"2024-08-20T01:29:55.015970+0000","last_undegraded":"2024-08-20T01:29:55.015970+0000","last_fullsized":"2024-08-20T01:29:55.015970+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:12:08.510755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021766+0000","last_change":"2024-08-20T01:29:06.421276+0000","last_active":"2024-08-20T01:29:55.021766+0000","last_peered":"2024-08-20T01:29:55.021766+0000","last_clean":"2024-08-20T01:29:55.021766+0000","last_became_active":"2024-08-20T01:29:06.420916+0000","last_became_peered":"2024-08-20T01:29:06.420916+0000","last_unstale":"2024-08-20T01:29:55.021766+0000","last_undegraded":"2024-08-20T01:29:55.021766+0000","last_fullsized":"2024-08-20T01:29:55.021766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:04:59.399172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.020688+0000","last_change":"2024-08-20T01:29:06.420848+0000","last_active":"2024-08-20T01:29:55.020688+0000","last_peered":"2024-08-20T01:29:55.020688+0000","last_clean":"2024-08-20T01:29:55.020688+0000","last_became_active":"2024-08-20T01:29:06.420465+0000","last_became_peered":"2024-08-20T01:29:06.420465+0000","last_unstale":"2024-08-20T01:29:55.020688+0000","last_undegraded":"2024-08-20T01:29:55.020688+0000","last_fullsized":"2024-08-20T01:29:55.020688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:42:33.210813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019585+0000","last_change":"2024-08-20T01:29:06.407353+0000","last_active":"2024-08-20T01:29:55.019585+0000","last_peered":"2024-08-20T01:29:55.019585+0000","last_clean":"2024-08-20T01:29:55.019585+0000","last_became_active":"2024-08-20T01:29:06.406944+0000","last_became_peered":"2024-08-20T01:29:06.406944+0000","last_unstale":"2024-08-20T01:29:55.019585+0000","last_undegraded":"2024-08-20T01:29:55.019585+0000","last_fullsized":"2024-08-20T01:29:55.019585+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:49:22.324317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027678+0000","last_change":"2024-08-20T01:29:06.419757+0000","last_active":"2024-08-20T01:29:55.027678+0000","last_peered":"2024-08-20T01:29:55.027678+0000","last_clean":"2024-08-20T01:29:55.027678+0000","last_became_active":"2024-08-20T01:29:06.419433+0000","last_became_peered":"2024-08-20T01:29:06.419433+0000","last_unstale":"2024-08-20T01:29:55.027678+0000","last_undegraded":"2024-08-20T01:29:55.027678+0000","last_fullsized":"2024-08-20T01:29:55.027678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:22:36.968949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.695425+0000","last_change":"2024-08-20T01:29:06.418110+0000","last_active":"2024-08-20T01:30:53.695425+0000","last_peered":"2024-08-20T01:30:53.695425+0000","last_clean":"2024-08-20T01:30:53.695425+0000","last_became_active":"2024-08-20T01:29:06.417776+0000","last_became_peered":"2024-08-20T01:29:06.417776+0000","last_unstale":"2024-08-20T01:30:53.695425+0000","last_undegraded":"2024-08-20T01:30:53.695425+0000","last_fullsized":"2024-08-20T01:30:53.695425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:55:55.105453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"77'6","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-20T01:30:54.628398+0000","last_change":"2024-08-20T01:29:06.414240+0000","last_active":"2024-08-20T01:30:54.628398+0000","last_peered":"2024-08-20T01:30:54.628398+0000","last_clean":"2024-08-20T01:30:54.628398+0000","last_became_active":"2024-08-20T01:29:06.413884+0000","last_became_peered":"2024-08-20T01:29:06.413884+0000","last_unstale":"2024-08-20T01:30:54.628398+0000","last_undegraded":"2024-08-20T01:30:54.628398+0000","last_fullsized":"2024-08-20T01:30:54.628398+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:00.042588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.694275+0000","last_change":"2024-08-20T01:29:06.419344+0000","last_active":"2024-08-20T01:30:53.694275+0000","last_peered":"2024-08-20T01:30:53.694275+0000","last_clean":"2024-08-20T01:30:53.694275+0000","last_became_active":"2024-08-20T01:29:06.418689+0000","last_became_peered":"2024-08-20T01:29:06.418689+0000","last_unstale":"2024-08-20T01:30:53.694275+0000","last_undegraded":"2024-08-20T01:30:53.694275+0000","last_fullsized":"2024-08-20T01:30:53.694275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:34:23.604213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.022077+0000","last_change":"2024-08-20T01:29:06.415161+0000","last_active":"2024-08-20T01:29:55.022077+0000","last_peered":"2024-08-20T01:29:55.022077+0000","last_clean":"2024-08-20T01:29:55.022077+0000","last_became_active":"2024-08-20T01:29:06.414812+0000","last_became_peered":"2024-08-20T01:29:06.414812+0000","last_unstale":"2024-08-20T01:29:55.022077+0000","last_undegraded":"2024-08-20T01:29:55.022077+0000","last_fullsized":"2024-08-20T01:29:55.022077+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:10:49.527635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021022+0000","last_change":"2024-08-20T01:29:06.416502+0000","last_active":"2024-08-20T01:29:55.021022+0000","last_peered":"2024-08-20T01:29:55.021022+0000","last_clean":"2024-08-20T01:29:55.021022+0000","last_became_active":"2024-08-20T01:29:06.416139+0000","last_became_peered":"2024-08-20T01:29:06.416139+0000","last_unstale":"2024-08-20T01:29:55.021022+0000","last_undegraded":"2024-08-20T01:29:55.021022+0000","last_fullsized":"2024-08-20T01:29:55.021022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:19:32.379867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019525+0000","last_change":"2024-08-20T01:29:06.412494+0000","last_active":"2024-08-20T01:29:55.019525+0000","last_peered":"2024-08-20T01:29:55.019525+0000","last_clean":"2024-08-20T01:29:55.019525+0000","last_became_active":"2024-08-20T01:29:06.412158+0000","last_became_peered":"2024-08-20T01:29:06.412158+0000","last_unstale":"2024-08-20T01:29:55.019525+0000","last_undegraded":"2024-08-20T01:29:55.019525+0000","last_fullsized":"2024-08-20T01:29:55.019525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:57:52.088445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'4","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255526+0000","last_change":"2024-08-20T01:29:06.412869+0000","last_active":"2024-08-20T01:29:55.255526+0000","last_peered":"2024-08-20T01:29:55.255526+0000","last_clean":"2024-08-20T01:29:55.255526+0000","last_became_active":"2024-08-20T01:29:06.412540+0000","last_became_peered":"2024-08-20T01:29:06.412540+0000","last_unstale":"2024-08-20T01:29:55.255526+0000","last_undegraded":"2024-08-20T01:29:55.255526+0000","last_fullsized":"2024-08-20T01:29:55.255526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:11:10.011252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.256428+0000","last_change":"2024-08-20T01:29:55.256345+0000","last_active":"2024-08-20T01:29:55.256428+0000","last_peered":"2024-08-20T01:29:55.256428+0000","last_clean":"2024-08-20T01:29:55.256428+0000","last_became_active":"2024-08-20T01:29:55.256001+0000","last_became_peered":"2024-08-20T01:29:55.256001+0000","last_unstale":"2024-08-20T01:29:55.256428+0000","last_undegraded":"2024-08-20T01:29:55.256428+0000","last_fullsized":"2024-08-20T01:29:55.256428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:02:02.453668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.022020+0000","last_change":"2024-08-20T01:29:06.423874+0000","last_active":"2024-08-20T01:29:55.022020+0000","last_peered":"2024-08-20T01:29:55.022020+0000","last_clean":"2024-08-20T01:29:55.022020+0000","last_became_active":"2024-08-20T01:29:06.423561+0000","last_became_peered":"2024-08-20T01:29:06.423561+0000","last_unstale":"2024-08-20T01:29:55.022020+0000","last_undegraded":"2024-08-20T01:29:55.022020+0000","last_fullsized":"2024-08-20T01:29:55.022020+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:13:53.654099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019575+0000","last_change":"2024-08-20T01:29:06.414212+0000","last_active":"2024-08-20T01:29:55.019575+0000","last_peered":"2024-08-20T01:29:55.019575+0000","last_clean":"2024-08-20T01:29:55.019575+0000","last_became_active":"2024-08-20T01:29:06.413848+0000","last_became_peered":"2024-08-20T01:29:06.413848+0000","last_unstale":"2024-08-20T01:29:55.019575+0000","last_undegraded":"2024-08-20T01:29:55.019575+0000","last_fullsized":"2024-08-20T01:29:55.019575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:00:29.005461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.377988+0000","last_change":"2024-08-20T01:29:55.377940+0000","last_active":"2024-08-20T01:29:55.377988+0000","last_peered":"2024-08-20T01:29:55.377988+0000","last_clean":"2024-08-20T01:29:55.377988+0000","last_became_active":"2024-08-20T01:29:55.377642+0000","last_became_peered":"2024-08-20T01:29:55.377642+0000","last_unstale":"2024-08-20T01:29:55.377988+0000","last_undegraded":"2024-08-20T01:29:55.377988+0000","last_fullsized":"2024-08-20T01:29:55.377988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:55:28.416610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'7","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-20T01:30:54.628876+0000","last_change":"2024-08-20T01:29:04.413482+0000","last_active":"2024-08-20T01:30:54.628876+0000","last_peered":"2024-08-20T01:30:54.628876+0000","last_clean":"2024-08-20T01:30:54.628876+0000","last_became_active":"2024-08-20T01:29:04.413096+0000","last_became_peered":"2024-08-20T01:29:04.413096+0000","last_unstale":"2024-08-20T01:30:54.628876+0000","last_undegraded":"2024-08-20T01:30:54.628876+0000","last_fullsized":"2024-08-20T01:30:54.628876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:26:05.947182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'8","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-20T01:30:54.628375+0000","last_change":"2024-08-20T01:29:55.022156+0000","last_active":"2024-08-20T01:30:54.628375+0000","last_peered":"2024-08-20T01:30:54.628375+0000","last_clean":"2024-08-20T01:30:54.628375+0000","last_became_active":"2024-08-20T01:29:55.021604+0000","last_became_peered":"2024-08-20T01:29:55.021604+0000","last_unstale":"2024-08-20T01:30:54.628375+0000","last_undegraded":"2024-08-20T01:30:54.628375+0000","last_fullsized":"2024-08-20T01:30:54.628375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:28:35.155390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024796+0000","last_change":"2024-08-20T01:29:04.409605+0000","last_active":"2024-08-20T01:29:55.024796+0000","last_peered":"2024-08-20T01:29:55.024796+0000","last_clean":"2024-08-20T01:29:55.024796+0000","last_became_active":"2024-08-20T01:29:04.409284+0000","last_became_peered":"2024-08-20T01:29:04.409284+0000","last_unstale":"2024-08-20T01:29:55.024796+0000","last_undegraded":"2024-08-20T01:29:55.024796+0000","last_fullsized":"2024-08-20T01:29:55.024796+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:29:27.471748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019177+0000","last_change":"2024-08-20T01:29:04.400635+0000","last_active":"2024-08-20T01:29:55.019177+0000","last_peered":"2024-08-20T01:29:55.019177+0000","last_clean":"2024-08-20T01:29:55.019177+0000","last_became_active":"2024-08-20T01:29:04.400234+0000","last_became_peered":"2024-08-20T01:29:04.400234+0000","last_unstale":"2024-08-20T01:29:55.019177+0000","last_undegraded":"2024-08-20T01:29:55.019177+0000","last_fullsized":"2024-08-20T01:29:55.019177+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:47:24.810916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.697781+0000","last_change":"2024-08-20T01:29:06.411872+0000","last_active":"2024-08-20T01:30:53.697781+0000","last_peered":"2024-08-20T01:30:53.697781+0000","last_clean":"2024-08-20T01:30:53.697781+0000","last_became_active":"2024-08-20T01:29:06.411563+0000","last_became_peered":"2024-08-20T01:29:06.411563+0000","last_unstale":"2024-08-20T01:30:53.697781+0000","last_undegraded":"2024-08-20T01:30:53.697781+0000","last_fullsized":"2024-08-20T01:30:53.697781+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:03:37.351529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-20T01:30:54.628745+0000","last_change":"2024-08-20T01:29:04.407395+0000","last_active":"2024-08-20T01:30:54.628745+0000","last_peered":"2024-08-20T01:30:54.628745+0000","last_clean":"2024-08-20T01:30:54.628745+0000","last_became_active":"2024-08-20T01:29:04.407000+0000","last_became_peered":"2024-08-20T01:29:04.407000+0000","last_unstale":"2024-08-20T01:30:54.628745+0000","last_undegraded":"2024-08-20T01:30:54.628745+0000","last_fullsized":"2024-08-20T01:30:54.628745+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:36:42.512450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015687+0000","last_change":"2024-08-20T01:29:06.410094+0000","last_active":"2024-08-20T01:29:55.015687+0000","last_peered":"2024-08-20T01:29:55.015687+0000","last_clean":"2024-08-20T01:29:55.015687+0000","last_became_active":"2024-08-20T01:29:06.409749+0000","last_became_peered":"2024-08-20T01:29:06.409749+0000","last_unstale":"2024-08-20T01:29:55.015687+0000","last_undegraded":"2024-08-20T01:29:55.015687+0000","last_fullsized":"2024-08-20T01:29:55.015687+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:52:51.072953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":121,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:49.615938+0000","last_change":"2024-08-20T01:29:04.406810+0000","last_active":"2024-08-20T01:30:49.615938+0000","last_peered":"2024-08-20T01:30:49.615938+0000","last_clean":"2024-08-20T01:30:49.615938+0000","last_became_active":"2024-08-20T01:29:04.406436+0000","last_became_peered":"2024-08-20T01:29:04.406436+0000","last_unstale":"2024-08-20T01:30:49.615938+0000","last_undegraded":"2024-08-20T01:30:49.615938+0000","last_fullsized":"2024-08-20T01:30:49.615938+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:49:57.305447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.028186+0000","last_change":"2024-08-20T01:29:06.424442+0000","last_active":"2024-08-20T01:29:55.028186+0000","last_peered":"2024-08-20T01:29:55.028186+0000","last_clean":"2024-08-20T01:29:55.028186+0000","last_became_active":"2024-08-20T01:29:06.424132+0000","last_became_peered":"2024-08-20T01:29:06.424132+0000","last_unstale":"2024-08-20T01:29:55.028186+0000","last_undegraded":"2024-08-20T01:29:55.028186+0000","last_fullsized":"2024-08-20T01:29:55.028186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:31:30.861113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376745+0000","last_change":"2024-08-20T01:29:04.412307+0000","last_active":"2024-08-20T01:29:55.376745+0000","last_peered":"2024-08-20T01:29:55.376745+0000","last_clean":"2024-08-20T01:29:55.376745+0000","last_became_active":"2024-08-20T01:29:04.411861+0000","last_became_peered":"2024-08-20T01:29:04.411861+0000","last_unstale":"2024-08-20T01:29:55.376745+0000","last_undegraded":"2024-08-20T01:29:55.376745+0000","last_fullsized":"2024-08-20T01:29:55.376745+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:56:51.356821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255721+0000","last_change":"2024-08-20T01:29:06.418525+0000","last_active":"2024-08-20T01:29:55.255721+0000","last_peered":"2024-08-20T01:29:55.255721+0000","last_clean":"2024-08-20T01:29:55.255721+0000","last_became_active":"2024-08-20T01:29:06.417902+0000","last_became_peered":"2024-08-20T01:29:06.417902+0000","last_unstale":"2024-08-20T01:29:55.255721+0000","last_undegraded":"2024-08-20T01:29:55.255721+0000","last_fullsized":"2024-08-20T01:29:55.255721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:28:23.017315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-20T01:30:54.628770+0000","last_change":"2024-08-20T01:29:05.171538+0000","last_active":"2024-08-20T01:30:54.628770+0000","last_peered":"2024-08-20T01:30:54.628770+0000","last_clean":"2024-08-20T01:30:54.628770+0000","last_became_active":"2024-08-20T01:29:05.171172+0000","last_became_peered":"2024-08-20T01:29:05.171172+0000","last_unstale":"2024-08-20T01:30:54.628770+0000","last_undegraded":"2024-08-20T01:30:54.628770+0000","last_fullsized":"2024-08-20T01:30:54.628770+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:04:27.968049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027866+0000","last_change":"2024-08-20T01:29:06.426886+0000","last_active":"2024-08-20T01:29:55.027866+0000","last_peered":"2024-08-20T01:29:55.027866+0000","last_clean":"2024-08-20T01:29:55.027866+0000","last_became_active":"2024-08-20T01:29:06.426569+0000","last_became_peered":"2024-08-20T01:29:06.426569+0000","last_unstale":"2024-08-20T01:29:55.027866+0000","last_undegraded":"2024-08-20T01:29:55.027866+0000","last_fullsized":"2024-08-20T01:29:55.027866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:34:21.948591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'30","reported_seq":270,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:50.124736+0000","last_change":"2024-08-20T01:29:55.038445+0000","last_active":"2024-08-20T01:30:50.124736+0000","last_peered":"2024-08-20T01:30:50.124736+0000","last_clean":"2024-08-20T01:30:50.124736+0000","last_became_active":"2024-08-20T01:29:55.030683+0000","last_became_peered":"2024-08-20T01:29:55.030683+0000","last_unstale":"2024-08-20T01:30:50.124736+0000","last_undegraded":"2024-08-20T01:30:50.124736+0000","last_fullsized":"2024-08-20T01:30:50.124736+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:07:42.592996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60070,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":194,"num_read_kb":155,"num_write":31,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":59762,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018478+0000","last_change":"2024-08-20T01:29:06.417097+0000","last_active":"2024-08-20T01:29:55.018478+0000","last_peered":"2024-08-20T01:29:55.018478+0000","last_clean":"2024-08-20T01:29:55.018478+0000","last_became_active":"2024-08-20T01:29:06.416491+0000","last_became_peered":"2024-08-20T01:29:06.416491+0000","last_unstale":"2024-08-20T01:29:55.018478+0000","last_undegraded":"2024-08-20T01:29:55.018478+0000","last_fullsized":"2024-08-20T01:29:55.018478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:30:16.071161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021546+0000","last_change":"2024-08-20T01:29:04.412071+0000","last_active":"2024-08-20T01:29:55.021546+0000","last_peered":"2024-08-20T01:29:55.021546+0000","last_clean":"2024-08-20T01:29:55.021546+0000","last_became_active":"2024-08-20T01:29:04.411741+0000","last_became_peered":"2024-08-20T01:29:04.411741+0000","last_unstale":"2024-08-20T01:29:55.021546+0000","last_undegraded":"2024-08-20T01:29:55.021546+0000","last_fullsized":"2024-08-20T01:29:55.021546+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:33:47.753754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019405+0000","last_change":"2024-08-20T01:29:06.408996+0000","last_active":"2024-08-20T01:29:55.019405+0000","last_peered":"2024-08-20T01:29:55.019405+0000","last_clean":"2024-08-20T01:29:55.019405+0000","last_became_active":"2024-08-20T01:29:06.408685+0000","last_became_peered":"2024-08-20T01:29:06.408685+0000","last_unstale":"2024-08-20T01:29:55.019405+0000","last_undegraded":"2024-08-20T01:29:55.019405+0000","last_fullsized":"2024-08-20T01:29:55.019405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:18:28.974108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-20T01:30:54.628379+0000","last_change":"2024-08-20T01:29:04.407852+0000","last_active":"2024-08-20T01:30:54.628379+0000","last_peered":"2024-08-20T01:30:54.628379+0000","last_clean":"2024-08-20T01:30:54.628379+0000","last_became_active":"2024-08-20T01:29:04.406828+0000","last_became_peered":"2024-08-20T01:29:04.406828+0000","last_unstale":"2024-08-20T01:30:54.628379+0000","last_undegraded":"2024-08-20T01:30:54.628379+0000","last_fullsized":"2024-08-20T01:30:54.628379+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:36:03.641146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376676+0000","last_change":"2024-08-20T01:29:06.418652+0000","last_active":"2024-08-20T01:29:55.376676+0000","last_peered":"2024-08-20T01:29:55.376676+0000","last_clean":"2024-08-20T01:29:55.376676+0000","last_became_active":"2024-08-20T01:29:06.418340+0000","last_became_peered":"2024-08-20T01:29:06.418340+0000","last_unstale":"2024-08-20T01:29:55.376676+0000","last_undegraded":"2024-08-20T01:29:55.376676+0000","last_fullsized":"2024-08-20T01:29:55.376676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:56:30.194426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'4","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-20T01:30:54.506691+0000","last_change":"2024-08-20T01:29:04.405950+0000","last_active":"2024-08-20T01:30:54.506691+0000","last_peered":"2024-08-20T01:30:54.506691+0000","last_clean":"2024-08-20T01:30:54.506691+0000","last_became_active":"2024-08-20T01:29:04.405650+0000","last_became_peered":"2024-08-20T01:29:04.405650+0000","last_unstale":"2024-08-20T01:30:54.506691+0000","last_undegraded":"2024-08-20T01:30:54.506691+0000","last_fullsized":"2024-08-20T01:30:54.506691+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:12:01.752958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376068+0000","last_change":"2024-08-20T01:29:06.413967+0000","last_active":"2024-08-20T01:29:55.376068+0000","last_peered":"2024-08-20T01:29:55.376068+0000","last_clean":"2024-08-20T01:29:55.376068+0000","last_became_active":"2024-08-20T01:29:06.413628+0000","last_became_peered":"2024-08-20T01:29:06.413628+0000","last_unstale":"2024-08-20T01:29:55.376068+0000","last_undegraded":"2024-08-20T01:29:55.376068+0000","last_fullsized":"2024-08-20T01:29:55.376068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:09:16.394482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018723+0000","last_change":"2024-08-20T01:29:05.169872+0000","last_active":"2024-08-20T01:29:55.018723+0000","last_peered":"2024-08-20T01:29:55.018723+0000","last_clean":"2024-08-20T01:29:55.018723+0000","last_became_active":"2024-08-20T01:29:05.169186+0000","last_became_peered":"2024-08-20T01:29:05.169186+0000","last_unstale":"2024-08-20T01:29:55.018723+0000","last_undegraded":"2024-08-20T01:29:55.018723+0000","last_fullsized":"2024-08-20T01:29:55.018723+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:55:47.447959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"77'6","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-20T01:30:54.628484+0000","last_change":"2024-08-20T01:29:55.030761+0000","last_active":"2024-08-20T01:30:54.628484+0000","last_peered":"2024-08-20T01:30:54.628484+0000","last_clean":"2024-08-20T01:30:54.628484+0000","last_became_active":"2024-08-20T01:29:55.030308+0000","last_became_peered":"2024-08-20T01:29:55.030308+0000","last_unstale":"2024-08-20T01:30:54.628484+0000","last_undegraded":"2024-08-20T01:30:54.628484+0000","last_fullsized":"2024-08-20T01:30:54.628484+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:27:57.082711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018547+0000","last_change":"2024-08-20T01:29:04.408188+0000","last_active":"2024-08-20T01:29:55.018547+0000","last_peered":"2024-08-20T01:29:55.018547+0000","last_clean":"2024-08-20T01:29:55.018547+0000","last_became_active":"2024-08-20T01:29:04.407794+0000","last_became_peered":"2024-08-20T01:29:04.407794+0000","last_unstale":"2024-08-20T01:29:55.018547+0000","last_undegraded":"2024-08-20T01:29:55.018547+0000","last_fullsized":"2024-08-20T01:29:55.018547+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:49:40.679218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024931+0000","last_change":"2024-08-20T01:29:55.024851+0000","last_active":"2024-08-20T01:29:55.024931+0000","last_peered":"2024-08-20T01:29:55.024931+0000","last_clean":"2024-08-20T01:29:55.024931+0000","last_became_active":"2024-08-20T01:29:55.024396+0000","last_became_peered":"2024-08-20T01:29:55.024396+0000","last_unstale":"2024-08-20T01:29:55.024931+0000","last_undegraded":"2024-08-20T01:29:55.024931+0000","last_fullsized":"2024-08-20T01:29:55.024931+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:44:03.846805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019416+0000","last_change":"2024-08-20T01:29:04.412178+0000","last_active":"2024-08-20T01:29:55.019416+0000","last_peered":"2024-08-20T01:29:55.019416+0000","last_clean":"2024-08-20T01:29:55.019416+0000","last_became_active":"2024-08-20T01:29:04.411819+0000","last_became_peered":"2024-08-20T01:29:04.411819+0000","last_unstale":"2024-08-20T01:29:55.019416+0000","last_undegraded":"2024-08-20T01:29:55.019416+0000","last_fullsized":"2024-08-20T01:29:55.019416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:03:11.524911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376922+0000","last_change":"2024-08-20T01:29:06.415697+0000","last_active":"2024-08-20T01:29:55.376922+0000","last_peered":"2024-08-20T01:29:55.376922+0000","last_clean":"2024-08-20T01:29:55.376922+0000","last_became_active":"2024-08-20T01:29:06.415180+0000","last_became_peered":"2024-08-20T01:29:06.415180+0000","last_unstale":"2024-08-20T01:29:55.376922+0000","last_undegraded":"2024-08-20T01:29:55.376922+0000","last_fullsized":"2024-08-20T01:29:55.376922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:55:50.810063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-20T01:30:54.628884+0000","last_change":"2024-08-20T01:29:04.405961+0000","last_active":"2024-08-20T01:30:54.628884+0000","last_peered":"2024-08-20T01:30:54.628884+0000","last_clean":"2024-08-20T01:30:54.628884+0000","last_became_active":"2024-08-20T01:29:04.405633+0000","last_became_peered":"2024-08-20T01:29:04.405633+0000","last_unstale":"2024-08-20T01:30:54.628884+0000","last_undegraded":"2024-08-20T01:30:54.628884+0000","last_fullsized":"2024-08-20T01:30:54.628884+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:00:27.918313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376620+0000","last_change":"2024-08-20T01:29:06.417221+0000","last_active":"2024-08-20T01:29:55.376620+0000","last_peered":"2024-08-20T01:29:55.376620+0000","last_clean":"2024-08-20T01:29:55.376620+0000","last_became_active":"2024-08-20T01:29:06.416912+0000","last_became_peered":"2024-08-20T01:29:06.416912+0000","last_unstale":"2024-08-20T01:29:55.376620+0000","last_undegraded":"2024-08-20T01:29:55.376620+0000","last_fullsized":"2024-08-20T01:29:55.376620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:12:10.667134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.023090+0000","last_change":"2024-08-20T01:29:05.169494+0000","last_active":"2024-08-20T01:29:55.023090+0000","last_peered":"2024-08-20T01:29:55.023090+0000","last_clean":"2024-08-20T01:29:55.023090+0000","last_became_active":"2024-08-20T01:29:05.169059+0000","last_became_peered":"2024-08-20T01:29:05.169059+0000","last_unstale":"2024-08-20T01:29:55.023090+0000","last_undegraded":"2024-08-20T01:29:55.023090+0000","last_fullsized":"2024-08-20T01:29:55.023090+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:25:39.300668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376709+0000","last_change":"2024-08-20T01:29:06.424040+0000","last_active":"2024-08-20T01:29:55.376709+0000","last_peered":"2024-08-20T01:29:55.376709+0000","last_clean":"2024-08-20T01:29:55.376709+0000","last_became_active":"2024-08-20T01:29:06.421360+0000","last_became_peered":"2024-08-20T01:29:06.421360+0000","last_unstale":"2024-08-20T01:29:55.376709+0000","last_undegraded":"2024-08-20T01:29:55.376709+0000","last_fullsized":"2024-08-20T01:29:55.376709+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:24:50.497310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":99,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376310+0000","last_change":"2024-08-20T01:27:51.625696+0000","last_active":"2024-08-20T01:29:55.376310+0000","last_peered":"2024-08-20T01:29:55.376310+0000","last_clean":"2024-08-20T01:29:55.376310+0000","last_became_active":"2024-08-20T01:27:51.620833+0000","last_became_peered":"2024-08-20T01:27:51.620833+0000","last_unstale":"2024-08-20T01:29:55.376310+0000","last_undegraded":"2024-08-20T01:29:55.376310+0000","last_fullsized":"2024-08-20T01:29:55.376310+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:24:32.140649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:24:32.140649+0000","last_clean_scrub_stamp":"2024-08-20T01:24:32.140649+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:54:02.650548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-20T01:30:54.506690+0000","last_change":"2024-08-20T01:29:04.405411+0000","last_active":"2024-08-20T01:30:54.506690+0000","last_peered":"2024-08-20T01:30:54.506690+0000","last_clean":"2024-08-20T01:30:54.506690+0000","last_became_active":"2024-08-20T01:29:04.404980+0000","last_became_peered":"2024-08-20T01:29:04.404980+0000","last_unstale":"2024-08-20T01:30:54.506690+0000","last_undegraded":"2024-08-20T01:30:54.506690+0000","last_fullsized":"2024-08-20T01:30:54.506690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:31:39.335857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.701767+0000","last_change":"2024-08-20T01:29:06.420368+0000","last_active":"2024-08-20T01:30:53.701767+0000","last_peered":"2024-08-20T01:30:53.701767+0000","last_clean":"2024-08-20T01:30:53.701767+0000","last_became_active":"2024-08-20T01:29:06.419653+0000","last_became_peered":"2024-08-20T01:29:06.419653+0000","last_unstale":"2024-08-20T01:30:53.701767+0000","last_undegraded":"2024-08-20T01:30:53.701767+0000","last_fullsized":"2024-08-20T01:30:53.701767+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:48.771774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376170+0000","last_change":"2024-08-20T01:29:04.410302+0000","last_active":"2024-08-20T01:29:55.376170+0000","last_peered":"2024-08-20T01:29:55.376170+0000","last_clean":"2024-08-20T01:29:55.376170+0000","last_became_active":"2024-08-20T01:29:04.409977+0000","last_became_peered":"2024-08-20T01:29:04.409977+0000","last_unstale":"2024-08-20T01:29:55.376170+0000","last_undegraded":"2024-08-20T01:29:55.376170+0000","last_fullsized":"2024-08-20T01:29:55.376170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:57:21.593739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019623+0000","last_change":"2024-08-20T01:29:06.419798+0000","last_active":"2024-08-20T01:29:55.019623+0000","last_peered":"2024-08-20T01:29:55.019623+0000","last_clean":"2024-08-20T01:29:55.019623+0000","last_became_active":"2024-08-20T01:29:06.419546+0000","last_became_peered":"2024-08-20T01:29:06.419546+0000","last_unstale":"2024-08-20T01:29:55.019623+0000","last_undegraded":"2024-08-20T01:29:55.019623+0000","last_fullsized":"2024-08-20T01:29:55.019623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:51:31.848883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'5","reported_seq":123,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:49.861551+0000","last_change":"2024-08-20T01:29:05.169237+0000","last_active":"2024-08-20T01:30:49.861551+0000","last_peered":"2024-08-20T01:30:49.861551+0000","last_clean":"2024-08-20T01:30:49.861551+0000","last_became_active":"2024-08-20T01:29:05.168778+0000","last_became_peered":"2024-08-20T01:29:05.168778+0000","last_unstale":"2024-08-20T01:30:49.861551+0000","last_undegraded":"2024-08-20T01:30:49.861551+0000","last_fullsized":"2024-08-20T01:30:49.861551+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:04:48.847412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"77'8","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-20T01:30:54.628744+0000","last_change":"2024-08-20T01:29:55.024339+0000","last_active":"2024-08-20T01:30:54.628744+0000","last_peered":"2024-08-20T01:30:54.628744+0000","last_clean":"2024-08-20T01:30:54.628744+0000","last_became_active":"2024-08-20T01:29:55.023944+0000","last_became_peered":"2024-08-20T01:29:55.023944+0000","last_unstale":"2024-08-20T01:30:54.628744+0000","last_undegraded":"2024-08-20T01:30:54.628744+0000","last_fullsized":"2024-08-20T01:30:54.628744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:14:00.589422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376838+0000","last_change":"2024-08-20T01:29:04.404472+0000","last_active":"2024-08-20T01:29:55.376838+0000","last_peered":"2024-08-20T01:29:55.376838+0000","last_clean":"2024-08-20T01:29:55.376838+0000","last_became_active":"2024-08-20T01:29:04.404010+0000","last_became_peered":"2024-08-20T01:29:04.404010+0000","last_unstale":"2024-08-20T01:29:55.376838+0000","last_undegraded":"2024-08-20T01:29:55.376838+0000","last_fullsized":"2024-08-20T01:29:55.376838+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:53:04.263362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024682+0000","last_change":"2024-08-20T01:29:06.421875+0000","last_active":"2024-08-20T01:29:55.024682+0000","last_peered":"2024-08-20T01:29:55.024682+0000","last_clean":"2024-08-20T01:29:55.024682+0000","last_became_active":"2024-08-20T01:29:06.421542+0000","last_became_peered":"2024-08-20T01:29:06.421542+0000","last_unstale":"2024-08-20T01:29:55.024682+0000","last_undegraded":"2024-08-20T01:29:55.024682+0000","last_fullsized":"2024-08-20T01:29:55.024682+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:10:46.320252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015905+0000","last_change":"2024-08-20T01:29:05.169985+0000","last_active":"2024-08-20T01:29:55.015905+0000","last_peered":"2024-08-20T01:29:55.015905+0000","last_clean":"2024-08-20T01:29:55.015905+0000","last_became_active":"2024-08-20T01:29:05.169607+0000","last_became_peered":"2024-08-20T01:29:05.169607+0000","last_unstale":"2024-08-20T01:29:55.015905+0000","last_undegraded":"2024-08-20T01:29:55.015905+0000","last_fullsized":"2024-08-20T01:29:55.015905+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:03:23.278369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.024870+0000","last_change":"2024-08-20T01:29:06.414862+0000","last_active":"2024-08-20T01:29:55.024870+0000","last_peered":"2024-08-20T01:29:55.024870+0000","last_clean":"2024-08-20T01:29:55.024870+0000","last_became_active":"2024-08-20T01:29:06.414527+0000","last_became_peered":"2024-08-20T01:29:06.414527+0000","last_unstale":"2024-08-20T01:29:55.024870+0000","last_undegraded":"2024-08-20T01:29:55.024870+0000","last_fullsized":"2024-08-20T01:29:55.024870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:14:20.884073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018713+0000","last_change":"2024-08-20T01:29:05.169638+0000","last_active":"2024-08-20T01:29:55.018713+0000","last_peered":"2024-08-20T01:29:55.018713+0000","last_clean":"2024-08-20T01:29:55.018713+0000","last_became_active":"2024-08-20T01:29:05.169202+0000","last_became_peered":"2024-08-20T01:29:05.169202+0000","last_unstale":"2024-08-20T01:29:55.018713+0000","last_undegraded":"2024-08-20T01:29:55.018713+0000","last_fullsized":"2024-08-20T01:29:55.018713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:05:39.645782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.019554+0000","last_change":"2024-08-20T01:29:06.413839+0000","last_active":"2024-08-20T01:29:55.019554+0000","last_peered":"2024-08-20T01:29:55.019554+0000","last_clean":"2024-08-20T01:29:55.019554+0000","last_became_active":"2024-08-20T01:29:06.413488+0000","last_became_peered":"2024-08-20T01:29:06.413488+0000","last_unstale":"2024-08-20T01:29:55.019554+0000","last_undegraded":"2024-08-20T01:29:55.019554+0000","last_fullsized":"2024-08-20T01:29:55.019554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:35:04.007192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'12","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.028397+0000","last_change":"2024-08-20T01:29:55.028344+0000","last_active":"2024-08-20T01:29:55.028397+0000","last_peered":"2024-08-20T01:29:55.028397+0000","last_clean":"2024-08-20T01:29:55.028397+0000","last_became_active":"2024-08-20T01:29:55.023700+0000","last_became_peered":"2024-08-20T01:29:55.023700+0000","last_unstale":"2024-08-20T01:29:55.028397+0000","last_undegraded":"2024-08-20T01:29:55.028397+0000","last_fullsized":"2024-08-20T01:29:55.028397+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:48:39.513322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.693961+0000","last_change":"2024-08-20T01:29:06.421024+0000","last_active":"2024-08-20T01:30:53.693961+0000","last_peered":"2024-08-20T01:30:53.693961+0000","last_clean":"2024-08-20T01:30:53.693961+0000","last_became_active":"2024-08-20T01:29:06.420631+0000","last_became_peered":"2024-08-20T01:29:06.420631+0000","last_unstale":"2024-08-20T01:30:53.693961+0000","last_undegraded":"2024-08-20T01:30:53.693961+0000","last_fullsized":"2024-08-20T01:30:53.693961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:07:57.992230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-20T01:30:54.507019+0000","last_change":"2024-08-20T01:29:04.835075+0000","last_active":"2024-08-20T01:30:54.507019+0000","last_peered":"2024-08-20T01:30:54.507019+0000","last_clean":"2024-08-20T01:30:54.507019+0000","last_became_active":"2024-08-20T01:29:04.834759+0000","last_became_peered":"2024-08-20T01:29:04.834759+0000","last_unstale":"2024-08-20T01:30:54.507019+0000","last_undegraded":"2024-08-20T01:30:54.507019+0000","last_fullsized":"2024-08-20T01:30:54.507019+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:45:29.040626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255550+0000","last_change":"2024-08-20T01:29:06.418187+0000","last_active":"2024-08-20T01:29:55.255550+0000","last_peered":"2024-08-20T01:29:55.255550+0000","last_clean":"2024-08-20T01:29:55.255550+0000","last_became_active":"2024-08-20T01:29:06.417851+0000","last_became_peered":"2024-08-20T01:29:06.417851+0000","last_unstale":"2024-08-20T01:29:55.255550+0000","last_undegraded":"2024-08-20T01:29:55.255550+0000","last_fullsized":"2024-08-20T01:29:55.255550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:15:48.204455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027380+0000","last_change":"2024-08-20T01:29:05.169736+0000","last_active":"2024-08-20T01:29:55.027380+0000","last_peered":"2024-08-20T01:29:55.027380+0000","last_clean":"2024-08-20T01:29:55.027380+0000","last_became_active":"2024-08-20T01:29:05.169403+0000","last_became_peered":"2024-08-20T01:29:05.169403+0000","last_unstale":"2024-08-20T01:29:55.027380+0000","last_undegraded":"2024-08-20T01:29:55.027380+0000","last_fullsized":"2024-08-20T01:29:55.027380+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:43:43.500841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017870+0000","last_change":"2024-08-20T01:29:06.416433+0000","last_active":"2024-08-20T01:29:55.017870+0000","last_peered":"2024-08-20T01:29:55.017870+0000","last_clean":"2024-08-20T01:29:55.017870+0000","last_became_active":"2024-08-20T01:29:06.414708+0000","last_became_peered":"2024-08-20T01:29:06.414708+0000","last_unstale":"2024-08-20T01:29:55.017870+0000","last_undegraded":"2024-08-20T01:29:55.017870+0000","last_fullsized":"2024-08-20T01:29:55.017870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:17:15.461536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018260+0000","last_change":"2024-08-20T01:29:04.403090+0000","last_active":"2024-08-20T01:29:55.018260+0000","last_peered":"2024-08-20T01:29:55.018260+0000","last_clean":"2024-08-20T01:29:55.018260+0000","last_became_active":"2024-08-20T01:29:04.402697+0000","last_became_peered":"2024-08-20T01:29:04.402697+0000","last_unstale":"2024-08-20T01:29:55.018260+0000","last_undegraded":"2024-08-20T01:29:55.018260+0000","last_fullsized":"2024-08-20T01:29:55.018260+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:36:04.055868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.020556+0000","last_change":"2024-08-20T01:29:06.413427+0000","last_active":"2024-08-20T01:29:55.020556+0000","last_peered":"2024-08-20T01:29:55.020556+0000","last_clean":"2024-08-20T01:29:55.020556+0000","last_became_active":"2024-08-20T01:29:06.413058+0000","last_became_peered":"2024-08-20T01:29:06.413058+0000","last_unstale":"2024-08-20T01:29:55.020556+0000","last_undegraded":"2024-08-20T01:29:55.020556+0000","last_fullsized":"2024-08-20T01:29:55.020556+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:38:38.546701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.021609+0000","last_change":"2024-08-20T01:29:04.409859+0000","last_active":"2024-08-20T01:29:55.021609+0000","last_peered":"2024-08-20T01:29:55.021609+0000","last_clean":"2024-08-20T01:29:55.021609+0000","last_became_active":"2024-08-20T01:29:04.409497+0000","last_became_peered":"2024-08-20T01:29:04.409497+0000","last_unstale":"2024-08-20T01:29:55.021609+0000","last_undegraded":"2024-08-20T01:29:55.021609+0000","last_fullsized":"2024-08-20T01:29:55.021609+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:23:43.548912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.696726+0000","last_change":"2024-08-20T01:29:06.418428+0000","last_active":"2024-08-20T01:30:53.696726+0000","last_peered":"2024-08-20T01:30:53.696726+0000","last_clean":"2024-08-20T01:30:53.696726+0000","last_became_active":"2024-08-20T01:29:06.418033+0000","last_became_peered":"2024-08-20T01:29:06.418033+0000","last_unstale":"2024-08-20T01:30:53.696726+0000","last_undegraded":"2024-08-20T01:30:53.696726+0000","last_fullsized":"2024-08-20T01:30:53.696726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:50:23.503977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.017941+0000","last_change":"2024-08-20T01:29:04.412549+0000","last_active":"2024-08-20T01:29:55.017941+0000","last_peered":"2024-08-20T01:29:55.017941+0000","last_clean":"2024-08-20T01:29:55.017941+0000","last_became_active":"2024-08-20T01:29:04.412071+0000","last_became_peered":"2024-08-20T01:29:04.412071+0000","last_unstale":"2024-08-20T01:29:55.017941+0000","last_undegraded":"2024-08-20T01:29:55.017941+0000","last_fullsized":"2024-08-20T01:29:55.017941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:48:51.195295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.376669+0000","last_change":"2024-08-20T01:29:06.421431+0000","last_active":"2024-08-20T01:29:55.376669+0000","last_peered":"2024-08-20T01:29:55.376669+0000","last_clean":"2024-08-20T01:29:55.376669+0000","last_became_active":"2024-08-20T01:29:06.420916+0000","last_became_peered":"2024-08-20T01:29:06.420916+0000","last_unstale":"2024-08-20T01:29:55.376669+0000","last_undegraded":"2024-08-20T01:29:55.376669+0000","last_fullsized":"2024-08-20T01:29:55.376669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:45.674530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"77'15","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-20T01:30:54.628776+0000","last_change":"2024-08-20T01:29:06.418209+0000","last_active":"2024-08-20T01:30:54.628776+0000","last_peered":"2024-08-20T01:30:54.628776+0000","last_clean":"2024-08-20T01:30:54.628776+0000","last_became_active":"2024-08-20T01:29:06.417812+0000","last_became_peered":"2024-08-20T01:29:06.417812+0000","last_unstale":"2024-08-20T01:30:54.628776+0000","last_undegraded":"2024-08-20T01:30:54.628776+0000","last_fullsized":"2024-08-20T01:30:54.628776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:05:43.794281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018906+0000","last_change":"2024-08-20T01:29:04.408472+0000","last_active":"2024-08-20T01:29:55.018906+0000","last_peered":"2024-08-20T01:29:55.018906+0000","last_clean":"2024-08-20T01:29:55.018906+0000","last_became_active":"2024-08-20T01:29:04.408082+0000","last_became_peered":"2024-08-20T01:29:04.408082+0000","last_unstale":"2024-08-20T01:29:55.018906+0000","last_undegraded":"2024-08-20T01:29:55.018906+0000","last_fullsized":"2024-08-20T01:29:55.018906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:14:44.659672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.027748+0000","last_change":"2024-08-20T01:29:06.423562+0000","last_active":"2024-08-20T01:29:55.027748+0000","last_peered":"2024-08-20T01:29:55.027748+0000","last_clean":"2024-08-20T01:29:55.027748+0000","last_became_active":"2024-08-20T01:29:06.423241+0000","last_became_peered":"2024-08-20T01:29:06.423241+0000","last_unstale":"2024-08-20T01:29:55.027748+0000","last_undegraded":"2024-08-20T01:29:55.027748+0000","last_fullsized":"2024-08-20T01:29:55.027748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:59:46.049449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018583+0000","last_change":"2024-08-20T01:29:04.412287+0000","last_active":"2024-08-20T01:29:55.018583+0000","last_peered":"2024-08-20T01:29:55.018583+0000","last_clean":"2024-08-20T01:29:55.018583+0000","last_became_active":"2024-08-20T01:29:04.411912+0000","last_became_peered":"2024-08-20T01:29:04.411912+0000","last_unstale":"2024-08-20T01:29:55.018583+0000","last_undegraded":"2024-08-20T01:29:55.018583+0000","last_fullsized":"2024-08-20T01:29:55.018583+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:19:25.816795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.255713+0000","last_change":"2024-08-20T01:29:06.416899+0000","last_active":"2024-08-20T01:29:55.255713+0000","last_peered":"2024-08-20T01:29:55.255713+0000","last_clean":"2024-08-20T01:29:55.255713+0000","last_became_active":"2024-08-20T01:29:06.416594+0000","last_became_peered":"2024-08-20T01:29:06.416594+0000","last_unstale":"2024-08-20T01:29:55.255713+0000","last_undegraded":"2024-08-20T01:29:55.255713+0000","last_fullsized":"2024-08-20T01:29:55.255713+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:43.896728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.018949+0000","last_change":"2024-08-20T01:29:05.169571+0000","last_active":"2024-08-20T01:29:55.018949+0000","last_peered":"2024-08-20T01:29:55.018949+0000","last_clean":"2024-08-20T01:29:55.018949+0000","last_became_active":"2024-08-20T01:29:05.169250+0000","last_became_peered":"2024-08-20T01:29:05.169250+0000","last_unstale":"2024-08-20T01:29:55.018949+0000","last_undegraded":"2024-08-20T01:29:55.018949+0000","last_fullsized":"2024-08-20T01:29:55.018949+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:32:04.555825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:30:53.698335+0000","last_change":"2024-08-20T01:29:06.415582+0000","last_active":"2024-08-20T01:30:53.698335+0000","last_peered":"2024-08-20T01:30:53.698335+0000","last_clean":"2024-08-20T01:30:53.698335+0000","last_became_active":"2024-08-20T01:29:06.415284+0000","last_became_peered":"2024-08-20T01:29:06.415284+0000","last_unstale":"2024-08-20T01:30:53.698335+0000","last_undegraded":"2024-08-20T01:30:53.698335+0000","last_fullsized":"2024-08-20T01:30:53.698335+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:05.394097+0000","last_clean_scrub_stamp":"2024-08-20T01:29:05.394097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:43:10.311792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-08-20T01:29:55.015914+0000","last_change":"2024-08-20T01:29:04.409389+0000","last_active":"2024-08-20T01:29:55.015914+0000","last_peered":"2024-08-20T01:29:55.015914+0000","last_clean":"2024-08-20T01:29:55.015914+0000","last_became_active":"2024-08-20T01:29:04.409099+0000","last_became_peered":"2024-08-20T01:29:04.409099+0000","last_unstale":"2024-08-20T01:29:55.015914+0000","last_undegraded":"2024-08-20T01:29:55.015914+0000","last_fullsized":"2024-08-20T01:29:55.015914+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:29:03.384686+0000","last_clean_scrub_stamp":"2024-08-20T01:29:03.384686+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:19:30.156443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64520,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":603,"num_read_kb":366,"num_write":169,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":59762,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":202155,"data_compressed":9608,"data_compressed_allocated":12288,"data_compressed_original":57344,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285456,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743459,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":831488,"data_stored":406512,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939688,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1058371,"data_compressed":42066,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103212,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":406748,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":847872,"data_stored":406668,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495670,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":998906,"data_compressed":42066,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659196,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":406137,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855426,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":998423,"data_compressed":42066,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018951,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":471515,"data_compressed":15386,"data_compressed_allocated":20480,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215179,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":851968,"data_stored":406448,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,4,6,17,18],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":851968,"data_stored":407671,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":466000,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":856064,"data_stored":407408,"data_compressed":5778,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34672,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36288,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":65585,"data_compressed":9608,"data_compressed_allocated":12288,"data_compressed_original":57344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T01:30:55.641 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:30:55.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:55 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-08-20T01:30:55.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:55 smithi077 ceph-mon[22251]: osdmap e78: 12 total, 12 up, 12 in 2024-08-20T01:30:55.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:55 smithi077 ceph-mon[22251]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:30:55.934 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:56.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:55 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-08-20T01:30:56.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:55 smithi134 ceph-mon[22511]: osdmap e78: 12 total, 12 up, 12 in 2024-08-20T01:30:56.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:55 smithi134 ceph-mon[22511]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:30:56.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.418+0000 7fd960b0f640 1 -- 172.21.15.22:0/4102200944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd95c104300 msgr2=0x7fd95c10c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:56.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.418+0000 7fd960b0f640 1 --2- 172.21.15.22:0/4102200944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd95c104300 0x7fd95c10c7f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd944009900 tx=0x7fd94402a410 comp rx=0 tx=0).stop 2024-08-20T01:30:56.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.419+0000 7fd960b0f640 1 -- 172.21.15.22:0/4102200944 shutdown_connections 2024-08-20T01:30:56.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.419+0000 7fd960b0f640 1 --2- 172.21.15.22:0/4102200944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95c10ce40 0x7fd95c10f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:56.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.419+0000 7fd960b0f640 1 --2- 172.21.15.22:0/4102200944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd95c104300 0x7fd95c10c7f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:56.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.419+0000 7fd960b0f640 1 --2- 172.21.15.22:0/4102200944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd95c1039e0 0x7fd95c103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:56.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.419+0000 7fd960b0f640 1 -- 172.21.15.22:0/4102200944 >> 172.21.15.22:0/4102200944 conn(0x7fd95c0fd420 msgr2=0x7fd95c0ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:56.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.419+0000 7fd960b0f640 1 -- 172.21.15.22:0/4102200944 shutdown_connections 2024-08-20T01:30:56.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.419+0000 7fd960b0f640 1 -- 172.21.15.22:0/4102200944 wait complete. 2024-08-20T01:30:56.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.419+0000 7fd960b0f640 1 Processor -- start 2024-08-20T01:30:56.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.419+0000 7fd960b0f640 1 -- start start 2024-08-20T01:30:56.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.420+0000 7fd960b0f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd95c1039e0 0x7fd95c199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:56.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.420+0000 7fd960b0f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd95c104300 0x7fd95c199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:56.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.420+0000 7fd960b0f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95c10ce40 0x7fd95c19e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:56.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.420+0000 7fd960b0f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c112af0 con 0x7fd95c1039e0 2024-08-20T01:30:56.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.420+0000 7fd960b0f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c112970 con 0x7fd95c104300 2024-08-20T01:30:56.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.420+0000 7fd960b0f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c112c70 con 0x7fd95c10ce40 2024-08-20T01:30:56.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.420+0000 7fd95a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd95c1039e0 0x7fd95c199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:56.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.420+0000 7fd95a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd95c1039e0 0x7fd95c199040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43266/0 (socket says 172.21.15.22:43266) 2024-08-20T01:30:56.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.420+0000 7fd95a59c640 1 -- 172.21.15.22:0/1429815285 learned_addr learned my addr 172.21.15.22:0/1429815285 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:56.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.420+0000 7fd953fff640 1 --2- 172.21.15.22:0/1429815285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd95c104300 0x7fd95c199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:56.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.420+0000 7fd95ad9d640 1 --2- 172.21.15.22:0/1429815285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95c10ce40 0x7fd95c19e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:56.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.420+0000 7fd95a59c640 1 -- 172.21.15.22:0/1429815285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95c10ce40 msgr2=0x7fd95c19e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:56.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.420+0000 7fd95a59c640 1 --2- 172.21.15.22:0/1429815285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95c10ce40 0x7fd95c19e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:56.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.420+0000 7fd95a59c640 1 -- 172.21.15.22:0/1429815285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd95c104300 msgr2=0x7fd95c199580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:56.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.420+0000 7fd95a59c640 1 --2- 172.21.15.22:0/1429815285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd95c104300 0x7fd95c199580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:56.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.420+0000 7fd95a59c640 1 -- 172.21.15.22:0/1429815285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95c19f0f0 con 0x7fd95c1039e0 2024-08-20T01:30:56.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.420+0000 7fd953fff640 1 --2- 172.21.15.22:0/1429815285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd95c104300 0x7fd95c199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:30:56.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.420+0000 7fd95a59c640 1 --2- 172.21.15.22:0/1429815285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd95c1039e0 0x7fd95c199040 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00b4a0 tx=0x7fd94c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:56.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.420+0000 7fd9537fe640 1 -- 172.21.15.22:0/1429815285 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c014070 con 0x7fd95c1039e0 2024-08-20T01:30:56.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.421+0000 7fd9537fe640 1 -- 172.21.15.22:0/1429815285 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd94c010ac0 con 0x7fd95c1039e0 2024-08-20T01:30:56.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.421+0000 7fd960b0f640 1 -- 172.21.15.22:0/1429815285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd95c19f3e0 con 0x7fd95c1039e0 2024-08-20T01:30:56.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.421+0000 7fd9537fe640 1 -- 172.21.15.22:0/1429815285 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c017c30 con 0x7fd95c1039e0 2024-08-20T01:30:56.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.421+0000 7fd960b0f640 1 -- 172.21.15.22:0/1429815285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd95c1a5aa0 con 0x7fd95c1039e0 2024-08-20T01:30:56.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.422+0000 7fd960b0f640 1 -- 172.21.15.22:0/1429815285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd95c103dc0 con 0x7fd95c1039e0 2024-08-20T01:30:56.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.423+0000 7fd9537fe640 1 -- 172.21.15.22:0/1429815285 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd94c017070 con 0x7fd95c1039e0 2024-08-20T01:30:56.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.424+0000 7fd9537fe640 1 --2- 172.21.15.22:0/1429815285 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9480b3bd0 0x7fd9480b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:56.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.424+0000 7fd953fff640 1 --2- 172.21.15.22:0/1429815285 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9480b3bd0 0x7fd9480b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:56.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.425+0000 7fd9537fe640 1 -- 172.21.15.22:0/1429815285 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8298+0+0 (secure 0 0 0) 0x7fd94c0e3490 con 0x7fd95c1039e0 2024-08-20T01:30:56.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.425+0000 7fd953fff640 1 --2- 172.21.15.22:0/1429815285 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9480b3bd0 0x7fd9480b6090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd944005ab0 tx=0x7fd944031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:56.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.428+0000 7fd9537fe640 1 -- 172.21.15.22:0/1429815285 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd94c0aaaa0 con 0x7fd95c1039e0 2024-08-20T01:30:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:56 smithi022 ceph-mon[18709]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:30:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:56 smithi022 ceph-mon[18709]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-20T01:30:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:56 smithi022 ceph-mon[18709]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-08-20T01:30:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:56 smithi022 ceph-mon[18709]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:30:56.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.653+0000 7fd960b0f640 1 -- 172.21.15.22:0/1429815285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd95c1a5e30 con 0x7fd95c1039e0 2024-08-20T01:30:56.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.654+0000 7fd9537fe640 1 -- 172.21.15.22:0/1429815285 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11906 (secure 0 0 0) 0x7fd94c0aa3a0 con 0x7fd95c1039e0 2024-08-20T01:30:56.655 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:56.655 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"btime":"2024-08-20T01:30:51:488019+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:30:50.622248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24586,24575,24565]},"id":1}]} 2024-08-20T01:30:56.655 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 25 2024-08-20T01:30:56.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.656+0000 7fd960b0f640 1 -- 172.21.15.22:0/1429815285 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9480b3bd0 msgr2=0x7fd9480b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:56.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.656+0000 7fd960b0f640 1 --2- 172.21.15.22:0/1429815285 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9480b3bd0 0x7fd9480b6090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd944005ab0 tx=0x7fd944031400 comp rx=0 tx=0).stop 2024-08-20T01:30:56.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.656+0000 7fd960b0f640 1 -- 172.21.15.22:0/1429815285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd95c1039e0 msgr2=0x7fd95c199040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:56.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.656+0000 7fd960b0f640 1 --2- 172.21.15.22:0/1429815285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd95c1039e0 0x7fd95c199040 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00b4a0 tx=0x7fd94c00b960 comp rx=0 tx=0).stop 2024-08-20T01:30:56.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.656+0000 7fd960b0f640 1 -- 172.21.15.22:0/1429815285 shutdown_connections 2024-08-20T01:30:56.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.656+0000 7fd960b0f640 1 --2- 172.21.15.22:0/1429815285 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9480b3bd0 0x7fd9480b6090 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:56.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.656+0000 7fd960b0f640 1 --2- 172.21.15.22:0/1429815285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95c10ce40 0x7fd95c19e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:56.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.656+0000 7fd960b0f640 1 --2- 172.21.15.22:0/1429815285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd95c104300 0x7fd95c199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:56.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.656+0000 7fd960b0f640 1 --2- 172.21.15.22:0/1429815285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd95c1039e0 0x7fd95c199040 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:56.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.656+0000 7fd960b0f640 1 -- 172.21.15.22:0/1429815285 >> 172.21.15.22:0/1429815285 conn(0x7fd95c0fd420 msgr2=0x7fd95c0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:56.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.656+0000 7fd960b0f640 1 -- 172.21.15.22:0/1429815285 shutdown_connections 2024-08-20T01:30:56.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:56.656+0000 7fd960b0f640 1 -- 172.21.15.22:0/1429815285 wait complete. 2024-08-20T01:30:56.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:56 smithi077 ceph-mon[22251]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:30:56.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:56 smithi077 ceph-mon[22251]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-20T01:30:56.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:56 smithi077 ceph-mon[22251]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-08-20T01:30:56.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:56 smithi077 ceph-mon[22251]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:30:57.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:56 smithi134 ceph-mon[22511]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:30:57.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:56 smithi134 ceph-mon[22511]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-20T01:30:57.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:56 smithi134 ceph-mon[22511]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-08-20T01:30:57.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:56 smithi134 ceph-mon[22511]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:30:57.349 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:30:57.611 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:57.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:57 smithi022 ceph-mon[18709]: osdmap e79: 12 total, 12 up, 12 in 2024-08-20T01:30:57.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:57 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1429815285' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:57.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:57 smithi077 ceph-mon[22251]: osdmap e79: 12 total, 12 up, 12 in 2024-08-20T01:30:57.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:57 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1429815285' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:58.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:57 smithi134 ceph-mon[22511]: osdmap e79: 12 total, 12 up, 12 in 2024-08-20T01:30:58.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:57 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1429815285' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:30:58.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.095+0000 7fb573290640 1 -- 172.21.15.22:0/4151874293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56c1084e0 msgr2=0x7fb56c108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:58.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.095+0000 7fb573290640 1 --2- 172.21.15.22:0/4151874293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56c1084e0 0x7fb56c108920 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009900 tx=0x7fb55c02a410 comp rx=0 tx=0).stop 2024-08-20T01:30:58.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.095+0000 7fb573290640 1 -- 172.21.15.22:0/4151874293 shutdown_connections 2024-08-20T01:30:58.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.095+0000 7fb573290640 1 --2- 172.21.15.22:0/4151874293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb56c108e60 0x7fb56c10f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:58.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.095+0000 7fb573290640 1 --2- 172.21.15.22:0/4151874293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56c1084e0 0x7fb56c108920 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:58.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.095+0000 7fb573290640 1 --2- 172.21.15.22:0/4151874293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56c102ad0 0x7fb56c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:58.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.095+0000 7fb573290640 1 -- 172.21.15.22:0/4151874293 >> 172.21.15.22:0/4151874293 conn(0x7fb56c0fe540 msgr2=0x7fb56c100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.095+0000 7fb573290640 1 -- 172.21.15.22:0/4151874293 shutdown_connections 2024-08-20T01:30:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.095+0000 7fb573290640 1 -- 172.21.15.22:0/4151874293 wait complete. 2024-08-20T01:30:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.096+0000 7fb573290640 1 Processor -- start 2024-08-20T01:30:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.096+0000 7fb573290640 1 -- start start 2024-08-20T01:30:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.096+0000 7fb573290640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb56c102ad0 0x7fb56c1990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.096+0000 7fb573290640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56c1084e0 0x7fb56c1995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.096+0000 7fb573290640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56c108e60 0x7fb56c19e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.096+0000 7fb573290640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c112ae0 con 0x7fb56c108e60 2024-08-20T01:30:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.096+0000 7fb573290640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c112960 con 0x7fb56c1084e0 2024-08-20T01:30:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.096+0000 7fb573290640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c112c60 con 0x7fb56c102ad0 2024-08-20T01:30:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.096+0000 7fb57182d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56c108e60 0x7fb56c19e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.096+0000 7fb57182d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56c108e60 0x7fb56c19e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43296/0 (socket says 172.21.15.22:43296) 2024-08-20T01:30:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.096+0000 7fb57182d640 1 -- 172.21.15.22:0/1374255185 learned_addr learned my addr 172.21.15.22:0/1374255185 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.096+0000 7fb57102c640 1 --2- 172.21.15.22:0/1374255185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb56c102ad0 0x7fb56c1990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.096+0000 7fb57082b640 1 --2- 172.21.15.22:0/1374255185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56c1084e0 0x7fb56c1995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.096+0000 7fb57182d640 1 -- 172.21.15.22:0/1374255185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb56c102ad0 msgr2=0x7fb56c1990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.096+0000 7fb57182d640 1 --2- 172.21.15.22:0/1374255185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb56c102ad0 0x7fb56c1990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.096+0000 7fb57182d640 1 -- 172.21.15.22:0/1374255185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56c1084e0 msgr2=0x7fb56c1995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.096+0000 7fb57182d640 1 --2- 172.21.15.22:0/1374255185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56c1084e0 0x7fb56c1995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.096+0000 7fb57182d640 1 -- 172.21.15.22:0/1374255185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56c19f160 con 0x7fb56c108e60 2024-08-20T01:30:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.096+0000 7fb57082b640 1 --2- 172.21.15.22:0/1374255185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56c1084e0 0x7fb56c1995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.097+0000 7fb57182d640 1 --2- 172.21.15.22:0/1374255185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56c108e60 0x7fb56c19e990 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb56400cad0 tx=0x7fb56400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.097+0000 7fb5627fc640 1 -- 172.21.15.22:0/1374255185 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56400ae20 con 0x7fb56c108e60 2024-08-20T01:30:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.097+0000 7fb5627fc640 1 -- 172.21.15.22:0/1374255185 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb564005020 con 0x7fb56c108e60 2024-08-20T01:30:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.097+0000 7fb573290640 1 -- 172.21.15.22:0/1374255185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb56c19f450 con 0x7fb56c108e60 2024-08-20T01:30:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.097+0000 7fb5627fc640 1 -- 172.21.15.22:0/1374255185 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56400f6b0 con 0x7fb56c108e60 2024-08-20T01:30:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.097+0000 7fb573290640 1 -- 172.21.15.22:0/1374255185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb56c1a5b10 con 0x7fb56c108e60 2024-08-20T01:30:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.098+0000 7fb573290640 1 -- 172.21.15.22:0/1374255185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb56c103d80 con 0x7fb56c108e60 2024-08-20T01:30:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.099+0000 7fb5627fc640 1 -- 172.21.15.22:0/1374255185 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb5640051d0 con 0x7fb56c108e60 2024-08-20T01:30:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.100+0000 7fb5627fc640 1 --2- 172.21.15.22:0/1374255185 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb5580b3c50 0x7fb5580b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.100+0000 7fb57102c640 1 --2- 172.21.15.22:0/1374255185 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb5580b3c50 0x7fb5580b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:58.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.100+0000 7fb5627fc640 1 -- 172.21.15.22:0/1374255185 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb5640e3b50 con 0x7fb56c108e60 2024-08-20T01:30:58.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.100+0000 7fb57102c640 1 --2- 172.21.15.22:0/1374255185 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb5580b3c50 0x7fb5580b6110 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb5680058c0 tx=0x7fb56800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:58.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.104+0000 7fb5627fc640 1 -- 172.21.15.22:0/1374255185 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fb564014030 con 0x7fb56c108e60 2024-08-20T01:30:58.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.289+0000 7fb573290640 1 -- 172.21.15.22:0/1374255185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb56c10a6b0 con 0x7fb56c108e60 2024-08-20T01:30:58.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.290+0000 7fb5627fc640 1 -- 172.21.15.22:0/1374255185 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22747 (secure 0 0 0) 0x7fb5640ab160 con 0x7fb56c108e60 2024-08-20T01:30:58.291 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:30:58.291 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":79,"fsid":"586fd06c-5e92-11ef-bccf-c7b262605968","created":"2024-08-20T01:20:55.065729+0000","modified":"2024-08-20T01:30:56.514561+0000","last_up_change":"2024-08-20T01:28:14.752931+0000","last_in_change":"2024-08-20T01:27:51.812525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:24:31.674035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:29:02.800545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:29:04.951975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b67a59af-5eea-4073-a4b2-604a1b7b8f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6803","nonce":812056903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6805","nonce":812056903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6809","nonce":812056903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6807","nonce":812056903}]},"public_addr":"172.21.15.22:6803/812056903","cluster_addr":"172.21.15.22:6805/812056903","heartbeat_back_addr":"172.21.15.22:6809/812056903","heartbeat_front_addr":"172.21.15.22:6807/812056903","state":["exists","up"]},{"osd":1,"uuid":"9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6801","nonce":823882511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6803","nonce":823882511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6807","nonce":823882511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6805","nonce":823882511}]},"public_addr":"172.21.15.77:6801/823882511","cluster_addr":"172.21.15.77:6803/823882511","heartbeat_back_addr":"172.21.15.77:6807/823882511","heartbeat_front_addr":"172.21.15.77:6805/823882511","state":["exists","up"]},{"osd":2,"uuid":"71e3c019-a3e0-4632-81a8-27ac31279f7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6801","nonce":3873702897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6803","nonce":3873702897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6807","nonce":3873702897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6805","nonce":3873702897}]},"public_addr":"172.21.15.134:6801/3873702897","cluster_addr":"172.21.15.134:6803/3873702897","heartbeat_back_addr":"172.21.15.134:6807/3873702897","heartbeat_front_addr":"172.21.15.134:6805/3873702897","state":["exists","up"]},{"osd":3,"uuid":"a60de748-aa65-477d-864e-6281db1261ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6811","nonce":1775946906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6813","nonce":1775946906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6817","nonce":1775946906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6815","nonce":1775946906}]},"public_addr":"172.21.15.22:6811/1775946906","cluster_addr":"172.21.15.22:6813/1775946906","heartbeat_back_addr":"172.21.15.22:6817/1775946906","heartbeat_front_addr":"172.21.15.22:6815/1775946906","state":["exists","up"]},{"osd":4,"uuid":"07d99671-2ece-471c-ad69-fc9043d917f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6809","nonce":1954209322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6811","nonce":1954209322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6815","nonce":1954209322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6813","nonce":1954209322}]},"public_addr":"172.21.15.77:6809/1954209322","cluster_addr":"172.21.15.77:6811/1954209322","heartbeat_back_addr":"172.21.15.77:6815/1954209322","heartbeat_front_addr":"172.21.15.77:6813/1954209322","state":["exists","up"]},{"osd":5,"uuid":"971cac33-0b98-49b1-b4b2-27354fc0ab90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6809","nonce":2805488123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6811","nonce":2805488123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6815","nonce":2805488123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6813","nonce":2805488123}]},"public_addr":"172.21.15.134:6809/2805488123","cluster_addr":"172.21.15.134:6811/2805488123","heartbeat_back_addr":"172.21.15.134:6815/2805488123","heartbeat_front_addr":"172.21.15.134:6813/2805488123","state":["exists","up"]},{"osd":6,"uuid":"48d90292-8511-47d6-8093-330bd13ae70e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6819","nonce":3804882416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6821","nonce":3804882416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6825","nonce":3804882416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6823","nonce":3804882416}]},"public_addr":"172.21.15.22:6819/3804882416","cluster_addr":"172.21.15.22:6821/3804882416","heartbeat_back_addr":"172.21.15.22:6825/3804882416","heartbeat_front_addr":"172.21.15.22:6823/3804882416","state":["exists","up"]},{"osd":7,"uuid":"e217112d-9f56-4a48-93bf-6eb052ce540a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6817","nonce":700318902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6819","nonce":700318902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6823","nonce":700318902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6821","nonce":700318902}]},"public_addr":"172.21.15.77:6817/700318902","cluster_addr":"172.21.15.77:6819/700318902","heartbeat_back_addr":"172.21.15.77:6823/700318902","heartbeat_front_addr":"172.21.15.77:6821/700318902","state":["exists","up"]},{"osd":8,"uuid":"1786747c-6ff6-4e00-bcf6-a8176215847f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6817","nonce":1635473481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6819","nonce":1635473481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6823","nonce":1635473481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6821","nonce":1635473481}]},"public_addr":"172.21.15.134:6817/1635473481","cluster_addr":"172.21.15.134:6819/1635473481","heartbeat_back_addr":"172.21.15.134:6823/1635473481","heartbeat_front_addr":"172.21.15.134:6821/1635473481","state":["exists","up"]},{"osd":9,"uuid":"708f7390-1b51-4397-a92a-8ff3f4a5bc45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6827","nonce":3899297933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6829","nonce":3899297933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6833","nonce":3899297933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6831","nonce":3899297933}]},"public_addr":"172.21.15.22:6827/3899297933","cluster_addr":"172.21.15.22:6829/3899297933","heartbeat_back_addr":"172.21.15.22:6833/3899297933","heartbeat_front_addr":"172.21.15.22:6831/3899297933","state":["exists","up"]},{"osd":10,"uuid":"d15b0acd-dd08-431d-88aa-756b6420987d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6825","nonce":2765589872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6827","nonce":2765589872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6831","nonce":2765589872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6829","nonce":2765589872}]},"public_addr":"172.21.15.77:6825/2765589872","cluster_addr":"172.21.15.77:6827/2765589872","heartbeat_back_addr":"172.21.15.77:6831/2765589872","heartbeat_front_addr":"172.21.15.77:6829/2765589872","state":["exists","up"]},{"osd":11,"uuid":"d15017fa-3c3d-4096-a35d-275cd54bb9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6825","nonce":964533669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6827","nonce":964533669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6831","nonce":964533669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6829","nonce":964533669}]},"public_addr":"172.21.15.134:6825/964533669","cluster_addr":"172.21.15.134:6827/964533669","heartbeat_back_addr":"172.21.15.134:6831/964533669","heartbeat_front_addr":"172.21.15.134:6829/964533669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:23:40.839725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:05.141389+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:28.340737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:52.028949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:17.029913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:42.092826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:07.831100+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:33.380447+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:58.772655+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:23.017208+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:47.966711+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:28:13.123047+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/416470260":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6800/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/1142422661":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:6800/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/2093308719":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/3772866379":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3424402756":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3864772624":"2024-08-21T01:21:28.981981+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:30:58.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.292+0000 7fb573290640 1 -- 172.21.15.22:0/1374255185 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb5580b3c50 msgr2=0x7fb5580b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:58.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.292+0000 7fb573290640 1 --2- 172.21.15.22:0/1374255185 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb5580b3c50 0x7fb5580b6110 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb5680058c0 tx=0x7fb56800a250 comp rx=0 tx=0).stop 2024-08-20T01:30:58.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.292+0000 7fb573290640 1 -- 172.21.15.22:0/1374255185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56c108e60 msgr2=0x7fb56c19e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:58.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.292+0000 7fb573290640 1 --2- 172.21.15.22:0/1374255185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56c108e60 0x7fb56c19e990 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb56400cad0 tx=0x7fb56400cf90 comp rx=0 tx=0).stop 2024-08-20T01:30:58.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.292+0000 7fb573290640 1 -- 172.21.15.22:0/1374255185 shutdown_connections 2024-08-20T01:30:58.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.292+0000 7fb573290640 1 --2- 172.21.15.22:0/1374255185 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb5580b3c50 0x7fb5580b6110 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:58.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.292+0000 7fb573290640 1 --2- 172.21.15.22:0/1374255185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56c108e60 0x7fb56c19e990 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:58.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.292+0000 7fb573290640 1 --2- 172.21.15.22:0/1374255185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56c1084e0 0x7fb56c1995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:58.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.292+0000 7fb573290640 1 --2- 172.21.15.22:0/1374255185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb56c102ad0 0x7fb56c1990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:58.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.292+0000 7fb573290640 1 -- 172.21.15.22:0/1374255185 >> 172.21.15.22:0/1374255185 conn(0x7fb56c0fe540 msgr2=0x7fb56c100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:58.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.292+0000 7fb573290640 1 -- 172.21.15.22:0/1374255185 shutdown_connections 2024-08-20T01:30:58.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:58.292+0000 7fb573290640 1 -- 172.21.15.22:0/1374255185 wait complete. 2024-08-20T01:30:58.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:58 smithi022 ceph-mon[18709]: pgmap v341: 97 pgs: 1 peering, 96 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-08-20T01:30:58.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:58 smithi022 ceph-mon[18709]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-08-20T01:30:58.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:30:58 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1374255185' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:30:58.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:58 smithi077 ceph-mon[22251]: pgmap v341: 97 pgs: 1 peering, 96 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-08-20T01:30:58.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:58 smithi077 ceph-mon[22251]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-08-20T01:30:58.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:30:58 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1374255185' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:30:58.914 DEBUG:tasks.fwd_scrub:Yielding 2024-08-20T01:30:58.914 INFO:teuthology.run_tasks:Running task background_exec... 2024-08-20T01:30:58.925 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-08-20T01:30:58.925 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-08-20T01:30:58.926 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-08-20T01:30:58.926 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:30:58.926 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:30:58.928 INFO:teuthology.run_tasks:Running task workunit... 2024-08-20T01:30:58.952 INFO:tasks.workunit:Pulling workunits from ref ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:30:58.953 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-20T01:30:58.953 INFO:tasks.workunit:timeout=3h 2024-08-20T01:30:58.953 INFO:tasks.workunit:cleanup=True 2024-08-20T01:30:58.953 DEBUG:teuthology.orchestra.run.smithi022:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-20T01:30:58.972 INFO:teuthology.orchestra.run.smithi022.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-08-20T01:30:58.973 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-08-20T01:30:58.973 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 79h/121d Inode: 1099511628283 Links: 2 2024-08-20T01:30:58.973 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:30:58.973 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-08-20T01:30:58.973 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-08-20 01:29:24.886445603 +0000 2024-08-20T01:30:58.973 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-08-20 01:29:24.886445603 +0000 2024-08-20T01:30:58.973 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-08-20 01:30:49.894792825 +0000 2024-08-20T01:30:58.973 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-08-20 01:29:24.886445603 +0000 2024-08-20T01:30:58.973 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-08-20T01:30:58.974 DEBUG:teuthology.orchestra.run.smithi022:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-08-20T01:30:59.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:58 smithi134 ceph-mon[22511]: pgmap v341: 97 pgs: 1 peering, 96 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-08-20T01:30:59.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:58 smithi134 ceph-mon[22511]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-08-20T01:30:59.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:30:58 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1374255185' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:30:59.047 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:30:59.105 INFO:tasks.workunit.client.0.smithi022.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-20T01:30:59.200 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:59.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.699+0000 7f9edbcbd640 1 -- 172.21.15.22:0/1366847476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ed41042c0 msgr2=0x7f9ed410c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:59.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.699+0000 7f9edbcbd640 1 --2- 172.21.15.22:0/1366847476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ed41042c0 0x7f9ed410c7b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4009900 tx=0x7f9ec402a3f0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.699+0000 7f9edbcbd640 1 -- 172.21.15.22:0/1366847476 shutdown_connections 2024-08-20T01:30:59.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.699+0000 7f9edbcbd640 1 --2- 172.21.15.22:0/1366847476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed410ce00 0x7f9ed410f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.699+0000 7f9edbcbd640 1 --2- 172.21.15.22:0/1366847476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ed41042c0 0x7f9ed410c7b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.699+0000 7f9edbcbd640 1 --2- 172.21.15.22:0/1366847476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ed41039a0 0x7f9ed4103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.699+0000 7f9edbcbd640 1 -- 172.21.15.22:0/1366847476 >> 172.21.15.22:0/1366847476 conn(0x7f9ed40fd400 msgr2=0x7f9ed40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:59.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.700+0000 7f9edbcbd640 1 -- 172.21.15.22:0/1366847476 shutdown_connections 2024-08-20T01:30:59.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.700+0000 7f9edbcbd640 1 -- 172.21.15.22:0/1366847476 wait complete. 2024-08-20T01:30:59.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.700+0000 7f9edbcbd640 1 Processor -- start 2024-08-20T01:30:59.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.700+0000 7f9edbcbd640 1 -- start start 2024-08-20T01:30:59.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.700+0000 7f9edbcbd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ed41039a0 0x7f9ed4101650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:59.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.700+0000 7f9edbcbd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed41042c0 0x7f9ed4101b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:59.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.700+0000 7f9edbcbd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ed410ce00 0x7f9ed41020d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:59.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.700+0000 7f9edbcbd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed4112a70 con 0x7f9ed41039a0 2024-08-20T01:30:59.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.700+0000 7f9edbcbd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed41128f0 con 0x7f9ed41042c0 2024-08-20T01:30:59.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.700+0000 7f9edbcbd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed4112bf0 con 0x7f9ed410ce00 2024-08-20T01:30:59.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.701+0000 7f9ed9a59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ed41039a0 0x7f9ed4101650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:59.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.701+0000 7f9ed9a59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ed41039a0 0x7f9ed4101650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55442/0 (socket says 172.21.15.22:55442) 2024-08-20T01:30:59.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.701+0000 7f9ed9a59640 1 -- 172.21.15.22:0/392537266 learned_addr learned my addr 172.21.15.22:0/392537266 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:59.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.701+0000 7f9ed9258640 1 --2- 172.21.15.22:0/392537266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed41042c0 0x7f9ed4101b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:59.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.701+0000 7f9eda25a640 1 --2- 172.21.15.22:0/392537266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ed410ce00 0x7f9ed41020d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:59.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.701+0000 7f9ed9a59640 1 -- 172.21.15.22:0/392537266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ed410ce00 msgr2=0x7f9ed41020d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:59.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.701+0000 7f9ed9a59640 1 --2- 172.21.15.22:0/392537266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ed410ce00 0x7f9ed41020d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.701+0000 7f9ed9a59640 1 -- 172.21.15.22:0/392537266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed41042c0 msgr2=0x7f9ed4101b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:59.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.701+0000 7f9ed9a59640 1 --2- 172.21.15.22:0/392537266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed41042c0 0x7f9ed4101b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.701+0000 7f9ed9a59640 1 -- 172.21.15.22:0/392537266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed41a7320 con 0x7f9ed41039a0 2024-08-20T01:30:59.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.701+0000 7f9ed9a59640 1 --2- 172.21.15.22:0/392537266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ed41039a0 0x7f9ed4101650 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000c920 tx=0x7f9ed000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:59.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.701+0000 7f9ecaffd640 1 -- 172.21.15.22:0/392537266 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0007c70 con 0x7f9ed41039a0 2024-08-20T01:30:59.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.701+0000 7f9ecaffd640 1 -- 172.21.15.22:0/392537266 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ed0007e10 con 0x7f9ed41039a0 2024-08-20T01:30:59.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.701+0000 7f9edbcbd640 1 -- 172.21.15.22:0/392537266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed41a7610 con 0x7f9ed41039a0 2024-08-20T01:30:59.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.701+0000 7f9ecaffd640 1 -- 172.21.15.22:0/392537266 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0018820 con 0x7f9ed41039a0 2024-08-20T01:30:59.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.701+0000 7f9edbcbd640 1 -- 172.21.15.22:0/392537266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed41a7b20 con 0x7f9ed41039a0 2024-08-20T01:30:59.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.704+0000 7f9ede0b6740 1 Processor -- start 2024-08-20T01:30:59.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.704+0000 7f9ecaffd640 1 -- 172.21.15.22:0/392537266 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9ed000f450 con 0x7f9ed41039a0 2024-08-20T01:30:59.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.704+0000 7f9ede0b6740 1 -- start start 2024-08-20T01:30:59.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.704+0000 7f9ede0b6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd23b0 0x563d3dfd2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:59.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.704+0000 7f9ede0b6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfd2cd0 0x563d3dfde720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:59.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.704+0000 7f9ede0b6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfdec60 0x563d3dfe1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:59.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.704+0000 7f9ede0b6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563d3df48940 con 0x563d3dfd23b0 2024-08-20T01:30:59.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.704+0000 7f9ede0b6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563d3df37e40 con 0x563d3dfd2cd0 2024-08-20T01:30:59.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.704+0000 7f9ede0b6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563d3df3be80 con 0x563d3dfdec60 2024-08-20T01:30:59.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.705+0000 7f9eda25a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd23b0 0x563d3dfd2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:59.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.705+0000 7f9eda25a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd23b0 0x563d3dfd2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55452/0 (socket says 172.21.15.22:55452) 2024-08-20T01:30:59.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.705+0000 7f9eda25a640 1 -- 172.21.15.22:0/1566301285 learned_addr learned my addr 172.21.15.22:0/1566301285 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:59.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.705+0000 7f9ed9258640 1 --2- 172.21.15.22:0/1566301285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfdec60 0x563d3dfe1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:59.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.705+0000 7f9ed9a59640 1 --2- 172.21.15.22:0/1566301285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfd2cd0 0x563d3dfde720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:59.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.705+0000 7f9eda25a640 1 -- 172.21.15.22:0/1566301285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfdec60 msgr2=0x563d3dfe1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:59.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.705+0000 7f9eda25a640 1 --2- 172.21.15.22:0/1566301285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfdec60 0x563d3dfe1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.705+0000 7f9eda25a640 1 -- 172.21.15.22:0/1566301285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfd2cd0 msgr2=0x563d3dfde720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:59.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.705+0000 7f9eda25a640 1 --2- 172.21.15.22:0/1566301285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfd2cd0 0x563d3dfde720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.705+0000 7f9eda25a640 1 -- 172.21.15.22:0/1566301285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d3ded4520 con 0x563d3dfd23b0 2024-08-20T01:30:59.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.705+0000 7f9ed9a59640 1 --2- 172.21.15.22:0/1566301285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfd2cd0 0x563d3dfde720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:30:59.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.705+0000 7f9ecaffd640 1 --2- 172.21.15.22:0/392537266 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9ec00b3bd0 0x7f9ec00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:59.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.705+0000 7f9eda25a640 1 --2- 172.21.15.22:0/1566301285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd23b0 0x563d3dfd2790 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc007ef0 tx=0x7f9ecc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628a307eb2c46d63 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:59.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.705+0000 7f9ed9a59640 1 --2- 172.21.15.22:0/392537266 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9ec00b3bd0 0x7f9ec00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:59.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.705+0000 7f9ecaffd640 1 -- 172.21.15.22:0/392537266 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f9ed00e3ce0 con 0x7f9ed41039a0 2024-08-20T01:30:59.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.705+0000 7f9ebffff640 1 -- 172.21.15.22:0/1566301285 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc010840 con 0x563d3dfd23b0 2024-08-20T01:30:59.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.706+0000 7f9ebffff640 1 -- 172.21.15.22:0/1566301285 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ecc0183f0 con 0x563d3dfd23b0 2024-08-20T01:30:59.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.706+0000 7f9ebffff640 1 -- 172.21.15.22:0/1566301285 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc017600 con 0x563d3dfd23b0 2024-08-20T01:30:59.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.706+0000 7f9ede0b6740 1 -- 172.21.15.22:0/1566301285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd23b0 msgr2=0x563d3dfd2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:59.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.706+0000 7f9ed9a59640 1 --2- 172.21.15.22:0/392537266 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9ec00b3bd0 0x7f9ec00b6090 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00e1b10 tx=0x7f9ed0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:59.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.706+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/1566301285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd23b0 0x563d3dfd2790 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc007ef0 tx=0x7f9ecc00f790 comp rx=0 tx=0).stop 2024-08-20T01:30:59.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.706+0000 7f9ede0b6740 1 -- 172.21.15.22:0/1566301285 shutdown_connections 2024-08-20T01:30:59.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.706+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/1566301285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfdec60 0x563d3dfe1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.706+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/1566301285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfd2cd0 0x563d3dfde720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.706+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/1566301285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd23b0 0x563d3dfd2790 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.706+0000 7f9ede0b6740 1 -- 172.21.15.22:0/1566301285 >> 172.21.15.22:0/1566301285 conn(0x563d3dfd01e0 msgr2=0x563d3dfd1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:59.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.706+0000 7f9ede0b6740 1 -- 172.21.15.22:0/1566301285 shutdown_connections 2024-08-20T01:30:59.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.706+0000 7f9ede0b6740 1 -- 172.21.15.22:0/1566301285 wait complete. 2024-08-20T01:30:59.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.707+0000 7f9ede0b6740 1 -- start start 2024-08-20T01:30:59.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.707+0000 7f9ede0b6740 1 Processor -- start 2024-08-20T01:30:59.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.707+0000 7f9ede0b6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfd23b0 0x563d3dfdbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:59.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.707+0000 7f9ede0b6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfd2cd0 0x563d3dfdc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:59.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.707+0000 7f9ede0b6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfdec60 0x563d3dfdc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:59.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.707+0000 7f9ede0b6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563d3dd9a890 con 0x563d3dfdec60 2024-08-20T01:30:59.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.707+0000 7f9ede0b6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563d3debe700 con 0x563d3dfd2cd0 2024-08-20T01:30:59.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.707+0000 7f9ede0b6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563d3dfe19b0 con 0x563d3dfd23b0 2024-08-20T01:30:59.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.707+0000 7f9ede0b6740 10 client.0 _ll_register_callbacks cb 0x563d3df336f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:30:59.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.707+0000 7f9eda25a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfdec60 0x563d3dfdc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:59.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.708+0000 7f9eda25a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfdec60 0x563d3dfdc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55462/0 (socket says 172.21.15.22:55462) 2024-08-20T01:30:59.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.708+0000 7f9eda25a640 1 -- 172.21.15.22:0/2412509356 learned_addr learned my addr 172.21.15.22:0/2412509356 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:59.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.708+0000 7f9eda25a640 1 --2- 172.21.15.22:0/2412509356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfd23b0 0x563d3dfdbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:59.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.708+0000 7f9ed9258640 1 --2- 172.21.15.22:0/2412509356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfd2cd0 0x563d3dfdc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:59.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.708+0000 7f9eda25a640 1 -- 172.21.15.22:0/2412509356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfd23b0 msgr2=0x563d3dfdbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:59.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.708+0000 7f9eda25a640 1 --2- 172.21.15.22:0/2412509356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfd23b0 0x563d3dfdbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.708+0000 7f9eda25a640 1 -- 172.21.15.22:0/2412509356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfd2cd0 msgr2=0x563d3dfdc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:59.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.708+0000 7f9eda25a640 1 --2- 172.21.15.22:0/2412509356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfd2cd0 0x563d3dfdc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.708+0000 7f9eda25a640 1 -- 172.21.15.22:0/2412509356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d3dc97930 con 0x563d3dfdec60 2024-08-20T01:30:59.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.708+0000 7f9eda25a640 1 --2- 172.21.15.22:0/2412509356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfdec60 0x563d3dfdc6b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc018e90 tx=0x7f9ecc012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b9b05c5aefb6d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:59.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.708+0000 7f9ebd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:30:59.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.708+0000 7f9ebd7fa640 1 -- 172.21.15.22:0/2412509356 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc02c060 con 0x563d3dfdec60 2024-08-20T01:30:59.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.708+0000 7f9ede0b6740 1 -- 172.21.15.22:0/2412509356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ecc0183f0 con 0x563d3dfdec60 2024-08-20T01:30:59.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.708+0000 7f9ebd7fa640 1 -- 172.21.15.22:0/2412509356 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f9ecc003d80 con 0x563d3dfdec60 2024-08-20T01:30:59.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.709+0000 7f9ebd7fa640 1 -- 172.21.15.22:0/2412509356 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9ecc010730 con 0x563d3dfdec60 2024-08-20T01:30:59.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.709+0000 7f9ede0b6740 10 client.15336 fetch_fsmap learned FSMap version 25 2024-08-20T01:30:59.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.709+0000 7f9ede0b6740 1 -- 172.21.15.22:0/2412509356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563d3dfed4e0 con 0x563d3dfdec60 2024-08-20T01:30:59.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.709+0000 7f9ebd7fa640 1 -- 172.21.15.22:0/2412509356 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ecc0183f0 con 0x563d3dfdec60 2024-08-20T01:30:59.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.709+0000 7f9ebd7fa640 1 -- 172.21.15.22:0/2412509356 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9ecc024040 con 0x563d3dfdec60 2024-08-20T01:30:59.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.709+0000 7f9ede0b6740 10 client.15336 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:30:59.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.709+0000 7f9ede0b6740 10 client.15336 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:30:59.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.709+0000 7f9ede0b6740 20 client.15336 populate_metadata read hostname 'smithi022' 2024-08-20T01:30:59.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.709+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/2412509356 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563d3dfee940 0x563d3dff0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:59.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.709+0000 7f9ede0b6740 4 client.15336 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:30:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.709+0000 7f9ede0b6740 1 -- 172.21.15.22:0/2412509356 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d3df4a890 con 0x563d3dfee940 2024-08-20T01:30:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.709+0000 7f9ed9258640 1 --2- 172.21.15.22:0/2412509356 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563d3dfee940 0x563d3dff0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.710+0000 7f9ed9258640 1 --2- 172.21.15.22:0/2412509356 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563d3dfee940 0x563d3dff0d30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffdd0af19282d88b server_cookie=6f263d3db265e688 in_seq=0 out_seq=0 2024-08-20T01:30:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.710+0000 7f9ebd7fa640 10 client.15336 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:30:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.710+0000 7f9ebd7fa640 1 -- 172.21.15.22:0/2412509356 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d3df4a890 con 0x563d3dfee940 2024-08-20T01:30:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.710+0000 7f9ebd7fa640 10 client.15336 handle_command_reply: tid=0 2024-08-20T01:30:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.710+0000 7f9ede0b6740 1 client.15336 shutdown 2024-08-20T01:30:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.711+0000 7f9ede0b6740 1 -- 172.21.15.22:0/2412509356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfdec60 msgr2=0x563d3dfdc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.711+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/2412509356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfdec60 0x563d3dfdc6b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc018e90 tx=0x7f9ecc012040 comp rx=0 tx=0).stop 2024-08-20T01:30:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.711+0000 7f9ede0b6740 1 -- 172.21.15.22:0/2412509356 shutdown_connections 2024-08-20T01:30:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.711+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/2412509356 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563d3dfee940 0x563d3dff0d30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.711+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/2412509356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfdec60 0x563d3dfdc6b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.711+0000 7f9ebd7fa640 0 client.15336 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:30:59.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.711+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/2412509356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfd2cd0 0x563d3dfdc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.711+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/2412509356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfd23b0 0x563d3dfdbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.711+0000 7f9ede0b6740 1 -- 172.21.15.22:0/2412509356 >> 172.21.15.22:0/2412509356 conn(0x563d3dfd01e0 msgr2=0x563d3dfd5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:59.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.711+0000 7f9ede0b6740 1 -- 172.21.15.22:0/2412509356 shutdown_connections 2024-08-20T01:30:59.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.711+0000 7f9ede0b6740 1 -- 172.21.15.22:0/2412509356 wait complete. 2024-08-20T01:30:59.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.711+0000 7f9ede0b6740 20 client.15336 trim_cache size 0 max 16384 2024-08-20T01:30:59.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.728+0000 7f9ede0b6740 1 Processor -- start 2024-08-20T01:30:59.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.728+0000 7f9ede0b6740 1 -- start start 2024-08-20T01:30:59.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9ede0b6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfd23b0 0x563d3dfcf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:59.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9ede0b6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd2cd0 0x563d3dfd6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:59.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9ede0b6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfdec60 0x563d3dff6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:59.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9ede0b6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed41b2c30 con 0x563d3dfd2cd0 2024-08-20T01:30:59.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9ede0b6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed41b0500 con 0x563d3dfdec60 2024-08-20T01:30:59.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9ede0b6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed41ae350 con 0x563d3dfd23b0 2024-08-20T01:30:59.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9ed9258640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd2cd0 0x563d3dfd6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:59.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9ed9258640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd2cd0 0x563d3dfd6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55474/0 (socket says 172.21.15.22:55474) 2024-08-20T01:30:59.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9ed9258640 1 -- 172.21.15.22:0/4235044250 learned_addr learned my addr 172.21.15.22:0/4235044250 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:59.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9eda25a640 1 --2- 172.21.15.22:0/4235044250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfdec60 0x563d3dff6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:59.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9ed9258640 1 -- 172.21.15.22:0/4235044250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfd23b0 msgr2=0x563d3dfcf5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:30:59.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9ed9258640 1 --2- 172.21.15.22:0/4235044250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfd23b0 0x563d3dfcf5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9ed9258640 1 -- 172.21.15.22:0/4235044250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfdec60 msgr2=0x563d3dff6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:59.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9ed9258640 1 --2- 172.21.15.22:0/4235044250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfdec60 0x563d3dff6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9ed9258640 1 -- 172.21.15.22:0/4235044250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d3dfd0010 con 0x563d3dfd2cd0 2024-08-20T01:30:59.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9eda25a640 1 --2- 172.21.15.22:0/4235044250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfdec60 0x563d3dff6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:30:59.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9ed9258640 1 --2- 172.21.15.22:0/4235044250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd2cd0 0x563d3dfd6570 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4009900 tx=0x7f9ec4031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44cb6ddcfc07260c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:59.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9ebf7fe640 1 -- 172.21.15.22:0/4235044250 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4035040 con 0x563d3dfd2cd0 2024-08-20T01:30:59.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9ebf7fe640 1 -- 172.21.15.22:0/4235044250 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ec4004400 con 0x563d3dfd2cd0 2024-08-20T01:30:59.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.729+0000 7f9ebf7fe640 1 -- 172.21.15.22:0/4235044250 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4032510 con 0x563d3dfd2cd0 2024-08-20T01:30:59.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.730+0000 7f9ede0b6740 1 -- 172.21.15.22:0/4235044250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd2cd0 msgr2=0x563d3dfd6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:59.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.730+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/4235044250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd2cd0 0x563d3dfd6570 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4009900 tx=0x7f9ec4031400 comp rx=0 tx=0).stop 2024-08-20T01:30:59.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.730+0000 7f9ede0b6740 1 -- 172.21.15.22:0/4235044250 shutdown_connections 2024-08-20T01:30:59.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.730+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/4235044250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfdec60 0x563d3dff6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.730+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/4235044250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd2cd0 0x563d3dfd6570 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.730+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/4235044250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfd23b0 0x563d3dfcf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.730+0000 7f9ede0b6740 1 -- 172.21.15.22:0/4235044250 >> 172.21.15.22:0/4235044250 conn(0x563d3dfd01e0 msgr2=0x563d3dfdc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:59.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.730+0000 7f9ede0b6740 1 -- 172.21.15.22:0/4235044250 shutdown_connections 2024-08-20T01:30:59.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.730+0000 7f9ede0b6740 1 -- 172.21.15.22:0/4235044250 wait complete. 2024-08-20T01:30:59.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.730+0000 7f9ede0b6740 1 -- start start 2024-08-20T01:30:59.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.731+0000 7f9ede0b6740 1 Processor -- start 2024-08-20T01:30:59.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.731+0000 7f9ede0b6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd23b0 0x563d3dfe2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:59.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.731+0000 7f9ede0b6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfd2cd0 0x563d3dfe3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:59.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.731+0000 7f9ede0b6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfdec60 0x563d3e0582f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:59.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.731+0000 7f9ede0b6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed41ae9c0 con 0x563d3dfd23b0 2024-08-20T01:30:59.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.731+0000 7f9ede0b6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed41afe30 con 0x563d3dfdec60 2024-08-20T01:30:59.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.731+0000 7f9ede0b6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed41af090 con 0x563d3dfd2cd0 2024-08-20T01:30:59.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.731+0000 7f9ede0b6740 10 client.0 _ll_register_callbacks cb 0x7f9ecc007d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:30:59.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.731+0000 7f9eda25a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd23b0 0x563d3dfe2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:59.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.731+0000 7f9eda25a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd23b0 0x563d3dfe2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55480/0 (socket says 172.21.15.22:55480) 2024-08-20T01:30:59.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.731+0000 7f9eda25a640 1 -- 172.21.15.22:0/2022473678 learned_addr learned my addr 172.21.15.22:0/2022473678 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:30:59.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.731+0000 7f9eda25a640 1 --2- 172.21.15.22:0/2022473678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfdec60 0x563d3e0582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:59.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.731+0000 7f9ed9258640 1 --2- 172.21.15.22:0/2022473678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfd2cd0 0x563d3dfe3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:59.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.731+0000 7f9eda25a640 1 -- 172.21.15.22:0/2022473678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfd2cd0 msgr2=0x563d3dfe3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:59.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.731+0000 7f9eda25a640 1 --2- 172.21.15.22:0/2022473678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfd2cd0 0x563d3dfe3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.731+0000 7f9eda25a640 1 -- 172.21.15.22:0/2022473678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfdec60 msgr2=0x563d3e0582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:30:59.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.731+0000 7f9eda25a640 1 --2- 172.21.15.22:0/2022473678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfdec60 0x563d3e0582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.731+0000 7f9eda25a640 1 -- 172.21.15.22:0/2022473678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d3dfdcad0 con 0x563d3dfd23b0 2024-08-20T01:30:59.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.731+0000 7f9ed9258640 1 --2- 172.21.15.22:0/2022473678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfd2cd0 0x563d3dfe3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:30:59.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.732+0000 7f9eda25a640 1 --2- 172.21.15.22:0/2022473678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd23b0 0x563d3dfe2ed0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc010700 tx=0x7f9ecc007520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e78c27dfa74e8e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:59.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.732+0000 7f9ebd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:30:59.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.732+0000 7f9ebd7fa640 1 -- 172.21.15.22:0/2022473678 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc02c040 con 0x563d3dfd23b0 2024-08-20T01:30:59.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.732+0000 7f9ede0b6740 1 -- 172.21.15.22:0/2022473678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ec4004400 con 0x563d3dfd23b0 2024-08-20T01:30:59.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.732+0000 7f9ebd7fa640 1 -- 172.21.15.22:0/2022473678 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f9ecc0108d0 con 0x563d3dfd23b0 2024-08-20T01:30:59.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.732+0000 7f9ebd7fa640 1 -- 172.21.15.22:0/2022473678 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9ecc044050 con 0x563d3dfd23b0 2024-08-20T01:30:59.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.732+0000 7f9ede0b6740 10 client.15342 fetch_fsmap learned FSMap version 25 2024-08-20T01:30:59.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.732+0000 7f9ede0b6740 1 -- 172.21.15.22:0/2022473678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563d3dfd0c60 con 0x563d3dfd23b0 2024-08-20T01:30:59.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.732+0000 7f9ebd7fa640 1 -- 172.21.15.22:0/2022473678 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ec4004400 con 0x563d3dfd23b0 2024-08-20T01:30:59.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.732+0000 7f9ebd7fa640 1 -- 172.21.15.22:0/2022473678 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9ecc03b070 con 0x563d3dfd23b0 2024-08-20T01:30:59.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.733+0000 7f9ede0b6740 10 client.15342 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:30:59.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.733+0000 7f9ede0b6740 10 client.15342 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:30:59.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.733+0000 7f9ede0b6740 20 client.15342 populate_metadata read hostname 'smithi022' 2024-08-20T01:30:59.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.733+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/2022473678 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563d3e059de0 0x563d3e05c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:59.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.733+0000 7f9ede0b6740 4 client.15342 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:30:59.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.733+0000 7f9ede0b6740 1 -- 172.21.15.22:0/2022473678 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563d3df46330 con 0x563d3e059de0 2024-08-20T01:30:59.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.733+0000 7f9ed9258640 1 --2- 172.21.15.22:0/2022473678 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563d3e059de0 0x563d3e05c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:59.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.733+0000 7f9ebd7fa640 10 client.15342 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:30:59.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.733+0000 7f9ed9258640 1 --2- 172.21.15.22:0/2022473678 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563d3e059de0 0x563d3e05c200 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dca64024dae4ec84 server_cookie=454d17f17b8acdfe in_seq=0 out_seq=0 2024-08-20T01:30:59.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.734+0000 7f9ebd7fa640 1 -- 172.21.15.22:0/2022473678 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563d3df46330 con 0x563d3e059de0 2024-08-20T01:30:59.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.734+0000 7f9ebd7fa640 10 client.15342 handle_command_reply: tid=0 2024-08-20T01:30:59.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.734+0000 7f9ede0b6740 1 client.15342 shutdown 2024-08-20T01:30:59.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.735+0000 7f9ede0b6740 1 -- 172.21.15.22:0/2022473678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd23b0 msgr2=0x563d3dfe2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:59.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.735+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/2022473678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd23b0 0x563d3dfe2ed0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc010700 tx=0x7f9ecc007520 comp rx=0 tx=0).stop 2024-08-20T01:30:59.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.735+0000 7f9ede0b6740 1 -- 172.21.15.22:0/2022473678 shutdown_connections 2024-08-20T01:30:59.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.735+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/2022473678 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563d3e059de0 0x563d3e05c200 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.735+0000 7f9ebd7fa640 0 client.15342 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:30:59.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.735+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/2022473678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d3dfdec60 0x563d3e0582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.735+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/2022473678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d3dfd2cd0 0x563d3dfe3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.735+0000 7f9ede0b6740 1 --2- 172.21.15.22:0/2022473678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d3dfd23b0 0x563d3dfe2ed0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.735+0000 7f9ede0b6740 1 -- 172.21.15.22:0/2022473678 >> 172.21.15.22:0/2022473678 conn(0x563d3dfd01e0 msgr2=0x563d3dfe9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:59.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.735+0000 7f9ede0b6740 1 -- 172.21.15.22:0/2022473678 shutdown_connections 2024-08-20T01:30:59.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.735+0000 7f9ede0b6740 1 -- 172.21.15.22:0/2022473678 wait complete. 2024-08-20T01:30:59.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.735+0000 7f9ede0b6740 20 client.15342 trim_cache size 0 max 16384 2024-08-20T01:30:59.741 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:30:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-08-20T01:30:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "2c8c7a7f-c038-4c16-98b2-a8f7e41f3f68", 2024-08-20T01:30:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-08-20T01:30:59.741 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:30:59.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.736+0000 7f9edbcbd640 1 -- 172.21.15.22:0/392537266 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9ec00b3bd0 msgr2=0x7f9ec00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:59.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.736+0000 7f9edbcbd640 1 --2- 172.21.15.22:0/392537266 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9ec00b3bd0 0x7f9ec00b6090 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00e1b10 tx=0x7f9ed0000bc0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.736+0000 7f9edbcbd640 1 -- 172.21.15.22:0/392537266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ed41039a0 msgr2=0x7f9ed4101650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:59.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.736+0000 7f9edbcbd640 1 --2- 172.21.15.22:0/392537266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ed41039a0 0x7f9ed4101650 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000c920 tx=0x7f9ed000cde0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.736+0000 7f9edbcbd640 1 -- 172.21.15.22:0/392537266 shutdown_connections 2024-08-20T01:30:59.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.736+0000 7f9edbcbd640 1 --2- 172.21.15.22:0/392537266 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9ec00b3bd0 0x7f9ec00b6090 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.736+0000 7f9edbcbd640 1 --2- 172.21.15.22:0/392537266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ed410ce00 0x7f9ed41020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.736+0000 7f9edbcbd640 1 --2- 172.21.15.22:0/392537266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed41042c0 0x7f9ed4101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.736+0000 7f9edbcbd640 1 --2- 172.21.15.22:0/392537266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ed41039a0 0x7f9ed4101650 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:59.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.736+0000 7f9edbcbd640 1 -- 172.21.15.22:0/392537266 >> 172.21.15.22:0/392537266 conn(0x7f9ed40fd400 msgr2=0x7f9ed40fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:59.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.736+0000 7f9edbcbd640 1 -- 172.21.15.22:0/392537266 shutdown_connections 2024-08-20T01:30:59.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:30:59.736+0000 7f9edbcbd640 1 -- 172.21.15.22:0/392537266 wait complete. 2024-08-20T01:31:00.491 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:31:00.791 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:31:00.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:00 smithi077 ceph-mon[22251]: pgmap v342: 97 pgs: 1 peering, 96 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-08-20T01:31:00.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:00 smithi077 ceph-mon[22251]: scrub queued for path: / 2024-08-20T01:31:00.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:00 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:31:00.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:00 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:31:00.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:00 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:31:00.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:00 smithi022 ceph-mon[18709]: pgmap v342: 97 pgs: 1 peering, 96 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-08-20T01:31:00.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:00 smithi022 ceph-mon[18709]: scrub queued for path: / 2024-08-20T01:31:00.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:00 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:31:00.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:00 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:31:00.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:00 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:31:01.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:00 smithi134 ceph-mon[22511]: pgmap v342: 97 pgs: 1 peering, 96 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-08-20T01:31:01.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:00 smithi134 ceph-mon[22511]: scrub queued for path: / 2024-08-20T01:31:01.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:00 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:31:01.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:00 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:31:01.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:00 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:31:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.316+0000 7fa97e2f5640 1 -- 172.21.15.22:0/3912184212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9781039e0 msgr2=0x7fa978103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.316+0000 7fa97e2f5640 1 --2- 172.21.15.22:0/3912184212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9781039e0 0x7fa978103dc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa968009900 tx=0x7fa96802a410 comp rx=0 tx=0).stop 2024-08-20T01:31:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.316+0000 7fa97e2f5640 1 -- 172.21.15.22:0/3912184212 shutdown_connections 2024-08-20T01:31:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.317+0000 7fa97e2f5640 1 --2- 172.21.15.22:0/3912184212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa97810ce40 0x7fa97810f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.317+0000 7fa97e2f5640 1 --2- 172.21.15.22:0/3912184212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa978104300 0x7fa97810c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.317+0000 7fa97e2f5640 1 --2- 172.21.15.22:0/3912184212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9781039e0 0x7fa978103dc0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.317+0000 7fa97e2f5640 1 -- 172.21.15.22:0/3912184212 >> 172.21.15.22:0/3912184212 conn(0x7fa9780fd440 msgr2=0x7fa9780ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.317+0000 7fa97e2f5640 1 -- 172.21.15.22:0/3912184212 shutdown_connections 2024-08-20T01:31:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.317+0000 7fa97e2f5640 1 -- 172.21.15.22:0/3912184212 wait complete. 2024-08-20T01:31:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.317+0000 7fa97e2f5640 1 Processor -- start 2024-08-20T01:31:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.317+0000 7fa97e2f5640 1 -- start start 2024-08-20T01:31:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.318+0000 7fa97e2f5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9781039e0 0x7fa978198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.318+0000 7fa97e2f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa978104300 0x7fa9781994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.318+0000 7fa97e2f5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa97810ce40 0x7fa97819e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.318+0000 7fa97e2f5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa978112ab0 con 0x7fa97810ce40 2024-08-20T01:31:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.318+0000 7fa97e2f5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa978112930 con 0x7fa9781039e0 2024-08-20T01:31:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.318+0000 7fa97e2f5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa978112c30 con 0x7fa978104300 2024-08-20T01:31:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.318+0000 7fa97c892640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa97810ce40 0x7fa97819e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.318+0000 7fa97c892640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa97810ce40 0x7fa97819e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55494/0 (socket says 172.21.15.22:55494) 2024-08-20T01:31:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.318+0000 7fa97c892640 1 -- 172.21.15.22:0/1418417995 learned_addr learned my addr 172.21.15.22:0/1418417995 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.318+0000 7fa977fff640 1 --2- 172.21.15.22:0/1418417995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9781039e0 0x7fa978198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.318+0000 7fa9777fe640 1 --2- 172.21.15.22:0/1418417995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa978104300 0x7fa9781994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.318+0000 7fa97c892640 1 -- 172.21.15.22:0/1418417995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa978104300 msgr2=0x7fa9781994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.318+0000 7fa97c892640 1 --2- 172.21.15.22:0/1418417995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa978104300 0x7fa9781994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.318+0000 7fa97c892640 1 -- 172.21.15.22:0/1418417995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9781039e0 msgr2=0x7fa978198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.318+0000 7fa97c892640 1 --2- 172.21.15.22:0/1418417995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9781039e0 0x7fa978198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.318+0000 7fa97c892640 1 -- 172.21.15.22:0/1418417995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97819f050 con 0x7fa97810ce40 2024-08-20T01:31:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.319+0000 7fa97c892640 1 --2- 172.21.15.22:0/1418417995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa97810ce40 0x7fa97819e880 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa97000cce0 tx=0x7fa97000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.319+0000 7fa9757fa640 1 -- 172.21.15.22:0/1418417995 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97000f450 con 0x7fa97810ce40 2024-08-20T01:31:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.319+0000 7fa97e2f5640 1 -- 172.21.15.22:0/1418417995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa97819f340 con 0x7fa97810ce40 2024-08-20T01:31:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.319+0000 7fa9757fa640 1 -- 172.21.15.22:0/1418417995 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa97000faa0 con 0x7fa97810ce40 2024-08-20T01:31:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.319+0000 7fa9757fa640 1 -- 172.21.15.22:0/1418417995 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa970018b70 con 0x7fa97810ce40 2024-08-20T01:31:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.319+0000 7fa97e2f5640 1 -- 172.21.15.22:0/1418417995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9781a5a00 con 0x7fa97810ce40 2024-08-20T01:31:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.321+0000 7fa9757fa640 1 -- 172.21.15.22:0/1418417995 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa970018d10 con 0x7fa97810ce40 2024-08-20T01:31:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.321+0000 7fa9806ee740 1 Processor -- start 2024-08-20T01:31:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.321+0000 7fa9806ee740 1 -- start start 2024-08-20T01:31:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa9806ee740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d746064830 0x55d746064c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa9806ee740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d746065150 0x55d746074fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa9806ee740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7460754f0 0x55d7460778e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa9806ee740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d745fdb8e0 con 0x55d7460754f0 2024-08-20T01:31:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa9806ee740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d745fcade0 con 0x55d746064830 2024-08-20T01:31:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa9806ee740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d745fcee20 con 0x55d746065150 2024-08-20T01:31:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa9777fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7460754f0 0x55d7460778e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa9777fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7460754f0 0x55d7460778e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55502/0 (socket says 172.21.15.22:55502) 2024-08-20T01:31:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa9777fe640 1 -- 172.21.15.22:0/465429031 learned_addr learned my addr 172.21.15.22:0/465429031 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa9777fe640 1 --2- 172.21.15.22:0/465429031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d746064830 0x55d746064c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa977fff640 1 --2- 172.21.15.22:0/465429031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d746065150 0x55d746074fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa9777fe640 1 -- 172.21.15.22:0/465429031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d746065150 msgr2=0x55d746074fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa9777fe640 1 --2- 172.21.15.22:0/465429031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d746065150 0x55d746074fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa9777fe640 1 -- 172.21.15.22:0/465429031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d746064830 msgr2=0x55d746064c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:01.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa9777fe640 1 --2- 172.21.15.22:0/465429031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d746064830 0x55d746064c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa9777fe640 1 -- 172.21.15.22:0/465429031 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d745d2a650 con 0x55d7460754f0 2024-08-20T01:31:01.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa9777fe640 1 --2- 172.21.15.22:0/465429031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7460754f0 0x55d7460778e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00bec0 tx=0x7fa96c005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b40adfef9c105b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:01.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa9757fa640 1 --2- 172.21.15.22:0/1418417995 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa9600b3bd0 0x7fa9600b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:01.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa977fff640 1 --2- 172.21.15.22:0/1418417995 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa9600b3bd0 0x7fa9600b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:01.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa95e7fc640 1 -- 172.21.15.22:0/465429031 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c005020 con 0x55d7460754f0 2024-08-20T01:31:01.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa95e7fc640 1 -- 172.21.15.22:0/465429031 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa96c0047a0 con 0x55d7460754f0 2024-08-20T01:31:01.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.322+0000 7fa95e7fc640 1 -- 172.21.15.22:0/465429031 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0106c0 con 0x55d7460754f0 2024-08-20T01:31:01.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.323+0000 7fa9757fa640 1 -- 172.21.15.22:0/1418417995 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fa9700e3fd0 con 0x7fa97810ce40 2024-08-20T01:31:01.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.323+0000 7fa9806ee740 1 -- 172.21.15.22:0/465429031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7460754f0 msgr2=0x55d7460778e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:01.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.323+0000 7fa977fff640 1 --2- 172.21.15.22:0/1418417995 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa9600b3bd0 0x7fa9600b6090 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa968031440 tx=0x7fa968005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:01.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.323+0000 7fa9806ee740 1 --2- 172.21.15.22:0/465429031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7460754f0 0x55d7460778e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00bec0 tx=0x7fa96c005c90 comp rx=0 tx=0).stop 2024-08-20T01:31:01.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.323+0000 7fa9806ee740 1 -- 172.21.15.22:0/465429031 shutdown_connections 2024-08-20T01:31:01.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.323+0000 7fa9806ee740 1 --2- 172.21.15.22:0/465429031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7460754f0 0x55d7460778e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.323+0000 7fa9806ee740 1 --2- 172.21.15.22:0/465429031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d746065150 0x55d746074fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.323+0000 7fa9806ee740 1 --2- 172.21.15.22:0/465429031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d746064830 0x55d746064c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.323+0000 7fa9806ee740 1 -- 172.21.15.22:0/465429031 >> 172.21.15.22:0/465429031 conn(0x55d746062660 msgr2=0x55d746063800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:01.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.323+0000 7fa9806ee740 1 -- 172.21.15.22:0/465429031 shutdown_connections 2024-08-20T01:31:01.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.323+0000 7fa9806ee740 1 -- 172.21.15.22:0/465429031 wait complete. 2024-08-20T01:31:01.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.324+0000 7fa9806ee740 1 -- start start 2024-08-20T01:31:01.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.324+0000 7fa9806ee740 1 Processor -- start 2024-08-20T01:31:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.324+0000 7fa9806ee740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746064830 0x55d7460724d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.324+0000 7fa9806ee740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d746065150 0x55d746072a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.324+0000 7fa9806ee740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7460754f0 0x55d746072f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.324+0000 7fa9806ee740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d745e2d700 con 0x55d746064830 2024-08-20T01:31:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.324+0000 7fa9806ee740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d745f517c0 con 0x55d7460754f0 2024-08-20T01:31:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.324+0000 7fa9806ee740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d7460781a0 con 0x55d746065150 2024-08-20T01:31:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.324+0000 7fa9806ee740 10 client.0 _ll_register_callbacks cb 0x55d745fc46b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.325+0000 7fa977fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746064830 0x55d7460724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.325+0000 7fa977fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746064830 0x55d7460724d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55514/0 (socket says 172.21.15.22:55514) 2024-08-20T01:31:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.325+0000 7fa977fff640 1 -- 172.21.15.22:0/2288754373 learned_addr learned my addr 172.21.15.22:0/2288754373 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.325+0000 7fa9777fe640 1 --2- 172.21.15.22:0/2288754373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d746065150 0x55d746072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.325+0000 7fa97c892640 1 --2- 172.21.15.22:0/2288754373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7460754f0 0x55d746072f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.325+0000 7fa977fff640 1 -- 172.21.15.22:0/2288754373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d746065150 msgr2=0x55d746072a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.325+0000 7fa977fff640 1 --2- 172.21.15.22:0/2288754373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d746065150 0x55d746072a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.325+0000 7fa977fff640 1 -- 172.21.15.22:0/2288754373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7460754f0 msgr2=0x55d746072f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.325+0000 7fa977fff640 1 --2- 172.21.15.22:0/2288754373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7460754f0 0x55d746072f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.325+0000 7fa977fff640 1 -- 172.21.15.22:0/2288754373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7460815d0 con 0x55d746064830 2024-08-20T01:31:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.325+0000 7fa9777fe640 1 --2- 172.21.15.22:0/2288754373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d746065150 0x55d746072a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:31:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.325+0000 7fa977fff640 1 --2- 172.21.15.22:0/2288754373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746064830 0x55d7460724d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa968031720 tx=0x7fa96802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7536990c521b6397 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.325+0000 7fa9577fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:31:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.325+0000 7fa9577fe640 1 -- 172.21.15.22:0/2288754373 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96804c020 con 0x55d746064830 2024-08-20T01:31:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.325+0000 7fa9577fe640 1 -- 172.21.15.22:0/2288754373 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fa968004250 con 0x55d746064830 2024-08-20T01:31:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.325+0000 7fa9806ee740 1 -- 172.21.15.22:0/2288754373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d745f7a100 con 0x55d746064830 2024-08-20T01:31:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.326+0000 7fa9577fe640 1 -- 172.21.15.22:0/2288754373 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa968057050 con 0x55d746064830 2024-08-20T01:31:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.326+0000 7fa9806ee740 10 client.15354 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.326+0000 7fa9806ee740 1 -- 172.21.15.22:0/2288754373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d746083f80 con 0x55d746064830 2024-08-20T01:31:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.326+0000 7fa9577fe640 1 -- 172.21.15.22:0/2288754373 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d745f7a100 con 0x55d746064830 2024-08-20T01:31:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.326+0000 7fa9577fe640 1 -- 172.21.15.22:0/2288754373 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa968004ac0 con 0x55d746064830 2024-08-20T01:31:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.326+0000 7fa9806ee740 10 client.15354 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.326+0000 7fa9806ee740 10 client.15354 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:31:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.326+0000 7fa9806ee740 20 client.15354 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.326+0000 7fa9806ee740 1 --2- 172.21.15.22:0/2288754373 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d746085490 0x55d746087900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.326+0000 7fa9806ee740 4 client.15354 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:31:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.326+0000 7fa9806ee740 1 -- 172.21.15.22:0/2288754373 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d745fdd830 con 0x55d746085490 2024-08-20T01:31:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.326+0000 7fa9777fe640 1 --2- 172.21.15.22:0/2288754373 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d746085490 0x55d746087900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.327+0000 7fa9777fe640 1 --2- 172.21.15.22:0/2288754373 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d746085490 0x55d746087900 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ebc82f379822eb8 server_cookie=2c5965eb90ffa95d in_seq=0 out_seq=0 2024-08-20T01:31:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.327+0000 7fa9577fe640 10 client.15354 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.328+0000 7fa9577fe640 1 -- 172.21.15.22:0/2288754373 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d745fdd830 con 0x55d746085490 2024-08-20T01:31:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.328+0000 7fa9577fe640 10 client.15354 handle_command_reply: tid=0 2024-08-20T01:31:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.328+0000 7fa9806ee740 1 client.15354 shutdown 2024-08-20T01:31:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.328+0000 7fa9806ee740 1 -- 172.21.15.22:0/2288754373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746064830 msgr2=0x55d7460724d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.328+0000 7fa9806ee740 1 --2- 172.21.15.22:0/2288754373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746064830 0x55d7460724d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa968031720 tx=0x7fa96802a410 comp rx=0 tx=0).stop 2024-08-20T01:31:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.328+0000 7fa9806ee740 1 -- 172.21.15.22:0/2288754373 shutdown_connections 2024-08-20T01:31:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.328+0000 7fa9806ee740 1 --2- 172.21.15.22:0/2288754373 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d746085490 0x55d746087900 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.328+0000 7fa9806ee740 1 --2- 172.21.15.22:0/2288754373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7460754f0 0x55d746072f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.328+0000 7fa9806ee740 1 --2- 172.21.15.22:0/2288754373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d746065150 0x55d746072a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.328+0000 7fa9806ee740 1 --2- 172.21.15.22:0/2288754373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746064830 0x55d7460724d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.328+0000 7fa9577fe640 0 client.15354 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.328+0000 7fa9806ee740 1 -- 172.21.15.22:0/2288754373 >> 172.21.15.22:0/2288754373 conn(0x55d746062660 msgr2=0x55d7460681d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.328+0000 7fa9806ee740 1 -- 172.21.15.22:0/2288754373 shutdown_connections 2024-08-20T01:31:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.328+0000 7fa9806ee740 1 -- 172.21.15.22:0/2288754373 wait complete. 2024-08-20T01:31:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.328+0000 7fa9806ee740 20 client.15354 trim_cache size 0 max 16384 2024-08-20T01:31:01.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.345+0000 7fa9806ee740 1 Processor -- start 2024-08-20T01:31:01.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.346+0000 7fa9806ee740 1 -- start start 2024-08-20T01:31:01.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.346+0000 7fa9806ee740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d746064830 0x55d746071d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:01.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.346+0000 7fa9806ee740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746065150 0x55d74606ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:01.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.346+0000 7fa9806ee740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7460754f0 0x55d746072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:01.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.346+0000 7fa9806ee740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa9781ae830 con 0x55d746065150 2024-08-20T01:31:01.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.346+0000 7fa9806ee740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa9781ac100 con 0x55d7460754f0 2024-08-20T01:31:01.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.346+0000 7fa9806ee740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa9781a9f70 con 0x55d746064830 2024-08-20T01:31:01.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.346+0000 7fa9777fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746065150 0x55d74606ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:01.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.346+0000 7fa9777fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746065150 0x55d74606ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55520/0 (socket says 172.21.15.22:55520) 2024-08-20T01:31:01.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.346+0000 7fa9777fe640 1 -- 172.21.15.22:0/363226019 learned_addr learned my addr 172.21.15.22:0/363226019 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:01.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.346+0000 7fa977fff640 1 --2- 172.21.15.22:0/363226019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d746064830 0x55d746071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:01.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.346+0000 7fa97c892640 1 --2- 172.21.15.22:0/363226019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7460754f0 0x55d746072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:01.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.346+0000 7fa9777fe640 1 -- 172.21.15.22:0/363226019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d746064830 msgr2=0x55d746071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:01.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.346+0000 7fa9777fe640 1 --2- 172.21.15.22:0/363226019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d746064830 0x55d746071d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.346+0000 7fa9777fe640 1 -- 172.21.15.22:0/363226019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7460754f0 msgr2=0x55d746072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:01.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.346+0000 7fa9777fe640 1 --2- 172.21.15.22:0/363226019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7460754f0 0x55d746072b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.346+0000 7fa9777fe640 1 -- 172.21.15.22:0/363226019 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d746074cb0 con 0x55d746065150 2024-08-20T01:31:01.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.346+0000 7fa977fff640 1 --2- 172.21.15.22:0/363226019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d746064830 0x55d746071d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:31:01.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.346+0000 7fa9777fe640 1 --2- 172.21.15.22:0/363226019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746065150 0x55d74606ff80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa96c012c50 tx=0x7fa96c00bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ccef6ed3c31558b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:01.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.347+0000 7fa95dffb640 1 -- 172.21.15.22:0/363226019 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c005240 con 0x55d746065150 2024-08-20T01:31:01.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.347+0000 7fa95dffb640 1 -- 172.21.15.22:0/363226019 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa96c004660 con 0x55d746065150 2024-08-20T01:31:01.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.347+0000 7fa95dffb640 1 -- 172.21.15.22:0/363226019 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0106a0 con 0x55d746065150 2024-08-20T01:31:01.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.347+0000 7fa9806ee740 1 -- 172.21.15.22:0/363226019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746065150 msgr2=0x55d74606ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:01.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.347+0000 7fa9806ee740 1 --2- 172.21.15.22:0/363226019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746065150 0x55d74606ff80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa96c012c50 tx=0x7fa96c00bca0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.347+0000 7fa9806ee740 1 -- 172.21.15.22:0/363226019 shutdown_connections 2024-08-20T01:31:01.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.347+0000 7fa9806ee740 1 --2- 172.21.15.22:0/363226019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7460754f0 0x55d746072b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.347+0000 7fa9806ee740 1 --2- 172.21.15.22:0/363226019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746065150 0x55d74606ff80 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.347+0000 7fa9806ee740 1 --2- 172.21.15.22:0/363226019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d746064830 0x55d746071d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.347+0000 7fa9806ee740 1 -- 172.21.15.22:0/363226019 >> 172.21.15.22:0/363226019 conn(0x55d746062660 msgr2=0x55d746072440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:01.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.347+0000 7fa9806ee740 1 -- 172.21.15.22:0/363226019 shutdown_connections 2024-08-20T01:31:01.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.347+0000 7fa9806ee740 1 -- 172.21.15.22:0/363226019 wait complete. 2024-08-20T01:31:01.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.348+0000 7fa9806ee740 1 -- start start 2024-08-20T01:31:01.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.348+0000 7fa9806ee740 1 Processor -- start 2024-08-20T01:31:01.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.348+0000 7fa9806ee740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746064830 0x55d74607dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:01.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.348+0000 7fa9806ee740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d746065150 0x55d74608cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:01.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.348+0000 7fa9806ee740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d7460754f0 0x55d74608d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:01.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.348+0000 7fa9806ee740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa9781aa5c0 con 0x55d746064830 2024-08-20T01:31:01.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.348+0000 7fa9806ee740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa9781aba30 con 0x55d746065150 2024-08-20T01:31:01.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.348+0000 7fa9806ee740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa9781aac90 con 0x55d7460754f0 2024-08-20T01:31:01.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.348+0000 7fa9806ee740 10 client.0 _ll_register_callbacks cb 0x7fa968040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:01.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.348+0000 7fa977fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746064830 0x55d74607dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:01.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.349+0000 7fa977fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746064830 0x55d74607dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55534/0 (socket says 172.21.15.22:55534) 2024-08-20T01:31:01.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.349+0000 7fa977fff640 1 -- 172.21.15.22:0/3350205573 learned_addr learned my addr 172.21.15.22:0/3350205573 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:01.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.349+0000 7fa9777fe640 1 --2- 172.21.15.22:0/3350205573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d746065150 0x55d74608cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:01.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.349+0000 7fa97c892640 1 --2- 172.21.15.22:0/3350205573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d7460754f0 0x55d74608d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:01.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.349+0000 7fa977fff640 1 -- 172.21.15.22:0/3350205573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d7460754f0 msgr2=0x55d74608d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:01.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.349+0000 7fa977fff640 1 --2- 172.21.15.22:0/3350205573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d7460754f0 0x55d74608d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.349+0000 7fa977fff640 1 -- 172.21.15.22:0/3350205573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d746065150 msgr2=0x55d74608cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:01.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.349+0000 7fa977fff640 1 --2- 172.21.15.22:0/3350205573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d746065150 0x55d74608cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.349+0000 7fa977fff640 1 -- 172.21.15.22:0/3350205573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7460ef1a0 con 0x55d746064830 2024-08-20T01:31:01.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.349+0000 7fa97c892640 1 --2- 172.21.15.22:0/3350205573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d7460754f0 0x55d74608d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:31:01.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.349+0000 7fa9777fe640 1 --2- 172.21.15.22:0/3350205573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d746065150 0x55d74608cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:31:01.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.349+0000 7fa977fff640 1 --2- 172.21.15.22:0/3350205573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746064830 0x55d74607dcb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa96802a930 tx=0x7fa9680038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650292178381f126 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:01.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.349+0000 7fa9577fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:31:01.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.349+0000 7fa9577fe640 1 -- 172.21.15.22:0/3350205573 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96805f070 con 0x55d746064830 2024-08-20T01:31:01.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.349+0000 7fa9577fe640 1 -- 172.21.15.22:0/3350205573 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fa968003b10 con 0x55d746064830 2024-08-20T01:31:01.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.349+0000 7fa9806ee740 1 -- 172.21.15.22:0/3350205573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa96c004660 con 0x55d746064830 2024-08-20T01:31:01.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.349+0000 7fa9577fe640 1 -- 172.21.15.22:0/3350205573 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa96806b050 con 0x55d746064830 2024-08-20T01:31:01.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.349+0000 7fa9806ee740 10 client.15360 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:01.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.349+0000 7fa9806ee740 1 -- 172.21.15.22:0/3350205573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d7460f03f0 con 0x55d746064830 2024-08-20T01:31:01.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.350+0000 7fa9577fe640 1 -- 172.21.15.22:0/3350205573 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa96c004660 con 0x55d746064830 2024-08-20T01:31:01.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.350+0000 7fa9577fe640 1 -- 172.21.15.22:0/3350205573 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa968005090 con 0x55d746064830 2024-08-20T01:31:01.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.350+0000 7fa9806ee740 10 client.15360 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:01.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.350+0000 7fa9806ee740 10 client.15360 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:31:01.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.350+0000 7fa9806ee740 20 client.15360 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:01.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.350+0000 7fa9806ee740 1 --2- 172.21.15.22:0/3350205573 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d7460f0ba0 0x55d7460f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:01.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.350+0000 7fa9806ee740 4 client.15360 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:31:01.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.350+0000 7fa9806ee740 1 -- 172.21.15.22:0/3350205573 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d745fd92d0 con 0x55d7460f0ba0 2024-08-20T01:31:01.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.350+0000 7fa9777fe640 1 --2- 172.21.15.22:0/3350205573 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d7460f0ba0 0x55d7460f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:01.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.351+0000 7fa9777fe640 1 --2- 172.21.15.22:0/3350205573 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d7460f0ba0 0x55d7460f2fc0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=561c7b20f73ed977 server_cookie=15d47b9c8aad28c8 in_seq=0 out_seq=0 2024-08-20T01:31:01.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.351+0000 7fa9577fe640 10 client.15360 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:01.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.351+0000 7fa9577fe640 1 -- 172.21.15.22:0/3350205573 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d745fd92d0 con 0x55d7460f0ba0 2024-08-20T01:31:01.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.351+0000 7fa9577fe640 10 client.15360 handle_command_reply: tid=0 2024-08-20T01:31:01.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.351+0000 7fa9806ee740 1 client.15360 shutdown 2024-08-20T01:31:01.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.351+0000 7fa9806ee740 1 -- 172.21.15.22:0/3350205573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746064830 msgr2=0x55d74607dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:01.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.351+0000 7fa9806ee740 1 --2- 172.21.15.22:0/3350205573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746064830 0x55d74607dcb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa96802a930 tx=0x7fa9680038a0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.351+0000 7fa9806ee740 1 -- 172.21.15.22:0/3350205573 shutdown_connections 2024-08-20T01:31:01.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.351+0000 7fa9806ee740 1 --2- 172.21.15.22:0/3350205573 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d7460f0ba0 0x55d7460f2fc0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.351+0000 7fa9806ee740 1 --2- 172.21.15.22:0/3350205573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d7460754f0 0x55d74608d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.351+0000 7fa9806ee740 1 --2- 172.21.15.22:0/3350205573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d746065150 0x55d74608cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.351+0000 7fa9577fe640 0 client.15360 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:01.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.351+0000 7fa9806ee740 1 --2- 172.21.15.22:0/3350205573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d746064830 0x55d74607dcb0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.351+0000 7fa9806ee740 1 -- 172.21.15.22:0/3350205573 >> 172.21.15.22:0/3350205573 conn(0x55d746062660 msgr2=0x55d746061720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:01.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.351+0000 7fa9806ee740 1 -- 172.21.15.22:0/3350205573 shutdown_connections 2024-08-20T01:31:01.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.351+0000 7fa9806ee740 1 -- 172.21.15.22:0/3350205573 wait complete. 2024-08-20T01:31:01.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.351+0000 7fa9806ee740 20 client.15360 trim_cache size 0 max 16384 2024-08-20T01:31:01.358 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:31:01.358 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:31:01.358 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-08-20T01:31:01.358 INFO:teuthology.orchestra.run.smithi022.stdout: "2c8c7a7f-c038-4c16-98b2-a8f7e41f3f68": { 2024-08-20T01:31:01.358 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-08-20T01:31:01.358 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "2c8c7a7f-c038-4c16-98b2-a8f7e41f3f68", 2024-08-20T01:31:01.358 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-08-20T01:31:01.358 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:31:01.358 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:31:01.358 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:31:01.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.352+0000 7fa97e2f5640 1 -- 172.21.15.22:0/1418417995 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa9600b3bd0 msgr2=0x7fa9600b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:01.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.352+0000 7fa97e2f5640 1 --2- 172.21.15.22:0/1418417995 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa9600b3bd0 0x7fa9600b6090 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa968031440 tx=0x7fa968005b50 comp rx=0 tx=0).stop 2024-08-20T01:31:01.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.352+0000 7fa97e2f5640 1 -- 172.21.15.22:0/1418417995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa97810ce40 msgr2=0x7fa97819e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:01.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.352+0000 7fa97e2f5640 1 --2- 172.21.15.22:0/1418417995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa97810ce40 0x7fa97819e880 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa97000cce0 tx=0x7fa97000a620 comp rx=0 tx=0).stop 2024-08-20T01:31:01.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.352+0000 7fa97e2f5640 1 -- 172.21.15.22:0/1418417995 shutdown_connections 2024-08-20T01:31:01.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.352+0000 7fa97e2f5640 1 --2- 172.21.15.22:0/1418417995 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa9600b3bd0 0x7fa9600b6090 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.352+0000 7fa97e2f5640 1 --2- 172.21.15.22:0/1418417995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa97810ce40 0x7fa97819e880 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.352+0000 7fa97e2f5640 1 --2- 172.21.15.22:0/1418417995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa978104300 0x7fa9781994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.352+0000 7fa97e2f5640 1 --2- 172.21.15.22:0/1418417995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9781039e0 0x7fa978198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:01.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.352+0000 7fa97e2f5640 1 -- 172.21.15.22:0/1418417995 >> 172.21.15.22:0/1418417995 conn(0x7fa9780fd440 msgr2=0x7fa97810f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:01.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.352+0000 7fa97e2f5640 1 -- 172.21.15.22:0/1418417995 shutdown_connections 2024-08-20T01:31:01.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:01.352+0000 7fa97e2f5640 1 -- 172.21.15.22:0/1418417995 wait complete. 2024-08-20T01:31:01.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:01 smithi022 ceph-mon[18709]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-08-20T01:31:01.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:01 smithi022 ceph-mon[18709]: Cluster is now healthy 2024-08-20T01:31:02.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:01 smithi134 ceph-mon[22511]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-08-20T01:31:02.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:01 smithi134 ceph-mon[22511]: Cluster is now healthy 2024-08-20T01:31:02.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:01 smithi077 ceph-mon[22251]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-08-20T01:31:02.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:01 smithi077 ceph-mon[22251]: Cluster is now healthy 2024-08-20T01:31:02.373 INFO:tasks.cephfs.filesystem:scrub status for tag:2c8c7a7f-c038-4c16-98b2-a8f7e41f3f68 - {'path': '/', 'tag': '2c8c7a7f-c038-4c16-98b2-a8f7e41f3f68', 'options': 'recursive,force'} 2024-08-20T01:31:02.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:02 smithi022 ceph-mon[18709]: pgmap v343: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-08-20T01:31:03.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:02 smithi134 ceph-mon[22511]: pgmap v343: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-08-20T01:31:03.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:02 smithi077 ceph-mon[22251]: pgmap v343: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-08-20T01:31:04.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:04 smithi022 ceph-mon[18709]: pgmap v344: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-08-20T01:31:05.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:04 smithi134 ceph-mon[22511]: pgmap v344: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-08-20T01:31:05.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:04 smithi077 ceph-mon[22251]: pgmap v344: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-08-20T01:31:06.586 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:06 smithi022 ceph-mon[18709]: pgmap v345: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-08-20T01:31:07.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:06 smithi134 ceph-mon[22511]: pgmap v345: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-08-20T01:31:07.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:06 smithi077 ceph-mon[22251]: pgmap v345: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-08-20T01:31:08.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:08 smithi022 ceph-mon[18709]: pgmap v346: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 663 B/s wr, 6 op/s 2024-08-20T01:31:09.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:08 smithi134 ceph-mon[22511]: pgmap v346: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 663 B/s wr, 6 op/s 2024-08-20T01:31:09.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:08 smithi077 ceph-mon[22251]: pgmap v346: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 663 B/s wr, 6 op/s 2024-08-20T01:31:10.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:10 smithi022 ceph-mon[18709]: pgmap v347: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-20T01:31:11.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:10 smithi134 ceph-mon[22511]: pgmap v347: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-20T01:31:11.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:10 smithi077 ceph-mon[22251]: pgmap v347: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-20T01:31:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.074+0000 7f6e0290f640 1 -- 172.21.15.22:0/110611238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dfc1026b0 msgr2=0x7f6dfc102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.074+0000 7f6e0290f640 1 --2- 172.21.15.22:0/110611238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dfc1026b0 0x7f6dfc102b30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009930 tx=0x7f6df002a420 comp rx=0 tx=0).stop 2024-08-20T01:31:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.074+0000 7f6e0290f640 1 -- 172.21.15.22:0/110611238 shutdown_connections 2024-08-20T01:31:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.074+0000 7f6e0290f640 1 --2- 172.21.15.22:0/110611238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dfc103070 0x7f6dfc1099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.074+0000 7f6e0290f640 1 --2- 172.21.15.22:0/110611238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dfc1026b0 0x7f6dfc102b30 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.074+0000 7f6e0290f640 1 --2- 172.21.15.22:0/110611238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6dfc101560 0x7f6dfc101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.074+0000 7f6e0290f640 1 -- 172.21.15.22:0/110611238 >> 172.21.15.22:0/110611238 conn(0x7f6dfc0fce40 msgr2=0x7f6dfc0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.074+0000 7f6e0290f640 1 -- 172.21.15.22:0/110611238 shutdown_connections 2024-08-20T01:31:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.074+0000 7f6e0290f640 1 -- 172.21.15.22:0/110611238 wait complete. 2024-08-20T01:31:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.075+0000 7f6e0290f640 1 Processor -- start 2024-08-20T01:31:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.075+0000 7f6e0290f640 1 -- start start 2024-08-20T01:31:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.075+0000 7f6e0290f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dfc101560 0x7f6dfc06aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.075+0000 7f6e0290f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dfc1026b0 0x7f6dfc19d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.075+0000 7f6e0290f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6dfc103070 0x7f6dfc19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.075+0000 7f6e0290f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc10d1d0 con 0x7f6dfc101560 2024-08-20T01:31:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.075+0000 7f6e0290f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc10d050 con 0x7f6dfc103070 2024-08-20T01:31:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.075+0000 7f6e0290f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc10d350 con 0x7f6dfc1026b0 2024-08-20T01:31:12.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.075+0000 7f6dfbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dfc101560 0x7f6dfc06aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:12.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.075+0000 7f6dfbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dfc101560 0x7f6dfc06aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38496/0 (socket says 172.21.15.22:38496) 2024-08-20T01:31:12.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.075+0000 7f6dfbfff640 1 -- 172.21.15.22:0/2656992690 learned_addr learned my addr 172.21.15.22:0/2656992690 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:12.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.075+0000 7f6dfb7fe640 1 --2- 172.21.15.22:0/2656992690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dfc1026b0 0x7f6dfc19d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:12.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.075+0000 7f6e00eac640 1 --2- 172.21.15.22:0/2656992690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6dfc103070 0x7f6dfc19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:12.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.076+0000 7f6dfbfff640 1 -- 172.21.15.22:0/2656992690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dfc1026b0 msgr2=0x7f6dfc19d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:12.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.076+0000 7f6dfbfff640 1 --2- 172.21.15.22:0/2656992690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dfc1026b0 0x7f6dfc19d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.076+0000 7f6dfbfff640 1 -- 172.21.15.22:0/2656992690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6dfc103070 msgr2=0x7f6dfc19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:12.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.076+0000 7f6dfbfff640 1 --2- 172.21.15.22:0/2656992690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6dfc103070 0x7f6dfc19fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.076+0000 7f6dfbfff640 1 -- 172.21.15.22:0/2656992690 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dfc1a06b0 con 0x7f6dfc101560 2024-08-20T01:31:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.076+0000 7f6e00eac640 1 --2- 172.21.15.22:0/2656992690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6dfc103070 0x7f6dfc19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:31:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.076+0000 7f6dfbfff640 1 --2- 172.21.15.22:0/2656992690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dfc101560 0x7f6dfc06aea0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00e9f0 tx=0x7f6dec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.076+0000 7f6df97fa640 1 -- 172.21.15.22:0/2656992690 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec00cd80 con 0x7f6dfc101560 2024-08-20T01:31:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.076+0000 7f6df97fa640 1 -- 172.21.15.22:0/2656992690 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dec0108e0 con 0x7f6dfc101560 2024-08-20T01:31:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.076+0000 7f6e0290f640 1 -- 172.21.15.22:0/2656992690 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dfc1a0940 con 0x7f6dfc101560 2024-08-20T01:31:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.076+0000 7f6df97fa640 1 -- 172.21.15.22:0/2656992690 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec018980 con 0x7f6dfc101560 2024-08-20T01:31:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.076+0000 7f6e0290f640 1 -- 172.21.15.22:0/2656992690 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dfc1a0e90 con 0x7f6dfc101560 2024-08-20T01:31:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.079+0000 7f6df97fa640 1 -- 172.21.15.22:0/2656992690 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6dec010430 con 0x7f6dfc101560 2024-08-20T01:31:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.079+0000 7f6df97fa640 1 --2- 172.21.15.22:0/2656992690 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6de40b3bd0 0x7f6de40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.080+0000 7f6e057dc740 1 Processor -- start 2024-08-20T01:31:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.080+0000 7f6dfb7fe640 1 --2- 172.21.15.22:0/2656992690 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6de40b3bd0 0x7f6de40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.080+0000 7f6df97fa640 1 -- 172.21.15.22:0/2656992690 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f6dec0e3ff0 con 0x7f6dfc101560 2024-08-20T01:31:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.080+0000 7f6e057dc740 1 -- start start 2024-08-20T01:31:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.080+0000 7f6e057dc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a7d8d0 0x5588f6a7fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.080+0000 7f6e057dc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a80200 0x5588f6a825f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.080+0000 7f6e057dc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a82c40 0x5588f6a85100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.080+0000 7f6e057dc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5588f69f0360 con 0x5588f6a80200 2024-08-20T01:31:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.080+0000 7f6e057dc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5588f69df860 con 0x5588f6a7d8d0 2024-08-20T01:31:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.080+0000 7f6e057dc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5588f69e38a0 con 0x5588f6a82c40 2024-08-20T01:31:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.080+0000 7f6dfb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a80200 0x5588f6a825f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.080+0000 7f6dfb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a80200 0x5588f6a825f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38508/0 (socket says 172.21.15.22:38508) 2024-08-20T01:31:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.080+0000 7f6dfb7fe640 1 -- 172.21.15.22:0/3965149871 learned_addr learned my addr 172.21.15.22:0/3965149871 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.080+0000 7f6dfb7fe640 1 --2- 172.21.15.22:0/2656992690 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6de40b3bd0 0x7f6de40b6090 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6df0006010 tx=0x7f6df00314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.080+0000 7f6e00eac640 1 --2- 172.21.15.22:0/3965149871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a82c40 0x5588f6a85100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.080+0000 7f6dfbfff640 1 --2- 172.21.15.22:0/3965149871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a7d8d0 0x5588f6a7fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.081+0000 7f6dfb7fe640 1 -- 172.21.15.22:0/3965149871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a82c40 msgr2=0x5588f6a85100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.081+0000 7f6dfb7fe640 1 --2- 172.21.15.22:0/3965149871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a82c40 0x5588f6a85100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.081+0000 7f6dfb7fe640 1 -- 172.21.15.22:0/3965149871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a7d8d0 msgr2=0x5588f6a7fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.081+0000 7f6dfb7fe640 1 --2- 172.21.15.22:0/3965149871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a7d8d0 0x5588f6a7fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.081+0000 7f6dfb7fe640 1 -- 172.21.15.22:0/3965149871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588f6986e40 con 0x5588f6a80200 2024-08-20T01:31:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.081+0000 7f6e00eac640 1 --2- 172.21.15.22:0/3965149871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a82c40 0x5588f6a85100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:31:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.081+0000 7f6dfbfff640 1 --2- 172.21.15.22:0/3965149871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a7d8d0 0x5588f6a7fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:31:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.081+0000 7f6dfb7fe640 1 --2- 172.21.15.22:0/3965149871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a80200 0x5588f6a825f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009930 tx=0x7f6df003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6565bb805e9cc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.081+0000 7f6de27fc640 1 -- 172.21.15.22:0/3965149871 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df0035050 con 0x5588f6a80200 2024-08-20T01:31:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.081+0000 7f6de27fc640 1 -- 172.21.15.22:0/3965149871 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6df0004440 con 0x5588f6a80200 2024-08-20T01:31:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.081+0000 7f6de27fc640 1 -- 172.21.15.22:0/3965149871 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df003c910 con 0x5588f6a80200 2024-08-20T01:31:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.082+0000 7f6e057dc740 1 -- 172.21.15.22:0/3965149871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a80200 msgr2=0x5588f6a825f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.082+0000 7f6e057dc740 1 --2- 172.21.15.22:0/3965149871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a80200 0x5588f6a825f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009930 tx=0x7f6df003e000 comp rx=0 tx=0).stop 2024-08-20T01:31:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.082+0000 7f6e057dc740 1 -- 172.21.15.22:0/3965149871 shutdown_connections 2024-08-20T01:31:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.082+0000 7f6e057dc740 1 --2- 172.21.15.22:0/3965149871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a82c40 0x5588f6a85100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.082+0000 7f6e057dc740 1 --2- 172.21.15.22:0/3965149871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a80200 0x5588f6a825f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.082+0000 7f6e057dc740 1 --2- 172.21.15.22:0/3965149871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a7d8d0 0x5588f6a7fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.082+0000 7f6e057dc740 1 -- 172.21.15.22:0/3965149871 >> 172.21.15.22:0/3965149871 conn(0x5588f6a78a20 msgr2=0x5588f6a797b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.082+0000 7f6e057dc740 1 -- 172.21.15.22:0/3965149871 shutdown_connections 2024-08-20T01:31:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.082+0000 7f6e057dc740 1 -- 172.21.15.22:0/3965149871 wait complete. 2024-08-20T01:31:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.082+0000 7f6e057dc740 1 -- start start 2024-08-20T01:31:12.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.083+0000 7f6e057dc740 1 Processor -- start 2024-08-20T01:31:12.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.083+0000 7f6e057dc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a7d8d0 0x5588f6a87060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:12.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.083+0000 7f6e057dc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a80200 0x5588f6a87700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:12.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.083+0000 7f6e057dc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a82c40 0x5588f6a882d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:12.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.083+0000 7f6e057dc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5588f6918ab0 con 0x5588f6a82c40 2024-08-20T01:31:12.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.083+0000 7f6e057dc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5588f6966780 con 0x5588f6a80200 2024-08-20T01:31:12.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.083+0000 7f6e057dc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5588f6a85bc0 con 0x5588f6a7d8d0 2024-08-20T01:31:12.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.083+0000 7f6e057dc740 10 client.0 _ll_register_callbacks cb 0x5588f66eea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:12.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.083+0000 7f6e00eac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a82c40 0x5588f6a882d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:12.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.083+0000 7f6e00eac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a82c40 0x5588f6a882d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38512/0 (socket says 172.21.15.22:38512) 2024-08-20T01:31:12.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.083+0000 7f6e00eac640 1 -- 172.21.15.22:0/1516940787 learned_addr learned my addr 172.21.15.22:0/1516940787 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:12.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.083+0000 7f6dfbfff640 1 --2- 172.21.15.22:0/1516940787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a7d8d0 0x5588f6a87060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.083+0000 7f6dfb7fe640 1 --2- 172.21.15.22:0/1516940787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a80200 0x5588f6a87700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.083+0000 7f6e00eac640 1 -- 172.21.15.22:0/1516940787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a7d8d0 msgr2=0x5588f6a87060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.083+0000 7f6e00eac640 1 --2- 172.21.15.22:0/1516940787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a7d8d0 0x5588f6a87060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.083+0000 7f6e00eac640 1 -- 172.21.15.22:0/1516940787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a80200 msgr2=0x5588f6a87700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.083+0000 7f6e00eac640 1 --2- 172.21.15.22:0/1516940787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a80200 0x5588f6a87700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.083+0000 7f6e00eac640 1 -- 172.21.15.22:0/1516940787 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588f6742790 con 0x5588f6a82c40 2024-08-20T01:31:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.084+0000 7f6e00eac640 1 --2- 172.21.15.22:0/1516940787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a82c40 0x5588f6a882d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6df4012720 tx=0x7f6df4012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6778d405bd6dcc78 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.084+0000 7f6ddb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:31:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.084+0000 7f6ddb7fe640 1 -- 172.21.15.22:0/1516940787 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df401f060 con 0x5588f6a82c40 2024-08-20T01:31:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.084+0000 7f6ddb7fe640 1 -- 172.21.15.22:0/1516940787 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f6df4010d60 con 0x5588f6a82c40 2024-08-20T01:31:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.084+0000 7f6e057dc740 1 -- 172.21.15.22:0/1516940787 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5588f698ee00 con 0x5588f6a82c40 2024-08-20T01:31:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.084+0000 7f6ddb7fe640 1 -- 172.21.15.22:0/1516940787 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6df4025420 con 0x5588f6a82c40 2024-08-20T01:31:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.084+0000 7f6e057dc740 10 client.15372 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.084+0000 7f6e057dc740 1 -- 172.21.15.22:0/1516940787 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5588f67bb620 con 0x5588f6a82c40 2024-08-20T01:31:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.084+0000 7f6ddb7fe640 1 -- 172.21.15.22:0/1516940787 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5588f698ee00 con 0x5588f6a82c40 2024-08-20T01:31:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.084+0000 7f6ddb7fe640 1 -- 172.21.15.22:0/1516940787 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6df4019030 con 0x5588f6a82c40 2024-08-20T01:31:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.085+0000 7f6e057dc740 10 client.15372 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.085+0000 7f6e057dc740 10 client.15372 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:31:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.085+0000 7f6e057dc740 20 client.15372 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.085+0000 7f6e057dc740 1 --2- 172.21.15.22:0/1516940787 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5588f6a92a70 0x5588f6a94e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.085+0000 7f6e057dc740 4 client.15372 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:31:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.085+0000 7f6e057dc740 1 -- 172.21.15.22:0/1516940787 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588f69f22b0 con 0x5588f6a92a70 2024-08-20T01:31:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.085+0000 7f6dfbfff640 1 --2- 172.21.15.22:0/1516940787 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5588f6a92a70 0x5588f6a94e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.086+0000 7f6dfbfff640 1 --2- 172.21.15.22:0/1516940787 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5588f6a92a70 0x5588f6a94e90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e579decbb25654a server_cookie=51e3f40b51c7c86c in_seq=0 out_seq=0 2024-08-20T01:31:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.086+0000 7f6ddb7fe640 10 client.15372 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.086+0000 7f6ddb7fe640 1 -- 172.21.15.22:0/1516940787 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5588f69f22b0 con 0x5588f6a92a70 2024-08-20T01:31:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.086+0000 7f6ddb7fe640 10 client.15372 handle_command_reply: tid=0 2024-08-20T01:31:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.086+0000 7f6e057dc740 1 client.15372 shutdown 2024-08-20T01:31:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.086+0000 7f6e057dc740 1 -- 172.21.15.22:0/1516940787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a82c40 msgr2=0x5588f6a882d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.086+0000 7f6e057dc740 1 --2- 172.21.15.22:0/1516940787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a82c40 0x5588f6a882d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6df4012720 tx=0x7f6df4012be0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.086+0000 7f6e057dc740 1 -- 172.21.15.22:0/1516940787 shutdown_connections 2024-08-20T01:31:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.086+0000 7f6e057dc740 1 --2- 172.21.15.22:0/1516940787 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5588f6a92a70 0x5588f6a94e90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.086+0000 7f6e057dc740 1 --2- 172.21.15.22:0/1516940787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a82c40 0x5588f6a882d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.086+0000 7f6e057dc740 1 --2- 172.21.15.22:0/1516940787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a80200 0x5588f6a87700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.086+0000 7f6ddb7fe640 0 client.15372 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.086+0000 7f6e057dc740 1 --2- 172.21.15.22:0/1516940787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a7d8d0 0x5588f6a87060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.086+0000 7f6e057dc740 1 -- 172.21.15.22:0/1516940787 >> 172.21.15.22:0/1516940787 conn(0x5588f6a78a20 msgr2=0x5588f6a77ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.087+0000 7f6e057dc740 1 -- 172.21.15.22:0/1516940787 shutdown_connections 2024-08-20T01:31:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.087+0000 7f6e057dc740 1 -- 172.21.15.22:0/1516940787 wait complete. 2024-08-20T01:31:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.087+0000 7f6e057dc740 20 client.15372 trim_cache size 0 max 16384 2024-08-20T01:31:12.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.101+0000 7f6e057dc740 1 Processor -- start 2024-08-20T01:31:12.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.101+0000 7f6e057dc740 1 -- start start 2024-08-20T01:31:12.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.101+0000 7f6e057dc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a7d8d0 0x5588f6a882b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:12.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.101+0000 7f6e057dc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a80200 0x5588f6a738e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:12.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.101+0000 7f6e057dc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a82c40 0x5588f6a83020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:12.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.101+0000 7f6e057dc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc1ac5d0 con 0x5588f6a7d8d0 2024-08-20T01:31:12.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.101+0000 7f6e057dc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc1a9ea0 con 0x5588f6a82c40 2024-08-20T01:31:12.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.101+0000 7f6e057dc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc1a7cf0 con 0x5588f6a80200 2024-08-20T01:31:12.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.101+0000 7f6dfbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a7d8d0 0x5588f6a882b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:12.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.102+0000 7f6dfbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a7d8d0 0x5588f6a882b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38526/0 (socket says 172.21.15.22:38526) 2024-08-20T01:31:12.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.102+0000 7f6dfbfff640 1 -- 172.21.15.22:0/717035484 learned_addr learned my addr 172.21.15.22:0/717035484 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:12.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.102+0000 7f6dfb7fe640 1 --2- 172.21.15.22:0/717035484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a80200 0x5588f6a738e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:12.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.102+0000 7f6e00eac640 1 --2- 172.21.15.22:0/717035484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a82c40 0x5588f6a83020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:12.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.102+0000 7f6dfbfff640 1 -- 172.21.15.22:0/717035484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a80200 msgr2=0x5588f6a738e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:12.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.102+0000 7f6dfbfff640 1 --2- 172.21.15.22:0/717035484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a80200 0x5588f6a738e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.102+0000 7f6dfbfff640 1 -- 172.21.15.22:0/717035484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a82c40 msgr2=0x5588f6a83020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:12.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.102+0000 7f6dfbfff640 1 --2- 172.21.15.22:0/717035484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a82c40 0x5588f6a83020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.102+0000 7f6dfbfff640 1 -- 172.21.15.22:0/717035484 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588f6a82960 con 0x5588f6a7d8d0 2024-08-20T01:31:12.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.102+0000 7f6dfbfff640 1 --2- 172.21.15.22:0/717035484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a7d8d0 0x5588f6a882b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009250 tx=0x7f6dec018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32fbaadd8530392 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:12.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.102+0000 7f6de1ffb640 1 -- 172.21.15.22:0/717035484 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec0c0300 con 0x5588f6a7d8d0 2024-08-20T01:31:12.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.102+0000 7f6de1ffb640 1 -- 172.21.15.22:0/717035484 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dec0af500 con 0x5588f6a7d8d0 2024-08-20T01:31:12.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.102+0000 7f6de1ffb640 1 -- 172.21.15.22:0/717035484 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec018b20 con 0x5588f6a7d8d0 2024-08-20T01:31:12.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.103+0000 7f6e057dc740 1 -- 172.21.15.22:0/717035484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a7d8d0 msgr2=0x5588f6a882b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:12.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.103+0000 7f6e057dc740 1 --2- 172.21.15.22:0/717035484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a7d8d0 0x5588f6a882b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009250 tx=0x7f6dec018420 comp rx=0 tx=0).stop 2024-08-20T01:31:12.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.103+0000 7f6e057dc740 1 -- 172.21.15.22:0/717035484 shutdown_connections 2024-08-20T01:31:12.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.103+0000 7f6e057dc740 1 --2- 172.21.15.22:0/717035484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a82c40 0x5588f6a83020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.103+0000 7f6e057dc740 1 --2- 172.21.15.22:0/717035484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a80200 0x5588f6a738e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.103+0000 7f6e057dc740 1 --2- 172.21.15.22:0/717035484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a7d8d0 0x5588f6a882b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.103+0000 7f6e057dc740 1 -- 172.21.15.22:0/717035484 >> 172.21.15.22:0/717035484 conn(0x5588f6a78a20 msgr2=0x5588f6a845c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:12.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.103+0000 7f6e057dc740 1 -- 172.21.15.22:0/717035484 shutdown_connections 2024-08-20T01:31:12.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.103+0000 7f6e057dc740 1 -- 172.21.15.22:0/717035484 wait complete. 2024-08-20T01:31:12.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.103+0000 7f6e057dc740 1 -- start start 2024-08-20T01:31:12.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.104+0000 7f6e057dc740 1 Processor -- start 2024-08-20T01:31:12.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.104+0000 7f6e057dc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a7d8d0 0x5588f6a8bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:12.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.104+0000 7f6e057dc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a80200 0x5588f6a8c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.104+0000 7f6e057dc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a82c40 0x5588f6a8d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.104+0000 7f6e057dc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc1a8360 con 0x5588f6a7d8d0 2024-08-20T01:31:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.104+0000 7f6e057dc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc1a97d0 con 0x5588f6a80200 2024-08-20T01:31:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.104+0000 7f6e057dc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc1a8a30 con 0x5588f6a82c40 2024-08-20T01:31:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.104+0000 7f6e057dc740 10 client.0 _ll_register_callbacks cb 0x7f6df4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.104+0000 7f6dfbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a7d8d0 0x5588f6a8bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.104+0000 7f6dfbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a7d8d0 0x5588f6a8bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38534/0 (socket says 172.21.15.22:38534) 2024-08-20T01:31:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.104+0000 7f6dfbfff640 1 -- 172.21.15.22:0/2866068374 learned_addr learned my addr 172.21.15.22:0/2866068374 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.104+0000 7f6dfb7fe640 1 --2- 172.21.15.22:0/2866068374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a80200 0x5588f6a8c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.104+0000 7f6e00eac640 1 --2- 172.21.15.22:0/2866068374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a82c40 0x5588f6a8d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.104+0000 7f6dfbfff640 1 -- 172.21.15.22:0/2866068374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a82c40 msgr2=0x5588f6a8d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.104+0000 7f6dfbfff640 1 --2- 172.21.15.22:0/2866068374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a82c40 0x5588f6a8d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.104+0000 7f6dfbfff640 1 -- 172.21.15.22:0/2866068374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a80200 msgr2=0x5588f6a8c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.104+0000 7f6dfbfff640 1 --2- 172.21.15.22:0/2866068374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a80200 0x5588f6a8c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.104+0000 7f6dfbfff640 1 -- 172.21.15.22:0/2866068374 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588f6a8d9a0 con 0x5588f6a7d8d0 2024-08-20T01:31:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.104+0000 7f6dfbfff640 1 --2- 172.21.15.22:0/2866068374 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a7d8d0 0x5588f6a8bf00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6dec0e1e20 tx=0x7f6dec0ab770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8abb1bafd9436ab9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.105+0000 7f6ddb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:31:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.105+0000 7f6ddb7fe640 1 -- 172.21.15.22:0/2866068374 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec0ca060 con 0x5588f6a7d8d0 2024-08-20T01:31:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.105+0000 7f6ddb7fe640 1 -- 172.21.15.22:0/2866068374 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f6dec0aa160 con 0x5588f6a7d8d0 2024-08-20T01:31:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.105+0000 7f6e057dc740 1 -- 172.21.15.22:0/2866068374 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dec0af500 con 0x5588f6a7d8d0 2024-08-20T01:31:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.105+0000 7f6ddb7fe640 1 -- 172.21.15.22:0/2866068374 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6dec0b3fb0 con 0x5588f6a7d8d0 2024-08-20T01:31:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.105+0000 7f6e057dc740 10 client.15378 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.105+0000 7f6e057dc740 1 -- 172.21.15.22:0/2866068374 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5588f6a8ed10 con 0x5588f6a7d8d0 2024-08-20T01:31:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.105+0000 7f6ddb7fe640 1 -- 172.21.15.22:0/2866068374 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dec0af500 con 0x5588f6a7d8d0 2024-08-20T01:31:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.105+0000 7f6ddb7fe640 1 -- 172.21.15.22:0/2866068374 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6dec0a9bd0 con 0x5588f6a7d8d0 2024-08-20T01:31:12.111 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.105+0000 7f6e057dc740 10 client.15378 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:12.111 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.105+0000 7f6e057dc740 10 client.15378 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:31:12.111 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.105+0000 7f6e057dc740 20 client.15378 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:12.111 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.105+0000 7f6e057dc740 1 --2- 172.21.15.22:0/2866068374 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5588f6afda80 0x5588f6affea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:12.111 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.105+0000 7f6e057dc740 4 client.15378 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:31:12.111 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.105+0000 7f6e057dc740 1 -- 172.21.15.22:0/2866068374 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5588f69edd50 con 0x5588f6afda80 2024-08-20T01:31:12.111 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.106+0000 7f6dfb7fe640 1 --2- 172.21.15.22:0/2866068374 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5588f6afda80 0x5588f6affea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:12.111 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.106+0000 7f6dfb7fe640 1 --2- 172.21.15.22:0/2866068374 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5588f6afda80 0x5588f6affea0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1f0052d420a8b5d server_cookie=95b9eaf36afaea03 in_seq=0 out_seq=0 2024-08-20T01:31:12.111 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.106+0000 7f6ddb7fe640 10 client.15378 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:12.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.119+0000 7f6ddb7fe640 1 -- 172.21.15.22:0/2866068374 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5588f69edd50 con 0x5588f6afda80 2024-08-20T01:31:12.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.119+0000 7f6ddb7fe640 10 client.15378 handle_command_reply: tid=0 2024-08-20T01:31:12.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.119+0000 7f6e057dc740 1 client.15378 shutdown 2024-08-20T01:31:12.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.119+0000 7f6e057dc740 1 -- 172.21.15.22:0/2866068374 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a7d8d0 msgr2=0x5588f6a8bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:12.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.119+0000 7f6e057dc740 1 --2- 172.21.15.22:0/2866068374 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a7d8d0 0x5588f6a8bf00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6dec0e1e20 tx=0x7f6dec0ab770 comp rx=0 tx=0).stop 2024-08-20T01:31:12.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.119+0000 7f6e057dc740 1 -- 172.21.15.22:0/2866068374 shutdown_connections 2024-08-20T01:31:12.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.119+0000 7f6e057dc740 1 --2- 172.21.15.22:0/2866068374 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5588f6afda80 0x5588f6affea0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.119+0000 7f6e057dc740 1 --2- 172.21.15.22:0/2866068374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588f6a82c40 0x5588f6a8d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.119+0000 7f6e057dc740 1 --2- 172.21.15.22:0/2866068374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588f6a80200 0x5588f6a8c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.119+0000 7f6ddb7fe640 0 client.15378 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.119+0000 7f6e057dc740 1 --2- 172.21.15.22:0/2866068374 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588f6a7d8d0 0x5588f6a8bf00 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.119+0000 7f6e057dc740 1 -- 172.21.15.22:0/2866068374 >> 172.21.15.22:0/2866068374 conn(0x5588f6a78a20 msgr2=0x5588f6a772c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.119+0000 7f6e057dc740 1 -- 172.21.15.22:0/2866068374 shutdown_connections 2024-08-20T01:31:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.119+0000 7f6e057dc740 1 -- 172.21.15.22:0/2866068374 wait complete. 2024-08-20T01:31:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.119+0000 7f6e057dc740 20 client.15378 trim_cache size 0 max 16384 2024-08-20T01:31:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:31:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:31:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:31:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:31:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.120+0000 7f6e0290f640 1 -- 172.21.15.22:0/2656992690 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6de40b3bd0 msgr2=0x7f6de40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.120+0000 7f6e0290f640 1 --2- 172.21.15.22:0/2656992690 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6de40b3bd0 0x7f6de40b6090 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6df0006010 tx=0x7f6df00314a0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.120+0000 7f6e0290f640 1 -- 172.21.15.22:0/2656992690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dfc101560 msgr2=0x7f6dfc06aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.120+0000 7f6e0290f640 1 --2- 172.21.15.22:0/2656992690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dfc101560 0x7f6dfc06aea0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00e9f0 tx=0x7f6dec00eeb0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.120+0000 7f6e0290f640 1 -- 172.21.15.22:0/2656992690 shutdown_connections 2024-08-20T01:31:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.120+0000 7f6e0290f640 1 --2- 172.21.15.22:0/2656992690 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6de40b3bd0 0x7f6de40b6090 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.120+0000 7f6e0290f640 1 --2- 172.21.15.22:0/2656992690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6dfc103070 0x7f6dfc19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.120+0000 7f6e0290f640 1 --2- 172.21.15.22:0/2656992690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dfc1026b0 0x7f6dfc19d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.120+0000 7f6e0290f640 1 --2- 172.21.15.22:0/2656992690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dfc101560 0x7f6dfc06aea0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.120+0000 7f6e0290f640 1 -- 172.21.15.22:0/2656992690 >> 172.21.15.22:0/2656992690 conn(0x7f6dfc0fce40 msgr2=0x7f6dfc105aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.120+0000 7f6e0290f640 1 -- 172.21.15.22:0/2656992690 shutdown_connections 2024-08-20T01:31:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:12.120+0000 7f6e0290f640 1 -- 172.21.15.22:0/2656992690 wait complete. 2024-08-20T01:31:12.866 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:12 smithi077 ceph-mon[22251]: pgmap v348: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-20T01:31:12.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:12 smithi022 ceph-mon[18709]: pgmap v348: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-20T01:31:13.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:12 smithi134 ceph-mon[22511]: pgmap v348: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-20T01:31:13.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:13 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:31:13.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:13 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:31:14.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:13 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:31:14.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:13 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:31:14.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:13 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:31:14.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:13 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:31:14.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:14 smithi022 ceph-mon[18709]: pgmap v349: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:31:14.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:14.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:14.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:14.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:14.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:14.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:14 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:15.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:14 smithi134 ceph-mon[22511]: pgmap v349: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:31:15.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:15.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:15.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:15.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:15.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:15.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:14 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:15.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:14 smithi077 ceph-mon[22251]: pgmap v349: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-20T01:31:15.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:15.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:15.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:15.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:15.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:15.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:14 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:15.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:15 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:15.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:15 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:31:15.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:15 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:16.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:15 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:16.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:15 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:31:16.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:15 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:16.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:15 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:16.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:15 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:31:16.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:15 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:31:17.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:16 smithi134 ceph-mon[22511]: pgmap v350: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-20T01:31:17.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:16 smithi077 ceph-mon[22251]: pgmap v350: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-20T01:31:17.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:16 smithi022 ceph-mon[18709]: pgmap v350: 97 pgs: 97 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-20T01:31:19.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:18 smithi134 ceph-mon[22511]: pgmap v351: 97 pgs: 97 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-08-20T01:31:19.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:18 smithi077 ceph-mon[22251]: pgmap v351: 97 pgs: 97 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-08-20T01:31:19.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:18 smithi022 ceph-mon[18709]: pgmap v351: 97 pgs: 97 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-08-20T01:31:20.938 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:20 smithi022 ceph-mon[18709]: pgmap v352: 97 pgs: 97 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-20T01:31:21.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:20 smithi134 ceph-mon[22511]: pgmap v352: 97 pgs: 97 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-20T01:31:21.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:20 smithi077 ceph-mon[22251]: pgmap v352: 97 pgs: 97 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-20T01:31:23.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:22 smithi134 ceph-mon[22511]: pgmap v353: 97 pgs: 97 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-08-20T01:31:23.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:22 smithi077 ceph-mon[22251]: pgmap v353: 97 pgs: 97 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-08-20T01:31:23.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:22 smithi022 ceph-mon[18709]: pgmap v353: 97 pgs: 97 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-08-20T01:31:25.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:24 smithi134 ceph-mon[22511]: pgmap v354: 97 pgs: 97 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-20T01:31:25.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:24 smithi077 ceph-mon[22251]: pgmap v354: 97 pgs: 97 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-20T01:31:25.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:24 smithi022 ceph-mon[18709]: pgmap v354: 97 pgs: 97 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-20T01:31:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.214+0000 7f70a6a77640 1 -- 172.21.15.22:0/1296808995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a0102680 msgr2=0x7f70a0102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.214+0000 7f70a6a77640 1 --2- 172.21.15.22:0/1296808995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a0102680 0x7f70a0102a80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7094009930 tx=0x7f709402a420 comp rx=0 tx=0).stop 2024-08-20T01:31:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.214+0000 7f70a6a77640 1 -- 172.21.15.22:0/1296808995 shutdown_connections 2024-08-20T01:31:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.214+0000 7f70a6a77640 1 --2- 172.21.15.22:0/1296808995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a0104190 0x7f70a010ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.214+0000 7f70a6a77640 1 --2- 172.21.15.22:0/1296808995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70a01037d0 0x7f70a0103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.214+0000 7f70a6a77640 1 --2- 172.21.15.22:0/1296808995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a0102680 0x7f70a0102a80 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.214+0000 7f70a6a77640 1 -- 172.21.15.22:0/1296808995 >> 172.21.15.22:0/1296808995 conn(0x7f70a00fdf40 msgr2=0x7f70a0100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.214+0000 7f70a6a77640 1 -- 172.21.15.22:0/1296808995 shutdown_connections 2024-08-20T01:31:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.214+0000 7f70a6a77640 1 -- 172.21.15.22:0/1296808995 wait complete. 2024-08-20T01:31:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.215+0000 7f70a6a77640 1 Processor -- start 2024-08-20T01:31:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.215+0000 7f70a6a77640 1 -- start start 2024-08-20T01:31:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.215+0000 7f70a6a77640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a0102680 0x7f70a0198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.215+0000 7f70a6a77640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70a01037d0 0x7f70a0199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.215+0000 7f70a6a77640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a0104190 0x7f70a0199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.215+0000 7f70a6a77640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f70a010e2f0 con 0x7f70a0102680 2024-08-20T01:31:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.215+0000 7f70a4813640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a0102680 0x7f70a0198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.215+0000 7f70a6a77640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f70a010e170 con 0x7f70a0104190 2024-08-20T01:31:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.215+0000 7f70a6a77640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f70a010e470 con 0x7f70a01037d0 2024-08-20T01:31:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.215+0000 7f70a4813640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a0102680 0x7f70a0198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49826/0 (socket says 172.21.15.22:49826) 2024-08-20T01:31:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.216+0000 7f70a4813640 1 -- 172.21.15.22:0/2107071420 learned_addr learned my addr 172.21.15.22:0/2107071420 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.216+0000 7f709ffff640 1 --2- 172.21.15.22:0/2107071420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70a01037d0 0x7f70a0199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.216+0000 7f70a5014640 1 --2- 172.21.15.22:0/2107071420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a0104190 0x7f70a0199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.216+0000 7f70a4813640 1 -- 172.21.15.22:0/2107071420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70a01037d0 msgr2=0x7f70a0199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.216+0000 7f70a4813640 1 --2- 172.21.15.22:0/2107071420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70a01037d0 0x7f70a0199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.216+0000 7f70a4813640 1 -- 172.21.15.22:0/2107071420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a0104190 msgr2=0x7f70a0199d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.216+0000 7f70a4813640 1 --2- 172.21.15.22:0/2107071420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a0104190 0x7f70a0199d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.216+0000 7f70a4813640 1 -- 172.21.15.22:0/2107071420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a019a610 con 0x7f70a0102680 2024-08-20T01:31:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.216+0000 7f70a4813640 1 --2- 172.21.15.22:0/2107071420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a0102680 0x7f70a0198ad0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7094009a50 tx=0x7f70940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.216+0000 7f709dffb640 1 -- 172.21.15.22:0/2107071420 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709403f030 con 0x7f70a0102680 2024-08-20T01:31:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.216+0000 7f70a6a77640 1 -- 172.21.15.22:0/2107071420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a019a8a0 con 0x7f70a0102680 2024-08-20T01:31:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.216+0000 7f709dffb640 1 -- 172.21.15.22:0/2107071420 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7094003cb0 con 0x7f70a0102680 2024-08-20T01:31:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.216+0000 7f709dffb640 1 -- 172.21.15.22:0/2107071420 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7094035070 con 0x7f70a0102680 2024-08-20T01:31:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.217+0000 7f70a6a77640 1 -- 172.21.15.22:0/2107071420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a01a0fd0 con 0x7f70a0102680 2024-08-20T01:31:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.220+0000 7f70a9867740 1 Processor -- start 2024-08-20T01:31:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.220+0000 7f70a9867740 1 -- start start 2024-08-20T01:31:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.220+0000 7f70a9867740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e8f630 0x556317e91a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.220+0000 7f70a9867740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e91f60 0x556317e94350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.220+0000 7f70a9867740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e949a0 0x556317e96e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.220+0000 7f70a9867740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556317e02360 con 0x556317e8f630 2024-08-20T01:31:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.220+0000 7f70a9867740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556317df1860 con 0x556317e949a0 2024-08-20T01:31:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.220+0000 7f70a9867740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556317df58a0 con 0x556317e91f60 2024-08-20T01:31:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.221+0000 7f70a5014640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e8f630 0x556317e91a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.221+0000 7f709dffb640 1 -- 172.21.15.22:0/2107071420 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7094042030 con 0x7f70a0102680 2024-08-20T01:31:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.221+0000 7f70a5014640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e8f630 0x556317e91a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49832/0 (socket says 172.21.15.22:49832) 2024-08-20T01:31:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.221+0000 7f70a5014640 1 -- 172.21.15.22:0/1546456757 learned_addr learned my addr 172.21.15.22:0/1546456757 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.221+0000 7f709ffff640 1 --2- 172.21.15.22:0/1546456757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e949a0 0x556317e96e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.221+0000 7f70a4813640 1 --2- 172.21.15.22:0/1546456757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e91f60 0x556317e94350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.221+0000 7f70a5014640 1 -- 172.21.15.22:0/1546456757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e91f60 msgr2=0x556317e94350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.221+0000 7f70a5014640 1 --2- 172.21.15.22:0/1546456757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e91f60 0x556317e94350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.221+0000 7f70a5014640 1 -- 172.21.15.22:0/1546456757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e949a0 msgr2=0x556317e96e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.221+0000 7f70a5014640 1 --2- 172.21.15.22:0/1546456757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e949a0 0x556317e96e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.221+0000 7f70a5014640 1 -- 172.21.15.22:0/1546456757 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556317d98e40 con 0x556317e8f630 2024-08-20T01:31:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.221+0000 7f70a4813640 1 --2- 172.21.15.22:0/1546456757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e91f60 0x556317e94350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:31:25.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.221+0000 7f70a5014640 1 --2- 172.21.15.22:0/1546456757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e8f630 0x556317e91a20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7098009f90 tx=0x7f70980118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455f96d7f7d37032 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.222+0000 7f708affd640 1 -- 172.21.15.22:0/1546456757 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7098004d20 con 0x556317e8f630 2024-08-20T01:31:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.222+0000 7f708affd640 1 -- 172.21.15.22:0/1546456757 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7098004050 con 0x556317e8f630 2024-08-20T01:31:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.222+0000 7f708affd640 1 -- 172.21.15.22:0/1546456757 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7098005220 con 0x556317e8f630 2024-08-20T01:31:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.222+0000 7f709dffb640 1 --2- 172.21.15.22:0/2107071420 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70900b3bd0 0x7f70900b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.222+0000 7f709dffb640 1 -- 172.21.15.22:0/2107071420 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f7094104590 con 0x7f70a0102680 2024-08-20T01:31:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.222+0000 7f70a4813640 1 --2- 172.21.15.22:0/2107071420 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70900b3bd0 0x7f70900b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.223+0000 7f70a9867740 1 -- 172.21.15.22:0/1546456757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e8f630 msgr2=0x556317e91a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.223+0000 7f70a9867740 1 --2- 172.21.15.22:0/1546456757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e8f630 0x556317e91a20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7098009f90 tx=0x7f70980118d0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.223+0000 7f70a9867740 1 -- 172.21.15.22:0/1546456757 shutdown_connections 2024-08-20T01:31:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.223+0000 7f70a4813640 1 --2- 172.21.15.22:0/2107071420 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70900b3bd0 0x7f70900b6090 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7094005ec0 tx=0x7f709402a420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.223+0000 7f70a9867740 1 --2- 172.21.15.22:0/1546456757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e949a0 0x556317e96e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.223+0000 7f70a9867740 1 --2- 172.21.15.22:0/1546456757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e91f60 0x556317e94350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.223+0000 7f70a9867740 1 --2- 172.21.15.22:0/1546456757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e8f630 0x556317e91a20 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.223+0000 7f70a9867740 1 -- 172.21.15.22:0/1546456757 >> 172.21.15.22:0/1546456757 conn(0x556317e8a730 msgr2=0x556317e8b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.223+0000 7f70a9867740 1 -- 172.21.15.22:0/1546456757 shutdown_connections 2024-08-20T01:31:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.223+0000 7f70a9867740 1 -- 172.21.15.22:0/1546456757 wait complete. 2024-08-20T01:31:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.223+0000 7f70a9867740 1 -- start start 2024-08-20T01:31:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.223+0000 7f70a9867740 1 Processor -- start 2024-08-20T01:31:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.224+0000 7f70a9867740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e8f630 0x556317e98e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.224+0000 7f70a9867740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e91f60 0x556317e99500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.224+0000 7f70a9867740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e949a0 0x556317e9a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.224+0000 7f70a9867740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556317d2aab0 con 0x556317e949a0 2024-08-20T01:31:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.224+0000 7f70a9867740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556317d78780 con 0x556317e91f60 2024-08-20T01:31:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.224+0000 7f70a9867740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556317e97980 con 0x556317e8f630 2024-08-20T01:31:25.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.224+0000 7f709ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e91f60 0x556317e99500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:25.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.224+0000 7f709ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e91f60 0x556317e99500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:55408/0 (socket says 172.21.15.22:55408) 2024-08-20T01:31:25.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.224+0000 7f70a5014640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e949a0 0x556317e9a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:25.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.224+0000 7f709ffff640 1 -- 172.21.15.22:0/1192275839 learned_addr learned my addr 172.21.15.22:0/1192275839 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:25.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.224+0000 7f70a9867740 10 client.0 _ll_register_callbacks cb 0x556317b00a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:25.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.225+0000 7f70a5014640 1 -- 172.21.15.22:0/1192275839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e8f630 msgr2=0x556317e98e60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:31:25.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.225+0000 7f70a5014640 1 --2- 172.21.15.22:0/1192275839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e8f630 0x556317e98e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.225+0000 7f70a5014640 1 -- 172.21.15.22:0/1192275839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e91f60 msgr2=0x556317e99500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:25.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.225+0000 7f70a5014640 1 --2- 172.21.15.22:0/1192275839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e91f60 0x556317e99500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.225+0000 7f70a5014640 1 -- 172.21.15.22:0/1192275839 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556317b54790 con 0x556317e949a0 2024-08-20T01:31:25.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.225+0000 7f709ffff640 1 --2- 172.21.15.22:0/1192275839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e91f60 0x556317e99500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:31:25.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.225+0000 7f70a5014640 1 --2- 172.21.15.22:0/1192275839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e949a0 0x556317e9a0d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f709801b040 tx=0x7f7098004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3fb2106c8a46b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:25.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.225+0000 7f707ffff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:31:25.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.225+0000 7f707ffff640 1 -- 172.21.15.22:0/1192275839 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7098028020 con 0x556317e949a0 2024-08-20T01:31:25.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.225+0000 7f707ffff640 1 -- 172.21.15.22:0/1192275839 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f7098004350 con 0x556317e949a0 2024-08-20T01:31:25.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.225+0000 7f70a9867740 1 -- 172.21.15.22:0/1192275839 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556317da0e00 con 0x556317e949a0 2024-08-20T01:31:25.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.226+0000 7f707ffff640 1 -- 172.21.15.22:0/1192275839 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7098004550 con 0x556317e949a0 2024-08-20T01:31:25.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.226+0000 7f70a9867740 10 client.15390 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:25.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.226+0000 7f70a9867740 1 -- 172.21.15.22:0/1192275839 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556317bcd620 con 0x556317e949a0 2024-08-20T01:31:25.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.226+0000 7f707ffff640 1 -- 172.21.15.22:0/1192275839 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556317da0e00 con 0x556317e949a0 2024-08-20T01:31:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.226+0000 7f707ffff640 1 -- 172.21.15.22:0/1192275839 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7098005230 con 0x556317e949a0 2024-08-20T01:31:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.226+0000 7f70a9867740 10 client.15390 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.227+0000 7f70a9867740 10 client.15390 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:31:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.227+0000 7f70a9867740 20 client.15390 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.227+0000 7f70a9867740 1 --2- 172.21.15.22:0/1192275839 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556317ea43c0 0x556317ea67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.227+0000 7f70a9867740 4 client.15390 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:31:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.227+0000 7f70a9867740 1 -- 172.21.15.22:0/1192275839 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556317e042b0 con 0x556317ea43c0 2024-08-20T01:31:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.227+0000 7f709ffff640 1 --2- 172.21.15.22:0/1192275839 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556317ea43c0 0x556317ea67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.228+0000 7f709ffff640 1 --2- 172.21.15.22:0/1192275839 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556317ea43c0 0x556317ea67b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbe8366824fb083d server_cookie=1c296995d500a5e6 in_seq=0 out_seq=0 2024-08-20T01:31:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.228+0000 7f707ffff640 10 client.15390 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.228+0000 7f707ffff640 1 -- 172.21.15.22:0/1192275839 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556317e042b0 con 0x556317ea43c0 2024-08-20T01:31:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.228+0000 7f707ffff640 10 client.15390 handle_command_reply: tid=0 2024-08-20T01:31:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.228+0000 7f70a9867740 1 client.15390 shutdown 2024-08-20T01:31:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.229+0000 7f70a9867740 1 -- 172.21.15.22:0/1192275839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e949a0 msgr2=0x556317e9a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.229+0000 7f70a9867740 1 --2- 172.21.15.22:0/1192275839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e949a0 0x556317e9a0d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f709801b040 tx=0x7f7098004f80 comp rx=0 tx=0).stop 2024-08-20T01:31:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.229+0000 7f70a9867740 1 -- 172.21.15.22:0/1192275839 shutdown_connections 2024-08-20T01:31:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.229+0000 7f70a9867740 1 --2- 172.21.15.22:0/1192275839 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556317ea43c0 0x556317ea67b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.229+0000 7f70a9867740 1 --2- 172.21.15.22:0/1192275839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e949a0 0x556317e9a0d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.229+0000 7f707ffff640 0 client.15390 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.229+0000 7f70a9867740 1 --2- 172.21.15.22:0/1192275839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e91f60 0x556317e99500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.229+0000 7f70a9867740 1 --2- 172.21.15.22:0/1192275839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e8f630 0x556317e98e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.229+0000 7f70a9867740 1 -- 172.21.15.22:0/1192275839 >> 172.21.15.22:0/1192275839 conn(0x556317e8a730 msgr2=0x556317e89850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.229+0000 7f70a9867740 1 -- 172.21.15.22:0/1192275839 shutdown_connections 2024-08-20T01:31:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.229+0000 7f70a9867740 1 -- 172.21.15.22:0/1192275839 wait complete. 2024-08-20T01:31:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.229+0000 7f70a9867740 20 client.15390 trim_cache size 0 max 16384 2024-08-20T01:31:25.260 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.258+0000 7f70a9867740 1 Processor -- start 2024-08-20T01:31:25.260 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.258+0000 7f70a9867740 1 -- start start 2024-08-20T01:31:25.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.258+0000 7f70a9867740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e8f630 0x556317e89740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:25.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.258+0000 7f70a9867740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e91f60 0x556317eab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:25.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.258+0000 7f70a9867740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e949a0 0x556317eab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:25.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.258+0000 7f70a9867740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f70a01ac600 con 0x556317e949a0 2024-08-20T01:31:25.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.259+0000 7f70a9867740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f70a01a9ed0 con 0x556317e8f630 2024-08-20T01:31:25.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.259+0000 7f70a9867740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f70a01a7d20 con 0x556317e91f60 2024-08-20T01:31:25.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.259+0000 7f709ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e91f60 0x556317eab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:25.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.259+0000 7f70a5014640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e949a0 0x556317eab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:25.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.259+0000 7f709ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e91f60 0x556317eab060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:40950/0 (socket says 172.21.15.22:40950) 2024-08-20T01:31:25.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.259+0000 7f709ffff640 1 -- 172.21.15.22:0/4264468067 learned_addr learned my addr 172.21.15.22:0/4264468067 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:25.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.259+0000 7f70a5014640 1 --2- 172.21.15.22:0/4264468067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e8f630 0x556317e89740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:25.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.259+0000 7f709ffff640 1 -- 172.21.15.22:0/4264468067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e8f630 msgr2=0x556317e89740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:25.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.259+0000 7f709ffff640 1 --2- 172.21.15.22:0/4264468067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e8f630 0x556317e89740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.259+0000 7f709ffff640 1 -- 172.21.15.22:0/4264468067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e949a0 msgr2=0x556317eab5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:25.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.259+0000 7f709ffff640 1 --2- 172.21.15.22:0/4264468067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e949a0 0x556317eab5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.259+0000 7f709ffff640 1 -- 172.21.15.22:0/4264468067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556317ea6b20 con 0x556317e91f60 2024-08-20T01:31:25.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.259+0000 7f70a5014640 1 --2- 172.21.15.22:0/4264468067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e8f630 0x556317e89740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:31:25.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.259+0000 7f709ffff640 1 --2- 172.21.15.22:0/4264468067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e91f60 0x556317eab060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f708c00ba60 tx=0x7f708c00b390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51807b494e3b99f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:25.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.259+0000 7f708a7fc640 1 -- 172.21.15.22:0/4264468067 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c011440 con 0x556317e91f60 2024-08-20T01:31:25.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.260+0000 7f708a7fc640 1 -- 172.21.15.22:0/4264468067 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f708c011a90 con 0x556317e91f60 2024-08-20T01:31:25.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.260+0000 7f708a7fc640 1 -- 172.21.15.22:0/4264468067 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c01da60 con 0x556317e91f60 2024-08-20T01:31:25.265 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.261+0000 7f70a9867740 1 -- 172.21.15.22:0/4264468067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e91f60 msgr2=0x556317eab060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:25.265 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.261+0000 7f70a9867740 1 --2- 172.21.15.22:0/4264468067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e91f60 0x556317eab060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f708c00ba60 tx=0x7f708c00b390 comp rx=0 tx=0).stop 2024-08-20T01:31:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.261+0000 7f70a9867740 1 -- 172.21.15.22:0/4264468067 shutdown_connections 2024-08-20T01:31:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.261+0000 7f70a9867740 1 --2- 172.21.15.22:0/4264468067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e949a0 0x556317eab5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.261+0000 7f70a9867740 1 --2- 172.21.15.22:0/4264468067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e91f60 0x556317eab060 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.261+0000 7f70a9867740 1 --2- 172.21.15.22:0/4264468067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e8f630 0x556317e89740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.261+0000 7f70a9867740 1 -- 172.21.15.22:0/4264468067 >> 172.21.15.22:0/4264468067 conn(0x556317e8a730 msgr2=0x556317e89030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.261+0000 7f70a9867740 1 -- 172.21.15.22:0/4264468067 shutdown_connections 2024-08-20T01:31:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.261+0000 7f70a9867740 1 -- 172.21.15.22:0/4264468067 wait complete. 2024-08-20T01:31:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.261+0000 7f70a9867740 1 -- start start 2024-08-20T01:31:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.261+0000 7f70a9867740 1 Processor -- start 2024-08-20T01:31:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.262+0000 7f70a9867740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e8f630 0x556317ea0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.262+0000 7f70a9867740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e91f60 0x556317e9f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.262+0000 7f70a9867740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e949a0 0x556317e9f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.262+0000 7f70a9867740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f70a01a8390 con 0x556317e949a0 2024-08-20T01:31:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.262+0000 7f70a9867740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f70a01a9800 con 0x556317e91f60 2024-08-20T01:31:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.262+0000 7f70a9867740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f70a01a8a60 con 0x556317e8f630 2024-08-20T01:31:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.262+0000 7f709ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e91f60 0x556317e9f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.262+0000 7f709ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e91f60 0x556317e9f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:55416/0 (socket says 172.21.15.22:55416) 2024-08-20T01:31:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.262+0000 7f709ffff640 1 -- 172.21.15.22:0/3639547804 learned_addr learned my addr 172.21.15.22:0/3639547804 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.262+0000 7f70a5014640 1 --2- 172.21.15.22:0/3639547804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e8f630 0x556317ea0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.263+0000 7f70a5014640 1 --2- 172.21.15.22:0/3639547804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e949a0 0x556317e9f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.263+0000 7f70a9867740 10 client.0 _ll_register_callbacks cb 0x7f708c004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.263+0000 7f70a5014640 1 -- 172.21.15.22:0/3639547804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e91f60 msgr2=0x556317e9f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.263+0000 7f70a5014640 1 --2- 172.21.15.22:0/3639547804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e91f60 0x556317e9f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.263+0000 7f70a5014640 1 -- 172.21.15.22:0/3639547804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e949a0 msgr2=0x556317e9f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.263+0000 7f70a5014640 1 --2- 172.21.15.22:0/3639547804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e949a0 0x556317e9f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.263+0000 7f70a5014640 1 -- 172.21.15.22:0/3639547804 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556317ea0090 con 0x556317e8f630 2024-08-20T01:31:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.263+0000 7f709ffff640 1 --2- 172.21.15.22:0/3639547804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e91f60 0x556317e9f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:31:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.263+0000 7f70a9867740 1 -- 172.21.15.22:0/3639547804 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f708c011a90 con 0x556317e8f630 2024-08-20T01:31:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.263+0000 7f70a5014640 1 --2- 172.21.15.22:0/3639547804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e8f630 0x556317ea0760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7098005b40 tx=0x7f7098000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cc27bc2158e15f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.263+0000 7f707ffff640 10 client.25045 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:31:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.263+0000 7f707ffff640 1 -- 172.21.15.22:0/3639547804 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7098028030 con 0x556317e8f630 2024-08-20T01:31:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.263+0000 7f707ffff640 1 -- 172.21.15.22:0/3639547804 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f7098004250 con 0x556317e8f630 2024-08-20T01:31:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.263+0000 7f707ffff640 1 -- 172.21.15.22:0/3639547804 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f709800f4e0 con 0x556317e8f630 2024-08-20T01:31:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.263+0000 7f70a9867740 10 client.25045 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.263+0000 7f70a9867740 1 -- 172.21.15.22:0/3639547804 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({fsmap=25}) -- 0x556317f0f040 con 0x556317e8f630 2024-08-20T01:31:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.264+0000 7f707ffff640 1 -- 172.21.15.22:0/3639547804 <== mon.1 v2:172.21.15.134:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f709800f680 con 0x556317e8f630 2024-08-20T01:31:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.264+0000 7f70a9867740 10 client.25045 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.264+0000 7f70a9867740 10 client.25045 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:31:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.264+0000 7f70a9867740 20 client.25045 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.264+0000 7f70a9867740 1 --2- 172.21.15.22:0/3639547804 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556317ea43c0 0x556317f117a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.264+0000 7f70a9867740 4 client.25045 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:31:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.264+0000 7f70a9867740 1 -- 172.21.15.22:0/3639547804 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556317dffd50 con 0x556317ea43c0 2024-08-20T01:31:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.264+0000 7f709ffff640 1 --2- 172.21.15.22:0/3639547804 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556317ea43c0 0x556317f117a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.265+0000 7f707ffff640 10 client.25045 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.265+0000 7f709ffff640 1 --2- 172.21.15.22:0/3639547804 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556317ea43c0 0x556317f117a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cfc1646404597cc server_cookie=71e896fc72809793 in_seq=0 out_seq=0 2024-08-20T01:31:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.273+0000 7f707ffff640 1 -- 172.21.15.22:0/3639547804 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556317dffd50 con 0x556317ea43c0 2024-08-20T01:31:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.273+0000 7f707ffff640 10 client.25045 handle_command_reply: tid=0 2024-08-20T01:31:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.273+0000 7f70a9867740 1 client.25045 shutdown 2024-08-20T01:31:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.273+0000 7f70a9867740 1 -- 172.21.15.22:0/3639547804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e8f630 msgr2=0x556317ea0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.273+0000 7f70a9867740 1 --2- 172.21.15.22:0/3639547804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e8f630 0x556317ea0760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7098005b40 tx=0x7f7098000f40 comp rx=0 tx=0).stop 2024-08-20T01:31:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.273+0000 7f70a9867740 1 -- 172.21.15.22:0/3639547804 shutdown_connections 2024-08-20T01:31:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.273+0000 7f70a9867740 1 --2- 172.21.15.22:0/3639547804 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556317ea43c0 0x556317f117a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.273+0000 7f70a9867740 1 --2- 172.21.15.22:0/3639547804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556317e949a0 0x556317e9f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.273+0000 7f707ffff640 0 client.25045 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.273+0000 7f70a9867740 1 --2- 172.21.15.22:0/3639547804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556317e91f60 0x556317e9f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.273+0000 7f70a9867740 1 --2- 172.21.15.22:0/3639547804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556317e8f630 0x556317ea0760 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.273+0000 7f70a9867740 1 -- 172.21.15.22:0/3639547804 >> 172.21.15.22:0/3639547804 conn(0x556317e8a730 msgr2=0x556317e89850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.273+0000 7f70a9867740 1 -- 172.21.15.22:0/3639547804 shutdown_connections 2024-08-20T01:31:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.273+0000 7f70a9867740 1 -- 172.21.15.22:0/3639547804 wait complete. 2024-08-20T01:31:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.273+0000 7f70a9867740 20 client.25045 trim_cache size 0 max 16384 2024-08-20T01:31:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:31:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:31:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:31:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:31:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.274+0000 7f70a6a77640 1 -- 172.21.15.22:0/2107071420 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70900b3bd0 msgr2=0x7f70900b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.274+0000 7f70a6a77640 1 --2- 172.21.15.22:0/2107071420 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70900b3bd0 0x7f70900b6090 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7094005ec0 tx=0x7f709402a420 comp rx=0 tx=0).stop 2024-08-20T01:31:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.274+0000 7f70a6a77640 1 -- 172.21.15.22:0/2107071420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a0102680 msgr2=0x7f70a0198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.274+0000 7f70a6a77640 1 --2- 172.21.15.22:0/2107071420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a0102680 0x7f70a0198ad0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7094009a50 tx=0x7f70940042f0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.274+0000 7f70a6a77640 1 -- 172.21.15.22:0/2107071420 shutdown_connections 2024-08-20T01:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.274+0000 7f70a6a77640 1 --2- 172.21.15.22:0/2107071420 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f70900b3bd0 0x7f70900b6090 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.274+0000 7f70a6a77640 1 --2- 172.21.15.22:0/2107071420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a0104190 0x7f70a0199d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.274+0000 7f70a6a77640 1 --2- 172.21.15.22:0/2107071420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70a01037d0 0x7f70a0199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.274+0000 7f70a6a77640 1 --2- 172.21.15.22:0/2107071420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a0102680 0x7f70a0198ad0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.274+0000 7f70a6a77640 1 -- 172.21.15.22:0/2107071420 >> 172.21.15.22:0/2107071420 conn(0x7f70a00fdf40 msgr2=0x7f70a0106c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.274+0000 7f70a6a77640 1 -- 172.21.15.22:0/2107071420 shutdown_connections 2024-08-20T01:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:25.274+0000 7f70a6a77640 1 -- 172.21.15.22:0/2107071420 wait complete. 2024-08-20T01:31:27.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:26 smithi134 ceph-mon[22511]: pgmap v355: 97 pgs: 97 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-08-20T01:31:27.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:26 smithi077 ceph-mon[22251]: pgmap v355: 97 pgs: 97 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-08-20T01:31:27.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:26 smithi022 ceph-mon[18709]: pgmap v355: 97 pgs: 97 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-08-20T01:31:29.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:28 smithi134 ceph-mon[22511]: pgmap v356: 97 pgs: 97 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-08-20T01:31:29.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:28 smithi077 ceph-mon[22251]: pgmap v356: 97 pgs: 97 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-08-20T01:31:29.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:28 smithi022 ceph-mon[18709]: pgmap v356: 97 pgs: 97 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-08-20T01:31:31.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:30 smithi134 ceph-mon[22511]: pgmap v357: 97 pgs: 97 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 682 B/s wr, 5 op/s 2024-08-20T01:31:31.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:30 smithi077 ceph-mon[22251]: pgmap v357: 97 pgs: 97 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 682 B/s wr, 5 op/s 2024-08-20T01:31:31.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:30 smithi022 ceph-mon[18709]: pgmap v357: 97 pgs: 97 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 682 B/s wr, 5 op/s 2024-08-20T01:31:32.373 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:31:32.703 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:31:32.970 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:32 smithi022 ceph-mon[18709]: pgmap v358: 97 pgs: 97 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-08-20T01:31:33.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:32 smithi134 ceph-mon[22511]: pgmap v358: 97 pgs: 97 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-08-20T01:31:33.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:32 smithi077 ceph-mon[22251]: pgmap v358: 97 pgs: 97 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-08-20T01:31:33.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.191+0000 7f6463fae640 1 -- 172.21.15.22:0/657680601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f645c101990 msgr2=0x7f645c101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:33.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.191+0000 7f6463fae640 1 --2- 172.21.15.22:0/657680601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f645c101990 0x7f645c101d70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6458009900 tx=0x7f645802a410 comp rx=0 tx=0).stop 2024-08-20T01:31:33.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.191+0000 7f6463fae640 1 -- 172.21.15.22:0/657680601 shutdown_connections 2024-08-20T01:31:33.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.191+0000 7f6463fae640 1 --2- 172.21.15.22:0/657680601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f645c107d20 0x7f645c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.191+0000 7f6463fae640 1 --2- 172.21.15.22:0/657680601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f645c1073a0 0x7f645c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.191+0000 7f6463fae640 1 --2- 172.21.15.22:0/657680601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f645c101990 0x7f645c101d70 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.191+0000 7f6463fae640 1 -- 172.21.15.22:0/657680601 >> 172.21.15.22:0/657680601 conn(0x7f645c0fd400 msgr2=0x7f645c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:33.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.191+0000 7f6463fae640 1 -- 172.21.15.22:0/657680601 shutdown_connections 2024-08-20T01:31:33.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.191+0000 7f6463fae640 1 -- 172.21.15.22:0/657680601 wait complete. 2024-08-20T01:31:33.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.192+0000 7f6463fae640 1 Processor -- start 2024-08-20T01:31:33.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.192+0000 7f6463fae640 1 -- start start 2024-08-20T01:31:33.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.192+0000 7f6463fae640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f645c101990 0x7f645c103250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:33.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.193+0000 7f6463fae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f645c1073a0 0x7f645c103790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:33.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.193+0000 7f6463fae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f645c107d20 0x7f645c103cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:33.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.193+0000 7f6463fae640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f645c1119e0 con 0x7f645c101990 2024-08-20T01:31:33.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.193+0000 7f6461d4a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f645c101990 0x7f645c103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:33.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.193+0000 7f6463fae640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f645c111860 con 0x7f645c1073a0 2024-08-20T01:31:33.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.193+0000 7f6463fae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f645c111b60 con 0x7f645c107d20 2024-08-20T01:31:33.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.193+0000 7f6461d4a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f645c101990 0x7f645c103250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43522/0 (socket says 172.21.15.22:43522) 2024-08-20T01:31:33.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.193+0000 7f6461d4a640 1 -- 172.21.15.22:0/3927340995 learned_addr learned my addr 172.21.15.22:0/3927340995 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:33.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.193+0000 7f6461549640 1 --2- 172.21.15.22:0/3927340995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f645c1073a0 0x7f645c103790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:33.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.193+0000 7f646254b640 1 --2- 172.21.15.22:0/3927340995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f645c107d20 0x7f645c103cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:33.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.193+0000 7f6461d4a640 1 -- 172.21.15.22:0/3927340995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f645c107d20 msgr2=0x7f645c103cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:33.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.193+0000 7f6461d4a640 1 --2- 172.21.15.22:0/3927340995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f645c107d20 0x7f645c103cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.193+0000 7f6461d4a640 1 -- 172.21.15.22:0/3927340995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f645c1073a0 msgr2=0x7f645c103790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:33.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.193+0000 7f6461d4a640 1 --2- 172.21.15.22:0/3927340995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f645c1073a0 0x7f645c103790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.193+0000 7f6461d4a640 1 -- 172.21.15.22:0/3927340995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645c1a7400 con 0x7f645c101990 2024-08-20T01:31:33.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.193+0000 7f646254b640 1 --2- 172.21.15.22:0/3927340995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f645c107d20 0x7f645c103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:31:33.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.193+0000 7f6461d4a640 1 --2- 172.21.15.22:0/3927340995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f645c101990 0x7f645c103250 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6458005940 tx=0x7f64580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:33.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.194+0000 7f6452ffd640 1 -- 172.21.15.22:0/3927340995 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645803f030 con 0x7f645c101990 2024-08-20T01:31:33.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.194+0000 7f6463fae640 1 -- 172.21.15.22:0/3927340995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f645c1a7690 con 0x7f645c101990 2024-08-20T01:31:33.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.194+0000 7f6463fae640 1 -- 172.21.15.22:0/3927340995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f645c1a7bc0 con 0x7f645c101990 2024-08-20T01:31:33.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.194+0000 7f6452ffd640 1 -- 172.21.15.22:0/3927340995 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6458003cb0 con 0x7f645c101990 2024-08-20T01:31:33.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.194+0000 7f6452ffd640 1 -- 172.21.15.22:0/3927340995 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645803f030 con 0x7f645c101990 2024-08-20T01:31:33.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.197+0000 7f64663a7740 1 Processor -- start 2024-08-20T01:31:33.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.197+0000 7f64663a7740 1 -- start start 2024-08-20T01:31:33.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.198+0000 7f64663a7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef146a830 0x55eef146ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:33.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.198+0000 7f64663a7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eef146b150 0x55eef1476ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:33.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.198+0000 7f64663a7740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef14770e0 0x55eef14794d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:33.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.198+0000 7f64663a7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55eef13e18e0 con 0x55eef146a830 2024-08-20T01:31:33.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.198+0000 7f64663a7740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55eef13d0de0 con 0x55eef14770e0 2024-08-20T01:31:33.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.198+0000 7f64663a7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55eef13d4e20 con 0x55eef146b150 2024-08-20T01:31:33.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.198+0000 7f6461549640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef14770e0 0x55eef14794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:33.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.198+0000 7f646254b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef146a830 0x55eef146ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:33.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.198+0000 7f6461549640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef14770e0 0x55eef14794d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:55040/0 (socket says 172.21.15.22:55040) 2024-08-20T01:31:33.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.198+0000 7f6461549640 1 -- 172.21.15.22:0/2309632320 learned_addr learned my addr 172.21.15.22:0/2309632320 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:33.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.198+0000 7f6461549640 1 -- 172.21.15.22:0/2309632320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eef146b150 msgr2=0x55eef1476ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:31:33.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.198+0000 7f6461549640 1 --2- 172.21.15.22:0/2309632320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eef146b150 0x55eef1476ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.198+0000 7f6461549640 1 -- 172.21.15.22:0/2309632320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef146a830 msgr2=0x55eef146ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:33.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.198+0000 7f6461549640 1 --2- 172.21.15.22:0/2309632320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef146a830 0x55eef146ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.198+0000 7f6452ffd640 1 -- 172.21.15.22:0/3927340995 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6458042030 con 0x7f645c101990 2024-08-20T01:31:33.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.198+0000 7f6461549640 1 -- 172.21.15.22:0/2309632320 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eef1130650 con 0x55eef14770e0 2024-08-20T01:31:33.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.198+0000 7f646254b640 1 --2- 172.21.15.22:0/2309632320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef146a830 0x55eef146ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:31:33.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.199+0000 7f6461549640 1 --2- 172.21.15.22:0/2309632320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef14770e0 0x55eef14794d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f644c00bc80 tx=0x7f644c00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db94b34a10be231d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:33.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.199+0000 7f6447fff640 1 -- 172.21.15.22:0/2309632320 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c015070 con 0x55eef14770e0 2024-08-20T01:31:33.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.199+0000 7f6447fff640 1 -- 172.21.15.22:0/2309632320 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f644c01a910 con 0x55eef14770e0 2024-08-20T01:31:33.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.199+0000 7f6447fff640 1 -- 172.21.15.22:0/2309632320 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c011900 con 0x55eef14770e0 2024-08-20T01:31:33.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.200+0000 7f6452ffd640 1 --2- 172.21.15.22:0/3927340995 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f64480b3fc0 0x7f64480b6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:33.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.200+0000 7f6452ffd640 1 -- 172.21.15.22:0/3927340995 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f6458040070 con 0x7f645c101990 2024-08-20T01:31:33.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.200+0000 7f646254b640 1 --2- 172.21.15.22:0/3927340995 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f64480b3fc0 0x7f64480b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:33.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.200+0000 7f64663a7740 1 -- 172.21.15.22:0/2309632320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef14770e0 msgr2=0x55eef14794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:33.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.200+0000 7f64663a7740 1 --2- 172.21.15.22:0/2309632320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef14770e0 0x55eef14794d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f644c00bc80 tx=0x7f644c00f730 comp rx=0 tx=0).stop 2024-08-20T01:31:33.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.200+0000 7f64663a7740 1 -- 172.21.15.22:0/2309632320 shutdown_connections 2024-08-20T01:31:33.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.200+0000 7f64663a7740 1 --2- 172.21.15.22:0/2309632320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef14770e0 0x55eef14794d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.200+0000 7f64663a7740 1 --2- 172.21.15.22:0/2309632320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eef146b150 0x55eef1476ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.200+0000 7f64663a7740 1 --2- 172.21.15.22:0/2309632320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef146a830 0x55eef146ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.200+0000 7f64663a7740 1 -- 172.21.15.22:0/2309632320 >> 172.21.15.22:0/2309632320 conn(0x55eef1468660 msgr2=0x55eef1469800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:33.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.201+0000 7f646254b640 1 --2- 172.21.15.22:0/3927340995 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f64480b3fc0 0x7f64480b6480 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f645c105310 tx=0x7f6454009820 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:33.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.201+0000 7f64663a7740 1 -- 172.21.15.22:0/2309632320 shutdown_connections 2024-08-20T01:31:33.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.201+0000 7f64663a7740 1 -- 172.21.15.22:0/2309632320 wait complete. 2024-08-20T01:31:33.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.201+0000 7f64663a7740 1 -- start start 2024-08-20T01:31:33.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.201+0000 7f64663a7740 1 Processor -- start 2024-08-20T01:31:33.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.202+0000 7f64663a7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eef146a830 0x55eef14740a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:33.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.202+0000 7f64663a7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef146b150 0x55eef14745e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:33.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.202+0000 7f64663a7740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef14770e0 0x55eef1474b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:33.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.202+0000 7f6461549640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef146b150 0x55eef14745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:33.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.202+0000 7f64663a7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55eef1233700 con 0x55eef146b150 2024-08-20T01:31:33.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.202+0000 7f6461549640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef146b150 0x55eef14745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43550/0 (socket says 172.21.15.22:43550) 2024-08-20T01:31:33.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.202+0000 7f64663a7740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55eef13577c0 con 0x55eef14770e0 2024-08-20T01:31:33.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.202+0000 7f64663a7740 1 -- 172.21.15.22:0/3075945160 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55eef1479d90 con 0x55eef146a830 2024-08-20T01:31:33.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.202+0000 7f6461549640 1 -- 172.21.15.22:0/3075945160 learned_addr learned my addr 172.21.15.22:0/3075945160 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:33.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.202+0000 7f64663a7740 10 client.0 _ll_register_callbacks cb 0x55eef13ca6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:33.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.202+0000 7f6461549640 1 -- 172.21.15.22:0/3075945160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eef146a830 msgr2=0x55eef14740a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:33.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.202+0000 7f6461549640 1 --2- 172.21.15.22:0/3075945160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eef146a830 0x55eef14740a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.202+0000 7f6461549640 1 -- 172.21.15.22:0/3075945160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef14770e0 msgr2=0x55eef1474b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:33.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.202+0000 7f6461549640 1 --2- 172.21.15.22:0/3075945160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef14770e0 0x55eef1474b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.202+0000 7f6461549640 1 -- 172.21.15.22:0/3075945160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eef1483200 con 0x55eef146b150 2024-08-20T01:31:33.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.202+0000 7f6461549640 1 --2- 172.21.15.22:0/3075945160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef146b150 0x55eef14745e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f644c011520 tx=0x7f644c00bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74cba536f86aa6f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:33.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.202+0000 7f64457fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:31:33.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.203+0000 7f64457fa640 1 -- 172.21.15.22:0/3075945160 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c028060 con 0x55eef146b150 2024-08-20T01:31:33.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.203+0000 7f64663a7740 1 -- 172.21.15.22:0/3075945160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eef1380100 con 0x55eef146b150 2024-08-20T01:31:33.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.203+0000 7f64457fa640 1 -- 172.21.15.22:0/3075945160 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f644c005310 con 0x55eef146b150 2024-08-20T01:31:33.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.204+0000 7f64457fa640 1 -- 172.21.15.22:0/3075945160 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f644c015070 con 0x55eef146b150 2024-08-20T01:31:33.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.204+0000 7f64663a7740 10 client.15408 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:33.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.204+0000 7f64663a7740 1 -- 172.21.15.22:0/3075945160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55eef1485bc0 con 0x55eef146b150 2024-08-20T01:31:33.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.204+0000 7f64457fa640 1 -- 172.21.15.22:0/3075945160 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55eef1380100 con 0x55eef146b150 2024-08-20T01:31:33.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.204+0000 7f64457fa640 1 -- 172.21.15.22:0/3075945160 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f644c004820 con 0x55eef146b150 2024-08-20T01:31:33.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.204+0000 7f64663a7740 10 client.15408 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:33.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.204+0000 7f64663a7740 10 client.15408 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:31:33.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.204+0000 7f64663a7740 20 client.15408 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:33.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.204+0000 7f64663a7740 1 --2- 172.21.15.22:0/3075945160 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55eef14873d0 0x55eef1489890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:33.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.204+0000 7f64663a7740 4 client.15408 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:31:33.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.204+0000 7f64663a7740 1 -- 172.21.15.22:0/3075945160 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eef13e3830 con 0x55eef14873d0 2024-08-20T01:31:33.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.205+0000 7f6461d4a640 1 --2- 172.21.15.22:0/3075945160 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55eef14873d0 0x55eef1489890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:33.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.205+0000 7f64457fa640 10 client.15408 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:33.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.205+0000 7f6461d4a640 1 --2- 172.21.15.22:0/3075945160 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55eef14873d0 0x55eef1489890 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d599da65f93ebf13 server_cookie=b9f637babfb398ff in_seq=0 out_seq=0 2024-08-20T01:31:33.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.206+0000 7f64457fa640 1 -- 172.21.15.22:0/3075945160 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eef13e3830 con 0x55eef14873d0 2024-08-20T01:31:33.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.206+0000 7f64457fa640 10 client.15408 handle_command_reply: tid=0 2024-08-20T01:31:33.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.206+0000 7f64663a7740 1 client.15408 shutdown 2024-08-20T01:31:33.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.206+0000 7f64663a7740 1 -- 172.21.15.22:0/3075945160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef146b150 msgr2=0x55eef14745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:33.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.206+0000 7f64663a7740 1 --2- 172.21.15.22:0/3075945160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef146b150 0x55eef14745e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f644c011520 tx=0x7f644c00bfa0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.206+0000 7f64663a7740 1 -- 172.21.15.22:0/3075945160 shutdown_connections 2024-08-20T01:31:33.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.206+0000 7f64663a7740 1 --2- 172.21.15.22:0/3075945160 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55eef14873d0 0x55eef1489890 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.206+0000 7f64663a7740 1 --2- 172.21.15.22:0/3075945160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef14770e0 0x55eef1474b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.206+0000 7f64663a7740 1 --2- 172.21.15.22:0/3075945160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef146b150 0x55eef14745e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.206+0000 7f64663a7740 1 --2- 172.21.15.22:0/3075945160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eef146a830 0x55eef14740a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.206+0000 7f64663a7740 1 -- 172.21.15.22:0/3075945160 >> 172.21.15.22:0/3075945160 conn(0x55eef1468660 msgr2=0x55eef146e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:33.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.206+0000 7f64457fa640 0 client.15408 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:33.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.206+0000 7f64663a7740 1 -- 172.21.15.22:0/3075945160 shutdown_connections 2024-08-20T01:31:33.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.206+0000 7f64663a7740 1 -- 172.21.15.22:0/3075945160 wait complete. 2024-08-20T01:31:33.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.206+0000 7f64663a7740 20 client.15408 trim_cache size 0 max 16384 2024-08-20T01:31:33.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.238+0000 7f64663a7740 1 Processor -- start 2024-08-20T01:31:33.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.238+0000 7f64663a7740 1 -- start start 2024-08-20T01:31:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.238+0000 7f64663a7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eef146a830 0x55eef146e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.238+0000 7f64663a7740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef14770e0 0x55eef1463380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.238+0000 7f64663a7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef1473030 0x55eef148f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.238+0000 7f64663a7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6440010f80 con 0x55eef1473030 2024-08-20T01:31:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.238+0000 7f64663a7740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f644000e850 con 0x55eef14770e0 2024-08-20T01:31:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.238+0000 7f64663a7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f644000c6a0 con 0x55eef146a830 2024-08-20T01:31:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.238+0000 7f646254b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef1473030 0x55eef148f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.238+0000 7f646254b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef1473030 0x55eef148f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43564/0 (socket says 172.21.15.22:43564) 2024-08-20T01:31:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.238+0000 7f646254b640 1 -- 172.21.15.22:0/3551147140 learned_addr learned my addr 172.21.15.22:0/3551147140 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.239+0000 7f6461549640 1 --2- 172.21.15.22:0/3551147140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef14770e0 0x55eef1463380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.239+0000 7f646254b640 1 -- 172.21.15.22:0/3551147140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eef146a830 msgr2=0x55eef146e9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:31:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.239+0000 7f646254b640 1 --2- 172.21.15.22:0/3551147140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eef146a830 0x55eef146e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.239+0000 7f646254b640 1 -- 172.21.15.22:0/3551147140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef14770e0 msgr2=0x55eef1463380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.239+0000 7f646254b640 1 --2- 172.21.15.22:0/3551147140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef14770e0 0x55eef1463380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.239+0000 7f646254b640 1 -- 172.21.15.22:0/3551147140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eef1469d90 con 0x55eef1473030 2024-08-20T01:31:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.239+0000 7f646254b640 1 --2- 172.21.15.22:0/3551147140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef1473030 0x55eef148f160 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6454011650 tx=0x7f6454015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1caf0925dc79779 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.240+0000 7f64477fe640 1 -- 172.21.15.22:0/3551147140 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454004b20 con 0x55eef1473030 2024-08-20T01:31:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.240+0000 7f64477fe640 1 -- 172.21.15.22:0/3551147140 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6454004cc0 con 0x55eef1473030 2024-08-20T01:31:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.240+0000 7f64477fe640 1 -- 172.21.15.22:0/3551147140 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64540286e0 con 0x55eef1473030 2024-08-20T01:31:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.240+0000 7f64663a7740 1 -- 172.21.15.22:0/3551147140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef1473030 msgr2=0x55eef148f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.240+0000 7f64663a7740 1 --2- 172.21.15.22:0/3551147140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef1473030 0x55eef148f160 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6454011650 tx=0x7f6454015040 comp rx=0 tx=0).stop 2024-08-20T01:31:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.241+0000 7f64663a7740 1 -- 172.21.15.22:0/3551147140 shutdown_connections 2024-08-20T01:31:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.241+0000 7f64663a7740 1 --2- 172.21.15.22:0/3551147140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef1473030 0x55eef148f160 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.241+0000 7f64663a7740 1 --2- 172.21.15.22:0/3551147140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef14770e0 0x55eef1463380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.241+0000 7f64663a7740 1 --2- 172.21.15.22:0/3551147140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eef146a830 0x55eef146e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.241+0000 7f64663a7740 1 -- 172.21.15.22:0/3551147140 >> 172.21.15.22:0/3551147140 conn(0x55eef1468660 msgr2=0x55eef1472920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:33.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.241+0000 7f64663a7740 1 -- 172.21.15.22:0/3551147140 shutdown_connections 2024-08-20T01:31:33.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.241+0000 7f64663a7740 1 -- 172.21.15.22:0/3551147140 wait complete. 2024-08-20T01:31:33.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.241+0000 7f64663a7740 1 -- start start 2024-08-20T01:31:33.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.241+0000 7f64663a7740 1 Processor -- start 2024-08-20T01:31:33.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.242+0000 7f64663a7740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef146a830 0x55eef147f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:33.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.242+0000 7f64663a7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef1473030 0x55eef147d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:33.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.242+0000 7f64663a7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eef14770e0 0x55eef147d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:33.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.242+0000 7f64663a7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f644000cd10 con 0x55eef1473030 2024-08-20T01:31:33.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.242+0000 7f64663a7740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f644000e180 con 0x55eef146a830 2024-08-20T01:31:33.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.242+0000 7f64663a7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f644000d3e0 con 0x55eef14770e0 2024-08-20T01:31:33.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.242+0000 7f64663a7740 10 client.0 _ll_register_callbacks cb 0x7f64540096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:33.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.242+0000 7f6461549640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef1473030 0x55eef147d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:33.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.242+0000 7f6461549640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef1473030 0x55eef147d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43576/0 (socket says 172.21.15.22:43576) 2024-08-20T01:31:33.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.242+0000 7f6461549640 1 -- 172.21.15.22:0/1175942583 learned_addr learned my addr 172.21.15.22:0/1175942583 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:33.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.243+0000 7f6461d4a640 1 --2- 172.21.15.22:0/1175942583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef146a830 0x55eef147f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:33.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.243+0000 7f6461549640 1 -- 172.21.15.22:0/1175942583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eef14770e0 msgr2=0x55eef147d860 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:31:33.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.243+0000 7f6461549640 1 --2- 172.21.15.22:0/1175942583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eef14770e0 0x55eef147d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.243+0000 7f6461549640 1 -- 172.21.15.22:0/1175942583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef146a830 msgr2=0x55eef147f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:33.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.243+0000 7f6461549640 1 --2- 172.21.15.22:0/1175942583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef146a830 0x55eef147f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.243+0000 7f6461549640 1 -- 172.21.15.22:0/1175942583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eef147e090 con 0x55eef1473030 2024-08-20T01:31:33.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.243+0000 7f6461549640 1 --2- 172.21.15.22:0/1175942583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef1473030 0x55eef147d2a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f644c000c00 tx=0x7f644c00b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb7d93c814f7228 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:33.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.243+0000 7f64457fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:31:33.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.243+0000 7f64457fa640 1 -- 172.21.15.22:0/1175942583 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c028070 con 0x55eef1473030 2024-08-20T01:31:33.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.243+0000 7f64457fa640 1 -- 172.21.15.22:0/1175942583 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f644c01a460 con 0x55eef1473030 2024-08-20T01:31:33.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.243+0000 7f64663a7740 1 -- 172.21.15.22:0/1175942583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6454004cc0 con 0x55eef1473030 2024-08-20T01:31:33.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.244+0000 7f64457fa640 1 -- 172.21.15.22:0/1175942583 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f644c032080 con 0x55eef1473030 2024-08-20T01:31:33.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.244+0000 7f64663a7740 10 client.15414 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:33.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.244+0000 7f64663a7740 1 -- 172.21.15.22:0/1175942583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55eef14f1210 con 0x55eef1473030 2024-08-20T01:31:33.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.244+0000 7f64457fa640 1 -- 172.21.15.22:0/1175942583 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6454004cc0 con 0x55eef1473030 2024-08-20T01:31:33.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.244+0000 7f64457fa640 1 -- 172.21.15.22:0/1175942583 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f644c011550 con 0x55eef1473030 2024-08-20T01:31:33.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.244+0000 7f64663a7740 10 client.15414 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:33.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.244+0000 7f64663a7740 10 client.15414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:31:33.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.244+0000 7f64663a7740 20 client.15414 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:33.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.244+0000 7f64663a7740 1 --2- 172.21.15.22:0/1175942583 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55eef14f1910 0x55eef14f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:33.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.244+0000 7f64663a7740 4 client.15414 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:31:33.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.244+0000 7f64663a7740 1 -- 172.21.15.22:0/1175942583 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55eef13df2d0 con 0x55eef14f1910 2024-08-20T01:31:33.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.245+0000 7f6461d4a640 1 --2- 172.21.15.22:0/1175942583 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55eef14f1910 0x55eef14f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:33.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.245+0000 7f6461d4a640 1 --2- 172.21.15.22:0/1175942583 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55eef14f1910 0x55eef14f3d30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=520ceee8d5ffa51d server_cookie=7b83e074affc87c3 in_seq=0 out_seq=0 2024-08-20T01:31:33.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.245+0000 7f64457fa640 10 client.15414 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:33.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.245+0000 7f64457fa640 1 -- 172.21.15.22:0/1175942583 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55eef13df2d0 con 0x55eef14f1910 2024-08-20T01:31:33.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.245+0000 7f64457fa640 10 client.15414 handle_command_reply: tid=0 2024-08-20T01:31:33.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.245+0000 7f64663a7740 1 client.15414 shutdown 2024-08-20T01:31:33.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.245+0000 7f64663a7740 1 -- 172.21.15.22:0/1175942583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef1473030 msgr2=0x55eef147d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:33.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.245+0000 7f64663a7740 1 --2- 172.21.15.22:0/1175942583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef1473030 0x55eef147d2a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f644c000c00 tx=0x7f644c00b9d0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.246+0000 7f64663a7740 1 -- 172.21.15.22:0/1175942583 shutdown_connections 2024-08-20T01:31:33.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.246+0000 7f64663a7740 1 --2- 172.21.15.22:0/1175942583 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55eef14f1910 0x55eef14f3d30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.251 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:31:33.251 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-08-20T01:31:33.252 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-08-20T01:31:33.252 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:31:33.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.246+0000 7f64663a7740 1 --2- 172.21.15.22:0/1175942583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eef14770e0 0x55eef147d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.246+0000 7f64663a7740 1 --2- 172.21.15.22:0/1175942583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eef1473030 0x55eef147d2a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.246+0000 7f64663a7740 1 --2- 172.21.15.22:0/1175942583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eef146a830 0x55eef147f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.246+0000 7f64663a7740 1 -- 172.21.15.22:0/1175942583 >> 172.21.15.22:0/1175942583 conn(0x55eef1468660 msgr2=0x55eef14740a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:33.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.246+0000 7f64457fa640 0 client.15414 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:33.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.246+0000 7f64663a7740 1 -- 172.21.15.22:0/1175942583 shutdown_connections 2024-08-20T01:31:33.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.246+0000 7f64663a7740 1 -- 172.21.15.22:0/1175942583 wait complete. 2024-08-20T01:31:33.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.246+0000 7f64663a7740 20 client.15414 trim_cache size 0 max 16384 2024-08-20T01:31:33.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.246+0000 7f6463fae640 1 -- 172.21.15.22:0/3927340995 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f64480b3fc0 msgr2=0x7f64480b6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:33.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.246+0000 7f6463fae640 1 --2- 172.21.15.22:0/3927340995 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f64480b3fc0 0x7f64480b6480 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f645c105310 tx=0x7f6454009820 comp rx=0 tx=0).stop 2024-08-20T01:31:33.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.247+0000 7f6463fae640 1 -- 172.21.15.22:0/3927340995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f645c101990 msgr2=0x7f645c103250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:33.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.247+0000 7f6463fae640 1 --2- 172.21.15.22:0/3927340995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f645c101990 0x7f645c103250 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6458005940 tx=0x7f64580042f0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.247+0000 7f6463fae640 1 -- 172.21.15.22:0/3927340995 shutdown_connections 2024-08-20T01:31:33.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.247+0000 7f6463fae640 1 --2- 172.21.15.22:0/3927340995 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f64480b3fc0 0x7f64480b6480 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.247+0000 7f6463fae640 1 --2- 172.21.15.22:0/3927340995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f645c107d20 0x7f645c103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.247+0000 7f6463fae640 1 --2- 172.21.15.22:0/3927340995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f645c1073a0 0x7f645c103790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.247+0000 7f6463fae640 1 --2- 172.21.15.22:0/3927340995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f645c101990 0x7f645c103250 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:33.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.247+0000 7f6463fae640 1 -- 172.21.15.22:0/3927340995 >> 172.21.15.22:0/3927340995 conn(0x7f645c0fd400 msgr2=0x7f645c06aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:33.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.251+0000 7f6463fae640 1 -- 172.21.15.22:0/3927340995 shutdown_connections 2024-08-20T01:31:33.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:33.251+0000 7f6463fae640 1 -- 172.21.15.22:0/3927340995 wait complete. 2024-08-20T01:31:34.093 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:31:34.094 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:31:34.474 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:31:34.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:34 smithi022 ceph-mon[18709]: pgmap v359: 97 pgs: 97 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-08-20T01:31:35.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.993+0000 7fb170a4a640 1 -- 172.21.15.22:0/3830681566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb16c1073a0 msgr2=0x7fb16c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:35.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.993+0000 7fb170a4a640 1 --2- 172.21.15.22:0/3830681566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb16c1073a0 0x7fb16c1077e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb160009900 tx=0x7fb16002a410 comp rx=0 tx=0).stop 2024-08-20T01:31:35.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.993+0000 7fb170a4a640 1 -- 172.21.15.22:0/3830681566 shutdown_connections 2024-08-20T01:31:35.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.993+0000 7fb170a4a640 1 --2- 172.21.15.22:0/3830681566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb16c107d20 0x7fb16c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:35.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.993+0000 7fb170a4a640 1 --2- 172.21.15.22:0/3830681566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb16c1073a0 0x7fb16c1077e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:35.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.993+0000 7fb170a4a640 1 --2- 172.21.15.22:0/3830681566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb16c101990 0x7fb16c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:35.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.993+0000 7fb170a4a640 1 -- 172.21.15.22:0/3830681566 >> 172.21.15.22:0/3830681566 conn(0x7fb16c0fd400 msgr2=0x7fb16c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:35.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.993+0000 7fb170a4a640 1 -- 172.21.15.22:0/3830681566 shutdown_connections 2024-08-20T01:31:35.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.993+0000 7fb170a4a640 1 -- 172.21.15.22:0/3830681566 wait complete. 2024-08-20T01:31:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.994+0000 7fb170a4a640 1 Processor -- start 2024-08-20T01:31:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.994+0000 7fb170a4a640 1 -- start start 2024-08-20T01:31:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.995+0000 7fb170a4a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb16c101990 0x7fb16c196dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.995+0000 7fb170a4a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb16c1073a0 0x7fb16c197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.995+0000 7fb170a4a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb16c107d20 0x7fb16c19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.995+0000 7fb170a4a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c1108b0 con 0x7fb16c1073a0 2024-08-20T01:31:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.995+0000 7fb170a4a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c110730 con 0x7fb16c107d20 2024-08-20T01:31:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.995+0000 7fb170a4a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c110a30 con 0x7fb16c101990 2024-08-20T01:31:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.995+0000 7fb16ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb16c107d20 0x7fb16c19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.995+0000 7fb16ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb16c107d20 0x7fb16c19c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:55094/0 (socket says 172.21.15.22:55094) 2024-08-20T01:31:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.995+0000 7fb16ad9d640 1 -- 172.21.15.22:0/3424991457 learned_addr learned my addr 172.21.15.22:0/3424991457 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.995+0000 7fb16a59c640 1 --2- 172.21.15.22:0/3424991457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb16c101990 0x7fb16c196dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:35.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.995+0000 7fb169d9b640 1 --2- 172.21.15.22:0/3424991457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb16c1073a0 0x7fb16c197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.995+0000 7fb16ad9d640 1 -- 172.21.15.22:0/3424991457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb16c101990 msgr2=0x7fb16c196dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.995+0000 7fb16ad9d640 1 --2- 172.21.15.22:0/3424991457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb16c101990 0x7fb16c196dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.995+0000 7fb16ad9d640 1 -- 172.21.15.22:0/3424991457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb16c1073a0 msgr2=0x7fb16c197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.995+0000 7fb16ad9d640 1 --2- 172.21.15.22:0/3424991457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb16c1073a0 0x7fb16c197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.995+0000 7fb16ad9d640 1 -- 172.21.15.22:0/3424991457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16c19ce70 con 0x7fb16c107d20 2024-08-20T01:31:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.995+0000 7fb169d9b640 1 --2- 172.21.15.22:0/3424991457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb16c1073a0 0x7fb16c197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:31:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.996+0000 7fb16ad9d640 1 --2- 172.21.15.22:0/3424991457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb16c107d20 0x7fb16c19c6a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb16400eb10 tx=0x7fb16400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.996+0000 7fb15b7fe640 1 -- 172.21.15.22:0/3424991457 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164004b20 con 0x7fb16c107d20 2024-08-20T01:31:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.996+0000 7fb15b7fe640 1 -- 172.21.15.22:0/3424991457 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb164004cc0 con 0x7fb16c107d20 2024-08-20T01:31:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.996+0000 7fb15b7fe640 1 -- 172.21.15.22:0/3424991457 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164010670 con 0x7fb16c107d20 2024-08-20T01:31:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.996+0000 7fb170a4a640 1 -- 172.21.15.22:0/3424991457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb16c19d160 con 0x7fb16c107d20 2024-08-20T01:31:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.996+0000 7fb170a4a640 1 -- 172.21.15.22:0/3424991457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb16c1a7c30 con 0x7fb16c107d20 2024-08-20T01:31:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.997+0000 7fb170a4a640 1 -- 172.21.15.22:0/3424991457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb16c101d70 con 0x7fb16c107d20 2024-08-20T01:31:35.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.999+0000 7fb15b7fe640 1 -- 172.21.15.22:0/3424991457 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb164005000 con 0x7fb16c107d20 2024-08-20T01:31:35.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.999+0000 7fb15b7fe640 1 --2- 172.21.15.22:0/3424991457 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb1540b3c30 0x7fb1540b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:35.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.999+0000 7fb16a59c640 1 --2- 172.21.15.22:0/3424991457 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb1540b3c30 0x7fb1540b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:35.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:34.999+0000 7fb15b7fe640 1 -- 172.21.15.22:0/3424991457 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb1640e44e0 con 0x7fb16c107d20 2024-08-20T01:31:35.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:35.000+0000 7fb16a59c640 1 --2- 172.21.15.22:0/3424991457 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb1540b3c30 0x7fb1540b60f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00bbe0 tx=0x7fb15c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:35.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:35.002+0000 7fb15b7fe640 1 -- 172.21.15.22:0/3424991457 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fb164055e20 con 0x7fb16c107d20 2024-08-20T01:31:35.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:34 smithi134 ceph-mon[22511]: pgmap v359: 97 pgs: 97 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-08-20T01:31:35.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:34 smithi077 ceph-mon[22251]: pgmap v359: 97 pgs: 97 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-08-20T01:31:35.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:35.246+0000 7fb170a4a640 1 -- 172.21.15.22:0/3424991457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb16c197ef0 con 0x7fb16c107d20 2024-08-20T01:31:35.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:35.247+0000 7fb15b7fe640 1 -- 172.21.15.22:0/3424991457 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11906 (secure 0 0 0) 0x7fb1640aba90 con 0x7fb16c107d20 2024-08-20T01:31:35.249 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:31:35.249 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 25 2024-08-20T01:31:35.249 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"btime":"2024-08-20T01:30:51:488019+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:30:50.622248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24586,24575,24565]},"id":1}]} 2024-08-20T01:31:35.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:35.250+0000 7fb170a4a640 1 -- 172.21.15.22:0/3424991457 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb1540b3c30 msgr2=0x7fb1540b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:35.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:35.250+0000 7fb170a4a640 1 --2- 172.21.15.22:0/3424991457 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb1540b3c30 0x7fb1540b60f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00bbe0 tx=0x7fb15c00b390 comp rx=0 tx=0).stop 2024-08-20T01:31:35.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:35.250+0000 7fb170a4a640 1 -- 172.21.15.22:0/3424991457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb16c107d20 msgr2=0x7fb16c19c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:35.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:35.250+0000 7fb170a4a640 1 --2- 172.21.15.22:0/3424991457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb16c107d20 0x7fb16c19c6a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb16400eb10 tx=0x7fb16400c2d0 comp rx=0 tx=0).stop 2024-08-20T01:31:35.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:35.250+0000 7fb170a4a640 1 -- 172.21.15.22:0/3424991457 shutdown_connections 2024-08-20T01:31:35.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:35.250+0000 7fb170a4a640 1 --2- 172.21.15.22:0/3424991457 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb1540b3c30 0x7fb1540b60f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:35.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:35.250+0000 7fb170a4a640 1 --2- 172.21.15.22:0/3424991457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb16c107d20 0x7fb16c19c6a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:35.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:35.250+0000 7fb170a4a640 1 --2- 172.21.15.22:0/3424991457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb16c1073a0 0x7fb16c197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:35.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:35.250+0000 7fb170a4a640 1 --2- 172.21.15.22:0/3424991457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb16c101990 0x7fb16c196dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:35.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:35.250+0000 7fb170a4a640 1 -- 172.21.15.22:0/3424991457 >> 172.21.15.22:0/3424991457 conn(0x7fb16c0fd400 msgr2=0x7fb16c0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:35.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:35.251+0000 7fb170a4a640 1 -- 172.21.15.22:0/3424991457 shutdown_connections 2024-08-20T01:31:35.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:35.251+0000 7fb170a4a640 1 -- 172.21.15.22:0/3424991457 wait complete. 2024-08-20T01:31:35.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:35 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3424991457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:31:35.969 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:31:36.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:35 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3424991457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:31:36.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:35 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3424991457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:31:36.370 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:31:36.774 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:36 smithi022 ceph-mon[18709]: pgmap v360: 97 pgs: 97 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-20T01:31:36.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.906+0000 7fcad0549640 1 -- 172.21.15.22:0/982164559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcac81084a0 msgr2=0x7fcac81088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:36.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.906+0000 7fcad0549640 1 --2- 172.21.15.22:0/982164559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcac81084a0 0x7fcac81088e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009900 tx=0x7fcab802a410 comp rx=0 tx=0).stop 2024-08-20T01:31:36.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.906+0000 7fcad0549640 1 -- 172.21.15.22:0/982164559 shutdown_connections 2024-08-20T01:31:36.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.906+0000 7fcad0549640 1 --2- 172.21.15.22:0/982164559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcac8108e20 0x7fcac810f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.906+0000 7fcad0549640 1 --2- 172.21.15.22:0/982164559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcac81084a0 0x7fcac81088e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.906+0000 7fcad0549640 1 --2- 172.21.15.22:0/982164559 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcac8102a90 0x7fcac8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.906+0000 7fcad0549640 1 -- 172.21.15.22:0/982164559 >> 172.21.15.22:0/982164559 conn(0x7fcac80fe540 msgr2=0x7fcac8100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:36.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.906+0000 7fcad0549640 1 -- 172.21.15.22:0/982164559 shutdown_connections 2024-08-20T01:31:36.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.906+0000 7fcad0549640 1 -- 172.21.15.22:0/982164559 wait complete. 2024-08-20T01:31:36.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.907+0000 7fcad0549640 1 Processor -- start 2024-08-20T01:31:36.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.907+0000 7fcad0549640 1 -- start start 2024-08-20T01:31:36.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.908+0000 7fcad0549640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcac8102a90 0x7fcac8196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:36.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.908+0000 7fcad0549640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcac81084a0 0x7fcac81972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:36.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.908+0000 7fcad0549640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcac8108e20 0x7fcac819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:36.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.908+0000 7fcad0549640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcac81108f0 con 0x7fcac81084a0 2024-08-20T01:31:36.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.908+0000 7fcad0549640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcac8110770 con 0x7fcac8108e20 2024-08-20T01:31:36.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.908+0000 7fcad0549640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcac8110a70 con 0x7fcac8102a90 2024-08-20T01:31:36.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.908+0000 7fcacdae4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcac81084a0 0x7fcac81972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:36.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.908+0000 7fcacdae4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcac81084a0 0x7fcac81972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43604/0 (socket says 172.21.15.22:43604) 2024-08-20T01:31:36.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.908+0000 7fcacdae4640 1 -- 172.21.15.22:0/491491441 learned_addr learned my addr 172.21.15.22:0/491491441 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:36.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.908+0000 7fcaceae6640 1 --2- 172.21.15.22:0/491491441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcac8108e20 0x7fcac819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:36.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.908+0000 7fcacdae4640 1 -- 172.21.15.22:0/491491441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcac8102a90 msgr2=0x7fcac8196d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:36.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.908+0000 7fcacdae4640 1 --2- 172.21.15.22:0/491491441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcac8102a90 0x7fcac8196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.908+0000 7fcacdae4640 1 -- 172.21.15.22:0/491491441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcac8108e20 msgr2=0x7fcac819c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:36.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.908+0000 7fcacdae4640 1 --2- 172.21.15.22:0/491491441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcac8108e20 0x7fcac819c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.908+0000 7fcacdae4640 1 -- 172.21.15.22:0/491491441 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac819ce30 con 0x7fcac81084a0 2024-08-20T01:31:36.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.909+0000 7fcaceae6640 1 --2- 172.21.15.22:0/491491441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcac8108e20 0x7fcac819c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:31:36.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.909+0000 7fcacdae4640 1 --2- 172.21.15.22:0/491491441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcac81084a0 0x7fcac81972c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcab8005940 tx=0x7fcab80040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:36.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.909+0000 7fcabf7fe640 1 -- 172.21.15.22:0/491491441 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab803f030 con 0x7fcac81084a0 2024-08-20T01:31:36.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.909+0000 7fcabf7fe640 1 -- 172.21.15.22:0/491491441 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcab80044c0 con 0x7fcac81084a0 2024-08-20T01:31:36.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.909+0000 7fcabf7fe640 1 -- 172.21.15.22:0/491491441 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8035070 con 0x7fcac81084a0 2024-08-20T01:31:36.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.909+0000 7fcad0549640 1 -- 172.21.15.22:0/491491441 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac819d0c0 con 0x7fcac81084a0 2024-08-20T01:31:36.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.909+0000 7fcad0549640 1 -- 172.21.15.22:0/491491441 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac819d490 con 0x7fcac81084a0 2024-08-20T01:31:36.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.912+0000 7fcabf7fe640 1 -- 172.21.15.22:0/491491441 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcab8042030 con 0x7fcac81084a0 2024-08-20T01:31:36.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.913+0000 7fcabf7fe640 1 --2- 172.21.15.22:0/491491441 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcab40b3d20 0x7fcab40b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:36.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.913+0000 7fcad2942740 1 Processor -- start 2024-08-20T01:31:36.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.913+0000 7fcabf7fe640 1 -- 172.21.15.22:0/491491441 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fcab8103fa0 con 0x7fcac81084a0 2024-08-20T01:31:36.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.913+0000 7fcace2e5640 1 --2- 172.21.15.22:0/491491441 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcab40b3d20 0x7fcab40b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.913+0000 7fcad2942740 1 -- start start 2024-08-20T01:31:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.914+0000 7fcad2942740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634dc22b880 0x5634dc22bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.914+0000 7fcad2942740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc22c1a0 0x5634dc237bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.914+0000 7fcad2942740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc238130 0x5634dc23a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.914+0000 7fcad2942740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5634dc1a2930 con 0x5634dc22c1a0 2024-08-20T01:31:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.914+0000 7fcad2942740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5634dc191e30 con 0x5634dc238130 2024-08-20T01:31:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.914+0000 7fcad2942740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5634dc195e70 con 0x5634dc22b880 2024-08-20T01:31:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.914+0000 7fcaceae6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc238130 0x5634dc23a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.914+0000 7fcacdae4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc22c1a0 0x5634dc237bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.914+0000 7fcacdae4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc22c1a0 0x5634dc237bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43614/0 (socket says 172.21.15.22:43614) 2024-08-20T01:31:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.914+0000 7fcacdae4640 1 -- 172.21.15.22:0/3204339275 learned_addr learned my addr 172.21.15.22:0/3204339275 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.914+0000 7fcacdae4640 1 -- 172.21.15.22:0/3204339275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634dc22b880 msgr2=0x5634dc22bc60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:31:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.914+0000 7fcacdae4640 1 --2- 172.21.15.22:0/3204339275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634dc22b880 0x5634dc22bc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.914+0000 7fcacdae4640 1 -- 172.21.15.22:0/3204339275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc238130 msgr2=0x5634dc23a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.914+0000 7fcacdae4640 1 --2- 172.21.15.22:0/3204339275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc238130 0x5634dc23a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.914+0000 7fcacdae4640 1 -- 172.21.15.22:0/3204339275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634dbef1650 con 0x5634dc22c1a0 2024-08-20T01:31:36.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.915+0000 7fcaceae6640 1 --2- 172.21.15.22:0/3204339275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc238130 0x5634dc23a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:31:36.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.915+0000 7fcacdae4640 1 --2- 172.21.15.22:0/3204339275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc22c1a0 0x5634dc237bf0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcab80cae40 tx=0x7fcab80ca9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70e49d559ecb33d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.915+0000 7fcabcff9640 1 -- 172.21.15.22:0/3204339275 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8049030 con 0x5634dc22c1a0 2024-08-20T01:31:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.915+0000 7fcabcff9640 1 -- 172.21.15.22:0/3204339275 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcab80cf4b0 con 0x5634dc22c1a0 2024-08-20T01:31:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.915+0000 7fcabcff9640 1 -- 172.21.15.22:0/3204339275 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab80d3ad0 con 0x5634dc22c1a0 2024-08-20T01:31:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.916+0000 7fcad2942740 1 -- 172.21.15.22:0/3204339275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc22c1a0 msgr2=0x5634dc237bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.916+0000 7fcad2942740 1 --2- 172.21.15.22:0/3204339275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc22c1a0 0x5634dc237bf0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcab80cae40 tx=0x7fcab80ca9c0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.916+0000 7fcace2e5640 1 --2- 172.21.15.22:0/491491441 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcab40b3d20 0x7fcab40b61e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcac400d870 tx=0x7fcac400d7c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.916+0000 7fcad2942740 1 -- 172.21.15.22:0/3204339275 shutdown_connections 2024-08-20T01:31:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.916+0000 7fcad2942740 1 --2- 172.21.15.22:0/3204339275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc238130 0x5634dc23a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.916+0000 7fcad2942740 1 --2- 172.21.15.22:0/3204339275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc22c1a0 0x5634dc237bf0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.916+0000 7fcad2942740 1 --2- 172.21.15.22:0/3204339275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634dc22b880 0x5634dc22bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.916+0000 7fcad2942740 1 -- 172.21.15.22:0/3204339275 >> 172.21.15.22:0/3204339275 conn(0x5634dc2296b0 msgr2=0x5634dc22a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:36.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.916+0000 7fcad2942740 1 -- 172.21.15.22:0/3204339275 shutdown_connections 2024-08-20T01:31:36.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.916+0000 7fcad2942740 1 -- 172.21.15.22:0/3204339275 wait complete. 2024-08-20T01:31:36.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.917+0000 7fcad2942740 1 -- start start 2024-08-20T01:31:36.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.917+0000 7fcad2942740 1 Processor -- start 2024-08-20T01:31:36.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.918+0000 7fcad2942740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634dc22b880 0x5634dc2350f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:36.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.918+0000 7fcad2942740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc22c1a0 0x5634dc235630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.918+0000 7fcad2942740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc238130 0x5634dc235b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.918+0000 7fcaceae6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc238130 0x5634dc235b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.918+0000 7fcaceae6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc238130 0x5634dc235b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43624/0 (socket says 172.21.15.22:43624) 2024-08-20T01:31:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.918+0000 7fcaceae6640 1 -- 172.21.15.22:0/2713842957 learned_addr learned my addr 172.21.15.22:0/2713842957 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.918+0000 7fcacdae4640 1 --2- 172.21.15.22:0/2713842957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc22c1a0 0x5634dc235630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.918+0000 7fcad2942740 1 -- 172.21.15.22:0/2713842957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5634dbff4700 con 0x5634dc238130 2024-08-20T01:31:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.918+0000 7fcad2942740 1 -- 172.21.15.22:0/2713842957 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5634dc118810 con 0x5634dc22c1a0 2024-08-20T01:31:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.918+0000 7fcad2942740 1 -- 172.21.15.22:0/2713842957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5634dc23aba0 con 0x5634dc22b880 2024-08-20T01:31:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.919+0000 7fcaceae6640 1 -- 172.21.15.22:0/2713842957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634dc22b880 msgr2=0x5634dc2350f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.919+0000 7fcace2e5640 1 --2- 172.21.15.22:0/2713842957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634dc22b880 0x5634dc2350f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:36.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.919+0000 7fcaceae6640 1 --2- 172.21.15.22:0/2713842957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634dc22b880 0x5634dc2350f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.919+0000 7fcaceae6640 1 -- 172.21.15.22:0/2713842957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc22c1a0 msgr2=0x5634dc235630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:36.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.919+0000 7fcaceae6640 1 --2- 172.21.15.22:0/2713842957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc22c1a0 0x5634dc235630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.919+0000 7fcaceae6640 1 -- 172.21.15.22:0/2713842957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634dc243ec0 con 0x5634dc238130 2024-08-20T01:31:36.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.919+0000 7fcace2e5640 1 --2- 172.21.15.22:0/2713842957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634dc22b880 0x5634dc2350f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:31:36.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.919+0000 7fcaceae6640 1 --2- 172.21.15.22:0/2713842957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc238130 0x5634dc235b70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcac0012990 tx=0x7fcac0012e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e29726f0dafc2d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:36.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.919+0000 7fcab1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:31:36.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.919+0000 7fcad2942740 10 client.0 _ll_register_callbacks cb 0x5634dc18b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:36.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.919+0000 7fcad2942740 1 -- 172.21.15.22:0/2713842957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5634dc141150 con 0x5634dc238130 2024-08-20T01:31:36.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.919+0000 7fcab1ffb640 1 -- 172.21.15.22:0/2713842957 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac0010e00 con 0x5634dc238130 2024-08-20T01:31:36.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.919+0000 7fcab1ffb640 1 -- 172.21.15.22:0/2713842957 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fcac0004b20 con 0x5634dc238130 2024-08-20T01:31:36.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.920+0000 7fcab1ffb640 1 -- 172.21.15.22:0/2713842957 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcac0004d20 con 0x5634dc238130 2024-08-20T01:31:36.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.920+0000 7fcad2942740 10 client.15432 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:36.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.920+0000 7fcad2942740 1 -- 172.21.15.22:0/2713842957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5634dc246730 con 0x5634dc238130 2024-08-20T01:31:36.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.920+0000 7fcab1ffb640 1 -- 172.21.15.22:0/2713842957 <== mon.0 v2:172.21.15.22:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcac0026440 con 0x5634dc238130 2024-08-20T01:31:36.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.920+0000 7fcad2942740 10 client.15432 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:36.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.920+0000 7fcad2942740 10 client.15432 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:31:36.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.920+0000 7fcad2942740 20 client.15432 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:36.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.920+0000 7fcad2942740 1 --2- 172.21.15.22:0/2713842957 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5634dc247b80 0x5634dc249ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:36.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.920+0000 7fcad2942740 4 client.15432 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:31:36.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.920+0000 7fcad2942740 1 -- 172.21.15.22:0/2713842957 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634dc1a4880 con 0x5634dc247b80 2024-08-20T01:31:36.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.921+0000 7fcace2e5640 1 --2- 172.21.15.22:0/2713842957 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5634dc247b80 0x5634dc249ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:36.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.921+0000 7fcace2e5640 1 --2- 172.21.15.22:0/2713842957 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5634dc247b80 0x5634dc249ff0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ab6e54e103566913 server_cookie=87de4ca3877c28ac in_seq=0 out_seq=0 2024-08-20T01:31:36.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.921+0000 7fcab1ffb640 10 client.15432 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:31:36.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.922+0000 7fcab1ffb640 1 -- 172.21.15.22:0/2713842957 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5634dc1a4880 con 0x5634dc247b80 2024-08-20T01:31:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.922+0000 7fcab1ffb640 10 client.15432 handle_command_reply: tid=0 2024-08-20T01:31:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.922+0000 7fcad2942740 1 client.15432 shutdown 2024-08-20T01:31:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.922+0000 7fcad2942740 1 -- 172.21.15.22:0/2713842957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc238130 msgr2=0x5634dc235b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.922+0000 7fcad2942740 1 --2- 172.21.15.22:0/2713842957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc238130 0x5634dc235b70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcac0012990 tx=0x7fcac0012e50 comp rx=0 tx=0).stop 2024-08-20T01:31:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.922+0000 7fcad2942740 1 -- 172.21.15.22:0/2713842957 shutdown_connections 2024-08-20T01:31:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.922+0000 7fcad2942740 1 --2- 172.21.15.22:0/2713842957 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5634dc247b80 0x5634dc249ff0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.922+0000 7fcab1ffb640 0 client.15432 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:31:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.922+0000 7fcad2942740 1 --2- 172.21.15.22:0/2713842957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc238130 0x5634dc235b70 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.922+0000 7fcad2942740 1 --2- 172.21.15.22:0/2713842957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc22c1a0 0x5634dc235630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.922+0000 7fcad2942740 1 --2- 172.21.15.22:0/2713842957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634dc22b880 0x5634dc2350f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.922+0000 7fcad2942740 1 -- 172.21.15.22:0/2713842957 >> 172.21.15.22:0/2713842957 conn(0x5634dc2296b0 msgr2=0x5634dc22f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.923+0000 7fcad2942740 1 -- 172.21.15.22:0/2713842957 shutdown_connections 2024-08-20T01:31:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.923+0000 7fcad2942740 1 -- 172.21.15.22:0/2713842957 wait complete. 2024-08-20T01:31:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.923+0000 7fcad2942740 20 client.15432 trim_cache size 0 max 16384 2024-08-20T01:31:36.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.948+0000 7fcad2942740 1 Processor -- start 2024-08-20T01:31:36.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.948+0000 7fcad2942740 1 -- start start 2024-08-20T01:31:36.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.948+0000 7fcad2942740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc2296b0 0x5634dc22fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:36.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.948+0000 7fcad2942740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc22b880 0x5634dc234600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:36.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.949+0000 7fcad2942740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634dc22c1a0 0x5634dc24f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:36.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.949+0000 7fcad2942740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcac81ae7d0 con 0x5634dc22b880 2024-08-20T01:31:36.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.949+0000 7fcad2942740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcac81ac0a0 con 0x5634dc2296b0 2024-08-20T01:31:36.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.949+0000 7fcad2942740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcac81a9ef0 con 0x5634dc22c1a0 2024-08-20T01:31:36.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.949+0000 7fcacdae4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc22b880 0x5634dc234600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:36.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.949+0000 7fcacdae4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc22b880 0x5634dc234600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43634/0 (socket says 172.21.15.22:43634) 2024-08-20T01:31:36.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.949+0000 7fcacdae4640 1 -- 172.21.15.22:0/3482079135 learned_addr learned my addr 172.21.15.22:0/3482079135 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:36.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.949+0000 7fcace2e5640 1 --2- 172.21.15.22:0/3482079135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc2296b0 0x5634dc22fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:36.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.949+0000 7fcacdae4640 1 -- 172.21.15.22:0/3482079135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634dc22c1a0 msgr2=0x5634dc24f900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:31:36.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.949+0000 7fcacdae4640 1 --2- 172.21.15.22:0/3482079135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634dc22c1a0 0x5634dc24f900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.949+0000 7fcacdae4640 1 -- 172.21.15.22:0/3482079135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc2296b0 msgr2=0x5634dc22fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:36.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.949+0000 7fcacdae4640 1 --2- 172.21.15.22:0/3482079135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc2296b0 0x5634dc22fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.949+0000 7fcacdae4640 1 -- 172.21.15.22:0/3482079135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634dc24a670 con 0x5634dc22b880 2024-08-20T01:31:36.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.949+0000 7fcacdae4640 1 --2- 172.21.15.22:0/3482079135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc22b880 0x5634dc234600 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcab80c6f30 tx=0x7fcab802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5572224a9a8b6747 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:36.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.949+0000 7fcab3fff640 1 -- 172.21.15.22:0/3482079135 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8049040 con 0x5634dc22b880 2024-08-20T01:31:36.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.950+0000 7fcab3fff640 1 -- 172.21.15.22:0/3482079135 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcab80e9070 con 0x5634dc22b880 2024-08-20T01:31:36.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.950+0000 7fcab3fff640 1 -- 172.21.15.22:0/3482079135 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab80d3d30 con 0x5634dc22b880 2024-08-20T01:31:36.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.950+0000 7fcad2942740 1 -- 172.21.15.22:0/3482079135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc22b880 msgr2=0x5634dc234600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:36.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.950+0000 7fcad2942740 1 --2- 172.21.15.22:0/3482079135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc22b880 0x5634dc234600 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcab80c6f30 tx=0x7fcab802a410 comp rx=0 tx=0).stop 2024-08-20T01:31:36.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.951+0000 7fcad2942740 1 -- 172.21.15.22:0/3482079135 shutdown_connections 2024-08-20T01:31:36.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.951+0000 7fcad2942740 1 --2- 172.21.15.22:0/3482079135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634dc22c1a0 0x5634dc24f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.951+0000 7fcad2942740 1 --2- 172.21.15.22:0/3482079135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc22b880 0x5634dc234600 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.951+0000 7fcad2942740 1 --2- 172.21.15.22:0/3482079135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc2296b0 0x5634dc22fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.951+0000 7fcad2942740 1 -- 172.21.15.22:0/3482079135 >> 172.21.15.22:0/3482079135 conn(0x5634dc237350 msgr2=0x5634dc228770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:36.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.951+0000 7fcad2942740 1 -- 172.21.15.22:0/3482079135 shutdown_connections 2024-08-20T01:31:36.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.951+0000 7fcad2942740 1 -- 172.21.15.22:0/3482079135 wait complete. 2024-08-20T01:31:36.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.951+0000 7fcad2942740 1 -- start start 2024-08-20T01:31:36.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.951+0000 7fcad2942740 1 Processor -- start 2024-08-20T01:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.952+0000 7fcad2942740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc2296b0 0x5634dc23bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.952+0000 7fcad2942740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc22b880 0x5634dc23c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.952+0000 7fcad2942740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634dc22c1a0 0x5634dc23c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.952+0000 7fcad2942740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcac81aa560 con 0x5634dc2296b0 2024-08-20T01:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.952+0000 7fcad2942740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcac81ab9d0 con 0x5634dc22b880 2024-08-20T01:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.952+0000 7fcad2942740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcac81aac30 con 0x5634dc22c1a0 2024-08-20T01:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.952+0000 7fcad2942740 10 client.0 _ll_register_callbacks cb 0x7fcac0009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.952+0000 7fcace2e5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc2296b0 0x5634dc23bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.952+0000 7fcace2e5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc2296b0 0x5634dc23bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43646/0 (socket says 172.21.15.22:43646) 2024-08-20T01:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.952+0000 7fcace2e5640 1 -- 172.21.15.22:0/137650838 learned_addr learned my addr 172.21.15.22:0/137650838 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.952+0000 7fcacdae4640 1 --2- 172.21.15.22:0/137650838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc22b880 0x5634dc23c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.952+0000 7fcace2e5640 1 -- 172.21.15.22:0/137650838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634dc22c1a0 msgr2=0x5634dc23c780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.952+0000 7fcace2e5640 1 --2- 172.21.15.22:0/137650838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634dc22c1a0 0x5634dc23c780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.952+0000 7fcace2e5640 1 -- 172.21.15.22:0/137650838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc22b880 msgr2=0x5634dc23c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:36.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.952+0000 7fcace2e5640 1 --2- 172.21.15.22:0/137650838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc22b880 0x5634dc23c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.952+0000 7fcace2e5640 1 -- 172.21.15.22:0/137650838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634dc22a130 con 0x5634dc2296b0 2024-08-20T01:31:36.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.953+0000 7fcace2e5640 1 --2- 172.21.15.22:0/137650838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc2296b0 0x5634dc23bd00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x5634dc24a8a0 tx=0x7fcac4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9164a5a587ddf305 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:36.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.953+0000 7fcab1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:31:36.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.953+0000 7fcab1ffb640 1 -- 172.21.15.22:0/137650838 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4024d30 con 0x5634dc2296b0 2024-08-20T01:31:36.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.953+0000 7fcad2942740 1 -- 172.21.15.22:0/137650838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcab80e9070 con 0x5634dc2296b0 2024-08-20T01:31:36.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.953+0000 7fcab1ffb640 1 -- 172.21.15.22:0/137650838 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fcac402c2c0 con 0x5634dc2296b0 2024-08-20T01:31:36.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.953+0000 7fcab1ffb640 1 -- 172.21.15.22:0/137650838 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcac402c4c0 con 0x5634dc2296b0 2024-08-20T01:31:36.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.953+0000 7fcad2942740 10 client.15438 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:36.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.953+0000 7fcad2942740 1 -- 172.21.15.22:0/137650838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5634dc2b2bb0 con 0x5634dc2296b0 2024-08-20T01:31:36.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.954+0000 7fcab1ffb640 1 -- 172.21.15.22:0/137650838 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcac4030030 con 0x5634dc2296b0 2024-08-20T01:31:36.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.954+0000 7fcab1ffb640 1 -- 172.21.15.22:0/137650838 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcac403f760 con 0x5634dc2296b0 2024-08-20T01:31:36.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.954+0000 7fcad2942740 10 client.15438 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:36.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.954+0000 7fcad2942740 10 client.15438 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:31:36.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.954+0000 7fcad2942740 20 client.15438 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:36.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.954+0000 7fcad2942740 1 --2- 172.21.15.22:0/137650838 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5634dc238130 0x5634dc2b5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:36.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.954+0000 7fcad2942740 4 client.15438 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:31:36.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.954+0000 7fcad2942740 1 -- 172.21.15.22:0/137650838 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fcab80e9070 con 0x5634dc238130 2024-08-20T01:31:36.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.954+0000 7fcacdae4640 1 --2- 172.21.15.22:0/137650838 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5634dc238130 0x5634dc2b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:36.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.955+0000 7fcacdae4640 1 --2- 172.21.15.22:0/137650838 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5634dc238130 0x5634dc2b5390 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=120a2f20ed0fd6b2 server_cookie=98f9de5315012573 in_seq=0 out_seq=0 2024-08-20T01:31:36.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.955+0000 7fcab1ffb640 10 client.15438 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:31:36.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.955+0000 7fcab1ffb640 1 -- 172.21.15.22:0/137650838 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fcab80e9070 con 0x5634dc238130 2024-08-20T01:31:36.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.955+0000 7fcab1ffb640 10 client.15438 handle_command_reply: tid=0 2024-08-20T01:31:36.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.955+0000 7fcad2942740 1 client.15438 shutdown 2024-08-20T01:31:36.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.955+0000 7fcad2942740 1 -- 172.21.15.22:0/137650838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc2296b0 msgr2=0x5634dc23bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:36.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.955+0000 7fcad2942740 1 --2- 172.21.15.22:0/137650838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc2296b0 0x5634dc23bd00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x5634dc24a8a0 tx=0x7fcac4005f90 comp rx=0 tx=0).stop 2024-08-20T01:31:36.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.955+0000 7fcad2942740 1 -- 172.21.15.22:0/137650838 shutdown_connections 2024-08-20T01:31:36.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.955+0000 7fcad2942740 1 --2- 172.21.15.22:0/137650838 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5634dc238130 0x5634dc2b5390 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.955+0000 7fcad2942740 1 --2- 172.21.15.22:0/137650838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634dc22c1a0 0x5634dc23c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.955+0000 7fcad2942740 1 --2- 172.21.15.22:0/137650838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634dc22b880 0x5634dc23c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.955+0000 7fcad2942740 1 --2- 172.21.15.22:0/137650838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634dc2296b0 0x5634dc23bd00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.955+0000 7fcad2942740 1 -- 172.21.15.22:0/137650838 >> 172.21.15.22:0/137650838 conn(0x5634dc237350 msgr2=0x5634dc227f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:36.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.956+0000 7fcab1ffb640 0 client.15438 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:31:36.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.956+0000 7fcad2942740 1 -- 172.21.15.22:0/137650838 shutdown_connections 2024-08-20T01:31:36.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.956+0000 7fcad2942740 1 -- 172.21.15.22:0/137650838 wait complete. 2024-08-20T01:31:36.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.956+0000 7fcad2942740 20 client.15438 trim_cache size 0 max 16384 2024-08-20T01:31:36.960 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:31:36.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.957+0000 7fcad0549640 1 -- 172.21.15.22:0/491491441 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcab40b3d20 msgr2=0x7fcab40b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:36.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.957+0000 7fcad0549640 1 --2- 172.21.15.22:0/491491441 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcab40b3d20 0x7fcab40b61e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcac400d870 tx=0x7fcac400d7c0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.957+0000 7fcad0549640 1 -- 172.21.15.22:0/491491441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcac81084a0 msgr2=0x7fcac81972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:36.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.957+0000 7fcad0549640 1 --2- 172.21.15.22:0/491491441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcac81084a0 0x7fcac81972c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcab8005940 tx=0x7fcab80040c0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.957+0000 7fcad0549640 1 -- 172.21.15.22:0/491491441 shutdown_connections 2024-08-20T01:31:36.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.957+0000 7fcad0549640 1 --2- 172.21.15.22:0/491491441 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcab40b3d20 0x7fcab40b61e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.957+0000 7fcad0549640 1 --2- 172.21.15.22:0/491491441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcac8108e20 0x7fcac819c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.957+0000 7fcad0549640 1 --2- 172.21.15.22:0/491491441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcac81084a0 0x7fcac81972c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.957+0000 7fcad0549640 1 --2- 172.21.15.22:0/491491441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcac8102a90 0x7fcac8196d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.957+0000 7fcad0549640 1 -- 172.21.15.22:0/491491441 >> 172.21.15.22:0/491491441 conn(0x7fcac80fe540 msgr2=0x7fcac8100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:36.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.957+0000 7fcad0549640 1 -- 172.21.15.22:0/491491441 shutdown_connections 2024-08-20T01:31:36.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:36.957+0000 7fcad0549640 1 -- 172.21.15.22:0/491491441 wait complete. 2024-08-20T01:31:37.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:36 smithi134 ceph-mon[22511]: pgmap v360: 97 pgs: 97 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-20T01:31:37.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:36 smithi077 ceph-mon[22251]: pgmap v360: 97 pgs: 97 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-20T01:31:37.636 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:31:37.993 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:31:38.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.370+0000 7fd91d143640 1 -- 172.21.15.22:0/4069284346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd918103070 msgr2=0x7fd9181099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:38.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.370+0000 7fd91d143640 1 --2- 172.21.15.22:0/4069284346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd918103070 0x7fd9181099f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd910009cd0 tx=0x7fd91002a8e0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.370+0000 7fd91d143640 1 -- 172.21.15.22:0/4069284346 shutdown_connections 2024-08-20T01:31:38.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.370+0000 7fd91d143640 1 --2- 172.21.15.22:0/4069284346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd918103070 0x7fd9181099f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.370+0000 7fd91d143640 1 --2- 172.21.15.22:0/4069284346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9181026b0 0x7fd918102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.370+0000 7fd91d143640 1 --2- 172.21.15.22:0/4069284346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd918101560 0x7fd918101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.370+0000 7fd91d143640 1 -- 172.21.15.22:0/4069284346 >> 172.21.15.22:0/4069284346 conn(0x7fd9180fce40 msgr2=0x7fd9180ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:38.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.370+0000 7fd91d143640 1 -- 172.21.15.22:0/4069284346 shutdown_connections 2024-08-20T01:31:38.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.370+0000 7fd91d143640 1 -- 172.21.15.22:0/4069284346 wait complete. 2024-08-20T01:31:38.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.371+0000 7fd91d143640 1 Processor -- start 2024-08-20T01:31:38.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.372+0000 7fd91d143640 1 -- start start 2024-08-20T01:31:38.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.372+0000 7fd91d143640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd918101560 0x7fd918198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.372+0000 7fd91d143640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9181026b0 0x7fd9181990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.372+0000 7fd91d143640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd918103070 0x7fd918199ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.372+0000 7fd91d143640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd91810d1d0 con 0x7fd918103070 2024-08-20T01:31:38.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.372+0000 7fd91d143640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd91810d050 con 0x7fd9181026b0 2024-08-20T01:31:38.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.372+0000 7fd91d143640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd91810d350 con 0x7fd918101560 2024-08-20T01:31:38.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.372+0000 7fd91759e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd918103070 0x7fd918199ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.372+0000 7fd91659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9181026b0 0x7fd9181990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.372+0000 7fd91659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9181026b0 0x7fd9181990b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:55146/0 (socket says 172.21.15.22:55146) 2024-08-20T01:31:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.372+0000 7fd91659c640 1 -- 172.21.15.22:0/3574924725 learned_addr learned my addr 172.21.15.22:0/3574924725 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.372+0000 7fd91759e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd918103070 0x7fd918199ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43666/0 (socket says 172.21.15.22:43666) 2024-08-20T01:31:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.372+0000 7fd916d9d640 1 --2- 172.21.15.22:0/3574924725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd918101560 0x7fd918198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.372+0000 7fd91659c640 1 -- 172.21.15.22:0/3574924725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd918101560 msgr2=0x7fd918198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.372+0000 7fd91659c640 1 --2- 172.21.15.22:0/3574924725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd918101560 0x7fd918198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.372+0000 7fd91659c640 1 -- 172.21.15.22:0/3574924725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd918103070 msgr2=0x7fd918199ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.372+0000 7fd91659c640 1 --2- 172.21.15.22:0/3574924725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd918103070 0x7fd918199ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.372+0000 7fd91659c640 1 -- 172.21.15.22:0/3574924725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd91819a5a0 con 0x7fd9181026b0 2024-08-20T01:31:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.373+0000 7fd91659c640 1 --2- 172.21.15.22:0/3574924725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9181026b0 0x7fd9181990b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00d770 tx=0x7fd90c00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.373+0000 7fd8fffff640 1 -- 172.21.15.22:0/3574924725 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c018070 con 0x7fd9181026b0 2024-08-20T01:31:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.373+0000 7fd91d143640 1 -- 172.21.15.22:0/3574924725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd91819a890 con 0x7fd9181026b0 2024-08-20T01:31:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.373+0000 7fd8fffff640 1 -- 172.21.15.22:0/3574924725 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd90c0054d0 con 0x7fd9181026b0 2024-08-20T01:31:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.373+0000 7fd8fffff640 1 -- 172.21.15.22:0/3574924725 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c004c30 con 0x7fd9181026b0 2024-08-20T01:31:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.373+0000 7fd91d143640 1 -- 172.21.15.22:0/3574924725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd918103ba0 con 0x7fd9181026b0 2024-08-20T01:31:38.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.376+0000 7fd920012740 1 Processor -- start 2024-08-20T01:31:38.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.376+0000 7fd920012740 1 -- start start 2024-08-20T01:31:38.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.376+0000 7fd920012740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 0x563d5cd69cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.376+0000 7fd920012740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 0x563d5cd6c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.376+0000 7fd920012740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd6cc40 0x563d5cd6f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.376+0000 7fd920012740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563d5ccda360 con 0x563d5cd6a200 2024-08-20T01:31:38.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.376+0000 7fd920012740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563d5ccc9860 con 0x563d5cd6cc40 2024-08-20T01:31:38.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.376+0000 7fd920012740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563d5cccd8a0 con 0x563d5cd678d0 2024-08-20T01:31:38.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.376+0000 7fd916d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 0x563d5cd6c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.376+0000 7fd916d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 0x563d5cd6c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43674/0 (socket says 172.21.15.22:43674) 2024-08-20T01:31:38.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.376+0000 7fd916d9d640 1 -- 172.21.15.22:0/805459529 learned_addr learned my addr 172.21.15.22:0/805459529 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:38.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.376+0000 7fd91759e640 1 --2- 172.21.15.22:0/805459529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 0x563d5cd69cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.377+0000 7fd916d9d640 1 -- 172.21.15.22:0/805459529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 msgr2=0x563d5cd69cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:38.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.377+0000 7fd916d9d640 1 --2- 172.21.15.22:0/805459529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 0x563d5cd69cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.377+0000 7fd916d9d640 1 -- 172.21.15.22:0/805459529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd6cc40 msgr2=0x563d5cd6f100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:31:38.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.377+0000 7fd916d9d640 1 --2- 172.21.15.22:0/805459529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd6cc40 0x563d5cd6f100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.377+0000 7fd916d9d640 1 -- 172.21.15.22:0/805459529 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d5cc70e40 con 0x563d5cd6a200 2024-08-20T01:31:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.377+0000 7fd8fffff640 1 -- 172.21.15.22:0/3574924725 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd90c004eb0 con 0x7fd9181026b0 2024-08-20T01:31:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.377+0000 7fd916d9d640 1 --2- 172.21.15.22:0/805459529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 0x563d5cd6c5f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd90800bd10 tx=0x7fd9080107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb805202dd120b63 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.377+0000 7fd8fd7fa640 1 -- 172.21.15.22:0/805459529 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908004030 con 0x563d5cd6a200 2024-08-20T01:31:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.377+0000 7fd8fd7fa640 1 -- 172.21.15.22:0/805459529 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9080035f0 con 0x563d5cd6a200 2024-08-20T01:31:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.377+0000 7fd8fd7fa640 1 -- 172.21.15.22:0/805459529 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908011770 con 0x563d5cd6a200 2024-08-20T01:31:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.378+0000 7fd8fffff640 1 --2- 172.21.15.22:0/3574924725 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9000b3bd0 0x7fd9000b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.378+0000 7fd920012740 1 -- 172.21.15.22:0/805459529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 msgr2=0x563d5cd6c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.378+0000 7fd920012740 1 --2- 172.21.15.22:0/805459529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 0x563d5cd6c5f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd90800bd10 tx=0x7fd9080107a0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.378+0000 7fd91759e640 1 --2- 172.21.15.22:0/3574924725 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9000b3bd0 0x7fd9000b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.378+0000 7fd8fffff640 1 -- 172.21.15.22:0/3574924725 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fd90c0e7930 con 0x7fd9181026b0 2024-08-20T01:31:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.378+0000 7fd920012740 1 -- 172.21.15.22:0/805459529 shutdown_connections 2024-08-20T01:31:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.378+0000 7fd920012740 1 --2- 172.21.15.22:0/805459529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd6cc40 0x563d5cd6f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.378+0000 7fd920012740 1 --2- 172.21.15.22:0/805459529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 0x563d5cd6c5f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.378+0000 7fd920012740 1 --2- 172.21.15.22:0/805459529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 0x563d5cd69cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.378+0000 7fd920012740 1 -- 172.21.15.22:0/805459529 >> 172.21.15.22:0/805459529 conn(0x563d5cd62a20 msgr2=0x563d5cd637b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.379+0000 7fd920012740 1 -- 172.21.15.22:0/805459529 shutdown_connections 2024-08-20T01:31:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.379+0000 7fd91759e640 1 --2- 172.21.15.22:0/3574924725 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9000b3bd0 0x7fd9000b6090 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd9181997e0 tx=0x7fd91003d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.379+0000 7fd920012740 1 -- 172.21.15.22:0/805459529 wait complete. 2024-08-20T01:31:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.379+0000 7fd920012740 1 -- start start 2024-08-20T01:31:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.379+0000 7fd920012740 1 Processor -- start 2024-08-20T01:31:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.380+0000 7fd920012740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 0x563d5cd71150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.380+0000 7fd920012740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 0x563d5cd717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.380+0000 7fd920012740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd6cc40 0x563d5cd723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.380+0000 7fd920012740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563d5cc02ab0 con 0x563d5cd6a200 2024-08-20T01:31:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.380+0000 7fd916d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 0x563d5cd71150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.380+0000 7fd91659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 0x563d5cd717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.380+0000 7fd916d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 0x563d5cd71150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:57564/0 (socket says 172.21.15.22:57564) 2024-08-20T01:31:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.380+0000 7fd916d9d640 1 -- 172.21.15.22:0/2940015689 learned_addr learned my addr 172.21.15.22:0/2940015689 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.380+0000 7fd920012740 1 -- 172.21.15.22:0/2940015689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563d5cc50780 con 0x563d5cd6cc40 2024-08-20T01:31:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.380+0000 7fd920012740 1 -- 172.21.15.22:0/2940015689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563d5cd6fc20 con 0x563d5cd678d0 2024-08-20T01:31:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.380+0000 7fd91759e640 1 --2- 172.21.15.22:0/2940015689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd6cc40 0x563d5cd723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.380+0000 7fd920012740 10 client.0 _ll_register_callbacks cb 0x563d5c9d8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.380+0000 7fd916d9d640 1 -- 172.21.15.22:0/2940015689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd6cc40 msgr2=0x563d5cd723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.380+0000 7fd916d9d640 1 --2- 172.21.15.22:0/2940015689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd6cc40 0x563d5cd723c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.380+0000 7fd916d9d640 1 -- 172.21.15.22:0/2940015689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 msgr2=0x563d5cd717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.380+0000 7fd916d9d640 1 --2- 172.21.15.22:0/2940015689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 0x563d5cd717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.380+0000 7fd916d9d640 1 -- 172.21.15.22:0/2940015689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d5ca2c790 con 0x563d5cd678d0 2024-08-20T01:31:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.380+0000 7fd91659c640 1 --2- 172.21.15.22:0/2940015689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 0x563d5cd717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:31:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.381+0000 7fd920012740 1 -- 172.21.15.22:0/2940015689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563d5cc78e00 con 0x563d5cd678d0 2024-08-20T01:31:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.381+0000 7fd916d9d640 1 --2- 172.21.15.22:0/2940015689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 0x563d5cd71150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd908003e20 tx=0x7fd90800ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b5227e4702be06a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.381+0000 7fd8faff5640 10 client.25072 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:31:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.381+0000 7fd8faff5640 1 -- 172.21.15.22:0/2940015689 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908029060 con 0x563d5cd678d0 2024-08-20T01:31:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.381+0000 7fd8faff5640 1 -- 172.21.15.22:0/2940015689 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fd9080039b0 con 0x563d5cd678d0 2024-08-20T01:31:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.381+0000 7fd8faff5640 1 -- 172.21.15.22:0/2940015689 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd908003fc0 con 0x563d5cd678d0 2024-08-20T01:31:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.381+0000 7fd920012740 10 client.25072 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.381+0000 7fd920012740 1 -- 172.21.15.22:0/2940015689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({fsmap=25}) -- 0x563d5caa5620 con 0x563d5cd678d0 2024-08-20T01:31:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.382+0000 7fd8faff5640 1 -- 172.21.15.22:0/2940015689 <== mon.1 v2:172.21.15.134:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd908004160 con 0x563d5cd678d0 2024-08-20T01:31:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.382+0000 7fd920012740 10 client.25072 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.382+0000 7fd920012740 10 client.25072 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:31:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.382+0000 7fd920012740 20 client.25072 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.382+0000 7fd920012740 1 --2- 172.21.15.22:0/2940015689 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563d5cd7c510 0x563d5cd7e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.382+0000 7fd920012740 4 client.25072 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:31:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.382+0000 7fd920012740 1 -- 172.21.15.22:0/2940015689 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d5ccdc2b0 con 0x563d5cd7c510 2024-08-20T01:31:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.382+0000 7fd91659c640 1 --2- 172.21.15.22:0/2940015689 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563d5cd7c510 0x563d5cd7e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.383+0000 7fd8faff5640 10 client.25072 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.383+0000 7fd91659c640 1 --2- 172.21.15.22:0/2940015689 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563d5cd7c510 0x563d5cd7e900 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d90326ddd7d04543 server_cookie=705a34f8232ff32d in_seq=0 out_seq=0 2024-08-20T01:31:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.383+0000 7fd8faff5640 1 -- 172.21.15.22:0/2940015689 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d5ccdc2b0 con 0x563d5cd7c510 2024-08-20T01:31:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.383+0000 7fd8faff5640 10 client.25072 handle_command_reply: tid=0 2024-08-20T01:31:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.383+0000 7fd920012740 1 client.25072 shutdown 2024-08-20T01:31:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.384+0000 7fd920012740 1 -- 172.21.15.22:0/2940015689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 msgr2=0x563d5cd71150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.384+0000 7fd920012740 1 --2- 172.21.15.22:0/2940015689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 0x563d5cd71150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd908003e20 tx=0x7fd90800ba20 comp rx=0 tx=0).stop 2024-08-20T01:31:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.384+0000 7fd920012740 1 -- 172.21.15.22:0/2940015689 shutdown_connections 2024-08-20T01:31:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.384+0000 7fd920012740 1 --2- 172.21.15.22:0/2940015689 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563d5cd7c510 0x563d5cd7e900 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.384+0000 7fd8faff5640 0 client.25072 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.384+0000 7fd920012740 1 --2- 172.21.15.22:0/2940015689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd6cc40 0x563d5cd723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.384+0000 7fd920012740 1 --2- 172.21.15.22:0/2940015689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 0x563d5cd717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.384+0000 7fd920012740 1 --2- 172.21.15.22:0/2940015689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 0x563d5cd71150 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.384+0000 7fd920012740 1 -- 172.21.15.22:0/2940015689 >> 172.21.15.22:0/2940015689 conn(0x563d5cd62a20 msgr2=0x563d5cd61ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.384+0000 7fd920012740 1 -- 172.21.15.22:0/2940015689 shutdown_connections 2024-08-20T01:31:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.384+0000 7fd920012740 1 -- 172.21.15.22:0/2940015689 wait complete. 2024-08-20T01:31:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.384+0000 7fd920012740 20 client.25072 trim_cache size 0 max 16384 2024-08-20T01:31:38.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.399+0000 7fd920012740 1 Processor -- start 2024-08-20T01:31:38.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.399+0000 7fd920012740 1 -- start start 2024-08-20T01:31:38.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.399+0000 7fd920012740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 0x563d5cd70ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.399+0000 7fd920012740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 0x563d5cd6d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.399+0000 7fd920012740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd6cc40 0x563d5cd6d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.399+0000 7fd920012740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd9181aa440 con 0x563d5cd6a200 2024-08-20T01:31:38.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.399+0000 7fd920012740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd9181a7d10 con 0x563d5cd6cc40 2024-08-20T01:31:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.399+0000 7fd920012740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd9181a5b60 con 0x563d5cd678d0 2024-08-20T01:31:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.399+0000 7fd91659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 0x563d5cd6d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.399+0000 7fd91659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 0x563d5cd6d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43702/0 (socket says 172.21.15.22:43702) 2024-08-20T01:31:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.400+0000 7fd91659c640 1 -- 172.21.15.22:0/4081196102 learned_addr learned my addr 172.21.15.22:0/4081196102 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.400+0000 7fd916d9d640 1 --2- 172.21.15.22:0/4081196102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 0x563d5cd70ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.400+0000 7fd91759e640 1 --2- 172.21.15.22:0/4081196102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd6cc40 0x563d5cd6d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.400+0000 7fd91659c640 1 -- 172.21.15.22:0/4081196102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 msgr2=0x563d5cd70ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.400+0000 7fd91659c640 1 --2- 172.21.15.22:0/4081196102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 0x563d5cd70ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.400+0000 7fd91659c640 1 -- 172.21.15.22:0/4081196102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd6cc40 msgr2=0x563d5cd6d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.400+0000 7fd91659c640 1 --2- 172.21.15.22:0/4081196102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd6cc40 0x563d5cd6d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.400+0000 7fd91659c640 1 -- 172.21.15.22:0/4081196102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d5cd63c80 con 0x563d5cd6a200 2024-08-20T01:31:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.400+0000 7fd91759e640 1 --2- 172.21.15.22:0/4081196102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd6cc40 0x563d5cd6d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:31:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.400+0000 7fd916d9d640 1 --2- 172.21.15.22:0/4081196102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 0x563d5cd70ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:31:38.403 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.400+0000 7fd91659c640 1 --2- 172.21.15.22:0/4081196102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 0x563d5cd6d0b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0e53f0 tx=0x7fd90c096040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a669fee758169ba9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:38.403 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.400+0000 7fd8fcff9640 1 -- 172.21.15.22:0/4081196102 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c005680 con 0x563d5cd6a200 2024-08-20T01:31:38.403 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.400+0000 7fd8fcff9640 1 -- 172.21.15.22:0/4081196102 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd90c0aef40 con 0x563d5cd6a200 2024-08-20T01:31:38.403 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.400+0000 7fd8fcff9640 1 -- 172.21.15.22:0/4081196102 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c009c30 con 0x563d5cd6a200 2024-08-20T01:31:38.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.401+0000 7fd920012740 1 -- 172.21.15.22:0/4081196102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 msgr2=0x563d5cd6d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:38.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.401+0000 7fd920012740 1 --2- 172.21.15.22:0/4081196102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 0x563d5cd6d0b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0e53f0 tx=0x7fd90c096040 comp rx=0 tx=0).stop 2024-08-20T01:31:38.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.401+0000 7fd920012740 1 -- 172.21.15.22:0/4081196102 shutdown_connections 2024-08-20T01:31:38.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.401+0000 7fd920012740 1 --2- 172.21.15.22:0/4081196102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd6cc40 0x563d5cd6d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.401+0000 7fd920012740 1 --2- 172.21.15.22:0/4081196102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6a200 0x563d5cd6d0b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.401+0000 7fd920012740 1 --2- 172.21.15.22:0/4081196102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 0x563d5cd70ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.401+0000 7fd920012740 1 -- 172.21.15.22:0/4081196102 >> 172.21.15.22:0/4081196102 conn(0x563d5cd62a20 msgr2=0x563d5cd6e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:38.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.401+0000 7fd920012740 1 -- 172.21.15.22:0/4081196102 shutdown_connections 2024-08-20T01:31:38.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.401+0000 7fd920012740 1 -- 172.21.15.22:0/4081196102 wait complete. 2024-08-20T01:31:38.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.402+0000 7fd920012740 1 -- start start 2024-08-20T01:31:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.402+0000 7fd920012740 1 Processor -- start 2024-08-20T01:31:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.402+0000 7fd920012740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 0x563d5cd765b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.402+0000 7fd920012740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6cc40 0x563d5cd76c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.402+0000 7fd920012740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd7c510 0x563d5cd77820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.402+0000 7fd920012740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd9181a61d0 con 0x563d5cd6cc40 2024-08-20T01:31:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.402+0000 7fd920012740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd9181a7640 con 0x563d5cd7c510 2024-08-20T01:31:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.402+0000 7fd920012740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd9181a68a0 con 0x563d5cd678d0 2024-08-20T01:31:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.402+0000 7fd920012740 10 client.0 _ll_register_callbacks cb 0x7fd910005d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.402+0000 7fd91659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6cc40 0x563d5cd76c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.402+0000 7fd916d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 0x563d5cd765b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.402+0000 7fd91659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6cc40 0x563d5cd76c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43718/0 (socket says 172.21.15.22:43718) 2024-08-20T01:31:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.402+0000 7fd91659c640 1 -- 172.21.15.22:0/651946911 learned_addr learned my addr 172.21.15.22:0/651946911 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.403+0000 7fd91759e640 1 --2- 172.21.15.22:0/651946911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd7c510 0x563d5cd77820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.403+0000 7fd91659c640 1 -- 172.21.15.22:0/651946911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 msgr2=0x563d5cd765b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.403+0000 7fd91659c640 1 --2- 172.21.15.22:0/651946911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 0x563d5cd765b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.403+0000 7fd91659c640 1 -- 172.21.15.22:0/651946911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd7c510 msgr2=0x563d5cd77820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.403+0000 7fd91659c640 1 --2- 172.21.15.22:0/651946911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd7c510 0x563d5cd77820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.403+0000 7fd91659c640 1 -- 172.21.15.22:0/651946911 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d5cd72730 con 0x563d5cd6cc40 2024-08-20T01:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.403+0000 7fd91659c640 1 --2- 172.21.15.22:0/651946911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6cc40 0x563d5cd76c50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0e5760 tx=0x7fd90c0ae930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d55ec1932bc920 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.403+0000 7fd8faff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.403+0000 7fd8faff5640 1 -- 172.21.15.22:0/651946911 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0b78f0 con 0x563d5cd6cc40 2024-08-20T01:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.403+0000 7fd8faff5640 1 -- 172.21.15.22:0/651946911 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fd90c0051a0 con 0x563d5cd6cc40 2024-08-20T01:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.403+0000 7fd920012740 1 -- 172.21.15.22:0/651946911 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd90c0aef40 con 0x563d5cd6cc40 2024-08-20T01:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.403+0000 7fd8faff5640 1 -- 172.21.15.22:0/651946911 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd90c0aaad0 con 0x563d5cd6cc40 2024-08-20T01:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.403+0000 7fd920012740 10 client.15456 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.403+0000 7fd920012740 1 -- 172.21.15.22:0/651946911 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563d5cd79220 con 0x563d5cd6cc40 2024-08-20T01:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.403+0000 7fd8faff5640 1 -- 172.21.15.22:0/651946911 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd90c0aef40 con 0x563d5cd6cc40 2024-08-20T01:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.404+0000 7fd8faff5640 1 -- 172.21.15.22:0/651946911 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd90c0afc70 con 0x563d5cd6cc40 2024-08-20T01:31:38.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.404+0000 7fd920012740 10 client.15456 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:38.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.404+0000 7fd920012740 10 client.15456 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:31:38.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.404+0000 7fd920012740 20 client.15456 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:38.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.404+0000 7fd920012740 1 --2- 172.21.15.22:0/651946911 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563d5cde7300 0x563d5cde96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.404+0000 7fd920012740 4 client.15456 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:31:38.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.404+0000 7fd920012740 1 -- 172.21.15.22:0/651946911 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563d5cd715a0 con 0x563d5cde7300 2024-08-20T01:31:38.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.404+0000 7fd916d9d640 1 --2- 172.21.15.22:0/651946911 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563d5cde7300 0x563d5cde96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.405+0000 7fd916d9d640 1 --2- 172.21.15.22:0/651946911 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563d5cde7300 0x563d5cde96f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff9d0747be21cb25 server_cookie=737c08725a2ec74d in_seq=0 out_seq=0 2024-08-20T01:31:38.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.405+0000 7fd8faff5640 10 client.15456 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.412+0000 7fd8faff5640 1 -- 172.21.15.22:0/651946911 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563d5cd715a0 con 0x563d5cde7300 2024-08-20T01:31:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.412+0000 7fd8faff5640 10 client.15456 handle_command_reply: tid=0 2024-08-20T01:31:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.412+0000 7fd920012740 1 client.15456 shutdown 2024-08-20T01:31:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.413+0000 7fd920012740 1 -- 172.21.15.22:0/651946911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6cc40 msgr2=0x563d5cd76c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.413+0000 7fd920012740 1 --2- 172.21.15.22:0/651946911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6cc40 0x563d5cd76c50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0e5760 tx=0x7fd90c0ae930 comp rx=0 tx=0).stop 2024-08-20T01:31:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.413+0000 7fd920012740 1 -- 172.21.15.22:0/651946911 shutdown_connections 2024-08-20T01:31:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.413+0000 7fd920012740 1 --2- 172.21.15.22:0/651946911 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563d5cde7300 0x563d5cde96f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.413+0000 7fd920012740 1 --2- 172.21.15.22:0/651946911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d5cd7c510 0x563d5cd77820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.413+0000 7fd920012740 1 --2- 172.21.15.22:0/651946911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d5cd6cc40 0x563d5cd76c50 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.413+0000 7fd920012740 1 --2- 172.21.15.22:0/651946911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5cd678d0 0x563d5cd765b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.413+0000 7fd920012740 1 -- 172.21.15.22:0/651946911 >> 172.21.15.22:0/651946911 conn(0x563d5cd62a20 msgr2=0x563d5cd612c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.413+0000 7fd8faff5640 0 client.15456 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.413+0000 7fd920012740 1 -- 172.21.15.22:0/651946911 shutdown_connections 2024-08-20T01:31:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.413+0000 7fd920012740 1 -- 172.21.15.22:0/651946911 wait complete. 2024-08-20T01:31:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.413+0000 7fd920012740 20 client.15456 trim_cache size 0 max 16384 2024-08-20T01:31:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:31:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:31:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:31:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:31:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.414+0000 7fd91d143640 1 -- 172.21.15.22:0/3574924725 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9000b3bd0 msgr2=0x7fd9000b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.414+0000 7fd91d143640 1 --2- 172.21.15.22:0/3574924725 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9000b3bd0 0x7fd9000b6090 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd9181997e0 tx=0x7fd91003d040 comp rx=0 tx=0).stop 2024-08-20T01:31:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.414+0000 7fd91d143640 1 -- 172.21.15.22:0/3574924725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9181026b0 msgr2=0x7fd9181990b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.414+0000 7fd91d143640 1 --2- 172.21.15.22:0/3574924725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9181026b0 0x7fd9181990b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00d770 tx=0x7fd90c00dc30 comp rx=0 tx=0).stop 2024-08-20T01:31:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.414+0000 7fd91d143640 1 -- 172.21.15.22:0/3574924725 shutdown_connections 2024-08-20T01:31:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.414+0000 7fd91d143640 1 --2- 172.21.15.22:0/3574924725 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9000b3bd0 0x7fd9000b6090 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.414+0000 7fd91d143640 1 --2- 172.21.15.22:0/3574924725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd918103070 0x7fd918199ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.414+0000 7fd91d143640 1 --2- 172.21.15.22:0/3574924725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9181026b0 0x7fd9181990b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.414+0000 7fd91d143640 1 --2- 172.21.15.22:0/3574924725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd918101560 0x7fd918198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.414+0000 7fd91d143640 1 -- 172.21.15.22:0/3574924725 >> 172.21.15.22:0/3574924725 conn(0x7fd9180fce40 msgr2=0x7fd9180fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.414+0000 7fd91d143640 1 -- 172.21.15.22:0/3574924725 shutdown_connections 2024-08-20T01:31:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:38.414+0000 7fd91d143640 1 -- 172.21.15.22:0/3574924725 wait complete. 2024-08-20T01:31:38.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.502+0000 7ff91b83d640 1 -- 172.21.15.22:0/2385444223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff914075270 msgr2=0x7ff914075650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:38.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.502+0000 7ff91b83d640 1 --2- 172.21.15.22:0/2385444223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff914075270 0x7ff914075650 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff910009900 tx=0x7ff91002a410 comp rx=0 tx=0).stop 2024-08-20T01:31:38.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.502+0000 7ff91b83d640 1 -- 172.21.15.22:0/2385444223 shutdown_connections 2024-08-20T01:31:38.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.502+0000 7ff91b83d640 1 --2- 172.21.15.22:0/2385444223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff91410f110 0x7ff914111500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.502+0000 7ff91b83d640 1 --2- 172.21.15.22:0/2385444223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff914075c70 0x7ff91410eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.502+0000 7ff91b83d640 1 --2- 172.21.15.22:0/2385444223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff914075270 0x7ff914075650 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.502+0000 7ff91b83d640 1 -- 172.21.15.22:0/2385444223 >> 172.21.15.22:0/2385444223 conn(0x7ff9140fe540 msgr2=0x7ff914100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:38.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.502+0000 7ff91b83d640 1 -- 172.21.15.22:0/2385444223 shutdown_connections 2024-08-20T01:31:38.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.502+0000 7ff91b83d640 1 -- 172.21.15.22:0/2385444223 wait complete. 2024-08-20T01:31:38.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.503+0000 7ff91b83d640 1 Processor -- start 2024-08-20T01:31:38.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.503+0000 7ff91b83d640 1 -- start start 2024-08-20T01:31:38.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.503+0000 7ff91b83d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff914075270 0x7ff91419b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.503+0000 7ff91b83d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff914075c70 0x7ff91419b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.503+0000 7ff91b83d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff91410f110 0x7ff9141a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.503+0000 7ff91b83d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff914114d10 con 0x7ff914075c70 2024-08-20T01:31:38.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.503+0000 7ff91b83d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff914114b90 con 0x7ff914075270 2024-08-20T01:31:38.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.503+0000 7ff91b83d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff914114e90 con 0x7ff91410f110 2024-08-20T01:31:38.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.504+0000 7ff9195d9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff914075270 0x7ff91419b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.504+0000 7ff9195d9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff914075270 0x7ff91419b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:55190/0 (socket says 172.21.15.22:55190) 2024-08-20T01:31:38.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.504+0000 7ff9195d9640 1 -- 172.21.15.22:0/257099283 learned_addr learned my addr 172.21.15.22:0/257099283 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:38.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.504+0000 7ff918dd8640 1 --2- 172.21.15.22:0/257099283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff914075c70 0x7ff91419b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.504+0000 7ff919dda640 1 --2- 172.21.15.22:0/257099283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff91410f110 0x7ff9141a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.504+0000 7ff9195d9640 1 -- 172.21.15.22:0/257099283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff91410f110 msgr2=0x7ff9141a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:38.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.504+0000 7ff9195d9640 1 --2- 172.21.15.22:0/257099283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff91410f110 0x7ff9141a0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.504+0000 7ff9195d9640 1 -- 172.21.15.22:0/257099283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff914075c70 msgr2=0x7ff91419b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:38.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.504+0000 7ff9195d9640 1 --2- 172.21.15.22:0/257099283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff914075c70 0x7ff91419b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.504+0000 7ff9195d9640 1 -- 172.21.15.22:0/257099283 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9141a1250 con 0x7ff914075270 2024-08-20T01:31:38.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.504+0000 7ff918dd8640 1 --2- 172.21.15.22:0/257099283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff914075c70 0x7ff91419b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:31:38.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.505+0000 7ff9195d9640 1 --2- 172.21.15.22:0/257099283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff914075270 0x7ff91419b1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff910005ab0 tx=0x7ff910003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:38.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.505+0000 7ff90a7fc640 1 -- 172.21.15.22:0/257099283 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91003f070 con 0x7ff914075270 2024-08-20T01:31:38.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.505+0000 7ff90a7fc640 1 -- 172.21.15.22:0/257099283 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff910031d60 con 0x7ff914075270 2024-08-20T01:31:38.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.505+0000 7ff91b83d640 1 -- 172.21.15.22:0/257099283 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9141a14e0 con 0x7ff914075270 2024-08-20T01:31:38.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.505+0000 7ff90a7fc640 1 -- 172.21.15.22:0/257099283 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff910035030 con 0x7ff914075270 2024-08-20T01:31:38.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.505+0000 7ff91b83d640 1 -- 172.21.15.22:0/257099283 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9141a7c00 con 0x7ff914075270 2024-08-20T01:31:38.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.509+0000 7ff91dc36740 1 Processor -- start 2024-08-20T01:31:38.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.509+0000 7ff91dc36740 1 -- start start 2024-08-20T01:31:38.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.509+0000 7ff91dc36740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba2d730 0x55971ba2db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.509+0000 7ff91dc36740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2e050 0x55971ba422b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.509+0000 7ff91dc36740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba427f0 0x55971ba44be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.509+0000 7ff91dc36740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55971b9a4930 con 0x55971ba2e050 2024-08-20T01:31:38.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.509+0000 7ff91dc36740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55971b993e30 con 0x55971ba427f0 2024-08-20T01:31:38.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.509+0000 7ff91dc36740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55971b997e70 con 0x55971ba2d730 2024-08-20T01:31:38.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.509+0000 7ff90a7fc640 1 -- 172.21.15.22:0/257099283 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff910042070 con 0x7ff914075270 2024-08-20T01:31:38.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.510+0000 7ff919dda640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba2d730 0x55971ba2db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.510+0000 7ff919dda640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba2d730 0x55971ba2db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:57612/0 (socket says 172.21.15.22:57612) 2024-08-20T01:31:38.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.510+0000 7ff919dda640 1 -- 172.21.15.22:0/3124638703 learned_addr learned my addr 172.21.15.22:0/3124638703 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:38.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.510+0000 7ff918dd8640 1 --2- 172.21.15.22:0/3124638703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba427f0 0x55971ba44be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.510+0000 7ff9195d9640 1 --2- 172.21.15.22:0/3124638703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2e050 0x55971ba422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.510+0000 7ff919dda640 1 -- 172.21.15.22:0/3124638703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba427f0 msgr2=0x55971ba44be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:38.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.510+0000 7ff919dda640 1 --2- 172.21.15.22:0/3124638703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba427f0 0x55971ba44be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.510+0000 7ff919dda640 1 -- 172.21.15.22:0/3124638703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2e050 msgr2=0x55971ba422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:38.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.511+0000 7ff90a7fc640 1 --2- 172.21.15.22:0/257099283 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff9000b3bd0 0x7ff9000b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.511+0000 7ff919dda640 1 --2- 172.21.15.22:0/3124638703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2e050 0x55971ba422b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.511+0000 7ff919dda640 1 -- 172.21.15.22:0/3124638703 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55971b6f3650 con 0x55971ba2d730 2024-08-20T01:31:38.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.511+0000 7ff918dd8640 1 --2- 172.21.15.22:0/3124638703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba427f0 0x55971ba44be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:31:38.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.511+0000 7ff9195d9640 1 --2- 172.21.15.22:0/3124638703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2e050 0x55971ba422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:31:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.511+0000 7ff918dd8640 1 --2- 172.21.15.22:0/257099283 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff9000b3bd0 0x7ff9000b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.511+0000 7ff919dda640 1 --2- 172.21.15.22:0/3124638703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba2d730 0x55971ba2db10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009f30 tx=0x7ff90c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a9f9e5000276225 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.512+0000 7ff8ff7fe640 1 -- 172.21.15.22:0/3124638703 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c004d20 con 0x55971ba2d730 2024-08-20T01:31:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.512+0000 7ff8ff7fe640 1 -- 172.21.15.22:0/3124638703 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff90c004050 con 0x55971ba2d730 2024-08-20T01:31:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.512+0000 7ff90a7fc640 1 -- 172.21.15.22:0/257099283 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ff910104420 con 0x7ff914075270 2024-08-20T01:31:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.513+0000 7ff8ff7fe640 1 -- 172.21.15.22:0/3124638703 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c005280 con 0x55971ba2d730 2024-08-20T01:31:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.513+0000 7ff91dc36740 1 -- 172.21.15.22:0/3124638703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba2d730 msgr2=0x55971ba2db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.513+0000 7ff91dc36740 1 --2- 172.21.15.22:0/3124638703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba2d730 0x55971ba2db10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009f30 tx=0x7ff90c0118d0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.513+0000 7ff918dd8640 1 --2- 172.21.15.22:0/257099283 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff9000b3bd0 0x7ff9000b6090 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff914100d70 tx=0x7ff90400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.513+0000 7ff91dc36740 1 -- 172.21.15.22:0/3124638703 shutdown_connections 2024-08-20T01:31:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.513+0000 7ff91dc36740 1 --2- 172.21.15.22:0/3124638703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba427f0 0x55971ba44be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.513+0000 7ff91dc36740 1 --2- 172.21.15.22:0/3124638703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2e050 0x55971ba422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.513+0000 7ff91dc36740 1 --2- 172.21.15.22:0/3124638703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba2d730 0x55971ba2db10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.513+0000 7ff91dc36740 1 -- 172.21.15.22:0/3124638703 >> 172.21.15.22:0/3124638703 conn(0x55971ba2b560 msgr2=0x55971ba2c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:38.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.513+0000 7ff91dc36740 1 -- 172.21.15.22:0/3124638703 shutdown_connections 2024-08-20T01:31:38.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.513+0000 7ff91dc36740 1 -- 172.21.15.22:0/3124638703 wait complete. 2024-08-20T01:31:38.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.513+0000 7ff91dc36740 1 -- start start 2024-08-20T01:31:38.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.514+0000 7ff91dc36740 1 Processor -- start 2024-08-20T01:31:38.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.514+0000 7ff91dc36740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2d730 0x55971ba42210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.514+0000 7ff91dc36740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba2e050 0x55971ba3f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.514+0000 7ff91dc36740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba427f0 0x55971ba3fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.514+0000 7ff91dc36740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55971b7f6700 con 0x55971ba2d730 2024-08-20T01:31:38.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.514+0000 7ff91dc36740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55971b91a810 con 0x55971ba2e050 2024-08-20T01:31:38.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.514+0000 7ff91dc36740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55971ba454c0 con 0x55971ba427f0 2024-08-20T01:31:38.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.514+0000 7ff91dc36740 10 client.0 _ll_register_callbacks cb 0x55971b98d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:38.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.514+0000 7ff9195d9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2d730 0x55971ba42210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.514+0000 7ff9195d9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2d730 0x55971ba42210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43760/0 (socket says 172.21.15.22:43760) 2024-08-20T01:31:38.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.514+0000 7ff9195d9640 1 -- 172.21.15.22:0/1838507722 learned_addr learned my addr 172.21.15.22:0/1838507722 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:38.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.515+0000 7ff919dda640 1 --2- 172.21.15.22:0/1838507722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba427f0 0x55971ba3fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.515+0000 7ff9195d9640 1 -- 172.21.15.22:0/1838507722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba427f0 msgr2=0x55971ba3fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:38.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.515+0000 7ff9195d9640 1 --2- 172.21.15.22:0/1838507722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba427f0 0x55971ba3fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.515+0000 7ff9195d9640 1 -- 172.21.15.22:0/1838507722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba2e050 msgr2=0x55971ba3f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:38.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.515+0000 7ff918dd8640 1 --2- 172.21.15.22:0/1838507722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba2e050 0x55971ba3f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.515+0000 7ff9195d9640 1 --2- 172.21.15.22:0/1838507722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba2e050 0x55971ba3f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.515+0000 7ff9195d9640 1 -- 172.21.15.22:0/1838507722 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55971ba4e840 con 0x55971ba2d730 2024-08-20T01:31:38.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.515+0000 7ff9195d9640 1 --2- 172.21.15.22:0/1838507722 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2d730 0x55971ba42210 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff9100c85f0 tx=0x7ff91002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c0ef18a222b986 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:38.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.515+0000 7ff8fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:31:38.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.516+0000 7ff8fcff9640 1 -- 172.21.15.22:0/1838507722 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff910049070 con 0x55971ba2d730 2024-08-20T01:31:38.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.516+0000 7ff8fcff9640 1 -- 172.21.15.22:0/1838507722 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ff9100c7610 con 0x55971ba2d730 2024-08-20T01:31:38.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.516+0000 7ff91dc36740 1 -- 172.21.15.22:0/1838507722 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55971b943150 con 0x55971ba2d730 2024-08-20T01:31:38.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.516+0000 7ff8fcff9640 1 -- 172.21.15.22:0/1838507722 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff9100cb380 con 0x55971ba2d730 2024-08-20T01:31:38.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.516+0000 7ff91dc36740 10 client.15465 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:38.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.516+0000 7ff91dc36740 1 -- 172.21.15.22:0/1838507722 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55971ba510b0 con 0x55971ba2d730 2024-08-20T01:31:38.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.516+0000 7ff8fcff9640 1 -- 172.21.15.22:0/1838507722 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55971b943150 con 0x55971ba2d730 2024-08-20T01:31:38.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.516+0000 7ff8fcff9640 1 -- 172.21.15.22:0/1838507722 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff9100cb5e0 con 0x55971ba2d730 2024-08-20T01:31:38.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.516+0000 7ff91dc36740 10 client.15465 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:38.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.516+0000 7ff91dc36740 10 client.15465 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:31:38.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.516+0000 7ff91dc36740 20 client.15465 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:38.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.516+0000 7ff91dc36740 1 --2- 172.21.15.22:0/1838507722 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55971ba52740 0x55971ba54bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.516+0000 7ff91dc36740 4 client.15465 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:31:38.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.516+0000 7ff91dc36740 1 -- 172.21.15.22:0/1838507722 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55971b9a6880 con 0x55971ba52740 2024-08-20T01:31:38.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.517+0000 7ff918dd8640 1 --2- 172.21.15.22:0/1838507722 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55971ba52740 0x55971ba54bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.517+0000 7ff8fcff9640 10 client.15465 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:31:38.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.517+0000 7ff918dd8640 1 --2- 172.21.15.22:0/1838507722 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55971ba52740 0x55971ba54bd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2b4d4bd092244b7c server_cookie=c00981695ffb78d2 in_seq=0 out_seq=0 2024-08-20T01:31:38.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.518+0000 7ff8fcff9640 1 -- 172.21.15.22:0/1838507722 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55971b9a6880 con 0x55971ba52740 2024-08-20T01:31:38.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.518+0000 7ff8fcff9640 10 client.15465 handle_command_reply: tid=0 2024-08-20T01:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.518+0000 7ff91dc36740 1 client.15465 shutdown 2024-08-20T01:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.518+0000 7ff91dc36740 1 -- 172.21.15.22:0/1838507722 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2d730 msgr2=0x55971ba42210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.518+0000 7ff91dc36740 1 --2- 172.21.15.22:0/1838507722 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2d730 0x55971ba42210 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff9100c85f0 tx=0x7ff91002a410 comp rx=0 tx=0).stop 2024-08-20T01:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.518+0000 7ff91dc36740 1 -- 172.21.15.22:0/1838507722 shutdown_connections 2024-08-20T01:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.518+0000 7ff91dc36740 1 --2- 172.21.15.22:0/1838507722 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55971ba52740 0x55971ba54bd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.518+0000 7ff91dc36740 1 --2- 172.21.15.22:0/1838507722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba427f0 0x55971ba3fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.518+0000 7ff91dc36740 1 --2- 172.21.15.22:0/1838507722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba2e050 0x55971ba3f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.518+0000 7ff91dc36740 1 --2- 172.21.15.22:0/1838507722 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2d730 0x55971ba42210 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.518+0000 7ff91dc36740 1 -- 172.21.15.22:0/1838507722 >> 172.21.15.22:0/1838507722 conn(0x55971ba2b560 msgr2=0x55971ba31100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.518+0000 7ff8fcff9640 0 client.15465 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.519+0000 7ff91dc36740 1 -- 172.21.15.22:0/1838507722 shutdown_connections 2024-08-20T01:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.519+0000 7ff91dc36740 1 -- 172.21.15.22:0/1838507722 wait complete. 2024-08-20T01:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.519+0000 7ff91dc36740 20 client.15465 trim_cache size 0 max 16384 2024-08-20T01:31:38.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.532+0000 7ff91dc36740 1 Processor -- start 2024-08-20T01:31:38.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.532+0000 7ff91dc36740 1 -- start start 2024-08-20T01:31:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.533+0000 7ff91dc36740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2d730 0x55971ba43790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.533+0000 7ff91dc36740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba2e050 0x55971ba43cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.533+0000 7ff91dc36740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba427f0 0x55971ba3dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.533+0000 7ff91dc36740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141ae780 con 0x55971ba2d730 2024-08-20T01:31:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.533+0000 7ff91dc36740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141ac050 con 0x55971ba2e050 2024-08-20T01:31:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.533+0000 7ff91dc36740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141a9f00 con 0x55971ba427f0 2024-08-20T01:31:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.533+0000 7ff9195d9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2d730 0x55971ba43790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.533+0000 7ff918dd8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba2e050 0x55971ba43cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.533+0000 7ff918dd8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba2e050 0x55971ba43cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:55232/0 (socket says 172.21.15.22:55232) 2024-08-20T01:31:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.533+0000 7ff918dd8640 1 -- 172.21.15.22:0/2900454387 learned_addr learned my addr 172.21.15.22:0/2900454387 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.533+0000 7ff919dda640 1 --2- 172.21.15.22:0/2900454387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba427f0 0x55971ba3dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.533+0000 7ff918dd8640 1 -- 172.21.15.22:0/2900454387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba427f0 msgr2=0x55971ba3dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:38.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.533+0000 7ff918dd8640 1 --2- 172.21.15.22:0/2900454387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba427f0 0x55971ba3dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.533+0000 7ff918dd8640 1 -- 172.21.15.22:0/2900454387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2d730 msgr2=0x55971ba43790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:38.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.533+0000 7ff918dd8640 1 --2- 172.21.15.22:0/2900454387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2d730 0x55971ba43790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.533+0000 7ff918dd8640 1 -- 172.21.15.22:0/2900454387 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55971ba524f0 con 0x55971ba2e050 2024-08-20T01:31:38.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.533+0000 7ff919dda640 1 --2- 172.21.15.22:0/2900454387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba427f0 0x55971ba3dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:31:38.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.534+0000 7ff918dd8640 1 --2- 172.21.15.22:0/2900454387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba2e050 0x55971ba43cd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff9040127a0 tx=0x7ff904018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f2881f57c37fc24 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:38.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.534+0000 7ff8feffd640 1 -- 172.21.15.22:0/2900454387 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904018070 con 0x55971ba2e050 2024-08-20T01:31:38.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.534+0000 7ff8feffd640 1 -- 172.21.15.22:0/2900454387 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff904026970 con 0x55971ba2e050 2024-08-20T01:31:38.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.534+0000 7ff8feffd640 1 -- 172.21.15.22:0/2900454387 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90401daf0 con 0x55971ba2e050 2024-08-20T01:31:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.535+0000 7ff91dc36740 1 -- 172.21.15.22:0/2900454387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba2e050 msgr2=0x55971ba43cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.535+0000 7ff91dc36740 1 --2- 172.21.15.22:0/2900454387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba2e050 0x55971ba43cd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff9040127a0 tx=0x7ff904018000 comp rx=0 tx=0).stop 2024-08-20T01:31:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.536+0000 7ff91dc36740 1 -- 172.21.15.22:0/2900454387 shutdown_connections 2024-08-20T01:31:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.536+0000 7ff91dc36740 1 --2- 172.21.15.22:0/2900454387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba427f0 0x55971ba3dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.536+0000 7ff91dc36740 1 --2- 172.21.15.22:0/2900454387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba2e050 0x55971ba43cd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.536+0000 7ff91dc36740 1 --2- 172.21.15.22:0/2900454387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2d730 0x55971ba43790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.536+0000 7ff91dc36740 1 -- 172.21.15.22:0/2900454387 >> 172.21.15.22:0/2900454387 conn(0x55971ba2b560 msgr2=0x55971ba3eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.536+0000 7ff91dc36740 1 -- 172.21.15.22:0/2900454387 shutdown_connections 2024-08-20T01:31:38.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.536+0000 7ff91dc36740 1 -- 172.21.15.22:0/2900454387 wait complete. 2024-08-20T01:31:38.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.536+0000 7ff91dc36740 1 -- start start 2024-08-20T01:31:38.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.536+0000 7ff91dc36740 1 Processor -- start 2024-08-20T01:31:38.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.537+0000 7ff91dc36740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba2d730 0x55971ba5a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.537+0000 7ff91dc36740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2e050 0x55971ba5a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.537+0000 7ff91dc36740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba427f0 0x55971ba4a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.537+0000 7ff91dc36740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141aa550 con 0x55971ba2e050 2024-08-20T01:31:38.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.537+0000 7ff91dc36740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141ab980 con 0x55971ba427f0 2024-08-20T01:31:38.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.537+0000 7ff91dc36740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141aabe0 con 0x55971ba2d730 2024-08-20T01:31:38.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.537+0000 7ff918dd8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2e050 0x55971ba5a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.537+0000 7ff91dc36740 10 client.0 _ll_register_callbacks cb 0x7ff910005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:38.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.537+0000 7ff918dd8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2e050 0x55971ba5a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43780/0 (socket says 172.21.15.22:43780) 2024-08-20T01:31:38.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.537+0000 7ff918dd8640 1 -- 172.21.15.22:0/717939491 learned_addr learned my addr 172.21.15.22:0/717939491 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:38.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.537+0000 7ff919dda640 1 --2- 172.21.15.22:0/717939491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba427f0 0x55971ba4a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.537+0000 7ff9195d9640 1 --2- 172.21.15.22:0/717939491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba2d730 0x55971ba5a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.537+0000 7ff918dd8640 1 -- 172.21.15.22:0/717939491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba2d730 msgr2=0x55971ba5a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:38.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.537+0000 7ff918dd8640 1 --2- 172.21.15.22:0/717939491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba2d730 0x55971ba5a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.537+0000 7ff918dd8640 1 -- 172.21.15.22:0/717939491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba427f0 msgr2=0x55971ba4a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.537+0000 7ff918dd8640 1 --2- 172.21.15.22:0/717939491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba427f0 0x55971ba4a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.537+0000 7ff918dd8640 1 -- 172.21.15.22:0/717939491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55971ba4ad90 con 0x55971ba2e050 2024-08-20T01:31:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.538+0000 7ff918dd8640 1 --2- 172.21.15.22:0/717939491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2e050 0x55971ba5a880 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff904026d50 tx=0x7ff904026d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dfa656b4c47b3fa server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.538+0000 7ff8fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:31:38.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.538+0000 7ff8fcff9640 1 -- 172.21.15.22:0/717939491 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904032070 con 0x55971ba2e050 2024-08-20T01:31:38.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.538+0000 7ff8fcff9640 1 -- 172.21.15.22:0/717939491 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ff9040264c0 con 0x55971ba2e050 2024-08-20T01:31:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.538+0000 7ff91dc36740 1 -- 172.21.15.22:0/717939491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff904026970 con 0x55971ba2e050 2024-08-20T01:31:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.538+0000 7ff8fcff9640 1 -- 172.21.15.22:0/717939491 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff904026700 con 0x55971ba2e050 2024-08-20T01:31:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.538+0000 7ff91dc36740 10 client.15471 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.538+0000 7ff91dc36740 1 -- 172.21.15.22:0/717939491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55971ba2f610 con 0x55971ba2e050 2024-08-20T01:31:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.539+0000 7ff8fcff9640 1 -- 172.21.15.22:0/717939491 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff90403d030 con 0x55971ba2e050 2024-08-20T01:31:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.539+0000 7ff8fcff9640 1 -- 172.21.15.22:0/717939491 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff904037780 con 0x55971ba2e050 2024-08-20T01:31:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.539+0000 7ff91dc36740 10 client.15471 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.539+0000 7ff91dc36740 10 client.15471 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:31:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.539+0000 7ff91dc36740 20 client.15471 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.539+0000 7ff91dc36740 1 --2- 172.21.15.22:0/717939491 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55971babd4a0 0x55971babf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.539+0000 7ff91dc36740 4 client.15471 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:31:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.539+0000 7ff91dc36740 1 -- 172.21.15.22:0/717939491 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff904026970 con 0x55971babd4a0 2024-08-20T01:31:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.539+0000 7ff9195d9640 1 --2- 172.21.15.22:0/717939491 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55971babd4a0 0x55971babf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.540+0000 7ff9195d9640 1 --2- 172.21.15.22:0/717939491 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55971babd4a0 0x55971babf8c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a852e93f1555630f server_cookie=81c15036edef63e4 in_seq=0 out_seq=0 2024-08-20T01:31:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.540+0000 7ff8fcff9640 10 client.15471 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:31:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.540+0000 7ff8fcff9640 1 -- 172.21.15.22:0/717939491 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff904026970 con 0x55971babd4a0 2024-08-20T01:31:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.540+0000 7ff8fcff9640 10 client.15471 handle_command_reply: tid=0 2024-08-20T01:31:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.540+0000 7ff91dc36740 1 client.15471 shutdown 2024-08-20T01:31:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.540+0000 7ff91dc36740 1 -- 172.21.15.22:0/717939491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2e050 msgr2=0x55971ba5a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.540+0000 7ff91dc36740 1 --2- 172.21.15.22:0/717939491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2e050 0x55971ba5a880 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff904026d50 tx=0x7ff904026d80 comp rx=0 tx=0).stop 2024-08-20T01:31:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.540+0000 7ff91dc36740 1 -- 172.21.15.22:0/717939491 shutdown_connections 2024-08-20T01:31:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.540+0000 7ff91dc36740 1 --2- 172.21.15.22:0/717939491 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55971babd4a0 0x55971babf8c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.540+0000 7ff91dc36740 1 --2- 172.21.15.22:0/717939491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971ba427f0 0x55971ba4a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.540+0000 7ff91dc36740 1 --2- 172.21.15.22:0/717939491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55971ba2e050 0x55971ba5a880 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.540+0000 7ff91dc36740 1 --2- 172.21.15.22:0/717939491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55971ba2d730 0x55971ba5a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.540+0000 7ff91dc36740 1 -- 172.21.15.22:0/717939491 >> 172.21.15.22:0/717939491 conn(0x55971ba2b560 msgr2=0x55971ba43790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.540+0000 7ff8fcff9640 0 client.15471 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:31:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.541+0000 7ff91dc36740 1 -- 172.21.15.22:0/717939491 shutdown_connections 2024-08-20T01:31:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.541+0000 7ff91dc36740 1 -- 172.21.15.22:0/717939491 wait complete. 2024-08-20T01:31:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.541+0000 7ff91dc36740 20 client.15471 trim_cache size 0 max 16384 2024-08-20T01:31:38.544 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:31:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.542+0000 7ff91b83d640 1 -- 172.21.15.22:0/257099283 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff9000b3bd0 msgr2=0x7ff9000b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.542+0000 7ff91b83d640 1 --2- 172.21.15.22:0/257099283 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff9000b3bd0 0x7ff9000b6090 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff914100d70 tx=0x7ff90400b410 comp rx=0 tx=0).stop 2024-08-20T01:31:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.542+0000 7ff91b83d640 1 -- 172.21.15.22:0/257099283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff914075270 msgr2=0x7ff91419b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.542+0000 7ff91b83d640 1 --2- 172.21.15.22:0/257099283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff914075270 0x7ff91419b1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff910005ab0 tx=0x7ff910003c80 comp rx=0 tx=0).stop 2024-08-20T01:31:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.542+0000 7ff91b83d640 1 -- 172.21.15.22:0/257099283 shutdown_connections 2024-08-20T01:31:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.542+0000 7ff91b83d640 1 --2- 172.21.15.22:0/257099283 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff9000b3bd0 0x7ff9000b6090 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.542+0000 7ff91b83d640 1 --2- 172.21.15.22:0/257099283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff91410f110 0x7ff9141a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.542+0000 7ff91b83d640 1 --2- 172.21.15.22:0/257099283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff914075c70 0x7ff91419b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.542+0000 7ff91b83d640 1 --2- 172.21.15.22:0/257099283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff914075270 0x7ff91419b1a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.542+0000 7ff91b83d640 1 -- 172.21.15.22:0/257099283 >> 172.21.15.22:0/257099283 conn(0x7ff9140fe540 msgr2=0x7ff9141112d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.542+0000 7ff91b83d640 1 -- 172.21.15.22:0/257099283 shutdown_connections 2024-08-20T01:31:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:38.542+0000 7ff91b83d640 1 -- 172.21.15.22:0/257099283 wait complete. 2024-08-20T01:31:38.682 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:38 smithi022 ceph-mon[18709]: pgmap v361: 97 pgs: 97 active+clean; 667 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-08-20T01:31:39.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:38 smithi134 ceph-mon[22511]: pgmap v361: 97 pgs: 97 active+clean; 667 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-08-20T01:31:39.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:38 smithi077 ceph-mon[22251]: pgmap v361: 97 pgs: 97 active+clean; 667 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-08-20T01:31:39.241 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:31:39.578 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:31:40.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.135+0000 7f6490dc6640 1 -- 172.21.15.22:0/208512091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f648c101eb0 msgr2=0x7f648c10ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:40.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.135+0000 7f6490dc6640 1 --2- 172.21.15.22:0/208512091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f648c101eb0 0x7f648c10ec00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6480009900 tx=0x7f648002a480 comp rx=0 tx=0).stop 2024-08-20T01:31:40.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.135+0000 7f6490dc6640 1 -- 172.21.15.22:0/208512091 shutdown_connections 2024-08-20T01:31:40.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.135+0000 7f6490dc6640 1 --2- 172.21.15.22:0/208512091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648c10f140 0x7f648c111530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.135+0000 7f6490dc6640 1 --2- 172.21.15.22:0/208512091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f648c101eb0 0x7f648c10ec00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.135+0000 7f6490dc6640 1 --2- 172.21.15.22:0/208512091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f648c101590 0x7f648c101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.135+0000 7f6490dc6640 1 -- 172.21.15.22:0/208512091 >> 172.21.15.22:0/208512091 conn(0x7f648c0fd400 msgr2=0x7f648c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:40.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.135+0000 7f6490dc6640 1 -- 172.21.15.22:0/208512091 shutdown_connections 2024-08-20T01:31:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.135+0000 7f6490dc6640 1 -- 172.21.15.22:0/208512091 wait complete. 2024-08-20T01:31:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.136+0000 7f6490dc6640 1 Processor -- start 2024-08-20T01:31:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.136+0000 7f6490dc6640 1 -- start start 2024-08-20T01:31:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.136+0000 7f6490dc6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f648c101590 0x7f648c19b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.136+0000 7f6490dc6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648c101eb0 0x7f648c19b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.136+0000 7f6490dc6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f648c10f140 0x7f648c1a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.136+0000 7f6490dc6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f648c114c50 con 0x7f648c101590 2024-08-20T01:31:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.136+0000 7f6490dc6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f648c114ad0 con 0x7f648c10f140 2024-08-20T01:31:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.136+0000 7f6490dc6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f648c114dd0 con 0x7f648c101eb0 2024-08-20T01:31:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.136+0000 7f648a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f648c101590 0x7f648c19b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.136+0000 7f648a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f648c101590 0x7f648c19b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35586/0 (socket says 172.21.15.22:35586) 2024-08-20T01:31:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.136+0000 7f648a59c640 1 -- 172.21.15.22:0/1498076596 learned_addr learned my addr 172.21.15.22:0/1498076596 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.136+0000 7f6489d9b640 1 --2- 172.21.15.22:0/1498076596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648c101eb0 0x7f648c19b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.137+0000 7f648ad9d640 1 --2- 172.21.15.22:0/1498076596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f648c10f140 0x7f648c1a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.137+0000 7f648a59c640 1 -- 172.21.15.22:0/1498076596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648c101eb0 msgr2=0x7f648c19b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.137+0000 7f648a59c640 1 --2- 172.21.15.22:0/1498076596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648c101eb0 0x7f648c19b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.137+0000 7f648a59c640 1 -- 172.21.15.22:0/1498076596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f648c10f140 msgr2=0x7f648c1a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.137+0000 7f648a59c640 1 --2- 172.21.15.22:0/1498076596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f648c10f140 0x7f648c1a0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.137+0000 7f648a59c640 1 -- 172.21.15.22:0/1498076596 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c1a1210 con 0x7f648c101590 2024-08-20T01:31:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.137+0000 7f648ad9d640 1 --2- 172.21.15.22:0/1498076596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f648c10f140 0x7f648c1a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:31:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.137+0000 7f648a59c640 1 --2- 172.21.15.22:0/1498076596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f648c101590 0x7f648c19b160 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f647c00c920 tx=0x7f647c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.137+0000 7f647b7fe640 1 -- 172.21.15.22:0/1498076596 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c007c70 con 0x7f648c101590 2024-08-20T01:31:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.137+0000 7f647b7fe640 1 -- 172.21.15.22:0/1498076596 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f647c007e10 con 0x7f648c101590 2024-08-20T01:31:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.137+0000 7f6490dc6640 1 -- 172.21.15.22:0/1498076596 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f648c1a1500 con 0x7f648c101590 2024-08-20T01:31:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.138+0000 7f647b7fe640 1 -- 172.21.15.22:0/1498076596 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c018820 con 0x7f648c101590 2024-08-20T01:31:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.138+0000 7f6490dc6640 1 -- 172.21.15.22:0/1498076596 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f648c1a7bc0 con 0x7f648c101590 2024-08-20T01:31:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.141+0000 7f64931bf740 1 Processor -- start 2024-08-20T01:31:40.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.141+0000 7f64931bf740 1 -- start start 2024-08-20T01:31:40.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.142+0000 7f64931bf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74e96880 0x557e74e96c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.142+0000 7f647b7fe640 1 -- 172.21.15.22:0/1498076596 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f647c00f450 con 0x7f648c101590 2024-08-20T01:31:40.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.142+0000 7f64931bf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74e971a0 0x557e74ea2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.142+0000 7f64931bf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74ea3130 0x557e74ea5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.142+0000 7f64931bf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557e74e0d930 con 0x557e74ea3130 2024-08-20T01:31:40.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.142+0000 7f64931bf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557e74dfce30 con 0x557e74e971a0 2024-08-20T01:31:40.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.142+0000 7f64931bf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557e74e00e70 con 0x557e74e96880 2024-08-20T01:31:40.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.142+0000 7f6489d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74ea3130 0x557e74ea5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.142+0000 7f6489d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74ea3130 0x557e74ea5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35592/0 (socket says 172.21.15.22:35592) 2024-08-20T01:31:40.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.142+0000 7f6489d9b640 1 -- 172.21.15.22:0/3996974152 learned_addr learned my addr 172.21.15.22:0/3996974152 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:40.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.142+0000 7f648a59c640 1 --2- 172.21.15.22:0/3996974152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74e971a0 0x557e74ea2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.142+0000 7f648ad9d640 1 --2- 172.21.15.22:0/3996974152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74e96880 0x557e74e96c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.143+0000 7f6489d9b640 1 -- 172.21.15.22:0/3996974152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74e96880 msgr2=0x557e74e96c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:40.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.143+0000 7f6489d9b640 1 --2- 172.21.15.22:0/3996974152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74e96880 0x557e74e96c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.143+0000 7f6489d9b640 1 -- 172.21.15.22:0/3996974152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74e971a0 msgr2=0x557e74ea2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:40.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.143+0000 7f6489d9b640 1 --2- 172.21.15.22:0/3996974152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74e971a0 0x557e74ea2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.143+0000 7f6489d9b640 1 -- 172.21.15.22:0/3996974152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e74b5c650 con 0x557e74ea3130 2024-08-20T01:31:40.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.143+0000 7f648a59c640 1 --2- 172.21.15.22:0/3996974152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74e971a0 0x557e74ea2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:31:40.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.143+0000 7f6489d9b640 1 --2- 172.21.15.22:0/3996974152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74ea3130 0x557e74ea5520 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6480033000 tx=0x7f6480032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ce56e0c21df0a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:40.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.143+0000 7f6478ff9640 1 -- 172.21.15.22:0/3996974152 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480035040 con 0x557e74ea3130 2024-08-20T01:31:40.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.144+0000 7f6478ff9640 1 -- 172.21.15.22:0/3996974152 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64800316a0 con 0x557e74ea3130 2024-08-20T01:31:40.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.144+0000 7f6478ff9640 1 -- 172.21.15.22:0/3996974152 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480004750 con 0x557e74ea3130 2024-08-20T01:31:40.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.144+0000 7f647b7fe640 1 --2- 172.21.15.22:0/1498076596 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f64740b3da0 0x7f64740b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.144+0000 7f648ad9d640 1 --2- 172.21.15.22:0/1498076596 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f64740b3da0 0x7f64740b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.144+0000 7f647b7fe640 1 -- 172.21.15.22:0/1498076596 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f647c0e3d00 con 0x7f648c101590 2024-08-20T01:31:40.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.145+0000 7f64931bf740 1 -- 172.21.15.22:0/3996974152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74ea3130 msgr2=0x557e74ea5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:40.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.145+0000 7f64931bf740 1 --2- 172.21.15.22:0/3996974152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74ea3130 0x557e74ea5520 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6480033000 tx=0x7f6480032e60 comp rx=0 tx=0).stop 2024-08-20T01:31:40.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.145+0000 7f64931bf740 1 -- 172.21.15.22:0/3996974152 shutdown_connections 2024-08-20T01:31:40.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.145+0000 7f64931bf740 1 --2- 172.21.15.22:0/3996974152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74ea3130 0x557e74ea5520 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.145+0000 7f64931bf740 1 --2- 172.21.15.22:0/3996974152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74e971a0 0x557e74ea2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.145+0000 7f64931bf740 1 --2- 172.21.15.22:0/3996974152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74e96880 0x557e74e96c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.145+0000 7f64931bf740 1 -- 172.21.15.22:0/3996974152 >> 172.21.15.22:0/3996974152 conn(0x557e74e946b0 msgr2=0x557e74e95850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:40.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.145+0000 7f64931bf740 1 -- 172.21.15.22:0/3996974152 shutdown_connections 2024-08-20T01:31:40.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.145+0000 7f64931bf740 1 -- 172.21.15.22:0/3996974152 wait complete. 2024-08-20T01:31:40.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.145+0000 7f648ad9d640 1 --2- 172.21.15.22:0/1498076596 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f64740b3da0 0x7f64740b6260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f648c102570 tx=0x7f64840098a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:40.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.145+0000 7f64931bf740 1 -- start start 2024-08-20T01:31:40.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.146+0000 7f64931bf740 1 Processor -- start 2024-08-20T01:31:40.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.146+0000 7f64931bf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74e96880 0x557e74ea00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.146+0000 7f64931bf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e971a0 0x557e74ea0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.146+0000 7f6489d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e971a0 0x557e74ea0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.146+0000 7f6489d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e971a0 0x557e74ea0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35594/0 (socket says 172.21.15.22:35594) 2024-08-20T01:31:40.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.146+0000 7f6489d9b640 1 -- 172.21.15.22:0/3469305303 learned_addr learned my addr 172.21.15.22:0/3469305303 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:40.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.146+0000 7f64931bf740 1 --2- 172.21.15.22:0/3469305303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74ea3130 0x557e74ea0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.146+0000 7f64931bf740 1 -- 172.21.15.22:0/3469305303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557e74c5f700 con 0x557e74e971a0 2024-08-20T01:31:40.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.146+0000 7f64931bf740 1 -- 172.21.15.22:0/3469305303 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557e74d83810 con 0x557e74ea3130 2024-08-20T01:31:40.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.146+0000 7f64931bf740 1 -- 172.21.15.22:0/3469305303 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557e74ea5d80 con 0x557e74e96880 2024-08-20T01:31:40.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.146+0000 7f648a59c640 1 --2- 172.21.15.22:0/3469305303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74e96880 0x557e74ea00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.147+0000 7f648ad9d640 1 --2- 172.21.15.22:0/3469305303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74ea3130 0x557e74ea0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.147+0000 7f6489d9b640 1 -- 172.21.15.22:0/3469305303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74e96880 msgr2=0x557e74ea00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:40.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.147+0000 7f6489d9b640 1 --2- 172.21.15.22:0/3469305303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74e96880 0x557e74ea00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.147+0000 7f6489d9b640 1 -- 172.21.15.22:0/3469305303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74ea3130 msgr2=0x557e74ea0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:40.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.147+0000 7f6489d9b640 1 --2- 172.21.15.22:0/3469305303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74ea3130 0x557e74ea0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.147+0000 7f6489d9b640 1 -- 172.21.15.22:0/3469305303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e74eaf190 con 0x557e74e971a0 2024-08-20T01:31:40.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.147+0000 7f64931bf740 10 client.0 _ll_register_callbacks cb 0x557e74df6700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:40.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.147+0000 7f64931bf740 1 -- 172.21.15.22:0/3469305303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557e74dac150 con 0x557e74e971a0 2024-08-20T01:31:40.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.147+0000 7f6489d9b640 1 --2- 172.21.15.22:0/3469305303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e971a0 0x557e74ea0600 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6480005b50 tx=0x7f648002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28613ec3ef3b1d60 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:40.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.147+0000 7f6471ffb640 10 client.15483 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:31:40.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.148+0000 7f6471ffb640 1 -- 172.21.15.22:0/3469305303 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480035040 con 0x557e74e971a0 2024-08-20T01:31:40.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.148+0000 7f6471ffb640 1 -- 172.21.15.22:0/3469305303 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f64800316a0 con 0x557e74e971a0 2024-08-20T01:31:40.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.148+0000 7f6471ffb640 1 -- 172.21.15.22:0/3469305303 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f64800318e0 con 0x557e74e971a0 2024-08-20T01:31:40.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.148+0000 7f64931bf740 10 client.15483 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:40.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.148+0000 7f64931bf740 1 -- 172.21.15.22:0/3469305303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({fsmap=25}) -- 0x557e74eb1740 con 0x557e74e971a0 2024-08-20T01:31:40.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.149+0000 7f6471ffb640 1 -- 172.21.15.22:0/3469305303 <== mon.0 v2:172.21.15.22:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6480004750 con 0x557e74e971a0 2024-08-20T01:31:40.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.149+0000 7f64931bf740 10 client.15483 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:40.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.149+0000 7f64931bf740 10 client.15483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:31:40.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.149+0000 7f64931bf740 20 client.15483 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:40.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.149+0000 7f64931bf740 1 --2- 172.21.15.22:0/3469305303 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557e74eb2e50 0x557e74eb5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.149+0000 7f64931bf740 4 client.15483 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:31:40.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.149+0000 7f64931bf740 1 -- 172.21.15.22:0/3469305303 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e74e0f880 con 0x557e74eb2e50 2024-08-20T01:31:40.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.149+0000 7f648a59c640 1 --2- 172.21.15.22:0/3469305303 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557e74eb2e50 0x557e74eb5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.150+0000 7f6471ffb640 10 client.15483 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:40.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.150+0000 7f648a59c640 1 --2- 172.21.15.22:0/3469305303 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557e74eb2e50 0x557e74eb5310 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86e8ff953a2575ff server_cookie=3cb784ca7600c39d in_seq=0 out_seq=0 2024-08-20T01:31:40.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.150+0000 7f6471ffb640 1 -- 172.21.15.22:0/3469305303 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557e74e0f880 con 0x557e74eb2e50 2024-08-20T01:31:40.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.150+0000 7f6471ffb640 10 client.15483 handle_command_reply: tid=0 2024-08-20T01:31:40.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.151+0000 7f64931bf740 1 client.15483 shutdown 2024-08-20T01:31:40.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.153+0000 7f64931bf740 1 -- 172.21.15.22:0/3469305303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e971a0 msgr2=0x557e74ea0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:40.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.153+0000 7f64931bf740 1 --2- 172.21.15.22:0/3469305303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e971a0 0x557e74ea0600 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6480005b50 tx=0x7f648002a480 comp rx=0 tx=0).stop 2024-08-20T01:31:40.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.153+0000 7f64931bf740 1 -- 172.21.15.22:0/3469305303 shutdown_connections 2024-08-20T01:31:40.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.153+0000 7f64931bf740 1 --2- 172.21.15.22:0/3469305303 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557e74eb2e50 0x557e74eb5310 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.153+0000 7f64931bf740 1 --2- 172.21.15.22:0/3469305303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74ea3130 0x557e74ea0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.153+0000 7f6471ffb640 0 client.15483 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:40.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.153+0000 7f64931bf740 1 --2- 172.21.15.22:0/3469305303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e971a0 0x557e74ea0600 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.153+0000 7f64931bf740 1 --2- 172.21.15.22:0/3469305303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74e96880 0x557e74ea00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.153+0000 7f64931bf740 1 -- 172.21.15.22:0/3469305303 >> 172.21.15.22:0/3469305303 conn(0x557e74e946b0 msgr2=0x557e74e9a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:40.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.153+0000 7f64931bf740 1 -- 172.21.15.22:0/3469305303 shutdown_connections 2024-08-20T01:31:40.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.153+0000 7f64931bf740 1 -- 172.21.15.22:0/3469305303 wait complete. 2024-08-20T01:31:40.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.153+0000 7f64931bf740 20 client.15483 trim_cache size 0 max 16384 2024-08-20T01:31:40.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.179+0000 7f64931bf740 1 Processor -- start 2024-08-20T01:31:40.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.179+0000 7f64931bf740 1 -- start start 2024-08-20T01:31:40.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.179+0000 7f64931bf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e96880 0x557e74e9aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.179+0000 7f64931bf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74e971a0 0x557e74ea1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.179+0000 7f64931bf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74ea3130 0x557e74ebac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.179+0000 7f64931bf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f648c1b2b20 con 0x557e74e96880 2024-08-20T01:31:40.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.179+0000 7f64931bf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f648c1b03f0 con 0x557e74e971a0 2024-08-20T01:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.179+0000 7f64931bf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f648c1ae240 con 0x557e74ea3130 2024-08-20T01:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.179+0000 7f648a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e96880 0x557e74e9aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.179+0000 7f648a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e96880 0x557e74e9aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35598/0 (socket says 172.21.15.22:35598) 2024-08-20T01:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.180+0000 7f648a59c640 1 -- 172.21.15.22:0/1476991724 learned_addr learned my addr 172.21.15.22:0/1476991724 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.180+0000 7f6489d9b640 1 --2- 172.21.15.22:0/1476991724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74e971a0 0x557e74ea1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.180+0000 7f648a59c640 1 -- 172.21.15.22:0/1476991724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74ea3130 msgr2=0x557e74ebac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.180+0000 7f648a59c640 1 --2- 172.21.15.22:0/1476991724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74ea3130 0x557e74ebac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.180+0000 7f648a59c640 1 -- 172.21.15.22:0/1476991724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74e971a0 msgr2=0x557e74ea1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.180+0000 7f648a59c640 1 --2- 172.21.15.22:0/1476991724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74e971a0 0x557e74ea1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.180+0000 7f648a59c640 1 -- 172.21.15.22:0/1476991724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e74e95130 con 0x557e74e96880 2024-08-20T01:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.180+0000 7f6489d9b640 1 --2- 172.21.15.22:0/1476991724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74e971a0 0x557e74ea1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.180+0000 7f648a59c640 1 --2- 172.21.15.22:0/1476991724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e96880 0x557e74e9aa40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f647c0aab40 tx=0x7f647c00fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ccbd907030185c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:40.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.180+0000 7f6473fff640 1 -- 172.21.15.22:0/1476991724 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c0aabb0 con 0x557e74e96880 2024-08-20T01:31:40.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.181+0000 7f6473fff640 1 -- 172.21.15.22:0/1476991724 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f647c0af1b0 con 0x557e74e96880 2024-08-20T01:31:40.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.181+0000 7f6473fff640 1 -- 172.21.15.22:0/1476991724 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c00f740 con 0x557e74e96880 2024-08-20T01:31:40.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.182+0000 7f64931bf740 1 -- 172.21.15.22:0/1476991724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e96880 msgr2=0x557e74e9aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:40.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.182+0000 7f64931bf740 1 --2- 172.21.15.22:0/1476991724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e96880 0x557e74e9aa40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f647c0aab40 tx=0x7f647c00fe60 comp rx=0 tx=0).stop 2024-08-20T01:31:40.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.182+0000 7f64931bf740 1 -- 172.21.15.22:0/1476991724 shutdown_connections 2024-08-20T01:31:40.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.182+0000 7f64931bf740 1 --2- 172.21.15.22:0/1476991724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74ea3130 0x557e74ebac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.182+0000 7f64931bf740 1 --2- 172.21.15.22:0/1476991724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74e971a0 0x557e74ea1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.182+0000 7f64931bf740 1 --2- 172.21.15.22:0/1476991724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e96880 0x557e74e9aa40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.182+0000 7f64931bf740 1 -- 172.21.15.22:0/1476991724 >> 172.21.15.22:0/1476991724 conn(0x557e74e946b0 msgr2=0x557e74ea16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:40.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.182+0000 7f64931bf740 1 -- 172.21.15.22:0/1476991724 shutdown_connections 2024-08-20T01:31:40.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.182+0000 7f64931bf740 1 -- 172.21.15.22:0/1476991724 wait complete. 2024-08-20T01:31:40.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.182+0000 7f64931bf740 1 -- start start 2024-08-20T01:31:40.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.182+0000 7f64931bf740 1 Processor -- start 2024-08-20T01:31:40.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.183+0000 7f64931bf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74e96880 0x557e74eab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.183+0000 7f64931bf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e971a0 0x557e74ea7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.183+0000 7f64931bf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74ea3130 0x557e74ea8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.183+0000 7f6489d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e971a0 0x557e74ea7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.183+0000 7f64931bf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f648c1ae8b0 con 0x557e74e971a0 2024-08-20T01:31:40.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.183+0000 7f64931bf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f648c1afd20 con 0x557e74ea3130 2024-08-20T01:31:40.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.183+0000 7f64931bf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f648c1aef80 con 0x557e74e96880 2024-08-20T01:31:40.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.183+0000 7f6489d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e971a0 0x557e74ea7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35614/0 (socket says 172.21.15.22:35614) 2024-08-20T01:31:40.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.183+0000 7f6489d9b640 1 -- 172.21.15.22:0/1603625800 learned_addr learned my addr 172.21.15.22:0/1603625800 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:40.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.183+0000 7f64931bf740 10 client.0 _ll_register_callbacks cb 0x7f6484009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:40.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.183+0000 7f648a59c640 1 --2- 172.21.15.22:0/1603625800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74e96880 0x557e74eab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.183+0000 7f648ad9d640 1 --2- 172.21.15.22:0/1603625800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74ea3130 0x557e74ea8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.183+0000 7f648a59c640 1 -- 172.21.15.22:0/1603625800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74ea3130 msgr2=0x557e74ea8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:40.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.183+0000 7f648a59c640 1 --2- 172.21.15.22:0/1603625800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74ea3130 0x557e74ea8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.183+0000 7f648a59c640 1 -- 172.21.15.22:0/1603625800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e971a0 msgr2=0x557e74ea7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.183+0000 7f648a59c640 1 --2- 172.21.15.22:0/1603625800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e971a0 0x557e74ea7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.183+0000 7f648a59c640 1 -- 172.21.15.22:0/1603625800 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e74f1bbf0 con 0x557e74e96880 2024-08-20T01:31:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.184+0000 7f6489d9b640 1 --2- 172.21.15.22:0/1603625800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e971a0 0x557e74ea7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:31:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.184+0000 7f648a59c640 1 --2- 172.21.15.22:0/1603625800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74e96880 0x557e74eab8d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f647c0aab40 tx=0x7f647c0aaca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c35b0b980f556e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.184+0000 7f6471ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:31:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.184+0000 7f6471ffb640 1 -- 172.21.15.22:0/1603625800 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c0b7030 con 0x557e74e96880 2024-08-20T01:31:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.184+0000 7f6471ffb640 1 -- 172.21.15.22:0/1603625800 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f647c0ca040 con 0x557e74e96880 2024-08-20T01:31:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.184+0000 7f64931bf740 1 -- 172.21.15.22:0/1603625800 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f647c0af1b0 con 0x557e74e96880 2024-08-20T01:31:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.184+0000 7f6471ffb640 1 -- 172.21.15.22:0/1603625800 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f647c00f740 con 0x557e74e96880 2024-08-20T01:31:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.184+0000 7f64931bf740 10 client.25111 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.184+0000 7f64931bf740 1 -- 172.21.15.22:0/1603625800 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557e74f1cdf0 con 0x557e74e96880 2024-08-20T01:31:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.185+0000 7f6471ffb640 1 -- 172.21.15.22:0/1603625800 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f647c0af1b0 con 0x557e74e96880 2024-08-20T01:31:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.185+0000 7f6471ffb640 1 -- 172.21.15.22:0/1603625800 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f647c0c2070 con 0x557e74e96880 2024-08-20T01:31:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.185+0000 7f64931bf740 10 client.25111 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:40.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.185+0000 7f64931bf740 10 client.25111 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:31:40.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.185+0000 7f64931bf740 20 client.25111 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:40.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.185+0000 7f64931bf740 1 --2- 172.21.15.22:0/1603625800 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557e74eb2e50 0x557e74f1f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.185+0000 7f64931bf740 4 client.25111 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:31:40.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.185+0000 7f64931bf740 1 -- 172.21.15.22:0/1603625800 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557e74e0b320 con 0x557e74eb2e50 2024-08-20T01:31:40.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.185+0000 7f6489d9b640 1 --2- 172.21.15.22:0/1603625800 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557e74eb2e50 0x557e74f1f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.186+0000 7f6471ffb640 10 client.25111 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:40.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.186+0000 7f6489d9b640 1 --2- 172.21.15.22:0/1603625800 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557e74eb2e50 0x557e74f1f410 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca66a63b08bf9e28 server_cookie=de6b7ba94b5cf022 in_seq=0 out_seq=0 2024-08-20T01:31:40.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.186+0000 7f6471ffb640 1 -- 172.21.15.22:0/1603625800 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557e74e0b320 con 0x557e74eb2e50 2024-08-20T01:31:40.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.186+0000 7f6471ffb640 10 client.25111 handle_command_reply: tid=0 2024-08-20T01:31:40.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.186+0000 7f64931bf740 1 client.25111 shutdown 2024-08-20T01:31:40.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.186+0000 7f64931bf740 1 -- 172.21.15.22:0/1603625800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74e96880 msgr2=0x557e74eab8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:40.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.186+0000 7f64931bf740 1 --2- 172.21.15.22:0/1603625800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74e96880 0x557e74eab8d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f647c0aab40 tx=0x7f647c0aaca0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.186+0000 7f64931bf740 1 -- 172.21.15.22:0/1603625800 shutdown_connections 2024-08-20T01:31:40.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.186+0000 7f64931bf740 1 --2- 172.21.15.22:0/1603625800 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557e74eb2e50 0x557e74f1f410 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.191 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:31:40.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.186+0000 7f6471ffb640 0 client.25111 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:40.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.186+0000 7f64931bf740 1 --2- 172.21.15.22:0/1603625800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e74ea3130 0x557e74ea8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.186+0000 7f64931bf740 1 --2- 172.21.15.22:0/1603625800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e74e971a0 0x557e74ea7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.186+0000 7f64931bf740 1 --2- 172.21.15.22:0/1603625800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e74e96880 0x557e74eab8d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.186+0000 7f64931bf740 1 -- 172.21.15.22:0/1603625800 >> 172.21.15.22:0/1603625800 conn(0x557e74e946b0 msgr2=0x557e74ea1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:40.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.186+0000 7f64931bf740 1 -- 172.21.15.22:0/1603625800 shutdown_connections 2024-08-20T01:31:40.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.186+0000 7f64931bf740 1 -- 172.21.15.22:0/1603625800 wait complete. 2024-08-20T01:31:40.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.187+0000 7f64931bf740 20 client.25111 trim_cache size 0 max 16384 2024-08-20T01:31:40.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.187+0000 7f6490dc6640 1 -- 172.21.15.22:0/1498076596 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f64740b3da0 msgr2=0x7f64740b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:40.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.187+0000 7f6490dc6640 1 --2- 172.21.15.22:0/1498076596 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f64740b3da0 0x7f64740b6260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f648c102570 tx=0x7f64840098a0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.187+0000 7f6490dc6640 1 -- 172.21.15.22:0/1498076596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f648c101590 msgr2=0x7f648c19b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:40.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.187+0000 7f6490dc6640 1 --2- 172.21.15.22:0/1498076596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f648c101590 0x7f648c19b160 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f647c00c920 tx=0x7f647c00cde0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.188+0000 7f6490dc6640 1 -- 172.21.15.22:0/1498076596 shutdown_connections 2024-08-20T01:31:40.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.188+0000 7f6490dc6640 1 --2- 172.21.15.22:0/1498076596 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f64740b3da0 0x7f64740b6260 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.188+0000 7f6490dc6640 1 --2- 172.21.15.22:0/1498076596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f648c10f140 0x7f648c1a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.188+0000 7f6490dc6640 1 --2- 172.21.15.22:0/1498076596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f648c101eb0 0x7f648c19b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.188+0000 7f6490dc6640 1 --2- 172.21.15.22:0/1498076596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f648c101590 0x7f648c19b160 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.188+0000 7f6490dc6640 1 -- 172.21.15.22:0/1498076596 >> 172.21.15.22:0/1498076596 conn(0x7f648c0fd400 msgr2=0x7f648c0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:40.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.188+0000 7f6490dc6640 1 -- 172.21.15.22:0/1498076596 shutdown_connections 2024-08-20T01:31:40.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:40.188+0000 7f6490dc6640 1 -- 172.21.15.22:0/1498076596 wait complete. 2024-08-20T01:31:41.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:40 smithi134 ceph-mon[22511]: pgmap v362: 97 pgs: 97 active+clean; 667 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 853 B/s wr, 5 op/s 2024-08-20T01:31:41.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:40 smithi077 ceph-mon[22251]: pgmap v362: 97 pgs: 97 active+clean; 667 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 853 B/s wr, 5 op/s 2024-08-20T01:31:41.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:40 smithi022 ceph-mon[18709]: pgmap v362: 97 pgs: 97 active+clean; 667 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 853 B/s wr, 5 op/s 2024-08-20T01:31:41.813 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:31:41.814 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:31:42.200 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:31:42.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.759+0000 7f89357c0640 1 -- 172.21.15.22:0/2043976994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89301042c0 msgr2=0x7f893010c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:42.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.759+0000 7f89357c0640 1 --2- 172.21.15.22:0/2043976994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89301042c0 0x7f893010c7b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8924009900 tx=0x7f892402a3f0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.759+0000 7f89357c0640 1 -- 172.21.15.22:0/2043976994 shutdown_connections 2024-08-20T01:31:42.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.759+0000 7f89357c0640 1 --2- 172.21.15.22:0/2043976994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f893010ce00 0x7f893010f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.759+0000 7f89357c0640 1 --2- 172.21.15.22:0/2043976994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89301042c0 0x7f893010c7b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.759+0000 7f89357c0640 1 --2- 172.21.15.22:0/2043976994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89301039a0 0x7f8930103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.759+0000 7f89357c0640 1 -- 172.21.15.22:0/2043976994 >> 172.21.15.22:0/2043976994 conn(0x7f89300fd400 msgr2=0x7f89300ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:42.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.759+0000 7f89357c0640 1 -- 172.21.15.22:0/2043976994 shutdown_connections 2024-08-20T01:31:42.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.759+0000 7f89357c0640 1 -- 172.21.15.22:0/2043976994 wait complete. 2024-08-20T01:31:42.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.760+0000 7f89357c0640 1 Processor -- start 2024-08-20T01:31:42.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.760+0000 7f89357c0640 1 -- start start 2024-08-20T01:31:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.761+0000 7f89357c0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89301039a0 0x7f8930101650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.761+0000 7f89357c0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89301042c0 0x7f8930101b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.761+0000 7f89357c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f893010ce00 0x7f89301020d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.761+0000 7f89357c0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8930112ac0 con 0x7f893010ce00 2024-08-20T01:31:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.761+0000 7f89357c0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8930112940 con 0x7f89301039a0 2024-08-20T01:31:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.761+0000 7f89357c0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8930112c40 con 0x7f89301042c0 2024-08-20T01:31:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.761+0000 7f892f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f893010ce00 0x7f89301020d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.761+0000 7f892f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f893010ce00 0x7f89301020d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35630/0 (socket says 172.21.15.22:35630) 2024-08-20T01:31:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.761+0000 7f892f7fe640 1 -- 172.21.15.22:0/3863209172 learned_addr learned my addr 172.21.15.22:0/3863209172 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.761+0000 7f892effd640 1 --2- 172.21.15.22:0/3863209172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89301039a0 0x7f8930101650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.761+0000 7f892e7fc640 1 --2- 172.21.15.22:0/3863209172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89301042c0 0x7f8930101b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.761+0000 7f892f7fe640 1 -- 172.21.15.22:0/3863209172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89301042c0 msgr2=0x7f8930101b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.761+0000 7f892f7fe640 1 --2- 172.21.15.22:0/3863209172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89301042c0 0x7f8930101b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.761+0000 7f892f7fe640 1 -- 172.21.15.22:0/3863209172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89301039a0 msgr2=0x7f8930101650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.761+0000 7f892f7fe640 1 --2- 172.21.15.22:0/3863209172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89301039a0 0x7f8930101650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.761+0000 7f892f7fe640 1 -- 172.21.15.22:0/3863209172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89301a7370 con 0x7f893010ce00 2024-08-20T01:31:42.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.762+0000 7f892e7fc640 1 --2- 172.21.15.22:0/3863209172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89301042c0 0x7f8930101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:31:42.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.762+0000 7f892f7fe640 1 --2- 172.21.15.22:0/3863209172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f893010ce00 0x7f89301020d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f892800eaa0 tx=0x7f892800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:42.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.762+0000 7f8917fff640 1 -- 172.21.15.22:0/3863209172 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8928004d20 con 0x7f893010ce00 2024-08-20T01:31:42.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.762+0000 7f8917fff640 1 -- 172.21.15.22:0/3863209172 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8928005020 con 0x7f893010ce00 2024-08-20T01:31:42.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.762+0000 7f8917fff640 1 -- 172.21.15.22:0/3863209172 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89280116b0 con 0x7f893010ce00 2024-08-20T01:31:42.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.762+0000 7f89357c0640 1 -- 172.21.15.22:0/3863209172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89301a7660 con 0x7f893010ce00 2024-08-20T01:31:42.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.762+0000 7f89357c0640 1 -- 172.21.15.22:0/3863209172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8930198e30 con 0x7f893010ce00 2024-08-20T01:31:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.766+0000 7f8917fff640 1 -- 172.21.15.22:0/3863209172 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f89280051d0 con 0x7f893010ce00 2024-08-20T01:31:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.767+0000 7f8937bb9740 1 Processor -- start 2024-08-20T01:31:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.767+0000 7f8937bb9740 1 -- start start 2024-08-20T01:31:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.767+0000 7f8937bb9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c003b0 0x5584d0c00790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.767+0000 7f8937bb9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c00cd0 0x5584d0c0c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.767+0000 7f8937bb9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c0cc60 0x5584d0c0f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.767+0000 7f8937bb9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5584d0b76940 con 0x5584d0c003b0 2024-08-20T01:31:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.767+0000 7f8937bb9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5584d0b65e40 con 0x5584d0c0cc60 2024-08-20T01:31:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.767+0000 7f8937bb9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5584d0b69e80 con 0x5584d0c00cd0 2024-08-20T01:31:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.767+0000 7f892effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c00cd0 0x5584d0c0c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.767+0000 7f892effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c00cd0 0x5584d0c0c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:33428/0 (socket says 172.21.15.22:33428) 2024-08-20T01:31:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.767+0000 7f892effd640 1 -- 172.21.15.22:0/24047001 learned_addr learned my addr 172.21.15.22:0/24047001 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:42.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.768+0000 7f892e7fc640 1 --2- 172.21.15.22:0/24047001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c003b0 0x5584d0c00790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:42.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.768+0000 7f892effd640 1 -- 172.21.15.22:0/24047001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c0cc60 msgr2=0x5584d0c0f050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:31:42.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.768+0000 7f892effd640 1 --2- 172.21.15.22:0/24047001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c0cc60 0x5584d0c0f050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.768+0000 7f892effd640 1 -- 172.21.15.22:0/24047001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c003b0 msgr2=0x5584d0c00790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:42.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.768+0000 7f892effd640 1 --2- 172.21.15.22:0/24047001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c003b0 0x5584d0c00790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.768+0000 7f892effd640 1 -- 172.21.15.22:0/24047001 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584d0b02520 con 0x5584d0c00cd0 2024-08-20T01:31:42.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.768+0000 7f892e7fc640 1 --2- 172.21.15.22:0/24047001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c003b0 0x5584d0c00790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:31:42.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.768+0000 7f8917fff640 1 --2- 172.21.15.22:0/3863209172 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f89180bc460 0x7f89180be920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:42.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.768+0000 7f892effd640 1 --2- 172.21.15.22:0/24047001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c00cd0 0x5584d0c0c720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f892000ad30 tx=0x7f892000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b0db797d6eb3def server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:42.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.768+0000 7f892e7fc640 1 --2- 172.21.15.22:0/3863209172 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f89180bc460 0x7f89180be920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:42.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.768+0000 7f8917fff640 1 -- 172.21.15.22:0/3863209172 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f89280e3e00 con 0x7f893010ce00 2024-08-20T01:31:42.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.768+0000 7f89157fa640 1 -- 172.21.15.22:0/24047001 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8920010840 con 0x5584d0c00cd0 2024-08-20T01:31:42.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.768+0000 7f89157fa640 1 -- 172.21.15.22:0/24047001 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8920014070 con 0x5584d0c00cd0 2024-08-20T01:31:42.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.768+0000 7f89157fa640 1 -- 172.21.15.22:0/24047001 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8920018af0 con 0x5584d0c00cd0 2024-08-20T01:31:42.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.769+0000 7f8937bb9740 1 -- 172.21.15.22:0/24047001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c00cd0 msgr2=0x5584d0c0c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:42.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.769+0000 7f892e7fc640 1 --2- 172.21.15.22:0/3863209172 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f89180bc460 0x7f89180be920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8924009230 tx=0x7f8924005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:42.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.769+0000 7f8937bb9740 1 --2- 172.21.15.22:0/24047001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c00cd0 0x5584d0c0c720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f892000ad30 tx=0x7f892000f790 comp rx=0 tx=0).stop 2024-08-20T01:31:42.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.769+0000 7f8937bb9740 1 -- 172.21.15.22:0/24047001 shutdown_connections 2024-08-20T01:31:42.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.769+0000 7f8937bb9740 1 --2- 172.21.15.22:0/24047001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c0cc60 0x5584d0c0f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.769+0000 7f8937bb9740 1 --2- 172.21.15.22:0/24047001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c00cd0 0x5584d0c0c720 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.769+0000 7f8937bb9740 1 --2- 172.21.15.22:0/24047001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c003b0 0x5584d0c00790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.769+0000 7f8937bb9740 1 -- 172.21.15.22:0/24047001 >> 172.21.15.22:0/24047001 conn(0x5584d0bfe1e0 msgr2=0x5584d0bff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:42.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.770+0000 7f8937bb9740 1 -- 172.21.15.22:0/24047001 shutdown_connections 2024-08-20T01:31:42.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.770+0000 7f8937bb9740 1 -- 172.21.15.22:0/24047001 wait complete. 2024-08-20T01:31:42.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.770+0000 7f8937bb9740 1 -- start start 2024-08-20T01:31:42.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.770+0000 7f8937bb9740 1 Processor -- start 2024-08-20T01:31:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.771+0000 7f8937bb9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c003b0 0x5584d0c09be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.771+0000 7f8937bb9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c00cd0 0x5584d0c0a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.771+0000 7f8937bb9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c0cc60 0x5584d0c0a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.771+0000 7f892effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c003b0 0x5584d0c09be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.771+0000 7f892effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c003b0 0x5584d0c09be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:33430/0 (socket says 172.21.15.22:33430) 2024-08-20T01:31:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.771+0000 7f892f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c0cc60 0x5584d0c0a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.771+0000 7f892effd640 1 -- 172.21.15.22:0/344462127 learned_addr learned my addr 172.21.15.22:0/344462127 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.771+0000 7f8937bb9740 1 -- 172.21.15.22:0/344462127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5584d09c8890 con 0x5584d0c0cc60 2024-08-20T01:31:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.771+0000 7f8937bb9740 1 -- 172.21.15.22:0/344462127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5584d0aec700 con 0x5584d0c00cd0 2024-08-20T01:31:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.771+0000 7f8937bb9740 1 -- 172.21.15.22:0/344462127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5584d0c0f9b0 con 0x5584d0c003b0 2024-08-20T01:31:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.771+0000 7f892e7fc640 1 --2- 172.21.15.22:0/344462127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c00cd0 0x5584d0c0a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.771+0000 7f8937bb9740 10 client.0 _ll_register_callbacks cb 0x5584d0b616f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.771+0000 7f892f7fe640 1 -- 172.21.15.22:0/344462127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c003b0 msgr2=0x5584d0c09be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:42.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.771+0000 7f892f7fe640 1 --2- 172.21.15.22:0/344462127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c003b0 0x5584d0c09be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.771+0000 7f892f7fe640 1 -- 172.21.15.22:0/344462127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c00cd0 msgr2=0x5584d0c0a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:42.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.771+0000 7f892f7fe640 1 --2- 172.21.15.22:0/344462127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c00cd0 0x5584d0c0a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.771+0000 7f892f7fe640 1 -- 172.21.15.22:0/344462127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584d08c5930 con 0x5584d0c0cc60 2024-08-20T01:31:42.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.771+0000 7f892e7fc640 1 --2- 172.21.15.22:0/344462127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c00cd0 0x5584d0c0a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:31:42.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.772+0000 7f8912ff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:31:42.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.772+0000 7f892f7fe640 1 --2- 172.21.15.22:0/344462127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c0cc60 0x5584d0c0a660 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f89280e18c0 tx=0x7f89280aa960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7d57c22026b442 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:42.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.772+0000 7f8912ff5640 1 -- 172.21.15.22:0/344462127 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892801f040 con 0x5584d0c0cc60 2024-08-20T01:31:42.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.772+0000 7f8912ff5640 1 -- 172.21.15.22:0/344462127 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f89280a7300 con 0x5584d0c0cc60 2024-08-20T01:31:42.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.772+0000 7f8937bb9740 1 -- 172.21.15.22:0/344462127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8920014070 con 0x5584d0c0cc60 2024-08-20T01:31:42.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.772+0000 7f8912ff5640 1 -- 172.21.15.22:0/344462127 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f89280af310 con 0x5584d0c0cc60 2024-08-20T01:31:42.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.772+0000 7f8937bb9740 10 client.15498 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:42.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.772+0000 7f8937bb9740 1 -- 172.21.15.22:0/344462127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5584d0c1b4d0 con 0x5584d0c0cc60 2024-08-20T01:31:42.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.773+0000 7f8912ff5640 1 -- 172.21.15.22:0/344462127 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89280b3dc0 con 0x5584d0c0cc60 2024-08-20T01:31:42.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.773+0000 7f8912ff5640 1 -- 172.21.15.22:0/344462127 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f892800f040 con 0x5584d0c0cc60 2024-08-20T01:31:42.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.773+0000 7f8937bb9740 10 client.15498 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:42.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.773+0000 7f8937bb9740 10 client.15498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:31:42.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.773+0000 7f8937bb9740 20 client.15498 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:42.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.773+0000 7f8937bb9740 1 --2- 172.21.15.22:0/344462127 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5584d0c1c930 0x5584d0c1ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:42.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.773+0000 7f8937bb9740 4 client.15498 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:31:42.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.773+0000 7f8937bb9740 1 -- 172.21.15.22:0/344462127 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8920014070 con 0x5584d0c1c930 2024-08-20T01:31:42.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.773+0000 7f892effd640 1 --2- 172.21.15.22:0/344462127 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5584d0c1c930 0x5584d0c1ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:42.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.774+0000 7f892effd640 1 --2- 172.21.15.22:0/344462127 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5584d0c1c930 0x5584d0c1ed90 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89a2b9c98e1e2978 server_cookie=82025baec99b1cd7 in_seq=0 out_seq=0 2024-08-20T01:31:42.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.774+0000 7f8912ff5640 10 client.15498 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:42.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.774+0000 7f8912ff5640 1 -- 172.21.15.22:0/344462127 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f8920014070 con 0x5584d0c1c930 2024-08-20T01:31:42.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.775+0000 7f8912ff5640 10 client.15498 handle_command_reply: tid=0 2024-08-20T01:31:42.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.775+0000 7f8937bb9740 1 client.15498 shutdown 2024-08-20T01:31:42.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.775+0000 7f8937bb9740 1 -- 172.21.15.22:0/344462127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c0cc60 msgr2=0x5584d0c0a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:42.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.775+0000 7f8937bb9740 1 --2- 172.21.15.22:0/344462127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c0cc60 0x5584d0c0a660 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f89280e18c0 tx=0x7f89280aa960 comp rx=0 tx=0).stop 2024-08-20T01:31:42.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.775+0000 7f8937bb9740 1 -- 172.21.15.22:0/344462127 shutdown_connections 2024-08-20T01:31:42.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.775+0000 7f8937bb9740 1 --2- 172.21.15.22:0/344462127 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5584d0c1c930 0x5584d0c1ed90 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.775+0000 7f8937bb9740 1 --2- 172.21.15.22:0/344462127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c0cc60 0x5584d0c0a660 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.775+0000 7f8937bb9740 1 --2- 172.21.15.22:0/344462127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c00cd0 0x5584d0c0a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.775+0000 7f8912ff5640 0 client.15498 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:42.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.775+0000 7f8937bb9740 1 --2- 172.21.15.22:0/344462127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c003b0 0x5584d0c09be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.775+0000 7f8937bb9740 1 -- 172.21.15.22:0/344462127 >> 172.21.15.22:0/344462127 conn(0x5584d0bfe1e0 msgr2=0x5584d0c03d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:42.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.775+0000 7f8937bb9740 1 -- 172.21.15.22:0/344462127 shutdown_connections 2024-08-20T01:31:42.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.775+0000 7f8937bb9740 1 -- 172.21.15.22:0/344462127 wait complete. 2024-08-20T01:31:42.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.775+0000 7f8937bb9740 20 client.15498 trim_cache size 0 max 16384 2024-08-20T01:31:42.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.793+0000 7f8937bb9740 1 Processor -- start 2024-08-20T01:31:42.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.793+0000 7f8937bb9740 1 -- start start 2024-08-20T01:31:42.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.793+0000 7f8937bb9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c003b0 0x5584d0c044b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:42.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.793+0000 7f8937bb9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c00cd0 0x5584d0bff5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:42.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.793+0000 7f8937bb9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c0cc60 0x5584d0c24660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:42.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.793+0000 7f8937bb9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f89301ae850 con 0x5584d0c00cd0 2024-08-20T01:31:42.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.793+0000 7f8937bb9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f89301ac120 con 0x5584d0c0cc60 2024-08-20T01:31:42.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.793+0000 7f8937bb9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f89301aa010 con 0x5584d0c003b0 2024-08-20T01:31:42.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.793+0000 7f892e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c00cd0 0x5584d0bff5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:42.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.793+0000 7f892e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c00cd0 0x5584d0bff5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35656/0 (socket says 172.21.15.22:35656) 2024-08-20T01:31:42.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.793+0000 7f892e7fc640 1 -- 172.21.15.22:0/3603037004 learned_addr learned my addr 172.21.15.22:0/3603037004 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:42.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.793+0000 7f892effd640 1 --2- 172.21.15.22:0/3603037004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c003b0 0x5584d0c044b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.793+0000 7f892f7fe640 1 --2- 172.21.15.22:0/3603037004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c0cc60 0x5584d0c24660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.794+0000 7f892e7fc640 1 -- 172.21.15.22:0/3603037004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c003b0 msgr2=0x5584d0c044b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.794+0000 7f892e7fc640 1 --2- 172.21.15.22:0/3603037004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c003b0 0x5584d0c044b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.794+0000 7f892e7fc640 1 -- 172.21.15.22:0/3603037004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c0cc60 msgr2=0x5584d0c24660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.794+0000 7f892e7fc640 1 --2- 172.21.15.22:0/3603037004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c0cc60 0x5584d0c24660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.794+0000 7f892e7fc640 1 -- 172.21.15.22:0/3603037004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584d0c00b00 con 0x5584d0c00cd0 2024-08-20T01:31:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.794+0000 7f892effd640 1 --2- 172.21.15.22:0/3603037004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c003b0 0x5584d0c044b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:31:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.794+0000 7f892f7fe640 1 --2- 172.21.15.22:0/3603037004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c0cc60 0x5584d0c24660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:31:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.794+0000 7f892e7fc640 1 --2- 172.21.15.22:0/3603037004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c00cd0 0x5584d0bff5d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f893006b650 tx=0x7f8924009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5410e58af6165d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.794+0000 7f8914ff9640 1 -- 172.21.15.22:0/3603037004 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924035050 con 0x5584d0c00cd0 2024-08-20T01:31:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.794+0000 7f8914ff9640 1 -- 172.21.15.22:0/3603037004 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f892404e070 con 0x5584d0c00cd0 2024-08-20T01:31:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.794+0000 7f8914ff9640 1 -- 172.21.15.22:0/3603037004 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89240324b0 con 0x5584d0c00cd0 2024-08-20T01:31:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.795+0000 7f8937bb9740 1 -- 172.21.15.22:0/3603037004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c00cd0 msgr2=0x5584d0bff5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.795+0000 7f8937bb9740 1 --2- 172.21.15.22:0/3603037004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c00cd0 0x5584d0bff5d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f893006b650 tx=0x7f8924009260 comp rx=0 tx=0).stop 2024-08-20T01:31:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.795+0000 7f8937bb9740 1 -- 172.21.15.22:0/3603037004 shutdown_connections 2024-08-20T01:31:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.795+0000 7f8937bb9740 1 --2- 172.21.15.22:0/3603037004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c0cc60 0x5584d0c24660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.795+0000 7f8937bb9740 1 --2- 172.21.15.22:0/3603037004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c00cd0 0x5584d0bff5d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.795+0000 7f8937bb9740 1 --2- 172.21.15.22:0/3603037004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c003b0 0x5584d0c044b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.795+0000 7f8937bb9740 1 -- 172.21.15.22:0/3603037004 >> 172.21.15.22:0/3603037004 conn(0x5584d0bfe1e0 msgr2=0x5584d0bfeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.795+0000 7f8937bb9740 1 -- 172.21.15.22:0/3603037004 shutdown_connections 2024-08-20T01:31:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.795+0000 7f8937bb9740 1 -- 172.21.15.22:0/3603037004 wait complete. 2024-08-20T01:31:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.796+0000 7f8937bb9740 1 -- start start 2024-08-20T01:31:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.796+0000 7f8937bb9740 1 Processor -- start 2024-08-20T01:31:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.796+0000 7f8937bb9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c003b0 0x5584d0c15360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.796+0000 7f8937bb9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c00cd0 0x5584d0c10830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.796+0000 7f892e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c00cd0 0x5584d0c10830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.797+0000 7f892e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c00cd0 0x5584d0c10830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35662/0 (socket says 172.21.15.22:35662) 2024-08-20T01:31:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.797+0000 7f892e7fc640 1 -- 172.21.15.22:0/1982965671 learned_addr learned my addr 172.21.15.22:0/1982965671 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.797+0000 7f8937bb9740 1 --2- 172.21.15.22:0/1982965671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c0cc60 0x5584d0c10df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.797+0000 7f8937bb9740 1 -- 172.21.15.22:0/1982965671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f89301aa660 con 0x5584d0c00cd0 2024-08-20T01:31:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.797+0000 7f8937bb9740 1 -- 172.21.15.22:0/1982965671 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f89301aba50 con 0x5584d0c0cc60 2024-08-20T01:31:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.797+0000 7f8937bb9740 1 -- 172.21.15.22:0/1982965671 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f89301aacb0 con 0x5584d0c003b0 2024-08-20T01:31:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.797+0000 7f8937bb9740 10 client.0 _ll_register_callbacks cb 0x7f89280a6bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.797+0000 7f892effd640 1 --2- 172.21.15.22:0/1982965671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c003b0 0x5584d0c15360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.797+0000 7f892f7fe640 1 --2- 172.21.15.22:0/1982965671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c0cc60 0x5584d0c10df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.797+0000 7f892e7fc640 1 -- 172.21.15.22:0/1982965671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c003b0 msgr2=0x5584d0c15360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.797+0000 7f892e7fc640 1 --2- 172.21.15.22:0/1982965671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c003b0 0x5584d0c15360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.797+0000 7f892e7fc640 1 -- 172.21.15.22:0/1982965671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c0cc60 msgr2=0x5584d0c10df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.797+0000 7f892e7fc640 1 --2- 172.21.15.22:0/1982965671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c0cc60 0x5584d0c10df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.797+0000 7f892e7fc640 1 -- 172.21.15.22:0/1982965671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584d0c11620 con 0x5584d0c00cd0 2024-08-20T01:31:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.797+0000 7f892effd640 1 --2- 172.21.15.22:0/1982965671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c003b0 0x5584d0c15360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:31:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.797+0000 7f892e7fc640 1 --2- 172.21.15.22:0/1982965671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c00cd0 0x5584d0c10830 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8924004010 tx=0x7f8924000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f99e4b3629d386 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:42.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.797+0000 7f8912ff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:31:42.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.798+0000 7f8912ff5640 1 -- 172.21.15.22:0/1982965671 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924056070 con 0x5584d0c00cd0 2024-08-20T01:31:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.798+0000 7f8912ff5640 1 -- 172.21.15.22:0/1982965671 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f8924004980 con 0x5584d0c00cd0 2024-08-20T01:31:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.798+0000 7f8937bb9740 1 -- 172.21.15.22:0/1982965671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f892404e070 con 0x5584d0c00cd0 2024-08-20T01:31:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.798+0000 7f8912ff5640 1 -- 172.21.15.22:0/1982965671 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8924060050 con 0x5584d0c00cd0 2024-08-20T01:31:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.798+0000 7f8937bb9740 10 client.15504 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.798+0000 7f8937bb9740 1 -- 172.21.15.22:0/1982965671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5584d0c876f0 con 0x5584d0c00cd0 2024-08-20T01:31:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.799+0000 7f8912ff5640 1 -- 172.21.15.22:0/1982965671 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f892404e070 con 0x5584d0c00cd0 2024-08-20T01:31:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.799+0000 7f8912ff5640 1 -- 172.21.15.22:0/1982965671 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8924032b90 con 0x5584d0c00cd0 2024-08-20T01:31:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.799+0000 7f8937bb9740 10 client.15504 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.799+0000 7f8937bb9740 10 client.15504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:31:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.799+0000 7f8937bb9740 20 client.15504 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.799+0000 7f8937bb9740 1 --2- 172.21.15.22:0/1982965671 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5584d0c87e90 0x5584d0c8a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.799+0000 7f8937bb9740 4 client.15504 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:31:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.799+0000 7f8937bb9740 1 -- 172.21.15.22:0/1982965671 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5584d0b78890 con 0x5584d0c87e90 2024-08-20T01:31:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.800+0000 7f892effd640 1 --2- 172.21.15.22:0/1982965671 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5584d0c87e90 0x5584d0c8a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.800+0000 7f8912ff5640 10 client.15504 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.800+0000 7f892effd640 1 --2- 172.21.15.22:0/1982965671 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5584d0c87e90 0x5584d0c8a2b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e4ab1ac3a83648f server_cookie=3815a59549fe1a8b in_seq=0 out_seq=0 2024-08-20T01:31:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.801+0000 7f8912ff5640 1 -- 172.21.15.22:0/1982965671 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5584d0b78890 con 0x5584d0c87e90 2024-08-20T01:31:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.801+0000 7f8912ff5640 10 client.15504 handle_command_reply: tid=0 2024-08-20T01:31:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.801+0000 7f8937bb9740 1 client.15504 shutdown 2024-08-20T01:31:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.801+0000 7f8937bb9740 1 -- 172.21.15.22:0/1982965671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c00cd0 msgr2=0x5584d0c10830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.801+0000 7f8937bb9740 1 --2- 172.21.15.22:0/1982965671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c00cd0 0x5584d0c10830 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8924004010 tx=0x7f8924000bc0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.801+0000 7f8937bb9740 1 -- 172.21.15.22:0/1982965671 shutdown_connections 2024-08-20T01:31:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.801+0000 7f8937bb9740 1 --2- 172.21.15.22:0/1982965671 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5584d0c87e90 0x5584d0c8a2b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.801+0000 7f8937bb9740 1 --2- 172.21.15.22:0/1982965671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584d0c0cc60 0x5584d0c10df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.801+0000 7f8912ff5640 0 client.15504 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.802+0000 7f8937bb9740 1 --2- 172.21.15.22:0/1982965671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584d0c00cd0 0x5584d0c10830 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.802+0000 7f8937bb9740 1 --2- 172.21.15.22:0/1982965671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5584d0c003b0 0x5584d0c15360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.802+0000 7f8937bb9740 1 -- 172.21.15.22:0/1982965671 >> 172.21.15.22:0/1982965671 conn(0x5584d0bfe1e0 msgr2=0x5584d0c0a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.802+0000 7f8937bb9740 1 -- 172.21.15.22:0/1982965671 shutdown_connections 2024-08-20T01:31:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.802+0000 7f8937bb9740 1 -- 172.21.15.22:0/1982965671 wait complete. 2024-08-20T01:31:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.802+0000 7f8937bb9740 20 client.15504 trim_cache size 0 max 16384 2024-08-20T01:31:42.806 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:31:42.806 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-08-20T01:31:42.806 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "00e88037-8aeb-47be-81a3-db299723bdd0", 2024-08-20T01:31:42.806 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-08-20T01:31:42.806 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:31:42.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.803+0000 7f89357c0640 1 -- 172.21.15.22:0/3863209172 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f89180bc460 msgr2=0x7f89180be920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:42.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.803+0000 7f89357c0640 1 --2- 172.21.15.22:0/3863209172 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f89180bc460 0x7f89180be920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8924009230 tx=0x7f8924005fd0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.803+0000 7f89357c0640 1 -- 172.21.15.22:0/3863209172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f893010ce00 msgr2=0x7f89301020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.803+0000 7f89357c0640 1 --2- 172.21.15.22:0/3863209172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f893010ce00 0x7f89301020d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f892800eaa0 tx=0x7f892800eea0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.803+0000 7f89357c0640 1 -- 172.21.15.22:0/3863209172 shutdown_connections 2024-08-20T01:31:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.803+0000 7f89357c0640 1 --2- 172.21.15.22:0/3863209172 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f89180bc460 0x7f89180be920 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.803+0000 7f89357c0640 1 --2- 172.21.15.22:0/3863209172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f893010ce00 0x7f89301020d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.803+0000 7f89357c0640 1 --2- 172.21.15.22:0/3863209172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89301042c0 0x7f8930101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.803+0000 7f89357c0640 1 --2- 172.21.15.22:0/3863209172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89301039a0 0x7f8930101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.803+0000 7f89357c0640 1 -- 172.21.15.22:0/3863209172 >> 172.21.15.22:0/3863209172 conn(0x7f89300fd400 msgr2=0x7f89300fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.803+0000 7f89357c0640 1 -- 172.21.15.22:0/3863209172 shutdown_connections 2024-08-20T01:31:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:42.803+0000 7f89357c0640 1 -- 172.21.15.22:0/3863209172 wait complete. 2024-08-20T01:31:42.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:42 smithi022 ceph-mon[18709]: pgmap v363: 97 pgs: 97 active+clean; 668 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-08-20T01:31:43.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:42 smithi134 ceph-mon[22511]: pgmap v363: 97 pgs: 97 active+clean; 668 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-08-20T01:31:43.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:42 smithi077 ceph-mon[22251]: pgmap v363: 97 pgs: 97 active+clean; 668 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-08-20T01:31:43.594 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:31:43.928 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:31:44.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.443+0000 7f8f16512640 1 -- 172.21.15.22:0/2692365327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f10101eb0 msgr2=0x7f8f1010ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:44.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.443+0000 7f8f16512640 1 --2- 172.21.15.22:0/2692365327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f10101eb0 0x7f8f1010ec00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009900 tx=0x7f8f0402a480 comp rx=0 tx=0).stop 2024-08-20T01:31:44.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.443+0000 7f8f16512640 1 -- 172.21.15.22:0/2692365327 shutdown_connections 2024-08-20T01:31:44.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.443+0000 7f8f16512640 1 --2- 172.21.15.22:0/2692365327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f1010f140 0x7f8f10111530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.443+0000 7f8f16512640 1 --2- 172.21.15.22:0/2692365327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f10101eb0 0x7f8f1010ec00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.443+0000 7f8f16512640 1 --2- 172.21.15.22:0/2692365327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f10101590 0x7f8f10101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.443+0000 7f8f16512640 1 -- 172.21.15.22:0/2692365327 >> 172.21.15.22:0/2692365327 conn(0x7f8f100fd400 msgr2=0x7f8f100ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:44.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.443+0000 7f8f16512640 1 -- 172.21.15.22:0/2692365327 shutdown_connections 2024-08-20T01:31:44.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.443+0000 7f8f16512640 1 -- 172.21.15.22:0/2692365327 wait complete. 2024-08-20T01:31:44.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.444+0000 7f8f16512640 1 Processor -- start 2024-08-20T01:31:44.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.444+0000 7f8f16512640 1 -- start start 2024-08-20T01:31:44.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.444+0000 7f8f16512640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f10101590 0x7f8f1019b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:44.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.444+0000 7f8f16512640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f10101eb0 0x7f8f1019b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:44.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.444+0000 7f8f16512640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f1010f140 0x7f8f101a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:44.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.444+0000 7f8f16512640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8f10114c80 con 0x7f8f10101590 2024-08-20T01:31:44.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.444+0000 7f8f16512640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8f10114b00 con 0x7f8f10101eb0 2024-08-20T01:31:44.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.444+0000 7f8f16512640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8f10114e00 con 0x7f8f1010f140 2024-08-20T01:31:44.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.444+0000 7f8f0ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f10101590 0x7f8f1019b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:44.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.444+0000 7f8f0ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f10101590 0x7f8f1019b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35678/0 (socket says 172.21.15.22:35678) 2024-08-20T01:31:44.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.444+0000 7f8f0ffff640 1 -- 172.21.15.22:0/4104614989 learned_addr learned my addr 172.21.15.22:0/4104614989 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:44.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.444+0000 7f8f14aaf640 1 --2- 172.21.15.22:0/4104614989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f1010f140 0x7f8f101a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:44.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.444+0000 7f8f0f7fe640 1 --2- 172.21.15.22:0/4104614989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f10101eb0 0x7f8f1019b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:44.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.445+0000 7f8f0ffff640 1 -- 172.21.15.22:0/4104614989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f1010f140 msgr2=0x7f8f101a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:44.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.445+0000 7f8f0ffff640 1 --2- 172.21.15.22:0/4104614989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f1010f140 0x7f8f101a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.445+0000 7f8f0ffff640 1 -- 172.21.15.22:0/4104614989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f10101eb0 msgr2=0x7f8f1019b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:44.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.445+0000 7f8f0ffff640 1 --2- 172.21.15.22:0/4104614989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f10101eb0 0x7f8f1019b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.445+0000 7f8f0ffff640 1 -- 172.21.15.22:0/4104614989 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f101a1340 con 0x7f8f10101590 2024-08-20T01:31:44.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.445+0000 7f8f0ffff640 1 --2- 172.21.15.22:0/4104614989 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f10101590 0x7f8f1019b290 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000e9f0 tx=0x7f8f0000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:44.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.445+0000 7f8f0d7fa640 1 -- 172.21.15.22:0/4104614989 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0000cd80 con 0x7f8f10101590 2024-08-20T01:31:44.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.445+0000 7f8f16512640 1 -- 172.21.15.22:0/4104614989 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f101a1630 con 0x7f8f10101590 2024-08-20T01:31:44.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.445+0000 7f8f0d7fa640 1 -- 172.21.15.22:0/4104614989 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f000108e0 con 0x7f8f10101590 2024-08-20T01:31:44.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.445+0000 7f8f16512640 1 -- 172.21.15.22:0/4104614989 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f101a7ec0 con 0x7f8f10101590 2024-08-20T01:31:44.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.445+0000 7f8f0d7fa640 1 -- 172.21.15.22:0/4104614989 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f00018980 con 0x7f8f10101590 2024-08-20T01:31:44.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.449+0000 7f8f1890b740 1 Processor -- start 2024-08-20T01:31:44.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.449+0000 7f8f1890b740 1 -- start start 2024-08-20T01:31:44.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.449+0000 7f8f0d7fa640 1 -- 172.21.15.22:0/4104614989 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8f00010430 con 0x7f8f10101590 2024-08-20T01:31:44.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.449+0000 7f8f1890b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c418830 0x561e3c418c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:44.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.450+0000 7f8f1890b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c419150 0x561e3c424ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:44.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.450+0000 7f8f1890b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561e3c4250e0 0x561e3c4274d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:44.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.450+0000 7f8f1890b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561e3c38f8e0 con 0x561e3c418830 2024-08-20T01:31:44.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.450+0000 7f8f1890b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561e3c37ede0 con 0x561e3c419150 2024-08-20T01:31:44.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.450+0000 7f8f1890b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561e3c382e20 con 0x561e3c4250e0 2024-08-20T01:31:44.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.450+0000 7f8f14aaf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c418830 0x561e3c418c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:44.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.450+0000 7f8f14aaf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c418830 0x561e3c418c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35686/0 (socket says 172.21.15.22:35686) 2024-08-20T01:31:44.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.450+0000 7f8f14aaf640 1 -- 172.21.15.22:0/3518431225 learned_addr learned my addr 172.21.15.22:0/3518431225 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:44.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.450+0000 7f8f0f7fe640 1 --2- 172.21.15.22:0/3518431225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561e3c4250e0 0x561e3c4274d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:44.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.450+0000 7f8f0ffff640 1 --2- 172.21.15.22:0/3518431225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c419150 0x561e3c424ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:44.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.450+0000 7f8f14aaf640 1 -- 172.21.15.22:0/3518431225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561e3c4250e0 msgr2=0x561e3c4274d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:44.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.450+0000 7f8f14aaf640 1 --2- 172.21.15.22:0/3518431225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561e3c4250e0 0x561e3c4274d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.450+0000 7f8f14aaf640 1 -- 172.21.15.22:0/3518431225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c419150 msgr2=0x561e3c424ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:44.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.450+0000 7f8f14aaf640 1 --2- 172.21.15.22:0/3518431225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c419150 0x561e3c424ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.450+0000 7f8f14aaf640 1 -- 172.21.15.22:0/3518431225 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e3c0de650 con 0x561e3c418830 2024-08-20T01:31:44.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.451+0000 7f8f0ffff640 1 --2- 172.21.15.22:0/3518431225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c419150 0x561e3c424ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:31:44.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.451+0000 7f8f0d7fa640 1 --2- 172.21.15.22:0/4104614989 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8ef80b3bd0 0x7f8ef80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:44.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.451+0000 7f8f14aaf640 1 --2- 172.21.15.22:0/3518431225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c418830 0x561e3c418c10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009f60 tx=0x7f8f08009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971fbbd0ec4c6f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:44.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.451+0000 7f8f0d7fa640 1 -- 172.21.15.22:0/4104614989 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f8f000e3d80 con 0x7f8f10101590 2024-08-20T01:31:44.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.451+0000 7f8f0ffff640 1 --2- 172.21.15.22:0/4104614989 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8ef80b3bd0 0x7f8ef80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:44.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.451+0000 7f8ef67fc640 1 -- 172.21.15.22:0/3518431225 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08004d20 con 0x561e3c418830 2024-08-20T01:31:44.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.451+0000 7f8ef67fc640 1 -- 172.21.15.22:0/3518431225 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f08004030 con 0x561e3c418830 2024-08-20T01:31:44.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.452+0000 7f8ef67fc640 1 -- 172.21.15.22:0/3518431225 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08005280 con 0x561e3c418830 2024-08-20T01:31:44.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.452+0000 7f8f1890b740 1 -- 172.21.15.22:0/3518431225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c418830 msgr2=0x561e3c418c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:44.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.452+0000 7f8f0ffff640 1 --2- 172.21.15.22:0/4104614989 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8ef80b3bd0 0x7f8ef80b6090 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8f000e1bb0 tx=0x7f8f00018560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:44.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.452+0000 7f8f1890b740 1 --2- 172.21.15.22:0/3518431225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c418830 0x561e3c418c10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009f60 tx=0x7f8f08009f90 comp rx=0 tx=0).stop 2024-08-20T01:31:44.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.452+0000 7f8f1890b740 1 -- 172.21.15.22:0/3518431225 shutdown_connections 2024-08-20T01:31:44.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.452+0000 7f8f1890b740 1 --2- 172.21.15.22:0/3518431225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561e3c4250e0 0x561e3c4274d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.452+0000 7f8f1890b740 1 --2- 172.21.15.22:0/3518431225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c419150 0x561e3c424ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.452+0000 7f8f1890b740 1 --2- 172.21.15.22:0/3518431225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c418830 0x561e3c418c10 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.452+0000 7f8f1890b740 1 -- 172.21.15.22:0/3518431225 >> 172.21.15.22:0/3518431225 conn(0x561e3c416660 msgr2=0x561e3c417800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:44.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.453+0000 7f8f1890b740 1 -- 172.21.15.22:0/3518431225 shutdown_connections 2024-08-20T01:31:44.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.453+0000 7f8f1890b740 1 -- 172.21.15.22:0/3518431225 wait complete. 2024-08-20T01:31:44.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.453+0000 7f8f1890b740 1 -- start start 2024-08-20T01:31:44.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.453+0000 7f8f1890b740 1 Processor -- start 2024-08-20T01:31:44.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.454+0000 7f8f1890b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561e3c418830 0x561e3c424b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:44.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.454+0000 7f8f1890b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c419150 0x561e3c421fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:44.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.454+0000 7f8f1890b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c4250e0 0x561e3c422730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:44.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.454+0000 7f8f1890b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561e3c1e1700 con 0x561e3c4250e0 2024-08-20T01:31:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.454+0000 7f8f1890b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561e3c3057c0 con 0x561e3c419150 2024-08-20T01:31:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.454+0000 7f8f1890b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561e3c427de0 con 0x561e3c418830 2024-08-20T01:31:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.454+0000 7f8f14aaf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c4250e0 0x561e3c422730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.454+0000 7f8f14aaf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c4250e0 0x561e3c422730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35690/0 (socket says 172.21.15.22:35690) 2024-08-20T01:31:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.454+0000 7f8f14aaf640 1 -- 172.21.15.22:0/210352878 learned_addr learned my addr 172.21.15.22:0/210352878 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.454+0000 7f8f14aaf640 1 --2- 172.21.15.22:0/210352878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561e3c418830 0x561e3c424b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.454+0000 7f8f0f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c419150 0x561e3c421fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.455+0000 7f8f14aaf640 1 -- 172.21.15.22:0/210352878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561e3c418830 msgr2=0x561e3c424b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.455+0000 7f8f14aaf640 1 --2- 172.21.15.22:0/210352878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561e3c418830 0x561e3c424b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.455+0000 7f8f14aaf640 1 -- 172.21.15.22:0/210352878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c419150 msgr2=0x561e3c421fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.455+0000 7f8f14aaf640 1 --2- 172.21.15.22:0/210352878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c419150 0x561e3c421fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.455+0000 7f8f14aaf640 1 -- 172.21.15.22:0/210352878 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e3c4311c0 con 0x561e3c4250e0 2024-08-20T01:31:44.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.455+0000 7f8f1890b740 10 client.0 _ll_register_callbacks cb 0x561e3c3786b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:44.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.455+0000 7f8f1890b740 1 -- 172.21.15.22:0/210352878 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561e3c32e100 con 0x561e3c4250e0 2024-08-20T01:31:44.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.455+0000 7f8f14aaf640 1 --2- 172.21.15.22:0/210352878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c4250e0 0x561e3c422730 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009d40 tx=0x7f8f08009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57b41bde84b05b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:44.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.455+0000 7f8eef7fe640 10 client.15516 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:31:44.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.455+0000 7f8eef7fe640 1 -- 172.21.15.22:0/210352878 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0802d060 con 0x561e3c4250e0 2024-08-20T01:31:44.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.455+0000 7f8eef7fe640 1 -- 172.21.15.22:0/210352878 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f8f08004fc0 con 0x561e3c4250e0 2024-08-20T01:31:44.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.455+0000 7f8eef7fe640 1 -- 172.21.15.22:0/210352878 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8f0801e040 con 0x561e3c4250e0 2024-08-20T01:31:44.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.455+0000 7f8f1890b740 10 client.15516 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:44.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.455+0000 7f8f1890b740 1 -- 172.21.15.22:0/210352878 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({fsmap=25}) -- 0x561e3c433930 con 0x561e3c4250e0 2024-08-20T01:31:44.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.456+0000 7f8eef7fe640 1 -- 172.21.15.22:0/210352878 <== mon.0 v2:172.21.15.22:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8f08024070 con 0x561e3c4250e0 2024-08-20T01:31:44.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.456+0000 7f8f1890b740 10 client.15516 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:44.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.456+0000 7f8f1890b740 10 client.15516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:31:44.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.456+0000 7f8f1890b740 20 client.15516 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:44.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.456+0000 7f8f1890b740 1 --2- 172.21.15.22:0/210352878 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561e3c434c80 0x561e3c437070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:44.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.456+0000 7f8f1890b740 4 client.15516 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:31:44.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.456+0000 7f8f1890b740 1 -- 172.21.15.22:0/210352878 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e3c391830 con 0x561e3c434c80 2024-08-20T01:31:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.457+0000 7f8f0f7fe640 1 --2- 172.21.15.22:0/210352878 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561e3c434c80 0x561e3c437070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.457+0000 7f8f0f7fe640 1 --2- 172.21.15.22:0/210352878 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561e3c434c80 0x561e3c437070 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bd9de8109d7b91a server_cookie=4e90b17040a0f18f in_seq=0 out_seq=0 2024-08-20T01:31:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.457+0000 7f8eef7fe640 10 client.15516 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.458+0000 7f8eef7fe640 1 -- 172.21.15.22:0/210352878 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561e3c391830 con 0x561e3c434c80 2024-08-20T01:31:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.458+0000 7f8eef7fe640 10 client.15516 handle_command_reply: tid=0 2024-08-20T01:31:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.458+0000 7f8f1890b740 1 client.15516 shutdown 2024-08-20T01:31:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.458+0000 7f8f1890b740 1 -- 172.21.15.22:0/210352878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c4250e0 msgr2=0x561e3c422730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.458+0000 7f8f1890b740 1 --2- 172.21.15.22:0/210352878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c4250e0 0x561e3c422730 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009d40 tx=0x7f8f08009500 comp rx=0 tx=0).stop 2024-08-20T01:31:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.458+0000 7f8f1890b740 1 -- 172.21.15.22:0/210352878 shutdown_connections 2024-08-20T01:31:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.458+0000 7f8f1890b740 1 --2- 172.21.15.22:0/210352878 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561e3c434c80 0x561e3c437070 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.458+0000 7f8f1890b740 1 --2- 172.21.15.22:0/210352878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c4250e0 0x561e3c422730 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.458+0000 7f8eef7fe640 0 client.15516 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.459+0000 7f8f1890b740 1 --2- 172.21.15.22:0/210352878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c419150 0x561e3c421fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.459+0000 7f8f1890b740 1 --2- 172.21.15.22:0/210352878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561e3c418830 0x561e3c424b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.459+0000 7f8f1890b740 1 -- 172.21.15.22:0/210352878 >> 172.21.15.22:0/210352878 conn(0x561e3c416660 msgr2=0x561e3c41c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:44.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.459+0000 7f8f1890b740 1 -- 172.21.15.22:0/210352878 shutdown_connections 2024-08-20T01:31:44.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.459+0000 7f8f1890b740 1 -- 172.21.15.22:0/210352878 wait complete. 2024-08-20T01:31:44.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.459+0000 7f8f1890b740 20 client.15516 trim_cache size 0 max 16384 2024-08-20T01:31:44.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.477+0000 7f8f1890b740 1 Processor -- start 2024-08-20T01:31:44.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.477+0000 7f8f1890b740 1 -- start start 2024-08-20T01:31:44.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.477+0000 7f8f1890b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561e3c418830 0x561e3c411150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:44.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.477+0000 7f8f1890b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c419150 0x561e3c421830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:44.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.477+0000 7f8f1890b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c4250e0 0x561e3c4306b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:44.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.477+0000 7f8f1890b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc010e60 con 0x561e3c419150 2024-08-20T01:31:44.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.477+0000 7f8f1890b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc00e730 con 0x561e3c4250e0 2024-08-20T01:31:44.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.477+0000 7f8f1890b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc00c580 con 0x561e3c418830 2024-08-20T01:31:44.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.477+0000 7f8f0f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c419150 0x561e3c421830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:44.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.478+0000 7f8f0f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c419150 0x561e3c421830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35702/0 (socket says 172.21.15.22:35702) 2024-08-20T01:31:44.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.478+0000 7f8f0f7fe640 1 -- 172.21.15.22:0/3531820063 learned_addr learned my addr 172.21.15.22:0/3531820063 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:44.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.478+0000 7f8f14aaf640 1 --2- 172.21.15.22:0/3531820063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561e3c418830 0x561e3c411150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:44.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.478+0000 7f8f14aaf640 1 --2- 172.21.15.22:0/3531820063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c4250e0 0x561e3c4306b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:44.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.478+0000 7f8f0f7fe640 1 -- 172.21.15.22:0/3531820063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561e3c418830 msgr2=0x561e3c411150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:44.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.478+0000 7f8f0f7fe640 1 --2- 172.21.15.22:0/3531820063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561e3c418830 0x561e3c411150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.478+0000 7f8f0f7fe640 1 -- 172.21.15.22:0/3531820063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c4250e0 msgr2=0x561e3c4306b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:44.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.478+0000 7f8f0f7fe640 1 --2- 172.21.15.22:0/3531820063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c4250e0 0x561e3c4306b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.478+0000 7f8f0f7fe640 1 -- 172.21.15.22:0/3531820063 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e3c417c50 con 0x561e3c419150 2024-08-20T01:31:44.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.478+0000 7f8f14aaf640 1 --2- 172.21.15.22:0/3531820063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c4250e0 0x561e3c4306b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:31:44.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.478+0000 7f8f0f7fe640 1 --2- 172.21.15.22:0/3531820063 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c419150 0x561e3c421830 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009900 tx=0x7f8f04009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16871d6d271de2ea server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:44.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.478+0000 7f8ef5ffb640 1 -- 172.21.15.22:0/3531820063 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f04049070 con 0x561e3c419150 2024-08-20T01:31:44.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.479+0000 7f8ef5ffb640 1 -- 172.21.15.22:0/3531820063 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f040054f0 con 0x561e3c419150 2024-08-20T01:31:44.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.479+0000 7f8ef5ffb640 1 -- 172.21.15.22:0/3531820063 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f04035040 con 0x561e3c419150 2024-08-20T01:31:44.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.479+0000 7f8f1890b740 1 -- 172.21.15.22:0/3531820063 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c419150 msgr2=0x561e3c421830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:44.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.479+0000 7f8f1890b740 1 --2- 172.21.15.22:0/3531820063 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c419150 0x561e3c421830 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009900 tx=0x7f8f04009580 comp rx=0 tx=0).stop 2024-08-20T01:31:44.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.480+0000 7f8f1890b740 1 -- 172.21.15.22:0/3531820063 shutdown_connections 2024-08-20T01:31:44.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.480+0000 7f8f1890b740 1 --2- 172.21.15.22:0/3531820063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c4250e0 0x561e3c4306b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.480+0000 7f8f1890b740 1 --2- 172.21.15.22:0/3531820063 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c419150 0x561e3c421830 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.480+0000 7f8f1890b740 1 --2- 172.21.15.22:0/3531820063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561e3c418830 0x561e3c411150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.480+0000 7f8f1890b740 1 -- 172.21.15.22:0/3531820063 >> 172.21.15.22:0/3531820063 conn(0x561e3c416660 msgr2=0x561e3c42ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:44.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.480+0000 7f8f1890b740 1 -- 172.21.15.22:0/3531820063 shutdown_connections 2024-08-20T01:31:44.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.480+0000 7f8f1890b740 1 -- 172.21.15.22:0/3531820063 wait complete. 2024-08-20T01:31:44.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.480+0000 7f8f1890b740 1 -- start start 2024-08-20T01:31:44.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.480+0000 7f8f1890b740 1 Processor -- start 2024-08-20T01:31:44.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.481+0000 7f8f1890b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c418830 0x561e3c42d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:44.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.481+0000 7f8f1890b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c419150 0x561e3c42d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:44.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.481+0000 7f8f1890b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561e3c4250e0 0x561e3c4280e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:44.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.481+0000 7f8f1890b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc00cbf0 con 0x561e3c418830 2024-08-20T01:31:44.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.481+0000 7f8f1890b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc00e060 con 0x561e3c419150 2024-08-20T01:31:44.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.481+0000 7f8f1890b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc00d2c0 con 0x561e3c4250e0 2024-08-20T01:31:44.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.481+0000 7f8f1890b740 10 client.0 _ll_register_callbacks cb 0x7f8f08009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:44.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.481+0000 7f8f14aaf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c418830 0x561e3c42d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:44.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.481+0000 7f8f14aaf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c418830 0x561e3c42d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35716/0 (socket says 172.21.15.22:35716) 2024-08-20T01:31:44.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.481+0000 7f8f14aaf640 1 -- 172.21.15.22:0/3373124905 learned_addr learned my addr 172.21.15.22:0/3373124905 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:44.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.481+0000 7f8f0f7fe640 1 --2- 172.21.15.22:0/3373124905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c419150 0x561e3c42d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:44.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.481+0000 7f8f14aaf640 1 -- 172.21.15.22:0/3373124905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561e3c4250e0 msgr2=0x561e3c4280e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:44.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.481+0000 7f8f14aaf640 1 --2- 172.21.15.22:0/3373124905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561e3c4250e0 0x561e3c4280e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.481+0000 7f8f14aaf640 1 -- 172.21.15.22:0/3373124905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c419150 msgr2=0x561e3c42d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:44.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.481+0000 7f8f14aaf640 1 --2- 172.21.15.22:0/3373124905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c419150 0x561e3c42d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.481+0000 7f8f14aaf640 1 -- 172.21.15.22:0/3373124905 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e3c4373e0 con 0x561e3c418830 2024-08-20T01:31:44.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.481+0000 7f8f0f7fe640 1 --2- 172.21.15.22:0/3373124905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c419150 0x561e3c42d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:31:44.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.482+0000 7f8f14aaf640 1 --2- 172.21.15.22:0/3373124905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c418830 0x561e3c42d130 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009370 tx=0x7f8f08009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ee433f0b4c6f4d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:44.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.482+0000 7f8eef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:31:44.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.482+0000 7f8eef7fe640 1 -- 172.21.15.22:0/3373124905 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08042060 con 0x561e3c418830 2024-08-20T01:31:44.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.482+0000 7f8eef7fe640 1 -- 172.21.15.22:0/3373124905 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f8f08004dc0 con 0x561e3c418830 2024-08-20T01:31:44.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.482+0000 7f8f1890b740 1 -- 172.21.15.22:0/3373124905 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f040054f0 con 0x561e3c418830 2024-08-20T01:31:44.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.482+0000 7f8eef7fe640 1 -- 172.21.15.22:0/3373124905 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8f08038040 con 0x561e3c418830 2024-08-20T01:31:44.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.482+0000 7f8f1890b740 10 client.15522 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:44.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.482+0000 7f8f1890b740 1 -- 172.21.15.22:0/3373124905 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561e3c49fde0 con 0x561e3c418830 2024-08-20T01:31:44.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.482+0000 7f8eef7fe640 1 -- 172.21.15.22:0/3373124905 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f040054f0 con 0x561e3c418830 2024-08-20T01:31:44.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.483+0000 7f8eef7fe640 1 -- 172.21.15.22:0/3373124905 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8f08018070 con 0x561e3c418830 2024-08-20T01:31:44.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.483+0000 7f8f1890b740 10 client.15522 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:44.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.483+0000 7f8f1890b740 10 client.15522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:31:44.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.483+0000 7f8f1890b740 20 client.15522 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:44.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.483+0000 7f8f1890b740 1 --2- 172.21.15.22:0/3373124905 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561e3c434c80 0x561e3c4a2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:44.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.483+0000 7f8f1890b740 4 client.15522 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:31:44.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.483+0000 7f8f1890b740 1 -- 172.21.15.22:0/3373124905 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561e3c411830 con 0x561e3c434c80 2024-08-20T01:31:44.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.483+0000 7f8f0f7fe640 1 --2- 172.21.15.22:0/3373124905 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561e3c434c80 0x561e3c4a2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:44.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.484+0000 7f8f0f7fe640 1 --2- 172.21.15.22:0/3373124905 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561e3c434c80 0x561e3c4a2500 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6216d2fa08c9c6c server_cookie=bcfffc29a00b3133 in_seq=0 out_seq=0 2024-08-20T01:31:44.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.484+0000 7f8eef7fe640 10 client.15522 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:44.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.484+0000 7f8eef7fe640 1 -- 172.21.15.22:0/3373124905 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x561e3c411830 con 0x561e3c434c80 2024-08-20T01:31:44.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.484+0000 7f8eef7fe640 10 client.15522 handle_command_reply: tid=0 2024-08-20T01:31:44.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.484+0000 7f8f1890b740 1 client.15522 shutdown 2024-08-20T01:31:44.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.484+0000 7f8f1890b740 1 -- 172.21.15.22:0/3373124905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c418830 msgr2=0x561e3c42d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:44.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.484+0000 7f8f1890b740 1 --2- 172.21.15.22:0/3373124905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c418830 0x561e3c42d130 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009370 tx=0x7f8f08009f90 comp rx=0 tx=0).stop 2024-08-20T01:31:44.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.484+0000 7f8f1890b740 1 -- 172.21.15.22:0/3373124905 shutdown_connections 2024-08-20T01:31:44.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.484+0000 7f8f1890b740 1 --2- 172.21.15.22:0/3373124905 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561e3c434c80 0x561e3c4a2500 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.484+0000 7f8eef7fe640 0 client.15522 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:44.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.484+0000 7f8f1890b740 1 --2- 172.21.15.22:0/3373124905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561e3c4250e0 0x561e3c4280e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.484+0000 7f8f1890b740 1 --2- 172.21.15.22:0/3373124905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e3c419150 0x561e3c42d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.484+0000 7f8f1890b740 1 --2- 172.21.15.22:0/3373124905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561e3c418830 0x561e3c42d130 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.484+0000 7f8f1890b740 1 -- 172.21.15.22:0/3373124905 >> 172.21.15.22:0/3373124905 conn(0x561e3c416660 msgr2=0x561e3c4307c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:44.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.485+0000 7f8f1890b740 1 -- 172.21.15.22:0/3373124905 shutdown_connections 2024-08-20T01:31:44.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.485+0000 7f8f1890b740 1 -- 172.21.15.22:0/3373124905 wait complete. 2024-08-20T01:31:44.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.485+0000 7f8f1890b740 20 client.15522 trim_cache size 0 max 16384 2024-08-20T01:31:44.498 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:31:44.499 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:31:44.499 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-08-20T01:31:44.499 INFO:teuthology.orchestra.run.smithi022.stdout: "00e88037-8aeb-47be-81a3-db299723bdd0": { 2024-08-20T01:31:44.499 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-08-20T01:31:44.499 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "00e88037-8aeb-47be-81a3-db299723bdd0", 2024-08-20T01:31:44.499 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-08-20T01:31:44.499 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:31:44.499 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:31:44.500 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:31:44.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.486+0000 7f8f16512640 1 -- 172.21.15.22:0/4104614989 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8ef80b3bd0 msgr2=0x7f8ef80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:44.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.486+0000 7f8f16512640 1 --2- 172.21.15.22:0/4104614989 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8ef80b3bd0 0x7f8ef80b6090 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8f000e1bb0 tx=0x7f8f00018560 comp rx=0 tx=0).stop 2024-08-20T01:31:44.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.486+0000 7f8f16512640 1 -- 172.21.15.22:0/4104614989 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f10101590 msgr2=0x7f8f1019b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:44.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.486+0000 7f8f16512640 1 --2- 172.21.15.22:0/4104614989 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f10101590 0x7f8f1019b290 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000e9f0 tx=0x7f8f0000eeb0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.486+0000 7f8f16512640 1 -- 172.21.15.22:0/4104614989 shutdown_connections 2024-08-20T01:31:44.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.486+0000 7f8f16512640 1 --2- 172.21.15.22:0/4104614989 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8ef80b3bd0 0x7f8ef80b6090 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.486+0000 7f8f16512640 1 --2- 172.21.15.22:0/4104614989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f1010f140 0x7f8f101a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.486+0000 7f8f16512640 1 --2- 172.21.15.22:0/4104614989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f10101eb0 0x7f8f1019b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.486+0000 7f8f16512640 1 --2- 172.21.15.22:0/4104614989 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f10101590 0x7f8f1019b290 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:44.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.486+0000 7f8f16512640 1 -- 172.21.15.22:0/4104614989 >> 172.21.15.22:0/4104614989 conn(0x7f8f100fd400 msgr2=0x7f8f100ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:44.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.486+0000 7f8f16512640 1 -- 172.21.15.22:0/4104614989 shutdown_connections 2024-08-20T01:31:44.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:31:44.486+0000 7f8f16512640 1 -- 172.21.15.22:0/4104614989 wait complete. 2024-08-20T01:31:45.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:44 smithi134 ceph-mon[22511]: scrub queued for path: / 2024-08-20T01:31:45.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:44 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:31:45.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:44 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:31:45.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:44 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:31:45.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:44 smithi134 ceph-mon[22511]: pgmap v364: 97 pgs: 97 active+clean; 668 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-08-20T01:31:45.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:44 smithi077 ceph-mon[22251]: scrub queued for path: / 2024-08-20T01:31:45.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:44 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:31:45.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:44 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:31:45.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:44 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:31:45.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:44 smithi077 ceph-mon[22251]: pgmap v364: 97 pgs: 97 active+clean; 668 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-08-20T01:31:45.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:44 smithi022 ceph-mon[18709]: scrub queued for path: / 2024-08-20T01:31:45.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:44 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:31:45.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:44 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:31:45.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:44 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:31:45.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:44 smithi022 ceph-mon[18709]: pgmap v364: 97 pgs: 97 active+clean; 668 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-08-20T01:31:45.186 INFO:tasks.cephfs.filesystem:scrub status for tag:00e88037-8aeb-47be-81a3-db299723bdd0 - {'path': '/', 'tag': '00e88037-8aeb-47be-81a3-db299723bdd0', 'options': 'recursive,force'} 2024-08-20T01:31:47.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:46 smithi134 ceph-mon[22511]: pgmap v365: 97 pgs: 97 active+clean; 668 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-08-20T01:31:47.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:46 smithi077 ceph-mon[22251]: pgmap v365: 97 pgs: 97 active+clean; 668 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-08-20T01:31:47.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:46 smithi022 ceph-mon[18709]: pgmap v365: 97 pgs: 97 active+clean; 668 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-08-20T01:31:49.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:48 smithi134 ceph-mon[22511]: pgmap v366: 97 pgs: 97 active+clean; 668 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-08-20T01:31:49.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:48 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:31:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:48 smithi077 ceph-mon[22251]: pgmap v366: 97 pgs: 97 active+clean; 668 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-08-20T01:31:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:48 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:31:49.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:48 smithi022 ceph-mon[18709]: pgmap v366: 97 pgs: 97 active+clean; 668 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-08-20T01:31:49.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:48 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:31:50.031 INFO:tasks.workunit.client.0.smithi022.stderr:Updating files: 95% (11548/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-08-20T01:31:50.552 INFO:tasks.workunit.client.0.smithi022.stderr:Note: switching to 'ef4275410d8483698016fe484b2a3c664080b4c1'. 2024-08-20T01:31:50.552 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-08-20T01:31:50.553 INFO:tasks.workunit.client.0.smithi022.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-20T01:31:50.553 INFO:tasks.workunit.client.0.smithi022.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-20T01:31:50.553 INFO:tasks.workunit.client.0.smithi022.stderr:state without impacting any branches by switching back to a branch. 2024-08-20T01:31:50.553 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-08-20T01:31:50.553 INFO:tasks.workunit.client.0.smithi022.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-20T01:31:50.553 INFO:tasks.workunit.client.0.smithi022.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-20T01:31:50.553 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-08-20T01:31:50.553 INFO:tasks.workunit.client.0.smithi022.stderr: git switch -c 2024-08-20T01:31:50.553 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-08-20T01:31:50.553 INFO:tasks.workunit.client.0.smithi022.stderr:Or undo this operation with: 2024-08-20T01:31:50.554 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-08-20T01:31:50.554 INFO:tasks.workunit.client.0.smithi022.stderr: git switch - 2024-08-20T01:31:50.554 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-08-20T01:31:50.554 INFO:tasks.workunit.client.0.smithi022.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-20T01:31:50.554 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-08-20T01:31:50.555 INFO:tasks.workunit.client.0.smithi022.stderr:HEAD is now at ef4275410d8 Merge branch 'mds-conf-sorted' of https://github.com/batrick/ceph into wip-hemanth-testing-2024-08-19-1357 2024-08-20T01:31:50.557 DEBUG:teuthology.orchestra.run.smithi022:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-20T01:31:50.584 INFO:tasks.workunit.client.0.smithi022.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-20T01:31:50.587 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-20T01:31:50.587 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-20T01:31:50.956 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:50 smithi022 ceph-mon[18709]: pgmap v367: 97 pgs: 97 active+clean; 668 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-20T01:31:51.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:50 smithi134 ceph-mon[22511]: pgmap v367: 97 pgs: 97 active+clean; 668 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-20T01:31:51.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:50 smithi077 ceph-mon[22251]: pgmap v367: 97 pgs: 97 active+clean; 668 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-20T01:31:51.198 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-20T01:31:51.264 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-20T01:31:51.306 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-20T01:31:51.306 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-20T01:31:51.307 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-20T01:31:51.353 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-20T01:31:51.357 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-08-20T01:31:51.357 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-20T01:31:51.415 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-08-20T01:31:51.416 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-08-20T01:31:51.417 DEBUG:teuthology.orchestra.run.smithi022:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ef4275410d8483698016fe484b2a3c664080b4c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-08-20T01:31:51.485 INFO:tasks.workunit.client.0.smithi022.stdout:getting blogbench 2024-08-20T01:31:51.485 INFO:tasks.workunit.client.0.smithi022.stderr:+ echo 'getting blogbench' 2024-08-20T01:31:51.485 INFO:tasks.workunit.client.0.smithi022.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-08-20T01:31:51.500 INFO:tasks.workunit.client.0.smithi022.stderr:--2024-08-20 01:31:51-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-08-20T01:31:51.501 INFO:tasks.workunit.client.0.smithi022.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-08-20T01:31:51.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.511+0000 7fbb45877640 1 -- 172.21.15.22:0/798410963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb40102680 msgr2=0x7fbb40102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:51.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.511+0000 7fbb45877640 1 --2- 172.21.15.22:0/798410963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb40102680 0x7fbb40102a80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009930 tx=0x7fbb3002a420 comp rx=0 tx=0).stop 2024-08-20T01:31:51.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.511+0000 7fbb45877640 1 -- 172.21.15.22:0/798410963 shutdown_connections 2024-08-20T01:31:51.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.511+0000 7fbb45877640 1 --2- 172.21.15.22:0/798410963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb40104190 0x7fbb4010ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.511+0000 7fbb45877640 1 --2- 172.21.15.22:0/798410963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb401037d0 0x7fbb40103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.511+0000 7fbb45877640 1 --2- 172.21.15.22:0/798410963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb40102680 0x7fbb40102a80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.511+0000 7fbb45877640 1 -- 172.21.15.22:0/798410963 >> 172.21.15.22:0/798410963 conn(0x7fbb400fdf40 msgr2=0x7fbb40100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:51.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.511+0000 7fbb45877640 1 -- 172.21.15.22:0/798410963 shutdown_connections 2024-08-20T01:31:51.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.511+0000 7fbb45877640 1 -- 172.21.15.22:0/798410963 wait complete. 2024-08-20T01:31:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.512+0000 7fbb45877640 1 Processor -- start 2024-08-20T01:31:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.512+0000 7fbb45877640 1 -- start start 2024-08-20T01:31:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.512+0000 7fbb45877640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb40102680 0x7fbb4019ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.512+0000 7fbb45877640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb401037d0 0x7fbb4019b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.512+0000 7fbb45877640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb40104190 0x7fbb4019bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.512+0000 7fbb45877640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4010e2d0 con 0x7fbb40104190 2024-08-20T01:31:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.512+0000 7fbb45877640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4010e150 con 0x7fbb40102680 2024-08-20T01:31:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.512+0000 7fbb45877640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4010e450 con 0x7fbb401037d0 2024-08-20T01:31:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.512+0000 7fbb3f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb40104190 0x7fbb4019bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.512+0000 7fbb3f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb40104190 0x7fbb4019bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49164/0 (socket says 172.21.15.22:49164) 2024-08-20T01:31:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.512+0000 7fbb3f7fe640 1 -- 172.21.15.22:0/1454165667 learned_addr learned my addr 172.21.15.22:0/1454165667 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.512+0000 7fbb3effd640 1 --2- 172.21.15.22:0/1454165667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb40102680 0x7fbb4019ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.512+0000 7fbb37fff640 1 --2- 172.21.15.22:0/1454165667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb401037d0 0x7fbb4019b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.512+0000 7fbb3f7fe640 1 -- 172.21.15.22:0/1454165667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb401037d0 msgr2=0x7fbb4019b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.512+0000 7fbb3f7fe640 1 --2- 172.21.15.22:0/1454165667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb401037d0 0x7fbb4019b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.512+0000 7fbb3f7fe640 1 -- 172.21.15.22:0/1454165667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb40102680 msgr2=0x7fbb4019ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.512+0000 7fbb3f7fe640 1 --2- 172.21.15.22:0/1454165667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb40102680 0x7fbb4019ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.512+0000 7fbb3f7fe640 1 -- 172.21.15.22:0/1454165667 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4019c760 con 0x7fbb40104190 2024-08-20T01:31:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.513+0000 7fbb3f7fe640 1 --2- 172.21.15.22:0/1454165667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb40104190 0x7fbb4019bea0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800eaa0 tx=0x7fbb3800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.513+0000 7fbb44875640 1 -- 172.21.15.22:0/1454165667 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38004d20 con 0x7fbb40104190 2024-08-20T01:31:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.513+0000 7fbb44875640 1 -- 172.21.15.22:0/1454165667 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb38005020 con 0x7fbb40104190 2024-08-20T01:31:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.513+0000 7fbb45877640 1 -- 172.21.15.22:0/1454165667 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4019ca50 con 0x7fbb40104190 2024-08-20T01:31:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.513+0000 7fbb44875640 1 -- 172.21.15.22:0/1454165667 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb380116b0 con 0x7fbb40104190 2024-08-20T01:31:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.513+0000 7fbb45877640 1 -- 172.21.15.22:0/1454165667 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb401a3120 con 0x7fbb40104190 2024-08-20T01:31:51.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.515+0000 7fbb48668740 1 Processor -- start 2024-08-20T01:31:51.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.516+0000 7fbb44875640 1 -- 172.21.15.22:0/1454165667 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbb380051d0 con 0x7fbb40104190 2024-08-20T01:31:51.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.516+0000 7fbb48668740 1 -- start start 2024-08-20T01:31:51.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.516+0000 7fbb48668740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef12630 0x55d62ef14a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:51.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.516+0000 7fbb48668740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef14f60 0x55d62ef17350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:51.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.516+0000 7fbb48668740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef179a0 0x55d62ef19e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:51.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.516+0000 7fbb48668740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d62ee85360 con 0x55d62ef14f60 2024-08-20T01:31:51.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.516+0000 7fbb48668740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d62ee74860 con 0x55d62ef179a0 2024-08-20T01:31:51.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.516+0000 7fbb48668740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d62ee788a0 con 0x55d62ef12630 2024-08-20T01:31:51.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.516+0000 7fbb3effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef14f60 0x55d62ef17350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:51.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.516+0000 7fbb3effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef14f60 0x55d62ef17350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49170/0 (socket says 172.21.15.22:49170) 2024-08-20T01:31:51.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.516+0000 7fbb3effd640 1 -- 172.21.15.22:0/4018536067 learned_addr learned my addr 172.21.15.22:0/4018536067 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:51.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.516+0000 7fbb37fff640 1 --2- 172.21.15.22:0/4018536067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef179a0 0x55d62ef19e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:51.525 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.516+0000 7fbb37fff640 1 --2- 172.21.15.22:0/4018536067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef12630 0x55d62ef14a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:51.525 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.516+0000 7fbb3effd640 1 -- 172.21.15.22:0/4018536067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef12630 msgr2=0x55d62ef14a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:51.525 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.517+0000 7fbb3effd640 1 --2- 172.21.15.22:0/4018536067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef12630 0x55d62ef14a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.525 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.517+0000 7fbb3effd640 1 -- 172.21.15.22:0/4018536067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef179a0 msgr2=0x55d62ef19e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:51.525 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.517+0000 7fbb3effd640 1 --2- 172.21.15.22:0/4018536067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef179a0 0x55d62ef19e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.525 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.517+0000 7fbb3effd640 1 -- 172.21.15.22:0/4018536067 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d62ee1be40 con 0x55d62ef14f60 2024-08-20T01:31:51.525 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.517+0000 7fbb44875640 1 --2- 172.21.15.22:0/1454165667 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbb2c0b3bd0 0x7fbb2c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:51.525 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.517+0000 7fbb3effd640 1 --2- 172.21.15.22:0/4018536067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef14f60 0x55d62ef17350 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbb3002a940 tx=0x7fbb30031c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fd7ff869c727 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:51.525 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.517+0000 7fbb37fff640 1 --2- 172.21.15.22:0/1454165667 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbb2c0b3bd0 0x7fbb2c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:51.525 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.517+0000 7fbb44875640 1 -- 172.21.15.22:0/1454165667 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fbb380e3dc0 con 0x7fbb40104190 2024-08-20T01:31:51.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.517+0000 7fbb35ffb640 1 -- 172.21.15.22:0/4018536067 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30035030 con 0x55d62ef14f60 2024-08-20T01:31:51.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.517+0000 7fbb35ffb640 1 -- 172.21.15.22:0/4018536067 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb30040070 con 0x55d62ef14f60 2024-08-20T01:31:51.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.517+0000 7fbb35ffb640 1 -- 172.21.15.22:0/4018536067 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30003bb0 con 0x55d62ef14f60 2024-08-20T01:31:51.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.518+0000 7fbb48668740 1 -- 172.21.15.22:0/4018536067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef14f60 msgr2=0x55d62ef17350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:51.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.518+0000 7fbb48668740 1 --2- 172.21.15.22:0/4018536067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef14f60 0x55d62ef17350 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbb3002a940 tx=0x7fbb30031c40 comp rx=0 tx=0).stop 2024-08-20T01:31:51.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.518+0000 7fbb37fff640 1 --2- 172.21.15.22:0/1454165667 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbb2c0b3bd0 0x7fbb2c0b6090 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbb280105d0 tx=0x7fbb28013040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:51.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.518+0000 7fbb48668740 1 -- 172.21.15.22:0/4018536067 shutdown_connections 2024-08-20T01:31:51.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.518+0000 7fbb48668740 1 --2- 172.21.15.22:0/4018536067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef179a0 0x55d62ef19e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.518+0000 7fbb48668740 1 --2- 172.21.15.22:0/4018536067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef14f60 0x55d62ef17350 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.518+0000 7fbb48668740 1 --2- 172.21.15.22:0/4018536067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef12630 0x55d62ef14a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.518+0000 7fbb48668740 1 -- 172.21.15.22:0/4018536067 >> 172.21.15.22:0/4018536067 conn(0x55d62ef0d730 msgr2=0x55d62ef0e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:51.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.518+0000 7fbb48668740 1 -- 172.21.15.22:0/4018536067 shutdown_connections 2024-08-20T01:31:51.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.518+0000 7fbb48668740 1 -- 172.21.15.22:0/4018536067 wait complete. 2024-08-20T01:31:51.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.518+0000 7fbb48668740 1 -- start start 2024-08-20T01:31:51.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.518+0000 7fbb48668740 1 Processor -- start 2024-08-20T01:31:51.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.519+0000 7fbb48668740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef12630 0x55d62ef1bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:51.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.519+0000 7fbb48668740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef14f60 0x55d62ef1c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:51.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.519+0000 7fbb48668740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef179a0 0x55d62ef1d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:51.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.519+0000 7fbb48668740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d62edadab0 con 0x55d62ef14f60 2024-08-20T01:31:51.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.519+0000 7fbb48668740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d62edfb780 con 0x55d62ef12630 2024-08-20T01:31:51.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.519+0000 7fbb48668740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d62ef1a920 con 0x55d62ef179a0 2024-08-20T01:31:51.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.519+0000 7fbb48668740 10 client.0 _ll_register_callbacks cb 0x55d62eb83a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:51.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.519+0000 7fbb37fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef14f60 0x55d62ef1c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.519+0000 7fbb37fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef14f60 0x55d62ef1c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49182/0 (socket says 172.21.15.22:49182) 2024-08-20T01:31:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.519+0000 7fbb37fff640 1 -- 172.21.15.22:0/695391293 learned_addr learned my addr 172.21.15.22:0/695391293 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.519+0000 7fbb3effd640 1 --2- 172.21.15.22:0/695391293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef12630 0x55d62ef1bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.519+0000 7fbb3f7fe640 1 --2- 172.21.15.22:0/695391293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef179a0 0x55d62ef1d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.519+0000 7fbb37fff640 1 -- 172.21.15.22:0/695391293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef179a0 msgr2=0x55d62ef1d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.519+0000 7fbb37fff640 1 --2- 172.21.15.22:0/695391293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef179a0 0x55d62ef1d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.519+0000 7fbb37fff640 1 -- 172.21.15.22:0/695391293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef12630 msgr2=0x55d62ef1bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.519+0000 7fbb37fff640 1 --2- 172.21.15.22:0/695391293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef12630 0x55d62ef1bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.519+0000 7fbb37fff640 1 -- 172.21.15.22:0/695391293 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d62ebd7790 con 0x55d62ef14f60 2024-08-20T01:31:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.519+0000 7fbb3effd640 1 --2- 172.21.15.22:0/695391293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef12630 0x55d62ef1bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:31:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.520+0000 7fbb37fff640 1 --2- 172.21.15.22:0/695391293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef14f60 0x55d62ef1c460 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbb28020e70 tx=0x7fbb280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d7d9259284b155 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.520+0000 7fbb1effd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:31:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.520+0000 7fbb1effd640 1 -- 172.21.15.22:0/695391293 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2801f430 con 0x55d62ef14f60 2024-08-20T01:31:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.520+0000 7fbb1effd640 1 -- 172.21.15.22:0/695391293 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fbb2801f5d0 con 0x55d62ef14f60 2024-08-20T01:31:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.520+0000 7fbb48668740 1 -- 172.21.15.22:0/695391293 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d62ee23e00 con 0x55d62ef14f60 2024-08-20T01:31:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.520+0000 7fbb1effd640 1 -- 172.21.15.22:0/695391293 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbb2801f7d0 con 0x55d62ef14f60 2024-08-20T01:31:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.520+0000 7fbb48668740 10 client.15534 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.520+0000 7fbb48668740 1 -- 172.21.15.22:0/695391293 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d62ec50620 con 0x55d62ef14f60 2024-08-20T01:31:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.520+0000 7fbb1effd640 1 -- 172.21.15.22:0/695391293 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d62ee23e00 con 0x55d62ef14f60 2024-08-20T01:31:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.520+0000 7fbb1effd640 1 -- 172.21.15.22:0/695391293 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbb28029030 con 0x55d62ef14f60 2024-08-20T01:31:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.520+0000 7fbb48668740 10 client.15534 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.520+0000 7fbb48668740 10 client.15534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:31:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.520+0000 7fbb48668740 20 client.15534 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.520+0000 7fbb48668740 1 --2- 172.21.15.22:0/695391293 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d62ef276b0 0x55d62ef29b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.520+0000 7fbb48668740 4 client.15534 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:31:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.520+0000 7fbb48668740 1 -- 172.21.15.22:0/695391293 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d62ee872b0 con 0x55d62ef276b0 2024-08-20T01:31:51.531 INFO:tasks.workunit.client.0.smithi022.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-08-20T01:31:51.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.521+0000 7fbb3effd640 1 --2- 172.21.15.22:0/695391293 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d62ef276b0 0x55d62ef29b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:51.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.521+0000 7fbb3effd640 1 --2- 172.21.15.22:0/695391293 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d62ef276b0 0x55d62ef29b20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcd256e7774ad40 server_cookie=58c258471b5b3b2a in_seq=0 out_seq=0 2024-08-20T01:31:51.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.521+0000 7fbb1effd640 10 client.15534 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:51.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.522+0000 7fbb1effd640 1 -- 172.21.15.22:0/695391293 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d62ee872b0 con 0x55d62ef276b0 2024-08-20T01:31:51.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.522+0000 7fbb1effd640 10 client.15534 handle_command_reply: tid=0 2024-08-20T01:31:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.522+0000 7fbb48668740 1 client.15534 shutdown 2024-08-20T01:31:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.522+0000 7fbb48668740 1 -- 172.21.15.22:0/695391293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef14f60 msgr2=0x55d62ef1c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.522+0000 7fbb48668740 1 --2- 172.21.15.22:0/695391293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef14f60 0x55d62ef1c460 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbb28020e70 tx=0x7fbb280046c0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.522+0000 7fbb48668740 1 -- 172.21.15.22:0/695391293 shutdown_connections 2024-08-20T01:31:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.522+0000 7fbb48668740 1 --2- 172.21.15.22:0/695391293 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d62ef276b0 0x55d62ef29b20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.522+0000 7fbb48668740 1 --2- 172.21.15.22:0/695391293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef179a0 0x55d62ef1d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.522+0000 7fbb48668740 1 --2- 172.21.15.22:0/695391293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef14f60 0x55d62ef1c460 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.522+0000 7fbb1effd640 0 client.15534 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.522+0000 7fbb48668740 1 --2- 172.21.15.22:0/695391293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef12630 0x55d62ef1bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.522+0000 7fbb48668740 1 -- 172.21.15.22:0/695391293 >> 172.21.15.22:0/695391293 conn(0x55d62ef0d730 msgr2=0x55d62ef0c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.522+0000 7fbb48668740 1 -- 172.21.15.22:0/695391293 shutdown_connections 2024-08-20T01:31:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.522+0000 7fbb48668740 1 -- 172.21.15.22:0/695391293 wait complete. 2024-08-20T01:31:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.522+0000 7fbb48668740 20 client.15534 trim_cache size 0 max 16384 2024-08-20T01:31:51.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.537+0000 7fbb48668740 1 Processor -- start 2024-08-20T01:31:51.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.537+0000 7fbb48668740 1 -- start start 2024-08-20T01:31:51.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.537+0000 7fbb48668740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef12630 0x55d62ef17d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:51.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.537+0000 7fbb48668740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef14f60 0x55d62ef182c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:51.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.537+0000 7fbb48668740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef179a0 0x55d62ef18800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:51.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.537+0000 7fbb48668740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401ae7d0 con 0x55d62ef179a0 2024-08-20T01:31:51.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.537+0000 7fbb48668740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401ac0a0 con 0x55d62ef12630 2024-08-20T01:31:51.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.537+0000 7fbb48668740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401a9ef0 con 0x55d62ef14f60 2024-08-20T01:31:51.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.537+0000 7fbb3f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef179a0 0x55d62ef18800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:51.541 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.537+0000 7fbb3f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef179a0 0x55d62ef18800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49196/0 (socket says 172.21.15.22:49196) 2024-08-20T01:31:51.541 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.537+0000 7fbb3f7fe640 1 -- 172.21.15.22:0/2525476357 learned_addr learned my addr 172.21.15.22:0/2525476357 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:51.541 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.537+0000 7fbb37fff640 1 --2- 172.21.15.22:0/2525476357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef14f60 0x55d62ef182c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:51.541 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.537+0000 7fbb3effd640 1 --2- 172.21.15.22:0/2525476357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef12630 0x55d62ef17d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:51.541 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.537+0000 7fbb3f7fe640 1 -- 172.21.15.22:0/2525476357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef14f60 msgr2=0x55d62ef182c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:51.541 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.537+0000 7fbb3f7fe640 1 --2- 172.21.15.22:0/2525476357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef14f60 0x55d62ef182c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.541 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.537+0000 7fbb3f7fe640 1 -- 172.21.15.22:0/2525476357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef12630 msgr2=0x55d62ef17d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:51.541 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.537+0000 7fbb3f7fe640 1 --2- 172.21.15.22:0/2525476357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef12630 0x55d62ef17d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.541 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.537+0000 7fbb3f7fe640 1 -- 172.21.15.22:0/2525476357 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d62ef14d90 con 0x55d62ef179a0 2024-08-20T01:31:51.541 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.538+0000 7fbb3f7fe640 1 --2- 172.21.15.22:0/2525476357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef179a0 0x55d62ef18800 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbb380e1820 tx=0x7fbb3800ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275251a0fd91a72c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:51.541 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.538+0000 7fbb357fa640 1 -- 172.21.15.22:0/2525476357 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3801f040 con 0x55d62ef179a0 2024-08-20T01:31:51.541 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.538+0000 7fbb357fa640 1 -- 172.21.15.22:0/2525476357 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb380b3d80 con 0x55d62ef179a0 2024-08-20T01:31:51.541 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.538+0000 7fbb357fa640 1 -- 172.21.15.22:0/2525476357 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3800caf0 con 0x55d62ef179a0 2024-08-20T01:31:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.538+0000 7fbb48668740 1 -- 172.21.15.22:0/2525476357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef179a0 msgr2=0x55d62ef18800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.538+0000 7fbb48668740 1 --2- 172.21.15.22:0/2525476357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef179a0 0x55d62ef18800 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbb380e1820 tx=0x7fbb3800ea20 comp rx=0 tx=0).stop 2024-08-20T01:31:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.538+0000 7fbb48668740 1 -- 172.21.15.22:0/2525476357 shutdown_connections 2024-08-20T01:31:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.538+0000 7fbb48668740 1 --2- 172.21.15.22:0/2525476357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef179a0 0x55d62ef18800 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.539+0000 7fbb48668740 1 --2- 172.21.15.22:0/2525476357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef14f60 0x55d62ef182c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.539+0000 7fbb48668740 1 --2- 172.21.15.22:0/2525476357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef12630 0x55d62ef17d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.539+0000 7fbb48668740 1 -- 172.21.15.22:0/2525476357 >> 172.21.15.22:0/2525476357 conn(0x55d62ef0d730 msgr2=0x55d62ef0df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.539+0000 7fbb48668740 1 -- 172.21.15.22:0/2525476357 shutdown_connections 2024-08-20T01:31:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.539+0000 7fbb48668740 1 -- 172.21.15.22:0/2525476357 wait complete. 2024-08-20T01:31:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.539+0000 7fbb48668740 1 -- start start 2024-08-20T01:31:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.539+0000 7fbb48668740 1 Processor -- start 2024-08-20T01:31:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.539+0000 7fbb48668740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef12630 0x55d62ef239e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.539+0000 7fbb48668740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef14f60 0x55d62ef226e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.539+0000 7fbb48668740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef179a0 0x55d62ef22d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.539+0000 7fbb48668740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401aa560 con 0x55d62ef12630 2024-08-20T01:31:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.539+0000 7fbb48668740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401ab9d0 con 0x55d62ef179a0 2024-08-20T01:31:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.539+0000 7fbb48668740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401aac30 con 0x55d62ef14f60 2024-08-20T01:31:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.539+0000 7fbb48668740 10 client.0 _ll_register_callbacks cb 0x7fbb2800acb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:31:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.539+0000 7fbb3effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef12630 0x55d62ef239e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb3effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef12630 0x55d62ef239e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49200/0 (socket says 172.21.15.22:49200) 2024-08-20T01:31:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb3effd640 1 -- 172.21.15.22:0/3969514547 learned_addr learned my addr 172.21.15.22:0/3969514547 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:31:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb37fff640 1 --2- 172.21.15.22:0/3969514547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef14f60 0x55d62ef226e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb3f7fe640 1 --2- 172.21.15.22:0/3969514547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef179a0 0x55d62ef22d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb3effd640 1 -- 172.21.15.22:0/3969514547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef14f60 msgr2=0x55d62ef226e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:51.547 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb3effd640 1 --2- 172.21.15.22:0/3969514547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef14f60 0x55d62ef226e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.547 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb3effd640 1 -- 172.21.15.22:0/3969514547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef179a0 msgr2=0x55d62ef22d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:31:51.547 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb3effd640 1 --2- 172.21.15.22:0/3969514547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef179a0 0x55d62ef22d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.547 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb3effd640 1 -- 172.21.15.22:0/3969514547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d62ef1d3a0 con 0x55d62ef12630 2024-08-20T01:31:51.547 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb37fff640 1 --2- 172.21.15.22:0/3969514547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef14f60 0x55d62ef226e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:31:51.547 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb3f7fe640 1 --2- 172.21.15.22:0/3969514547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef179a0 0x55d62ef22d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:31:51.547 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb3effd640 1 --2- 172.21.15.22:0/3969514547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef12630 0x55d62ef239e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbb3002a940 tx=0x7fbb300317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3785925fe6842c00 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:51.547 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb1effd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:31:51.547 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb1effd640 1 -- 172.21.15.22:0/3969514547 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30035040 con 0x55d62ef12630 2024-08-20T01:31:51.547 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb1effd640 1 -- 172.21.15.22:0/3969514547 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fbb30004450 con 0x55d62ef12630 2024-08-20T01:31:51.547 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb48668740 1 -- 172.21.15.22:0/3969514547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb380b3d80 con 0x55d62ef12630 2024-08-20T01:31:51.547 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb1effd640 1 -- 172.21.15.22:0/3969514547 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbb300035f0 con 0x55d62ef12630 2024-08-20T01:31:51.547 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb48668740 10 client.15540 fetch_fsmap learned FSMap version 25 2024-08-20T01:31:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb48668740 1 -- 172.21.15.22:0/3969514547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d62ef92490 con 0x55d62ef12630 2024-08-20T01:31:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.540+0000 7fbb1effd640 1 -- 172.21.15.22:0/3969514547 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb380b3d80 con 0x55d62ef12630 2024-08-20T01:31:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.541+0000 7fbb1effd640 1 -- 172.21.15.22:0/3969514547 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbb3004d040 con 0x55d62ef12630 2024-08-20T01:31:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.541+0000 7fbb48668740 10 client.15540 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:31:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.541+0000 7fbb48668740 10 client.15540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:31:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.541+0000 7fbb48668740 20 client.15540 populate_metadata read hostname 'smithi022' 2024-08-20T01:31:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.541+0000 7fbb48668740 1 --2- 172.21.15.22:0/3969514547 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d62ef92a10 0x55d62ef94e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.541+0000 7fbb48668740 4 client.15540 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:31:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.541+0000 7fbb48668740 1 -- 172.21.15.22:0/3969514547 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d62ee82d50 con 0x55d62ef92a10 2024-08-20T01:31:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.541+0000 7fbb37fff640 1 --2- 172.21.15.22:0/3969514547 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d62ef92a10 0x55d62ef94e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:51.548 INFO:tasks.workunit.client.0.smithi022.stderr:HTTP request sent, awaiting response... 200 OK 2024-08-20T01:31:51.549 INFO:tasks.workunit.client.0.smithi022.stderr:Length: 103355 (101K) [application/octet-stream] 2024-08-20T01:31:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.541+0000 7fbb37fff640 1 --2- 172.21.15.22:0/3969514547 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d62ef92a10 0x55d62ef94e30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a2ece8c653bf366 server_cookie=390fbc9d8c11dbdb in_seq=0 out_seq=0 2024-08-20T01:31:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.541+0000 7fbb1effd640 10 client.15540 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:51.549 INFO:tasks.workunit.client.0.smithi022.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-08-20T01:31:51.550 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-08-20T01:31:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.552+0000 7fbb1effd640 1 -- 172.21.15.22:0/3969514547 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d62ee82d50 con 0x55d62ef92a10 2024-08-20T01:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.552+0000 7fbb1effd640 10 client.15540 handle_command_reply: tid=0 2024-08-20T01:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.552+0000 7fbb48668740 1 client.15540 shutdown 2024-08-20T01:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.552+0000 7fbb48668740 1 -- 172.21.15.22:0/3969514547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef12630 msgr2=0x55d62ef239e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.552+0000 7fbb48668740 1 --2- 172.21.15.22:0/3969514547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef12630 0x55d62ef239e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbb3002a940 tx=0x7fbb300317e0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.552+0000 7fbb48668740 1 -- 172.21.15.22:0/3969514547 shutdown_connections 2024-08-20T01:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.552+0000 7fbb48668740 1 --2- 172.21.15.22:0/3969514547 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d62ef92a10 0x55d62ef94e30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.552+0000 7fbb48668740 1 --2- 172.21.15.22:0/3969514547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d62ef179a0 0x55d62ef22d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.552+0000 7fbb1effd640 0 client.15540 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.552+0000 7fbb48668740 1 --2- 172.21.15.22:0/3969514547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d62ef14f60 0x55d62ef226e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.552+0000 7fbb48668740 1 --2- 172.21.15.22:0/3969514547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d62ef12630 0x55d62ef239e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.552+0000 7fbb48668740 1 -- 172.21.15.22:0/3969514547 >> 172.21.15.22:0/3969514547 conn(0x55d62ef0d730 msgr2=0x55d62ef0c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.552+0000 7fbb48668740 1 -- 172.21.15.22:0/3969514547 shutdown_connections 2024-08-20T01:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.552+0000 7fbb48668740 1 -- 172.21.15.22:0/3969514547 wait complete. 2024-08-20T01:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.553+0000 7fbb48668740 20 client.15540 trim_cache size 0 max 16384 2024-08-20T01:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:31:51.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.553+0000 7fbb45877640 1 -- 172.21.15.22:0/1454165667 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbb2c0b3bd0 msgr2=0x7fbb2c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:51.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.553+0000 7fbb45877640 1 --2- 172.21.15.22:0/1454165667 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbb2c0b3bd0 0x7fbb2c0b6090 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbb280105d0 tx=0x7fbb28013040 comp rx=0 tx=0).stop 2024-08-20T01:31:51.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.553+0000 7fbb45877640 1 -- 172.21.15.22:0/1454165667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb40104190 msgr2=0x7fbb4019bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:51.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.553+0000 7fbb45877640 1 --2- 172.21.15.22:0/1454165667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb40104190 0x7fbb4019bea0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800eaa0 tx=0x7fbb3800eea0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.553+0000 7fbb45877640 1 -- 172.21.15.22:0/1454165667 shutdown_connections 2024-08-20T01:31:51.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.553+0000 7fbb45877640 1 --2- 172.21.15.22:0/1454165667 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbb2c0b3bd0 0x7fbb2c0b6090 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.553+0000 7fbb45877640 1 --2- 172.21.15.22:0/1454165667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb40104190 0x7fbb4019bea0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.553+0000 7fbb45877640 1 --2- 172.21.15.22:0/1454165667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb401037d0 0x7fbb4019b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.558 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.553+0000 7fbb45877640 1 --2- 172.21.15.22:0/1454165667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb40102680 0x7fbb4019ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:51.558 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.553+0000 7fbb45877640 1 -- 172.21.15.22:0/1454165667 >> 172.21.15.22:0/1454165667 conn(0x7fbb400fdf40 msgr2=0x7fbb400750b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:51.558 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.553+0000 7fbb45877640 1 -- 172.21.15.22:0/1454165667 shutdown_connections 2024-08-20T01:31:51.558 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:31:51.553+0000 7fbb45877640 1 -- 172.21.15.22:0/1454165667 wait complete. 2024-08-20T01:31:51.584 INFO:tasks.workunit.client.0.smithi022.stderr: 0K .......... .......... .......... .......... .......... 49% 1.23M 0s 2024-08-20T01:31:51.604 INFO:tasks.workunit.client.0.smithi022.stderr: 50K .......... .......... .......... .......... .......... 99% 2.40M 0s 2024-08-20T01:31:51.604 INFO:tasks.workunit.client.0.smithi022.stderr: 100K 100% 1.74T=0.06s 2024-08-20T01:31:51.604 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-08-20T01:31:51.604 INFO:tasks.workunit.client.0.smithi022.stderr:2024-08-20 01:31:51 (1.64 MB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-08-20T01:31:51.604 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-08-20T01:31:51.605 INFO:tasks.workunit.client.0.smithi022.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-08-20T01:31:51.643 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/ 2024-08-20T01:31:51.643 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/m4/ 2024-08-20T01:31:51.644 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-08-20T01:31:51.645 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/man/ 2024-08-20T01:31:51.646 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/man/blogbench.8 2024-08-20T01:31:51.647 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/man/Makefile.am 2024-08-20T01:31:51.648 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/man/Makefile.in 2024-08-20T01:31:51.649 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/src/ 2024-08-20T01:31:51.649 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/src/mysnprintf.c 2024-08-20T01:31:51.650 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/src/mysnprintf.h 2024-08-20T01:31:51.651 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/src/blogbench.c 2024-08-20T01:31:51.652 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/src/blogbench.h 2024-08-20T01:31:51.653 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/src/fakesnprintf.c 2024-08-20T01:31:51.654 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/src/fakesnprintf.h 2024-08-20T01:31:51.655 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/src/blogbench_p.h 2024-08-20T01:31:51.656 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-08-20T01:31:51.657 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-08-20T01:31:51.657 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/src/Makefile.am 2024-08-20T01:31:51.658 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/src/Makefile.in 2024-08-20T01:31:51.659 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/src/process.c 2024-08-20T01:31:51.660 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/src/globals.h 2024-08-20T01:31:51.661 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/src/commenter.c 2024-08-20T01:31:51.662 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/src/rewriter.c 2024-08-20T01:31:51.663 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/src/reader.c 2024-08-20T01:31:51.663 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/src/writer.c 2024-08-20T01:31:51.664 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/src/helpers.c 2024-08-20T01:31:51.665 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/NEWS 2024-08-20T01:31:51.666 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/compile 2024-08-20T01:31:51.667 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/depcomp 2024-08-20T01:31:51.668 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/aclocal.m4 2024-08-20T01:31:51.669 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/README 2024-08-20T01:31:51.669 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/configure 2024-08-20T01:31:51.673 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/configure.ac 2024-08-20T01:31:51.674 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/config.guess 2024-08-20T01:31:51.675 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/install-sh 2024-08-20T01:31:51.676 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/config.sub 2024-08-20T01:31:51.677 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/missing 2024-08-20T01:31:51.677 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/mkinstalldirs 2024-08-20T01:31:51.678 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/Makefile.am 2024-08-20T01:31:51.679 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/Makefile.in 2024-08-20T01:31:51.680 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/config.h.in 2024-08-20T01:31:51.681 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/AUTHORS 2024-08-20T01:31:51.682 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/INSTALL 2024-08-20T01:31:51.682 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/ChangeLog 2024-08-20T01:31:51.683 INFO:tasks.workunit.client.0.smithi022.stdout:blogbench-1.0/COPYING 2024-08-20T01:31:51.684 INFO:tasks.workunit.client.0.smithi022.stderr:+ cd blogbench-1.0/ 2024-08-20T01:31:51.685 INFO:tasks.workunit.client.0.smithi022.stderr:+ echo 'making blogbench' 2024-08-20T01:31:51.685 INFO:tasks.workunit.client.0.smithi022.stdout:making blogbench 2024-08-20T01:31:51.685 INFO:tasks.workunit.client.0.smithi022.stderr:+ ./configure 2024-08-20T01:31:51.780 INFO:tasks.workunit.client.0.smithi022.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-08-20T01:31:52.787 INFO:tasks.workunit.client.0.smithi022.stdout:checking whether build environment is sane... yes 2024-08-20T01:31:52.797 INFO:tasks.workunit.client.0.smithi022.stdout:checking for gawk... gawk 2024-08-20T01:31:52.812 INFO:tasks.workunit.client.0.smithi022.stdout:checking whether make sets $(MAKE)... yes 2024-08-20T01:31:52.829 INFO:tasks.workunit.client.0.smithi022.stdout:checking for gcc... gcc 2024-08-20T01:31:52.881 INFO:tasks.workunit.client.0.smithi022.stdout:checking for C compiler default output file name... a.out 2024-08-20T01:31:52.883 INFO:tasks.workunit.client.0.smithi022.stdout:checking whether the C compiler works... yes 2024-08-20T01:31:52.885 INFO:tasks.workunit.client.0.smithi022.stdout:checking whether we are cross compiling... no 2024-08-20T01:31:52.922 INFO:tasks.workunit.client.0.smithi022.stdout:checking for suffix of executables... 2024-08-20T01:31:52.957 INFO:tasks.workunit.client.0.smithi022.stdout:checking for suffix of object files... o 2024-08-20T01:31:52.991 INFO:tasks.workunit.client.0.smithi022.stdout:checking whether we are using the GNU C compiler... yes 2024-08-20T01:31:53.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:52 smithi134 ceph-mon[22511]: pgmap v368: 97 pgs: 97 active+clean; 668 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2024-08-20T01:31:53.024 INFO:tasks.workunit.client.0.smithi022.stdout:checking whether gcc accepts -g... yes 2024-08-20T01:31:53.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:52 smithi077 ceph-mon[22251]: pgmap v368: 97 pgs: 97 active+clean; 668 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2024-08-20T01:31:53.090 INFO:tasks.workunit.client.0.smithi022.stdout:checking for gcc option to accept ANSI C... none needed 2024-08-20T01:31:53.134 INFO:tasks.workunit.client.0.smithi022.stdout:checking for style of include used by make... GNU 2024-08-20T01:31:53.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:52 smithi022 ceph-mon[18709]: pgmap v368: 97 pgs: 97 active+clean; 668 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2024-08-20T01:31:53.228 INFO:tasks.workunit.client.0.smithi022.stdout:checking dependency style of gcc... gcc3 2024-08-20T01:31:53.228 INFO:tasks.workunit.client.0.smithi022.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-08-20T01:31:53.270 INFO:tasks.workunit.client.0.smithi022.stdout:checking how to run the C preprocessor... gcc -E 2024-08-20T01:31:53.319 INFO:tasks.workunit.client.0.smithi022.stdout:checking for egrep... grep -E 2024-08-20T01:31:53.328 INFO:tasks.workunit.client.0.smithi022.stdout:checking for AIX... no 2024-08-20T01:31:53.392 INFO:tasks.workunit.client.0.smithi022.stdout:checking for library containing strerror... none required 2024-08-20T01:31:53.535 INFO:tasks.workunit.client.0.smithi022.stdout:checking for ANSI C header files... yes 2024-08-20T01:31:53.572 INFO:tasks.workunit.client.0.smithi022.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-08-20T01:31:53.619 INFO:tasks.workunit.client.0.smithi022.stdout:checking for sys/types.h... yes 2024-08-20T01:31:53.667 INFO:tasks.workunit.client.0.smithi022.stdout:checking for sys/stat.h... yes 2024-08-20T01:31:53.714 INFO:tasks.workunit.client.0.smithi022.stdout:checking for stdlib.h... yes 2024-08-20T01:31:53.763 INFO:tasks.workunit.client.0.smithi022.stdout:checking for string.h... yes 2024-08-20T01:31:53.813 INFO:tasks.workunit.client.0.smithi022.stdout:checking for memory.h... yes 2024-08-20T01:31:53.938 INFO:tasks.workunit.client.0.smithi022.stdout:checking for strings.h... yes 2024-08-20T01:31:53.986 INFO:tasks.workunit.client.0.smithi022.stdout:checking for inttypes.h... yes 2024-08-20T01:31:54.035 INFO:tasks.workunit.client.0.smithi022.stdout:checking for stdint.h... yes 2024-08-20T01:31:54.087 INFO:tasks.workunit.client.0.smithi022.stdout:checking for unistd.h... yes 2024-08-20T01:31:54.100 INFO:tasks.workunit.client.0.smithi022.stdout:checking for memory.h... (cached) yes 2024-08-20T01:31:54.105 INFO:tasks.workunit.client.0.smithi022.stdout:checking for strings.h... (cached) yes 2024-08-20T01:31:54.110 INFO:tasks.workunit.client.0.smithi022.stdout:checking for unistd.h... (cached) yes 2024-08-20T01:31:54.159 INFO:tasks.workunit.client.0.smithi022.stdout:checking locale.h usability... yes 2024-08-20T01:31:54.182 INFO:tasks.workunit.client.0.smithi022.stdout:checking locale.h presence... yes 2024-08-20T01:31:54.183 INFO:tasks.workunit.client.0.smithi022.stdout:checking for locale.h... yes 2024-08-20T01:31:54.197 INFO:tasks.workunit.client.0.smithi022.stdout:checking for stdlib.h... (cached) yes 2024-08-20T01:31:54.203 INFO:tasks.workunit.client.0.smithi022.stdout:checking for string.h... (cached) yes 2024-08-20T01:31:54.258 INFO:tasks.workunit.client.0.smithi022.stdout:checking sys/socket.h usability... yes 2024-08-20T01:31:54.280 INFO:tasks.workunit.client.0.smithi022.stdout:checking sys/socket.h presence... yes 2024-08-20T01:31:54.280 INFO:tasks.workunit.client.0.smithi022.stdout:checking for sys/socket.h... yes 2024-08-20T01:31:54.337 INFO:tasks.workunit.client.0.smithi022.stdout:checking sys/time.h usability... yes 2024-08-20T01:31:54.357 INFO:tasks.workunit.client.0.smithi022.stdout:checking sys/time.h presence... yes 2024-08-20T01:31:54.358 INFO:tasks.workunit.client.0.smithi022.stdout:checking for sys/time.h... yes 2024-08-20T01:31:54.415 INFO:tasks.workunit.client.0.smithi022.stdout:checking fcntl.h usability... yes 2024-08-20T01:31:54.437 INFO:tasks.workunit.client.0.smithi022.stdout:checking fcntl.h presence... yes 2024-08-20T01:31:54.438 INFO:tasks.workunit.client.0.smithi022.stdout:checking for fcntl.h... yes 2024-08-20T01:31:54.501 INFO:tasks.workunit.client.0.smithi022.stdout:checking sys/fcntl.h usability... yes 2024-08-20T01:31:54.521 INFO:tasks.workunit.client.0.smithi022.stdout:checking sys/fcntl.h presence... yes 2024-08-20T01:31:54.522 INFO:tasks.workunit.client.0.smithi022.stdout:checking for sys/fcntl.h... yes 2024-08-20T01:31:54.601 INFO:tasks.workunit.client.0.smithi022.stdout:checking sys/param.h usability... yes 2024-08-20T01:31:54.623 INFO:tasks.workunit.client.0.smithi022.stdout:checking sys/param.h presence... yes 2024-08-20T01:31:54.623 INFO:tasks.workunit.client.0.smithi022.stdout:checking for sys/param.h... yes 2024-08-20T01:31:54.669 INFO:tasks.workunit.client.0.smithi022.stdout:checking ioctl.h usability... no 2024-08-20T01:31:54.690 INFO:tasks.workunit.client.0.smithi022.stdout:checking ioctl.h presence... no 2024-08-20T01:31:54.690 INFO:tasks.workunit.client.0.smithi022.stdout:checking for ioctl.h... no 2024-08-20T01:31:54.745 INFO:tasks.workunit.client.0.smithi022.stdout:checking sys/ioctl.h usability... yes 2024-08-20T01:31:54.766 INFO:tasks.workunit.client.0.smithi022.stdout:checking sys/ioctl.h presence... yes 2024-08-20T01:31:54.767 INFO:tasks.workunit.client.0.smithi022.stdout:checking for sys/ioctl.h... yes 2024-08-20T01:31:54.817 INFO:tasks.workunit.client.0.smithi022.stdout:checking return type of signal handlers... void 2024-08-20T01:31:54.862 INFO:tasks.workunit.client.0.smithi022.stdout:checking for size_t... yes 2024-08-20T01:31:54.902 INFO:tasks.workunit.client.0.smithi022.stdout:checking for dev_t... yes 2024-08-20T01:31:54.946 INFO:tasks.workunit.client.0.smithi022.stdout:checking for short... yes 2024-08-20T01:31:55.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:54 smithi134 ceph-mon[22511]: pgmap v369: 97 pgs: 97 active+clean; 668 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-08-20T01:31:55.023 INFO:tasks.workunit.client.0.smithi022.stdout:checking size of short... 2 2024-08-20T01:31:55.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:54 smithi077 ceph-mon[22251]: pgmap v369: 97 pgs: 97 active+clean; 668 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-08-20T01:31:55.067 INFO:tasks.workunit.client.0.smithi022.stdout:checking for int... yes 2024-08-20T01:31:55.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:54 smithi022 ceph-mon[18709]: pgmap v369: 97 pgs: 97 active+clean; 668 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-08-20T01:31:55.137 INFO:tasks.workunit.client.0.smithi022.stdout:checking size of int... 4 2024-08-20T01:31:55.182 INFO:tasks.workunit.client.0.smithi022.stdout:checking for long... yes 2024-08-20T01:31:55.252 INFO:tasks.workunit.client.0.smithi022.stdout:checking size of long... 8 2024-08-20T01:31:55.296 INFO:tasks.workunit.client.0.smithi022.stdout:checking for long long... yes 2024-08-20T01:31:55.365 INFO:tasks.workunit.client.0.smithi022.stdout:checking size of long long... 8 2024-08-20T01:31:55.407 INFO:tasks.workunit.client.0.smithi022.stdout:checking for ssize_t... yes 2024-08-20T01:31:55.447 INFO:tasks.workunit.client.0.smithi022.stdout:checking for sig_atomic_t... yes 2024-08-20T01:31:55.498 INFO:tasks.workunit.client.0.smithi022.stdout:checking whether gcc needs -traditional... no 2024-08-20T01:31:55.532 INFO:tasks.workunit.client.0.smithi022.stdout:checking for an ANSI C-conforming const... yes 2024-08-20T01:31:55.556 INFO:tasks.workunit.client.0.smithi022.stdout:checking for inline... inline 2024-08-20T01:31:55.614 INFO:tasks.workunit.client.0.smithi022.stdout:checking for working alloca.h... yes 2024-08-20T01:31:55.661 INFO:tasks.workunit.client.0.smithi022.stdout:checking for alloca... yes 2024-08-20T01:31:55.727 INFO:tasks.workunit.client.0.smithi022.stdout:checking for working memcmp... yes 2024-08-20T01:31:55.783 INFO:tasks.workunit.client.0.smithi022.stdout:checking for strftime... yes 2024-08-20T01:31:55.857 INFO:tasks.workunit.client.0.smithi022.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-08-20T01:31:55.916 INFO:tasks.workunit.client.0.smithi022.stdout:checking whether stat accepts an empty string... no 2024-08-20T01:31:55.971 INFO:tasks.workunit.client.0.smithi022.stdout:checking for vprintf... yes 2024-08-20T01:31:56.029 INFO:tasks.workunit.client.0.smithi022.stdout:checking for _doprnt... no 2024-08-20T01:31:56.051 INFO:tasks.workunit.client.0.smithi022.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-08-20T01:31:56.063 INFO:tasks.workunit.client.0.smithi022.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-08-20T01:31:56.114 INFO:tasks.workunit.client.0.smithi022.stdout:checking for the pthreads library -lpthreads... no 2024-08-20T01:31:56.167 INFO:tasks.workunit.client.0.smithi022.stdout:checking whether pthreads work without any flags... yes 2024-08-20T01:31:56.213 INFO:tasks.workunit.client.0.smithi022.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-08-20T01:31:56.213 INFO:tasks.workunit.client.0.smithi022.stdout:checking if more special flags are required for pthreads... no 2024-08-20T01:31:56.213 INFO:tasks.workunit.client.0.smithi022.stdout:checking for cc_r... gcc 2024-08-20T01:31:56.287 INFO:tasks.workunit.client.0.smithi022.stdout:checking for setrlimit... yes 2024-08-20T01:31:56.348 INFO:tasks.workunit.client.0.smithi022.stdout:checking for setproctitle... no 2024-08-20T01:31:56.406 INFO:tasks.workunit.client.0.smithi022.stdout:checking for getopt_long... yes 2024-08-20T01:31:56.467 INFO:tasks.workunit.client.0.smithi022.stdout:checking for strtoull... yes 2024-08-20T01:31:56.529 INFO:tasks.workunit.client.0.smithi022.stdout:checking for strtoq... yes 2024-08-20T01:31:56.589 INFO:tasks.workunit.client.0.smithi022.stdout:checking for snprintf... yes 2024-08-20T01:31:56.651 INFO:tasks.workunit.client.0.smithi022.stdout:checking for vsnprintf... yes 2024-08-20T01:31:56.740 INFO:tasks.workunit.client.0.smithi022.stdout:checking for vfprintf... yes 2024-08-20T01:31:56.810 INFO:tasks.workunit.client.0.smithi022.stdout:checking for gethostname... yes 2024-08-20T01:31:56.871 INFO:tasks.workunit.client.0.smithi022.stdout:checking for setlocale... yes 2024-08-20T01:31:56.932 INFO:tasks.workunit.client.0.smithi022.stdout:checking for sync... yes 2024-08-20T01:31:56.997 INFO:tasks.workunit.client.0.smithi022.stdout:checking whether snprintf is C99 conformant... done 2024-08-20T01:31:57.008 INFO:tasks.workunit.client.0.smithi022.stdout:configure: creating ./config.status 2024-08-20T01:31:57.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:56 smithi134 ceph-mon[22511]: pgmap v370: 97 pgs: 97 active+clean; 668 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 7 op/s 2024-08-20T01:31:57.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:56 smithi077 ceph-mon[22251]: pgmap v370: 97 pgs: 97 active+clean; 668 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 7 op/s 2024-08-20T01:31:57.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:56 smithi022 ceph-mon[18709]: pgmap v370: 97 pgs: 97 active+clean; 668 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 7 op/s 2024-08-20T01:31:57.164 INFO:tasks.workunit.client.0.smithi022.stdout:config.status: creating Makefile 2024-08-20T01:31:57.181 INFO:tasks.workunit.client.0.smithi022.stdout:config.status: creating src/Makefile 2024-08-20T01:31:57.200 INFO:tasks.workunit.client.0.smithi022.stdout:config.status: creating man/Makefile 2024-08-20T01:31:57.213 INFO:tasks.workunit.client.0.smithi022.stdout:config.status: creating config.h 2024-08-20T01:31:57.267 INFO:tasks.workunit.client.0.smithi022.stdout:config.status: executing depfiles commands 2024-08-20T01:31:57.405 INFO:tasks.workunit.client.0.smithi022.stderr:+ make 2024-08-20T01:31:57.416 INFO:tasks.workunit.client.0.smithi022.stdout:make all-recursive 2024-08-20T01:31:57.418 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-08-20T01:31:57.420 INFO:tasks.workunit.client.0.smithi022.stdout:Making all in src 2024-08-20T01:31:57.427 INFO:tasks.workunit.client.0.smithi022.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-08-20T01:31:57.427 INFO:tasks.workunit.client.0.smithi022.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-08-20T01:31:57.427 INFO:tasks.workunit.client.0.smithi022.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-08-20T01:31:57.537 INFO:tasks.workunit.client.0.smithi022.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-08-20T01:31:57.537 INFO:tasks.workunit.client.0.smithi022.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-08-20T01:31:57.620 INFO:tasks.workunit.client.0.smithi022.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-08-20T01:31:57.621 INFO:tasks.workunit.client.0.smithi022.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-08-20T01:31:57.675 INFO:tasks.workunit.client.0.smithi022.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-08-20T01:31:57.675 INFO:tasks.workunit.client.0.smithi022.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-08-20T01:31:57.729 INFO:tasks.workunit.client.0.smithi022.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-08-20T01:31:57.729 INFO:tasks.workunit.client.0.smithi022.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-08-20T01:31:57.779 INFO:tasks.workunit.client.0.smithi022.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-08-20T01:31:57.779 INFO:tasks.workunit.client.0.smithi022.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-08-20T01:31:57.826 INFO:tasks.workunit.client.0.smithi022.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-08-20T01:31:57.826 INFO:tasks.workunit.client.0.smithi022.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-08-20T01:31:57.901 INFO:tasks.workunit.client.0.smithi022.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-08-20T01:31:57.901 INFO:tasks.workunit.client.0.smithi022.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-08-20T01:31:57.936 INFO:tasks.workunit.client.0.smithi022.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-08-20T01:31:57.936 INFO:tasks.workunit.client.0.smithi022.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-08-20T01:31:57.970 INFO:tasks.workunit.client.0.smithi022.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-08-20T01:31:57.970 INFO:tasks.workunit.client.0.smithi022.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-08-20T01:31:58.008 INFO:tasks.workunit.client.0.smithi022.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-08-20T01:31:58.027 INFO:tasks.workunit.client.0.smithi022.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-08-20T01:31:58.028 INFO:tasks.workunit.client.0.smithi022.stdout:Making all in man 2024-08-20T01:31:58.043 INFO:tasks.workunit.client.0.smithi022.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-08-20T01:31:58.043 INFO:tasks.workunit.client.0.smithi022.stdout:make[2]: Nothing to be done for 'all'. 2024-08-20T01:31:58.043 INFO:tasks.workunit.client.0.smithi022.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-08-20T01:31:58.044 INFO:tasks.workunit.client.0.smithi022.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-08-20T01:31:58.045 INFO:tasks.workunit.client.0.smithi022.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-08-20T01:31:58.045 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-08-20T01:31:58.046 INFO:tasks.workunit.client.0.smithi022.stderr:+ cd src 2024-08-20T01:31:58.046 INFO:tasks.workunit.client.0.smithi022.stderr:+ mkdir blogtest_in 2024-08-20T01:31:58.047 INFO:tasks.workunit.client.0.smithi022.stdout:running blogbench 2024-08-20T01:31:58.048 INFO:tasks.workunit.client.0.smithi022.stderr:+ echo 'running blogbench' 2024-08-20T01:31:58.048 INFO:tasks.workunit.client.0.smithi022.stderr:+ ./blogbench -d blogtest_in 2024-08-20T01:31:58.048 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-08-20T01:31:58.048 INFO:tasks.workunit.client.0.smithi022.stdout:Frequency = 10 secs 2024-08-20T01:31:58.048 INFO:tasks.workunit.client.0.smithi022.stdout:Scratch dir = [blogtest_in] 2024-08-20T01:31:59.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:31:58 smithi134 ceph-mon[22511]: pgmap v371: 97 pgs: 97 active+clean; 2.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 144 KiB/s wr, 14 op/s 2024-08-20T01:31:59.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:31:58 smithi077 ceph-mon[22251]: pgmap v371: 97 pgs: 97 active+clean; 2.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 144 KiB/s wr, 14 op/s 2024-08-20T01:31:59.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:31:58 smithi022 ceph-mon[18709]: pgmap v371: 97 pgs: 97 active+clean; 2.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 144 KiB/s wr, 14 op/s 2024-08-20T01:32:00.018 INFO:tasks.workunit.client.0.smithi022.stdout:Spawning 3 writers... 2024-08-20T01:32:00.018 INFO:tasks.workunit.client.0.smithi022.stdout:Spawning 1 rewriters... 2024-08-20T01:32:00.018 INFO:tasks.workunit.client.0.smithi022.stdout:Spawning 5 commenters... 2024-08-20T01:32:00.019 INFO:tasks.workunit.client.0.smithi022.stdout:Spawning 100 readers... 2024-08-20T01:32:00.021 INFO:tasks.workunit.client.0.smithi022.stdout:Benchmarking for 30 iterations. 2024-08-20T01:32:00.021 INFO:tasks.workunit.client.0.smithi022.stdout:The test will run during 5 minutes. 2024-08-20T01:32:00.021 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-08-20T01:32:00.021 INFO:tasks.workunit.client.0.smithi022.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-08-20T01:32:01.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:00 smithi134 ceph-mon[22511]: pgmap v372: 97 pgs: 97 active+clean; 2.5 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 187 KiB/s wr, 23 op/s 2024-08-20T01:32:01.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:00 smithi077 ceph-mon[22251]: pgmap v372: 97 pgs: 97 active+clean; 2.5 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 187 KiB/s wr, 23 op/s 2024-08-20T01:32:01.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:00 smithi022 ceph-mon[18709]: pgmap v372: 97 pgs: 97 active+clean; 2.5 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 187 KiB/s wr, 23 op/s 2024-08-20T01:32:03.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:02 smithi134 ceph-mon[22511]: pgmap v373: 97 pgs: 97 active+clean; 5.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 512 KiB/s wr, 59 op/s 2024-08-20T01:32:03.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:02 smithi077 ceph-mon[22251]: pgmap v373: 97 pgs: 97 active+clean; 5.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 512 KiB/s wr, 59 op/s 2024-08-20T01:32:03.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:02 smithi022 ceph-mon[18709]: pgmap v373: 97 pgs: 97 active+clean; 5.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 512 KiB/s wr, 59 op/s 2024-08-20T01:32:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.644+0000 7fd9c577b640 1 -- 172.21.15.22:0/1831934063 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c01037f0 msgr2=0x7fd9c0103c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.644+0000 7fd9c577b640 1 --2- 172.21.15.22:0/1831934063 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c01037f0 0x7fd9c0103c70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8009930 tx=0x7fd9a802a420 comp rx=0 tx=0).stop 2024-08-20T01:32:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.644+0000 7fd9c577b640 1 -- 172.21.15.22:0/1831934063 shutdown_connections 2024-08-20T01:32:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.644+0000 7fd9c577b640 1 --2- 172.21.15.22:0/1831934063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9c01041b0 0x7fd9c010ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.644+0000 7fd9c577b640 1 --2- 172.21.15.22:0/1831934063 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c01037f0 0x7fd9c0103c70 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.644+0000 7fd9c577b640 1 --2- 172.21.15.22:0/1831934063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c01026a0 0x7fd9c0102aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.644+0000 7fd9c577b640 1 -- 172.21.15.22:0/1831934063 >> 172.21.15.22:0/1831934063 conn(0x7fd9c00fdf40 msgr2=0x7fd9c0100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.644+0000 7fd9c577b640 1 -- 172.21.15.22:0/1831934063 shutdown_connections 2024-08-20T01:32:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.644+0000 7fd9c577b640 1 -- 172.21.15.22:0/1831934063 wait complete. 2024-08-20T01:32:04.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.645+0000 7fd9c577b640 1 Processor -- start 2024-08-20T01:32:04.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.645+0000 7fd9c577b640 1 -- start start 2024-08-20T01:32:04.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.645+0000 7fd9c577b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c01026a0 0x7fd9c0076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:04.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.645+0000 7fd9c577b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9c01037f0 0x7fd9c0075270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:04.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.645+0000 7fd9c577b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c01041b0 0x7fd9c00757b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:04.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.645+0000 7fd9c577b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c010e3c0 con 0x7fd9c01026a0 2024-08-20T01:32:04.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.645+0000 7fd9c577b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c010e240 con 0x7fd9c01041b0 2024-08-20T01:32:04.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.645+0000 7fd9c577b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c010e540 con 0x7fd9c01037f0 2024-08-20T01:32:04.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.646+0000 7fd9beffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c01026a0 0x7fd9c0076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:04.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.646+0000 7fd9be7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9c01037f0 0x7fd9c0075270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:04.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.646+0000 7fd9beffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c01026a0 0x7fd9c0076a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50936/0 (socket says 172.21.15.22:50936) 2024-08-20T01:32:04.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.646+0000 7fd9beffd640 1 -- 172.21.15.22:0/3535521163 learned_addr learned my addr 172.21.15.22:0/3535521163 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:04.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.646+0000 7fd9bf7fe640 1 --2- 172.21.15.22:0/3535521163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c01041b0 0x7fd9c00757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:04.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.646+0000 7fd9beffd640 1 -- 172.21.15.22:0/3535521163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9c01037f0 msgr2=0x7fd9c0075270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:04.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.646+0000 7fd9beffd640 1 --2- 172.21.15.22:0/3535521163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9c01037f0 0x7fd9c0075270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.646+0000 7fd9beffd640 1 -- 172.21.15.22:0/3535521163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c01041b0 msgr2=0x7fd9c00757b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:04.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.646+0000 7fd9beffd640 1 --2- 172.21.15.22:0/3535521163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c01041b0 0x7fd9c00757b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.646+0000 7fd9beffd640 1 -- 172.21.15.22:0/3535521163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c0075cf0 con 0x7fd9c01026a0 2024-08-20T01:32:04.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.646+0000 7fd9bf7fe640 1 --2- 172.21.15.22:0/3535521163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c01041b0 0x7fd9c00757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:32:04.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.646+0000 7fd9beffd640 1 --2- 172.21.15.22:0/3535521163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c01026a0 0x7fd9c0076a10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000ba50 tx=0x7fd9b000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:04.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.646+0000 7fd9b7fff640 1 -- 172.21.15.22:0/3535521163 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0019070 con 0x7fd9c01026a0 2024-08-20T01:32:04.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.646+0000 7fd9c577b640 1 -- 172.21.15.22:0/3535521163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c0075fe0 con 0x7fd9c01026a0 2024-08-20T01:32:04.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.646+0000 7fd9b7fff640 1 -- 172.21.15.22:0/3535521163 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9b000cbe0 con 0x7fd9c01026a0 2024-08-20T01:32:04.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.646+0000 7fd9b7fff640 1 -- 172.21.15.22:0/3535521163 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00075d0 con 0x7fd9c01026a0 2024-08-20T01:32:04.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.646+0000 7fd9c577b640 1 -- 172.21.15.22:0/3535521163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c01a7610 con 0x7fd9c01026a0 2024-08-20T01:32:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.649+0000 7fd9c8645740 1 Processor -- start 2024-08-20T01:32:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.649+0000 7fd9b7fff640 1 -- 172.21.15.22:0/3535521163 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd9b001c070 con 0x7fd9c01026a0 2024-08-20T01:32:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.649+0000 7fd9c8645740 1 -- start start 2024-08-20T01:32:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.649+0000 7fd9c8645740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 0x5560916f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.649+0000 7fd9c8645740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f4200 0x5560916f65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.649+0000 7fd9c8645740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 0x5560916f9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.649+0000 7fd9c8645740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556091664360 con 0x5560916f18d0 2024-08-20T01:32:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.649+0000 7fd9c8645740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556091653860 con 0x5560916f4200 2024-08-20T01:32:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.649+0000 7fd9c8645740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5560916578a0 con 0x5560916f6c40 2024-08-20T01:32:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.650+0000 7fd9bf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 0x5560916f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.650+0000 7fd9be7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 0x5560916f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.650+0000 7fd9bf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 0x5560916f3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50938/0 (socket says 172.21.15.22:50938) 2024-08-20T01:32:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.650+0000 7fd9bf7fe640 1 -- 172.21.15.22:0/2919184260 learned_addr learned my addr 172.21.15.22:0/2919184260 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.650+0000 7fd9beffd640 1 --2- 172.21.15.22:0/2919184260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f4200 0x5560916f65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.650+0000 7fd9be7fc640 1 -- 172.21.15.22:0/2919184260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f4200 msgr2=0x5560916f65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.650+0000 7fd9be7fc640 1 --2- 172.21.15.22:0/2919184260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f4200 0x5560916f65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.650+0000 7fd9be7fc640 1 -- 172.21.15.22:0/2919184260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 msgr2=0x5560916f3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.650+0000 7fd9be7fc640 1 --2- 172.21.15.22:0/2919184260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 0x5560916f3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.650+0000 7fd9be7fc640 1 -- 172.21.15.22:0/2919184260 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560915fae40 con 0x5560916f6c40 2024-08-20T01:32:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.650+0000 7fd9bf7fe640 1 --2- 172.21.15.22:0/2919184260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 0x5560916f3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:32:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.650+0000 7fd9b7fff640 1 --2- 172.21.15.22:0/3535521163 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9ac0b3bd0 0x7fd9ac0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.650+0000 7fd9be7fc640 1 --2- 172.21.15.22:0/2919184260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 0x5560916f9100 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd9a802a940 tx=0x7fd9a8004200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=710843bde70f8b1c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.650+0000 7fd9bf7fe640 1 --2- 172.21.15.22:0/3535521163 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9ac0b3bd0 0x7fd9ac0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.650+0000 7fd9b57fa640 1 -- 172.21.15.22:0/2919184260 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8035040 con 0x5560916f6c40 2024-08-20T01:32:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.650+0000 7fd9b7fff640 1 -- 172.21.15.22:0/3535521163 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fd9b00e3210 con 0x7fd9c01026a0 2024-08-20T01:32:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.650+0000 7fd9b57fa640 1 -- 172.21.15.22:0/2919184260 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9a80044b0 con 0x5560916f6c40 2024-08-20T01:32:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.650+0000 7fd9b57fa640 1 -- 172.21.15.22:0/2919184260 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8004e60 con 0x5560916f6c40 2024-08-20T01:32:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.651+0000 7fd9bf7fe640 1 --2- 172.21.15.22:0/3535521163 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9ac0b3bd0 0x7fd9ac0b6090 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8012560 tx=0x7fd9b800b640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.651+0000 7fd9c8645740 1 -- 172.21.15.22:0/2919184260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 msgr2=0x5560916f9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.651+0000 7fd9c8645740 1 --2- 172.21.15.22:0/2919184260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 0x5560916f9100 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd9a802a940 tx=0x7fd9a8004200 comp rx=0 tx=0).stop 2024-08-20T01:32:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.651+0000 7fd9c8645740 1 -- 172.21.15.22:0/2919184260 shutdown_connections 2024-08-20T01:32:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.651+0000 7fd9c8645740 1 --2- 172.21.15.22:0/2919184260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 0x5560916f9100 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.651+0000 7fd9c8645740 1 --2- 172.21.15.22:0/2919184260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f4200 0x5560916f65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.651+0000 7fd9c8645740 1 --2- 172.21.15.22:0/2919184260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 0x5560916f3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.651+0000 7fd9c8645740 1 -- 172.21.15.22:0/2919184260 >> 172.21.15.22:0/2919184260 conn(0x5560916eca20 msgr2=0x5560916ed7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.651+0000 7fd9c8645740 1 -- 172.21.15.22:0/2919184260 shutdown_connections 2024-08-20T01:32:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.651+0000 7fd9c8645740 1 -- 172.21.15.22:0/2919184260 wait complete. 2024-08-20T01:32:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.652+0000 7fd9c8645740 1 -- start start 2024-08-20T01:32:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.652+0000 7fd9c8645740 1 Processor -- start 2024-08-20T01:32:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.652+0000 7fd9c8645740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f18d0 0x5560916fafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.652+0000 7fd9c8645740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f4200 0x5560916fb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.652+0000 7fd9c8645740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 0x5560916fc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.652+0000 7fd9c8645740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55609158cab0 con 0x5560916f4200 2024-08-20T01:32:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.652+0000 7fd9c8645740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5560915da780 con 0x5560916f18d0 2024-08-20T01:32:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.652+0000 7fd9c8645740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5560916f9bc0 con 0x5560916f6c40 2024-08-20T01:32:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.652+0000 7fd9c8645740 10 client.0 _ll_register_callbacks cb 0x556091362a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.652+0000 7fd9be7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f4200 0x5560916fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.652+0000 7fd9be7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f4200 0x5560916fb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50950/0 (socket says 172.21.15.22:50950) 2024-08-20T01:32:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.652+0000 7fd9be7fc640 1 -- 172.21.15.22:0/793742491 learned_addr learned my addr 172.21.15.22:0/793742491 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.652+0000 7fd9bf7fe640 1 --2- 172.21.15.22:0/793742491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 0x5560916fc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.652+0000 7fd9beffd640 1 --2- 172.21.15.22:0/793742491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f18d0 0x5560916fafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.652+0000 7fd9be7fc640 1 -- 172.21.15.22:0/793742491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 msgr2=0x5560916fc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.653+0000 7fd9be7fc640 1 --2- 172.21.15.22:0/793742491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 0x5560916fc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.653+0000 7fd9be7fc640 1 -- 172.21.15.22:0/793742491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f18d0 msgr2=0x5560916fafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.653+0000 7fd9be7fc640 1 --2- 172.21.15.22:0/793742491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f18d0 0x5560916fafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.653+0000 7fd9be7fc640 1 -- 172.21.15.22:0/793742491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560913b6790 con 0x5560916f4200 2024-08-20T01:32:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.653+0000 7fd9be7fc640 1 --2- 172.21.15.22:0/793742491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f4200 0x5560916fb640 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8005ab0 tx=0x7fd9a80049a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9569b7c7499c9af9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.653+0000 7fd9a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:32:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.653+0000 7fd9a67fc640 1 -- 172.21.15.22:0/793742491 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8052060 con 0x5560916f4200 2024-08-20T01:32:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.653+0000 7fd9c8645740 1 -- 172.21.15.22:0/793742491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556091602e00 con 0x5560916f4200 2024-08-20T01:32:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.653+0000 7fd9a67fc640 1 -- 172.21.15.22:0/793742491 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fd9a8005010 con 0x5560916f4200 2024-08-20T01:32:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.653+0000 7fd9a67fc640 1 -- 172.21.15.22:0/793742491 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd9a8035070 con 0x5560916f4200 2024-08-20T01:32:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.653+0000 7fd9c8645740 10 client.15552 fetch_fsmap learned FSMap version 25 2024-08-20T01:32:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.653+0000 7fd9c8645740 1 -- 172.21.15.22:0/793742491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55609142f620 con 0x5560916f4200 2024-08-20T01:32:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.653+0000 7fd9a67fc640 1 -- 172.21.15.22:0/793742491 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556091602e00 con 0x5560916f4200 2024-08-20T01:32:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.653+0000 7fd9a67fc640 1 -- 172.21.15.22:0/793742491 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd9a8003bd0 con 0x5560916f4200 2024-08-20T01:32:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.653+0000 7fd9c8645740 10 client.15552 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:32:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.653+0000 7fd9c8645740 10 client.15552 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:32:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.654+0000 7fd9c8645740 20 client.15552 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.654+0000 7fd9c8645740 1 --2- 172.21.15.22:0/793742491 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556091706440 0x556091708830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.654+0000 7fd9c8645740 4 client.15552 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:32:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.654+0000 7fd9c8645740 1 -- 172.21.15.22:0/793742491 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560916662b0 con 0x556091706440 2024-08-20T01:32:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.654+0000 7fd9beffd640 1 --2- 172.21.15.22:0/793742491 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556091706440 0x556091708830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.654+0000 7fd9beffd640 1 --2- 172.21.15.22:0/793742491 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556091706440 0x556091708830 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13e196e4af6ce198 server_cookie=a17c8f5a6b5f30d9 in_seq=0 out_seq=0 2024-08-20T01:32:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.654+0000 7fd9a67fc640 10 client.15552 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.661+0000 7fd9a67fc640 1 -- 172.21.15.22:0/793742491 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5560916662b0 con 0x556091706440 2024-08-20T01:32:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.661+0000 7fd9a67fc640 10 client.15552 handle_command_reply: tid=0 2024-08-20T01:32:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.661+0000 7fd9c8645740 1 client.15552 shutdown 2024-08-20T01:32:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.661+0000 7fd9c8645740 1 -- 172.21.15.22:0/793742491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f4200 msgr2=0x5560916fb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.661+0000 7fd9c8645740 1 --2- 172.21.15.22:0/793742491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f4200 0x5560916fb640 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8005ab0 tx=0x7fd9a80049a0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.661+0000 7fd9c8645740 1 -- 172.21.15.22:0/793742491 shutdown_connections 2024-08-20T01:32:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.661+0000 7fd9c8645740 1 --2- 172.21.15.22:0/793742491 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556091706440 0x556091708830 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.661+0000 7fd9c8645740 1 --2- 172.21.15.22:0/793742491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 0x5560916fc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.661+0000 7fd9c8645740 1 --2- 172.21.15.22:0/793742491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f4200 0x5560916fb640 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.661+0000 7fd9c8645740 1 --2- 172.21.15.22:0/793742491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f18d0 0x5560916fafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.661+0000 7fd9a67fc640 0 client.15552 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.661+0000 7fd9c8645740 1 -- 172.21.15.22:0/793742491 >> 172.21.15.22:0/793742491 conn(0x5560916eca20 msgr2=0x5560916ebae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.661+0000 7fd9c8645740 1 -- 172.21.15.22:0/793742491 shutdown_connections 2024-08-20T01:32:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.661+0000 7fd9c8645740 1 -- 172.21.15.22:0/793742491 wait complete. 2024-08-20T01:32:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.661+0000 7fd9c8645740 20 client.15552 trim_cache size 0 max 16384 2024-08-20T01:32:04.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.676+0000 7fd9c8645740 1 Processor -- start 2024-08-20T01:32:04.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.676+0000 7fd9c8645740 1 -- start start 2024-08-20T01:32:04.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.676+0000 7fd9c8645740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 0x5560916fafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:04.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.676+0000 7fd9c8645740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f4200 0x5560916fb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:04.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.676+0000 7fd9c8645740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 0x5560916eb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.676+0000 7fd9c8645740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c01b2bf0 con 0x5560916f18d0 2024-08-20T01:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.676+0000 7fd9c8645740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c01b04c0 con 0x5560916f4200 2024-08-20T01:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.676+0000 7fd9c8645740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c01ae310 con 0x5560916f6c40 2024-08-20T01:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.676+0000 7fd9beffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 0x5560916fafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.676+0000 7fd9beffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 0x5560916fafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50964/0 (socket says 172.21.15.22:50964) 2024-08-20T01:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.676+0000 7fd9beffd640 1 -- 172.21.15.22:0/778905222 learned_addr learned my addr 172.21.15.22:0/778905222 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.676+0000 7fd9bf7fe640 1 --2- 172.21.15.22:0/778905222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 0x5560916eb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.677+0000 7fd9be7fc640 1 --2- 172.21.15.22:0/778905222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f4200 0x5560916fb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.677+0000 7fd9beffd640 1 -- 172.21.15.22:0/778905222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 msgr2=0x5560916eb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.677+0000 7fd9beffd640 1 --2- 172.21.15.22:0/778905222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 0x5560916eb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.677+0000 7fd9beffd640 1 -- 172.21.15.22:0/778905222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f4200 msgr2=0x5560916fb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.677+0000 7fd9beffd640 1 --2- 172.21.15.22:0/778905222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f4200 0x5560916fb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.677+0000 7fd9beffd640 1 -- 172.21.15.22:0/778905222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560916f6960 con 0x5560916f18d0 2024-08-20T01:32:04.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.677+0000 7fd9beffd640 1 --2- 172.21.15.22:0/778905222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 0x5560916fafa0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00a6250 tx=0x7fd9b00e56f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc754e73011054be server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:04.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.677+0000 7fd9b4ff9640 1 -- 172.21.15.22:0/778905222 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00a9940 con 0x5560916f18d0 2024-08-20T01:32:04.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.677+0000 7fd9b4ff9640 1 -- 172.21.15.22:0/778905222 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9b00a9ce0 con 0x5560916f18d0 2024-08-20T01:32:04.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.677+0000 7fd9b4ff9640 1 -- 172.21.15.22:0/778905222 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b000ce20 con 0x5560916f18d0 2024-08-20T01:32:04.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.678+0000 7fd9c8645740 1 -- 172.21.15.22:0/778905222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 msgr2=0x5560916fafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:04.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.678+0000 7fd9c8645740 1 --2- 172.21.15.22:0/778905222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 0x5560916fafa0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00a6250 tx=0x7fd9b00e56f0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.678+0000 7fd9c8645740 1 -- 172.21.15.22:0/778905222 shutdown_connections 2024-08-20T01:32:04.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.678+0000 7fd9c8645740 1 --2- 172.21.15.22:0/778905222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 0x5560916eb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.678+0000 7fd9c8645740 1 --2- 172.21.15.22:0/778905222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f4200 0x5560916fb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.678+0000 7fd9c8645740 1 --2- 172.21.15.22:0/778905222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 0x5560916fafa0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.678+0000 7fd9c8645740 1 -- 172.21.15.22:0/778905222 >> 172.21.15.22:0/778905222 conn(0x5560916eca20 msgr2=0x5560916f8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.678+0000 7fd9c8645740 1 -- 172.21.15.22:0/778905222 shutdown_connections 2024-08-20T01:32:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.678+0000 7fd9c8645740 1 -- 172.21.15.22:0/778905222 wait complete. 2024-08-20T01:32:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.678+0000 7fd9c8645740 1 -- start start 2024-08-20T01:32:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.678+0000 7fd9c8645740 1 Processor -- start 2024-08-20T01:32:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.678+0000 7fd9c8645740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 0x5560916ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.678+0000 7fd9c8645740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f4200 0x556091700570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.678+0000 7fd9c8645740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 0x556091701140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.678+0000 7fd9c8645740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c01ae980 con 0x5560916f18d0 2024-08-20T01:32:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.678+0000 7fd9c8645740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c01afdf0 con 0x5560916f4200 2024-08-20T01:32:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.678+0000 7fd9c8645740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c01af050 con 0x5560916f6c40 2024-08-20T01:32:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9c8645740 10 client.0 _ll_register_callbacks cb 0x7fd9a80040d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9beffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 0x5560916ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9beffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 0x5560916ffed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50974/0 (socket says 172.21.15.22:50974) 2024-08-20T01:32:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9beffd640 1 -- 172.21.15.22:0/3115305734 learned_addr learned my addr 172.21.15.22:0/3115305734 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9bf7fe640 1 --2- 172.21.15.22:0/3115305734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 0x556091701140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9be7fc640 1 --2- 172.21.15.22:0/3115305734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f4200 0x556091700570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9beffd640 1 -- 172.21.15.22:0/3115305734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 msgr2=0x556091701140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9beffd640 1 --2- 172.21.15.22:0/3115305734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 0x556091701140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9beffd640 1 -- 172.21.15.22:0/3115305734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f4200 msgr2=0x556091700570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9beffd640 1 --2- 172.21.15.22:0/3115305734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f4200 0x556091700570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9beffd640 1 -- 172.21.15.22:0/3115305734 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556091701970 con 0x5560916f18d0 2024-08-20T01:32:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9be7fc640 1 --2- 172.21.15.22:0/3115305734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f4200 0x556091700570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:32:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9beffd640 1 --2- 172.21.15.22:0/3115305734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 0x5560916ffed0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000ba20 tx=0x7fd9b00b3240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648463bd4d503afb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:32:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9a67fc640 1 -- 172.21.15.22:0/3115305734 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00a9940 con 0x5560916f18d0 2024-08-20T01:32:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9a67fc640 1 -- 172.21.15.22:0/3115305734 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fd9b000ce00 con 0x5560916f18d0 2024-08-20T01:32:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9c8645740 1 -- 172.21.15.22:0/3115305734 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9b00a9ce0 con 0x5560916f18d0 2024-08-20T01:32:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9a67fc640 1 -- 172.21.15.22:0/3115305734 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd9b00aa1d0 con 0x5560916f18d0 2024-08-20T01:32:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9c8645740 10 client.15558 fetch_fsmap learned FSMap version 25 2024-08-20T01:32:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.679+0000 7fd9c8645740 1 -- 172.21.15.22:0/3115305734 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556091702ce0 con 0x5560916f18d0 2024-08-20T01:32:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.680+0000 7fd9a67fc640 1 -- 172.21.15.22:0/3115305734 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9b00a9ce0 con 0x5560916f18d0 2024-08-20T01:32:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.680+0000 7fd9a67fc640 1 -- 172.21.15.22:0/3115305734 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd9b00a8ea0 con 0x5560916f18d0 2024-08-20T01:32:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.680+0000 7fd9c8645740 10 client.15558 fetch_fsmap finished waiting for FSMap version 25 2024-08-20T01:32:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.680+0000 7fd9c8645740 10 client.15558 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:32:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.680+0000 7fd9c8645740 20 client.15558 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:04.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.680+0000 7fd9c8645740 1 --2- 172.21.15.22:0/3115305734 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556091771450 0x556091773870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:04.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.680+0000 7fd9c8645740 4 client.15558 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:32:04.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.680+0000 7fd9c8645740 1 -- 172.21.15.22:0/3115305734 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556091661d50 con 0x556091771450 2024-08-20T01:32:04.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.680+0000 7fd9be7fc640 1 --2- 172.21.15.22:0/3115305734 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556091771450 0x556091773870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:04.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.680+0000 7fd9be7fc640 1 --2- 172.21.15.22:0/3115305734 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556091771450 0x556091773870 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=211bdfd355985140 server_cookie=91fd45aecde3e51 in_seq=0 out_seq=0 2024-08-20T01:32:04.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:04.680+0000 7fd9a67fc640 10 client.15558 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:05.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:04 smithi134 ceph-mon[22511]: pgmap v374: 97 pgs: 97 active+clean; 5.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 517 KiB/s wr, 57 op/s 2024-08-20T01:32:05.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:04 smithi077 ceph-mon[22251]: pgmap v374: 97 pgs: 97 active+clean; 5.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 517 KiB/s wr, 57 op/s 2024-08-20T01:32:05.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:04 smithi022 ceph-mon[18709]: pgmap v374: 97 pgs: 97 active+clean; 5.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 517 KiB/s wr, 57 op/s 2024-08-20T01:32:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.876+0000 7fd9a67fc640 1 -- 172.21.15.22:0/3115305734 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556091661d50 con 0x556091771450 2024-08-20T01:32:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.876+0000 7fd9a67fc640 10 client.15558 handle_command_reply: tid=0 2024-08-20T01:32:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.876+0000 7fd9c8645740 1 client.15558 shutdown 2024-08-20T01:32:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.876+0000 7fd9c8645740 1 -- 172.21.15.22:0/3115305734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 msgr2=0x5560916ffed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.876+0000 7fd9c8645740 1 --2- 172.21.15.22:0/3115305734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 0x5560916ffed0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000ba20 tx=0x7fd9b00b3240 comp rx=0 tx=0).stop 2024-08-20T01:32:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9c8645740 1 -- 172.21.15.22:0/3115305734 shutdown_connections 2024-08-20T01:32:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9c8645740 1 --2- 172.21.15.22:0/3115305734 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556091771450 0x556091773870 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9c8645740 1 --2- 172.21.15.22:0/3115305734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5560916f6c40 0x556091701140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:05.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9c8645740 1 --2- 172.21.15.22:0/3115305734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5560916f4200 0x556091700570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:05.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9c8645740 1 --2- 172.21.15.22:0/3115305734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5560916f18d0 0x5560916ffed0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:05.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9a67fc640 0 client.15558 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:05.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9c8645740 1 -- 172.21.15.22:0/3115305734 >> 172.21.15.22:0/3115305734 conn(0x5560916eca20 msgr2=0x5560916f0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:05.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9c8645740 1 -- 172.21.15.22:0/3115305734 shutdown_connections 2024-08-20T01:32:05.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9c8645740 1 -- 172.21.15.22:0/3115305734 wait complete. 2024-08-20T01:32:05.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9c8645740 20 client.15558 trim_cache size 0 max 16384 2024-08-20T01:32:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:32:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:32:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:32:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:32:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9c577b640 1 -- 172.21.15.22:0/3535521163 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9ac0b3bd0 msgr2=0x7fd9ac0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9c577b640 1 --2- 172.21.15.22:0/3535521163 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9ac0b3bd0 0x7fd9ac0b6090 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8012560 tx=0x7fd9b800b640 comp rx=0 tx=0).stop 2024-08-20T01:32:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9c577b640 1 -- 172.21.15.22:0/3535521163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c01026a0 msgr2=0x7fd9c0076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9c577b640 1 --2- 172.21.15.22:0/3535521163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c01026a0 0x7fd9c0076a10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000ba50 tx=0x7fd9b000bf10 comp rx=0 tx=0).stop 2024-08-20T01:32:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9c577b640 1 -- 172.21.15.22:0/3535521163 shutdown_connections 2024-08-20T01:32:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9c577b640 1 --2- 172.21.15.22:0/3535521163 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9ac0b3bd0 0x7fd9ac0b6090 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9c577b640 1 --2- 172.21.15.22:0/3535521163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c01041b0 0x7fd9c00757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9c577b640 1 --2- 172.21.15.22:0/3535521163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9c01037f0 0x7fd9c0075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9c577b640 1 --2- 172.21.15.22:0/3535521163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c01026a0 0x7fd9c0076a10 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.877+0000 7fd9c577b640 1 -- 172.21.15.22:0/3535521163 >> 172.21.15.22:0/3535521163 conn(0x7fd9c00fdf40 msgr2=0x7fd9c0106be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.878+0000 7fd9c577b640 1 -- 172.21.15.22:0/3535521163 shutdown_connections 2024-08-20T01:32:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:05.878+0000 7fd9c577b640 1 -- 172.21.15.22:0/3535521163 wait complete. 2024-08-20T01:32:07.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:06 smithi134 ceph-mon[22511]: pgmap v375: 97 pgs: 97 active+clean; 9.7 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 872 KiB/s wr, 64 op/s 2024-08-20T01:32:07.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:06 smithi077 ceph-mon[22251]: pgmap v375: 97 pgs: 97 active+clean; 9.7 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 872 KiB/s wr, 64 op/s 2024-08-20T01:32:07.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:06 smithi022 ceph-mon[18709]: pgmap v375: 97 pgs: 97 active+clean; 9.7 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 872 KiB/s wr, 64 op/s 2024-08-20T01:32:09.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:08 smithi134 ceph-mon[22511]: pgmap v376: 97 pgs: 97 active+clean; 29 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 270 op/s 2024-08-20T01:32:09.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:08 smithi077 ceph-mon[22251]: pgmap v376: 97 pgs: 97 active+clean; 29 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 270 op/s 2024-08-20T01:32:09.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:08 smithi022 ceph-mon[18709]: pgmap v376: 97 pgs: 97 active+clean; 29 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 270 op/s 2024-08-20T01:32:10.021 INFO:tasks.workunit.client.0.smithi022.stdout: 11 220042 713 167454 711 79510 1450 2024-08-20T01:32:11.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:10 smithi134 ceph-mon[22511]: pgmap v377: 97 pgs: 97 active+clean; 39 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 3.4 MiB/s wr, 433 op/s 2024-08-20T01:32:11.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:10 smithi077 ceph-mon[22251]: pgmap v377: 97 pgs: 97 active+clean; 39 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 3.4 MiB/s wr, 433 op/s 2024-08-20T01:32:11.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:10 smithi022 ceph-mon[18709]: pgmap v377: 97 pgs: 97 active+clean; 39 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 3.4 MiB/s wr, 433 op/s 2024-08-20T01:32:13.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:12 smithi134 ceph-mon[22511]: pgmap v378: 97 pgs: 97 active+clean; 43 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 561 op/s 2024-08-20T01:32:13.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:12 smithi077 ceph-mon[22251]: pgmap v378: 97 pgs: 97 active+clean; 43 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 561 op/s 2024-08-20T01:32:13.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:12 smithi022 ceph-mon[18709]: pgmap v378: 97 pgs: 97 active+clean; 43 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 561 op/s 2024-08-20T01:32:15.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:14 smithi134 ceph-mon[22511]: pgmap v379: 97 pgs: 97 active+clean; 43 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 529 op/s 2024-08-20T01:32:15.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:14 smithi134 ceph-mon[22511]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:32:15.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:14 smithi077 ceph-mon[22251]: pgmap v379: 97 pgs: 97 active+clean; 43 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 529 op/s 2024-08-20T01:32:15.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:14 smithi077 ceph-mon[22251]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:32:15.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:14 smithi022 ceph-mon[18709]: pgmap v379: 97 pgs: 97 active+clean; 43 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 529 op/s 2024-08-20T01:32:15.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:14 smithi022 ceph-mon[18709]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:32:15.187 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:32:15.480 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:32:15.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:15 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:32:15.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:15 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:32:15.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:15 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:32:15.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:15 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:32:15.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:15 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:32:16.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:15 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:32:16.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:15 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:32:16.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:15 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:32:16.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:15 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:32:16.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:15 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:32:16.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:15 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:32:16.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:15 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:32:16.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:15 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:32:16.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:15 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:32:16.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:15 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:32:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.085+0000 7fb2b5c73640 1 -- 172.21.15.22:0/2082889420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2b010a0e0 msgr2=0x7fb2b010a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.085+0000 7fb2b5c73640 1 --2- 172.21.15.22:0/2082889420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2b010a0e0 0x7fb2b010a4c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8005fd0 tx=0x7fb2a802b430 comp rx=0 tx=0).stop 2024-08-20T01:32:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.087+0000 7fb2b5c73640 1 -- 172.21.15.22:0/2082889420 shutdown_connections 2024-08-20T01:32:16.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.087+0000 7fb2b5c73640 1 --2- 172.21.15.22:0/2082889420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2b0113810 0x7fb2b0115c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.087+0000 7fb2b5c73640 1 --2- 172.21.15.22:0/2082889420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b0110ee0 0x7fb2b01132d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.087+0000 7fb2b5c73640 1 --2- 172.21.15.22:0/2082889420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2b010a0e0 0x7fb2b010a4c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.087+0000 7fb2b5c73640 1 -- 172.21.15.22:0/2082889420 >> 172.21.15.22:0/2082889420 conn(0x7fb2b006cca0 msgr2=0x7fb2b006d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:16.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.095+0000 7fb2b5c73640 1 -- 172.21.15.22:0/2082889420 shutdown_connections 2024-08-20T01:32:16.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.095+0000 7fb2b5c73640 1 -- 172.21.15.22:0/2082889420 wait complete. 2024-08-20T01:32:16.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.096+0000 7fb2b5c73640 1 Processor -- start 2024-08-20T01:32:16.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.096+0000 7fb2b5c73640 1 -- start start 2024-08-20T01:32:16.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.096+0000 7fb2b5c73640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b010a0e0 0x7fb2b01a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:16.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.096+0000 7fb2b5c73640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2b0110ee0 0x7fb2b01a4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:16.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.096+0000 7fb2b5c73640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2b0113810 0x7fb2b01a91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:16.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.096+0000 7fb2b5c73640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b0118b50 con 0x7fb2b0113810 2024-08-20T01:32:16.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.096+0000 7fb2b5c73640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b01189d0 con 0x7fb2b0110ee0 2024-08-20T01:32:16.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.096+0000 7fb2b5c73640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b0118cd0 con 0x7fb2b010a0e0 2024-08-20T01:32:16.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.097+0000 7fb2affff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2b0113810 0x7fb2b01a91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:16.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.097+0000 7fb2affff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2b0113810 0x7fb2b01a91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40298/0 (socket says 172.21.15.22:40298) 2024-08-20T01:32:16.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.097+0000 7fb2affff640 1 -- 172.21.15.22:0/3735918608 learned_addr learned my addr 172.21.15.22:0/3735918608 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:16.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.097+0000 7fb2affff640 1 -- 172.21.15.22:0/3735918608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b010a0e0 msgr2=0x7fb2b01a3b10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T01:32:16.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.097+0000 7fb2affff640 1 --2- 172.21.15.22:0/3735918608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b010a0e0 0x7fb2b01a3b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.097+0000 7fb2affff640 1 -- 172.21.15.22:0/3735918608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2b0110ee0 msgr2=0x7fb2b01a4050 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T01:32:16.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.097+0000 7fb2affff640 1 --2- 172.21.15.22:0/3735918608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2b0110ee0 0x7fb2b01a4050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.098+0000 7fb2affff640 1 -- 172.21.15.22:0/3735918608 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b01a99c0 con 0x7fb2b0113810 2024-08-20T01:32:16.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.098+0000 7fb2affff640 1 --2- 172.21.15.22:0/3735918608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2b0113810 0x7fb2b01a91f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400b3f0 tx=0x7fb2a400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:16.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.100+0000 7fb2acff9640 1 -- 172.21.15.22:0/3735918608 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4015020 con 0x7fb2b0113810 2024-08-20T01:32:16.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.100+0000 7fb2acff9640 1 -- 172.21.15.22:0/3735918608 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2a4011ce0 con 0x7fb2b0113810 2024-08-20T01:32:16.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.101+0000 7fb2acff9640 1 -- 172.21.15.22:0/3735918608 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4010de0 con 0x7fb2b0113810 2024-08-20T01:32:16.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.105+0000 7fb2b5c73640 1 -- 172.21.15.22:0/3735918608 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b01a9cb0 con 0x7fb2b0113810 2024-08-20T01:32:16.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.105+0000 7fb2b5c73640 1 -- 172.21.15.22:0/3735918608 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b01b0390 con 0x7fb2b0113810 2024-08-20T01:32:16.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.113+0000 7fb2acff9640 1 -- 172.21.15.22:0/3735918608 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb2a4018020 con 0x7fb2b0113810 2024-08-20T01:32:16.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.116+0000 7fb2b806c740 1 Processor -- start 2024-08-20T01:32:16.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.117+0000 7fb2b806c740 1 -- start start 2024-08-20T01:32:16.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.118+0000 7fb2b806c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e600d0 0x559af1e604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:16.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.118+0000 7fb2b806c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e609f0 0x559af1e6c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:16.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.118+0000 7fb2b806c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e6c980 0x559af1e6ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:16.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.118+0000 7fb2b806c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559af1dce8e0 con 0x559af1e6c980 2024-08-20T01:32:16.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.118+0000 7fb2b806c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559af1dbdde0 con 0x559af1e609f0 2024-08-20T01:32:16.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.118+0000 7fb2b806c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559af1dc1e20 con 0x559af1e600d0 2024-08-20T01:32:16.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.118+0000 7fb2acff9640 1 --2- 172.21.15.22:0/3735918608 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb2980b3d70 0x7fb2980b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:16.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.119+0000 7fb2acff9640 1 -- 172.21.15.22:0/3735918608 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb2a40e3350 con 0x7fb2b0113810 2024-08-20T01:32:16.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.120+0000 7fb2aeffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e600d0 0x559af1e604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:16.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.120+0000 7fb2aeffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e600d0 0x559af1e604b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:54464/0 (socket says 172.21.15.22:54464) 2024-08-20T01:32:16.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.120+0000 7fb2aeffd640 1 -- 172.21.15.22:0/1750190451 learned_addr learned my addr 172.21.15.22:0/1750190451 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:16.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.120+0000 7fb2aeffd640 1 --2- 172.21.15.22:0/1750190451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e6c980 0x559af1e6ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:16.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.120+0000 7fb2affff640 1 --2- 172.21.15.22:0/3735918608 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb2980b3d70 0x7fb2980b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:16.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.120+0000 7fb2aeffd640 1 -- 172.21.15.22:0/1750190451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e609f0 msgr2=0x559af1e6c440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:32:16.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.120+0000 7fb2aeffd640 1 --2- 172.21.15.22:0/1750190451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e609f0 0x559af1e6c440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.120+0000 7fb2aeffd640 1 -- 172.21.15.22:0/1750190451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e6c980 msgr2=0x559af1e6ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:16.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.120+0000 7fb2aeffd640 1 --2- 172.21.15.22:0/1750190451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e6c980 0x559af1e6ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.120+0000 7fb2aeffd640 1 -- 172.21.15.22:0/1750190451 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559af1b1d650 con 0x559af1e600d0 2024-08-20T01:32:16.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.121+0000 7fb2aeffd640 1 --2- 172.21.15.22:0/1750190451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e600d0 0x559af1e604b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0012770 tx=0x7fb2a000d380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b94dfea87a01401 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:16.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.122+0000 7fb295ffb640 1 -- 172.21.15.22:0/1750190451 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a000a650 con 0x559af1e600d0 2024-08-20T01:32:16.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.122+0000 7fb295ffb640 1 -- 172.21.15.22:0/1750190451 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2a000aca0 con 0x559af1e600d0 2024-08-20T01:32:16.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.122+0000 7fb295ffb640 1 -- 172.21.15.22:0/1750190451 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0010c70 con 0x559af1e600d0 2024-08-20T01:32:16.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.123+0000 7fb2b806c740 1 -- 172.21.15.22:0/1750190451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e600d0 msgr2=0x559af1e604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:16.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.123+0000 7fb2b806c740 1 --2- 172.21.15.22:0/1750190451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e600d0 0x559af1e604b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0012770 tx=0x7fb2a000d380 comp rx=0 tx=0).stop 2024-08-20T01:32:16.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.125+0000 7fb2b806c740 1 -- 172.21.15.22:0/1750190451 shutdown_connections 2024-08-20T01:32:16.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.125+0000 7fb2b806c740 1 --2- 172.21.15.22:0/1750190451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e6c980 0x559af1e6ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.125+0000 7fb2b806c740 1 --2- 172.21.15.22:0/1750190451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e609f0 0x559af1e6c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.125+0000 7fb2b806c740 1 --2- 172.21.15.22:0/1750190451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e600d0 0x559af1e604b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.125+0000 7fb2b806c740 1 -- 172.21.15.22:0/1750190451 >> 172.21.15.22:0/1750190451 conn(0x559af1e5df00 msgr2=0x559af1e5f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:16.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.126+0000 7fb2b806c740 1 -- 172.21.15.22:0/1750190451 shutdown_connections 2024-08-20T01:32:16.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.129+0000 7fb2b806c740 1 -- 172.21.15.22:0/1750190451 wait complete. 2024-08-20T01:32:16.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.130+0000 7fb2b806c740 1 -- start start 2024-08-20T01:32:16.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.130+0000 7fb2b806c740 1 Processor -- start 2024-08-20T01:32:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.131+0000 7fb2b806c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e600d0 0x559af1e69940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.131+0000 7fb2b806c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e609f0 0x559af1e69e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.131+0000 7fb2b806c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e6c980 0x559af1e6a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.131+0000 7fb2b806c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559af1c20700 con 0x559af1e609f0 2024-08-20T01:32:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.131+0000 7fb2b806c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559af1d447c0 con 0x559af1e600d0 2024-08-20T01:32:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.131+0000 7fb2b806c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559af1e6f600 con 0x559af1e6c980 2024-08-20T01:32:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.131+0000 7fb2b806c740 10 client.0 _ll_register_callbacks cb 0x559af1db76b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.131+0000 7fb2affff640 1 --2- 172.21.15.22:0/3735918608 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb2980b3d70 0x7fb2980b6230 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4004790 tx=0x7fb2a40046e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.133+0000 7fb2aeffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e6c980 0x559af1e6a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.133+0000 7fb2aeffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e6c980 0x559af1e6a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:54474/0 (socket says 172.21.15.22:54474) 2024-08-20T01:32:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.133+0000 7fb2aeffd640 1 -- 172.21.15.22:0/2259262327 learned_addr learned my addr 172.21.15.22:0/2259262327 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.133+0000 7fb2aeffd640 1 --2- 172.21.15.22:0/2259262327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e600d0 0x559af1e69940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.134+0000 7fb2af7fe640 1 --2- 172.21.15.22:0/2259262327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e609f0 0x559af1e69e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.134+0000 7fb2aeffd640 1 -- 172.21.15.22:0/2259262327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e600d0 msgr2=0x559af1e69940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.134+0000 7fb2aeffd640 1 --2- 172.21.15.22:0/2259262327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e600d0 0x559af1e69940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.134+0000 7fb2aeffd640 1 -- 172.21.15.22:0/2259262327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e609f0 msgr2=0x559af1e69e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.134+0000 7fb2aeffd640 1 --2- 172.21.15.22:0/2259262327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e609f0 0x559af1e69e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.134+0000 7fb2aeffd640 1 -- 172.21.15.22:0/2259262327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559af1e550d0 con 0x559af1e6c980 2024-08-20T01:32:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.134+0000 7fb2af7fe640 1 --2- 172.21.15.22:0/2259262327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e609f0 0x559af1e69e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:32:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.135+0000 7fb2aeffd640 1 --2- 172.21.15.22:0/2259262327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e6c980 0x559af1e6a3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0005f50 tx=0x7fb2a0010730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bece83e3d5329cd1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.135+0000 7fb28effd640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:32:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.136+0000 7fb28effd640 1 -- 172.21.15.22:0/2259262327 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0010e20 con 0x559af1e6c980 2024-08-20T01:32:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.136+0000 7fb2b806c740 1 -- 172.21.15.22:0/2259262327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559af1d6d100 con 0x559af1e6c980 2024-08-20T01:32:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.136+0000 7fb28effd640 1 -- 172.21.15.22:0/2259262327 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb2a0005050 con 0x559af1e6c980 2024-08-20T01:32:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.136+0000 7fb28effd640 1 -- 172.21.15.22:0/2259262327 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb2a0033050 con 0x559af1e6c980 2024-08-20T01:32:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.136+0000 7fb2b806c740 10 client.25183 fetch_fsmap learned FSMap version 26 2024-08-20T01:32:16.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.136+0000 7fb2b806c740 1 -- 172.21.15.22:0/2259262327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559af1e57a80 con 0x559af1e6c980 2024-08-20T01:32:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.140+0000 7fb28effd640 1 -- 172.21.15.22:0/2259262327 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x559af1d6d100 con 0x559af1e6c980 2024-08-20T01:32:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.140+0000 7fb28effd640 1 -- 172.21.15.22:0/2259262327 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fb2a0004bd0 con 0x559af1e6c980 2024-08-20T01:32:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.140+0000 7fb2b806c740 10 client.25183 fetch_fsmap finished waiting for FSMap version 26 2024-08-20T01:32:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.140+0000 7fb2b806c740 10 client.25183 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:32:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.140+0000 7fb2b806c740 20 client.25183 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.140+0000 7fb2b806c740 1 --2- 172.21.15.22:0/2259262327 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559af1e592f0 0x559af1e5b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.140+0000 7fb2b806c740 4 client.25183 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:32:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.140+0000 7fb2b806c740 1 -- 172.21.15.22:0/2259262327 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559af1dd0830 con 0x559af1e592f0 2024-08-20T01:32:16.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.149+0000 7fb2af7fe640 1 --2- 172.21.15.22:0/2259262327 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559af1e592f0 0x559af1e5b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:16.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.158+0000 7fb2af7fe640 1 --2- 172.21.15.22:0/2259262327 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559af1e592f0 0x559af1e5b710 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c7af3ea465cf728 server_cookie=2f5f2a7b6441f9b in_seq=0 out_seq=0 2024-08-20T01:32:16.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.158+0000 7fb28effd640 10 client.25183 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:16.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.163+0000 7fb28effd640 1 -- 172.21.15.22:0/2259262327 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559af1dd0830 con 0x559af1e592f0 2024-08-20T01:32:16.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.163+0000 7fb28effd640 10 client.25183 handle_command_reply: tid=0 2024-08-20T01:32:16.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.163+0000 7fb2b806c740 1 client.25183 shutdown 2024-08-20T01:32:16.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.165+0000 7fb2b806c740 1 -- 172.21.15.22:0/2259262327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e6c980 msgr2=0x559af1e6a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:16.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.165+0000 7fb2b806c740 1 --2- 172.21.15.22:0/2259262327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e6c980 0x559af1e6a3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0005f50 tx=0x7fb2a0010730 comp rx=0 tx=0).stop 2024-08-20T01:32:16.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.165+0000 7fb2b806c740 1 -- 172.21.15.22:0/2259262327 shutdown_connections 2024-08-20T01:32:16.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.165+0000 7fb2b806c740 1 --2- 172.21.15.22:0/2259262327 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559af1e592f0 0x559af1e5b710 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.165+0000 7fb2b806c740 1 --2- 172.21.15.22:0/2259262327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e6c980 0x559af1e6a3c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.165+0000 7fb2b806c740 1 --2- 172.21.15.22:0/2259262327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e609f0 0x559af1e69e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.165+0000 7fb2b806c740 1 --2- 172.21.15.22:0/2259262327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e600d0 0x559af1e69940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.165+0000 7fb2b806c740 1 -- 172.21.15.22:0/2259262327 >> 172.21.15.22:0/2259262327 conn(0x559af1e5df00 msgr2=0x559af1e63aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:16.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.165+0000 7fb28effd640 0 client.25183 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:16.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.165+0000 7fb2b806c740 1 -- 172.21.15.22:0/2259262327 shutdown_connections 2024-08-20T01:32:16.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.165+0000 7fb2b806c740 1 -- 172.21.15.22:0/2259262327 wait complete. 2024-08-20T01:32:16.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.165+0000 7fb2b806c740 20 client.25183 trim_cache size 0 max 16384 2024-08-20T01:32:16.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.205+0000 7fb2b806c740 1 Processor -- start 2024-08-20T01:32:16.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.205+0000 7fb2b806c740 1 -- start start 2024-08-20T01:32:16.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.205+0000 7fb2b806c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e600d0 0x559af1e63df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:16.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.205+0000 7fb2b806c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e609f0 0x559af1e5cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:16.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.205+0000 7fb2b806c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e6c980 0x559af1e5d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:16.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.206+0000 7fb2aeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e600d0 0x559af1e63df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:16.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.206+0000 7fb2aeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e600d0 0x559af1e63df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40328/0 (socket says 172.21.15.22:40328) 2024-08-20T01:32:16.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.206+0000 7fb2af7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e609f0 0x559af1e5cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:16.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.206+0000 7fb2aeffd640 1 -- 172.21.15.22:0/10146599 learned_addr learned my addr 172.21.15.22:0/10146599 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:16.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.206+0000 7fb2b806c740 1 -- 172.21.15.22:0/10146599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b01b6d70 con 0x559af1e600d0 2024-08-20T01:32:16.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.206+0000 7fb2b806c740 1 -- 172.21.15.22:0/10146599 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b01b4640 con 0x559af1e609f0 2024-08-20T01:32:16.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.206+0000 7fb2b806c740 1 -- 172.21.15.22:0/10146599 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b01b24d0 con 0x559af1e6c980 2024-08-20T01:32:16.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.207+0000 7fb2aeffd640 1 --2- 172.21.15.22:0/10146599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e6c980 0x559af1e5d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:16.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.207+0000 7fb2aeffd640 1 -- 172.21.15.22:0/10146599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e6c980 msgr2=0x559af1e5d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:16.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.207+0000 7fb2aeffd640 1 --2- 172.21.15.22:0/10146599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e6c980 0x559af1e5d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.207+0000 7fb2aeffd640 1 -- 172.21.15.22:0/10146599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e609f0 msgr2=0x559af1e5cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:16.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.207+0000 7fb2aeffd640 1 --2- 172.21.15.22:0/10146599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e609f0 0x559af1e5cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.207+0000 7fb2aeffd640 1 -- 172.21.15.22:0/10146599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559af1e67e40 con 0x559af1e600d0 2024-08-20T01:32:16.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.208+0000 7fb2aeffd640 1 --2- 172.21.15.22:0/10146599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e600d0 0x559af1e63df0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0012590 tx=0x7fb2a0012500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee201ea744fde34 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.209+0000 7fb2957fa640 1 -- 172.21.15.22:0/10146599 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a000e350 con 0x559af1e600d0 2024-08-20T01:32:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.210+0000 7fb2957fa640 1 -- 172.21.15.22:0/10146599 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2a003c070 con 0x559af1e600d0 2024-08-20T01:32:16.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.210+0000 7fb2957fa640 1 -- 172.21.15.22:0/10146599 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0005b90 con 0x559af1e600d0 2024-08-20T01:32:16.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.211+0000 7fb2b806c740 1 -- 172.21.15.22:0/10146599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e600d0 msgr2=0x559af1e63df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:16.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.211+0000 7fb2b806c740 1 --2- 172.21.15.22:0/10146599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e600d0 0x559af1e63df0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0012590 tx=0x7fb2a0012500 comp rx=0 tx=0).stop 2024-08-20T01:32:16.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.212+0000 7fb2b806c740 1 -- 172.21.15.22:0/10146599 shutdown_connections 2024-08-20T01:32:16.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.212+0000 7fb2b806c740 1 --2- 172.21.15.22:0/10146599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e6c980 0x559af1e5d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.212+0000 7fb2b806c740 1 --2- 172.21.15.22:0/10146599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e609f0 0x559af1e5cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.212+0000 7fb2b806c740 1 --2- 172.21.15.22:0/10146599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e600d0 0x559af1e63df0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.212+0000 7fb2b806c740 1 -- 172.21.15.22:0/10146599 >> 172.21.15.22:0/10146599 conn(0x559af1e5df00 msgr2=0x559af1e681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:16.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.212+0000 7fb2b806c740 1 -- 172.21.15.22:0/10146599 shutdown_connections 2024-08-20T01:32:16.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.212+0000 7fb2b806c740 1 -- 172.21.15.22:0/10146599 wait complete. 2024-08-20T01:32:16.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.213+0000 7fb2b806c740 1 -- start start 2024-08-20T01:32:16.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.218+0000 7fb2b806c740 1 Processor -- start 2024-08-20T01:32:16.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.219+0000 7fb2b806c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e600d0 0x559af1e8ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:16.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.222+0000 7fb2b806c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e609f0 0x559af1e8f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.223+0000 7fb2b806c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e6c980 0x559af1e8dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.223+0000 7fb2af7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e609f0 0x559af1e8f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.223+0000 7fb2af7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e609f0 0x559af1e8f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:54488/0 (socket says 172.21.15.22:54488) 2024-08-20T01:32:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.223+0000 7fb2aeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e600d0 0x559af1e8ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.224+0000 7fb2aeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e600d0 0x559af1e8ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:45976/0 (socket says 172.21.15.22:45976) 2024-08-20T01:32:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.227+0000 7fb2b806c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b01b2b20 con 0x559af1e6c980 2024-08-20T01:32:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.227+0000 7fb2b806c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b01b3f70 con 0x559af1e600d0 2024-08-20T01:32:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.227+0000 7fb2b806c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b01b31d0 con 0x559af1e609f0 2024-08-20T01:32:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.228+0000 7fb2af7fe640 1 -- 172.21.15.22:0/824010127 learned_addr learned my addr 172.21.15.22:0/824010127 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:16.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.228+0000 7fb2aeffd640 1 -- 172.21.15.22:0/824010127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e609f0 msgr2=0x559af1e8f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:16.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.228+0000 7fb2aeffd640 1 --2- 172.21.15.22:0/824010127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e609f0 0x559af1e8f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.228+0000 7fb2aeffd640 1 -- 172.21.15.22:0/824010127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e6c980 msgr2=0x559af1e8dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:16.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.228+0000 7fb2aeffd640 1 --2- 172.21.15.22:0/824010127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e6c980 0x559af1e8dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.228+0000 7fb2aeffd640 1 -- 172.21.15.22:0/824010127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559af1e8e3e0 con 0x559af1e600d0 2024-08-20T01:32:16.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.229+0000 7fb2b806c740 10 client.0 _ll_register_callbacks cb 0x7fb2a000dd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:16.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.229+0000 7fb2aeffd640 1 --2- 172.21.15.22:0/824010127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e600d0 0x559af1e8ec70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0039040 tx=0x7fb2a000aa20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8f7da050c39037d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:16.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.229+0000 7fb28effd640 10 client.25172 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:32:16.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.229+0000 7fb2b806c740 1 -- 172.21.15.22:0/824010127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2a003c070 con 0x559af1e600d0 2024-08-20T01:32:16.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.229+0000 7fb28effd640 1 -- 172.21.15.22:0/824010127 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a004f050 con 0x559af1e600d0 2024-08-20T01:32:16.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.229+0000 7fb28effd640 1 -- 172.21.15.22:0/824010127 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb2a000ad70 con 0x559af1e600d0 2024-08-20T01:32:16.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.229+0000 7fb28effd640 1 -- 172.21.15.22:0/824010127 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb2a0045070 con 0x559af1e600d0 2024-08-20T01:32:16.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.229+0000 7fb2b806c740 10 client.25172 fetch_fsmap learned FSMap version 26 2024-08-20T01:32:16.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.229+0000 7fb2b806c740 1 -- 172.21.15.22:0/824010127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({fsmap=26}) -- 0x559af1e74370 con 0x559af1e600d0 2024-08-20T01:32:16.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.230+0000 7fb28effd640 1 -- 172.21.15.22:0/824010127 <== mon.2 v2:172.21.15.77:3300/0 4 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fb2a0052020 con 0x559af1e600d0 2024-08-20T01:32:16.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.231+0000 7fb2b806c740 10 client.25172 fetch_fsmap finished waiting for FSMap version 26 2024-08-20T01:32:16.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.231+0000 7fb2b806c740 10 client.25172 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:32:16.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.231+0000 7fb2b806c740 20 client.25172 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.231+0000 7fb2b806c740 1 --2- 172.21.15.22:0/824010127 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559af1e749b0 0x559af1e74dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.231+0000 7fb2b806c740 4 client.25172 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:32:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.231+0000 7fb2b806c740 1 -- 172.21.15.22:0/824010127 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fb2a003c070 con 0x559af1e749b0 2024-08-20T01:32:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.231+0000 7fb2af7fe640 1 --2- 172.21.15.22:0/824010127 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559af1e749b0 0x559af1e74dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.232+0000 7fb2af7fe640 1 --2- 172.21.15.22:0/824010127 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559af1e749b0 0x559af1e74dc0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e42783d22c05619 server_cookie=b9d84600e4598b1c in_seq=0 out_seq=0 2024-08-20T01:32:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.232+0000 7fb28effd640 10 client.25172 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:16.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.235+0000 7fb28effd640 1 -- 172.21.15.22:0/824010127 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7fb2a003c070 con 0x559af1e749b0 2024-08-20T01:32:16.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.236+0000 7fb28effd640 10 client.25172 handle_command_reply: tid=0 2024-08-20T01:32:16.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.236+0000 7fb2b806c740 1 client.25172 shutdown 2024-08-20T01:32:16.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.236+0000 7fb2b806c740 1 -- 172.21.15.22:0/824010127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e600d0 msgr2=0x559af1e8ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:16.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.236+0000 7fb2b806c740 1 --2- 172.21.15.22:0/824010127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e600d0 0x559af1e8ec70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0039040 tx=0x7fb2a000aa20 comp rx=0 tx=0).stop 2024-08-20T01:32:16.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.237+0000 7fb2b806c740 1 -- 172.21.15.22:0/824010127 shutdown_connections 2024-08-20T01:32:16.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.237+0000 7fb2b806c740 1 --2- 172.21.15.22:0/824010127 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559af1e749b0 0x559af1e74dc0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.237+0000 7fb2b806c740 1 --2- 172.21.15.22:0/824010127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559af1e6c980 0x559af1e8dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.237+0000 7fb2b806c740 1 --2- 172.21.15.22:0/824010127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559af1e609f0 0x559af1e8f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.238+0000 7fb2b806c740 1 --2- 172.21.15.22:0/824010127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559af1e600d0 0x559af1e8ec70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.238+0000 7fb2b806c740 1 -- 172.21.15.22:0/824010127 >> 172.21.15.22:0/824010127 conn(0x559af1e5df00 msgr2=0x559af1e53df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:16.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.238+0000 7fb28effd640 0 client.25172 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:16.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.238+0000 7fb2b806c740 1 -- 172.21.15.22:0/824010127 shutdown_connections 2024-08-20T01:32:16.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.238+0000 7fb2b806c740 1 -- 172.21.15.22:0/824010127 wait complete. 2024-08-20T01:32:16.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.238+0000 7fb2b806c740 20 client.25172 trim_cache size 0 max 16384 2024-08-20T01:32:16.244 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:32:16.244 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-08-20T01:32:16.244 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-08-20T01:32:16.244 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:32:16.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.250+0000 7fb2b5c73640 1 -- 172.21.15.22:0/3735918608 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb2980b3d70 msgr2=0x7fb2980b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:16.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.250+0000 7fb2b5c73640 1 --2- 172.21.15.22:0/3735918608 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb2980b3d70 0x7fb2980b6230 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4004790 tx=0x7fb2a40046e0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.250+0000 7fb2b5c73640 1 -- 172.21.15.22:0/3735918608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2b0113810 msgr2=0x7fb2b01a91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:16.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.250+0000 7fb2b5c73640 1 --2- 172.21.15.22:0/3735918608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2b0113810 0x7fb2b01a91f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400b3f0 tx=0x7fb2a400b8b0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.251+0000 7fb2b5c73640 1 -- 172.21.15.22:0/3735918608 shutdown_connections 2024-08-20T01:32:16.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.251+0000 7fb2b5c73640 1 --2- 172.21.15.22:0/3735918608 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb2980b3d70 0x7fb2980b6230 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.251+0000 7fb2b5c73640 1 --2- 172.21.15.22:0/3735918608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2b0113810 0x7fb2b01a91f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.251+0000 7fb2b5c73640 1 --2- 172.21.15.22:0/3735918608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2b0110ee0 0x7fb2b01a4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.251+0000 7fb2b5c73640 1 --2- 172.21.15.22:0/3735918608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b010a0e0 0x7fb2b01a3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:16.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.251+0000 7fb2b5c73640 1 -- 172.21.15.22:0/3735918608 >> 172.21.15.22:0/3735918608 conn(0x7fb2b006cca0 msgr2=0x7fb2b0071260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:16.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.252+0000 7fb2b5c73640 1 -- 172.21.15.22:0/3735918608 shutdown_connections 2024-08-20T01:32:16.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:16.252+0000 7fb2b5c73640 1 -- 172.21.15.22:0/3735918608 wait complete. 2024-08-20T01:32:16.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:16 smithi022 ceph-mon[18709]: pgmap v380: 97 pgs: 97 active+clean; 46 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 543 op/s 2024-08-20T01:32:16.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:16 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:16.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:16 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:16.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:16 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:32:17.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:16 smithi134 ceph-mon[22511]: pgmap v380: 97 pgs: 97 active+clean; 46 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 543 op/s 2024-08-20T01:32:17.015 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:16 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:17.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:16 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:17.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:16 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:32:17.058 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:32:17.059 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:32:17.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:16 smithi077 ceph-mon[22251]: pgmap v380: 97 pgs: 97 active+clean; 46 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 543 op/s 2024-08-20T01:32:17.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:16 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:17.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:16 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:17.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:16 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:32:17.435 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:32:18.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.089+0000 7f25baa97640 1 -- 172.21.15.22:0/1352283607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25b410ce40 msgr2=0x7f25b410f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:18.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.089+0000 7f25baa97640 1 --2- 172.21.15.22:0/1352283607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25b410ce40 0x7f25b410f2a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009ca0 tx=0x7f25ac02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.089+0000 7f25baa97640 1 -- 172.21.15.22:0/1352283607 shutdown_connections 2024-08-20T01:32:18.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.089+0000 7f25baa97640 1 --2- 172.21.15.22:0/1352283607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25b410ce40 0x7f25b410f2a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.089+0000 7f25baa97640 1 --2- 172.21.15.22:0/1352283607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25b4104300 0x7f25b410c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.089+0000 7f25baa97640 1 --2- 172.21.15.22:0/1352283607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25b41039e0 0x7f25b4103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.089+0000 7f25baa97640 1 -- 172.21.15.22:0/1352283607 >> 172.21.15.22:0/1352283607 conn(0x7f25b40fd460 msgr2=0x7f25b40ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:18.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.089+0000 7f25baa97640 1 -- 172.21.15.22:0/1352283607 shutdown_connections 2024-08-20T01:32:18.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.090+0000 7f25baa97640 1 -- 172.21.15.22:0/1352283607 wait complete. 2024-08-20T01:32:18.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.090+0000 7f25baa97640 1 Processor -- start 2024-08-20T01:32:18.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.091+0000 7f25baa97640 1 -- start start 2024-08-20T01:32:18.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.091+0000 7f25baa97640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25b41039e0 0x7f25b4101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:18.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.091+0000 7f25baa97640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25b4104300 0x7f25b4101bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:18.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.091+0000 7f25baa97640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25b410ce40 0x7f25b4102110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:18.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.091+0000 7f25baa97640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f25b4112ab0 con 0x7f25b41039e0 2024-08-20T01:32:18.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.091+0000 7f25baa97640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f25b4112930 con 0x7f25b4104300 2024-08-20T01:32:18.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.091+0000 7f25baa97640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f25b4112c30 con 0x7f25b410ce40 2024-08-20T01:32:18.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.091+0000 7f25b8833640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25b41039e0 0x7f25b4101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:18.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.091+0000 7f25b8833640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25b41039e0 0x7f25b4101690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40356/0 (socket says 172.21.15.22:40356) 2024-08-20T01:32:18.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.091+0000 7f25b8833640 1 -- 172.21.15.22:0/70147032 learned_addr learned my addr 172.21.15.22:0/70147032 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:18.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.091+0000 7f25b9034640 1 --2- 172.21.15.22:0/70147032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25b410ce40 0x7f25b4102110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:18.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.092+0000 7f25b3fff640 1 --2- 172.21.15.22:0/70147032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25b4104300 0x7f25b4101bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:18.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.092+0000 7f25b9034640 1 -- 172.21.15.22:0/70147032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25b4104300 msgr2=0x7f25b4101bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:18.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.092+0000 7f25b9034640 1 --2- 172.21.15.22:0/70147032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25b4104300 0x7f25b4101bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.092+0000 7f25b9034640 1 -- 172.21.15.22:0/70147032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25b41039e0 msgr2=0x7f25b4101690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:18.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.092+0000 7f25b9034640 1 --2- 172.21.15.22:0/70147032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25b41039e0 0x7f25b4101690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.092+0000 7f25b9034640 1 -- 172.21.15.22:0/70147032 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b41a7420 con 0x7f25b410ce40 2024-08-20T01:32:18.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.092+0000 7f25b9034640 1 --2- 172.21.15.22:0/70147032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25b410ce40 0x7f25b4102110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f25ac02ade0 tx=0x7f25ac0316f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:18.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.092+0000 7f25b1ffb640 1 -- 172.21.15.22:0/70147032 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac003b70 con 0x7f25b410ce40 2024-08-20T01:32:18.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.092+0000 7f25baa97640 1 -- 172.21.15.22:0/70147032 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25b41a76b0 con 0x7f25b410ce40 2024-08-20T01:32:18.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.092+0000 7f25b1ffb640 1 -- 172.21.15.22:0/70147032 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25ac003d10 con 0x7f25b410ce40 2024-08-20T01:32:18.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.092+0000 7f25b1ffb640 1 -- 172.21.15.22:0/70147032 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac02fa00 con 0x7f25b410ce40 2024-08-20T01:32:18.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.093+0000 7f25baa97640 1 -- 172.21.15.22:0/70147032 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25b41a7c40 con 0x7f25b410ce40 2024-08-20T01:32:18.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.094+0000 7f25baa97640 1 -- 172.21.15.22:0/70147032 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25b4103dc0 con 0x7f25b410ce40 2024-08-20T01:32:18.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.096+0000 7f25b1ffb640 1 -- 172.21.15.22:0/70147032 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f25ac004b40 con 0x7f25b410ce40 2024-08-20T01:32:18.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.097+0000 7f25b1ffb640 1 --2- 172.21.15.22:0/70147032 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f25a40b3c50 0x7f25a40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:18.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.097+0000 7f25b8833640 1 --2- 172.21.15.22:0/70147032 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f25a40b3c50 0x7f25a40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:18.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.097+0000 7f25b1ffb640 1 -- 172.21.15.22:0/70147032 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f25ac104fe0 con 0x7f25b410ce40 2024-08-20T01:32:18.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.098+0000 7f25b8833640 1 --2- 172.21.15.22:0/70147032 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f25a40b3c50 0x7f25a40b6110 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f25a8005fd0 tx=0x7f25a800b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:18.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.099+0000 7f25b1ffb640 1 -- 172.21.15.22:0/70147032 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f25ac0cc5d0 con 0x7f25b410ce40 2024-08-20T01:32:18.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.362+0000 7f25baa97640 1 -- 172.21.15.22:0/70147032 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25b4102990 con 0x7f25b410ce40 2024-08-20T01:32:18.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.363+0000 7f25b1ffb640 1 -- 172.21.15.22:0/70147032 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11907 (secure 0 0 0) 0x7f25b4102990 con 0x7f25b410ce40 2024-08-20T01:32:18.365 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:32:18.365 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"btime":"2024-08-20T01:32:13:733766+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:32:12.742211+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24565,24575,24586]},"id":1}]} 2024-08-20T01:32:18.365 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 26 2024-08-20T01:32:18.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.366+0000 7f25baa97640 1 -- 172.21.15.22:0/70147032 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f25a40b3c50 msgr2=0x7f25a40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:18.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.366+0000 7f25baa97640 1 --2- 172.21.15.22:0/70147032 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f25a40b3c50 0x7f25a40b6110 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f25a8005fd0 tx=0x7f25a800b480 comp rx=0 tx=0).stop 2024-08-20T01:32:18.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.366+0000 7f25baa97640 1 -- 172.21.15.22:0/70147032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25b410ce40 msgr2=0x7f25b4102110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:18.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.366+0000 7f25baa97640 1 --2- 172.21.15.22:0/70147032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25b410ce40 0x7f25b4102110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f25ac02ade0 tx=0x7f25ac0316f0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.366+0000 7f25baa97640 1 -- 172.21.15.22:0/70147032 shutdown_connections 2024-08-20T01:32:18.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.366+0000 7f25baa97640 1 --2- 172.21.15.22:0/70147032 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f25a40b3c50 0x7f25a40b6110 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.366+0000 7f25baa97640 1 --2- 172.21.15.22:0/70147032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25b410ce40 0x7f25b4102110 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.366+0000 7f25baa97640 1 --2- 172.21.15.22:0/70147032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25b4104300 0x7f25b4101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.366+0000 7f25baa97640 1 --2- 172.21.15.22:0/70147032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25b41039e0 0x7f25b4101690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.366+0000 7f25baa97640 1 -- 172.21.15.22:0/70147032 >> 172.21.15.22:0/70147032 conn(0x7f25b40fd460 msgr2=0x7f25b40fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:18.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.366+0000 7f25baa97640 1 -- 172.21.15.22:0/70147032 shutdown_connections 2024-08-20T01:32:18.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:18.366+0000 7f25baa97640 1 -- 172.21.15.22:0/70147032 wait complete. 2024-08-20T01:32:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.977+0000 7f4f3870d640 1 -- 172.21.15.22:0/494943478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f301015a0 msgr2=0x7f4f301019a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.977+0000 7f4f3870d640 1 --2- 172.21.15.22:0/494943478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f301015a0 0x7f4f301019a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009930 tx=0x7f4f2c02a420 comp rx=0 tx=0).stop 2024-08-20T01:32:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.977+0000 7f4f3870d640 1 -- 172.21.15.22:0/494943478 shutdown_connections 2024-08-20T01:32:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.977+0000 7f4f3870d640 1 --2- 172.21.15.22:0/494943478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f301030b0 0x7f4f30109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.977+0000 7f4f3870d640 1 --2- 172.21.15.22:0/494943478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f301026f0 0x7f4f30102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.977+0000 7f4f3870d640 1 --2- 172.21.15.22:0/494943478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f301015a0 0x7f4f301019a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.977+0000 7f4f3870d640 1 -- 172.21.15.22:0/494943478 >> 172.21.15.22:0/494943478 conn(0x7f4f300fce60 msgr2=0x7f4f300ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.977+0000 7f4f3870d640 1 -- 172.21.15.22:0/494943478 shutdown_connections 2024-08-20T01:32:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.977+0000 7f4f3870d640 1 -- 172.21.15.22:0/494943478 wait complete. 2024-08-20T01:32:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.977+0000 7f4f3870d640 1 Processor -- start 2024-08-20T01:32:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.977+0000 7f4f3870d640 1 -- start start 2024-08-20T01:32:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f3870d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f301015a0 0x7f4f30198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f3870d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f301026f0 0x7f4f301991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f3870d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f301030b0 0x7f4f30199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f3870d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3010d240 con 0x7f4f301015a0 2024-08-20T01:32:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f3870d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3010d0c0 con 0x7f4f301030b0 2024-08-20T01:32:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f3870d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3010d3c0 con 0x7f4f301026f0 2024-08-20T01:32:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f364a9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f301015a0 0x7f4f30198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f364a9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f301015a0 0x7f4f30198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40382/0 (socket says 172.21.15.22:40382) 2024-08-20T01:32:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f364a9640 1 -- 172.21.15.22:0/2876878946 learned_addr learned my addr 172.21.15.22:0/2876878946 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f35ca8640 1 --2- 172.21.15.22:0/2876878946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f301026f0 0x7f4f301991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f36caa640 1 --2- 172.21.15.22:0/2876878946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f301030b0 0x7f4f30199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f364a9640 1 -- 172.21.15.22:0/2876878946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f301026f0 msgr2=0x7f4f301991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f364a9640 1 --2- 172.21.15.22:0/2876878946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f301026f0 0x7f4f301991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f364a9640 1 -- 172.21.15.22:0/2876878946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f301030b0 msgr2=0x7f4f30199da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f364a9640 1 --2- 172.21.15.22:0/2876878946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f301030b0 0x7f4f30199da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f364a9640 1 -- 172.21.15.22:0/2876878946 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f3019a660 con 0x7f4f301015a0 2024-08-20T01:32:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f364a9640 1 --2- 172.21.15.22:0/2876878946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f301015a0 0x7f4f30198b90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c031500 tx=0x7f4f2c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f277fe640 1 -- 172.21.15.22:0/2876878946 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c03f070 con 0x7f4f301015a0 2024-08-20T01:32:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f277fe640 1 -- 172.21.15.22:0/2876878946 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f2c031c60 con 0x7f4f301015a0 2024-08-20T01:32:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f3870d640 1 -- 172.21.15.22:0/2876878946 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f3019a8f0 con 0x7f4f301015a0 2024-08-20T01:32:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.978+0000 7f4f277fe640 1 -- 172.21.15.22:0/2876878946 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c035030 con 0x7f4f301015a0 2024-08-20T01:32:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.979+0000 7f4f3870d640 1 -- 172.21.15.22:0/2876878946 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f301a1020 con 0x7f4f301015a0 2024-08-20T01:32:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.981+0000 7f4f277fe640 1 -- 172.21.15.22:0/2876878946 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4f2c042070 con 0x7f4f301015a0 2024-08-20T01:32:18.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.982+0000 7f4f277fe640 1 --2- 172.21.15.22:0/2876878946 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4f1c0b3c50 0x7f4f1c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:18.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.982+0000 7f4f277fe640 1 -- 172.21.15.22:0/2876878946 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f4f2c104630 con 0x7f4f301015a0 2024-08-20T01:32:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.982+0000 7f4f35ca8640 1 --2- 172.21.15.22:0/2876878946 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4f1c0b3c50 0x7f4f1c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.983+0000 7f4f3b5d1740 1 Processor -- start 2024-08-20T01:32:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.983+0000 7f4f35ca8640 1 --2- 172.21.15.22:0/2876878946 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4f1c0b3c50 0x7f4f1c0b6110 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009bd0 tx=0x7f4f20005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.983+0000 7f4f3b5d1740 1 -- start start 2024-08-20T01:32:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.983+0000 7f4f3b5d1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd0518d0 0x557dcd053cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.983+0000 7f4f3b5d1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd054200 0x557dcd0565f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.983+0000 7f4f3b5d1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd056c40 0x557dcd059100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.983+0000 7f4f3b5d1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557dccfc4360 con 0x557dcd056c40 2024-08-20T01:32:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.983+0000 7f4f3b5d1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557dccfb3860 con 0x557dcd0518d0 2024-08-20T01:32:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.983+0000 7f4f3b5d1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557dccfb78a0 con 0x557dcd054200 2024-08-20T01:32:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.983+0000 7f4f35ca8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd054200 0x557dcd0565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.983+0000 7f4f35ca8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd054200 0x557dcd0565f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:54528/0 (socket says 172.21.15.22:54528) 2024-08-20T01:32:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.983+0000 7f4f36caa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd056c40 0x557dcd059100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.983+0000 7f4f35ca8640 1 -- 172.21.15.22:0/1950162639 learned_addr learned my addr 172.21.15.22:0/1950162639 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.983+0000 7f4f364a9640 1 --2- 172.21.15.22:0/1950162639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd0518d0 0x557dcd053cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.984+0000 7f4f35ca8640 1 -- 172.21.15.22:0/1950162639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd0518d0 msgr2=0x557dcd053cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.984+0000 7f4f35ca8640 1 --2- 172.21.15.22:0/1950162639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd0518d0 0x557dcd053cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.984+0000 7f4f35ca8640 1 -- 172.21.15.22:0/1950162639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd056c40 msgr2=0x557dcd059100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.984+0000 7f4f35ca8640 1 --2- 172.21.15.22:0/1950162639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd056c40 0x557dcd059100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.984+0000 7f4f35ca8640 1 -- 172.21.15.22:0/1950162639 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dccf5ae40 con 0x557dcd054200 2024-08-20T01:32:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.984+0000 7f4f364a9640 1 --2- 172.21.15.22:0/1950162639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd0518d0 0x557dcd053cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:32:18.987 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.984+0000 7f4f35ca8640 1 --2- 172.21.15.22:0/1950162639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd054200 0x557dcd0565f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000e630 tx=0x7f4f20014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4797f40773d1063 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:18.987 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.984+0000 7f4f24ff9640 1 -- 172.21.15.22:0/1950162639 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f20004020 con 0x557dcd054200 2024-08-20T01:32:18.987 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.984+0000 7f4f24ff9640 1 -- 172.21.15.22:0/1950162639 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f200041c0 con 0x557dcd054200 2024-08-20T01:32:18.987 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.984+0000 7f4f24ff9640 1 -- 172.21.15.22:0/1950162639 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2001c650 con 0x557dcd054200 2024-08-20T01:32:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.985+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/1950162639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd054200 msgr2=0x557dcd0565f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.985+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/1950162639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd054200 0x557dcd0565f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000e630 tx=0x7f4f20014000 comp rx=0 tx=0).stop 2024-08-20T01:32:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.985+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/1950162639 shutdown_connections 2024-08-20T01:32:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.985+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/1950162639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd056c40 0x557dcd059100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.985+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/1950162639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd054200 0x557dcd0565f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.985+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/1950162639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd0518d0 0x557dcd053cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.985+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/1950162639 >> 172.21.15.22:0/1950162639 conn(0x557dcd04ca20 msgr2=0x557dcd04d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.985+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/1950162639 shutdown_connections 2024-08-20T01:32:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.985+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/1950162639 wait complete. 2024-08-20T01:32:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.986+0000 7f4f3b5d1740 1 -- start start 2024-08-20T01:32:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.986+0000 7f4f3b5d1740 1 Processor -- start 2024-08-20T01:32:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.986+0000 7f4f3b5d1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd0518d0 0x557dcd05b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.986+0000 7f4f3b5d1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd054200 0x557dcd05b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.986+0000 7f4f3b5d1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd056c40 0x557dcd05c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.986+0000 7f4f3b5d1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557dcceecab0 con 0x557dcd056c40 2024-08-20T01:32:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.986+0000 7f4f3b5d1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557dccf3a780 con 0x557dcd0518d0 2024-08-20T01:32:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.986+0000 7f4f3b5d1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557dcd059c20 con 0x557dcd054200 2024-08-20T01:32:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.986+0000 7f4f3b5d1740 10 client.0 _ll_register_callbacks cb 0x557dcccc2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.986+0000 7f4f36caa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd056c40 0x557dcd05c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.986+0000 7f4f36caa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd056c40 0x557dcd05c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40388/0 (socket says 172.21.15.22:40388) 2024-08-20T01:32:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.986+0000 7f4f35ca8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd054200 0x557dcd05b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.986+0000 7f4f36caa640 1 -- 172.21.15.22:0/1279549706 learned_addr learned my addr 172.21.15.22:0/1279549706 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.987+0000 7f4f364a9640 1 --2- 172.21.15.22:0/1279549706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd0518d0 0x557dcd05b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.987+0000 7f4f36caa640 1 -- 172.21.15.22:0/1279549706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd054200 msgr2=0x557dcd05b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.987+0000 7f4f36caa640 1 --2- 172.21.15.22:0/1279549706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd054200 0x557dcd05b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.987+0000 7f4f36caa640 1 -- 172.21.15.22:0/1279549706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd0518d0 msgr2=0x557dcd05b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.987+0000 7f4f36caa640 1 --2- 172.21.15.22:0/1279549706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd0518d0 0x557dcd05b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.987+0000 7f4f36caa640 1 -- 172.21.15.22:0/1279549706 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dccd16790 con 0x557dcd056c40 2024-08-20T01:32:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.987+0000 7f4f35ca8640 1 --2- 172.21.15.22:0/1279549706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd054200 0x557dcd05b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:32:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.987+0000 7f4f364a9640 1 --2- 172.21.15.22:0/1279549706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd0518d0 0x557dcd05b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:32:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.987+0000 7f4f36caa640 1 --2- 172.21.15.22:0/1279549706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd056c40 0x557dcd05c330 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4f28013d30 tx=0x7f4f280117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe19fd17c00a47b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.987+0000 7f4f19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:32:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.987+0000 7f4f19ffb640 1 -- 172.21.15.22:0/1279549706 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f28003b70 con 0x557dcd056c40 2024-08-20T01:32:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.987+0000 7f4f19ffb640 1 -- 172.21.15.22:0/1279549706 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f4f28003d10 con 0x557dcd056c40 2024-08-20T01:32:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.987+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/1279549706 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557dccf62e00 con 0x557dcd056c40 2024-08-20T01:32:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.987+0000 7f4f19ffb640 1 -- 172.21.15.22:0/1279549706 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4f28004050 con 0x557dcd056c40 2024-08-20T01:32:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.987+0000 7f4f3b5d1740 10 client.15588 fetch_fsmap learned FSMap version 27 2024-08-20T01:32:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.987+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/1279549706 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557dccd8f620 con 0x557dcd056c40 2024-08-20T01:32:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.987+0000 7f4f19ffb640 1 -- 172.21.15.22:0/1279549706 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557dccf62e00 con 0x557dcd056c40 2024-08-20T01:32:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.988+0000 7f4f19ffb640 1 -- 172.21.15.22:0/1279549706 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f4f2801a020 con 0x557dcd056c40 2024-08-20T01:32:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.988+0000 7f4f3b5d1740 10 client.15588 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:32:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.988+0000 7f4f3b5d1740 10 client.15588 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:32:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.988+0000 7f4f3b5d1740 20 client.15588 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.988+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/1279549706 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557dcd066a20 0x557dcd068e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.988+0000 7f4f3b5d1740 4 client.15588 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:32:18.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.988+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/1279549706 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557dccfc62b0 con 0x557dcd066a20 2024-08-20T01:32:18.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.988+0000 7f4f364a9640 1 --2- 172.21.15.22:0/1279549706 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557dcd066a20 0x557dcd068e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:18.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.988+0000 7f4f19ffb640 10 client.15588 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:18.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.988+0000 7f4f364a9640 1 --2- 172.21.15.22:0/1279549706 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557dcd066a20 0x557dcd068e50 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5372afbfcf51e19 server_cookie=915e98e6ed98c86e in_seq=0 out_seq=0 2024-08-20T01:32:18.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.992+0000 7f4f19ffb640 1 -- 172.21.15.22:0/1279549706 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557dccfc62b0 con 0x557dcd066a20 2024-08-20T01:32:18.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.992+0000 7f4f19ffb640 10 client.15588 handle_command_reply: tid=0 2024-08-20T01:32:18.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.992+0000 7f4f3b5d1740 1 client.15588 shutdown 2024-08-20T01:32:18.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.992+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/1279549706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd056c40 msgr2=0x557dcd05c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.992+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/1279549706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd056c40 0x557dcd05c330 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4f28013d30 tx=0x7f4f280117b0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.992+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/1279549706 shutdown_connections 2024-08-20T01:32:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.992+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/1279549706 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557dcd066a20 0x557dcd068e50 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.992+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/1279549706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd056c40 0x557dcd05c330 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.992+0000 7f4f19ffb640 0 client.15588 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.992+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/1279549706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd054200 0x557dcd05b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.992+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/1279549706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd0518d0 0x557dcd05b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.992+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/1279549706 >> 172.21.15.22:0/1279549706 conn(0x557dcd04ca20 msgr2=0x557dcd04bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.992+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/1279549706 shutdown_connections 2024-08-20T01:32:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.992+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/1279549706 wait complete. 2024-08-20T01:32:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:18.992+0000 7f4f3b5d1740 20 client.15588 trim_cache size 0 max 16384 2024-08-20T01:32:19.010 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.007+0000 7f4f3b5d1740 1 Processor -- start 2024-08-20T01:32:19.011 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.007+0000 7f4f3b5d1740 1 -- start start 2024-08-20T01:32:19.011 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.008+0000 7f4f3b5d1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd0518d0 0x557dcd05a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:19.011 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.008+0000 7f4f3b5d1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd054200 0x557dcd05a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:19.011 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.008+0000 7f4f3b5d1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd056c40 0x557dcd057020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:19.011 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.008+0000 7f4f3b5d1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4f301ac690 con 0x557dcd054200 2024-08-20T01:32:19.011 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.008+0000 7f4f3b5d1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4f301a9f60 con 0x557dcd056c40 2024-08-20T01:32:19.011 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.008+0000 7f4f3b5d1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4f301a7db0 con 0x557dcd0518d0 2024-08-20T01:32:19.011 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.008+0000 7f4f35ca8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd054200 0x557dcd05a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:19.011 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.008+0000 7f4f35ca8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd054200 0x557dcd05a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40392/0 (socket says 172.21.15.22:40392) 2024-08-20T01:32:19.011 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.008+0000 7f4f35ca8640 1 -- 172.21.15.22:0/3387554075 learned_addr learned my addr 172.21.15.22:0/3387554075 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:19.011 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.008+0000 7f4f364a9640 1 --2- 172.21.15.22:0/3387554075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd0518d0 0x557dcd05a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:19.011 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.008+0000 7f4f36caa640 1 --2- 172.21.15.22:0/3387554075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd056c40 0x557dcd057020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:19.011 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.008+0000 7f4f35ca8640 1 -- 172.21.15.22:0/3387554075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd0518d0 msgr2=0x557dcd05a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:19.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.008+0000 7f4f35ca8640 1 --2- 172.21.15.22:0/3387554075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd0518d0 0x557dcd05a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:19.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.008+0000 7f4f35ca8640 1 -- 172.21.15.22:0/3387554075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd056c40 msgr2=0x557dcd057020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:19.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.008+0000 7f4f35ca8640 1 --2- 172.21.15.22:0/3387554075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd056c40 0x557dcd057020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:19.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.008+0000 7f4f35ca8640 1 -- 172.21.15.22:0/3387554075 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dcd054030 con 0x557dcd054200 2024-08-20T01:32:19.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.008+0000 7f4f35ca8640 1 --2- 172.21.15.22:0/3387554075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd054200 0x557dcd05a7a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000e5d0 tx=0x7f4f2000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de65ecc871c7a1f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:19.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.008+0000 7f4f1bfff640 1 -- 172.21.15.22:0/3387554075 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f20005270 con 0x557dcd054200 2024-08-20T01:32:19.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.008+0000 7f4f1bfff640 1 -- 172.21.15.22:0/3387554075 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f20003e50 con 0x557dcd054200 2024-08-20T01:32:19.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.009+0000 7f4f1bfff640 1 -- 172.21.15.22:0/3387554075 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f200266e0 con 0x557dcd054200 2024-08-20T01:32:19.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.009+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/3387554075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd054200 msgr2=0x557dcd05a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:19.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.009+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/3387554075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd054200 0x557dcd05a7a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000e5d0 tx=0x7f4f2000ef60 comp rx=0 tx=0).stop 2024-08-20T01:32:19.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.009+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/3387554075 shutdown_connections 2024-08-20T01:32:19.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.009+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/3387554075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd056c40 0x557dcd057020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:19.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.009+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/3387554075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd054200 0x557dcd05a7a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:19.013 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.009+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/3387554075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd0518d0 0x557dcd05a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:19.013 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.009+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/3387554075 >> 172.21.15.22:0/3387554075 conn(0x557dcd04ca20 msgr2=0x557dcd0586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:19.013 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.009+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/3387554075 shutdown_connections 2024-08-20T01:32:19.013 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.009+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/3387554075 wait complete. 2024-08-20T01:32:19.013 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.010+0000 7f4f3b5d1740 1 -- start start 2024-08-20T01:32:19.013 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.010+0000 7f4f3b5d1740 1 Processor -- start 2024-08-20T01:32:19.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.010+0000 7f4f3b5d1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd0518d0 0x557dcd0628f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:19.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.010+0000 7f4f3b5d1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd054200 0x557dcd0615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.010+0000 7f4f3b5d1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd056c40 0x557dcd061b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.010+0000 7f4f3b5d1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4f301a8420 con 0x557dcd0518d0 2024-08-20T01:32:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.010+0000 7f4f3b5d1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4f301a9890 con 0x557dcd054200 2024-08-20T01:32:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.010+0000 7f4f3b5d1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4f301a8af0 con 0x557dcd056c40 2024-08-20T01:32:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.010+0000 7f4f3b5d1740 10 client.0 _ll_register_callbacks cb 0x7f4f28009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.010+0000 7f4f364a9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd0518d0 0x557dcd0628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.010+0000 7f4f364a9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd0518d0 0x557dcd0628f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40394/0 (socket says 172.21.15.22:40394) 2024-08-20T01:32:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.010+0000 7f4f364a9640 1 -- 172.21.15.22:0/4207764259 learned_addr learned my addr 172.21.15.22:0/4207764259 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.010+0000 7f4f36caa640 1 --2- 172.21.15.22:0/4207764259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd056c40 0x557dcd061b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.010+0000 7f4f35ca8640 1 --2- 172.21.15.22:0/4207764259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd054200 0x557dcd0615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.011+0000 7f4f364a9640 1 -- 172.21.15.22:0/4207764259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd056c40 msgr2=0x557dcd061b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.011+0000 7f4f364a9640 1 --2- 172.21.15.22:0/4207764259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd056c40 0x557dcd061b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.011+0000 7f4f364a9640 1 -- 172.21.15.22:0/4207764259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd054200 msgr2=0x557dcd0615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.011+0000 7f4f364a9640 1 --2- 172.21.15.22:0/4207764259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd054200 0x557dcd0615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:19.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.011+0000 7f4f364a9640 1 -- 172.21.15.22:0/4207764259 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dcd056960 con 0x557dcd0518d0 2024-08-20T01:32:19.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.011+0000 7f4f364a9640 1 --2- 172.21.15.22:0/4207764259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd0518d0 0x557dcd0628f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0cb580 tx=0x7f4f2c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd76942212179b12 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:19.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.011+0000 7f4f19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:32:19.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.011+0000 7f4f19ffb640 1 -- 172.21.15.22:0/4207764259 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c049040 con 0x557dcd0518d0 2024-08-20T01:32:19.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.011+0000 7f4f19ffb640 1 -- 172.21.15.22:0/4207764259 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f4f2c0cb850 con 0x557dcd0518d0 2024-08-20T01:32:19.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.011+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/4207764259 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f20003e50 con 0x557dcd0518d0 2024-08-20T01:32:19.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.011+0000 7f4f19ffb640 1 -- 172.21.15.22:0/4207764259 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4f2c0e9050 con 0x557dcd0518d0 2024-08-20T01:32:19.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.011+0000 7f4f3b5d1740 10 client.15594 fetch_fsmap learned FSMap version 27 2024-08-20T01:32:19.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.011+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/4207764259 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557dcd060db0 con 0x557dcd0518d0 2024-08-20T01:32:19.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.011+0000 7f4f19ffb640 1 -- 172.21.15.22:0/4207764259 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f20003e50 con 0x557dcd0518d0 2024-08-20T01:32:19.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.012+0000 7f4f19ffb640 1 -- 172.21.15.22:0/4207764259 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f4f2c03b460 con 0x557dcd0518d0 2024-08-20T01:32:19.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.012+0000 7f4f3b5d1740 10 client.15594 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:32:19.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.012+0000 7f4f3b5d1740 10 client.15594 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:32:19.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.012+0000 7f4f3b5d1740 20 client.15594 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:19.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.012+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/4207764259 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557dcd0d1dd0 0x557dcd0d41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:19.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.012+0000 7f4f3b5d1740 4 client.15594 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:32:19.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.012+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/4207764259 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557dccfc1d50 con 0x557dcd0d1dd0 2024-08-20T01:32:19.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.012+0000 7f4f35ca8640 1 --2- 172.21.15.22:0/4207764259 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557dcd0d1dd0 0x557dcd0d41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:19.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.012+0000 7f4f19ffb640 10 client.15594 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:19.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:19.012+0000 7f4f35ca8640 1 --2- 172.21.15.22:0/4207764259 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557dcd0d1dd0 0x557dcd0d41f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=642a0be9f841dea1 server_cookie=756638ffbeb93aab in_seq=0 out_seq=0 2024-08-20T01:32:19.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:18 smithi134 ceph-mon[22511]: pgmap v381: 97 pgs: 97 active+clean; 54 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.0 MiB/s wr, 557 op/s 2024-08-20T01:32:19.018 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:18 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/70147032' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:32:19.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:18 smithi077 ceph-mon[22251]: pgmap v381: 97 pgs: 97 active+clean; 54 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.0 MiB/s wr, 557 op/s 2024-08-20T01:32:19.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:18 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/70147032' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:32:19.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:18 smithi022 ceph-mon[18709]: pgmap v381: 97 pgs: 97 active+clean; 54 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.0 MiB/s wr, 557 op/s 2024-08-20T01:32:19.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:18 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/70147032' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:32:19.358 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:32:19.823 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:32:20.021 INFO:tasks.workunit.client.0.smithi022.stdout: 26 710295 1040 570148 864 277480 910 2024-08-20T01:32:20.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:19 smithi077 ceph-mon[22251]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:32:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.088+0000 7f4f19ffb640 1 -- 172.21.15.22:0/4207764259 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557dccfc1d50 con 0x557dcd0d1dd0 2024-08-20T01:32:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.088+0000 7f4f19ffb640 10 client.15594 handle_command_reply: tid=0 2024-08-20T01:32:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.088+0000 7f4f3b5d1740 1 client.15594 shutdown 2024-08-20T01:32:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.088+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/4207764259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd0518d0 msgr2=0x557dcd0628f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.088+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/4207764259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd0518d0 0x557dcd0628f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0cb580 tx=0x7f4f2c009260 comp rx=0 tx=0).stop 2024-08-20T01:32:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.088+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/4207764259 shutdown_connections 2024-08-20T01:32:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.088+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/4207764259 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557dcd0d1dd0 0x557dcd0d41f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.088+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/4207764259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dcd056c40 0x557dcd061b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.088+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/4207764259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557dcd054200 0x557dcd0615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.088+0000 7f4f19ffb640 0 client.15594 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.088+0000 7f4f3b5d1740 1 --2- 172.21.15.22:0/4207764259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557dcd0518d0 0x557dcd0628f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.088+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/4207764259 >> 172.21.15.22:0/4207764259 conn(0x557dcd04ca20 msgr2=0x557dcd0509f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.088+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/4207764259 shutdown_connections 2024-08-20T01:32:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.089+0000 7f4f3b5d1740 1 -- 172.21.15.22:0/4207764259 wait complete. 2024-08-20T01:32:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.089+0000 7f4f3b5d1740 20 client.15594 trim_cache size 0 max 16384 2024-08-20T01:32:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:32:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:32:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:32:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:32:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.089+0000 7f4f3870d640 1 -- 172.21.15.22:0/2876878946 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4f1c0b3c50 msgr2=0x7f4f1c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.089+0000 7f4f3870d640 1 --2- 172.21.15.22:0/2876878946 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4f1c0b3c50 0x7f4f1c0b6110 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009bd0 tx=0x7f4f20005f90 comp rx=0 tx=0).stop 2024-08-20T01:32:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.089+0000 7f4f3870d640 1 -- 172.21.15.22:0/2876878946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f301015a0 msgr2=0x7f4f30198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.089+0000 7f4f3870d640 1 --2- 172.21.15.22:0/2876878946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f301015a0 0x7f4f30198b90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c031500 tx=0x7f4f2c003c10 comp rx=0 tx=0).stop 2024-08-20T01:32:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.089+0000 7f4f3870d640 1 -- 172.21.15.22:0/2876878946 shutdown_connections 2024-08-20T01:32:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.089+0000 7f4f3870d640 1 --2- 172.21.15.22:0/2876878946 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4f1c0b3c50 0x7f4f1c0b6110 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.089+0000 7f4f3870d640 1 --2- 172.21.15.22:0/2876878946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f301030b0 0x7f4f30199da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.089+0000 7f4f3870d640 1 --2- 172.21.15.22:0/2876878946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f301026f0 0x7f4f301991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.089+0000 7f4f3870d640 1 --2- 172.21.15.22:0/2876878946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f301015a0 0x7f4f30198b90 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.089+0000 7f4f3870d640 1 -- 172.21.15.22:0/2876878946 >> 172.21.15.22:0/2876878946 conn(0x7f4f300fce60 msgr2=0x7f4f300fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.089+0000 7f4f3870d640 1 -- 172.21.15.22:0/2876878946 shutdown_connections 2024-08-20T01:32:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:20.089+0000 7f4f3870d640 1 -- 172.21.15.22:0/2876878946 wait complete. 2024-08-20T01:32:20.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:19 smithi022 ceph-mon[18709]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:32:20.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:19 smithi134 ceph-mon[22511]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:32:20.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.375+0000 7f6b4f20f640 1 -- 172.21.15.22:0/4257978712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b48102a90 msgr2=0x7f6b48102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:20.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.375+0000 7f6b4f20f640 1 --2- 172.21.15.22:0/4257978712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b48102a90 0x7f6b48102e70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009900 tx=0x7f6b3c02a410 comp rx=0 tx=0).stop 2024-08-20T01:32:20.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.375+0000 7f6b4f20f640 1 -- 172.21.15.22:0/4257978712 shutdown_connections 2024-08-20T01:32:20.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.375+0000 7f6b4f20f640 1 --2- 172.21.15.22:0/4257978712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b48108e20 0x7f6b4810f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.375+0000 7f6b4f20f640 1 --2- 172.21.15.22:0/4257978712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b481084a0 0x7f6b481088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.375+0000 7f6b4f20f640 1 --2- 172.21.15.22:0/4257978712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b48102a90 0x7f6b48102e70 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.375+0000 7f6b4f20f640 1 -- 172.21.15.22:0/4257978712 >> 172.21.15.22:0/4257978712 conn(0x7f6b480fe540 msgr2=0x7f6b48100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:20.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.375+0000 7f6b4f20f640 1 -- 172.21.15.22:0/4257978712 shutdown_connections 2024-08-20T01:32:20.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.376+0000 7f6b4f20f640 1 -- 172.21.15.22:0/4257978712 wait complete. 2024-08-20T01:32:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.376+0000 7f6b4f20f640 1 Processor -- start 2024-08-20T01:32:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.376+0000 7f6b4f20f640 1 -- start start 2024-08-20T01:32:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.377+0000 7f6b4f20f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b48102a90 0x7f6b4819b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.377+0000 7f6b4f20f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b481084a0 0x7f6b4819b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.377+0000 7f6b4f20f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b48108e20 0x7f6b481a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.377+0000 7f6b4f20f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6b48112ae0 con 0x7f6b481084a0 2024-08-20T01:32:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.377+0000 7f6b4f20f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6b48112960 con 0x7f6b48102a90 2024-08-20T01:32:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.377+0000 7f6b4f20f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6b48112c60 con 0x7f6b48108e20 2024-08-20T01:32:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.377+0000 7f6b47fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b481084a0 0x7f6b4819b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.377+0000 7f6b4d7ac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b48108e20 0x7f6b481a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.377+0000 7f6b47fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b481084a0 0x7f6b4819b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56718/0 (socket says 172.21.15.22:56718) 2024-08-20T01:32:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.377+0000 7f6b47fff640 1 -- 172.21.15.22:0/3345632003 learned_addr learned my addr 172.21.15.22:0/3345632003 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:20.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.377+0000 7f6b4cfab640 1 --2- 172.21.15.22:0/3345632003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b48102a90 0x7f6b4819b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:20.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.377+0000 7f6b47fff640 1 -- 172.21.15.22:0/3345632003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b48108e20 msgr2=0x7f6b481a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:20.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.377+0000 7f6b47fff640 1 --2- 172.21.15.22:0/3345632003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b48108e20 0x7f6b481a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.377+0000 7f6b47fff640 1 -- 172.21.15.22:0/3345632003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b48102a90 msgr2=0x7f6b4819b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.377+0000 7f6b47fff640 1 --2- 172.21.15.22:0/3345632003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b48102a90 0x7f6b4819b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.377+0000 7f6b47fff640 1 -- 172.21.15.22:0/3345632003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b481a12e0 con 0x7f6b481084a0 2024-08-20T01:32:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.377+0000 7f6b4d7ac640 1 --2- 172.21.15.22:0/3345632003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b48108e20 0x7f6b481a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:32:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.377+0000 7f6b47fff640 1 --2- 172.21.15.22:0/3345632003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b481084a0 0x7f6b4819b770 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6b3400e9f0 tx=0x7f6b3400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.377+0000 7f6b45ffb640 1 -- 172.21.15.22:0/3345632003 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3400cd80 con 0x7f6b481084a0 2024-08-20T01:32:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.378+0000 7f6b45ffb640 1 -- 172.21.15.22:0/3345632003 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b340054d0 con 0x7f6b481084a0 2024-08-20T01:32:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.378+0000 7f6b45ffb640 1 -- 172.21.15.22:0/3345632003 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b34010690 con 0x7f6b481084a0 2024-08-20T01:32:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.378+0000 7f6b4f20f640 1 -- 172.21.15.22:0/3345632003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b481a15d0 con 0x7f6b481084a0 2024-08-20T01:32:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.378+0000 7f6b4f20f640 1 -- 172.21.15.22:0/3345632003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b481a7c90 con 0x7f6b481084a0 2024-08-20T01:32:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.380+0000 7f6b45ffb640 1 -- 172.21.15.22:0/3345632003 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6b34004e90 con 0x7f6b481084a0 2024-08-20T01:32:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.380+0000 7f6b51608740 1 Processor -- start 2024-08-20T01:32:20.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.381+0000 7f6b51608740 1 -- start start 2024-08-20T01:32:20.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.381+0000 7f6b51608740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 0x5578c2fabc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:20.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.381+0000 7f6b51608740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fac1a0 0x5578c2fb7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:20.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.381+0000 7f6b51608740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fb8130 0x5578c2fba520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:20.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.381+0000 7f6b51608740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5578c2f22930 con 0x5578c2fab880 2024-08-20T01:32:20.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.381+0000 7f6b51608740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5578c2f11e30 con 0x5578c2fac1a0 2024-08-20T01:32:20.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.381+0000 7f6b51608740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5578c2f15e70 con 0x5578c2fb8130 2024-08-20T01:32:20.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.381+0000 7f6b4d7ac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 0x5578c2fabc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:20.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.381+0000 7f6b4cfab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fac1a0 0x5578c2fb7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:20.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.381+0000 7f6b4d7ac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 0x5578c2fabc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56726/0 (socket says 172.21.15.22:56726) 2024-08-20T01:32:20.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.381+0000 7f6b4d7ac640 1 -- 172.21.15.22:0/3324543952 learned_addr learned my addr 172.21.15.22:0/3324543952 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:20.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.381+0000 7f6b45ffb640 1 --2- 172.21.15.22:0/3345632003 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6b380b3bd0 0x7f6b380b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:20.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.381+0000 7f6b47fff640 1 --2- 172.21.15.22:0/3324543952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fb8130 0x5578c2fba520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:20.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.381+0000 7f6b4cfab640 1 -- 172.21.15.22:0/3324543952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fb8130 msgr2=0x5578c2fba520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:20.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.381+0000 7f6b4cfab640 1 --2- 172.21.15.22:0/3324543952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fb8130 0x5578c2fba520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.381+0000 7f6b4d7ac640 1 --2- 172.21.15.22:0/3345632003 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6b380b3bd0 0x7f6b380b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:20.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.381+0000 7f6b4cfab640 1 -- 172.21.15.22:0/3324543952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 msgr2=0x5578c2fabc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:20.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.381+0000 7f6b4cfab640 1 --2- 172.21.15.22:0/3324543952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 0x5578c2fabc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.382+0000 7f6b4cfab640 1 -- 172.21.15.22:0/3324543952 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578c2c71650 con 0x5578c2fac1a0 2024-08-20T01:32:20.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.382+0000 7f6b45ffb640 1 -- 172.21.15.22:0/3345632003 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f6b340e4070 con 0x7f6b481084a0 2024-08-20T01:32:20.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.382+0000 7f6b4cfab640 1 --2- 172.21.15.22:0/3324543952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fac1a0 0x5578c2fb7bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009230 tx=0x7f6b3c032b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7495d2065e04c46 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:20.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.382+0000 7f6b4d7ac640 1 --2- 172.21.15.22:0/3345632003 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6b380b3bd0 0x7f6b380b6090 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6b40005c40 tx=0x7f6b40004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:20.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.382+0000 7f6b32ffd640 1 -- 172.21.15.22:0/3324543952 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c040070 con 0x5578c2fac1a0 2024-08-20T01:32:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.382+0000 7f6b32ffd640 1 -- 172.21.15.22:0/3324543952 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b3c004030 con 0x5578c2fac1a0 2024-08-20T01:32:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.382+0000 7f6b32ffd640 1 -- 172.21.15.22:0/3324543952 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c035040 con 0x5578c2fac1a0 2024-08-20T01:32:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.383+0000 7f6b51608740 1 -- 172.21.15.22:0/3324543952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fac1a0 msgr2=0x5578c2fb7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.383+0000 7f6b51608740 1 --2- 172.21.15.22:0/3324543952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fac1a0 0x5578c2fb7bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009230 tx=0x7f6b3c032b20 comp rx=0 tx=0).stop 2024-08-20T01:32:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.383+0000 7f6b51608740 1 -- 172.21.15.22:0/3324543952 shutdown_connections 2024-08-20T01:32:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.383+0000 7f6b51608740 1 --2- 172.21.15.22:0/3324543952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fb8130 0x5578c2fba520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.383+0000 7f6b51608740 1 --2- 172.21.15.22:0/3324543952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fac1a0 0x5578c2fb7bf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.383+0000 7f6b51608740 1 --2- 172.21.15.22:0/3324543952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 0x5578c2fabc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.383+0000 7f6b51608740 1 -- 172.21.15.22:0/3324543952 >> 172.21.15.22:0/3324543952 conn(0x5578c2fa96b0 msgr2=0x5578c2faa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.383+0000 7f6b51608740 1 -- 172.21.15.22:0/3324543952 shutdown_connections 2024-08-20T01:32:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.383+0000 7f6b51608740 1 -- 172.21.15.22:0/3324543952 wait complete. 2024-08-20T01:32:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.384+0000 7f6b51608740 1 -- start start 2024-08-20T01:32:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.384+0000 7f6b51608740 1 Processor -- start 2024-08-20T01:32:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.384+0000 7f6b51608740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 0x5578c2fb50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.384+0000 7f6b51608740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fac1a0 0x5578c2fb5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.384+0000 7f6b51608740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fb8130 0x5578c2fb5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.384+0000 7f6b51608740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5578c2d74700 con 0x5578c2fab880 2024-08-20T01:32:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.385+0000 7f6b51608740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5578c2e98810 con 0x5578c2fb8130 2024-08-20T01:32:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.385+0000 7f6b51608740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5578c2fbad80 con 0x5578c2fac1a0 2024-08-20T01:32:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.385+0000 7f6b51608740 10 client.0 _ll_register_callbacks cb 0x5578c2f0b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.385+0000 7f6b4cfab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 0x5578c2fb50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.385+0000 7f6b4cfab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 0x5578c2fb50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56738/0 (socket says 172.21.15.22:56738) 2024-08-20T01:32:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.385+0000 7f6b4cfab640 1 -- 172.21.15.22:0/1644482619 learned_addr learned my addr 172.21.15.22:0/1644482619 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.385+0000 7f6b4d7ac640 1 --2- 172.21.15.22:0/1644482619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fb8130 0x5578c2fb5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.385+0000 7f6b47fff640 1 --2- 172.21.15.22:0/1644482619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fac1a0 0x5578c2fb5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.385+0000 7f6b4cfab640 1 -- 172.21.15.22:0/1644482619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fac1a0 msgr2=0x5578c2fb5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.385+0000 7f6b4cfab640 1 --2- 172.21.15.22:0/1644482619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fac1a0 0x5578c2fb5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.385+0000 7f6b4cfab640 1 -- 172.21.15.22:0/1644482619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fb8130 msgr2=0x5578c2fb5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.385+0000 7f6b4cfab640 1 --2- 172.21.15.22:0/1644482619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fb8130 0x5578c2fb5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.385+0000 7f6b4cfab640 1 -- 172.21.15.22:0/1644482619 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578c2fc4130 con 0x5578c2fab880 2024-08-20T01:32:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.385+0000 7f6b4cfab640 1 --2- 172.21.15.22:0/1644482619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 0x5578c2fb50d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c005c40 tx=0x7f6b3c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4311e7970cb0820b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.385+0000 7f6b27fff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:32:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.385+0000 7f6b27fff640 1 -- 172.21.15.22:0/1644482619 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c035040 con 0x5578c2fab880 2024-08-20T01:32:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.385+0000 7f6b27fff640 1 -- 172.21.15.22:0/1644482619 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f6b3c0318b0 con 0x5578c2fab880 2024-08-20T01:32:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.385+0000 7f6b51608740 1 -- 172.21.15.22:0/1644482619 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5578c2ec1150 con 0x5578c2fab880 2024-08-20T01:32:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.386+0000 7f6b27fff640 1 -- 172.21.15.22:0/1644482619 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6b3c040040 con 0x5578c2fab880 2024-08-20T01:32:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.386+0000 7f6b51608740 10 client.15606 fetch_fsmap learned FSMap version 27 2024-08-20T01:32:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.386+0000 7f6b51608740 1 -- 172.21.15.22:0/1644482619 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5578c2fc6ae0 con 0x5578c2fab880 2024-08-20T01:32:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.386+0000 7f6b27fff640 1 -- 172.21.15.22:0/1644482619 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5578c2ec1150 con 0x5578c2fab880 2024-08-20T01:32:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.386+0000 7f6b27fff640 1 -- 172.21.15.22:0/1644482619 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f6b3c004870 con 0x5578c2fab880 2024-08-20T01:32:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.386+0000 7f6b51608740 10 client.15606 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:32:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.386+0000 7f6b51608740 10 client.15606 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:32:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.386+0000 7f6b51608740 20 client.15606 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.387+0000 7f6b51608740 1 --2- 172.21.15.22:0/1644482619 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5578c2fc7e30 0x5578c2fca220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.387+0000 7f6b51608740 4 client.15606 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:32:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.387+0000 7f6b51608740 1 -- 172.21.15.22:0/1644482619 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578c2f24880 con 0x5578c2fc7e30 2024-08-20T01:32:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.387+0000 7f6b47fff640 1 --2- 172.21.15.22:0/1644482619 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5578c2fc7e30 0x5578c2fca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.387+0000 7f6b47fff640 1 --2- 172.21.15.22:0/1644482619 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5578c2fc7e30 0x5578c2fca220 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b63c2f367991515f server_cookie=a6e1667e149cd2ca in_seq=0 out_seq=0 2024-08-20T01:32:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.388+0000 7f6b27fff640 10 client.15606 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:32:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.391+0000 7f6b27fff640 1 -- 172.21.15.22:0/1644482619 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5578c2f24880 con 0x5578c2fc7e30 2024-08-20T01:32:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.391+0000 7f6b27fff640 10 client.15606 handle_command_reply: tid=0 2024-08-20T01:32:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.391+0000 7f6b51608740 1 client.15606 shutdown 2024-08-20T01:32:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.391+0000 7f6b51608740 1 -- 172.21.15.22:0/1644482619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 msgr2=0x5578c2fb50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.391+0000 7f6b51608740 1 --2- 172.21.15.22:0/1644482619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 0x5578c2fb50d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c005c40 tx=0x7f6b3c02a410 comp rx=0 tx=0).stop 2024-08-20T01:32:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.392+0000 7f6b51608740 1 -- 172.21.15.22:0/1644482619 shutdown_connections 2024-08-20T01:32:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.392+0000 7f6b51608740 1 --2- 172.21.15.22:0/1644482619 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5578c2fc7e30 0x5578c2fca220 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.392+0000 7f6b51608740 1 --2- 172.21.15.22:0/1644482619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fb8130 0x5578c2fb5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.392+0000 7f6b51608740 1 --2- 172.21.15.22:0/1644482619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fac1a0 0x5578c2fb5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.392+0000 7f6b27fff640 0 client.15606 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:32:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.392+0000 7f6b51608740 1 --2- 172.21.15.22:0/1644482619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 0x5578c2fb50d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.392+0000 7f6b51608740 1 -- 172.21.15.22:0/1644482619 >> 172.21.15.22:0/1644482619 conn(0x5578c2fa96b0 msgr2=0x5578c2faf250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:20.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.392+0000 7f6b51608740 1 -- 172.21.15.22:0/1644482619 shutdown_connections 2024-08-20T01:32:20.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.392+0000 7f6b51608740 1 -- 172.21.15.22:0/1644482619 wait complete. 2024-08-20T01:32:20.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.392+0000 7f6b51608740 20 client.15606 trim_cache size 0 max 16384 2024-08-20T01:32:20.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.408+0000 7f6b51608740 1 Processor -- start 2024-08-20T01:32:20.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.408+0000 7f6b51608740 1 -- start start 2024-08-20T01:32:20.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.408+0000 7f6b51608740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fab880 0x5578c2faf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:20.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.408+0000 7f6b51608740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fac1a0 0x5578c2fcf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:20.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.408+0000 7f6b51608740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fb8130 0x5578c2fcfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:20.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.408+0000 7f6b51608740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6b481b2ce0 con 0x5578c2fac1a0 2024-08-20T01:32:20.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.408+0000 7f6b51608740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6b481b05b0 con 0x5578c2fab880 2024-08-20T01:32:20.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.408+0000 7f6b51608740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6b481ae400 con 0x5578c2fb8130 2024-08-20T01:32:20.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.408+0000 7f6b47fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fac1a0 0x5578c2fcf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:20.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.408+0000 7f6b4cfab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fab880 0x5578c2faf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:20.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.408+0000 7f6b47fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fac1a0 0x5578c2fcf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56750/0 (socket says 172.21.15.22:56750) 2024-08-20T01:32:20.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.408+0000 7f6b47fff640 1 -- 172.21.15.22:0/1326229742 learned_addr learned my addr 172.21.15.22:0/1326229742 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:20.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.408+0000 7f6b4d7ac640 1 --2- 172.21.15.22:0/1326229742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fb8130 0x5578c2fcfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:20.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.409+0000 7f6b47fff640 1 -- 172.21.15.22:0/1326229742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fb8130 msgr2=0x5578c2fcfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:20.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.409+0000 7f6b47fff640 1 --2- 172.21.15.22:0/1326229742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fb8130 0x5578c2fcfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.409+0000 7f6b47fff640 1 -- 172.21.15.22:0/1326229742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fab880 msgr2=0x5578c2faf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:20.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.409+0000 7f6b47fff640 1 --2- 172.21.15.22:0/1326229742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fab880 0x5578c2faf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.409+0000 7f6b47fff640 1 -- 172.21.15.22:0/1326229742 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578c2fca590 con 0x5578c2fac1a0 2024-08-20T01:32:20.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.409+0000 7f6b4cfab640 1 --2- 172.21.15.22:0/1326229742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fab880 0x5578c2faf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:32:20.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.409+0000 7f6b47fff640 1 --2- 172.21.15.22:0/1326229742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fac1a0 0x5578c2fcf7c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6b340097d0 tx=0x7f6b340e1f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882a3564f58833d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:20.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.409+0000 7f6b327fc640 1 -- 172.21.15.22:0/1326229742 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b340bd070 con 0x5578c2fac1a0 2024-08-20T01:32:20.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.409+0000 7f6b327fc640 1 -- 172.21.15.22:0/1326229742 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b340aaa30 con 0x5578c2fac1a0 2024-08-20T01:32:20.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.409+0000 7f6b327fc640 1 -- 172.21.15.22:0/1326229742 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b340aaf20 con 0x5578c2fac1a0 2024-08-20T01:32:20.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.410+0000 7f6b51608740 1 -- 172.21.15.22:0/1326229742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fac1a0 msgr2=0x5578c2fcf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:20.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.410+0000 7f6b51608740 1 --2- 172.21.15.22:0/1326229742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fac1a0 0x5578c2fcf7c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6b340097d0 tx=0x7f6b340e1f90 comp rx=0 tx=0).stop 2024-08-20T01:32:20.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.410+0000 7f6b51608740 1 -- 172.21.15.22:0/1326229742 shutdown_connections 2024-08-20T01:32:20.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.410+0000 7f6b51608740 1 --2- 172.21.15.22:0/1326229742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fb8130 0x5578c2fcfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.410+0000 7f6b51608740 1 --2- 172.21.15.22:0/1326229742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fac1a0 0x5578c2fcf7c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.410+0000 7f6b51608740 1 --2- 172.21.15.22:0/1326229742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fab880 0x5578c2faf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.410+0000 7f6b51608740 1 -- 172.21.15.22:0/1326229742 >> 172.21.15.22:0/1326229742 conn(0x5578c2fa96b0 msgr2=0x5578c2fb6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:20.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.410+0000 7f6b51608740 1 -- 172.21.15.22:0/1326229742 shutdown_connections 2024-08-20T01:32:20.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.410+0000 7f6b51608740 1 -- 172.21.15.22:0/1326229742 wait complete. 2024-08-20T01:32:20.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.410+0000 7f6b51608740 1 -- start start 2024-08-20T01:32:20.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.410+0000 7f6b51608740 1 Processor -- start 2024-08-20T01:32:20.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b51608740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 0x5578c2fbda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:20.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b51608740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fac1a0 0x5578c2fbdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:20.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b51608740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fb8130 0x5578c30297c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:20.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b51608740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6b481aea70 con 0x5578c2fab880 2024-08-20T01:32:20.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b51608740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6b481afee0 con 0x5578c2fac1a0 2024-08-20T01:32:20.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b51608740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6b481af140 con 0x5578c2fb8130 2024-08-20T01:32:20.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b51608740 10 client.0 _ll_register_callbacks cb 0x7f6b40009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:20.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b4cfab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 0x5578c2fbda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:20.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b47fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fac1a0 0x5578c2fbdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:20.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b4d7ac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fb8130 0x5578c30297c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:20.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b4cfab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 0x5578c2fbda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56762/0 (socket says 172.21.15.22:56762) 2024-08-20T01:32:20.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b47fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fac1a0 0x5578c2fbdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:52878/0 (socket says 172.21.15.22:52878) 2024-08-20T01:32:20.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b4cfab640 1 -- 172.21.15.22:0/280327618 learned_addr learned my addr 172.21.15.22:0/280327618 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:20.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b4cfab640 1 -- 172.21.15.22:0/280327618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fb8130 msgr2=0x5578c30297c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:20.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b4cfab640 1 --2- 172.21.15.22:0/280327618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fb8130 0x5578c30297c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b4cfab640 1 -- 172.21.15.22:0/280327618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fac1a0 msgr2=0x5578c2fbdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:20.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b4cfab640 1 --2- 172.21.15.22:0/280327618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fac1a0 0x5578c2fbdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b4cfab640 1 -- 172.21.15.22:0/280327618 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578c3029ed0 con 0x5578c2fab880 2024-08-20T01:32:20.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b4cfab640 1 --2- 172.21.15.22:0/280327618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 0x5578c2fbda00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009900 tx=0x7f6b3c032970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe030c81fc4bfa44 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:20.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.411+0000 7f6b27fff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:32:20.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.412+0000 7f6b27fff640 1 -- 172.21.15.22:0/280327618 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c05b070 con 0x5578c2fab880 2024-08-20T01:32:20.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.412+0000 7f6b51608740 1 -- 172.21.15.22:0/280327618 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b340aaa30 con 0x5578c2fab880 2024-08-20T01:32:20.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.412+0000 7f6b27fff640 1 -- 172.21.15.22:0/280327618 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f6b3c004030 con 0x5578c2fab880 2024-08-20T01:32:20.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.412+0000 7f6b27fff640 1 -- 172.21.15.22:0/280327618 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6b3c035040 con 0x5578c2fab880 2024-08-20T01:32:20.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.412+0000 7f6b51608740 10 client.15612 fetch_fsmap learned FSMap version 27 2024-08-20T01:32:20.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.412+0000 7f6b51608740 1 -- 172.21.15.22:0/280327618 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5578c3032490 con 0x5578c2fab880 2024-08-20T01:32:20.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.412+0000 7f6b27fff640 1 -- 172.21.15.22:0/280327618 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b340aaa30 con 0x5578c2fab880 2024-08-20T01:32:20.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.412+0000 7f6b27fff640 1 -- 172.21.15.22:0/280327618 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f6b3c004350 con 0x5578c2fab880 2024-08-20T01:32:20.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.412+0000 7f6b51608740 10 client.15612 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:32:20.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.412+0000 7f6b51608740 10 client.15612 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:32:20.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.412+0000 7f6b51608740 20 client.15612 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:20.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.412+0000 7f6b51608740 1 --2- 172.21.15.22:0/280327618 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5578c3032bf0 0x5578c3035010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:20.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.412+0000 7f6b51608740 4 client.15612 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:32:20.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.412+0000 7f6b51608740 1 -- 172.21.15.22:0/280327618 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5578c2f20320 con 0x5578c3032bf0 2024-08-20T01:32:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.413+0000 7f6b47fff640 1 --2- 172.21.15.22:0/280327618 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5578c3032bf0 0x5578c3035010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.413+0000 7f6b47fff640 1 --2- 172.21.15.22:0/280327618 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5578c3032bf0 0x5578c3035010 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ba839a6dc213ba4e server_cookie=6af5c0abaca32a08 in_seq=0 out_seq=0 2024-08-20T01:32:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.413+0000 7f6b27fff640 10 client.15612 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:32:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.413+0000 7f6b27fff640 1 -- 172.21.15.22:0/280327618 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5578c2f20320 con 0x5578c3032bf0 2024-08-20T01:32:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.413+0000 7f6b27fff640 10 client.15612 handle_command_reply: tid=0 2024-08-20T01:32:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.413+0000 7f6b51608740 1 client.15612 shutdown 2024-08-20T01:32:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.413+0000 7f6b51608740 1 -- 172.21.15.22:0/280327618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 msgr2=0x5578c2fbda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.413+0000 7f6b51608740 1 --2- 172.21.15.22:0/280327618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 0x5578c2fbda00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009900 tx=0x7f6b3c032970 comp rx=0 tx=0).stop 2024-08-20T01:32:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.413+0000 7f6b51608740 1 -- 172.21.15.22:0/280327618 shutdown_connections 2024-08-20T01:32:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.413+0000 7f6b51608740 1 --2- 172.21.15.22:0/280327618 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5578c3032bf0 0x5578c3035010 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.413+0000 7f6b51608740 1 --2- 172.21.15.22:0/280327618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578c2fb8130 0x5578c30297c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.413+0000 7f6b51608740 1 --2- 172.21.15.22:0/280327618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578c2fac1a0 0x5578c2fbdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.413+0000 7f6b27fff640 0 client.15612 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:32:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.413+0000 7f6b51608740 1 --2- 172.21.15.22:0/280327618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578c2fab880 0x5578c2fbda00 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.413+0000 7f6b51608740 1 -- 172.21.15.22:0/280327618 >> 172.21.15.22:0/280327618 conn(0x5578c2fa96b0 msgr2=0x5578c2fc2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.414+0000 7f6b51608740 1 -- 172.21.15.22:0/280327618 shutdown_connections 2024-08-20T01:32:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.414+0000 7f6b51608740 1 -- 172.21.15.22:0/280327618 wait complete. 2024-08-20T01:32:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.414+0000 7f6b51608740 20 client.15612 trim_cache size 0 max 16384 2024-08-20T01:32:20.420 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:32:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.414+0000 7f6b4f20f640 1 -- 172.21.15.22:0/3345632003 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6b380b3bd0 msgr2=0x7f6b380b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.414+0000 7f6b4f20f640 1 --2- 172.21.15.22:0/3345632003 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6b380b3bd0 0x7f6b380b6090 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6b40005c40 tx=0x7f6b40004ab0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.414+0000 7f6b4f20f640 1 -- 172.21.15.22:0/3345632003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b481084a0 msgr2=0x7f6b4819b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.414+0000 7f6b4f20f640 1 --2- 172.21.15.22:0/3345632003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b481084a0 0x7f6b4819b770 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6b3400e9f0 tx=0x7f6b3400edf0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.414+0000 7f6b4f20f640 1 -- 172.21.15.22:0/3345632003 shutdown_connections 2024-08-20T01:32:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.414+0000 7f6b4f20f640 1 --2- 172.21.15.22:0/3345632003 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6b380b3bd0 0x7f6b380b6090 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.414+0000 7f6b4f20f640 1 --2- 172.21.15.22:0/3345632003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b48108e20 0x7f6b481a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.414+0000 7f6b4f20f640 1 --2- 172.21.15.22:0/3345632003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b481084a0 0x7f6b4819b770 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.414+0000 7f6b4f20f640 1 --2- 172.21.15.22:0/3345632003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b48102a90 0x7f6b4819b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.414+0000 7f6b4f20f640 1 -- 172.21.15.22:0/3345632003 >> 172.21.15.22:0/3345632003 conn(0x7f6b480fe540 msgr2=0x7f6b48104a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.415+0000 7f6b4f20f640 1 -- 172.21.15.22:0/3345632003 shutdown_connections 2024-08-20T01:32:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:20.415+0000 7f6b4f20f640 1 -- 172.21.15.22:0/3345632003 wait complete. 2024-08-20T01:32:21.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:20 smithi077 ceph-mon[22251]: pgmap v382: 97 pgs: 97 active+clean; 54 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 352 op/s 2024-08-20T01:32:21.066 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:20 smithi022 ceph-mon[18709]: pgmap v382: 97 pgs: 97 active+clean; 54 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 352 op/s 2024-08-20T01:32:21.100 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:32:21.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:20 smithi134 ceph-mon[22511]: pgmap v382: 97 pgs: 97 active+clean; 54 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 352 op/s 2024-08-20T01:32:21.387 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:32:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.897+0000 7f8d4f7fe640 1 -- 172.21.15.22:0/2273709458 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4802f310 con 0x7f8d50108e60 2024-08-20T01:32:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.898+0000 7f8d56e23640 1 -- 172.21.15.22:0/2273709458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d50108e60 msgr2=0x7f8d5010f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.898+0000 7f8d56e23640 1 --2- 172.21.15.22:0/2273709458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d50108e60 0x7f8d5010f660 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8d48009ca0 tx=0x7f8d4802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.898+0000 7f8d56e23640 1 -- 172.21.15.22:0/2273709458 shutdown_connections 2024-08-20T01:32:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.898+0000 7f8d56e23640 1 --2- 172.21.15.22:0/2273709458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d50108e60 0x7f8d5010f660 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.898+0000 7f8d56e23640 1 --2- 172.21.15.22:0/2273709458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d501084e0 0x7f8d50108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.898+0000 7f8d56e23640 1 --2- 172.21.15.22:0/2273709458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d50102ad0 0x7f8d50102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.898+0000 7f8d56e23640 1 -- 172.21.15.22:0/2273709458 >> 172.21.15.22:0/2273709458 conn(0x7f8d500fe540 msgr2=0x7f8d50100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.898+0000 7f8d56e23640 1 -- 172.21.15.22:0/2273709458 shutdown_connections 2024-08-20T01:32:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.898+0000 7f8d56e23640 1 -- 172.21.15.22:0/2273709458 wait complete. 2024-08-20T01:32:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.899+0000 7f8d56e23640 1 Processor -- start 2024-08-20T01:32:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.899+0000 7f8d56e23640 1 -- start start 2024-08-20T01:32:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.899+0000 7f8d56e23640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d50102ad0 0x7f8d50198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.899+0000 7f8d56e23640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d501084e0 0x7f8d50199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.899+0000 7f8d56e23640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d50108e60 0x7f8d5019e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.899+0000 7f8d56e23640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8d50112ae0 con 0x7f8d501084e0 2024-08-20T01:32:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.899+0000 7f8d56e23640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8d50112960 con 0x7f8d50102ad0 2024-08-20T01:32:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.899+0000 7f8d56e23640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d50112c60 con 0x7f8d50108e60 2024-08-20T01:32:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.899+0000 7f8d4ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d501084e0 0x7f8d50199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.899+0000 7f8d54bbf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d50102ad0 0x7f8d50198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.899+0000 7f8d553c0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d50108e60 0x7f8d5019e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.899+0000 7f8d553c0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d50108e60 0x7f8d5019e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:43732/0 (socket says 172.21.15.22:43732) 2024-08-20T01:32:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.899+0000 7f8d54bbf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d50102ad0 0x7f8d50198f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:52900/0 (socket says 172.21.15.22:52900) 2024-08-20T01:32:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.899+0000 7f8d4ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d501084e0 0x7f8d50199480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56782/0 (socket says 172.21.15.22:56782) 2024-08-20T01:32:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.899+0000 7f8d54bbf640 1 -- 172.21.15.22:0/121015941 learned_addr learned my addr 172.21.15.22:0/121015941 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.900+0000 7f8d553c0640 1 -- 172.21.15.22:0/121015941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d50102ad0 msgr2=0x7f8d50198f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.900+0000 7f8d553c0640 1 --2- 172.21.15.22:0/121015941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d50102ad0 0x7f8d50198f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.900+0000 7f8d553c0640 1 -- 172.21.15.22:0/121015941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d501084e0 msgr2=0x7f8d50199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.900+0000 7f8d553c0640 1 --2- 172.21.15.22:0/121015941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d501084e0 0x7f8d50199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.900+0000 7f8d553c0640 1 -- 172.21.15.22:0/121015941 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5019eff0 con 0x7f8d50108e60 2024-08-20T01:32:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.900+0000 7f8d553c0640 1 --2- 172.21.15.22:0/121015941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d50108e60 0x7f8d5019e820 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8d4802ade0 tx=0x7f8d48031660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.900+0000 7f8d4dffb640 1 -- 172.21.15.22:0/121015941 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d48003b70 con 0x7f8d50108e60 2024-08-20T01:32:21.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.900+0000 7f8d4dffb640 1 -- 172.21.15.22:0/121015941 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d48031910 con 0x7f8d50108e60 2024-08-20T01:32:21.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.900+0000 7f8d56e23640 1 -- 172.21.15.22:0/121015941 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d5019f280 con 0x7f8d50108e60 2024-08-20T01:32:21.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.900+0000 7f8d4dffb640 1 -- 172.21.15.22:0/121015941 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4802f950 con 0x7f8d50108e60 2024-08-20T01:32:21.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.901+0000 7f8d56e23640 1 -- 172.21.15.22:0/121015941 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d500750b0 con 0x7f8d50108e60 2024-08-20T01:32:21.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.904+0000 7f8d4dffb640 1 -- 172.21.15.22:0/121015941 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8d4802faf0 con 0x7f8d50108e60 2024-08-20T01:32:21.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.904+0000 7f8d5921c740 1 Processor -- start 2024-08-20T01:32:21.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.904+0000 7f8d5921c740 1 -- start start 2024-08-20T01:32:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.905+0000 7f8d5921c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d2f880 0x55e4d4d2fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.905+0000 7f8d5921c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d301a0 0x55e4d4d3bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.905+0000 7f8d5921c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d3c130 0x55e4d4d3e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.905+0000 7f8d5921c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e4d4ca6930 con 0x55e4d4d2f880 2024-08-20T01:32:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.905+0000 7f8d5921c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e4d4c95e30 con 0x55e4d4d301a0 2024-08-20T01:32:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.905+0000 7f8d5921c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e4d4c99e70 con 0x55e4d4d3c130 2024-08-20T01:32:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.905+0000 7f8d4ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d2f880 0x55e4d4d2fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.905+0000 7f8d4ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d2f880 0x55e4d4d2fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56796/0 (socket says 172.21.15.22:56796) 2024-08-20T01:32:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.905+0000 7f8d4ffff640 1 -- 172.21.15.22:0/3380518268 learned_addr learned my addr 172.21.15.22:0/3380518268 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.905+0000 7f8d4ffff640 1 --2- 172.21.15.22:0/3380518268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d3c130 0x55e4d4d3e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.905+0000 7f8d54bbf640 1 --2- 172.21.15.22:0/3380518268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d301a0 0x55e4d4d3bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.905+0000 7f8d4ffff640 1 -- 172.21.15.22:0/3380518268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d3c130 msgr2=0x55e4d4d3e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.905+0000 7f8d4ffff640 1 --2- 172.21.15.22:0/3380518268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d3c130 0x55e4d4d3e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.905+0000 7f8d4ffff640 1 -- 172.21.15.22:0/3380518268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d301a0 msgr2=0x55e4d4d3bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.905+0000 7f8d4ffff640 1 --2- 172.21.15.22:0/3380518268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d301a0 0x55e4d4d3bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.905+0000 7f8d4ffff640 1 -- 172.21.15.22:0/3380518268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4d49f5650 con 0x55e4d4d2f880 2024-08-20T01:32:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.906+0000 7f8d54bbf640 1 --2- 172.21.15.22:0/3380518268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d301a0 0x55e4d4d3bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:32:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.906+0000 7f8d4dffb640 1 --2- 172.21.15.22:0/121015941 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d400b3bd0 0x7f8d400b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.906+0000 7f8d4ffff640 1 --2- 172.21.15.22:0/3380518268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d2f880 0x55e4d4d2fc60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0098f0 tx=0x7f8d3c010950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc5fcf68baefb99 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.906+0000 7f8d54bbf640 1 --2- 172.21.15.22:0/121015941 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d400b3bd0 0x7f8d400b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.906+0000 7f8d3affd640 1 -- 172.21.15.22:0/3380518268 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c004230 con 0x55e4d4d2f880 2024-08-20T01:32:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.906+0000 7f8d3affd640 1 -- 172.21.15.22:0/3380518268 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d3c0043d0 con 0x55e4d4d2f880 2024-08-20T01:32:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.906+0000 7f8d3affd640 1 -- 172.21.15.22:0/3380518268 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c004d00 con 0x55e4d4d2f880 2024-08-20T01:32:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.907+0000 7f8d4dffb640 1 -- 172.21.15.22:0/121015941 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f8d48104f90 con 0x7f8d50108e60 2024-08-20T01:32:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.907+0000 7f8d5921c740 1 -- 172.21.15.22:0/3380518268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d2f880 msgr2=0x55e4d4d2fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.907+0000 7f8d54bbf640 1 --2- 172.21.15.22:0/121015941 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d400b3bd0 0x7f8d400b6090 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55e4d4d32a00 tx=0x7f8d44005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.907+0000 7f8d5921c740 1 --2- 172.21.15.22:0/3380518268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d2f880 0x55e4d4d2fc60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0098f0 tx=0x7f8d3c010950 comp rx=0 tx=0).stop 2024-08-20T01:32:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.907+0000 7f8d5921c740 1 -- 172.21.15.22:0/3380518268 shutdown_connections 2024-08-20T01:32:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.907+0000 7f8d5921c740 1 --2- 172.21.15.22:0/3380518268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d3c130 0x55e4d4d3e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.907+0000 7f8d5921c740 1 --2- 172.21.15.22:0/3380518268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d301a0 0x55e4d4d3bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.907+0000 7f8d5921c740 1 --2- 172.21.15.22:0/3380518268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d2f880 0x55e4d4d2fc60 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.907+0000 7f8d5921c740 1 -- 172.21.15.22:0/3380518268 >> 172.21.15.22:0/3380518268 conn(0x55e4d4d2d6b0 msgr2=0x55e4d4d2e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:21.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.907+0000 7f8d5921c740 1 -- 172.21.15.22:0/3380518268 shutdown_connections 2024-08-20T01:32:21.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.907+0000 7f8d5921c740 1 -- 172.21.15.22:0/3380518268 wait complete. 2024-08-20T01:32:21.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.908+0000 7f8d5921c740 1 -- start start 2024-08-20T01:32:21.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.908+0000 7f8d5921c740 1 Processor -- start 2024-08-20T01:32:21.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.909+0000 7f8d5921c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d2f880 0x55e4d4d390e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:21.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.909+0000 7f8d5921c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d301a0 0x55e4d4d39620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:21.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.909+0000 7f8d5921c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d3c130 0x55e4d4d39b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:21.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.909+0000 7f8d5921c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e4d4af8700 con 0x55e4d4d2f880 2024-08-20T01:32:21.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.909+0000 7f8d5921c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e4d4c1c810 con 0x55e4d4d301a0 2024-08-20T01:32:21.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.909+0000 7f8d5921c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e4d4d3ed80 con 0x55e4d4d3c130 2024-08-20T01:32:21.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.909+0000 7f8d5921c740 10 client.0 _ll_register_callbacks cb 0x55e4d4c8f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.909+0000 7f8d54bbf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d2f880 0x55e4d4d390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.909+0000 7f8d553c0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d3c130 0x55e4d4d39b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.909+0000 7f8d54bbf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d2f880 0x55e4d4d390e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56812/0 (socket says 172.21.15.22:56812) 2024-08-20T01:32:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.909+0000 7f8d54bbf640 1 -- 172.21.15.22:0/2171260195 learned_addr learned my addr 172.21.15.22:0/2171260195 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.909+0000 7f8d4ffff640 1 --2- 172.21.15.22:0/2171260195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d301a0 0x55e4d4d39620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.909+0000 7f8d553c0640 1 -- 172.21.15.22:0/2171260195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d301a0 msgr2=0x55e4d4d39620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.909+0000 7f8d553c0640 1 --2- 172.21.15.22:0/2171260195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d301a0 0x55e4d4d39620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.909+0000 7f8d553c0640 1 -- 172.21.15.22:0/2171260195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d2f880 msgr2=0x55e4d4d390e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.909+0000 7f8d553c0640 1 --2- 172.21.15.22:0/2171260195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d2f880 0x55e4d4d390e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.909+0000 7f8d553c0640 1 -- 172.21.15.22:0/2171260195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4d4d48160 con 0x55e4d4d3c130 2024-08-20T01:32:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.909+0000 7f8d54bbf640 1 --2- 172.21.15.22:0/2171260195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d2f880 0x55e4d4d390e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:32:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.910+0000 7f8d553c0640 1 --2- 172.21.15.22:0/2171260195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d3c130 0x55e4d4d39b60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8d48006010 tx=0x7f8d48009600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2848ed0bf6625617 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.910+0000 7f8d2ffff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:32:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.910+0000 7f8d2ffff640 1 -- 172.21.15.22:0/2171260195 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d480cbea0 con 0x55e4d4d3c130 2024-08-20T01:32:21.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.910+0000 7f8d2ffff640 1 -- 172.21.15.22:0/2171260195 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f8d480c8490 con 0x55e4d4d3c130 2024-08-20T01:32:21.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.910+0000 7f8d5921c740 1 -- 172.21.15.22:0/2171260195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e4d4c45150 con 0x55e4d4d3c130 2024-08-20T01:32:21.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.910+0000 7f8d2ffff640 1 -- 172.21.15.22:0/2171260195 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8d480d04a0 con 0x55e4d4d3c130 2024-08-20T01:32:21.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.910+0000 7f8d5921c740 10 client.25240 fetch_fsmap learned FSMap version 27 2024-08-20T01:32:21.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.910+0000 7f8d5921c740 1 -- 172.21.15.22:0/2171260195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e4d4d4aaf0 con 0x55e4d4d3c130 2024-08-20T01:32:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.910+0000 7f8d2ffff640 1 -- 172.21.15.22:0/2171260195 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e4d4c45150 con 0x55e4d4d3c130 2024-08-20T01:32:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.911+0000 7f8d2ffff640 1 -- 172.21.15.22:0/2171260195 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f8d480d4ac0 con 0x55e4d4d3c130 2024-08-20T01:32:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.911+0000 7f8d5921c740 10 client.25240 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:32:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.911+0000 7f8d5921c740 10 client.25240 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:32:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.911+0000 7f8d5921c740 20 client.25240 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.911+0000 7f8d5921c740 1 --2- 172.21.15.22:0/2171260195 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55e4d4d4bff0 0x55e4d4d4e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.911+0000 7f8d5921c740 4 client.25240 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:32:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.911+0000 7f8d5921c740 1 -- 172.21.15.22:0/2171260195 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4d4ca8880 con 0x55e4d4d4bff0 2024-08-20T01:32:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.911+0000 7f8d54bbf640 1 --2- 172.21.15.22:0/2171260195 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55e4d4d4bff0 0x55e4d4d4e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.912+0000 7f8d2ffff640 10 client.25240 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:32:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.912+0000 7f8d54bbf640 1 --2- 172.21.15.22:0/2171260195 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55e4d4d4bff0 0x55e4d4d4e450 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=efa55006ddc07efa server_cookie=dcbf4c13333d6b0f in_seq=0 out_seq=0 2024-08-20T01:32:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.912+0000 7f8d2ffff640 1 -- 172.21.15.22:0/2171260195 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e4d4ca8880 con 0x55e4d4d4bff0 2024-08-20T01:32:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.912+0000 7f8d2ffff640 10 client.25240 handle_command_reply: tid=0 2024-08-20T01:32:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.913+0000 7f8d5921c740 1 client.25240 shutdown 2024-08-20T01:32:21.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.913+0000 7f8d5921c740 1 -- 172.21.15.22:0/2171260195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d3c130 msgr2=0x55e4d4d39b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:21.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.913+0000 7f8d5921c740 1 --2- 172.21.15.22:0/2171260195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d3c130 0x55e4d4d39b60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8d48006010 tx=0x7f8d48009600 comp rx=0 tx=0).stop 2024-08-20T01:32:21.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.913+0000 7f8d5921c740 1 -- 172.21.15.22:0/2171260195 shutdown_connections 2024-08-20T01:32:21.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.913+0000 7f8d5921c740 1 --2- 172.21.15.22:0/2171260195 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55e4d4d4bff0 0x55e4d4d4e450 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.913+0000 7f8d5921c740 1 --2- 172.21.15.22:0/2171260195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d3c130 0x55e4d4d39b60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.913+0000 7f8d5921c740 1 --2- 172.21.15.22:0/2171260195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d301a0 0x55e4d4d39620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.913+0000 7f8d5921c740 1 --2- 172.21.15.22:0/2171260195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d2f880 0x55e4d4d390e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.913+0000 7f8d5921c740 1 -- 172.21.15.22:0/2171260195 >> 172.21.15.22:0/2171260195 conn(0x55e4d4d2d6b0 msgr2=0x55e4d4d33250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:21.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.913+0000 7f8d2ffff640 0 client.25240 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:32:21.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.913+0000 7f8d5921c740 1 -- 172.21.15.22:0/2171260195 shutdown_connections 2024-08-20T01:32:21.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.913+0000 7f8d5921c740 1 -- 172.21.15.22:0/2171260195 wait complete. 2024-08-20T01:32:21.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.913+0000 7f8d5921c740 20 client.25240 trim_cache size 0 max 16384 2024-08-20T01:32:21.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d5921c740 1 Processor -- start 2024-08-20T01:32:21.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d5921c740 1 -- start start 2024-08-20T01:32:21.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d5921c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d2f880 0x55e4d4d33a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d5921c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d301a0 0x55e4d4d38840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d5921c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d3c130 0x55e4d4d53d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d5921c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8d501ae7e0 con 0x55e4d4d301a0 2024-08-20T01:32:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d5921c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8d501ac0b0 con 0x55e4d4d2f880 2024-08-20T01:32:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d5921c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d501a9f00 con 0x55e4d4d3c130 2024-08-20T01:32:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d4ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d301a0 0x55e4d4d38840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d553c0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d3c130 0x55e4d4d53d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d553c0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d3c130 0x55e4d4d53d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:43760/0 (socket says 172.21.15.22:43760) 2024-08-20T01:32:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d4ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d301a0 0x55e4d4d38840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56816/0 (socket says 172.21.15.22:56816) 2024-08-20T01:32:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d553c0640 1 -- 172.21.15.22:0/1505418315 learned_addr learned my addr 172.21.15.22:0/1505418315 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d54bbf640 1 --2- 172.21.15.22:0/1505418315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d2f880 0x55e4d4d33a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d553c0640 1 -- 172.21.15.22:0/1505418315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d2f880 msgr2=0x55e4d4d33a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d553c0640 1 --2- 172.21.15.22:0/1505418315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d2f880 0x55e4d4d33a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d553c0640 1 -- 172.21.15.22:0/1505418315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d301a0 msgr2=0x55e4d4d38840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d553c0640 1 --2- 172.21.15.22:0/1505418315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d301a0 0x55e4d4d38840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d553c0640 1 -- 172.21.15.22:0/1505418315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4d4d2baf0 con 0x55e4d4d3c130 2024-08-20T01:32:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.927+0000 7f8d54bbf640 1 --2- 172.21.15.22:0/1505418315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d2f880 0x55e4d4d33a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:32:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.928+0000 7f8d553c0640 1 --2- 172.21.15.22:0/1505418315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d3c130 0x55e4d4d53d20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8d480cbe30 tx=0x7f8d48009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8eaabcc39bf4f8e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.928+0000 7f8d3a7fc640 1 -- 172.21.15.22:0/1505418315 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d480c7d60 con 0x55e4d4d3c130 2024-08-20T01:32:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.928+0000 7f8d3a7fc640 1 -- 172.21.15.22:0/1505418315 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d480a8070 con 0x55e4d4d3c130 2024-08-20T01:32:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.928+0000 7f8d3a7fc640 1 -- 172.21.15.22:0/1505418315 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d480cc2c0 con 0x55e4d4d3c130 2024-08-20T01:32:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.929+0000 7f8d5921c740 1 -- 172.21.15.22:0/1505418315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d3c130 msgr2=0x55e4d4d53d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.929+0000 7f8d5921c740 1 --2- 172.21.15.22:0/1505418315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d3c130 0x55e4d4d53d20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8d480cbe30 tx=0x7f8d48009920 comp rx=0 tx=0).stop 2024-08-20T01:32:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.929+0000 7f8d5921c740 1 -- 172.21.15.22:0/1505418315 shutdown_connections 2024-08-20T01:32:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.929+0000 7f8d5921c740 1 --2- 172.21.15.22:0/1505418315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d3c130 0x55e4d4d53d20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.929+0000 7f8d5921c740 1 --2- 172.21.15.22:0/1505418315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d301a0 0x55e4d4d38840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.929+0000 7f8d5921c740 1 --2- 172.21.15.22:0/1505418315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d2f880 0x55e4d4d33a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.929+0000 7f8d5921c740 1 -- 172.21.15.22:0/1505418315 >> 172.21.15.22:0/1505418315 conn(0x55e4d4d2d6b0 msgr2=0x55e4d4d3af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.929+0000 7f8d5921c740 1 -- 172.21.15.22:0/1505418315 shutdown_connections 2024-08-20T01:32:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.929+0000 7f8d5921c740 1 -- 172.21.15.22:0/1505418315 wait complete. 2024-08-20T01:32:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.929+0000 7f8d5921c740 1 -- start start 2024-08-20T01:32:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.929+0000 7f8d5921c740 1 Processor -- start 2024-08-20T01:32:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d5921c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d2f880 0x55e4d4d446f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d5921c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d301a0 0x55e4d4d3efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d5921c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d3c130 0x55e4d4d3f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d5921c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8d501aa570 con 0x55e4d4d3c130 2024-08-20T01:32:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d5921c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8d501ab9e0 con 0x55e4d4d2f880 2024-08-20T01:32:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d5921c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d501aac40 con 0x55e4d4d301a0 2024-08-20T01:32:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d5921c740 10 client.0 _ll_register_callbacks cb 0x7f8d48005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d553c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d3c130 0x55e4d4d3f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d54bbf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d2f880 0x55e4d4d446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d553c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d3c130 0x55e4d4d3f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56826/0 (socket says 172.21.15.22:56826) 2024-08-20T01:32:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d553c0640 1 -- 172.21.15.22:0/356165352 learned_addr learned my addr 172.21.15.22:0/356165352 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d4ffff640 1 --2- 172.21.15.22:0/356165352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d301a0 0x55e4d4d3efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d54bbf640 1 -- 172.21.15.22:0/356165352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d301a0 msgr2=0x55e4d4d3efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d54bbf640 1 --2- 172.21.15.22:0/356165352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d301a0 0x55e4d4d3efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d54bbf640 1 -- 172.21.15.22:0/356165352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d3c130 msgr2=0x55e4d4d3f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d54bbf640 1 --2- 172.21.15.22:0/356165352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d3c130 0x55e4d4d3f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d54bbf640 1 -- 172.21.15.22:0/356165352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4d4d3fd80 con 0x55e4d4d2f880 2024-08-20T01:32:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d553c0640 1 --2- 172.21.15.22:0/356165352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d3c130 0x55e4d4d3f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:32:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d54bbf640 1 --2- 172.21.15.22:0/356165352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d2f880 0x55e4d4d446f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009fd0 tx=0x7f8d440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32152da150798bdb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.930+0000 7f8d2ffff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:32:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.931+0000 7f8d2ffff640 1 -- 172.21.15.22:0/356165352 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4402b500 con 0x55e4d4d2f880 2024-08-20T01:32:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.931+0000 7f8d2ffff640 1 -- 172.21.15.22:0/356165352 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f8d4402b6a0 con 0x55e4d4d2f880 2024-08-20T01:32:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.931+0000 7f8d5921c740 1 -- 172.21.15.22:0/356165352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d480a8070 con 0x55e4d4d2f880 2024-08-20T01:32:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.931+0000 7f8d2ffff640 1 -- 172.21.15.22:0/356165352 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8d4402b8a0 con 0x55e4d4d2f880 2024-08-20T01:32:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.931+0000 7f8d5921c740 10 client.25232 fetch_fsmap learned FSMap version 27 2024-08-20T01:32:21.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.931+0000 7f8d5921c740 1 -- 172.21.15.22:0/356165352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e4d4db5de0 con 0x55e4d4d2f880 2024-08-20T01:32:21.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.931+0000 7f8d2ffff640 1 -- 172.21.15.22:0/356165352 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d480a8070 con 0x55e4d4d2f880 2024-08-20T01:32:21.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.931+0000 7f8d2ffff640 1 -- 172.21.15.22:0/356165352 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f8d44033430 con 0x55e4d4d2f880 2024-08-20T01:32:21.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.931+0000 7f8d5921c740 10 client.25232 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:32:21.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.931+0000 7f8d5921c740 10 client.25232 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:32:21.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.931+0000 7f8d5921c740 20 client.25232 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:21.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.931+0000 7f8d5921c740 1 --2- 172.21.15.22:0/356165352 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55e4d4db64f0 0x55e4d4db8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:21.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.931+0000 7f8d5921c740 4 client.25232 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:32:21.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.931+0000 7f8d5921c740 1 -- 172.21.15.22:0/356165352 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e4d4ca4320 con 0x55e4d4db64f0 2024-08-20T01:32:21.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.931+0000 7f8d4ffff640 1 --2- 172.21.15.22:0/356165352 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55e4d4db64f0 0x55e4d4db8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:21.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.932+0000 7f8d2ffff640 10 client.25232 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:32:21.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.932+0000 7f8d4ffff640 1 --2- 172.21.15.22:0/356165352 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55e4d4db64f0 0x55e4d4db8910 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a52f80840e8168c9 server_cookie=e197b36756ab4a4f in_seq=0 out_seq=0 2024-08-20T01:32:21.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.932+0000 7f8d2ffff640 1 -- 172.21.15.22:0/356165352 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e4d4ca4320 con 0x55e4d4db64f0 2024-08-20T01:32:21.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.932+0000 7f8d2ffff640 10 client.25232 handle_command_reply: tid=0 2024-08-20T01:32:21.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.932+0000 7f8d5921c740 1 client.25232 shutdown 2024-08-20T01:32:21.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.932+0000 7f8d5921c740 1 -- 172.21.15.22:0/356165352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d2f880 msgr2=0x55e4d4d446f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:21.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.932+0000 7f8d5921c740 1 --2- 172.21.15.22:0/356165352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d2f880 0x55e4d4d446f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009fd0 tx=0x7f8d440046c0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.932+0000 7f8d5921c740 1 -- 172.21.15.22:0/356165352 shutdown_connections 2024-08-20T01:32:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.932+0000 7f8d5921c740 1 --2- 172.21.15.22:0/356165352 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55e4d4db64f0 0x55e4d4db8910 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.932+0000 7f8d5921c740 1 --2- 172.21.15.22:0/356165352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4d4d3c130 0x55e4d4d3f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.932+0000 7f8d5921c740 1 --2- 172.21.15.22:0/356165352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e4d4d301a0 0x55e4d4d3efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.932+0000 7f8d5921c740 1 --2- 172.21.15.22:0/356165352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e4d4d2f880 0x55e4d4d446f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.932+0000 7f8d2ffff640 0 client.25232 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:32:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.932+0000 7f8d5921c740 1 -- 172.21.15.22:0/356165352 >> 172.21.15.22:0/356165352 conn(0x55e4d4d2d6b0 msgr2=0x55e4d4d39050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.932+0000 7f8d5921c740 1 -- 172.21.15.22:0/356165352 shutdown_connections 2024-08-20T01:32:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.932+0000 7f8d5921c740 1 -- 172.21.15.22:0/356165352 wait complete. 2024-08-20T01:32:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.932+0000 7f8d5921c740 20 client.25232 trim_cache size 0 max 16384 2024-08-20T01:32:21.938 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:32:21.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.933+0000 7f8d56e23640 1 -- 172.21.15.22:0/121015941 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d400b3bd0 msgr2=0x7f8d400b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:21.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.933+0000 7f8d56e23640 1 --2- 172.21.15.22:0/121015941 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d400b3bd0 0x7f8d400b6090 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55e4d4d32a00 tx=0x7f8d44005f90 comp rx=0 tx=0).stop 2024-08-20T01:32:21.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.933+0000 7f8d56e23640 1 -- 172.21.15.22:0/121015941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d50108e60 msgr2=0x7f8d5019e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:21.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.933+0000 7f8d56e23640 1 --2- 172.21.15.22:0/121015941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d50108e60 0x7f8d5019e820 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8d4802ade0 tx=0x7f8d48031660 comp rx=0 tx=0).stop 2024-08-20T01:32:21.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.933+0000 7f8d56e23640 1 -- 172.21.15.22:0/121015941 shutdown_connections 2024-08-20T01:32:21.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.933+0000 7f8d56e23640 1 --2- 172.21.15.22:0/121015941 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d400b3bd0 0x7f8d400b6090 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.933+0000 7f8d56e23640 1 --2- 172.21.15.22:0/121015941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d50108e60 0x7f8d5019e820 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.933+0000 7f8d56e23640 1 --2- 172.21.15.22:0/121015941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d501084e0 0x7f8d50199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.933+0000 7f8d56e23640 1 --2- 172.21.15.22:0/121015941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d50102ad0 0x7f8d50198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:21.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.933+0000 7f8d56e23640 1 -- 172.21.15.22:0/121015941 >> 172.21.15.22:0/121015941 conn(0x7f8d500fe540 msgr2=0x7f8d500feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:21.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.933+0000 7f8d56e23640 1 -- 172.21.15.22:0/121015941 shutdown_connections 2024-08-20T01:32:21.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:21.933+0000 7f8d56e23640 1 -- 172.21.15.22:0/121015941 wait complete. 2024-08-20T01:32:22.722 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:32:23.002 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:32:23.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:22 smithi077 ceph-mon[22251]: pgmap v383: 97 pgs: 97 active+clean; 36 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 647 op/s 2024-08-20T01:32:23.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:22 smithi022 ceph-mon[18709]: pgmap v383: 97 pgs: 97 active+clean; 36 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 647 op/s 2024-08-20T01:32:23.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:22 smithi134 ceph-mon[22511]: pgmap v383: 97 pgs: 97 active+clean; 36 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 647 op/s 2024-08-20T01:32:23.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.469+0000 7f4525098640 1 -- 172.21.15.22:0/674642564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45201019b0 msgr2=0x7f4520101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:23.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.469+0000 7f4525098640 1 --2- 172.21.15.22:0/674642564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45201019b0 0x7f4520101d90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4510009900 tx=0x7f451002a410 comp rx=0 tx=0).stop 2024-08-20T01:32:23.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.469+0000 7f4525098640 1 -- 172.21.15.22:0/674642564 shutdown_connections 2024-08-20T01:32:23.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.469+0000 7f4525098640 1 --2- 172.21.15.22:0/674642564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4520107d40 0x7f452010e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.469+0000 7f4525098640 1 --2- 172.21.15.22:0/674642564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45201073c0 0x7f4520107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.469+0000 7f4525098640 1 --2- 172.21.15.22:0/674642564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45201019b0 0x7f4520101d90 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.469+0000 7f4525098640 1 -- 172.21.15.22:0/674642564 >> 172.21.15.22:0/674642564 conn(0x7f45200fd400 msgr2=0x7f45200ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:23.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.469+0000 7f4525098640 1 -- 172.21.15.22:0/674642564 shutdown_connections 2024-08-20T01:32:23.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.469+0000 7f4525098640 1 -- 172.21.15.22:0/674642564 wait complete. 2024-08-20T01:32:23.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.470+0000 7f4525098640 1 Processor -- start 2024-08-20T01:32:23.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.471+0000 7f4525098640 1 -- start start 2024-08-20T01:32:23.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.471+0000 7f4525098640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45201019b0 0x7f4520197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:23.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.471+0000 7f4525098640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45201073c0 0x7f45201983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:23.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.471+0000 7f4525098640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4520107d40 0x7f452019d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:23.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.471+0000 7f4525098640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4520111a10 con 0x7f4520107d40 2024-08-20T01:32:23.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.471+0000 7f4525098640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4520111890 con 0x7f45201073c0 2024-08-20T01:32:23.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.471+0000 7f4525098640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4520111b90 con 0x7f45201019b0 2024-08-20T01:32:23.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.471+0000 7f451f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4520107d40 0x7f452019d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:23.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.471+0000 7f451f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4520107d40 0x7f452019d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56856/0 (socket says 172.21.15.22:56856) 2024-08-20T01:32:23.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.471+0000 7f451ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45201019b0 0x7f4520197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:23.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.471+0000 7f451f59e640 1 -- 172.21.15.22:0/246604435 learned_addr learned my addr 172.21.15.22:0/246604435 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:23.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.471+0000 7f451e59c640 1 --2- 172.21.15.22:0/246604435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45201073c0 0x7f45201983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:23.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.472+0000 7f451e59c640 1 -- 172.21.15.22:0/246604435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45201019b0 msgr2=0x7f4520197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:23.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.472+0000 7f451e59c640 1 --2- 172.21.15.22:0/246604435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45201019b0 0x7f4520197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.472+0000 7f451e59c640 1 -- 172.21.15.22:0/246604435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4520107d40 msgr2=0x7f452019d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:23.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.472+0000 7f451e59c640 1 --2- 172.21.15.22:0/246604435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4520107d40 0x7f452019d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.472+0000 7f451e59c640 1 -- 172.21.15.22:0/246604435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452019df50 con 0x7f45201073c0 2024-08-20T01:32:23.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.472+0000 7f451f59e640 1 --2- 172.21.15.22:0/246604435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4520107d40 0x7f452019d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:32:23.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.472+0000 7f451e59c640 1 --2- 172.21.15.22:0/246604435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45201073c0 0x7f45201983e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f450800d6d0 tx=0x7f450800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:23.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.472+0000 7f4517fff640 1 -- 172.21.15.22:0/246604435 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4508017070 con 0x7f45201073c0 2024-08-20T01:32:23.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.472+0000 7f4517fff640 1 -- 172.21.15.22:0/246604435 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4508009820 con 0x7f45201073c0 2024-08-20T01:32:23.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.472+0000 7f4525098640 1 -- 172.21.15.22:0/246604435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f452019e240 con 0x7f45201073c0 2024-08-20T01:32:23.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.472+0000 7f4517fff640 1 -- 172.21.15.22:0/246604435 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4508004c40 con 0x7f45201073c0 2024-08-20T01:32:23.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.472+0000 7f4525098640 1 -- 172.21.15.22:0/246604435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f452006b300 con 0x7f45201073c0 2024-08-20T01:32:23.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.475+0000 7f4517fff640 1 -- 172.21.15.22:0/246604435 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4508005220 con 0x7f45201073c0 2024-08-20T01:32:23.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.475+0000 7f4527491740 1 Processor -- start 2024-08-20T01:32:23.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.475+0000 7f4527491740 1 -- start start 2024-08-20T01:32:23.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.475+0000 7f4527491740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fc3880 0x558576fc3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:23.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.475+0000 7f4527491740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fc41a0 0x558576fcfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:23.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.476+0000 7f4527491740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fd0130 0x558576fd2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:23.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.476+0000 7f4527491740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558576f3a930 con 0x558576fc3880 2024-08-20T01:32:23.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.476+0000 7f4527491740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558576f29e30 con 0x558576fc41a0 2024-08-20T01:32:23.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.476+0000 7f4527491740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558576f2de70 con 0x558576fd0130 2024-08-20T01:32:23.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.476+0000 7f451f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fc3880 0x558576fc3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:23.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.476+0000 7f451f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fc3880 0x558576fc3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56858/0 (socket says 172.21.15.22:56858) 2024-08-20T01:32:23.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.476+0000 7f451f59e640 1 -- 172.21.15.22:0/1362578068 learned_addr learned my addr 172.21.15.22:0/1362578068 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:23.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.476+0000 7f451e59c640 1 --2- 172.21.15.22:0/1362578068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fd0130 0x558576fd2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:23.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.476+0000 7f451ed9d640 1 --2- 172.21.15.22:0/1362578068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fc41a0 0x558576fcfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:23.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.476+0000 7f451f59e640 1 -- 172.21.15.22:0/1362578068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fd0130 msgr2=0x558576fd2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:23.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.476+0000 7f451f59e640 1 --2- 172.21.15.22:0/1362578068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fd0130 0x558576fd2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.476+0000 7f451f59e640 1 -- 172.21.15.22:0/1362578068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fc41a0 msgr2=0x558576fcfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:23.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.476+0000 7f451f59e640 1 --2- 172.21.15.22:0/1362578068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fc41a0 0x558576fcfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.476+0000 7f451f59e640 1 -- 172.21.15.22:0/1362578068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558576c89650 con 0x558576fc3880 2024-08-20T01:32:23.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.476+0000 7f4517fff640 1 --2- 172.21.15.22:0/246604435 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f450c0b3c50 0x7f450c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:23.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.476+0000 7f451ed9d640 1 --2- 172.21.15.22:0/246604435 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f450c0b3c50 0x7f450c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:23.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.476+0000 7f451f59e640 1 --2- 172.21.15.22:0/1362578068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fc3880 0x558576fc3c60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f45180118e0 tx=0x7f4518011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76ff36f4ff23cad server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:23.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.476+0000 7f4517fff640 1 -- 172.21.15.22:0/246604435 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f45080e36b0 con 0x7f45201073c0 2024-08-20T01:32:23.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.477+0000 7f45157fa640 1 -- 172.21.15.22:0/1362578068 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451801e070 con 0x558576fc3880 2024-08-20T01:32:23.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.477+0000 7f45157fa640 1 -- 172.21.15.22:0/1362578068 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f451800fe70 con 0x558576fc3880 2024-08-20T01:32:23.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.477+0000 7f45157fa640 1 -- 172.21.15.22:0/1362578068 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4518019dc0 con 0x558576fc3880 2024-08-20T01:32:23.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.477+0000 7f4527491740 1 -- 172.21.15.22:0/1362578068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fc3880 msgr2=0x558576fc3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:23.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.477+0000 7f4527491740 1 --2- 172.21.15.22:0/1362578068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fc3880 0x558576fc3c60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f45180118e0 tx=0x7f4518011da0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.477+0000 7f451ed9d640 1 --2- 172.21.15.22:0/246604435 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f450c0b3c50 0x7f450c0b6110 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4510005ab0 tx=0x7f4510005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:23.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.478+0000 7f4527491740 1 -- 172.21.15.22:0/1362578068 shutdown_connections 2024-08-20T01:32:23.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.478+0000 7f4527491740 1 --2- 172.21.15.22:0/1362578068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fd0130 0x558576fd2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.478+0000 7f4527491740 1 --2- 172.21.15.22:0/1362578068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fc41a0 0x558576fcfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.478+0000 7f4527491740 1 --2- 172.21.15.22:0/1362578068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fc3880 0x558576fc3c60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.478+0000 7f4527491740 1 -- 172.21.15.22:0/1362578068 >> 172.21.15.22:0/1362578068 conn(0x558576fc16b0 msgr2=0x558576fc2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:23.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.478+0000 7f4527491740 1 -- 172.21.15.22:0/1362578068 shutdown_connections 2024-08-20T01:32:23.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.478+0000 7f4527491740 1 -- 172.21.15.22:0/1362578068 wait complete. 2024-08-20T01:32:23.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.478+0000 7f4527491740 1 -- start start 2024-08-20T01:32:23.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.478+0000 7f4527491740 1 Processor -- start 2024-08-20T01:32:23.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.478+0000 7f4527491740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fc3880 0x558576fcd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:23.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.478+0000 7f4527491740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fc41a0 0x558576fcd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:23.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.478+0000 7f4527491740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fd0130 0x558576fcdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:23.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.478+0000 7f4527491740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558576d8c700 con 0x558576fd0130 2024-08-20T01:32:23.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.478+0000 7f4527491740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558576eb0810 con 0x558576fc3880 2024-08-20T01:32:23.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.478+0000 7f4527491740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558576fd71f0 con 0x558576fc41a0 2024-08-20T01:32:23.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.478+0000 7f4527491740 10 client.0 _ll_register_callbacks cb 0x558576f23700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:23.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.479+0000 7f451e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fc41a0 0x558576fcd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:23.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.479+0000 7f451f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fd0130 0x558576fcdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:23.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.479+0000 7f451e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fc41a0 0x558576fcd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:43812/0 (socket says 172.21.15.22:43812) 2024-08-20T01:32:23.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.479+0000 7f451e59c640 1 -- 172.21.15.22:0/1713238065 learned_addr learned my addr 172.21.15.22:0/1713238065 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:23.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.479+0000 7f451ed9d640 1 --2- 172.21.15.22:0/1713238065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fc3880 0x558576fcd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:23.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.479+0000 7f451e59c640 1 -- 172.21.15.22:0/1713238065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fc3880 msgr2=0x558576fcd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:23.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.479+0000 7f451e59c640 1 --2- 172.21.15.22:0/1713238065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fc3880 0x558576fcd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.479+0000 7f451e59c640 1 -- 172.21.15.22:0/1713238065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fd0130 msgr2=0x558576fcdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:23.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.479+0000 7f451e59c640 1 --2- 172.21.15.22:0/1713238065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fd0130 0x558576fcdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.479+0000 7f451e59c640 1 -- 172.21.15.22:0/1713238065 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558576fe0550 con 0x558576fc41a0 2024-08-20T01:32:23.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.479+0000 7f451f59e640 1 --2- 172.21.15.22:0/1713238065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fd0130 0x558576fcdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:32:23.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.479+0000 7f451e59c640 1 --2- 172.21.15.22:0/1713238065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fc41a0 0x558576fcd5c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f45080a6690 tx=0x7f4508005760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=525d3c6204daf569 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:23.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.479+0000 7f45067fc640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:32:23.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.479+0000 7f45067fc640 1 -- 172.21.15.22:0/1713238065 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4508020030 con 0x558576fc41a0 2024-08-20T01:32:23.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.479+0000 7f4527491740 1 -- 172.21.15.22:0/1713238065 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558576ed9150 con 0x558576fc41a0 2024-08-20T01:32:23.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.479+0000 7f45067fc640 1 -- 172.21.15.22:0/1713238065 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f45080099d0 con 0x558576fc41a0 2024-08-20T01:32:23.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.480+0000 7f45067fc640 1 -- 172.21.15.22:0/1713238065 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f45080a9d80 con 0x558576fc41a0 2024-08-20T01:32:23.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.480+0000 7f4527491740 10 client.25258 fetch_fsmap learned FSMap version 27 2024-08-20T01:32:23.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.480+0000 7f4527491740 1 -- 172.21.15.22:0/1713238065 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558576fe2f50 con 0x558576fc41a0 2024-08-20T01:32:23.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.480+0000 7f45067fc640 1 -- 172.21.15.22:0/1713238065 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558576ed9150 con 0x558576fc41a0 2024-08-20T01:32:23.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.480+0000 7f45067fc640 1 -- 172.21.15.22:0/1713238065 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f45080a68a0 con 0x558576fc41a0 2024-08-20T01:32:23.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.480+0000 7f4527491740 10 client.25258 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:32:23.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.480+0000 7f4527491740 10 client.25258 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:32:23.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.480+0000 7f4527491740 20 client.25258 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:23.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.480+0000 7f4527491740 1 --2- 172.21.15.22:0/1713238065 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558576fe4340 0x558576fe6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:23.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.480+0000 7f4527491740 4 client.25258 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:32:23.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.480+0000 7f4527491740 1 -- 172.21.15.22:0/1713238065 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558576f3c880 con 0x558576fe4340 2024-08-20T01:32:23.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.480+0000 7f451ed9d640 1 --2- 172.21.15.22:0/1713238065 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558576fe4340 0x558576fe6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:23.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.481+0000 7f451ed9d640 1 --2- 172.21.15.22:0/1713238065 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558576fe4340 0x558576fe6760 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=287b7fc2e6332b server_cookie=7b72a28b585225b2 in_seq=0 out_seq=0 2024-08-20T01:32:23.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.481+0000 7f45067fc640 10 client.25258 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:23.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.482+0000 7f45067fc640 1 -- 172.21.15.22:0/1713238065 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558576f3c880 con 0x558576fe4340 2024-08-20T01:32:23.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.482+0000 7f45067fc640 10 client.25258 handle_command_reply: tid=0 2024-08-20T01:32:23.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.482+0000 7f4527491740 1 client.25258 shutdown 2024-08-20T01:32:23.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.482+0000 7f4527491740 1 -- 172.21.15.22:0/1713238065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fc41a0 msgr2=0x558576fcd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:23.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.482+0000 7f4527491740 1 --2- 172.21.15.22:0/1713238065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fc41a0 0x558576fcd5c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f45080a6690 tx=0x7f4508005760 comp rx=0 tx=0).stop 2024-08-20T01:32:23.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.482+0000 7f4527491740 1 -- 172.21.15.22:0/1713238065 shutdown_connections 2024-08-20T01:32:23.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.482+0000 7f4527491740 1 --2- 172.21.15.22:0/1713238065 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558576fe4340 0x558576fe6760 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.482+0000 7f4527491740 1 --2- 172.21.15.22:0/1713238065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fd0130 0x558576fcdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.482+0000 7f4527491740 1 --2- 172.21.15.22:0/1713238065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fc41a0 0x558576fcd5c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.482+0000 7f45067fc640 0 client.25258 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:23.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.482+0000 7f4527491740 1 --2- 172.21.15.22:0/1713238065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fc3880 0x558576fcd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.482+0000 7f4527491740 1 -- 172.21.15.22:0/1713238065 >> 172.21.15.22:0/1713238065 conn(0x558576fc16b0 msgr2=0x558576fc7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:23.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.482+0000 7f4527491740 1 -- 172.21.15.22:0/1713238065 shutdown_connections 2024-08-20T01:32:23.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.482+0000 7f4527491740 1 -- 172.21.15.22:0/1713238065 wait complete. 2024-08-20T01:32:23.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.482+0000 7f4527491740 20 client.25258 trim_cache size 0 max 16384 2024-08-20T01:32:23.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.496+0000 7f4527491740 1 Processor -- start 2024-08-20T01:32:23.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.496+0000 7f4527491740 1 -- start start 2024-08-20T01:32:23.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.496+0000 7f4527491740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fc3880 0x558576fec030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:23.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.496+0000 7f4527491740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fc41a0 0x558576fec570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:23.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.496+0000 7f4527491740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fd0130 0x558576fca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:23.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.496+0000 7f4527491740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f45201ae8e0 con 0x558576fc41a0 2024-08-20T01:32:23.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.496+0000 7f4527491740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f45201ac1b0 con 0x558576fd0130 2024-08-20T01:32:23.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.496+0000 7f4527491740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f45201aa000 con 0x558576fc3880 2024-08-20T01:32:23.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.496+0000 7f451e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fc41a0 0x558576fec570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:23.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.496+0000 7f451e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fc41a0 0x558576fec570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56876/0 (socket says 172.21.15.22:56876) 2024-08-20T01:32:23.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.496+0000 7f451e59c640 1 -- 172.21.15.22:0/3318006241 learned_addr learned my addr 172.21.15.22:0/3318006241 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:23.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.496+0000 7f451ed9d640 1 --2- 172.21.15.22:0/3318006241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fc3880 0x558576fec030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:23.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.496+0000 7f451f59e640 1 --2- 172.21.15.22:0/3318006241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fd0130 0x558576fca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:23.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.497+0000 7f451e59c640 1 -- 172.21.15.22:0/3318006241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fc3880 msgr2=0x558576fec030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:23.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.497+0000 7f451e59c640 1 --2- 172.21.15.22:0/3318006241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fc3880 0x558576fec030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.497+0000 7f451e59c640 1 -- 172.21.15.22:0/3318006241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fd0130 msgr2=0x558576fca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:23.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.497+0000 7f451e59c640 1 --2- 172.21.15.22:0/3318006241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fd0130 0x558576fca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.497+0000 7f451e59c640 1 -- 172.21.15.22:0/3318006241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558576fc2130 con 0x558576fc41a0 2024-08-20T01:32:23.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.497+0000 7f451e59c640 1 --2- 172.21.15.22:0/3318006241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fc41a0 0x558576fec570 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f45080e9820 tx=0x7f4508000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa5247b55682b98 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:23.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.497+0000 7f4514ff9640 1 -- 172.21.15.22:0/3318006241 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4508020070 con 0x558576fc41a0 2024-08-20T01:32:23.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.497+0000 7f4514ff9640 1 -- 172.21.15.22:0/3318006241 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45080c3020 con 0x558576fc41a0 2024-08-20T01:32:23.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.497+0000 7f4514ff9640 1 -- 172.21.15.22:0/3318006241 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45080099d0 con 0x558576fc41a0 2024-08-20T01:32:23.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.498+0000 7f4527491740 1 -- 172.21.15.22:0/3318006241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fc41a0 msgr2=0x558576fec570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:23.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.498+0000 7f4527491740 1 --2- 172.21.15.22:0/3318006241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fc41a0 0x558576fec570 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f45080e9820 tx=0x7f4508000bc0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.498+0000 7f4527491740 1 -- 172.21.15.22:0/3318006241 shutdown_connections 2024-08-20T01:32:23.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.498+0000 7f4527491740 1 --2- 172.21.15.22:0/3318006241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fd0130 0x558576fca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.498+0000 7f4527491740 1 --2- 172.21.15.22:0/3318006241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fc41a0 0x558576fec570 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.498+0000 7f4527491740 1 --2- 172.21.15.22:0/3318006241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fc3880 0x558576fec030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.498+0000 7f4527491740 1 -- 172.21.15.22:0/3318006241 >> 172.21.15.22:0/3318006241 conn(0x558576fc16b0 msgr2=0x558576fc8330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:23.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.498+0000 7f4527491740 1 -- 172.21.15.22:0/3318006241 shutdown_connections 2024-08-20T01:32:23.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.498+0000 7f4527491740 1 -- 172.21.15.22:0/3318006241 wait complete. 2024-08-20T01:32:23.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.498+0000 7f4527491740 1 -- start start 2024-08-20T01:32:23.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.498+0000 7f4527491740 1 Processor -- start 2024-08-20T01:32:23.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f4527491740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fc3880 0x558576fd9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:23.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f4527491740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fc41a0 0x558576fd9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:23.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f4527491740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fd0130 0x558576fd9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:23.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f4527491740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f45201aa670 con 0x558576fd0130 2024-08-20T01:32:23.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f4527491740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f45201abae0 con 0x558576fc41a0 2024-08-20T01:32:23.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f4527491740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f45201aad40 con 0x558576fc3880 2024-08-20T01:32:23.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f4527491740 10 client.0 _ll_register_callbacks cb 0x7f45080e9770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:23.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f451f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fd0130 0x558576fd9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:23.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f451f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fd0130 0x558576fd9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56880/0 (socket says 172.21.15.22:56880) 2024-08-20T01:32:23.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f451f59e640 1 -- 172.21.15.22:0/1093327100 learned_addr learned my addr 172.21.15.22:0/1093327100 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:23.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f451e59c640 1 --2- 172.21.15.22:0/1093327100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fc41a0 0x558576fd9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:23.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f451ed9d640 1 --2- 172.21.15.22:0/1093327100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fc3880 0x558576fd9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:23.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f451f59e640 1 -- 172.21.15.22:0/1093327100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fc3880 msgr2=0x558576fd9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:23.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f451f59e640 1 --2- 172.21.15.22:0/1093327100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fc3880 0x558576fd9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f451f59e640 1 -- 172.21.15.22:0/1093327100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fc41a0 msgr2=0x558576fd9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:23.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f451f59e640 1 --2- 172.21.15.22:0/1093327100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fc41a0 0x558576fd9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f451f59e640 1 -- 172.21.15.22:0/1093327100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55857704d0d0 con 0x558576fd0130 2024-08-20T01:32:23.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f451e59c640 1 --2- 172.21.15.22:0/1093327100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fc41a0 0x558576fd9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:32:23.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f451f59e640 1 --2- 172.21.15.22:0/1093327100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fd0130 0x558576fd9ed0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f45180118e0 tx=0x7f4518019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6d247351356bc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:23.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f45067fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:32:23.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f45067fc640 1 -- 172.21.15.22:0/1093327100 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451801e040 con 0x558576fd0130 2024-08-20T01:32:23.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f45067fc640 1 -- 172.21.15.22:0/1093327100 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f4518004c00 con 0x558576fd0130 2024-08-20T01:32:23.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.499+0000 7f4527491740 1 -- 172.21.15.22:0/1093327100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45080c3020 con 0x558576fd0130 2024-08-20T01:32:23.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.500+0000 7f45067fc640 1 -- 172.21.15.22:0/1093327100 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4518034050 con 0x558576fd0130 2024-08-20T01:32:23.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.500+0000 7f4527491740 10 client.15648 fetch_fsmap learned FSMap version 27 2024-08-20T01:32:23.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.500+0000 7f4527491740 1 -- 172.21.15.22:0/1093327100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55857704e3d0 con 0x558576fd0130 2024-08-20T01:32:23.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.500+0000 7f45067fc640 1 -- 172.21.15.22:0/1093327100 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45080c3020 con 0x558576fd0130 2024-08-20T01:32:23.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.500+0000 7f45067fc640 1 -- 172.21.15.22:0/1093327100 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f45180054b0 con 0x558576fd0130 2024-08-20T01:32:23.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.500+0000 7f4527491740 10 client.15648 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:32:23.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.500+0000 7f4527491740 10 client.15648 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:32:23.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.500+0000 7f4527491740 20 client.15648 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:23.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.500+0000 7f4527491740 1 --2- 172.21.15.22:0/1093327100 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55857704e9e0 0x558577050e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:23.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.500+0000 7f4527491740 4 client.15648 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:32:23.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.500+0000 7f4527491740 1 -- 172.21.15.22:0/1093327100 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558576fbc880 con 0x55857704e9e0 2024-08-20T01:32:23.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.500+0000 7f451ed9d640 1 --2- 172.21.15.22:0/1093327100 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55857704e9e0 0x558577050e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:23.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.501+0000 7f451ed9d640 1 --2- 172.21.15.22:0/1093327100 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55857704e9e0 0x558577050e00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73e0525fc900aedb server_cookie=3a2c50df7e327e13 in_seq=0 out_seq=0 2024-08-20T01:32:23.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.501+0000 7f45067fc640 10 client.15648 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:23.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.502+0000 7f45067fc640 1 -- 172.21.15.22:0/1093327100 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558576fbc880 con 0x55857704e9e0 2024-08-20T01:32:23.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.502+0000 7f45067fc640 10 client.15648 handle_command_reply: tid=0 2024-08-20T01:32:23.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.502+0000 7f4527491740 1 client.15648 shutdown 2024-08-20T01:32:23.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.502+0000 7f4527491740 1 -- 172.21.15.22:0/1093327100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fd0130 msgr2=0x558576fd9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:23.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.502+0000 7f4527491740 1 --2- 172.21.15.22:0/1093327100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fd0130 0x558576fd9ed0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f45180118e0 tx=0x7f4518019740 comp rx=0 tx=0).stop 2024-08-20T01:32:23.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.502+0000 7f4527491740 1 -- 172.21.15.22:0/1093327100 shutdown_connections 2024-08-20T01:32:23.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.502+0000 7f4527491740 1 --2- 172.21.15.22:0/1093327100 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55857704e9e0 0x558577050e00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.502+0000 7f4527491740 1 --2- 172.21.15.22:0/1093327100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558576fd0130 0x558576fd9ed0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.502+0000 7f4527491740 1 --2- 172.21.15.22:0/1093327100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558576fc41a0 0x558576fd9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.502+0000 7f4527491740 1 --2- 172.21.15.22:0/1093327100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558576fc3880 0x558576fd9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.502+0000 7f4527491740 1 -- 172.21.15.22:0/1093327100 >> 172.21.15.22:0/1093327100 conn(0x558576fc16b0 msgr2=0x558576fce6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:23.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.502+0000 7f45067fc640 0 client.15648 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:23.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.502+0000 7f4527491740 1 -- 172.21.15.22:0/1093327100 shutdown_connections 2024-08-20T01:32:23.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.502+0000 7f4527491740 1 -- 172.21.15.22:0/1093327100 wait complete. 2024-08-20T01:32:23.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.502+0000 7f4527491740 20 client.15648 trim_cache size 0 max 16384 2024-08-20T01:32:23.508 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:32:23.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.503+0000 7f4525098640 1 -- 172.21.15.22:0/246604435 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f450c0b3c50 msgr2=0x7f450c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:23.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.503+0000 7f4525098640 1 --2- 172.21.15.22:0/246604435 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f450c0b3c50 0x7f450c0b6110 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4510005ab0 tx=0x7f4510005a20 comp rx=0 tx=0).stop 2024-08-20T01:32:23.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.503+0000 7f4525098640 1 -- 172.21.15.22:0/246604435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45201073c0 msgr2=0x7f45201983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:23.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.503+0000 7f4525098640 1 --2- 172.21.15.22:0/246604435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45201073c0 0x7f45201983e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f450800d6d0 tx=0x7f450800db90 comp rx=0 tx=0).stop 2024-08-20T01:32:23.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.503+0000 7f4525098640 1 -- 172.21.15.22:0/246604435 shutdown_connections 2024-08-20T01:32:23.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.503+0000 7f4525098640 1 --2- 172.21.15.22:0/246604435 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f450c0b3c50 0x7f450c0b6110 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.503+0000 7f4525098640 1 --2- 172.21.15.22:0/246604435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4520107d40 0x7f452019d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.503+0000 7f4525098640 1 --2- 172.21.15.22:0/246604435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45201073c0 0x7f45201983e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.503+0000 7f4525098640 1 --2- 172.21.15.22:0/246604435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45201019b0 0x7f4520197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:23.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.503+0000 7f4525098640 1 -- 172.21.15.22:0/246604435 >> 172.21.15.22:0/246604435 conn(0x7f45200fd400 msgr2=0x7f45200ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:23.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.503+0000 7f4525098640 1 -- 172.21.15.22:0/246604435 shutdown_connections 2024-08-20T01:32:23.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:23.503+0000 7f4525098640 1 -- 172.21.15.22:0/246604435 wait complete. 2024-08-20T01:32:25.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:24 smithi077 ceph-mon[22251]: pgmap v384: 97 pgs: 97 active+clean; 36 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 573 op/s 2024-08-20T01:32:25.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:24 smithi022 ceph-mon[18709]: pgmap v384: 97 pgs: 97 active+clean; 36 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 573 op/s 2024-08-20T01:32:25.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:24 smithi134 ceph-mon[22511]: pgmap v384: 97 pgs: 97 active+clean; 36 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 573 op/s 2024-08-20T01:32:25.291 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:32:25.291 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:32:25.553 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:32:26.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.166+0000 7f1edb469640 1 -- 172.21.15.22:0/2988941518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ed4107b90 msgr2=0x7f1ed410e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:26.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.166+0000 7f1edb469640 1 --2- 172.21.15.22:0/2988941518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ed4107b90 0x7f1ed410e390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009be0 tx=0x7f1ecc02a6d0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.168+0000 7f1edb469640 1 -- 172.21.15.22:0/2988941518 shutdown_connections 2024-08-20T01:32:26.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.168+0000 7f1edb469640 1 --2- 172.21.15.22:0/2988941518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ed4107b90 0x7f1ed410e390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.168+0000 7f1edb469640 1 --2- 172.21.15.22:0/2988941518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ed4107210 0x7f1ed4107650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.168+0000 7f1edb469640 1 --2- 172.21.15.22:0/2988941518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ed4101800 0x7f1ed4101be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.168+0000 7f1edb469640 1 -- 172.21.15.22:0/2988941518 >> 172.21.15.22:0/2988941518 conn(0x7f1ed40fd2d0 msgr2=0x7f1ed40ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:26.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.171+0000 7f1edb469640 1 -- 172.21.15.22:0/2988941518 shutdown_connections 2024-08-20T01:32:26.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.172+0000 7f1edb469640 1 -- 172.21.15.22:0/2988941518 wait complete. 2024-08-20T01:32:26.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.173+0000 7f1edb469640 1 Processor -- start 2024-08-20T01:32:26.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.175+0000 7f1edb469640 1 -- start start 2024-08-20T01:32:26.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.175+0000 7f1edb469640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ed4101800 0x7f1ed410a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:26.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.175+0000 7f1edb469640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ed4107210 0x7f1ed410ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:26.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.175+0000 7f1edb469640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ed4107b90 0x7f1ed410b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:26.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.175+0000 7f1edb469640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed4110740 con 0x7f1ed4107210 2024-08-20T01:32:26.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.175+0000 7f1edb469640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed41105c0 con 0x7f1ed4107b90 2024-08-20T01:32:26.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.175+0000 7f1edb469640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed41108c0 con 0x7f1ed4101800 2024-08-20T01:32:26.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.176+0000 7f1ed9c66640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ed4107210 0x7f1ed410ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:26.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.176+0000 7f1ed9c66640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ed4107210 0x7f1ed410ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56904/0 (socket says 172.21.15.22:56904) 2024-08-20T01:32:26.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.176+0000 7f1ed9c66640 1 -- 172.21.15.22:0/2998793144 learned_addr learned my addr 172.21.15.22:0/2998793144 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:26.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.176+0000 7f1eda467640 1 --2- 172.21.15.22:0/2998793144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ed4101800 0x7f1ed410a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:26.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.177+0000 7f1edac68640 1 --2- 172.21.15.22:0/2998793144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ed4107b90 0x7f1ed410b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:26.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.177+0000 7f1ed9c66640 1 -- 172.21.15.22:0/2998793144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ed4101800 msgr2=0x7f1ed410a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:26.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.177+0000 7f1ed9c66640 1 --2- 172.21.15.22:0/2998793144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ed4101800 0x7f1ed410a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.177+0000 7f1ed9c66640 1 -- 172.21.15.22:0/2998793144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ed4107b90 msgr2=0x7f1ed410b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:26.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.177+0000 7f1ed9c66640 1 --2- 172.21.15.22:0/2998793144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ed4107b90 0x7f1ed410b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.177+0000 7f1ed9c66640 1 -- 172.21.15.22:0/2998793144 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed40749a0 con 0x7f1ed4107210 2024-08-20T01:32:26.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.178+0000 7f1ed9c66640 1 --2- 172.21.15.22:0/2998793144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ed4107210 0x7f1ed410ab50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000b4a0 tx=0x7f1ed000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:26.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.178+0000 7f1ecb7fe640 1 -- 172.21.15.22:0/2998793144 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0015020 con 0x7f1ed4107210 2024-08-20T01:32:26.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.178+0000 7f1ecb7fe640 1 -- 172.21.15.22:0/2998793144 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ed0011ce0 con 0x7f1ed4107210 2024-08-20T01:32:26.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.179+0000 7f1ecb7fe640 1 -- 172.21.15.22:0/2998793144 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0010dc0 con 0x7f1ed4107210 2024-08-20T01:32:26.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.180+0000 7f1edb469640 1 -- 172.21.15.22:0/2998793144 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed4074c90 con 0x7f1ed4107210 2024-08-20T01:32:26.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.180+0000 7f1edb469640 1 -- 172.21.15.22:0/2998793144 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed41b4660 con 0x7f1ed4107210 2024-08-20T01:32:26.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.185+0000 7f1ecb7fe640 1 -- 172.21.15.22:0/2998793144 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1ed0018020 con 0x7f1ed4107210 2024-08-20T01:32:26.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.187+0000 7f1ecb7fe640 1 --2- 172.21.15.22:0/2998793144 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f1ec00b3e90 0x7f1ec00b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:26.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.188+0000 7f1ecb7fe640 1 -- 172.21.15.22:0/2998793144 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f1ed00e3360 con 0x7f1ed4107210 2024-08-20T01:32:26.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.188+0000 7f1edeac4740 1 Processor -- start 2024-08-20T01:32:26.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.188+0000 7f1edeac4740 1 -- start start 2024-08-20T01:32:26.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.189+0000 7f1edeac4740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54530 0x5555bec54910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:26.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.189+0000 7f1edeac4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec54e50 0x5555bec608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:26.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.189+0000 7f1edeac4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec60de0 0x5555bec631d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:26.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.189+0000 7f1edeac4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5555bebca940 con 0x5555bec60de0 2024-08-20T01:32:26.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.189+0000 7f1edeac4740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5555bebb9e40 con 0x5555bec54530 2024-08-20T01:32:26.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.189+0000 7f1edeac4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5555bebbde80 con 0x5555bec54e50 2024-08-20T01:32:26.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.189+0000 7f1eda467640 1 --2- 172.21.15.22:0/2998793144 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f1ec00b3e90 0x7f1ec00b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:26.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.190+0000 7f1edac68640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec60de0 0x5555bec631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:26.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.190+0000 7f1edac68640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec60de0 0x5555bec631d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56906/0 (socket says 172.21.15.22:56906) 2024-08-20T01:32:26.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.190+0000 7f1edac68640 1 -- 172.21.15.22:0/83431629 learned_addr learned my addr 172.21.15.22:0/83431629 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:26.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.191+0000 7f1eda467640 1 --2- 172.21.15.22:0/83431629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54530 0x5555bec54910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:26.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.191+0000 7f1edac68640 1 -- 172.21.15.22:0/83431629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec54e50 msgr2=0x5555bec608a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:32:26.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.191+0000 7f1edac68640 1 --2- 172.21.15.22:0/83431629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec54e50 0x5555bec608a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.191+0000 7f1edac68640 1 -- 172.21.15.22:0/83431629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54530 msgr2=0x5555bec54910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:26.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.191+0000 7f1edac68640 1 --2- 172.21.15.22:0/83431629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54530 0x5555bec54910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.191+0000 7f1edac68640 1 -- 172.21.15.22:0/83431629 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555beb56520 con 0x5555bec60de0 2024-08-20T01:32:26.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.192+0000 7f1edac68640 1 --2- 172.21.15.22:0/83431629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec60de0 0x5555bec631d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009d00 tx=0x7f1ecc031540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d05a46c06e30ab server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:26.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.192+0000 7f1ec8ff9640 1 -- 172.21.15.22:0/83431629 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc040020 con 0x5555bec60de0 2024-08-20T01:32:26.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.193+0000 7f1eda467640 1 --2- 172.21.15.22:0/2998793144 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f1ec00b3e90 0x7f1ec00b6350 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4005fd0 tx=0x7f1ec4015040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:26.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.193+0000 7f1ec8ff9640 1 -- 172.21.15.22:0/83431629 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ecc037040 con 0x5555bec60de0 2024-08-20T01:32:26.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.194+0000 7f1edeac4740 1 -- 172.21.15.22:0/83431629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec60de0 msgr2=0x5555bec631d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:26.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.194+0000 7f1edeac4740 1 --2- 172.21.15.22:0/83431629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec60de0 0x5555bec631d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009d00 tx=0x7f1ecc031540 comp rx=0 tx=0).stop 2024-08-20T01:32:26.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.207+0000 7f1edeac4740 1 -- 172.21.15.22:0/83431629 shutdown_connections 2024-08-20T01:32:26.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.207+0000 7f1edeac4740 1 --2- 172.21.15.22:0/83431629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec60de0 0x5555bec631d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.207+0000 7f1edeac4740 1 --2- 172.21.15.22:0/83431629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec54e50 0x5555bec608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.207+0000 7f1edeac4740 1 --2- 172.21.15.22:0/83431629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54530 0x5555bec54910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.207+0000 7f1edeac4740 1 -- 172.21.15.22:0/83431629 >> 172.21.15.22:0/83431629 conn(0x5555bec52360 msgr2=0x5555bec53500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:26.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.211+0000 7f1edeac4740 1 -- 172.21.15.22:0/83431629 shutdown_connections 2024-08-20T01:32:26.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.211+0000 7f1edeac4740 1 -- 172.21.15.22:0/83431629 wait complete. 2024-08-20T01:32:26.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.212+0000 7f1edeac4740 1 -- start start 2024-08-20T01:32:26.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.212+0000 7f1edeac4740 1 Processor -- start 2024-08-20T01:32:26.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.213+0000 7f1edeac4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec54530 0x5555bec5dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:26.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.213+0000 7f1edeac4740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54e50 0x5555bec5e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:26.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.213+0000 7f1edeac4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec60de0 0x5555bec5e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:26.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.213+0000 7f1edeac4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5555bea1c890 con 0x5555bec54530 2024-08-20T01:32:26.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.213+0000 7f1edeac4740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5555beb40700 con 0x5555bec54e50 2024-08-20T01:32:26.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.213+0000 7f1edeac4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5555bec63b20 con 0x5555bec60de0 2024-08-20T01:32:26.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.213+0000 7f1edeac4740 10 client.0 _ll_register_callbacks cb 0x5555bebb56f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:26.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.213+0000 7f1edac68640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec60de0 0x5555bec5e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:26.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.213+0000 7f1edac68640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec60de0 0x5555bec5e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:43848/0 (socket says 172.21.15.22:43848) 2024-08-20T01:32:26.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.213+0000 7f1edac68640 1 -- 172.21.15.22:0/2386613649 learned_addr learned my addr 172.21.15.22:0/2386613649 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:26.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.214+0000 7f1eda467640 1 --2- 172.21.15.22:0/2386613649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec54530 0x5555bec5dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:26.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.215+0000 7f1ed9c66640 1 --2- 172.21.15.22:0/2386613649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54e50 0x5555bec5e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:26.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.215+0000 7f1edac68640 1 -- 172.21.15.22:0/2386613649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54e50 msgr2=0x5555bec5e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:26.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.215+0000 7f1edac68640 1 --2- 172.21.15.22:0/2386613649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54e50 0x5555bec5e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.215+0000 7f1edac68640 1 -- 172.21.15.22:0/2386613649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec54530 msgr2=0x5555bec5dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:26.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.215+0000 7f1edac68640 1 --2- 172.21.15.22:0/2386613649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec54530 0x5555bec5dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.215+0000 7f1edac68640 1 -- 172.21.15.22:0/2386613649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555be919930 con 0x5555bec60de0 2024-08-20T01:32:26.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.218+0000 7f1edac68640 1 --2- 172.21.15.22:0/2386613649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec60de0 0x5555bec5e810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc02a710 tx=0x7f1ecc030650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=499e1eb8316e5b4c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:26.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.218+0000 7f1ebdffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:32:26.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.218+0000 7f1ebdffb640 1 -- 172.21.15.22:0/2386613649 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc040070 con 0x5555bec60de0 2024-08-20T01:32:26.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.219+0000 7f1ebdffb640 1 -- 172.21.15.22:0/2386613649 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f1ecc003d80 con 0x5555bec60de0 2024-08-20T01:32:26.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.220+0000 7f1edeac4740 1 -- 172.21.15.22:0/2386613649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ecc037040 con 0x5555bec60de0 2024-08-20T01:32:26.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.221+0000 7f1ebdffb640 1 -- 172.21.15.22:0/2386613649 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1ecc055050 con 0x5555bec60de0 2024-08-20T01:32:26.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.224+0000 7f1edeac4740 10 client.25273 fetch_fsmap learned FSMap version 27 2024-08-20T01:32:26.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.224+0000 7f1edeac4740 1 -- 172.21.15.22:0/2386613649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5555bec6f710 con 0x5555bec60de0 2024-08-20T01:32:26.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.227+0000 7f1ebdffb640 1 -- 172.21.15.22:0/2386613649 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ecc037040 con 0x5555bec60de0 2024-08-20T01:32:26.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.228+0000 7f1ebdffb640 1 -- 172.21.15.22:0/2386613649 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1ecc004040 con 0x5555bec60de0 2024-08-20T01:32:26.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.229+0000 7f1edeac4740 10 client.25273 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:32:26.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.229+0000 7f1edeac4740 10 client.25273 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:32:26.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.229+0000 7f1edeac4740 20 client.25273 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:26.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.229+0000 7f1edeac4740 1 --2- 172.21.15.22:0/2386613649 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5555bec70cc0 0x5555bec73100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:26.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.229+0000 7f1edeac4740 4 client.25273 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:32:26.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.229+0000 7f1edeac4740 1 -- 172.21.15.22:0/2386613649 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555bebcc890 con 0x5555bec70cc0 2024-08-20T01:32:26.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.230+0000 7f1eda467640 1 --2- 172.21.15.22:0/2386613649 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5555bec70cc0 0x5555bec73100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:26.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.236+0000 7f1eda467640 1 --2- 172.21.15.22:0/2386613649 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5555bec70cc0 0x5555bec73100 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa3d545b37e907c5 server_cookie=344830d48ddb93da in_seq=0 out_seq=0 2024-08-20T01:32:26.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.236+0000 7f1ebdffb640 10 client.25273 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:26.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.242+0000 7f1ebdffb640 1 -- 172.21.15.22:0/2386613649 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5555bebcc890 con 0x5555bec70cc0 2024-08-20T01:32:26.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.242+0000 7f1ebdffb640 10 client.25273 handle_command_reply: tid=0 2024-08-20T01:32:26.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.242+0000 7f1edeac4740 1 client.25273 shutdown 2024-08-20T01:32:26.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.243+0000 7f1edeac4740 1 -- 172.21.15.22:0/2386613649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec60de0 msgr2=0x5555bec5e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:26.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.243+0000 7f1edeac4740 1 --2- 172.21.15.22:0/2386613649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec60de0 0x5555bec5e810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc02a710 tx=0x7f1ecc030650 comp rx=0 tx=0).stop 2024-08-20T01:32:26.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.243+0000 7f1edeac4740 1 -- 172.21.15.22:0/2386613649 shutdown_connections 2024-08-20T01:32:26.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.243+0000 7f1edeac4740 1 --2- 172.21.15.22:0/2386613649 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5555bec70cc0 0x5555bec73100 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.243+0000 7f1edeac4740 1 --2- 172.21.15.22:0/2386613649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec60de0 0x5555bec5e810 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.243+0000 7f1ebdffb640 0 client.25273 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:26.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.243+0000 7f1edeac4740 1 --2- 172.21.15.22:0/2386613649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54e50 0x5555bec5e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.243+0000 7f1edeac4740 1 --2- 172.21.15.22:0/2386613649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec54530 0x5555bec5dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.243+0000 7f1edeac4740 1 -- 172.21.15.22:0/2386613649 >> 172.21.15.22:0/2386613649 conn(0x5555bec52360 msgr2=0x5555bec57f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:26.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.244+0000 7f1edeac4740 1 -- 172.21.15.22:0/2386613649 shutdown_connections 2024-08-20T01:32:26.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.245+0000 7f1edeac4740 1 -- 172.21.15.22:0/2386613649 wait complete. 2024-08-20T01:32:26.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.245+0000 7f1edeac4740 20 client.25273 trim_cache size 0 max 16384 2024-08-20T01:32:26.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.287+0000 7f1edeac4740 1 Processor -- start 2024-08-20T01:32:26.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.290+0000 7f1edeac4740 1 -- start start 2024-08-20T01:32:26.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.291+0000 7f1edeac4740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54530 0x5555bec586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:26.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.291+0000 7f1edeac4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec54e50 0x5555bec51350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:26.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.291+0000 7f1edeac4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec60de0 0x5555bec789d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:26.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.291+0000 7f1edeac4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed41bf740 con 0x5555bec54e50 2024-08-20T01:32:26.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.291+0000 7f1edeac4740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed41bd010 con 0x5555bec54530 2024-08-20T01:32:26.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.291+0000 7f1edeac4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed41bae60 con 0x5555bec60de0 2024-08-20T01:32:26.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.291+0000 7f1edac68640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec60de0 0x5555bec789d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:26.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.292+0000 7f1eda467640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54530 0x5555bec586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:26.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.292+0000 7f1eda467640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54530 0x5555bec586f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:53044/0 (socket says 172.21.15.22:53044) 2024-08-20T01:32:26.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.292+0000 7f1eda467640 1 -- 172.21.15.22:0/3244492769 learned_addr learned my addr 172.21.15.22:0/3244492769 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:26.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.295+0000 7f1eda467640 1 -- 172.21.15.22:0/3244492769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec60de0 msgr2=0x5555bec789d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:26.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.295+0000 7f1eda467640 1 --2- 172.21.15.22:0/3244492769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec60de0 0x5555bec789d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.295+0000 7f1eda467640 1 -- 172.21.15.22:0/3244492769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec54e50 msgr2=0x5555bec51350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:26.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.295+0000 7f1eda467640 1 --2- 172.21.15.22:0/3244492769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec54e50 0x5555bec51350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.295+0000 7f1eda467640 1 -- 172.21.15.22:0/3244492769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555bec52190 con 0x5555bec54530 2024-08-20T01:32:26.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.295+0000 7f1eda467640 1 --2- 172.21.15.22:0/3244492769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54530 0x5555bec586f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009fd0 tx=0x7f1ec4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86d556d0a51a1f9e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:26.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.296+0000 7f1ebffff640 1 -- 172.21.15.22:0/3244492769 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4030070 con 0x5555bec54530 2024-08-20T01:32:26.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.297+0000 7f1ebffff640 1 -- 172.21.15.22:0/3244492769 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ec4003bc0 con 0x5555bec54530 2024-08-20T01:32:26.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.297+0000 7f1ebffff640 1 -- 172.21.15.22:0/3244492769 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec402a2d0 con 0x5555bec54530 2024-08-20T01:32:26.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.298+0000 7f1edeac4740 1 -- 172.21.15.22:0/3244492769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54530 msgr2=0x5555bec586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:26.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.298+0000 7f1edeac4740 1 --2- 172.21.15.22:0/3244492769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54530 0x5555bec586f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009fd0 tx=0x7f1ec4004730 comp rx=0 tx=0).stop 2024-08-20T01:32:26.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.299+0000 7f1edeac4740 1 -- 172.21.15.22:0/3244492769 shutdown_connections 2024-08-20T01:32:26.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.299+0000 7f1edeac4740 1 --2- 172.21.15.22:0/3244492769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec60de0 0x5555bec789d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.299+0000 7f1edeac4740 1 --2- 172.21.15.22:0/3244492769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec54e50 0x5555bec51350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.299+0000 7f1edeac4740 1 --2- 172.21.15.22:0/3244492769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54530 0x5555bec586f0 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009fd0 tx=0x7f1ec4004730 comp rx=0 tx=0).stop 2024-08-20T01:32:26.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.299+0000 7f1edeac4740 1 -- 172.21.15.22:0/3244492769 >> 172.21.15.22:0/3244492769 conn(0x5555bec52360 msgr2=0x5555bec50c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:26.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.301+0000 7f1edeac4740 1 -- 172.21.15.22:0/3244492769 shutdown_connections 2024-08-20T01:32:26.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.301+0000 7f1edeac4740 1 -- 172.21.15.22:0/3244492769 wait complete. 2024-08-20T01:32:26.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.301+0000 7f1edeac4740 1 -- start start 2024-08-20T01:32:26.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.302+0000 7f1edeac4740 1 Processor -- start 2024-08-20T01:32:26.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.302+0000 7f1edeac4740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54e50 0x5555bec64c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:26.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.302+0000 7f1edeac4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec60de0 0x5555bec65160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:26.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.303+0000 7f1edeac4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec656a0 0x5555becda9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:26.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.303+0000 7f1edeac4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed41bb4d0 con 0x5555bec656a0 2024-08-20T01:32:26.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.303+0000 7f1edeac4740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed41bc940 con 0x5555bec54e50 2024-08-20T01:32:26.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.303+0000 7f1eda467640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54e50 0x5555bec64c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:26.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.303+0000 7f1eda467640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54e50 0x5555bec64c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:53054/0 (socket says 172.21.15.22:53054) 2024-08-20T01:32:26.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.303+0000 7f1eda467640 1 -- 172.21.15.22:0/1760106620 learned_addr learned my addr 172.21.15.22:0/1760106620 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:26.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.303+0000 7f1edeac4740 1 -- 172.21.15.22:0/1760106620 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed41bbba0 con 0x5555bec60de0 2024-08-20T01:32:26.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.303+0000 7f1edeac4740 10 client.0 _ll_register_callbacks cb 0x7f1ec4009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:26.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.303+0000 7f1ed9c66640 1 --2- 172.21.15.22:0/1760106620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec60de0 0x5555bec65160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:26.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.303+0000 7f1eda467640 1 -- 172.21.15.22:0/1760106620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec60de0 msgr2=0x5555bec65160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:26.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.303+0000 7f1eda467640 1 --2- 172.21.15.22:0/1760106620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec60de0 0x5555bec65160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.303+0000 7f1eda467640 1 -- 172.21.15.22:0/1760106620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec656a0 msgr2=0x5555becda9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:26.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.303+0000 7f1eda467640 1 --2- 172.21.15.22:0/1760106620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec656a0 0x5555becda9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.303+0000 7f1eda467640 1 -- 172.21.15.22:0/1760106620 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555bec52de0 con 0x5555bec54e50 2024-08-20T01:32:26.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.304+0000 7f1eda467640 1 --2- 172.21.15.22:0/1760106620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54e50 0x5555bec64c20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4005890 tx=0x7f1ec4009e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d91a410db0e4673b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:26.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.304+0000 7f1ebdffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:32:26.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.305+0000 7f1ebdffb640 1 -- 172.21.15.22:0/1760106620 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4030070 con 0x5555bec54e50 2024-08-20T01:32:26.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.305+0000 7f1ebdffb640 1 -- 172.21.15.22:0/1760106620 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f1ec4029040 con 0x5555bec54e50 2024-08-20T01:32:26.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.306+0000 7f1edeac4740 1 -- 172.21.15.22:0/1760106620 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ec4003bc0 con 0x5555bec54e50 2024-08-20T01:32:26.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.307+0000 7f1ebdffb640 1 -- 172.21.15.22:0/1760106620 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1ec4025070 con 0x5555bec54e50 2024-08-20T01:32:26.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.307+0000 7f1edeac4740 10 client.25262 fetch_fsmap learned FSMap version 27 2024-08-20T01:32:26.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.307+0000 7f1edeac4740 1 -- 172.21.15.22:0/1760106620 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5555becdbee0 con 0x5555bec54e50 2024-08-20T01:32:26.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.309+0000 7f1ebdffb640 1 -- 172.21.15.22:0/1760106620 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ec4003bc0 con 0x5555bec54e50 2024-08-20T01:32:26.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.309+0000 7f1ebdffb640 1 -- 172.21.15.22:0/1760106620 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1ec401e040 con 0x5555bec54e50 2024-08-20T01:32:26.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.309+0000 7f1edeac4740 10 client.25262 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:32:26.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.309+0000 7f1edeac4740 10 client.25262 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:32:26.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.310+0000 7f1edeac4740 20 client.25262 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:26.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.310+0000 7f1edeac4740 1 --2- 172.21.15.22:0/1760106620 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5555becdc470 0x5555becde890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:26.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.310+0000 7f1edeac4740 4 client.25262 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:32:26.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.310+0000 7f1edeac4740 1 -- 172.21.15.22:0/1760106620 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5555bebc8330 con 0x5555becdc470 2024-08-20T01:32:26.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.311+0000 7f1ed9c66640 1 --2- 172.21.15.22:0/1760106620 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5555becdc470 0x5555becde890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:26.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.314+0000 7f1ed9c66640 1 --2- 172.21.15.22:0/1760106620 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5555becdc470 0x5555becde890 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5048d029f7930317 server_cookie=322081681f9e56c7 in_seq=0 out_seq=0 2024-08-20T01:32:26.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.314+0000 7f1ebdffb640 10 client.25262 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:26.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.443+0000 7f1ebdffb640 1 -- 172.21.15.22:0/1760106620 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5555bebc8330 con 0x5555becdc470 2024-08-20T01:32:26.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.443+0000 7f1ebdffb640 10 client.25262 handle_command_reply: tid=0 2024-08-20T01:32:26.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.443+0000 7f1edeac4740 1 client.25262 shutdown 2024-08-20T01:32:26.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.443+0000 7f1edeac4740 1 -- 172.21.15.22:0/1760106620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54e50 msgr2=0x5555bec64c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:26.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.444+0000 7f1edeac4740 1 --2- 172.21.15.22:0/1760106620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54e50 0x5555bec64c20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4005890 tx=0x7f1ec4009e20 comp rx=0 tx=0).stop 2024-08-20T01:32:26.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.444+0000 7f1edeac4740 1 -- 172.21.15.22:0/1760106620 shutdown_connections 2024-08-20T01:32:26.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.444+0000 7f1edeac4740 1 --2- 172.21.15.22:0/1760106620 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5555becdc470 0x5555becde890 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.444+0000 7f1edeac4740 1 --2- 172.21.15.22:0/1760106620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555bec656a0 0x5555becda9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.444+0000 7f1edeac4740 1 --2- 172.21.15.22:0/1760106620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555bec60de0 0x5555bec65160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.444+0000 7f1edeac4740 1 --2- 172.21.15.22:0/1760106620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555bec54e50 0x5555bec64c20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.444+0000 7f1edeac4740 1 -- 172.21.15.22:0/1760106620 >> 172.21.15.22:0/1760106620 conn(0x5555bec52360 msgr2=0x5555bec51460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:26.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.444+0000 7f1ebdffb640 0 client.25262 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:26.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.444+0000 7f1edeac4740 1 -- 172.21.15.22:0/1760106620 shutdown_connections 2024-08-20T01:32:26.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.444+0000 7f1edeac4740 1 -- 172.21.15.22:0/1760106620 wait complete. 2024-08-20T01:32:26.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.444+0000 7f1edeac4740 20 client.25262 trim_cache size 0 max 16384 2024-08-20T01:32:26.451 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:32:26.451 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-08-20T01:32:26.451 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "8c289810-8e8c-493a-82ee-462105abebeb", 2024-08-20T01:32:26.452 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-08-20T01:32:26.452 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:32:26.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.445+0000 7f1edb469640 1 -- 172.21.15.22:0/2998793144 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f1ec00b3e90 msgr2=0x7f1ec00b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:26.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.445+0000 7f1edb469640 1 --2- 172.21.15.22:0/2998793144 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f1ec00b3e90 0x7f1ec00b6350 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4005fd0 tx=0x7f1ec4015040 comp rx=0 tx=0).stop 2024-08-20T01:32:26.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.445+0000 7f1edb469640 1 -- 172.21.15.22:0/2998793144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ed4107210 msgr2=0x7f1ed410ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:26.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.445+0000 7f1edb469640 1 --2- 172.21.15.22:0/2998793144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ed4107210 0x7f1ed410ab50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000b4a0 tx=0x7f1ed000b8a0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.445+0000 7f1edb469640 1 -- 172.21.15.22:0/2998793144 shutdown_connections 2024-08-20T01:32:26.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.445+0000 7f1edb469640 1 --2- 172.21.15.22:0/2998793144 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f1ec00b3e90 0x7f1ec00b6350 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.445+0000 7f1edb469640 1 --2- 172.21.15.22:0/2998793144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ed4107b90 0x7f1ed410b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.445+0000 7f1edb469640 1 --2- 172.21.15.22:0/2998793144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ed4107210 0x7f1ed410ab50 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.445+0000 7f1edb469640 1 --2- 172.21.15.22:0/2998793144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ed4101800 0x7f1ed410a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:26.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.445+0000 7f1edb469640 1 -- 172.21.15.22:0/2998793144 >> 172.21.15.22:0/2998793144 conn(0x7f1ed40fd2d0 msgr2=0x7f1ed40ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:26.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.445+0000 7f1edb469640 1 -- 172.21.15.22:0/2998793144 shutdown_connections 2024-08-20T01:32:26.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:26.445+0000 7f1edb469640 1 -- 172.21.15.22:0/2998793144 wait complete. 2024-08-20T01:32:27.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:26 smithi077 ceph-mon[22251]: pgmap v385: 97 pgs: 97 active+clean; 34 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 748 op/s 2024-08-20T01:32:27.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:26 smithi077 ceph-mon[22251]: scrub queued for path: / 2024-08-20T01:32:27.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:26 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:27.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:26 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:27.088 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:26 smithi022 ceph-mon[18709]: pgmap v385: 97 pgs: 97 active+clean; 34 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 748 op/s 2024-08-20T01:32:27.088 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:26 smithi022 ceph-mon[18709]: scrub queued for path: / 2024-08-20T01:32:27.088 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:26 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:27.088 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:26 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:27.120 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:32:27.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:26 smithi134 ceph-mon[22511]: pgmap v385: 97 pgs: 97 active+clean; 34 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 748 op/s 2024-08-20T01:32:27.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:26 smithi134 ceph-mon[22511]: scrub queued for path: / 2024-08-20T01:32:27.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:26 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:27.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:26 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:27.378 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:32:27.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.832+0000 7f3a71152640 1 -- 172.21.15.22:0/3043857640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a6c1084e0 msgr2=0x7f3a6c108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:27.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.832+0000 7f3a71152640 1 --2- 172.21.15.22:0/3043857640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a6c1084e0 0x7f3a6c108920 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009900 tx=0x7f3a6002a3f0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.832+0000 7f3a71152640 1 -- 172.21.15.22:0/3043857640 shutdown_connections 2024-08-20T01:32:27.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.832+0000 7f3a71152640 1 --2- 172.21.15.22:0/3043857640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a6c108e60 0x7f3a6c10f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.832+0000 7f3a71152640 1 --2- 172.21.15.22:0/3043857640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a6c1084e0 0x7f3a6c108920 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.832+0000 7f3a71152640 1 --2- 172.21.15.22:0/3043857640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a6c102ad0 0x7f3a6c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.832+0000 7f3a71152640 1 -- 172.21.15.22:0/3043857640 >> 172.21.15.22:0/3043857640 conn(0x7f3a6c0fe540 msgr2=0x7f3a6c100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:27.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.832+0000 7f3a71152640 1 -- 172.21.15.22:0/3043857640 shutdown_connections 2024-08-20T01:32:27.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.832+0000 7f3a71152640 1 -- 172.21.15.22:0/3043857640 wait complete. 2024-08-20T01:32:27.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.833+0000 7f3a71152640 1 Processor -- start 2024-08-20T01:32:27.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.833+0000 7f3a71152640 1 -- start start 2024-08-20T01:32:27.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.833+0000 7f3a71152640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a6c102ad0 0x7f3a6c198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:27.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.833+0000 7f3a71152640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a6c1084e0 0x7f3a6c199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:27.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.833+0000 7f3a71152640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a6c108e60 0x7f3a6c19e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:27.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.833+0000 7f3a71152640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c112b70 con 0x7f3a6c102ad0 2024-08-20T01:32:27.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.833+0000 7f3a71152640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1129f0 con 0x7f3a6c108e60 2024-08-20T01:32:27.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.833+0000 7f3a71152640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c112cf0 con 0x7f3a6c1084e0 2024-08-20T01:32:27.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.833+0000 7f3a6ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a6c102ad0 0x7f3a6c198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:27.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.833+0000 7f3a6a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a6c1084e0 0x7f3a6c199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:27.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.833+0000 7f3a6ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a6c102ad0 0x7f3a6c198f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56952/0 (socket says 172.21.15.22:56952) 2024-08-20T01:32:27.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.833+0000 7f3a6ad9d640 1 -- 172.21.15.22:0/3218597403 learned_addr learned my addr 172.21.15.22:0/3218597403 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:27.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.834+0000 7f3a6b59e640 1 --2- 172.21.15.22:0/3218597403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a6c108e60 0x7f3a6c19e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:27.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.834+0000 7f3a6a59c640 1 -- 172.21.15.22:0/3218597403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a6c108e60 msgr2=0x7f3a6c19e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:27.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.834+0000 7f3a6a59c640 1 --2- 172.21.15.22:0/3218597403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a6c108e60 0x7f3a6c19e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.834+0000 7f3a6a59c640 1 -- 172.21.15.22:0/3218597403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a6c102ad0 msgr2=0x7f3a6c198f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:27.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.834+0000 7f3a6a59c640 1 --2- 172.21.15.22:0/3218597403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a6c102ad0 0x7f3a6c198f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.834+0000 7f3a6a59c640 1 -- 172.21.15.22:0/3218597403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6c19eff0 con 0x7f3a6c1084e0 2024-08-20T01:32:27.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.834+0000 7f3a6b59e640 1 --2- 172.21.15.22:0/3218597403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a6c108e60 0x7f3a6c19e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:32:27.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.835+0000 7f3a6a59c640 1 --2- 172.21.15.22:0/3218597403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a6c1084e0 0x7f3a6c199480 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3a6002a9e0 tx=0x7f3a60003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:27.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.835+0000 7f3a53fff640 1 -- 172.21.15.22:0/3218597403 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6003f070 con 0x7f3a6c1084e0 2024-08-20T01:32:27.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.835+0000 7f3a71152640 1 -- 172.21.15.22:0/3218597403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a6c19f280 con 0x7f3a6c1084e0 2024-08-20T01:32:27.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.835+0000 7f3a53fff640 1 -- 172.21.15.22:0/3218597403 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a60031b50 con 0x7f3a6c1084e0 2024-08-20T01:32:27.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.835+0000 7f3a53fff640 1 -- 172.21.15.22:0/3218597403 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60035030 con 0x7f3a6c1084e0 2024-08-20T01:32:27.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.835+0000 7f3a71152640 1 -- 172.21.15.22:0/3218597403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a6c1a59a0 con 0x7f3a6c1084e0 2024-08-20T01:32:27.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.837+0000 7f3a7354b740 1 Processor -- start 2024-08-20T01:32:27.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.837+0000 7f3a7354b740 1 -- start start 2024-08-20T01:32:27.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.838+0000 7f3a7354b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd86e0 0x560d7ffd8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.838+0000 7f3a7354b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffd9000 0x560d7ffe8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.838+0000 7f3a7354b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffe93a0 0x560d7ffeb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.838+0000 7f3a7354b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560d7ff4f8e0 con 0x560d7ffd9000 2024-08-20T01:32:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.838+0000 7f3a7354b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560d7ff3ede0 con 0x560d7ffd86e0 2024-08-20T01:32:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.838+0000 7f3a7354b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560d7ff42e20 con 0x560d7ffe93a0 2024-08-20T01:32:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.838+0000 7f3a53fff640 1 -- 172.21.15.22:0/3218597403 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3a60042070 con 0x7f3a6c1084e0 2024-08-20T01:32:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.838+0000 7f3a6ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffd9000 0x560d7ffe8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.838+0000 7f3a6b59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd86e0 0x560d7ffd8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.838+0000 7f3a6b59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd86e0 0x560d7ffd8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:53090/0 (socket says 172.21.15.22:53090) 2024-08-20T01:32:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.838+0000 7f3a6ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffd9000 0x560d7ffe8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56968/0 (socket says 172.21.15.22:56968) 2024-08-20T01:32:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.838+0000 7f3a6b59e640 1 -- 172.21.15.22:0/3791128286 learned_addr learned my addr 172.21.15.22:0/3791128286 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.838+0000 7f3a6a59c640 1 --2- 172.21.15.22:0/3791128286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffe93a0 0x560d7ffeb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.838+0000 7f3a6b59e640 1 -- 172.21.15.22:0/3791128286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffe93a0 msgr2=0x560d7ffeb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.838+0000 7f3a6b59e640 1 --2- 172.21.15.22:0/3791128286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffe93a0 0x560d7ffeb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.838+0000 7f3a6b59e640 1 -- 172.21.15.22:0/3791128286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffd9000 msgr2=0x560d7ffe8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:27.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.838+0000 7f3a6b59e640 1 --2- 172.21.15.22:0/3791128286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffd9000 0x560d7ffe8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.838+0000 7f3a6b59e640 1 -- 172.21.15.22:0/3791128286 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d7fc9e650 con 0x560d7ffd86e0 2024-08-20T01:32:27.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.839+0000 7f3a6b59e640 1 --2- 172.21.15.22:0/3791128286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd86e0 0x560d7ffd8ac0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3a64008e60 tx=0x7f3a6400d710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51e685f1232e6545 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:27.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.839+0000 7f3a517fa640 1 -- 172.21.15.22:0/3791128286 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6400f830 con 0x560d7ffd86e0 2024-08-20T01:32:27.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.839+0000 7f3a517fa640 1 -- 172.21.15.22:0/3791128286 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a64018480 con 0x560d7ffd86e0 2024-08-20T01:32:27.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.839+0000 7f3a517fa640 1 -- 172.21.15.22:0/3791128286 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6400e610 con 0x560d7ffd86e0 2024-08-20T01:32:27.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.839+0000 7f3a53fff640 1 --2- 172.21.15.22:0/3218597403 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3a540b3bd0 0x7f3a540b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:27.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.839+0000 7f3a6ad9d640 1 --2- 172.21.15.22:0/3218597403 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3a540b3bd0 0x7f3a540b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:27.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.839+0000 7f3a53fff640 1 -- 172.21.15.22:0/3218597403 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f3a601042c0 con 0x7f3a6c1084e0 2024-08-20T01:32:27.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.840+0000 7f3a7354b740 1 -- 172.21.15.22:0/3791128286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd86e0 msgr2=0x560d7ffd8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:27.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.840+0000 7f3a6ad9d640 1 --2- 172.21.15.22:0/3218597403 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3a540b3bd0 0x7f3a540b6090 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x560d7ffdb860 tx=0x7f3a5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:27.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.840+0000 7f3a7354b740 1 --2- 172.21.15.22:0/3791128286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd86e0 0x560d7ffd8ac0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3a64008e60 tx=0x7f3a6400d710 comp rx=0 tx=0).stop 2024-08-20T01:32:27.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.840+0000 7f3a7354b740 1 -- 172.21.15.22:0/3791128286 shutdown_connections 2024-08-20T01:32:27.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.840+0000 7f3a7354b740 1 --2- 172.21.15.22:0/3791128286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffe93a0 0x560d7ffeb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.840+0000 7f3a7354b740 1 --2- 172.21.15.22:0/3791128286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffd9000 0x560d7ffe8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.840+0000 7f3a7354b740 1 --2- 172.21.15.22:0/3791128286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd86e0 0x560d7ffd8ac0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.840+0000 7f3a7354b740 1 -- 172.21.15.22:0/3791128286 >> 172.21.15.22:0/3791128286 conn(0x560d7ffd6510 msgr2=0x560d7ffd76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:27.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.840+0000 7f3a7354b740 1 -- 172.21.15.22:0/3791128286 shutdown_connections 2024-08-20T01:32:27.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.840+0000 7f3a7354b740 1 -- 172.21.15.22:0/3791128286 wait complete. 2024-08-20T01:32:27.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.840+0000 7f3a7354b740 1 -- start start 2024-08-20T01:32:27.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.840+0000 7f3a7354b740 1 Processor -- start 2024-08-20T01:32:27.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.840+0000 7f3a7354b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd86e0 0x560d7ffe6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:27.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.840+0000 7f3a7354b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffd9000 0x560d7ffe68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:27.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a7354b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffe93a0 0x560d7ffe6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:27.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a7354b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560d7fda1700 con 0x560d7ffd9000 2024-08-20T01:32:27.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a7354b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560d7fec57c0 con 0x560d7ffd86e0 2024-08-20T01:32:27.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a7354b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560d7ffec050 con 0x560d7ffe93a0 2024-08-20T01:32:27.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a7354b740 10 client.0 _ll_register_callbacks cb 0x560d7ff386b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:27.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a6a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffd9000 0x560d7ffe68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:27.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a6b59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffe93a0 0x560d7ffe6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:27.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a6a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffd9000 0x560d7ffe68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56972/0 (socket says 172.21.15.22:56972) 2024-08-20T01:32:27.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a6a59c640 1 -- 172.21.15.22:0/3687791680 learned_addr learned my addr 172.21.15.22:0/3687791680 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:27.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a6b59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffe93a0 0x560d7ffe6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:43906/0 (socket says 172.21.15.22:43906) 2024-08-20T01:32:27.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a6ad9d640 1 --2- 172.21.15.22:0/3687791680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd86e0 0x560d7ffe6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:27.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a6a59c640 1 -- 172.21.15.22:0/3687791680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffe93a0 msgr2=0x560d7ffe6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:27.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a6a59c640 1 --2- 172.21.15.22:0/3687791680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffe93a0 0x560d7ffe6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a6a59c640 1 -- 172.21.15.22:0/3687791680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd86e0 msgr2=0x560d7ffe6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:27.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a6a59c640 1 --2- 172.21.15.22:0/3687791680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd86e0 0x560d7ffe6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a6a59c640 1 -- 172.21.15.22:0/3687791680 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d7fff54b0 con 0x560d7ffd9000 2024-08-20T01:32:27.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a6a59c640 1 --2- 172.21.15.22:0/3687791680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffd9000 0x560d7ffe68c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3a600c71f0 tx=0x7f3a60031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3027f784df375024 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:27.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a4eff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:32:27.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a4eff5640 1 -- 172.21.15.22:0/3687791680 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60049070 con 0x560d7ffd9000 2024-08-20T01:32:27.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a4eff5640 1 -- 172.21.15.22:0/3687791680 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f3a600d3d90 con 0x560d7ffd9000 2024-08-20T01:32:27.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.841+0000 7f3a7354b740 1 -- 172.21.15.22:0/3687791680 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560d7feee100 con 0x560d7ffd9000 2024-08-20T01:32:27.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.842+0000 7f3a4eff5640 1 -- 172.21.15.22:0/3687791680 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3a600caac0 con 0x560d7ffd9000 2024-08-20T01:32:27.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.842+0000 7f3a7354b740 10 client.15669 fetch_fsmap learned FSMap version 27 2024-08-20T01:32:27.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.842+0000 7f3a7354b740 1 -- 172.21.15.22:0/3687791680 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560d7fff7e60 con 0x560d7ffd9000 2024-08-20T01:32:27.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.842+0000 7f3a4eff5640 1 -- 172.21.15.22:0/3687791680 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560d7feee100 con 0x560d7ffd9000 2024-08-20T01:32:27.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.842+0000 7f3a4eff5640 1 -- 172.21.15.22:0/3687791680 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3a600ca3d0 con 0x560d7ffd9000 2024-08-20T01:32:27.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.842+0000 7f3a7354b740 10 client.15669 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:32:27.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.842+0000 7f3a7354b740 10 client.15669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:32:27.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.842+0000 7f3a7354b740 20 client.15669 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:27.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.842+0000 7f3a7354b740 1 --2- 172.21.15.22:0/3687791680 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560d7fff9360 0x560d7fffb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:27.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.842+0000 7f3a7354b740 4 client.15669 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:32:27.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.842+0000 7f3a7354b740 1 -- 172.21.15.22:0/3687791680 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d7ff51830 con 0x560d7fff9360 2024-08-20T01:32:27.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.842+0000 7f3a6ad9d640 1 --2- 172.21.15.22:0/3687791680 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560d7fff9360 0x560d7fffb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:27.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.843+0000 7f3a6ad9d640 1 --2- 172.21.15.22:0/3687791680 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560d7fff9360 0x560d7fffb7e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2467aa3392433e2 server_cookie=5c6f8d36cd835c50 in_seq=0 out_seq=0 2024-08-20T01:32:27.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.843+0000 7f3a4eff5640 10 client.15669 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:27.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.845+0000 7f3a4eff5640 1 -- 172.21.15.22:0/3687791680 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560d7ff51830 con 0x560d7fff9360 2024-08-20T01:32:27.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.845+0000 7f3a4eff5640 10 client.15669 handle_command_reply: tid=0 2024-08-20T01:32:27.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.845+0000 7f3a7354b740 1 client.15669 shutdown 2024-08-20T01:32:27.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.846+0000 7f3a7354b740 1 -- 172.21.15.22:0/3687791680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffd9000 msgr2=0x560d7ffe68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:27.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.846+0000 7f3a7354b740 1 --2- 172.21.15.22:0/3687791680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffd9000 0x560d7ffe68c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3a600c71f0 tx=0x7f3a60031400 comp rx=0 tx=0).stop 2024-08-20T01:32:27.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.846+0000 7f3a7354b740 1 -- 172.21.15.22:0/3687791680 shutdown_connections 2024-08-20T01:32:27.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.846+0000 7f3a7354b740 1 --2- 172.21.15.22:0/3687791680 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560d7fff9360 0x560d7fffb7e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.846+0000 7f3a7354b740 1 --2- 172.21.15.22:0/3687791680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffe93a0 0x560d7ffe6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.846+0000 7f3a7354b740 1 --2- 172.21.15.22:0/3687791680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffd9000 0x560d7ffe68c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.846+0000 7f3a4eff5640 0 client.15669 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:27.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.846+0000 7f3a7354b740 1 --2- 172.21.15.22:0/3687791680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd86e0 0x560d7ffe6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.846+0000 7f3a7354b740 1 -- 172.21.15.22:0/3687791680 >> 172.21.15.22:0/3687791680 conn(0x560d7ffd6510 msgr2=0x560d7ffdc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:27.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.846+0000 7f3a7354b740 1 -- 172.21.15.22:0/3687791680 shutdown_connections 2024-08-20T01:32:27.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.846+0000 7f3a7354b740 1 -- 172.21.15.22:0/3687791680 wait complete. 2024-08-20T01:32:27.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.846+0000 7f3a7354b740 20 client.15669 trim_cache size 0 max 16384 2024-08-20T01:32:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.864+0000 7f3a7354b740 1 Processor -- start 2024-08-20T01:32:27.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.865+0000 7f3a7354b740 1 -- start start 2024-08-20T01:32:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.865+0000 7f3a7354b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffd86e0 0x560d7ffe3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.865+0000 7f3a7354b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd9000 0x560d7ffd5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.865+0000 7f3a7354b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffe93a0 0x560d7ffe6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.865+0000 7f3a7354b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1ae760 con 0x560d7ffe93a0 2024-08-20T01:32:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.865+0000 7f3a7354b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1ac030 con 0x560d7ffd9000 2024-08-20T01:32:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.865+0000 7f3a7354b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1a9e80 con 0x560d7ffd86e0 2024-08-20T01:32:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.865+0000 7f3a6b59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffe93a0 0x560d7ffe6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.865+0000 7f3a6b59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffe93a0 0x560d7ffe6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56982/0 (socket says 172.21.15.22:56982) 2024-08-20T01:32:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.865+0000 7f3a6b59e640 1 -- 172.21.15.22:0/521633075 learned_addr learned my addr 172.21.15.22:0/521633075 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.865+0000 7f3a6ad9d640 1 --2- 172.21.15.22:0/521633075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffd86e0 0x560d7ffe3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.865+0000 7f3a6a59c640 1 --2- 172.21.15.22:0/521633075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd9000 0x560d7ffd5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.865+0000 7f3a6b59e640 1 -- 172.21.15.22:0/521633075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffd86e0 msgr2=0x560d7ffe3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:27.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.865+0000 7f3a6b59e640 1 --2- 172.21.15.22:0/521633075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffd86e0 0x560d7ffe3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.865+0000 7f3a6b59e640 1 -- 172.21.15.22:0/521633075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd9000 msgr2=0x560d7ffd5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:27.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.865+0000 7f3a6b59e640 1 --2- 172.21.15.22:0/521633075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd9000 0x560d7ffd5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.865+0000 7f3a6b59e640 1 -- 172.21.15.22:0/521633075 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d7ffe4370 con 0x560d7ffe93a0 2024-08-20T01:32:27.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.865+0000 7f3a6b59e640 1 --2- 172.21.15.22:0/521633075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffe93a0 0x560d7ffe6350 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3a64005fd0 tx=0x7f3a64008fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b284ce3f917e1b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:27.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.866+0000 7f3a50ff9640 1 -- 172.21.15.22:0/521633075 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64008970 con 0x560d7ffe93a0 2024-08-20T01:32:27.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.866+0000 7f3a50ff9640 1 -- 172.21.15.22:0/521633075 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a64018480 con 0x560d7ffe93a0 2024-08-20T01:32:27.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.866+0000 7f3a50ff9640 1 -- 172.21.15.22:0/521633075 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6400f960 con 0x560d7ffe93a0 2024-08-20T01:32:27.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.866+0000 7f3a7354b740 1 -- 172.21.15.22:0/521633075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffe93a0 msgr2=0x560d7ffe6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:27.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.866+0000 7f3a7354b740 1 --2- 172.21.15.22:0/521633075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffe93a0 0x560d7ffe6350 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3a64005fd0 tx=0x7f3a64008fb0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.866+0000 7f3a7354b740 1 -- 172.21.15.22:0/521633075 shutdown_connections 2024-08-20T01:32:27.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.866+0000 7f3a7354b740 1 --2- 172.21.15.22:0/521633075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffe93a0 0x560d7ffe6350 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.866+0000 7f3a7354b740 1 --2- 172.21.15.22:0/521633075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd9000 0x560d7ffd5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.866+0000 7f3a7354b740 1 --2- 172.21.15.22:0/521633075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffd86e0 0x560d7ffe3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.866+0000 7f3a7354b740 1 -- 172.21.15.22:0/521633075 >> 172.21.15.22:0/521633075 conn(0x560d7ffd6510 msgr2=0x560d7ffd7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:27.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.866+0000 7f3a7354b740 1 -- 172.21.15.22:0/521633075 shutdown_connections 2024-08-20T01:32:27.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.866+0000 7f3a7354b740 1 -- 172.21.15.22:0/521633075 wait complete. 2024-08-20T01:32:27.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.867+0000 7f3a7354b740 1 -- start start 2024-08-20T01:32:27.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.867+0000 7f3a7354b740 1 Processor -- start 2024-08-20T01:32:27.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.867+0000 7f3a7354b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd86e0 0x560d800010b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:27.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.867+0000 7f3a7354b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffd9000 0x560d800015f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:27.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.867+0000 7f3a7354b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffe93a0 0x560d7fff1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:27.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.867+0000 7f3a7354b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1aa4f0 con 0x560d7ffe93a0 2024-08-20T01:32:27.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.867+0000 7f3a7354b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1ab960 con 0x560d7ffd86e0 2024-08-20T01:32:27.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.867+0000 7f3a7354b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1aabc0 con 0x560d7ffd9000 2024-08-20T01:32:27.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.867+0000 7f3a7354b740 10 client.0 _ll_register_callbacks cb 0x7f3a60005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:27.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.867+0000 7f3a6b59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffe93a0 0x560d7fff1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:27.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.867+0000 7f3a6b59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffe93a0 0x560d7fff1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56998/0 (socket says 172.21.15.22:56998) 2024-08-20T01:32:27.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.867+0000 7f3a6a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffd9000 0x560d800015f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:27.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.867+0000 7f3a6b59e640 1 -- 172.21.15.22:0/411780610 learned_addr learned my addr 172.21.15.22:0/411780610 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:27.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.867+0000 7f3a6ad9d640 1 --2- 172.21.15.22:0/411780610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd86e0 0x560d800010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:27.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.868+0000 7f3a6ad9d640 1 -- 172.21.15.22:0/411780610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffd9000 msgr2=0x560d800015f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:27.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.868+0000 7f3a6ad9d640 1 --2- 172.21.15.22:0/411780610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffd9000 0x560d800015f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.868+0000 7f3a6ad9d640 1 -- 172.21.15.22:0/411780610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffe93a0 msgr2=0x560d7fff1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:27.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.868+0000 7f3a6ad9d640 1 --2- 172.21.15.22:0/411780610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffe93a0 0x560d7fff1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.868+0000 7f3a6ad9d640 1 -- 172.21.15.22:0/411780610 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d7fff1880 con 0x560d7ffd86e0 2024-08-20T01:32:27.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.868+0000 7f3a6b59e640 1 --2- 172.21.15.22:0/411780610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffe93a0 0x560d7fff1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:32:27.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.868+0000 7f3a6ad9d640 1 --2- 172.21.15.22:0/411780610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd86e0 0x560d800010b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x560d7fff9740 tx=0x7f3a5c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8689656b32c7270 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:27.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.868+0000 7f3a4eff5640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:32:27.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.868+0000 7f3a4eff5640 1 -- 172.21.15.22:0/411780610 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c01db00 con 0x560d7ffd86e0 2024-08-20T01:32:27.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.868+0000 7f3a4eff5640 1 -- 172.21.15.22:0/411780610 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f3a5c01dca0 con 0x560d7ffd86e0 2024-08-20T01:32:27.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.868+0000 7f3a7354b740 1 -- 172.21.15.22:0/411780610 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a64018480 con 0x560d7ffd86e0 2024-08-20T01:32:27.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.868+0000 7f3a4eff5640 1 -- 172.21.15.22:0/411780610 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3a5c005020 con 0x560d7ffd86e0 2024-08-20T01:32:27.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.868+0000 7f3a7354b740 10 client.25274 fetch_fsmap learned FSMap version 27 2024-08-20T01:32:27.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.868+0000 7f3a7354b740 1 -- 172.21.15.22:0/411780610 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560d7ffda270 con 0x560d7ffd86e0 2024-08-20T01:32:27.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.868+0000 7f3a4eff5640 1 -- 172.21.15.22:0/411780610 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a64018480 con 0x560d7ffd86e0 2024-08-20T01:32:27.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.869+0000 7f3a4eff5640 1 -- 172.21.15.22:0/411780610 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3a5c033460 con 0x560d7ffd86e0 2024-08-20T01:32:27.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.869+0000 7f3a7354b740 10 client.25274 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:32:27.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.869+0000 7f3a7354b740 10 client.25274 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:32:27.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.869+0000 7f3a7354b740 20 client.25274 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:27.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.869+0000 7f3a7354b740 1 --2- 172.21.15.22:0/411780610 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560d800641c0 0x560d800665e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:27.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.869+0000 7f3a7354b740 4 client.25274 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:32:27.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.869+0000 7f3a7354b740 1 -- 172.21.15.22:0/411780610 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560d7ff4d2d0 con 0x560d800641c0 2024-08-20T01:32:27.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.869+0000 7f3a6a59c640 1 --2- 172.21.15.22:0/411780610 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560d800641c0 0x560d800665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:27.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.869+0000 7f3a4eff5640 10 client.25274 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:27.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.869+0000 7f3a6a59c640 1 --2- 172.21.15.22:0/411780610 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560d800641c0 0x560d800665e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4f4e64220a11be2 server_cookie=4bc1a02f7af1f089 in_seq=0 out_seq=0 2024-08-20T01:32:27.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.873+0000 7f3a4eff5640 1 -- 172.21.15.22:0/411780610 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x560d7ff4d2d0 con 0x560d800641c0 2024-08-20T01:32:27.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.873+0000 7f3a4eff5640 10 client.25274 handle_command_reply: tid=0 2024-08-20T01:32:27.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.873+0000 7f3a7354b740 1 client.25274 shutdown 2024-08-20T01:32:27.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.873+0000 7f3a7354b740 1 -- 172.21.15.22:0/411780610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd86e0 msgr2=0x560d800010b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:27.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.873+0000 7f3a7354b740 1 --2- 172.21.15.22:0/411780610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd86e0 0x560d800010b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x560d7fff9740 tx=0x7f3a5c0046c0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.873+0000 7f3a7354b740 1 -- 172.21.15.22:0/411780610 shutdown_connections 2024-08-20T01:32:27.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.873+0000 7f3a7354b740 1 --2- 172.21.15.22:0/411780610 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560d800641c0 0x560d800665e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.873+0000 7f3a7354b740 1 --2- 172.21.15.22:0/411780610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560d7ffe93a0 0x560d7fff1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.873+0000 7f3a7354b740 1 --2- 172.21.15.22:0/411780610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560d7ffd9000 0x560d800015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.873+0000 7f3a4eff5640 0 client.25274 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:27.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.873+0000 7f3a7354b740 1 --2- 172.21.15.22:0/411780610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d7ffd86e0 0x560d800010b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.873+0000 7f3a7354b740 1 -- 172.21.15.22:0/411780610 >> 172.21.15.22:0/411780610 conn(0x560d7ffd6510 msgr2=0x560d7ffe79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:27.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.873+0000 7f3a7354b740 1 -- 172.21.15.22:0/411780610 shutdown_connections 2024-08-20T01:32:27.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.873+0000 7f3a7354b740 1 -- 172.21.15.22:0/411780610 wait complete. 2024-08-20T01:32:27.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.873+0000 7f3a7354b740 20 client.25274 trim_cache size 0 max 16384 2024-08-20T01:32:27.880 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:32:27.880 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "scrub active (943 inodes in the stack)", 2024-08-20T01:32:27.880 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-08-20T01:32:27.880 INFO:teuthology.orchestra.run.smithi022.stdout: "8c289810-8e8c-493a-82ee-462105abebeb": { 2024-08-20T01:32:27.880 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-08-20T01:32:27.880 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "8c289810-8e8c-493a-82ee-462105abebeb", 2024-08-20T01:32:27.880 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-08-20T01:32:27.880 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:32:27.881 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:32:27.881 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:32:27.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.873+0000 7f3a71152640 1 -- 172.21.15.22:0/3218597403 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3a540b3bd0 msgr2=0x7f3a540b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:27.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.873+0000 7f3a71152640 1 --2- 172.21.15.22:0/3218597403 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3a540b3bd0 0x7f3a540b6090 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x560d7ffdb860 tx=0x7f3a5c005f90 comp rx=0 tx=0).stop 2024-08-20T01:32:27.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.873+0000 7f3a71152640 1 -- 172.21.15.22:0/3218597403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a6c1084e0 msgr2=0x7f3a6c199480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:27.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.873+0000 7f3a71152640 1 --2- 172.21.15.22:0/3218597403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a6c1084e0 0x7f3a6c199480 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3a6002a9e0 tx=0x7f3a60003b90 comp rx=0 tx=0).stop 2024-08-20T01:32:27.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.874+0000 7f3a71152640 1 -- 172.21.15.22:0/3218597403 shutdown_connections 2024-08-20T01:32:27.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.874+0000 7f3a71152640 1 --2- 172.21.15.22:0/3218597403 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3a540b3bd0 0x7f3a540b6090 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.874+0000 7f3a71152640 1 --2- 172.21.15.22:0/3218597403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a6c108e60 0x7f3a6c19e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.874+0000 7f3a71152640 1 --2- 172.21.15.22:0/3218597403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a6c1084e0 0x7f3a6c199480 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.874+0000 7f3a71152640 1 --2- 172.21.15.22:0/3218597403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a6c102ad0 0x7f3a6c198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:27.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.874+0000 7f3a71152640 1 -- 172.21.15.22:0/3218597403 >> 172.21.15.22:0/3218597403 conn(0x7f3a6c0fe540 msgr2=0x7f3a6c100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:27.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.874+0000 7f3a71152640 1 -- 172.21.15.22:0/3218597403 shutdown_connections 2024-08-20T01:32:27.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:27.874+0000 7f3a71152640 1 -- 172.21.15.22:0/3218597403 wait complete. 2024-08-20T01:32:28.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:27 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:28.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:27 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:28.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:27 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:28.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:27 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:28.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:27 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:28.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:27 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:28.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:27 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:28.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:27 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:28.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:27 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:28.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:27 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:28.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:27 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:28.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:27 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:28.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:27 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:28.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:27 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:28.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:27 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:28.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:27 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:28.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:27 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:28.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:27 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:28.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:27 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:28.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:27 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:28.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:27 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:28.553 INFO:tasks.cephfs.filesystem:scrub status for tag:8c289810-8e8c-493a-82ee-462105abebeb - {'path': '/', 'tag': '8c289810-8e8c-493a-82ee-462105abebeb', 'options': 'recursive,force'} 2024-08-20T01:32:29.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:28 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:28 smithi077 ceph-mon[22251]: pgmap v386: 97 pgs: 97 active+clean; 44 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 770 op/s 2024-08-20T01:32:29.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:28 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:29.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:28 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:29.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:28 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:28 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:28 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:29.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:28 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:28 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:29.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:28 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:29.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:28 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:28 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:28 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:29.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:28 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:28 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:29.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:28 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:28 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:28 smithi022 ceph-mon[18709]: pgmap v386: 97 pgs: 97 active+clean; 44 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 770 op/s 2024-08-20T01:32:29.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:28 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:29.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:28 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:29.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:28 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:28 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:28 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:29.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:28 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:28 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:29.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:28 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:29.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:28 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:28 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:28 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:29.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:28 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:28 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:29.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:28 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:28 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:28 smithi134 ceph-mon[22511]: pgmap v386: 97 pgs: 97 active+clean; 44 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 770 op/s 2024-08-20T01:32:29.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:28 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:29.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:28 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:29.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:28 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:28 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:28 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:29.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:28 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:28 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:29.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:28 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:29.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:28 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:28 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:28 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:29.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:28 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:29.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:28 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:29.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:28 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:30.021 INFO:tasks.workunit.client.0.smithi022.stdout: 38 179616 544 142882 645 53201 274 2024-08-20T01:32:30.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:29 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:30.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:29 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:30.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:29 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:30.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:29 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:30.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:29 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:30.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:29 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:31.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:30 smithi077 ceph-mon[22251]: pgmap v387: 97 pgs: 97 active+clean; 75 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 934 op/s 2024-08-20T01:32:31.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:30 smithi022 ceph-mon[18709]: pgmap v387: 97 pgs: 97 active+clean; 75 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 934 op/s 2024-08-20T01:32:31.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:30 smithi134 ceph-mon[22511]: pgmap v387: 97 pgs: 97 active+clean; 75 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 934 op/s 2024-08-20T01:32:33.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: pgmap v388: 97 pgs: 97 active+clean; 138 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 1.36k op/s 2024-08-20T01:32:33.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.084 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.084 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.084 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.084 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.084 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.084 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.084 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.084 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.084 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.084 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.084 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.084 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.084 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.084 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.085 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.085 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.085 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.085 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.085 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.085 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.085 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.085 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.085 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.085 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.085 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.085 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.085 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.085 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.086 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.086 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.086 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.086 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.086 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.086 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.086 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.086 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.086 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.086 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.086 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.086 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.087 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.087 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.087 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.087 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.087 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.087 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.087 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.087 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.087 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.087 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.087 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.087 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.087 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.087 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.088 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.088 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.088 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.088 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.088 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.088 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.088 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.088 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.088 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.088 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.088 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.088 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.088 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.089 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.089 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.089 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.089 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.089 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.089 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.089 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.089 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.089 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.089 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.089 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.089 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.089 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.090 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.090 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.090 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.090 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.090 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.090 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.090 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.090 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.090 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.090 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.090 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.090 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.090 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.090 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.091 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.091 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.091 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.091 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.091 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.091 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.091 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.091 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.091 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.091 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.091 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.091 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.091 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.092 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.092 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.092 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.092 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.092 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.092 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.092 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.092 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.092 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.092 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.092 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.092 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.092 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.092 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.092 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.093 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.093 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.093 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.093 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.093 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.093 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.093 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.093 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.093 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.093 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.093 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.093 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.093 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.093 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.094 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.094 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.094 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.094 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.094 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.094 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.094 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.094 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.094 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.094 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.094 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.094 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.094 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.094 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.095 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.095 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.095 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.095 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.095 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.095 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.095 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.095 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.095 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.095 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.095 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.095 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.095 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.095 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.095 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.096 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.096 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.096 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.096 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.096 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.096 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.096 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.096 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.096 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.096 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.096 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.096 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.096 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.096 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.097 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.097 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.097 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:33.097 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: pgmap v388: 97 pgs: 97 active+clean; 138 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 1.36k op/s 2024-08-20T01:32:33.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.165 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.165 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.165 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.165 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.165 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.165 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.165 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.165 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.165 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.165 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.165 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.165 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.165 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.165 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.165 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.165 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.169 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.169 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:33.169 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.186 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.185+0000 7f3e8290f640 1 -- 172.21.15.22:0/1018652550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c1083c0 msgr2=0x7f3e7c10a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:33.186 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.185+0000 7f3e8290f640 1 --2- 172.21.15.22:0/1018652550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c1083c0 0x7f3e7c10a880 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009ca0 tx=0x7f3e7402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.186 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.185+0000 7f3e8290f640 1 -- 172.21.15.22:0/1018652550 shutdown_connections 2024-08-20T01:32:33.186 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.185+0000 7f3e8290f640 1 --2- 172.21.15.22:0/1018652550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c1083c0 0x7f3e7c10a880 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.186 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.185+0000 7f3e8290f640 1 --2- 172.21.15.22:0/1018652550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e7c105810 0x7f3e7c107c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.185+0000 7f3e8290f640 1 --2- 172.21.15.22:0/1018652550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e7c06bc50 0x7f3e7c1052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.185+0000 7f3e8290f640 1 -- 172.21.15.22:0/1018652550 >> 172.21.15.22:0/1018652550 conn(0x7f3e7c0fce60 msgr2=0x7f3e7c0ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.185+0000 7f3e8290f640 1 -- 172.21.15.22:0/1018652550 shutdown_connections 2024-08-20T01:32:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.185+0000 7f3e8290f640 1 -- 172.21.15.22:0/1018652550 wait complete. 2024-08-20T01:32:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.185+0000 7f3e8290f640 1 Processor -- start 2024-08-20T01:32:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.185+0000 7f3e8290f640 1 -- start start 2024-08-20T01:32:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e8290f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c06bc50 0x7f3e7c198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e8290f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e7c105810 0x7f3e7c199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e8290f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e7c1083c0 0x7f3e7c199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e8290f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c10e330 con 0x7f3e7c06bc50 2024-08-20T01:32:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e8290f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c10e1b0 con 0x7f3e7c105810 2024-08-20T01:32:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e8290f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c10e4b0 con 0x7f3e7c1083c0 2024-08-20T01:32:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e7bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c06bc50 0x7f3e7c198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e7bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c06bc50 0x7f3e7c198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48794/0 (socket says 172.21.15.22:48794) 2024-08-20T01:32:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e7bfff640 1 -- 172.21.15.22:0/1008277047 learned_addr learned my addr 172.21.15.22:0/1008277047 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e7b7fe640 1 --2- 172.21.15.22:0/1008277047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e7c105810 0x7f3e7c199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e80eac640 1 --2- 172.21.15.22:0/1008277047 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e7c1083c0 0x7f3e7c199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e7bfff640 1 -- 172.21.15.22:0/1008277047 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e7c1083c0 msgr2=0x7f3e7c199d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e7bfff640 1 --2- 172.21.15.22:0/1008277047 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e7c1083c0 0x7f3e7c199d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e7bfff640 1 -- 172.21.15.22:0/1008277047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e7c105810 msgr2=0x7f3e7c199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e7bfff640 1 --2- 172.21.15.22:0/1008277047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e7c105810 0x7f3e7c199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e7bfff640 1 -- 172.21.15.22:0/1008277047 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7c19a5f0 con 0x7f3e7c06bc50 2024-08-20T01:32:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e7b7fe640 1 --2- 172.21.15.22:0/1008277047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e7c105810 0x7f3e7c199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:32:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e80eac640 1 --2- 172.21.15.22:0/1008277047 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e7c1083c0 0x7f3e7c199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:32:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e7bfff640 1 --2- 172.21.15.22:0/1008277047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c06bc50 0x7f3e7c198ab0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00e9f0 tx=0x7f3e6c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.186+0000 7f3e797fa640 1 -- 172.21.15.22:0/1008277047 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c00cd80 con 0x7f3e7c06bc50 2024-08-20T01:32:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.187+0000 7f3e797fa640 1 -- 172.21.15.22:0/1008277047 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e6c0054d0 con 0x7f3e7c06bc50 2024-08-20T01:32:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.187+0000 7f3e8290f640 1 -- 172.21.15.22:0/1008277047 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e7c19a8e0 con 0x7f3e7c06bc50 2024-08-20T01:32:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.187+0000 7f3e797fa640 1 -- 172.21.15.22:0/1008277047 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c010690 con 0x7f3e7c06bc50 2024-08-20T01:32:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.187+0000 7f3e8290f640 1 -- 172.21.15.22:0/1008277047 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e7c1a0fb0 con 0x7f3e7c06bc50 2024-08-20T01:32:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.189+0000 7f3e857dc740 1 Processor -- start 2024-08-20T01:32:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.189+0000 7f3e797fa640 1 -- 172.21.15.22:0/1008277047 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3e6c004e90 con 0x7f3e7c06bc50 2024-08-20T01:32:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.189+0000 7f3e857dc740 1 -- start start 2024-08-20T01:32:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.189+0000 7f3e857dc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa56a40 0x55a67aa58e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.189+0000 7f3e857dc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa59370 0x55a67aa5b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.189+0000 7f3e857dc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa5bdb0 0x55a67aa5e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.189+0000 7f3e857dc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a67a9c5360 con 0x55a67aa5bdb0 2024-08-20T01:32:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.189+0000 7f3e857dc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a67a9b4860 con 0x55a67aa59370 2024-08-20T01:32:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.190+0000 7f3e857dc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a67a9b88a0 con 0x55a67aa56a40 2024-08-20T01:32:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.190+0000 7f3e7b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa5bdb0 0x55a67aa5e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.190+0000 7f3e7b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa5bdb0 0x55a67aa5e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48798/0 (socket says 172.21.15.22:48798) 2024-08-20T01:32:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.190+0000 7f3e7b7fe640 1 -- 172.21.15.22:0/640114212 learned_addr learned my addr 172.21.15.22:0/640114212 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.190+0000 7f3e80eac640 1 --2- 172.21.15.22:0/640114212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa56a40 0x55a67aa58e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.190+0000 7f3e7bfff640 1 --2- 172.21.15.22:0/640114212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa59370 0x55a67aa5b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.190+0000 7f3e80eac640 1 -- 172.21.15.22:0/640114212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa59370 msgr2=0x55a67aa5b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.190+0000 7f3e80eac640 1 --2- 172.21.15.22:0/640114212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa59370 0x55a67aa5b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.190+0000 7f3e80eac640 1 -- 172.21.15.22:0/640114212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa5bdb0 msgr2=0x55a67aa5e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.190+0000 7f3e80eac640 1 --2- 172.21.15.22:0/640114212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa5bdb0 0x55a67aa5e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.190+0000 7f3e80eac640 1 -- 172.21.15.22:0/640114212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a67a95be40 con 0x55a67aa56a40 2024-08-20T01:32:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.190+0000 7f3e7b7fe640 1 --2- 172.21.15.22:0/640114212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa5bdb0 0x55a67aa5e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:32:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.190+0000 7f3e797fa640 1 --2- 172.21.15.22:0/1008277047 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3e640b3bd0 0x7f3e640b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.190+0000 7f3e7bfff640 1 --2- 172.21.15.22:0/1008277047 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3e640b3bd0 0x7f3e640b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.190+0000 7f3e80eac640 1 --2- 172.21.15.22:0/640114212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa56a40 0x55a67aa58e30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3e74006010 tx=0x7f3e74009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c49ec63e157dc5a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.190+0000 7f3e797fa640 1 -- 172.21.15.22:0/1008277047 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f3e6c0e4020 con 0x7f3e7c06bc50 2024-08-20T01:32:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.190+0000 7f3e627fc640 1 -- 172.21.15.22:0/640114212 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e74031650 con 0x55a67aa56a40 2024-08-20T01:32:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.191+0000 7f3e627fc640 1 -- 172.21.15.22:0/640114212 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e74036040 con 0x55a67aa56a40 2024-08-20T01:32:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.191+0000 7f3e627fc640 1 -- 172.21.15.22:0/640114212 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e740045e0 con 0x55a67aa56a40 2024-08-20T01:32:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.191+0000 7f3e857dc740 1 -- 172.21.15.22:0/640114212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa56a40 msgr2=0x55a67aa58e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.191+0000 7f3e857dc740 1 --2- 172.21.15.22:0/640114212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa56a40 0x55a67aa58e30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3e74006010 tx=0x7f3e74009360 comp rx=0 tx=0).stop 2024-08-20T01:32:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.191+0000 7f3e7bfff640 1 --2- 172.21.15.22:0/1008277047 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3e640b3bd0 0x7f3e640b6090 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c0aaf60 tx=0x7f3e6c0e7b90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.191+0000 7f3e857dc740 1 -- 172.21.15.22:0/640114212 shutdown_connections 2024-08-20T01:32:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.191+0000 7f3e857dc740 1 --2- 172.21.15.22:0/640114212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa5bdb0 0x55a67aa5e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.191+0000 7f3e857dc740 1 --2- 172.21.15.22:0/640114212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa59370 0x55a67aa5b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.191+0000 7f3e857dc740 1 --2- 172.21.15.22:0/640114212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa56a40 0x55a67aa58e30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.191+0000 7f3e857dc740 1 -- 172.21.15.22:0/640114212 >> 172.21.15.22:0/640114212 conn(0x55a67aa4d730 msgr2=0x55a67aa4e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.191+0000 7f3e857dc740 1 -- 172.21.15.22:0/640114212 shutdown_connections 2024-08-20T01:32:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.191+0000 7f3e857dc740 1 -- 172.21.15.22:0/640114212 wait complete. 2024-08-20T01:32:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.192+0000 7f3e857dc740 1 -- start start 2024-08-20T01:32:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.192+0000 7f3e857dc740 1 Processor -- start 2024-08-20T01:32:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.192+0000 7f3e857dc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 0x55a67aa601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.192+0000 7f3e857dc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa59370 0x55a67aa60870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.192+0000 7f3e857dc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa5bdb0 0x55a67aa61440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.192+0000 7f3e857dc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a67a8edab0 con 0x55a67aa56a40 2024-08-20T01:32:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.192+0000 7f3e857dc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a67a93b780 con 0x55a67aa59370 2024-08-20T01:32:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.192+0000 7f3e857dc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a67aa5ed30 con 0x55a67aa5bdb0 2024-08-20T01:32:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.192+0000 7f3e857dc740 10 client.0 _ll_register_callbacks cb 0x55a67a6c3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.192+0000 7f3e80eac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 0x55a67aa601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.192+0000 7f3e7b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa59370 0x55a67aa60870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.192+0000 7f3e80eac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 0x55a67aa601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48802/0 (socket says 172.21.15.22:48802) 2024-08-20T01:32:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.192+0000 7f3e80eac640 1 -- 172.21.15.22:0/3482903219 learned_addr learned my addr 172.21.15.22:0/3482903219 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.192+0000 7f3e7b7fe640 1 --2- 172.21.15.22:0/3482903219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa59370 0x55a67aa60870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:51402/0 (socket says 172.21.15.22:51402) 2024-08-20T01:32:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.192+0000 7f3e80eac640 1 --2- 172.21.15.22:0/3482903219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa5bdb0 0x55a67aa61440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.193+0000 7f3e7b7fe640 1 -- 172.21.15.22:0/3482903219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa5bdb0 msgr2=0x55a67aa61440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.193+0000 7f3e7b7fe640 1 --2- 172.21.15.22:0/3482903219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa5bdb0 0x55a67aa61440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.193+0000 7f3e7b7fe640 1 -- 172.21.15.22:0/3482903219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 msgr2=0x55a67aa601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.193+0000 7f3e7b7fe640 1 --2- 172.21.15.22:0/3482903219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 0x55a67aa601d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.193+0000 7f3e7b7fe640 1 -- 172.21.15.22:0/3482903219 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a67a717790 con 0x55a67aa59370 2024-08-20T01:32:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.193+0000 7f3e7b7fe640 1 --2- 172.21.15.22:0/3482903219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa59370 0x55a67aa60870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3e70012d00 tx=0x7f3e7000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2061a292526a58b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.193+0000 7f3e5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:32:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.193+0000 7f3e5b7fe640 1 -- 172.21.15.22:0/3482903219 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e70009d90 con 0x55a67aa59370 2024-08-20T01:32:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.193+0000 7f3e857dc740 1 -- 172.21.15.22:0/3482903219 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a67a963e00 con 0x55a67aa59370 2024-08-20T01:32:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.193+0000 7f3e5b7fe640 1 -- 172.21.15.22:0/3482903219 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f3e700120d0 con 0x55a67aa59370 2024-08-20T01:32:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.193+0000 7f3e5b7fe640 1 -- 172.21.15.22:0/3482903219 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3e70004030 con 0x55a67aa59370 2024-08-20T01:32:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.193+0000 7f3e857dc740 10 client.25286 fetch_fsmap learned FSMap version 27 2024-08-20T01:32:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.193+0000 7f3e857dc740 1 -- 172.21.15.22:0/3482903219 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a67a790620 con 0x55a67aa59370 2024-08-20T01:32:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.193+0000 7f3e5b7fe640 1 -- 172.21.15.22:0/3482903219 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a67a963e00 con 0x55a67aa59370 2024-08-20T01:32:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.194+0000 7f3e5b7fe640 1 -- 172.21.15.22:0/3482903219 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3e7001c460 con 0x55a67aa59370 2024-08-20T01:32:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.194+0000 7f3e857dc740 10 client.25286 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:32:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.194+0000 7f3e857dc740 10 client.25286 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:32:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.194+0000 7f3e857dc740 20 client.25286 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.194+0000 7f3e857dc740 1 --2- 172.21.15.22:0/3482903219 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a67aa6bb30 0x55a67aa6df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.194+0000 7f3e857dc740 4 client.25286 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:32:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.194+0000 7f3e857dc740 1 -- 172.21.15.22:0/3482903219 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a67a9c72b0 con 0x55a67aa6bb30 2024-08-20T01:32:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.194+0000 7f3e80eac640 1 --2- 172.21.15.22:0/3482903219 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a67aa6bb30 0x55a67aa6df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.194+0000 7f3e80eac640 1 --2- 172.21.15.22:0/3482903219 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a67aa6bb30 0x55a67aa6df60 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c673e1e0aa188872 server_cookie=99ac8573b42b58b5 in_seq=0 out_seq=0 2024-08-20T01:32:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.194+0000 7f3e5b7fe640 10 client.25286 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.198+0000 7f3e5b7fe640 1 -- 172.21.15.22:0/3482903219 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a67a9c72b0 con 0x55a67aa6bb30 2024-08-20T01:32:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.198+0000 7f3e5b7fe640 10 client.25286 handle_command_reply: tid=0 2024-08-20T01:32:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.198+0000 7f3e857dc740 1 client.25286 shutdown 2024-08-20T01:32:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.198+0000 7f3e857dc740 1 -- 172.21.15.22:0/3482903219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa59370 msgr2=0x55a67aa60870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.198+0000 7f3e857dc740 1 --2- 172.21.15.22:0/3482903219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa59370 0x55a67aa60870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3e70012d00 tx=0x7f3e7000f790 comp rx=0 tx=0).stop 2024-08-20T01:32:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.198+0000 7f3e857dc740 1 -- 172.21.15.22:0/3482903219 shutdown_connections 2024-08-20T01:32:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.198+0000 7f3e857dc740 1 --2- 172.21.15.22:0/3482903219 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a67aa6bb30 0x55a67aa6df60 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.198+0000 7f3e857dc740 1 --2- 172.21.15.22:0/3482903219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa5bdb0 0x55a67aa61440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.198+0000 7f3e5b7fe640 0 client.25286 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.198+0000 7f3e857dc740 1 --2- 172.21.15.22:0/3482903219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa59370 0x55a67aa60870 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.198+0000 7f3e857dc740 1 --2- 172.21.15.22:0/3482903219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 0x55a67aa601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.198+0000 7f3e857dc740 1 -- 172.21.15.22:0/3482903219 >> 172.21.15.22:0/3482903219 conn(0x55a67aa4d730 msgr2=0x55a67aa4c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.198+0000 7f3e857dc740 1 -- 172.21.15.22:0/3482903219 shutdown_connections 2024-08-20T01:32:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.198+0000 7f3e857dc740 1 -- 172.21.15.22:0/3482903219 wait complete. 2024-08-20T01:32:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.198+0000 7f3e857dc740 20 client.25286 trim_cache size 0 max 16384 2024-08-20T01:32:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.214+0000 7f3e857dc740 1 Processor -- start 2024-08-20T01:32:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.214+0000 7f3e857dc740 1 -- start start 2024-08-20T01:32:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.214+0000 7f3e857dc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 0x55a67aa608e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.214+0000 7f3e857dc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa59370 0x55a67aa5c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.214+0000 7f3e857dc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa5bdb0 0x55a67aa5c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.214+0000 7f3e857dc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1aa4c0 con 0x55a67aa56a40 2024-08-20T01:32:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.214+0000 7f3e857dc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1a7d90 con 0x55a67aa5bdb0 2024-08-20T01:32:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.214+0000 7f3e857dc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1a5be0 con 0x55a67aa59370 2024-08-20T01:32:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.214+0000 7f3e80eac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 0x55a67aa608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.214+0000 7f3e80eac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 0x55a67aa608e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48816/0 (socket says 172.21.15.22:48816) 2024-08-20T01:32:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.214+0000 7f3e80eac640 1 -- 172.21.15.22:0/4126971368 learned_addr learned my addr 172.21.15.22:0/4126971368 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.214+0000 7f3e7b7fe640 1 --2- 172.21.15.22:0/4126971368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa59370 0x55a67aa5c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.215+0000 7f3e80eac640 1 --2- 172.21.15.22:0/4126971368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa5bdb0 0x55a67aa5c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.215+0000 7f3e80eac640 1 -- 172.21.15.22:0/4126971368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa59370 msgr2=0x55a67aa5c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.215+0000 7f3e80eac640 1 --2- 172.21.15.22:0/4126971368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa59370 0x55a67aa5c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.215+0000 7f3e80eac640 1 -- 172.21.15.22:0/4126971368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa5bdb0 msgr2=0x55a67aa5c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.215+0000 7f3e80eac640 1 --2- 172.21.15.22:0/4126971368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa5bdb0 0x55a67aa5c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.215+0000 7f3e80eac640 1 -- 172.21.15.22:0/4126971368 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a67aa591a0 con 0x55a67aa56a40 2024-08-20T01:32:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.215+0000 7f3e80eac640 1 --2- 172.21.15.22:0/4126971368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 0x55a67aa608e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3e7402ade0 tx=0x7f3e74009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6befa9c8d72aa610 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.215+0000 7f3e61ffb640 1 -- 172.21.15.22:0/4126971368 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e74003970 con 0x55a67aa56a40 2024-08-20T01:32:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.215+0000 7f3e61ffb640 1 -- 172.21.15.22:0/4126971368 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e7404b040 con 0x55a67aa56a40 2024-08-20T01:32:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.215+0000 7f3e61ffb640 1 -- 172.21.15.22:0/4126971368 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e74004770 con 0x55a67aa56a40 2024-08-20T01:32:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.216+0000 7f3e857dc740 1 -- 172.21.15.22:0/4126971368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 msgr2=0x55a67aa608e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.216+0000 7f3e857dc740 1 --2- 172.21.15.22:0/4126971368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 0x55a67aa608e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3e7402ade0 tx=0x7f3e74009560 comp rx=0 tx=0).stop 2024-08-20T01:32:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.216+0000 7f3e857dc740 1 -- 172.21.15.22:0/4126971368 shutdown_connections 2024-08-20T01:32:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.216+0000 7f3e857dc740 1 --2- 172.21.15.22:0/4126971368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa5bdb0 0x55a67aa5c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.216+0000 7f3e857dc740 1 --2- 172.21.15.22:0/4126971368 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa59370 0x55a67aa5c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.216+0000 7f3e857dc740 1 --2- 172.21.15.22:0/4126971368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 0x55a67aa608e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.216+0000 7f3e857dc740 1 -- 172.21.15.22:0/4126971368 >> 172.21.15.22:0/4126971368 conn(0x55a67aa4d730 msgr2=0x55a67aa601d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.216+0000 7f3e857dc740 1 -- 172.21.15.22:0/4126971368 shutdown_connections 2024-08-20T01:32:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.216+0000 7f3e857dc740 1 -- 172.21.15.22:0/4126971368 wait complete. 2024-08-20T01:32:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.216+0000 7f3e857dc740 1 -- start start 2024-08-20T01:32:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.216+0000 7f3e857dc740 1 Processor -- start 2024-08-20T01:32:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.216+0000 7f3e857dc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 0x55a67aa67c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.216+0000 7f3e857dc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa59370 0x55a67aa66930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.216+0000 7f3e857dc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa5bdb0 0x55a67aa66e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.216+0000 7f3e857dc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1a6250 con 0x55a67aa56a40 2024-08-20T01:32:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.216+0000 7f3e857dc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1a76c0 con 0x55a67aa59370 2024-08-20T01:32:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.216+0000 7f3e857dc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1a6920 con 0x55a67aa5bdb0 2024-08-20T01:32:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e857dc740 10 client.0 _ll_register_callbacks cb 0x7f3e70009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e80eac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 0x55a67aa67c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e80eac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 0x55a67aa67c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48824/0 (socket says 172.21.15.22:48824) 2024-08-20T01:32:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e80eac640 1 -- 172.21.15.22:0/300761907 learned_addr learned my addr 172.21.15.22:0/300761907 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e7b7fe640 1 --2- 172.21.15.22:0/300761907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa59370 0x55a67aa66930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e80eac640 1 --2- 172.21.15.22:0/300761907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa5bdb0 0x55a67aa66e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e80eac640 1 -- 172.21.15.22:0/300761907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa5bdb0 msgr2=0x55a67aa66e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e80eac640 1 --2- 172.21.15.22:0/300761907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa5bdb0 0x55a67aa66e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e80eac640 1 -- 172.21.15.22:0/300761907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa59370 msgr2=0x55a67aa66930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e80eac640 1 --2- 172.21.15.22:0/300761907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa59370 0x55a67aa66930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e80eac640 1 -- 172.21.15.22:0/300761907 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a67aa67600 con 0x55a67aa56a40 2024-08-20T01:32:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e7b7fe640 1 --2- 172.21.15.22:0/300761907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa59370 0x55a67aa66930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:32:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e80eac640 1 --2- 172.21.15.22:0/300761907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 0x55a67aa67c30 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3e74005e30 tx=0x7f3e740319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3b26d1c1fa859e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:32:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e5b7fe640 1 -- 172.21.15.22:0/300761907 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7404a040 con 0x55a67aa56a40 2024-08-20T01:32:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e5b7fe640 1 -- 172.21.15.22:0/300761907 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f3e74003b70 con 0x55a67aa56a40 2024-08-20T01:32:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e857dc740 1 -- 172.21.15.22:0/300761907 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e7404b040 con 0x55a67aa56a40 2024-08-20T01:32:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e5b7fe640 1 -- 172.21.15.22:0/300761907 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3e74003d70 con 0x55a67aa56a40 2024-08-20T01:32:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e857dc740 10 client.15693 fetch_fsmap learned FSMap version 27 2024-08-20T01:32:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.217+0000 7f3e857dc740 1 -- 172.21.15.22:0/300761907 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a67aad6840 con 0x55a67aa56a40 2024-08-20T01:32:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.218+0000 7f3e5b7fe640 1 -- 172.21.15.22:0/300761907 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e7404b040 con 0x55a67aa56a40 2024-08-20T01:32:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.218+0000 7f3e5b7fe640 1 -- 172.21.15.22:0/300761907 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3e7402fd40 con 0x55a67aa56a40 2024-08-20T01:32:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.218+0000 7f3e857dc740 10 client.15693 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:32:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.218+0000 7f3e857dc740 10 client.15693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:32:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.218+0000 7f3e857dc740 20 client.15693 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.218+0000 7f3e857dc740 1 --2- 172.21.15.22:0/300761907 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a67aad6ce0 0x55a67aad9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.218+0000 7f3e857dc740 4 client.15693 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:32:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.218+0000 7f3e857dc740 1 -- 172.21.15.22:0/300761907 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a67a9c2d50 con 0x55a67aad6ce0 2024-08-20T01:32:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.218+0000 7f3e7b7fe640 1 --2- 172.21.15.22:0/300761907 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a67aad6ce0 0x55a67aad9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.218+0000 7f3e5b7fe640 10 client.15693 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:33.218+0000 7f3e7b7fe640 1 --2- 172.21.15.22:0/300761907 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a67aad6ce0 0x55a67aad9100 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b51103438b9942ee server_cookie=9973d48c2141bf10 in_seq=0 out_seq=0 2024-08-20T01:32:33.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.270 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.270 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.270 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.270 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.270 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: pgmap v388: 97 pgs: 97 active+clean; 138 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 1.36k op/s 2024-08-20T01:32:33.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.282 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.282 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.282 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.282 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.282 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.282 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.282 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.282 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.282 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.282 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.282 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.282 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.282 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.287 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.287 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.287 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.287 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.287 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.287 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.287 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.287 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.287 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.287 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.287 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.287 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.287 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.287 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.287 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.288 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.288 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.288 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.288 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.288 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.288 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.288 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.288 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.288 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.288 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.288 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.288 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.288 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.289 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.289 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.289 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.289 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.289 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.289 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.289 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.289 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.289 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.289 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.289 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.289 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.289 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.290 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.290 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.290 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.290 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.290 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.290 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.290 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.290 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.290 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.290 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.290 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.290 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.290 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.291 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.291 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.291 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.291 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.291 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.291 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.291 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.291 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.291 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.291 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.291 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.291 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.291 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.291 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.292 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.292 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.292 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.292 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.292 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.292 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.292 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.292 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.292 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.292 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.292 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.292 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.292 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.292 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.293 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.293 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.293 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.293 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.293 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.293 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.293 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.293 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.293 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.293 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.293 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.293 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.293 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.293 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.293 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.294 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.294 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.294 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.294 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.294 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.294 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.294 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.294 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.294 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.294 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.294 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.294 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.294 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.295 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.295 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.295 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.295 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.295 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.295 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.295 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.295 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.295 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.295 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.295 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.295 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.295 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.295 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.296 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.296 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.296 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.296 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.296 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.296 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.296 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.296 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.296 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.296 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.296 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.296 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.296 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.296 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.297 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.297 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.297 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.297 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.297 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.297 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.297 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:33.297 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:33.297 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.077 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.078 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.081 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.082 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:34.083 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.145 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:34.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.270 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.270 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.270 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.273 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.274 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.276 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.277 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.278 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.279 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.280 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.281 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.282 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.282 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.282 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.282 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.282 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.282 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.283 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.284 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.285 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:34.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:34.286 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:35.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:34 smithi077 ceph-mon[22251]: pgmap v389: 97 pgs: 97 active+clean; 140 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 9.7 MiB/s wr, 956 op/s 2024-08-20T01:32:35.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:34 smithi022 ceph-mon[18709]: pgmap v389: 97 pgs: 97 active+clean; 140 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 9.7 MiB/s wr, 956 op/s 2024-08-20T01:32:35.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:34 smithi134 ceph-mon[22511]: pgmap v389: 97 pgs: 97 active+clean; 140 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 9.7 MiB/s wr, 956 op/s 2024-08-20T01:32:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.342+0000 7f3e5b7fe640 1 -- 172.21.15.22:0/300761907 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a67a9c2d50 con 0x55a67aad6ce0 2024-08-20T01:32:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.342+0000 7f3e5b7fe640 10 client.15693 handle_command_reply: tid=0 2024-08-20T01:32:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.342+0000 7f3e857dc740 1 client.15693 shutdown 2024-08-20T01:32:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.342+0000 7f3e857dc740 1 -- 172.21.15.22:0/300761907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 msgr2=0x55a67aa67c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.342+0000 7f3e857dc740 1 --2- 172.21.15.22:0/300761907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 0x55a67aa67c30 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3e74005e30 tx=0x7f3e740319b0 comp rx=0 tx=0).stop 2024-08-20T01:32:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.342+0000 7f3e857dc740 1 -- 172.21.15.22:0/300761907 shutdown_connections 2024-08-20T01:32:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.342+0000 7f3e857dc740 1 --2- 172.21.15.22:0/300761907 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a67aad6ce0 0x55a67aad9100 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.342+0000 7f3e857dc740 1 --2- 172.21.15.22:0/300761907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a67aa5bdb0 0x55a67aa66e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.342+0000 7f3e857dc740 1 --2- 172.21.15.22:0/300761907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a67aa59370 0x55a67aa66930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.342+0000 7f3e857dc740 1 --2- 172.21.15.22:0/300761907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a67aa56a40 0x55a67aa67c30 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.342+0000 7f3e5b7fe640 0 client.15693 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.342+0000 7f3e857dc740 1 -- 172.21.15.22:0/300761907 >> 172.21.15.22:0/300761907 conn(0x55a67aa4d730 msgr2=0x55a67aa4c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.342+0000 7f3e857dc740 1 -- 172.21.15.22:0/300761907 shutdown_connections 2024-08-20T01:32:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.343+0000 7f3e857dc740 1 -- 172.21.15.22:0/300761907 wait complete. 2024-08-20T01:32:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.343+0000 7f3e857dc740 20 client.15693 trim_cache size 0 max 16384 2024-08-20T01:32:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:32:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:32:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:32:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:32:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.343+0000 7f3e8290f640 1 -- 172.21.15.22:0/1008277047 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3e640b3bd0 msgr2=0x7f3e640b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.343+0000 7f3e8290f640 1 --2- 172.21.15.22:0/1008277047 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3e640b3bd0 0x7f3e640b6090 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c0aaf60 tx=0x7f3e6c0e7b90 comp rx=0 tx=0).stop 2024-08-20T01:32:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.343+0000 7f3e8290f640 1 -- 172.21.15.22:0/1008277047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c06bc50 msgr2=0x7f3e7c198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.343+0000 7f3e8290f640 1 --2- 172.21.15.22:0/1008277047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c06bc50 0x7f3e7c198ab0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00e9f0 tx=0x7f3e6c00edf0 comp rx=0 tx=0).stop 2024-08-20T01:32:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.343+0000 7f3e8290f640 1 -- 172.21.15.22:0/1008277047 shutdown_connections 2024-08-20T01:32:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.343+0000 7f3e8290f640 1 --2- 172.21.15.22:0/1008277047 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3e640b3bd0 0x7f3e640b6090 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.343+0000 7f3e8290f640 1 --2- 172.21.15.22:0/1008277047 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e7c1083c0 0x7f3e7c199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.343+0000 7f3e8290f640 1 --2- 172.21.15.22:0/1008277047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e7c105810 0x7f3e7c199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.343+0000 7f3e8290f640 1 --2- 172.21.15.22:0/1008277047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c06bc50 0x7f3e7c198ab0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.343+0000 7f3e8290f640 1 -- 172.21.15.22:0/1008277047 >> 172.21.15.22:0/1008277047 conn(0x7f3e7c0fce60 msgr2=0x7f3e7c103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.343+0000 7f3e8290f640 1 -- 172.21.15.22:0/1008277047 shutdown_connections 2024-08-20T01:32:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:35.343+0000 7f3e8290f640 1 -- 172.21.15.22:0/1008277047 wait complete. 2024-08-20T01:32:37.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: pgmap v390: 97 pgs: 97 active+clean; 143 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 1.02k op/s 2024-08-20T01:32:37.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:32:37.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:36 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: pgmap v390: 97 pgs: 97 active+clean; 143 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 1.02k op/s 2024-08-20T01:32:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:32:37.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:36 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: pgmap v390: 97 pgs: 97 active+clean; 143 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 1.02k op/s 2024-08-20T01:32:37.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:37.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:32:37.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:36 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:38.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:37 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:38.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:37 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:38.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:37 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:32:39.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:38 smithi022 ceph-mon[18709]: pgmap v391: 97 pgs: 97 active+clean; 127 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 1.11k op/s 2024-08-20T01:32:39.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:38 smithi134 ceph-mon[22511]: pgmap v391: 97 pgs: 97 active+clean; 127 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 1.11k op/s 2024-08-20T01:32:39.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:38 smithi077 ceph-mon[22251]: pgmap v391: 97 pgs: 97 active+clean; 127 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 1.11k op/s 2024-08-20T01:32:40.021 INFO:tasks.workunit.client.0.smithi022.stdout: 67 972615 1445 711916 1509 193348 437 2024-08-20T01:32:41.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:40 smithi022 ceph-mon[18709]: pgmap v392: 97 pgs: 97 active+clean; 128 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 9.4 MiB/s wr, 1.22k op/s 2024-08-20T01:32:41.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:40 smithi134 ceph-mon[22511]: pgmap v392: 97 pgs: 97 active+clean; 128 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 9.4 MiB/s wr, 1.22k op/s 2024-08-20T01:32:41.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:40 smithi077 ceph-mon[22251]: pgmap v392: 97 pgs: 97 active+clean; 128 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 9.4 MiB/s wr, 1.22k op/s 2024-08-20T01:32:43.116 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:42 smithi077 ceph-mon[22251]: pgmap v393: 97 pgs: 97 active+clean; 132 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.4 MiB/s wr, 1.09k op/s 2024-08-20T01:32:43.117 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:42 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:32:43.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:42 smithi022 ceph-mon[18709]: pgmap v393: 97 pgs: 97 active+clean; 132 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.4 MiB/s wr, 1.09k op/s 2024-08-20T01:32:43.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:42 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:32:43.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:42 smithi134 ceph-mon[22511]: pgmap v393: 97 pgs: 97 active+clean; 132 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.4 MiB/s wr, 1.09k op/s 2024-08-20T01:32:43.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:42 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:32:44.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:43 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:32:44.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:43 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:32:44.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:43 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:32:44.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:43 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:32:44.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:43 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:32:44.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:43 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:32:45.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:44 smithi022 ceph-mon[18709]: pgmap v394: 97 pgs: 97 active+clean; 142 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 695 op/s 2024-08-20T01:32:45.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:44 smithi134 ceph-mon[22511]: pgmap v394: 97 pgs: 97 active+clean; 142 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 695 op/s 2024-08-20T01:32:45.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:44 smithi077 ceph-mon[22251]: pgmap v394: 97 pgs: 97 active+clean; 142 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 695 op/s 2024-08-20T01:32:47.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:46 smithi022 ceph-mon[18709]: pgmap v395: 97 pgs: 97 active+clean; 177 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.4 MiB/s wr, 775 op/s 2024-08-20T01:32:47.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:46 smithi134 ceph-mon[22511]: pgmap v395: 97 pgs: 97 active+clean; 177 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.4 MiB/s wr, 775 op/s 2024-08-20T01:32:47.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:46 smithi077 ceph-mon[22251]: pgmap v395: 97 pgs: 97 active+clean; 177 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.4 MiB/s wr, 775 op/s 2024-08-20T01:32:48.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.453+0000 7ff98e53c640 1 -- 172.21.15.22:0/2456324050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9881026b0 msgr2=0x7ff988102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.453+0000 7ff98e53c640 1 --2- 172.21.15.22:0/2456324050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9881026b0 0x7ff988102b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009860 tx=0x7ff97c02a340 comp rx=0 tx=0).stop 2024-08-20T01:32:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.453+0000 7ff98e53c640 1 -- 172.21.15.22:0/2456324050 shutdown_connections 2024-08-20T01:32:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.453+0000 7ff98e53c640 1 --2- 172.21.15.22:0/2456324050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff988103070 0x7ff9881099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.453+0000 7ff98e53c640 1 --2- 172.21.15.22:0/2456324050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9881026b0 0x7ff988102b30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.453+0000 7ff98e53c640 1 --2- 172.21.15.22:0/2456324050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff988101560 0x7ff988101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.453+0000 7ff98e53c640 1 -- 172.21.15.22:0/2456324050 >> 172.21.15.22:0/2456324050 conn(0x7ff9880fce20 msgr2=0x7ff9880ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.453+0000 7ff98e53c640 1 -- 172.21.15.22:0/2456324050 shutdown_connections 2024-08-20T01:32:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.453+0000 7ff98e53c640 1 -- 172.21.15.22:0/2456324050 wait complete. 2024-08-20T01:32:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.454+0000 7ff98e53c640 1 Processor -- start 2024-08-20T01:32:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.454+0000 7ff98e53c640 1 -- start start 2024-08-20T01:32:48.457 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.454+0000 7ff98e53c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff988101560 0x7ff98806b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:48.457 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.454+0000 7ff98e53c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9881026b0 0x7ff98819d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:48.457 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.454+0000 7ff98e53c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff988103070 0x7ff98819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:48.457 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.454+0000 7ff98e53c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff98810d1b0 con 0x7ff9881026b0 2024-08-20T01:32:48.457 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.454+0000 7ff98e53c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff98810d030 con 0x7ff988103070 2024-08-20T01:32:48.457 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.454+0000 7ff98e53c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff98810d330 con 0x7ff988101560 2024-08-20T01:32:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.454+0000 7ff9877fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9881026b0 0x7ff98819d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.454+0000 7ff987fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff988101560 0x7ff98806b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.454+0000 7ff9877fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9881026b0 0x7ff98819d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44188/0 (socket says 172.21.15.22:44188) 2024-08-20T01:32:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.454+0000 7ff9877fe640 1 -- 172.21.15.22:0/2514308926 learned_addr learned my addr 172.21.15.22:0/2514308926 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.454+0000 7ff98cad9640 1 --2- 172.21.15.22:0/2514308926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff988103070 0x7ff98819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.455+0000 7ff987fff640 1 -- 172.21.15.22:0/2514308926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff988103070 msgr2=0x7ff98819fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.455+0000 7ff987fff640 1 --2- 172.21.15.22:0/2514308926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff988103070 0x7ff98819fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.455+0000 7ff987fff640 1 -- 172.21.15.22:0/2514308926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9881026b0 msgr2=0x7ff98819d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.455+0000 7ff987fff640 1 --2- 172.21.15.22:0/2514308926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9881026b0 0x7ff98819d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.455+0000 7ff987fff640 1 -- 172.21.15.22:0/2514308926 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9881a0600 con 0x7ff988101560 2024-08-20T01:32:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.455+0000 7ff987fff640 1 --2- 172.21.15.22:0/2514308926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff988101560 0x7ff98806b6a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff97800e9f0 tx=0x7ff97800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.455+0000 7ff9857fa640 1 -- 172.21.15.22:0/2514308926 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97800ccc0 con 0x7ff988101560 2024-08-20T01:32:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.455+0000 7ff9857fa640 1 -- 172.21.15.22:0/2514308926 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9780108e0 con 0x7ff988101560 2024-08-20T01:32:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.455+0000 7ff9857fa640 1 -- 172.21.15.22:0/2514308926 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff978018880 con 0x7ff988101560 2024-08-20T01:32:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.455+0000 7ff98e53c640 1 -- 172.21.15.22:0/2514308926 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9881a08f0 con 0x7ff988101560 2024-08-20T01:32:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.455+0000 7ff98e53c640 1 -- 172.21.15.22:0/2514308926 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9881a0e40 con 0x7ff988101560 2024-08-20T01:32:48.461 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.458+0000 7ff991406740 1 Processor -- start 2024-08-20T01:32:48.461 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.458+0000 7ff9857fa640 1 -- 172.21.15.22:0/2514308926 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff978010430 con 0x7ff988101560 2024-08-20T01:32:48.461 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.458+0000 7ff991406740 1 -- start start 2024-08-20T01:32:48.461 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.458+0000 7ff991406740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e36b8d0 0x55792e36dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:48.461 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.458+0000 7ff991406740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e36e200 0x55792e3705f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:48.461 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.458+0000 7ff991406740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e370c40 0x55792e373100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:48.461 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.458+0000 7ff991406740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55792e2de360 con 0x55792e36b8d0 2024-08-20T01:32:48.461 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.458+0000 7ff991406740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55792e2cd860 con 0x55792e36e200 2024-08-20T01:32:48.461 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.458+0000 7ff991406740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55792e2d18a0 con 0x55792e370c40 2024-08-20T01:32:48.461 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.459+0000 7ff98cad9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e36b8d0 0x55792e36dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:48.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.459+0000 7ff98cad9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e36b8d0 0x55792e36dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44192/0 (socket says 172.21.15.22:44192) 2024-08-20T01:32:48.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.459+0000 7ff98cad9640 1 -- 172.21.15.22:0/299170675 learned_addr learned my addr 172.21.15.22:0/299170675 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:48.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.459+0000 7ff9877fe640 1 --2- 172.21.15.22:0/299170675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e370c40 0x55792e373100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:48.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.459+0000 7ff987fff640 1 --2- 172.21.15.22:0/299170675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e36e200 0x55792e3705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:48.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.459+0000 7ff98cad9640 1 -- 172.21.15.22:0/299170675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e370c40 msgr2=0x55792e373100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:48.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.459+0000 7ff98cad9640 1 --2- 172.21.15.22:0/299170675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e370c40 0x55792e373100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.459+0000 7ff98cad9640 1 -- 172.21.15.22:0/299170675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e36e200 msgr2=0x55792e3705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:48.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.459+0000 7ff98cad9640 1 --2- 172.21.15.22:0/299170675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e36e200 0x55792e3705f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.459+0000 7ff98cad9640 1 -- 172.21.15.22:0/299170675 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55792e274e40 con 0x55792e36b8d0 2024-08-20T01:32:48.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.459+0000 7ff9857fa640 1 --2- 172.21.15.22:0/2514308926 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff9700b3bd0 0x7ff9700b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:48.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.459+0000 7ff98cad9640 1 --2- 172.21.15.22:0/299170675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e36b8d0 0x55792e36dcc0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff98000e580 tx=0x7ff9800095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f9bfbadd518801 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:48.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.459+0000 7ff987fff640 1 --2- 172.21.15.22:0/2514308926 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff9700b3bd0 0x7ff9700b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:48.463 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.459+0000 7ff96e7fc640 1 -- 172.21.15.22:0/299170675 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff980003970 con 0x55792e36b8d0 2024-08-20T01:32:48.463 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.460+0000 7ff9857fa640 1 -- 172.21.15.22:0/2514308926 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ff9780e3fb0 con 0x7ff988101560 2024-08-20T01:32:48.463 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.460+0000 7ff96e7fc640 1 -- 172.21.15.22:0/299170675 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff98000d830 con 0x55792e36b8d0 2024-08-20T01:32:48.463 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.460+0000 7ff96e7fc640 1 -- 172.21.15.22:0/299170675 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9800044c0 con 0x55792e36b8d0 2024-08-20T01:32:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.460+0000 7ff991406740 1 -- 172.21.15.22:0/299170675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e36b8d0 msgr2=0x55792e36dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.460+0000 7ff991406740 1 --2- 172.21.15.22:0/299170675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e36b8d0 0x55792e36dcc0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff98000e580 tx=0x7ff9800095c0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.460+0000 7ff987fff640 1 --2- 172.21.15.22:0/2514308926 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff9700b3bd0 0x7ff9700b6090 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff978000c00 tx=0x7ff9780e9040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.460+0000 7ff991406740 1 -- 172.21.15.22:0/299170675 shutdown_connections 2024-08-20T01:32:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.460+0000 7ff991406740 1 --2- 172.21.15.22:0/299170675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e370c40 0x55792e373100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.460+0000 7ff991406740 1 --2- 172.21.15.22:0/299170675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e36e200 0x55792e3705f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.460+0000 7ff991406740 1 --2- 172.21.15.22:0/299170675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e36b8d0 0x55792e36dcc0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.460+0000 7ff991406740 1 -- 172.21.15.22:0/299170675 >> 172.21.15.22:0/299170675 conn(0x55792e366a20 msgr2=0x55792e3677b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.460+0000 7ff991406740 1 -- 172.21.15.22:0/299170675 shutdown_connections 2024-08-20T01:32:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.460+0000 7ff991406740 1 -- 172.21.15.22:0/299170675 wait complete. 2024-08-20T01:32:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.461+0000 7ff991406740 1 -- start start 2024-08-20T01:32:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.461+0000 7ff991406740 1 Processor -- start 2024-08-20T01:32:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.461+0000 7ff991406740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e36b8d0 0x55792e375150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.461+0000 7ff991406740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e36e200 0x55792e3757f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.461+0000 7ff991406740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e370c40 0x55792e3763c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.461+0000 7ff991406740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55792e206ab0 con 0x55792e36b8d0 2024-08-20T01:32:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.461+0000 7ff991406740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55792e254780 con 0x55792e370c40 2024-08-20T01:32:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.461+0000 7ff991406740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55792e373c20 con 0x55792e36e200 2024-08-20T01:32:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.461+0000 7ff991406740 10 client.0 _ll_register_callbacks cb 0x55792dfdca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.462+0000 7ff98cad9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e36b8d0 0x55792e375150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.462+0000 7ff98cad9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e36b8d0 0x55792e375150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44208/0 (socket says 172.21.15.22:44208) 2024-08-20T01:32:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.462+0000 7ff98cad9640 1 -- 172.21.15.22:0/3165890562 learned_addr learned my addr 172.21.15.22:0/3165890562 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.462+0000 7ff9877fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e36e200 0x55792e3757f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.462+0000 7ff98cad9640 1 --2- 172.21.15.22:0/3165890562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e370c40 0x55792e3763c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.462+0000 7ff9877fe640 1 -- 172.21.15.22:0/3165890562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e370c40 msgr2=0x55792e3763c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.462+0000 7ff9877fe640 1 --2- 172.21.15.22:0/3165890562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e370c40 0x55792e3763c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.462+0000 7ff9877fe640 1 -- 172.21.15.22:0/3165890562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e36b8d0 msgr2=0x55792e375150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.462+0000 7ff9877fe640 1 --2- 172.21.15.22:0/3165890562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e36b8d0 0x55792e375150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.462+0000 7ff9877fe640 1 -- 172.21.15.22:0/3165890562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55792e030790 con 0x55792e36e200 2024-08-20T01:32:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.462+0000 7ff98cad9640 1 --2- 172.21.15.22:0/3165890562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e36b8d0 0x55792e375150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:32:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.462+0000 7ff9877fe640 1 --2- 172.21.15.22:0/3165890562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e36e200 0x55792e3757f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff97c02a930 tx=0x7ff97c009490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d979cd86316e28f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.462+0000 7ff9677fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:32:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.462+0000 7ff9677fe640 1 -- 172.21.15.22:0/3165890562 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c037040 con 0x55792e36e200 2024-08-20T01:32:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.462+0000 7ff991406740 1 -- 172.21.15.22:0/3165890562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55792e27ce00 con 0x55792e36e200 2024-08-20T01:32:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.462+0000 7ff9677fe640 1 -- 172.21.15.22:0/3165890562 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ff97c004240 con 0x55792e36e200 2024-08-20T01:32:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.463+0000 7ff9677fe640 1 -- 172.21.15.22:0/3165890562 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff97c04d050 con 0x55792e36e200 2024-08-20T01:32:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.463+0000 7ff991406740 10 client.25324 fetch_fsmap learned FSMap version 27 2024-08-20T01:32:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.463+0000 7ff991406740 1 -- 172.21.15.22:0/3165890562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55792e0a9620 con 0x55792e36e200 2024-08-20T01:32:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.463+0000 7ff9677fe640 1 -- 172.21.15.22:0/3165890562 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55792e27ce00 con 0x55792e36e200 2024-08-20T01:32:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.463+0000 7ff9677fe640 1 -- 172.21.15.22:0/3165890562 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff97c03d450 con 0x55792e36e200 2024-08-20T01:32:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.463+0000 7ff991406740 10 client.25324 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:32:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.463+0000 7ff991406740 10 client.25324 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:32:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.463+0000 7ff991406740 20 client.25324 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.463+0000 7ff991406740 1 --2- 172.21.15.22:0/3165890562 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55792e380aa0 0x55792e382ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.463+0000 7ff991406740 4 client.25324 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:32:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.463+0000 7ff991406740 1 -- 172.21.15.22:0/3165890562 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55792e2e02b0 con 0x55792e380aa0 2024-08-20T01:32:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.463+0000 7ff98cad9640 1 --2- 172.21.15.22:0/3165890562 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55792e380aa0 0x55792e382ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.464+0000 7ff98cad9640 1 --2- 172.21.15.22:0/3165890562 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55792e380aa0 0x55792e382ee0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2edee4c61b80269c server_cookie=3b160462589c6be1 in_seq=0 out_seq=0 2024-08-20T01:32:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.464+0000 7ff9677fe640 10 client.25324 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.467+0000 7ff9677fe640 1 -- 172.21.15.22:0/3165890562 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55792e2e02b0 con 0x55792e380aa0 2024-08-20T01:32:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.467+0000 7ff9677fe640 10 client.25324 handle_command_reply: tid=0 2024-08-20T01:32:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.467+0000 7ff991406740 1 client.25324 shutdown 2024-08-20T01:32:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.467+0000 7ff991406740 1 -- 172.21.15.22:0/3165890562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e36e200 msgr2=0x55792e3757f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.467+0000 7ff991406740 1 --2- 172.21.15.22:0/3165890562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e36e200 0x55792e3757f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff97c02a930 tx=0x7ff97c009490 comp rx=0 tx=0).stop 2024-08-20T01:32:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.467+0000 7ff991406740 1 -- 172.21.15.22:0/3165890562 shutdown_connections 2024-08-20T01:32:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.467+0000 7ff991406740 1 --2- 172.21.15.22:0/3165890562 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55792e380aa0 0x55792e382ee0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.467+0000 7ff991406740 1 --2- 172.21.15.22:0/3165890562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e370c40 0x55792e3763c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.467+0000 7ff991406740 1 --2- 172.21.15.22:0/3165890562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e36e200 0x55792e3757f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.467+0000 7ff9677fe640 0 client.25324 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.467+0000 7ff991406740 1 --2- 172.21.15.22:0/3165890562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e36b8d0 0x55792e375150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.467+0000 7ff991406740 1 -- 172.21.15.22:0/3165890562 >> 172.21.15.22:0/3165890562 conn(0x55792e366a20 msgr2=0x55792e365ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.467+0000 7ff991406740 1 -- 172.21.15.22:0/3165890562 shutdown_connections 2024-08-20T01:32:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.467+0000 7ff991406740 1 -- 172.21.15.22:0/3165890562 wait complete. 2024-08-20T01:32:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.468+0000 7ff991406740 20 client.25324 trim_cache size 0 max 16384 2024-08-20T01:32:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.489+0000 7ff991406740 1 Processor -- start 2024-08-20T01:32:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.490+0000 7ff991406740 1 -- start start 2024-08-20T01:32:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.490+0000 7ff991406740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e36b8d0 0x55792e375150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.490+0000 7ff991406740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e36e200 0x55792e375690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.490+0000 7ff991406740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e370c40 0x55792e371020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.490+0000 7ff991406740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff9881ac5d0 con 0x55792e370c40 2024-08-20T01:32:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.490+0000 7ff991406740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff9881a9ea0 con 0x55792e36e200 2024-08-20T01:32:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.490+0000 7ff991406740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9881a7cf0 con 0x55792e36b8d0 2024-08-20T01:32:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.490+0000 7ff9877fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e36e200 0x55792e375690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.490+0000 7ff9877fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e36e200 0x55792e375690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:43216/0 (socket says 172.21.15.22:43216) 2024-08-20T01:32:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.490+0000 7ff9877fe640 1 -- 172.21.15.22:0/3437247060 learned_addr learned my addr 172.21.15.22:0/3437247060 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.490+0000 7ff98cad9640 1 --2- 172.21.15.22:0/3437247060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e36b8d0 0x55792e375150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.490+0000 7ff98cad9640 1 --2- 172.21.15.22:0/3437247060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e370c40 0x55792e371020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.490+0000 7ff9877fe640 1 -- 172.21.15.22:0/3437247060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e36b8d0 msgr2=0x55792e375150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.490+0000 7ff9877fe640 1 --2- 172.21.15.22:0/3437247060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e36b8d0 0x55792e375150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.490+0000 7ff9877fe640 1 -- 172.21.15.22:0/3437247060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e370c40 msgr2=0x55792e371020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.490+0000 7ff9877fe640 1 --2- 172.21.15.22:0/3437247060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e370c40 0x55792e371020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.490+0000 7ff9877fe640 1 -- 172.21.15.22:0/3437247060 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55792e36e030 con 0x55792e36e200 2024-08-20T01:32:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.490+0000 7ff98cad9640 1 --2- 172.21.15.22:0/3437247060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e370c40 0x55792e371020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:32:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.490+0000 7ff9877fe640 1 --2- 172.21.15.22:0/3437247060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e36e200 0x55792e375690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff97c000c00 tx=0x7ff97c02a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e993799ffbfaa9e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.491+0000 7ff96dffb640 1 -- 172.21.15.22:0/3437247060 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c037030 con 0x55792e36e200 2024-08-20T01:32:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.491+0000 7ff96dffb640 1 -- 172.21.15.22:0/3437247060 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff97c0308d0 con 0x55792e36e200 2024-08-20T01:32:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.491+0000 7ff96dffb640 1 -- 172.21.15.22:0/3437247060 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c0052d0 con 0x55792e36e200 2024-08-20T01:32:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.491+0000 7ff991406740 1 -- 172.21.15.22:0/3437247060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e36e200 msgr2=0x55792e375690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.491+0000 7ff991406740 1 --2- 172.21.15.22:0/3437247060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e36e200 0x55792e375690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff97c000c00 tx=0x7ff97c02a340 comp rx=0 tx=0).stop 2024-08-20T01:32:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.491+0000 7ff991406740 1 -- 172.21.15.22:0/3437247060 shutdown_connections 2024-08-20T01:32:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.491+0000 7ff991406740 1 --2- 172.21.15.22:0/3437247060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e370c40 0x55792e371020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.491+0000 7ff991406740 1 --2- 172.21.15.22:0/3437247060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e36e200 0x55792e375690 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.491+0000 7ff991406740 1 --2- 172.21.15.22:0/3437247060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e36b8d0 0x55792e375150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.491+0000 7ff991406740 1 -- 172.21.15.22:0/3437247060 >> 172.21.15.22:0/3437247060 conn(0x55792e366a20 msgr2=0x55792e3676b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.492+0000 7ff991406740 1 -- 172.21.15.22:0/3437247060 shutdown_connections 2024-08-20T01:32:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.492+0000 7ff991406740 1 -- 172.21.15.22:0/3437247060 wait complete. 2024-08-20T01:32:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.492+0000 7ff991406740 1 -- start start 2024-08-20T01:32:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.492+0000 7ff991406740 1 Processor -- start 2024-08-20T01:32:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.492+0000 7ff991406740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e36b8d0 0x55792e37c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.492+0000 7ff991406740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e36e200 0x55792e37b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.492+0000 7ff991406740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e370c40 0x55792e37bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff991406740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff9881a8360 con 0x55792e370c40 2024-08-20T01:32:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff991406740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff9881a97d0 con 0x55792e36b8d0 2024-08-20T01:32:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff991406740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9881a8a30 con 0x55792e36e200 2024-08-20T01:32:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff991406740 10 client.0 _ll_register_callbacks cb 0x7ff980009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff9877fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e36e200 0x55792e37b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff98cad9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e370c40 0x55792e37bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff9877fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e36e200 0x55792e37b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:60320/0 (socket says 172.21.15.22:60320) 2024-08-20T01:32:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff98cad9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e370c40 0x55792e37bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44222/0 (socket says 172.21.15.22:44222) 2024-08-20T01:32:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff9877fe640 1 -- 172.21.15.22:0/2460040342 learned_addr learned my addr 172.21.15.22:0/2460040342 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff98cad9640 1 --2- 172.21.15.22:0/2460040342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e36b8d0 0x55792e37c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff98cad9640 1 -- 172.21.15.22:0/2460040342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e36e200 msgr2=0x55792e37b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff98cad9640 1 --2- 172.21.15.22:0/2460040342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e36e200 0x55792e37b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff98cad9640 1 -- 172.21.15.22:0/2460040342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e36b8d0 msgr2=0x55792e37c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff98cad9640 1 --2- 172.21.15.22:0/2460040342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e36b8d0 0x55792e37c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff98cad9640 1 -- 172.21.15.22:0/2460040342 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55792e37c0d0 con 0x55792e370c40 2024-08-20T01:32:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff9877fe640 1 --2- 172.21.15.22:0/2460040342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e36e200 0x55792e37b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:32:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff98cad9640 1 --2- 172.21.15.22:0/2460040342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e370c40 0x55792e37bb90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff980009ec0 tx=0x7ff9800095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42705232aebbecf server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff9677fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:32:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff9677fe640 1 -- 172.21.15.22:0/2460040342 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98000dae0 con 0x55792e370c40 2024-08-20T01:32:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff9677fe640 1 -- 172.21.15.22:0/2460040342 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ff98001c040 con 0x55792e370c40 2024-08-20T01:32:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.493+0000 7ff991406740 1 -- 172.21.15.22:0/2460040342 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff97c0308d0 con 0x55792e370c40 2024-08-20T01:32:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.494+0000 7ff9677fe640 1 -- 172.21.15.22:0/2460040342 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff98000dc80 con 0x55792e370c40 2024-08-20T01:32:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.494+0000 7ff991406740 10 client.15711 fetch_fsmap learned FSMap version 27 2024-08-20T01:32:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.494+0000 7ff991406740 1 -- 172.21.15.22:0/2460040342 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55792e37aef0 con 0x55792e370c40 2024-08-20T01:32:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.494+0000 7ff9677fe640 1 -- 172.21.15.22:0/2460040342 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff97c0308d0 con 0x55792e370c40 2024-08-20T01:32:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.494+0000 7ff9677fe640 1 -- 172.21.15.22:0/2460040342 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff98000b040 con 0x55792e370c40 2024-08-20T01:32:48.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.494+0000 7ff991406740 10 client.15711 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:32:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.494+0000 7ff991406740 10 client.15711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:32:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.494+0000 7ff991406740 20 client.15711 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.494+0000 7ff991406740 1 --2- 172.21.15.22:0/2460040342 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55792e3f01d0 0x55792e3f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.494+0000 7ff991406740 4 client.15711 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:32:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.494+0000 7ff991406740 1 -- 172.21.15.22:0/2460040342 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55792e2dbd50 con 0x55792e3f01d0 2024-08-20T01:32:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.494+0000 7ff9877fe640 1 --2- 172.21.15.22:0/2460040342 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55792e3f01d0 0x55792e3f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.495+0000 7ff9677fe640 10 client.15711 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:48.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:48.495+0000 7ff9877fe640 1 --2- 172.21.15.22:0/2460040342 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55792e3f01d0 0x55792e3f25f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c7805b9e5a19daf server_cookie=625ee672ff6287 in_seq=0 out_seq=0 2024-08-20T01:32:49.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:48 smithi022 ceph-mon[18709]: pgmap v396: 97 pgs: 97 active+clean; 236 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 870 op/s 2024-08-20T01:32:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.254+0000 7ff9677fe640 1 -- 172.21.15.22:0/2460040342 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55792e2dbd50 con 0x55792e3f01d0 2024-08-20T01:32:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.254+0000 7ff9677fe640 10 client.15711 handle_command_reply: tid=0 2024-08-20T01:32:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.255+0000 7ff991406740 1 client.15711 shutdown 2024-08-20T01:32:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.257+0000 7ff991406740 1 -- 172.21.15.22:0/2460040342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e370c40 msgr2=0x55792e37bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.257+0000 7ff991406740 1 --2- 172.21.15.22:0/2460040342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e370c40 0x55792e37bb90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff980009ec0 tx=0x7ff9800095c0 comp rx=0 tx=0).stop 2024-08-20T01:32:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.258+0000 7ff991406740 1 -- 172.21.15.22:0/2460040342 shutdown_connections 2024-08-20T01:32:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.258+0000 7ff991406740 1 --2- 172.21.15.22:0/2460040342 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55792e3f01d0 0x55792e3f25f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.258+0000 7ff991406740 1 --2- 172.21.15.22:0/2460040342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55792e370c40 0x55792e37bb90 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.258+0000 7ff991406740 1 --2- 172.21.15.22:0/2460040342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55792e36e200 0x55792e37b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.258+0000 7ff991406740 1 --2- 172.21.15.22:0/2460040342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55792e36b8d0 0x55792e37c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.258+0000 7ff991406740 1 -- 172.21.15.22:0/2460040342 >> 172.21.15.22:0/2460040342 conn(0x55792e366a20 msgr2=0x55792e375130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.258+0000 7ff9677fe640 0 client.15711 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.258+0000 7ff991406740 1 -- 172.21.15.22:0/2460040342 shutdown_connections 2024-08-20T01:32:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.259+0000 7ff991406740 1 -- 172.21.15.22:0/2460040342 wait complete. 2024-08-20T01:32:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.259+0000 7ff991406740 20 client.15711 trim_cache size 0 max 16384 2024-08-20T01:32:49.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:32:49.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:32:49.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:32:49.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:32:49.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:48 smithi134 ceph-mon[22511]: pgmap v396: 97 pgs: 97 active+clean; 236 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 870 op/s 2024-08-20T01:32:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.273+0000 7ff98e53c640 1 -- 172.21.15.22:0/2514308926 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff9700b3bd0 msgr2=0x7ff9700b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.273+0000 7ff98e53c640 1 --2- 172.21.15.22:0/2514308926 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff9700b3bd0 0x7ff9700b6090 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff978000c00 tx=0x7ff9780e9040 comp rx=0 tx=0).stop 2024-08-20T01:32:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.273+0000 7ff98e53c640 1 -- 172.21.15.22:0/2514308926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff988101560 msgr2=0x7ff98806b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.273+0000 7ff98e53c640 1 --2- 172.21.15.22:0/2514308926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff988101560 0x7ff98806b6a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff97800e9f0 tx=0x7ff97800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:32:49.278 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.277+0000 7ff98e53c640 1 -- 172.21.15.22:0/2514308926 shutdown_connections 2024-08-20T01:32:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.277+0000 7ff98e53c640 1 --2- 172.21.15.22:0/2514308926 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff9700b3bd0 0x7ff9700b6090 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.277+0000 7ff98e53c640 1 --2- 172.21.15.22:0/2514308926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff988103070 0x7ff98819fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.277+0000 7ff98e53c640 1 --2- 172.21.15.22:0/2514308926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9881026b0 0x7ff98819d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.277+0000 7ff98e53c640 1 --2- 172.21.15.22:0/2514308926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff988101560 0x7ff98806b6a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.277+0000 7ff98e53c640 1 -- 172.21.15.22:0/2514308926 >> 172.21.15.22:0/2514308926 conn(0x7ff9880fce20 msgr2=0x7ff988105a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.277+0000 7ff98e53c640 1 -- 172.21.15.22:0/2514308926 shutdown_connections 2024-08-20T01:32:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:32:49.278+0000 7ff98e53c640 1 -- 172.21.15.22:0/2514308926 wait complete. 2024-08-20T01:32:49.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:48 smithi077 ceph-mon[22251]: pgmap v396: 97 pgs: 97 active+clean; 236 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 870 op/s 2024-08-20T01:32:50.021 INFO:tasks.workunit.client.0.smithi022.stdout: 79 718474 822 513876 547 148916 462 2024-08-20T01:32:51.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:50 smithi022 ceph-mon[18709]: pgmap v397: 97 pgs: 97 active+clean; 236 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 661 op/s 2024-08-20T01:32:51.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:50 smithi134 ceph-mon[22511]: pgmap v397: 97 pgs: 97 active+clean; 236 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 661 op/s 2024-08-20T01:32:51.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:50 smithi077 ceph-mon[22251]: pgmap v397: 97 pgs: 97 active+clean; 236 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 661 op/s 2024-08-20T01:32:52.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:52 smithi022 ceph-mon[18709]: pgmap v398: 97 pgs: 97 active+clean; 220 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 10 MiB/s wr, 849 op/s 2024-08-20T01:32:53.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:52 smithi134 ceph-mon[22511]: pgmap v398: 97 pgs: 97 active+clean; 220 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 10 MiB/s wr, 849 op/s 2024-08-20T01:32:53.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:52 smithi077 ceph-mon[22251]: pgmap v398: 97 pgs: 97 active+clean; 220 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 10 MiB/s wr, 849 op/s 2024-08-20T01:32:55.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:54 smithi022 ceph-mon[18709]: pgmap v399: 97 pgs: 97 active+clean; 214 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.9 MiB/s wr, 878 op/s 2024-08-20T01:32:55.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:54 smithi134 ceph-mon[22511]: pgmap v399: 97 pgs: 97 active+clean; 214 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.9 MiB/s wr, 878 op/s 2024-08-20T01:32:55.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:54 smithi077 ceph-mon[22251]: pgmap v399: 97 pgs: 97 active+clean; 214 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.9 MiB/s wr, 878 op/s 2024-08-20T01:32:57.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:56 smithi022 ceph-mon[18709]: pgmap v400: 97 pgs: 97 active+clean; 215 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.1 MiB/s wr, 903 op/s 2024-08-20T01:32:57.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:56 smithi134 ceph-mon[22511]: pgmap v400: 97 pgs: 97 active+clean; 215 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.1 MiB/s wr, 903 op/s 2024-08-20T01:32:57.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:56 smithi077 ceph-mon[22251]: pgmap v400: 97 pgs: 97 active+clean; 215 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.1 MiB/s wr, 903 op/s 2024-08-20T01:32:58.554 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:32:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:32:59.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:32:58 smithi022 ceph-mon[18709]: pgmap v401: 97 pgs: 97 active+clean; 221 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.7 MiB/s wr, 836 op/s 2024-08-20T01:32:59.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:32:58 smithi134 ceph-mon[22511]: pgmap v401: 97 pgs: 97 active+clean; 221 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.7 MiB/s wr, 836 op/s 2024-08-20T01:32:59.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:32:58 smithi077 ceph-mon[22251]: pgmap v401: 97 pgs: 97 active+clean; 221 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.7 MiB/s wr, 836 op/s 2024-08-20T01:32:59.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.394+0000 7f883d03f640 1 -- 172.21.15.22:0/250889736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8838102af0 msgr2=0x7f8838102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:59.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.394+0000 7f883d03f640 1 --2- 172.21.15.22:0/250889736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8838102af0 0x7f8838102ed0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8828009900 tx=0x7f882802a410 comp rx=0 tx=0).stop 2024-08-20T01:32:59.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.394+0000 7f883d03f640 1 -- 172.21.15.22:0/250889736 shutdown_connections 2024-08-20T01:32:59.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.394+0000 7f883d03f640 1 --2- 172.21.15.22:0/250889736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8838108e80 0x7f883810f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.394+0000 7f883d03f640 1 --2- 172.21.15.22:0/250889736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8838108500 0x7f8838108940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.394+0000 7f883d03f640 1 --2- 172.21.15.22:0/250889736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8838102af0 0x7f8838102ed0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.394+0000 7f883d03f640 1 -- 172.21.15.22:0/250889736 >> 172.21.15.22:0/250889736 conn(0x7f88380fe540 msgr2=0x7f8838100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:59.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.394+0000 7f883d03f640 1 -- 172.21.15.22:0/250889736 shutdown_connections 2024-08-20T01:32:59.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.394+0000 7f883d03f640 1 -- 172.21.15.22:0/250889736 wait complete. 2024-08-20T01:32:59.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.395+0000 7f883d03f640 1 Processor -- start 2024-08-20T01:32:59.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.395+0000 7f883d03f640 1 -- start start 2024-08-20T01:32:59.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.396+0000 7f883d03f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8838102af0 0x7f88380751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:59.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.396+0000 7f883d03f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8838108500 0x7f8838075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:59.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.396+0000 7f883d03f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8838108e80 0x7f8838075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:59.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.396+0000 7f883d03f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8838112b40 con 0x7f8838108500 2024-08-20T01:32:59.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.396+0000 7f883d03f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f88381129c0 con 0x7f8838102af0 2024-08-20T01:32:59.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.396+0000 7f883d03f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8838112cc0 con 0x7f8838108e80 2024-08-20T01:32:59.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.396+0000 7f8836d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8838102af0 0x7f88380751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:59.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.396+0000 7f882ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8838108500 0x7f8838075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:59.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.396+0000 7f883759e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8838108e80 0x7f8838075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:59.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.396+0000 7f8836d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8838102af0 0x7f88380751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:35112/0 (socket says 172.21.15.22:35112) 2024-08-20T01:32:59.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.396+0000 7f8836d9d640 1 -- 172.21.15.22:0/2779909394 learned_addr learned my addr 172.21.15.22:0/2779909394 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:59.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.396+0000 7f8836d9d640 1 -- 172.21.15.22:0/2779909394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8838108e80 msgr2=0x7f8838075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:59.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.396+0000 7f8836d9d640 1 --2- 172.21.15.22:0/2779909394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8838108e80 0x7f8838075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.396+0000 7f8836d9d640 1 -- 172.21.15.22:0/2779909394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8838108500 msgr2=0x7f8838075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:59.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.396+0000 7f8836d9d640 1 --2- 172.21.15.22:0/2779909394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8838108500 0x7f8838075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.396+0000 7f8836d9d640 1 -- 172.21.15.22:0/2779909394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88381a73a0 con 0x7f8838102af0 2024-08-20T01:32:59.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.397+0000 7f8836d9d640 1 --2- 172.21.15.22:0/2779909394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8838102af0 0x7f88380751d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8828005940 tx=0x7f88280040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:59.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.397+0000 7f8834d99640 1 -- 172.21.15.22:0/2779909394 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882803f030 con 0x7f8838102af0 2024-08-20T01:32:59.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.397+0000 7f883d03f640 1 -- 172.21.15.22:0/2779909394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88381a7630 con 0x7f8838102af0 2024-08-20T01:32:59.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.397+0000 7f8834d99640 1 -- 172.21.15.22:0/2779909394 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88280044c0 con 0x7f8838102af0 2024-08-20T01:32:59.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.397+0000 7f8834d99640 1 -- 172.21.15.22:0/2779909394 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8828035070 con 0x7f8838102af0 2024-08-20T01:32:59.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.397+0000 7f883d03f640 1 -- 172.21.15.22:0/2779909394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88381a7b60 con 0x7f8838102af0 2024-08-20T01:32:59.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.400+0000 7f883f438740 1 Processor -- start 2024-08-20T01:32:59.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.400+0000 7f883f438740 1 -- start start 2024-08-20T01:32:59.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.401+0000 7f883f438740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603987f8830 0x5603987f8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:59.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.401+0000 7f883f438740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603987f9150 0x560398804ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:59.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.401+0000 7f8834d99640 1 -- 172.21.15.22:0/2779909394 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8828042030 con 0x7f8838102af0 2024-08-20T01:32:59.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.401+0000 7f883f438740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603988050e0 0x5603988074d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:59.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.401+0000 7f883f438740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56039876f8e0 con 0x5603988050e0 2024-08-20T01:32:59.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.401+0000 7f883f438740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56039875ede0 con 0x5603987f8830 2024-08-20T01:32:59.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.401+0000 7f883f438740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560398762e20 con 0x5603987f9150 2024-08-20T01:32:59.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.401+0000 7f883759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603987f8830 0x5603987f8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:59.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.401+0000 7f883759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603987f8830 0x5603987f8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:35126/0 (socket says 172.21.15.22:35126) 2024-08-20T01:32:59.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.401+0000 7f883759e640 1 -- 172.21.15.22:0/1990389818 learned_addr learned my addr 172.21.15.22:0/1990389818 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:59.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.402+0000 7f882ffff640 1 --2- 172.21.15.22:0/1990389818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603988050e0 0x5603988074d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:59.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.402+0000 7f883759e640 1 -- 172.21.15.22:0/1990389818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603987f9150 msgr2=0x560398804ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:59.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.402+0000 7f883759e640 1 --2- 172.21.15.22:0/1990389818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603987f9150 0x560398804ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.402+0000 7f883759e640 1 -- 172.21.15.22:0/1990389818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603988050e0 msgr2=0x5603988074d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:59.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.402+0000 7f883759e640 1 --2- 172.21.15.22:0/1990389818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603988050e0 0x5603988074d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.402+0000 7f883759e640 1 -- 172.21.15.22:0/1990389818 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603984be650 con 0x5603987f8830 2024-08-20T01:32:59.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.403+0000 7f8834d99640 1 --2- 172.21.15.22:0/2779909394 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f88240b3bd0 0x7f88240b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:59.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.403+0000 7f8836d9d640 1 --2- 172.21.15.22:0/2779909394 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f88240b3bd0 0x7f88240b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:59.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.403+0000 7f883759e640 1 --2- 172.21.15.22:0/1990389818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603987f8830 0x5603987f8c10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8830009f90 tx=0x7f88300118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e3cda8ee1739a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:59.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.403+0000 7f8834d99640 1 -- 172.21.15.22:0/2779909394 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f8828104000 con 0x7f8838102af0 2024-08-20T01:32:59.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.404+0000 7f8836d9d640 1 --2- 172.21.15.22:0/2779909394 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f88240b3bd0 0x7f88240b6090 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f88280c6f90 tx=0x7f88280c6e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:59.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.404+0000 7f882d7fa640 1 -- 172.21.15.22:0/1990389818 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830004b20 con 0x5603987f8830 2024-08-20T01:32:59.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.404+0000 7f882d7fa640 1 -- 172.21.15.22:0/1990389818 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8830004cc0 con 0x5603987f8830 2024-08-20T01:32:59.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.404+0000 7f882d7fa640 1 -- 172.21.15.22:0/1990389818 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830005020 con 0x5603987f8830 2024-08-20T01:32:59.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.405+0000 7f883f438740 1 -- 172.21.15.22:0/1990389818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603987f8830 msgr2=0x5603987f8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:59.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.405+0000 7f883f438740 1 --2- 172.21.15.22:0/1990389818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603987f8830 0x5603987f8c10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8830009f90 tx=0x7f88300118d0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.405+0000 7f883f438740 1 -- 172.21.15.22:0/1990389818 shutdown_connections 2024-08-20T01:32:59.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.405+0000 7f883f438740 1 --2- 172.21.15.22:0/1990389818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603988050e0 0x5603988074d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.405+0000 7f883f438740 1 --2- 172.21.15.22:0/1990389818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603987f9150 0x560398804ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.405+0000 7f883f438740 1 --2- 172.21.15.22:0/1990389818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603987f8830 0x5603987f8c10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.405+0000 7f883f438740 1 -- 172.21.15.22:0/1990389818 >> 172.21.15.22:0/1990389818 conn(0x5603987f6660 msgr2=0x5603987f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:59.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.405+0000 7f883f438740 1 -- 172.21.15.22:0/1990389818 shutdown_connections 2024-08-20T01:32:59.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.405+0000 7f883f438740 1 -- 172.21.15.22:0/1990389818 wait complete. 2024-08-20T01:32:59.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.405+0000 7f883f438740 1 -- start start 2024-08-20T01:32:59.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.406+0000 7f883f438740 1 Processor -- start 2024-08-20T01:32:59.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.406+0000 7f883f438740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603987f8830 0x5603988020c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:59.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.406+0000 7f883f438740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603987f9150 0x560398802600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:59.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.406+0000 7f883f438740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603988050e0 0x560398802b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:59.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.406+0000 7f883f438740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5603985c1700 con 0x5603987f8830 2024-08-20T01:32:59.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.406+0000 7f883f438740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5603986e57c0 con 0x5603987f9150 2024-08-20T01:32:59.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.406+0000 7f883f438740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560398807d90 con 0x5603988050e0 2024-08-20T01:32:59.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.406+0000 7f883f438740 10 client.0 _ll_register_callbacks cb 0x5603987586b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:59.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.406+0000 7f882ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603987f9150 0x560398802600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:59.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.406+0000 7f882ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603987f9150 0x560398802600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:35132/0 (socket says 172.21.15.22:35132) 2024-08-20T01:32:59.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.406+0000 7f882ffff640 1 -- 172.21.15.22:0/3080278167 learned_addr learned my addr 172.21.15.22:0/3080278167 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:59.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.406+0000 7f883759e640 1 --2- 172.21.15.22:0/3080278167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603987f8830 0x5603988020c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:59.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.406+0000 7f883759e640 1 --2- 172.21.15.22:0/3080278167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603988050e0 0x560398802b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:59.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.407+0000 7f882ffff640 1 -- 172.21.15.22:0/3080278167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603988050e0 msgr2=0x560398802b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:59.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.407+0000 7f882ffff640 1 --2- 172.21.15.22:0/3080278167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603988050e0 0x560398802b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.407+0000 7f882ffff640 1 -- 172.21.15.22:0/3080278167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603987f8830 msgr2=0x5603988020c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:59.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.407+0000 7f882ffff640 1 --2- 172.21.15.22:0/3080278167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603987f8830 0x5603988020c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.407+0000 7f882ffff640 1 -- 172.21.15.22:0/3080278167 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560398811190 con 0x5603987f9150 2024-08-20T01:32:59.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.407+0000 7f882ffff640 1 --2- 172.21.15.22:0/3080278167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603987f9150 0x560398802600 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8820013710 tx=0x7f8820013bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16b9ffb0bf9bd521 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:59.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.407+0000 7f881e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:32:59.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.407+0000 7f881e7fc640 1 -- 172.21.15.22:0/3080278167 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8820011dd0 con 0x5603987f9150 2024-08-20T01:32:59.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.407+0000 7f881e7fc640 1 -- 172.21.15.22:0/3080278167 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f8820004030 con 0x5603987f9150 2024-08-20T01:32:59.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.407+0000 7f883f438740 1 -- 172.21.15.22:0/3080278167 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56039870e100 con 0x5603987f9150 2024-08-20T01:32:59.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.407+0000 7f881e7fc640 1 -- 172.21.15.22:0/3080278167 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8820004230 con 0x5603987f9150 2024-08-20T01:32:59.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.407+0000 7f883f438740 10 client.25319 fetch_fsmap learned FSMap version 27 2024-08-20T01:32:59.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.407+0000 7f883f438740 1 -- 172.21.15.22:0/3080278167 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560398813ba0 con 0x5603987f9150 2024-08-20T01:32:59.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.408+0000 7f881e7fc640 1 -- 172.21.15.22:0/3080278167 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56039870e100 con 0x5603987f9150 2024-08-20T01:32:59.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.408+0000 7f881e7fc640 1 -- 172.21.15.22:0/3080278167 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f882001a070 con 0x5603987f9150 2024-08-20T01:32:59.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.408+0000 7f883f438740 10 client.25319 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:32:59.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.408+0000 7f883f438740 10 client.25319 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:32:59.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.408+0000 7f883f438740 20 client.25319 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:59.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.408+0000 7f883f438740 1 --2- 172.21.15.22:0/3080278167 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560398815050 0x5603988174c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:59.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.408+0000 7f883f438740 4 client.25319 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:32:59.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.408+0000 7f883f438740 1 -- 172.21.15.22:0/3080278167 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560398771830 con 0x560398815050 2024-08-20T01:32:59.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.408+0000 7f883759e640 1 --2- 172.21.15.22:0/3080278167 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560398815050 0x5603988174c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:59.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.409+0000 7f883759e640 1 --2- 172.21.15.22:0/3080278167 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560398815050 0x5603988174c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=153e5ffd8f26cf38 server_cookie=b23523b2b4a36d15 in_seq=0 out_seq=0 2024-08-20T01:32:59.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.409+0000 7f881e7fc640 10 client.25319 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:59.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.411+0000 7f881e7fc640 1 -- 172.21.15.22:0/3080278167 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560398771830 con 0x560398815050 2024-08-20T01:32:59.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.411+0000 7f881e7fc640 10 client.25319 handle_command_reply: tid=0 2024-08-20T01:32:59.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.411+0000 7f883f438740 1 client.25319 shutdown 2024-08-20T01:32:59.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.411+0000 7f883f438740 1 -- 172.21.15.22:0/3080278167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603987f9150 msgr2=0x560398802600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:59.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.411+0000 7f883f438740 1 --2- 172.21.15.22:0/3080278167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603987f9150 0x560398802600 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8820013710 tx=0x7f8820013bd0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.411+0000 7f883f438740 1 -- 172.21.15.22:0/3080278167 shutdown_connections 2024-08-20T01:32:59.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.411+0000 7f883f438740 1 --2- 172.21.15.22:0/3080278167 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560398815050 0x5603988174c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.412+0000 7f881e7fc640 0 client.25319 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:59.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.412+0000 7f883f438740 1 --2- 172.21.15.22:0/3080278167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603988050e0 0x560398802b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.412+0000 7f883f438740 1 --2- 172.21.15.22:0/3080278167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603987f9150 0x560398802600 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.412+0000 7f883f438740 1 --2- 172.21.15.22:0/3080278167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603987f8830 0x5603988020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.412+0000 7f883f438740 1 -- 172.21.15.22:0/3080278167 >> 172.21.15.22:0/3080278167 conn(0x5603987f6660 msgr2=0x5603987fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:59.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.412+0000 7f883f438740 1 -- 172.21.15.22:0/3080278167 shutdown_connections 2024-08-20T01:32:59.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.412+0000 7f883f438740 1 -- 172.21.15.22:0/3080278167 wait complete. 2024-08-20T01:32:59.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.412+0000 7f883f438740 20 client.25319 trim_cache size 0 max 16384 2024-08-20T01:32:59.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.431+0000 7f883f438740 1 Processor -- start 2024-08-20T01:32:59.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.431+0000 7f883f438740 1 -- start start 2024-08-20T01:32:59.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.432+0000 7f883f438740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603987f8830 0x5603987f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:59.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.432+0000 7f883f438740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603987f9150 0x5603987fc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:59.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.432+0000 7f883f438740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603988050e0 0x56039881cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:59.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.432+0000 7f883f438740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f88381b2c50 con 0x5603987f9150 2024-08-20T01:32:59.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.432+0000 7f883f438740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f88381b0520 con 0x5603988050e0 2024-08-20T01:32:59.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.432+0000 7f883f438740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f88381ae370 con 0x5603987f8830 2024-08-20T01:32:59.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.432+0000 7f882ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603987f9150 0x5603987fc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:59.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.432+0000 7f883759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603988050e0 0x56039881cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:59.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.432+0000 7f882ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603987f9150 0x5603987fc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41290/0 (socket says 172.21.15.22:41290) 2024-08-20T01:32:59.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.432+0000 7f882ffff640 1 -- 172.21.15.22:0/3204650202 learned_addr learned my addr 172.21.15.22:0/3204650202 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:59.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.432+0000 7f883759e640 1 --2- 172.21.15.22:0/3204650202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603987f8830 0x5603987f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:59.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.432+0000 7f883759e640 1 -- 172.21.15.22:0/3204650202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603987f8830 msgr2=0x5603987f7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:59.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.432+0000 7f883759e640 1 --2- 172.21.15.22:0/3204650202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603987f8830 0x5603987f7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.432+0000 7f883759e640 1 -- 172.21.15.22:0/3204650202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603987f9150 msgr2=0x5603987fc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:59.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.432+0000 7f883759e640 1 --2- 172.21.15.22:0/3204650202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603987f9150 0x5603987fc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.432+0000 7f883759e640 1 -- 172.21.15.22:0/3204650202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603987f6490 con 0x5603988050e0 2024-08-20T01:32:59.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.432+0000 7f882ffff640 1 --2- 172.21.15.22:0/3204650202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603987f9150 0x5603987fc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:32:59.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.432+0000 7f883759e640 1 --2- 172.21.15.22:0/3204650202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603988050e0 0x56039881cdd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8830004430 tx=0x7f8830004530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37b063a75c001a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:59.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.433+0000 7f882cff9640 1 -- 172.21.15.22:0/3204650202 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830003c70 con 0x5603988050e0 2024-08-20T01:32:59.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.433+0000 7f882cff9640 1 -- 172.21.15.22:0/3204650202 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f883000f4e0 con 0x5603988050e0 2024-08-20T01:32:59.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.433+0000 7f882cff9640 1 -- 172.21.15.22:0/3204650202 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830027440 con 0x5603988050e0 2024-08-20T01:32:59.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.434+0000 7f883f438740 1 -- 172.21.15.22:0/3204650202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603988050e0 msgr2=0x56039881cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:59.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.434+0000 7f883f438740 1 --2- 172.21.15.22:0/3204650202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603988050e0 0x56039881cdd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8830004430 tx=0x7f8830004530 comp rx=0 tx=0).stop 2024-08-20T01:32:59.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.434+0000 7f883f438740 1 -- 172.21.15.22:0/3204650202 shutdown_connections 2024-08-20T01:32:59.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.434+0000 7f883f438740 1 --2- 172.21.15.22:0/3204650202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603988050e0 0x56039881cdd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.434+0000 7f883f438740 1 --2- 172.21.15.22:0/3204650202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603987f9150 0x5603987fc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.434+0000 7f883f438740 1 --2- 172.21.15.22:0/3204650202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603987f8830 0x5603987f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.434+0000 7f883f438740 1 -- 172.21.15.22:0/3204650202 >> 172.21.15.22:0/3204650202 conn(0x5603987f6660 msgr2=0x5603987f7770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:59.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.434+0000 7f883f438740 1 -- 172.21.15.22:0/3204650202 shutdown_connections 2024-08-20T01:32:59.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.434+0000 7f883f438740 1 -- 172.21.15.22:0/3204650202 wait complete. 2024-08-20T01:32:59.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.434+0000 7f883f438740 1 -- start start 2024-08-20T01:32:59.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.434+0000 7f883f438740 1 Processor -- start 2024-08-20T01:32:59.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f883f438740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603987f8830 0x56039880d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:59.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f883f438740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603987f9150 0x5603987fec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:59.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f883f438740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603988050e0 0x5603987ff1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:59.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f883f438740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f88381ae9e0 con 0x5603987f9150 2024-08-20T01:32:59.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f883f438740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f88381afe50 con 0x5603987f8830 2024-08-20T01:32:59.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f883f438740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f88381af0b0 con 0x5603988050e0 2024-08-20T01:32:59.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f883f438740 10 client.0 _ll_register_callbacks cb 0x7f8820009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:32:59.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f882ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603987f9150 0x5603987fec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:59.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f882ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603987f9150 0x5603987fec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41302/0 (socket says 172.21.15.22:41302) 2024-08-20T01:32:59.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f882ffff640 1 -- 172.21.15.22:0/1774065898 learned_addr learned my addr 172.21.15.22:0/1774065898 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:32:59.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f883759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603987f8830 0x56039880d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:59.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f883759e640 1 --2- 172.21.15.22:0/1774065898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603988050e0 0x5603987ff1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:59.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f882ffff640 1 -- 172.21.15.22:0/1774065898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603988050e0 msgr2=0x5603987ff1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:59.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f882ffff640 1 --2- 172.21.15.22:0/1774065898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603988050e0 0x5603987ff1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f882ffff640 1 -- 172.21.15.22:0/1774065898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603987f8830 msgr2=0x56039880d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:32:59.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f882ffff640 1 --2- 172.21.15.22:0/1774065898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603987f8830 0x56039880d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f882ffff640 1 -- 172.21.15.22:0/1774065898 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603987f70e0 con 0x5603987f9150 2024-08-20T01:32:59.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f882ffff640 1 --2- 172.21.15.22:0/1774065898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603987f9150 0x5603987fec90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f882000a010 tx=0x7f88200118f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8c273dcc98d561 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:59.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f881e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:32:59.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f881e7fc640 1 -- 172.21.15.22:0/1774065898 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8820011de0 con 0x5603987f9150 2024-08-20T01:32:59.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.435+0000 7f881e7fc640 1 -- 172.21.15.22:0/1774065898 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f882000fab0 con 0x5603987f9150 2024-08-20T01:32:59.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.436+0000 7f883f438740 1 -- 172.21.15.22:0/1774065898 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f883000f4e0 con 0x5603987f9150 2024-08-20T01:32:59.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.436+0000 7f881e7fc640 1 -- 172.21.15.22:0/1774065898 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f882000fcb0 con 0x5603987f9150 2024-08-20T01:32:59.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.436+0000 7f883f438740 10 client.15729 fetch_fsmap learned FSMap version 27 2024-08-20T01:32:59.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.436+0000 7f883f438740 1 -- 172.21.15.22:0/1774065898 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56039887fa80 con 0x5603987f9150 2024-08-20T01:32:59.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.436+0000 7f881e7fc640 1 -- 172.21.15.22:0/1774065898 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f883000f4e0 con 0x5603987f9150 2024-08-20T01:32:59.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.436+0000 7f881e7fc640 1 -- 172.21.15.22:0/1774065898 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f882001a070 con 0x5603987f9150 2024-08-20T01:32:59.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.436+0000 7f883f438740 10 client.15729 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:32:59.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.436+0000 7f883f438740 10 client.15729 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:32:59.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.436+0000 7f883f438740 20 client.15729 populate_metadata read hostname 'smithi022' 2024-08-20T01:32:59.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.436+0000 7f883f438740 1 --2- 172.21.15.22:0/1774065898 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560398815050 0x560398882280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:59.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.436+0000 7f883f438740 4 client.15729 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:32:59.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.436+0000 7f883f438740 1 -- 172.21.15.22:0/1774065898 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56039876d2d0 con 0x560398815050 2024-08-20T01:32:59.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.436+0000 7f883759e640 1 --2- 172.21.15.22:0/1774065898 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560398815050 0x560398882280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:59.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.437+0000 7f881e7fc640 10 client.15729 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:59.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.437+0000 7f883759e640 1 --2- 172.21.15.22:0/1774065898 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560398815050 0x560398882280 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5590352986e4f8dc server_cookie=c126f714c5b6400a in_seq=0 out_seq=0 2024-08-20T01:32:59.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.439+0000 7f881e7fc640 1 -- 172.21.15.22:0/1774065898 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56039876d2d0 con 0x560398815050 2024-08-20T01:32:59.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.439+0000 7f881e7fc640 10 client.15729 handle_command_reply: tid=0 2024-08-20T01:32:59.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.439+0000 7f883f438740 1 client.15729 shutdown 2024-08-20T01:32:59.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.439+0000 7f883f438740 1 -- 172.21.15.22:0/1774065898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603987f9150 msgr2=0x5603987fec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:59.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.439+0000 7f883f438740 1 --2- 172.21.15.22:0/1774065898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603987f9150 0x5603987fec90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f882000a010 tx=0x7f88200118f0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.439+0000 7f883f438740 1 -- 172.21.15.22:0/1774065898 shutdown_connections 2024-08-20T01:32:59.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.439+0000 7f883f438740 1 --2- 172.21.15.22:0/1774065898 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560398815050 0x560398882280 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.440+0000 7f883f438740 1 --2- 172.21.15.22:0/1774065898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603988050e0 0x5603987ff1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.440+0000 7f883f438740 1 --2- 172.21.15.22:0/1774065898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603987f9150 0x5603987fec90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.440+0000 7f883f438740 1 --2- 172.21.15.22:0/1774065898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603987f8830 0x56039880d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.440+0000 7f883f438740 1 -- 172.21.15.22:0/1774065898 >> 172.21.15.22:0/1774065898 conn(0x5603987f6660 msgr2=0x56039880fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:59.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.440+0000 7f881e7fc640 0 client.15729 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:32:59.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.440+0000 7f883f438740 1 -- 172.21.15.22:0/1774065898 shutdown_connections 2024-08-20T01:32:59.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.440+0000 7f883f438740 1 -- 172.21.15.22:0/1774065898 wait complete. 2024-08-20T01:32:59.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.440+0000 7f883f438740 20 client.15729 trim_cache size 0 max 16384 2024-08-20T01:32:59.444 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:32:59.444 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-08-20T01:32:59.444 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-08-20T01:32:59.444 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:32:59.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.440+0000 7f883d03f640 1 -- 172.21.15.22:0/2779909394 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f88240b3bd0 msgr2=0x7f88240b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:59.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.440+0000 7f883d03f640 1 --2- 172.21.15.22:0/2779909394 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f88240b3bd0 0x7f88240b6090 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f88280c6f90 tx=0x7f88280c6e30 comp rx=0 tx=0).stop 2024-08-20T01:32:59.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.440+0000 7f883d03f640 1 -- 172.21.15.22:0/2779909394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8838102af0 msgr2=0x7f88380751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:59.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.440+0000 7f883d03f640 1 --2- 172.21.15.22:0/2779909394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8838102af0 0x7f88380751d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8828005940 tx=0x7f88280040c0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.440+0000 7f883d03f640 1 -- 172.21.15.22:0/2779909394 shutdown_connections 2024-08-20T01:32:59.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.440+0000 7f883d03f640 1 --2- 172.21.15.22:0/2779909394 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f88240b3bd0 0x7f88240b6090 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.440+0000 7f883d03f640 1 --2- 172.21.15.22:0/2779909394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8838108e80 0x7f8838075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.440+0000 7f883d03f640 1 --2- 172.21.15.22:0/2779909394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8838108500 0x7f8838075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.440+0000 7f883d03f640 1 --2- 172.21.15.22:0/2779909394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8838102af0 0x7f88380751d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:59.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.440+0000 7f883d03f640 1 -- 172.21.15.22:0/2779909394 >> 172.21.15.22:0/2779909394 conn(0x7f88380fe540 msgr2=0x7f8838100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:59.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.441+0000 7f883d03f640 1 -- 172.21.15.22:0/2779909394 shutdown_connections 2024-08-20T01:32:59.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:32:59.441+0000 7f883d03f640 1 -- 172.21.15.22:0/2779909394 wait complete. 2024-08-20T01:33:00.021 INFO:tasks.workunit.client.0.smithi022.stdout: 98 1638537 942 1162056 1135 360047 1087 2024-08-20T01:33:00.128 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:33:00.128 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:33:00.501 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:33:01.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.183+0000 7fa7337fe640 1 -- 172.21.15.22:0/1313491788 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c0035f0 con 0x7fa73411bdd0 2024-08-20T01:33:01.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.183+0000 7fa739c6a640 1 -- 172.21.15.22:0/1313491788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa73411bdd0 msgr2=0x7fa73411e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:01.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.183+0000 7fa739c6a640 1 --2- 172.21.15.22:0/1313491788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa73411bdd0 0x7fa73411e1c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009930 tx=0x7fa72c02a480 comp rx=0 tx=0).stop 2024-08-20T01:33:01.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.184+0000 7fa739c6a640 1 -- 172.21.15.22:0/1313491788 shutdown_connections 2024-08-20T01:33:01.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.184+0000 7fa739c6a640 1 --2- 172.21.15.22:0/1313491788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa73411bdd0 0x7fa73411e1c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:01.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.184+0000 7fa739c6a640 1 --2- 172.21.15.22:0/1313491788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa73410a260 0x7fa73410a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:01.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.184+0000 7fa739c6a640 1 --2- 172.21.15.22:0/1313491788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa734109e80 0x7fa734110ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:01.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.184+0000 7fa739c6a640 1 -- 172.21.15.22:0/1313491788 >> 172.21.15.22:0/1313491788 conn(0x7fa73406c830 msgr2=0x7fa73406cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:01.186 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:00 smithi022 ceph-mon[18709]: pgmap v402: 97 pgs: 97 active+clean; 222 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 642 op/s 2024-08-20T01:33:01.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.185+0000 7fa739c6a640 1 -- 172.21.15.22:0/1313491788 shutdown_connections 2024-08-20T01:33:01.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.185+0000 7fa739c6a640 1 -- 172.21.15.22:0/1313491788 wait complete. 2024-08-20T01:33:01.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.186+0000 7fa739c6a640 1 Processor -- start 2024-08-20T01:33:01.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.186+0000 7fa739c6a640 1 -- start start 2024-08-20T01:33:01.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.186+0000 7fa739c6a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa734109e80 0x7fa7341a7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:01.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.186+0000 7fa739c6a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa73410a260 0x7fa7341a7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:01.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.186+0000 7fa739c6a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa73411bdd0 0x7fa7341ad300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:01.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.186+0000 7fa733fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa73410a260 0x7fa7341a7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:01.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.187+0000 7fa739469640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa73411bdd0 0x7fa7341ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:01.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.187+0000 7fa739469640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa73411bdd0 0x7fa7341ad300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:40738/0 (socket says 172.21.15.22:40738) 2024-08-20T01:33:01.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.187+0000 7fa733fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa73410a260 0x7fa7341a7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:57048/0 (socket says 172.21.15.22:57048) 2024-08-20T01:33:01.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.187+0000 7fa739469640 1 -- 172.21.15.22:0/2970040811 learned_addr learned my addr 172.21.15.22:0/2970040811 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:01.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.187+0000 7fa739c6a640 1 -- 172.21.15.22:0/2970040811 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa734121800 con 0x7fa734109e80 2024-08-20T01:33:01.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.187+0000 7fa739c6a640 1 -- 172.21.15.22:0/2970040811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa734121680 con 0x7fa73410a260 2024-08-20T01:33:01.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.187+0000 7fa739c6a640 1 -- 172.21.15.22:0/2970040811 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa734121980 con 0x7fa73411bdd0 2024-08-20T01:33:01.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.187+0000 7fa738c68640 1 --2- 172.21.15.22:0/2970040811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa734109e80 0x7fa7341a7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:01.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.187+0000 7fa739469640 1 -- 172.21.15.22:0/2970040811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa73410a260 msgr2=0x7fa7341a7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:01.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.187+0000 7fa739469640 1 --2- 172.21.15.22:0/2970040811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa73410a260 0x7fa7341a7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:01.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.187+0000 7fa739469640 1 -- 172.21.15.22:0/2970040811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa734109e80 msgr2=0x7fa7341a7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:01.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.187+0000 7fa739469640 1 --2- 172.21.15.22:0/2970040811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa734109e80 0x7fa7341a7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:01.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.187+0000 7fa739469640 1 -- 172.21.15.22:0/2970040811 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7341adad0 con 0x7fa73411bdd0 2024-08-20T01:33:01.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.187+0000 7fa733fff640 1 --2- 172.21.15.22:0/2970040811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa73410a260 0x7fa7341a7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:33:01.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.187+0000 7fa738c68640 1 --2- 172.21.15.22:0/2970040811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa734109e80 0x7fa7341a7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:33:01.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.188+0000 7fa739469640 1 --2- 172.21.15.22:0/2970040811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa73411bdd0 0x7fa7341ad300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa72c02a9f0 tx=0x7fa72c003e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:01.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.188+0000 7fa731ffb640 1 -- 172.21.15.22:0/2970040811 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c041020 con 0x7fa73411bdd0 2024-08-20T01:33:01.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.188+0000 7fa731ffb640 1 -- 172.21.15.22:0/2970040811 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa72c004210 con 0x7fa73411bdd0 2024-08-20T01:33:01.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.188+0000 7fa731ffb640 1 -- 172.21.15.22:0/2970040811 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c031a50 con 0x7fa73411bdd0 2024-08-20T01:33:01.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.188+0000 7fa739c6a640 1 -- 172.21.15.22:0/2970040811 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7341add60 con 0x7fa73411bdd0 2024-08-20T01:33:01.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.189+0000 7fa739c6a640 1 -- 172.21.15.22:0/2970040811 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa73407b0e0 con 0x7fa73411bdd0 2024-08-20T01:33:01.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.190+0000 7fa739c6a640 1 -- 172.21.15.22:0/2970040811 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7341a8b50 con 0x7fa73411bdd0 2024-08-20T01:33:01.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.192+0000 7fa731ffb640 1 -- 172.21.15.22:0/2970040811 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa72c044020 con 0x7fa73411bdd0 2024-08-20T01:33:01.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.193+0000 7fa731ffb640 1 --2- 172.21.15.22:0/2970040811 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa7200b3d40 0x7fa7200b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:01.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.193+0000 7fa731ffb640 1 -- 172.21.15.22:0/2970040811 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fa72c104910 con 0x7fa73411bdd0 2024-08-20T01:33:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.194+0000 7fa738c68640 1 --2- 172.21.15.22:0/2970040811 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa7200b3d40 0x7fa7200b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.194+0000 7fa738c68640 1 --2- 172.21.15.22:0/2970040811 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa7200b3d40 0x7fa7200b6200 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa724005fd0 tx=0x7fa724009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:01.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.199+0000 7fa731ffb640 1 -- 172.21.15.22:0/2970040811 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa72c04b030 con 0x7fa73411bdd0 2024-08-20T01:33:01.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:00 smithi134 ceph-mon[22511]: pgmap v402: 97 pgs: 97 active+clean; 222 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 642 op/s 2024-08-20T01:33:01.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:00 smithi077 ceph-mon[22251]: pgmap v402: 97 pgs: 97 active+clean; 222 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 642 op/s 2024-08-20T01:33:01.519 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:33:01.519 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":27,"btime":"2024-08-20T01:32:18:745083+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:32:17.752132+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24586,24575,24565]},"id":1}]} 2024-08-20T01:33:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.511+0000 7fa739c6a640 1 -- 172.21.15.22:0/2970040811 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa73407b760 con 0x7fa73411bdd0 2024-08-20T01:33:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 27 2024-08-20T01:33:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.513+0000 7fa731ffb640 1 -- 172.21.15.22:0/2970040811 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11909 (secure 0 0 0) 0x7fa72c0cbf20 con 0x7fa73411bdd0 2024-08-20T01:33:01.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.525+0000 7fa739c6a640 1 -- 172.21.15.22:0/2970040811 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa7200b3d40 msgr2=0x7fa7200b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:01.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.525+0000 7fa739c6a640 1 --2- 172.21.15.22:0/2970040811 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa7200b3d40 0x7fa7200b6200 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa724005fd0 tx=0x7fa724009500 comp rx=0 tx=0).stop 2024-08-20T01:33:01.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.525+0000 7fa739c6a640 1 -- 172.21.15.22:0/2970040811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa73411bdd0 msgr2=0x7fa7341ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:01.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.525+0000 7fa739c6a640 1 --2- 172.21.15.22:0/2970040811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa73411bdd0 0x7fa7341ad300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa72c02a9f0 tx=0x7fa72c003e90 comp rx=0 tx=0).stop 2024-08-20T01:33:01.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.526+0000 7fa739c6a640 1 -- 172.21.15.22:0/2970040811 shutdown_connections 2024-08-20T01:33:01.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.526+0000 7fa739c6a640 1 --2- 172.21.15.22:0/2970040811 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa7200b3d40 0x7fa7200b6200 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:01.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.526+0000 7fa739c6a640 1 --2- 172.21.15.22:0/2970040811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa73411bdd0 0x7fa7341ad300 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:01.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.526+0000 7fa739c6a640 1 --2- 172.21.15.22:0/2970040811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa73410a260 0x7fa7341a7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:01.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.526+0000 7fa739c6a640 1 --2- 172.21.15.22:0/2970040811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa734109e80 0x7fa7341a7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:01.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.526+0000 7fa739c6a640 1 -- 172.21.15.22:0/2970040811 >> 172.21.15.22:0/2970040811 conn(0x7fa73406c830 msgr2=0x7fa73410aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:01.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.529+0000 7fa739c6a640 1 -- 172.21.15.22:0/2970040811 shutdown_connections 2024-08-20T01:33:01.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:01.529+0000 7fa739c6a640 1 -- 172.21.15.22:0/2970040811 wait complete. 2024-08-20T01:33:02.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:01 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2970040811' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:33:02.278 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:01 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2970040811' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:33:02.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:01 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2970040811' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:33:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.492+0000 7faa21f23640 1 -- 172.21.15.22:0/510375562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa1c102690 msgr2=0x7faa1c102a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.492+0000 7faa21f23640 1 --2- 172.21.15.22:0/510375562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa1c102690 0x7faa1c102a90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009930 tx=0x7faa0c02a420 comp rx=0 tx=0).stop 2024-08-20T01:33:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.492+0000 7faa21f23640 1 -- 172.21.15.22:0/510375562 shutdown_connections 2024-08-20T01:33:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.492+0000 7faa21f23640 1 --2- 172.21.15.22:0/510375562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa1c1041a0 0x7faa1c10ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.492+0000 7faa21f23640 1 --2- 172.21.15.22:0/510375562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa1c1037e0 0x7faa1c103c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.492+0000 7faa21f23640 1 --2- 172.21.15.22:0/510375562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa1c102690 0x7faa1c102a90 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.492+0000 7faa21f23640 1 -- 172.21.15.22:0/510375562 >> 172.21.15.22:0/510375562 conn(0x7faa1c0fdf70 msgr2=0x7faa1c100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.492+0000 7faa21f23640 1 -- 172.21.15.22:0/510375562 shutdown_connections 2024-08-20T01:33:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.492+0000 7faa21f23640 1 -- 172.21.15.22:0/510375562 wait complete. 2024-08-20T01:33:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.493+0000 7faa21f23640 1 Processor -- start 2024-08-20T01:33:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.493+0000 7faa21f23640 1 -- start start 2024-08-20T01:33:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.493+0000 7faa21f23640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa1c102690 0x7faa1c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.493+0000 7faa21f23640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa1c1037e0 0x7faa1c1990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.493+0000 7faa21f23640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa1c1041a0 0x7faa1c199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.493+0000 7faa21f23640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c10e350 con 0x7faa1c102690 2024-08-20T01:33:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.493+0000 7faa21f23640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c10e1d0 con 0x7faa1c1037e0 2024-08-20T01:33:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.493+0000 7faa21f23640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c10e4d0 con 0x7faa1c1041a0 2024-08-20T01:33:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.493+0000 7faa1b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa1c102690 0x7faa1c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.493+0000 7faa1bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa1c1041a0 0x7faa1c199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.493+0000 7faa1b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa1c102690 0x7faa1c198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40064/0 (socket says 172.21.15.22:40064) 2024-08-20T01:33:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.493+0000 7faa1b7fe640 1 -- 172.21.15.22:0/1404073384 learned_addr learned my addr 172.21.15.22:0/1404073384 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.493+0000 7faa1affd640 1 --2- 172.21.15.22:0/1404073384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa1c1037e0 0x7faa1c1990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.494+0000 7faa1b7fe640 1 -- 172.21.15.22:0/1404073384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa1c1041a0 msgr2=0x7faa1c199cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.494+0000 7faa1b7fe640 1 --2- 172.21.15.22:0/1404073384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa1c1041a0 0x7faa1c199cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.494+0000 7faa1b7fe640 1 -- 172.21.15.22:0/1404073384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa1c1037e0 msgr2=0x7faa1c1990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.494+0000 7faa1b7fe640 1 --2- 172.21.15.22:0/1404073384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa1c1037e0 0x7faa1c1990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.494+0000 7faa1b7fe640 1 -- 172.21.15.22:0/1404073384 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1c19a5b0 con 0x7faa1c102690 2024-08-20T01:33:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.494+0000 7faa1bfff640 1 --2- 172.21.15.22:0/1404073384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa1c1041a0 0x7faa1c199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.494+0000 7faa1b7fe640 1 --2- 172.21.15.22:0/1404073384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa1c102690 0x7faa1c198a70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7faa0c031500 tx=0x7faa0c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.494+0000 7faa18ff9640 1 -- 172.21.15.22:0/1404073384 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c03f070 con 0x7faa1c102690 2024-08-20T01:33:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.494+0000 7faa21f23640 1 -- 172.21.15.22:0/1404073384 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa1c19a840 con 0x7faa1c102690 2024-08-20T01:33:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.494+0000 7faa18ff9640 1 -- 172.21.15.22:0/1404073384 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa0c031c50 con 0x7faa1c102690 2024-08-20T01:33:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.494+0000 7faa18ff9640 1 -- 172.21.15.22:0/1404073384 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c035030 con 0x7faa1c102690 2024-08-20T01:33:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.494+0000 7faa21f23640 1 -- 172.21.15.22:0/1404073384 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa1c1a0f70 con 0x7faa1c102690 2024-08-20T01:33:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.497+0000 7faa18ff9640 1 -- 172.21.15.22:0/1404073384 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7faa0c042070 con 0x7faa1c102690 2024-08-20T01:33:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.497+0000 7faa24def740 1 Processor -- start 2024-08-20T01:33:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.497+0000 7faa24def740 1 -- start start 2024-08-20T01:33:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.497+0000 7faa24def740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc80e8d0 0x55a3cc810cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.497+0000 7faa24def740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc811200 0x55a3cc8135f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.497+0000 7faa24def740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc813c40 0x55a3cc816100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.497+0000 7faa24def740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a3cc781360 con 0x55a3cc811200 2024-08-20T01:33:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.497+0000 7faa24def740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a3cc770860 con 0x55a3cc80e8d0 2024-08-20T01:33:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.497+0000 7faa24def740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a3cc7748a0 con 0x55a3cc813c40 2024-08-20T01:33:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.497+0000 7faa1bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc80e8d0 0x55a3cc810cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.497+0000 7faa1b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc811200 0x55a3cc8135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.497+0000 7faa1affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc813c40 0x55a3cc816100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.497+0000 7faa1bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc80e8d0 0x55a3cc810cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:57080/0 (socket says 172.21.15.22:57080) 2024-08-20T01:33:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.497+0000 7faa1bfff640 1 -- 172.21.15.22:0/469635757 learned_addr learned my addr 172.21.15.22:0/469635757 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.498+0000 7faa1affd640 1 -- 172.21.15.22:0/469635757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc80e8d0 msgr2=0x55a3cc810cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.498+0000 7faa1affd640 1 --2- 172.21.15.22:0/469635757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc80e8d0 0x55a3cc810cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.498+0000 7faa1affd640 1 -- 172.21.15.22:0/469635757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc811200 msgr2=0x55a3cc8135f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.498+0000 7faa1affd640 1 --2- 172.21.15.22:0/469635757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc811200 0x55a3cc8135f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.498+0000 7faa1affd640 1 -- 172.21.15.22:0/469635757 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3cc717e40 con 0x55a3cc813c40 2024-08-20T01:33:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.498+0000 7faa18ff9640 1 --2- 172.21.15.22:0/1404073384 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faa040b3bd0 0x7faa040b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.498+0000 7faa1affd640 1 --2- 172.21.15.22:0/469635757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc813c40 0x55a3cc816100 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faa10009c20 tx=0x7faa10011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cfbf9eaf1ba305f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.498+0000 7faa1bfff640 1 --2- 172.21.15.22:0/1404073384 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faa040b3bd0 0x7faa040b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.498+0000 7faa18ff9640 1 -- 172.21.15.22:0/1404073384 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7faa0c104360 con 0x7faa1c102690 2024-08-20T01:33:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.498+0000 7faa01ffb640 1 -- 172.21.15.22:0/469635757 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1001e070 con 0x55a3cc813c40 2024-08-20T01:33:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.498+0000 7faa01ffb640 1 -- 172.21.15.22:0/469635757 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa10009dd0 con 0x55a3cc813c40 2024-08-20T01:33:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.498+0000 7faa01ffb640 1 -- 172.21.15.22:0/469635757 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10018710 con 0x55a3cc813c40 2024-08-20T01:33:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.499+0000 7faa24def740 1 -- 172.21.15.22:0/469635757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc813c40 msgr2=0x55a3cc816100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.499+0000 7faa1bfff640 1 --2- 172.21.15.22:0/1404073384 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faa040b3bd0 0x7faa040b6090 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faa14009fd0 tx=0x7faa14009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.499+0000 7faa24def740 1 --2- 172.21.15.22:0/469635757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc813c40 0x55a3cc816100 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faa10009c20 tx=0x7faa10011810 comp rx=0 tx=0).stop 2024-08-20T01:33:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.499+0000 7faa24def740 1 -- 172.21.15.22:0/469635757 shutdown_connections 2024-08-20T01:33:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.499+0000 7faa24def740 1 --2- 172.21.15.22:0/469635757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc813c40 0x55a3cc816100 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.499+0000 7faa24def740 1 --2- 172.21.15.22:0/469635757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc811200 0x55a3cc8135f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.499+0000 7faa24def740 1 --2- 172.21.15.22:0/469635757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc80e8d0 0x55a3cc810cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.499+0000 7faa24def740 1 -- 172.21.15.22:0/469635757 >> 172.21.15.22:0/469635757 conn(0x55a3cc809a20 msgr2=0x55a3cc80a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.499+0000 7faa24def740 1 -- 172.21.15.22:0/469635757 shutdown_connections 2024-08-20T01:33:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.499+0000 7faa24def740 1 -- 172.21.15.22:0/469635757 wait complete. 2024-08-20T01:33:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.499+0000 7faa24def740 1 -- start start 2024-08-20T01:33:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa24def740 1 Processor -- start 2024-08-20T01:33:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa24def740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc80e8d0 0x55a3cc8180c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa24def740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc811200 0x55a3cc818760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa24def740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc813c40 0x55a3cc819330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa24def740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a3cc6a9ab0 con 0x55a3cc811200 2024-08-20T01:33:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa24def740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a3cc6f7780 con 0x55a3cc813c40 2024-08-20T01:33:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa24def740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a3cc816c20 con 0x55a3cc80e8d0 2024-08-20T01:33:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa24def740 10 client.0 _ll_register_callbacks cb 0x55a3cc47fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa1affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc811200 0x55a3cc818760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa1bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc813c40 0x55a3cc819330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa1b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc80e8d0 0x55a3cc8180c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa1bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc813c40 0x55a3cc819330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:57094/0 (socket says 172.21.15.22:57094) 2024-08-20T01:33:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa1affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc811200 0x55a3cc818760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40078/0 (socket says 172.21.15.22:40078) 2024-08-20T01:33:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa1b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc80e8d0 0x55a3cc8180c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:40766/0 (socket says 172.21.15.22:40766) 2024-08-20T01:33:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa1bfff640 1 -- 172.21.15.22:0/3611735577 learned_addr learned my addr 172.21.15.22:0/3611735577 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa1bfff640 1 -- 172.21.15.22:0/3611735577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc80e8d0 msgr2=0x55a3cc8180c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa1bfff640 1 --2- 172.21.15.22:0/3611735577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc80e8d0 0x55a3cc8180c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa1bfff640 1 -- 172.21.15.22:0/3611735577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc811200 msgr2=0x55a3cc818760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa1bfff640 1 --2- 172.21.15.22:0/3611735577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc811200 0x55a3cc818760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.500+0000 7faa1bfff640 1 -- 172.21.15.22:0/3611735577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3cc4d3790 con 0x55a3cc813c40 2024-08-20T01:33:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.501+0000 7faa1bfff640 1 --2- 172.21.15.22:0/3611735577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc813c40 0x55a3cc819330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faa14003d60 tx=0x7faa14004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=674b84230073cd51 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.501+0000 7fa9faffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:33:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.501+0000 7fa9faffd640 1 -- 172.21.15.22:0/3611735577 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa14011020 con 0x55a3cc813c40 2024-08-20T01:33:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.501+0000 7fa9faffd640 1 -- 172.21.15.22:0/3611735577 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7faa14017030 con 0x55a3cc813c40 2024-08-20T01:33:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.501+0000 7faa24def740 1 -- 172.21.15.22:0/3611735577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a3cc71fe00 con 0x55a3cc813c40 2024-08-20T01:33:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.501+0000 7fa9faffd640 1 -- 172.21.15.22:0/3611735577 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faa140111c0 con 0x55a3cc813c40 2024-08-20T01:33:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.501+0000 7faa24def740 10 client.25343 fetch_fsmap learned FSMap version 27 2024-08-20T01:33:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.501+0000 7faa24def740 1 -- 172.21.15.22:0/3611735577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a3cc54c620 con 0x55a3cc813c40 2024-08-20T01:33:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.501+0000 7fa9faffd640 1 -- 172.21.15.22:0/3611735577 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a3cc71fe00 con 0x55a3cc813c40 2024-08-20T01:33:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.502+0000 7fa9faffd640 1 -- 172.21.15.22:0/3611735577 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7faa14010730 con 0x55a3cc813c40 2024-08-20T01:33:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.502+0000 7faa24def740 10 client.25343 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:33:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.502+0000 7faa24def740 10 client.25343 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:33:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.502+0000 7faa24def740 20 client.25343 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.502+0000 7faa24def740 1 --2- 172.21.15.22:0/3611735577 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a3cc823b30 0x55a3cc825f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.502+0000 7faa24def740 4 client.25343 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:33:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.502+0000 7faa24def740 1 -- 172.21.15.22:0/3611735577 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3cc7832b0 con 0x55a3cc823b30 2024-08-20T01:33:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.502+0000 7faa1b7fe640 1 --2- 172.21.15.22:0/3611735577 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a3cc823b30 0x55a3cc825f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.502+0000 7faa1b7fe640 1 --2- 172.21.15.22:0/3611735577 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a3cc823b30 0x55a3cc825f70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a32d56fa5e9fc6d5 server_cookie=ed397a737c4a455b in_seq=0 out_seq=0 2024-08-20T01:33:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.502+0000 7fa9faffd640 10 client.25343 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.505+0000 7fa9faffd640 1 -- 172.21.15.22:0/3611735577 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a3cc7832b0 con 0x55a3cc823b30 2024-08-20T01:33:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.505+0000 7fa9faffd640 10 client.25343 handle_command_reply: tid=0 2024-08-20T01:33:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.505+0000 7faa24def740 1 client.25343 shutdown 2024-08-20T01:33:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.505+0000 7faa24def740 1 -- 172.21.15.22:0/3611735577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc813c40 msgr2=0x55a3cc819330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.505+0000 7faa24def740 1 --2- 172.21.15.22:0/3611735577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc813c40 0x55a3cc819330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faa14003d60 tx=0x7faa14004a40 comp rx=0 tx=0).stop 2024-08-20T01:33:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.505+0000 7faa24def740 1 -- 172.21.15.22:0/3611735577 shutdown_connections 2024-08-20T01:33:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.505+0000 7faa24def740 1 --2- 172.21.15.22:0/3611735577 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a3cc823b30 0x55a3cc825f70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.505+0000 7faa24def740 1 --2- 172.21.15.22:0/3611735577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc813c40 0x55a3cc819330 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.505+0000 7fa9faffd640 0 client.25343 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.505+0000 7faa24def740 1 --2- 172.21.15.22:0/3611735577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc811200 0x55a3cc818760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.505+0000 7faa24def740 1 --2- 172.21.15.22:0/3611735577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc80e8d0 0x55a3cc8180c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.505+0000 7faa24def740 1 -- 172.21.15.22:0/3611735577 >> 172.21.15.22:0/3611735577 conn(0x55a3cc809a20 msgr2=0x55a3cc808ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.505+0000 7faa24def740 1 -- 172.21.15.22:0/3611735577 shutdown_connections 2024-08-20T01:33:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.505+0000 7faa24def740 1 -- 172.21.15.22:0/3611735577 wait complete. 2024-08-20T01:33:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.505+0000 7faa24def740 20 client.25343 trim_cache size 0 max 16384 2024-08-20T01:33:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.520+0000 7faa24def740 1 Processor -- start 2024-08-20T01:33:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.520+0000 7faa24def740 1 -- start start 2024-08-20T01:33:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.521+0000 7faa24def740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc80e8d0 0x55a3cc819310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.521+0000 7faa24def740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc811200 0x55a3cc8082c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.521+0000 7faa24def740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc813c40 0x55a3cc808800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.521+0000 7faa24def740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c1ac5f0 con 0x55a3cc811200 2024-08-20T01:33:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.521+0000 7faa24def740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c1a9ec0 con 0x55a3cc813c40 2024-08-20T01:33:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.521+0000 7faa24def740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c1a7d10 con 0x55a3cc80e8d0 2024-08-20T01:33:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.521+0000 7faa1affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc811200 0x55a3cc8082c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.521+0000 7faa1b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc80e8d0 0x55a3cc819310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.521+0000 7faa1affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc811200 0x55a3cc8082c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40084/0 (socket says 172.21.15.22:40084) 2024-08-20T01:33:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.521+0000 7faa1affd640 1 -- 172.21.15.22:0/720387876 learned_addr learned my addr 172.21.15.22:0/720387876 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.521+0000 7faa1bfff640 1 --2- 172.21.15.22:0/720387876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc813c40 0x55a3cc808800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.521+0000 7faa1affd640 1 -- 172.21.15.22:0/720387876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc80e8d0 msgr2=0x55a3cc819310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.521+0000 7faa1affd640 1 --2- 172.21.15.22:0/720387876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc80e8d0 0x55a3cc819310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.521+0000 7faa1affd640 1 -- 172.21.15.22:0/720387876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc813c40 msgr2=0x55a3cc808800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.521+0000 7faa1affd640 1 --2- 172.21.15.22:0/720387876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc813c40 0x55a3cc808800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.521+0000 7faa1affd640 1 -- 172.21.15.22:0/720387876 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3cc809850 con 0x55a3cc811200 2024-08-20T01:33:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.521+0000 7faa1bfff640 1 --2- 172.21.15.22:0/720387876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc813c40 0x55a3cc808800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.521+0000 7faa1affd640 1 --2- 172.21.15.22:0/720387876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc811200 0x55a3cc8082c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7faa10014040 tx=0x7faa10009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c988eab5d1b2182d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.521+0000 7faa017fa640 1 -- 172.21.15.22:0/720387876 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10027020 con 0x55a3cc811200 2024-08-20T01:33:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.522+0000 7faa017fa640 1 -- 172.21.15.22:0/720387876 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa100055b0 con 0x55a3cc811200 2024-08-20T01:33:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.522+0000 7faa017fa640 1 -- 172.21.15.22:0/720387876 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1001e040 con 0x55a3cc811200 2024-08-20T01:33:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.522+0000 7faa24def740 1 -- 172.21.15.22:0/720387876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc811200 msgr2=0x55a3cc8082c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.522+0000 7faa24def740 1 --2- 172.21.15.22:0/720387876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc811200 0x55a3cc8082c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7faa10014040 tx=0x7faa10009f60 comp rx=0 tx=0).stop 2024-08-20T01:33:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.522+0000 7faa24def740 1 -- 172.21.15.22:0/720387876 shutdown_connections 2024-08-20T01:33:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.522+0000 7faa24def740 1 --2- 172.21.15.22:0/720387876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc813c40 0x55a3cc808800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.522+0000 7faa24def740 1 --2- 172.21.15.22:0/720387876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc811200 0x55a3cc8082c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.522+0000 7faa24def740 1 --2- 172.21.15.22:0/720387876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc80e8d0 0x55a3cc819310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.522+0000 7faa24def740 1 -- 172.21.15.22:0/720387876 >> 172.21.15.22:0/720387876 conn(0x55a3cc809a20 msgr2=0x55a3cc8155c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.522+0000 7faa24def740 1 -- 172.21.15.22:0/720387876 shutdown_connections 2024-08-20T01:33:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.522+0000 7faa24def740 1 -- 172.21.15.22:0/720387876 wait complete. 2024-08-20T01:33:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.523+0000 7faa24def740 1 -- start start 2024-08-20T01:33:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.523+0000 7faa24def740 1 Processor -- start 2024-08-20T01:33:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.523+0000 7faa24def740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc80e8d0 0x55a3cc81f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.523+0000 7faa24def740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc811200 0x55a3cc81fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.523+0000 7faa24def740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc813c40 0x55a3cc81e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.523+0000 7faa24def740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c1a8380 con 0x55a3cc80e8d0 2024-08-20T01:33:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.523+0000 7faa24def740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c1a97f0 con 0x55a3cc811200 2024-08-20T01:33:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.523+0000 7faa24def740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c1a8a50 con 0x55a3cc813c40 2024-08-20T01:33:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.523+0000 7faa24def740 10 client.0 _ll_register_callbacks cb 0x7faa14003bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.523+0000 7faa1b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc80e8d0 0x55a3cc81f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.523+0000 7faa1affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc811200 0x55a3cc81fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.523+0000 7faa1affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc811200 0x55a3cc81fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:57112/0 (socket says 172.21.15.22:57112) 2024-08-20T01:33:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.523+0000 7faa1b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc80e8d0 0x55a3cc81f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40096/0 (socket says 172.21.15.22:40096) 2024-08-20T01:33:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.523+0000 7faa1bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc813c40 0x55a3cc81e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.523+0000 7faa1affd640 1 -- 172.21.15.22:0/4044913617 learned_addr learned my addr 172.21.15.22:0/4044913617 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.524+0000 7faa1b7fe640 1 -- 172.21.15.22:0/4044913617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc813c40 msgr2=0x55a3cc81e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.524+0000 7faa1b7fe640 1 --2- 172.21.15.22:0/4044913617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc813c40 0x55a3cc81e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.524+0000 7faa1b7fe640 1 -- 172.21.15.22:0/4044913617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc811200 msgr2=0x55a3cc81fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.524+0000 7faa1b7fe640 1 --2- 172.21.15.22:0/4044913617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc811200 0x55a3cc81fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.524+0000 7faa1b7fe640 1 -- 172.21.15.22:0/4044913617 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3cc81ee70 con 0x55a3cc80e8d0 2024-08-20T01:33:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.524+0000 7faa1affd640 1 --2- 172.21.15.22:0/4044913617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc811200 0x55a3cc81fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.524+0000 7faa1bfff640 1 --2- 172.21.15.22:0/4044913617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc813c40 0x55a3cc81e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.524+0000 7faa1b7fe640 1 --2- 172.21.15.22:0/4044913617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc80e8d0 0x55a3cc81f7e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7faa0c101e70 tx=0x7faa0c101cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4faa068f08bd65d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.524+0000 7fa9faffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:33:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.524+0000 7fa9faffd640 1 -- 172.21.15.22:0/4044913617 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c049040 con 0x55a3cc80e8d0 2024-08-20T01:33:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.524+0000 7fa9faffd640 1 -- 172.21.15.22:0/4044913617 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7faa0c03b460 con 0x55a3cc80e8d0 2024-08-20T01:33:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.524+0000 7faa24def740 1 -- 172.21.15.22:0/4044913617 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa100055b0 con 0x55a3cc80e8d0 2024-08-20T01:33:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.524+0000 7fa9faffd640 1 -- 172.21.15.22:0/4044913617 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faa0c0caa90 con 0x55a3cc80e8d0 2024-08-20T01:33:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.524+0000 7faa24def740 10 client.15750 fetch_fsmap learned FSMap version 27 2024-08-20T01:33:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.524+0000 7faa24def740 1 -- 172.21.15.22:0/4044913617 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a3cc81dd00 con 0x55a3cc80e8d0 2024-08-20T01:33:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.524+0000 7fa9faffd640 1 -- 172.21.15.22:0/4044913617 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa100055b0 con 0x55a3cc80e8d0 2024-08-20T01:33:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.525+0000 7fa9faffd640 1 -- 172.21.15.22:0/4044913617 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7faa0c0d3e90 con 0x55a3cc80e8d0 2024-08-20T01:33:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.525+0000 7faa24def740 10 client.15750 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:33:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.525+0000 7faa24def740 10 client.15750 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:33:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.525+0000 7faa24def740 20 client.15750 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.525+0000 7faa24def740 1 --2- 172.21.15.22:0/4044913617 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a3cc88ef20 0x55a3cc891340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.525+0000 7faa24def740 4 client.15750 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:33:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.525+0000 7faa24def740 1 -- 172.21.15.22:0/4044913617 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a3cc77ed50 con 0x55a3cc88ef20 2024-08-20T01:33:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.525+0000 7faa1affd640 1 --2- 172.21.15.22:0/4044913617 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a3cc88ef20 0x55a3cc891340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.525+0000 7fa9faffd640 10 client.15750 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:02.525+0000 7faa1affd640 1 --2- 172.21.15.22:0/4044913617 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a3cc88ef20 0x55a3cc891340 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f330c810429feb8 server_cookie=d3c0a0eac80a2ea0 in_seq=0 out_seq=0 2024-08-20T01:33:02.621 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:33:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.242+0000 7fa9faffd640 1 -- 172.21.15.22:0/4044913617 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a3cc77ed50 con 0x55a3cc88ef20 2024-08-20T01:33:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.242+0000 7fa9faffd640 10 client.15750 handle_command_reply: tid=0 2024-08-20T01:33:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.242+0000 7faa24def740 1 client.15750 shutdown 2024-08-20T01:33:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.242+0000 7faa24def740 1 -- 172.21.15.22:0/4044913617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc80e8d0 msgr2=0x55a3cc81f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.242+0000 7faa24def740 1 --2- 172.21.15.22:0/4044913617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc80e8d0 0x55a3cc81f7e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7faa0c101e70 tx=0x7faa0c101cf0 comp rx=0 tx=0).stop 2024-08-20T01:33:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.242+0000 7faa24def740 1 -- 172.21.15.22:0/4044913617 shutdown_connections 2024-08-20T01:33:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.242+0000 7faa24def740 1 --2- 172.21.15.22:0/4044913617 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a3cc88ef20 0x55a3cc891340 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.242+0000 7faa24def740 1 --2- 172.21.15.22:0/4044913617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3cc813c40 0x55a3cc81e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.242+0000 7faa24def740 1 --2- 172.21.15.22:0/4044913617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3cc811200 0x55a3cc81fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.242+0000 7faa24def740 1 --2- 172.21.15.22:0/4044913617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3cc80e8d0 0x55a3cc81f7e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.242+0000 7faa24def740 1 -- 172.21.15.22:0/4044913617 >> 172.21.15.22:0/4044913617 conn(0x55a3cc809a20 msgr2=0x55a3cc814020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.242+0000 7fa9faffd640 0 client.15750 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.245+0000 7faa24def740 1 -- 172.21.15.22:0/4044913617 shutdown_connections 2024-08-20T01:33:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.245+0000 7faa24def740 1 -- 172.21.15.22:0/4044913617 wait complete. 2024-08-20T01:33:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.245+0000 7faa24def740 20 client.15750 trim_cache size 0 max 16384 2024-08-20T01:33:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:33:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:33:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:33:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:33:03.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:02 smithi134 ceph-mon[22511]: pgmap v403: 97 pgs: 97 active+clean; 224 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.1 MiB/s wr, 676 op/s 2024-08-20T01:33:03.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.295+0000 7faa21f23640 1 -- 172.21.15.22:0/1404073384 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faa040b3bd0 msgr2=0x7faa040b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:03.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.295+0000 7faa21f23640 1 --2- 172.21.15.22:0/1404073384 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faa040b3bd0 0x7faa040b6090 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faa14009fd0 tx=0x7faa14009500 comp rx=0 tx=0).stop 2024-08-20T01:33:03.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.295+0000 7faa21f23640 1 -- 172.21.15.22:0/1404073384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa1c102690 msgr2=0x7faa1c198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:03.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.295+0000 7faa21f23640 1 --2- 172.21.15.22:0/1404073384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa1c102690 0x7faa1c198a70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7faa0c031500 tx=0x7faa0c003c10 comp rx=0 tx=0).stop 2024-08-20T01:33:03.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.295+0000 7faa21f23640 1 -- 172.21.15.22:0/1404073384 shutdown_connections 2024-08-20T01:33:03.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.295+0000 7faa21f23640 1 --2- 172.21.15.22:0/1404073384 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faa040b3bd0 0x7faa040b6090 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:03.297 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.295+0000 7faa21f23640 1 --2- 172.21.15.22:0/1404073384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa1c1041a0 0x7faa1c199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:03.297 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.295+0000 7faa21f23640 1 --2- 172.21.15.22:0/1404073384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa1c1037e0 0x7faa1c1990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:03.297 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.295+0000 7faa21f23640 1 --2- 172.21.15.22:0/1404073384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa1c102690 0x7faa1c198a70 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:03.297 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.295+0000 7faa21f23640 1 -- 172.21.15.22:0/1404073384 >> 172.21.15.22:0/1404073384 conn(0x7faa1c0fdf70 msgr2=0x7faa1c106b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:03.305 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.305+0000 7faa21f23640 1 -- 172.21.15.22:0/1404073384 shutdown_connections 2024-08-20T01:33:03.306 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:03.305+0000 7faa21f23640 1 -- 172.21.15.22:0/1404073384 wait complete. 2024-08-20T01:33:03.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:02 smithi077 ceph-mon[22251]: pgmap v403: 97 pgs: 97 active+clean; 224 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.1 MiB/s wr, 676 op/s 2024-08-20T01:33:03.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:02 smithi022 ceph-mon[18709]: pgmap v403: 97 pgs: 97 active+clean; 224 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.1 MiB/s wr, 676 op/s 2024-08-20T01:33:04.033 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:33:05.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:04 smithi022 ceph-mon[18709]: pgmap v404: 97 pgs: 97 active+clean; 228 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.2 MiB/s wr, 386 op/s 2024-08-20T01:33:05.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.009+0000 7f380b165640 1 -- 172.21.15.22:0/4105648091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38041039e0 msgr2=0x7f3804103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:05.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.009+0000 7f380b165640 1 --2- 172.21.15.22:0/4105648091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38041039e0 0x7f3804103dc0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009900 tx=0x7f37f402a410 comp rx=0 tx=0).stop 2024-08-20T01:33:05.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.009+0000 7f380b165640 1 -- 172.21.15.22:0/4105648091 shutdown_connections 2024-08-20T01:33:05.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.009+0000 7f380b165640 1 --2- 172.21.15.22:0/4105648091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f380410ce40 0x7f380410f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.009+0000 7f380b165640 1 --2- 172.21.15.22:0/4105648091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3804104300 0x7f380410c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.009+0000 7f380b165640 1 --2- 172.21.15.22:0/4105648091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38041039e0 0x7f3804103dc0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.009+0000 7f380b165640 1 -- 172.21.15.22:0/4105648091 >> 172.21.15.22:0/4105648091 conn(0x7f38040fd440 msgr2=0x7f38040ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:05.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.009+0000 7f380b165640 1 -- 172.21.15.22:0/4105648091 shutdown_connections 2024-08-20T01:33:05.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.009+0000 7f380b165640 1 -- 172.21.15.22:0/4105648091 wait complete. 2024-08-20T01:33:05.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.009+0000 7f380b165640 1 Processor -- start 2024-08-20T01:33:05.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.009+0000 7f380b165640 1 -- start start 2024-08-20T01:33:05.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f380b165640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38041039e0 0x7f3804198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:05.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f380b165640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3804104300 0x7f3804199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:05.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f380b165640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f380410ce40 0x7f380419e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:05.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f380b165640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3804112ab0 con 0x7f3804104300 2024-08-20T01:33:05.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f380b165640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3804112930 con 0x7f38041039e0 2024-08-20T01:33:05.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f380b165640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3804112c30 con 0x7f380410ce40 2024-08-20T01:33:05.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f3803fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3804104300 0x7f3804199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:05.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f3803fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3804104300 0x7f3804199500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40118/0 (socket says 172.21.15.22:40118) 2024-08-20T01:33:05.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f3803fff640 1 -- 172.21.15.22:0/1282169746 learned_addr learned my addr 172.21.15.22:0/1282169746 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:05.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f3808f01640 1 --2- 172.21.15.22:0/1282169746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38041039e0 0x7f3804198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:05.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f3809702640 1 --2- 172.21.15.22:0/1282169746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f380410ce40 0x7f380419e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:05.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f3803fff640 1 -- 172.21.15.22:0/1282169746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f380410ce40 msgr2=0x7f380419e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:05.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f3803fff640 1 --2- 172.21.15.22:0/1282169746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f380410ce40 0x7f380419e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f3803fff640 1 -- 172.21.15.22:0/1282169746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38041039e0 msgr2=0x7f3804198fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f3803fff640 1 --2- 172.21.15.22:0/1282169746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38041039e0 0x7f3804198fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f3803fff640 1 -- 172.21.15.22:0/1282169746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f380419f070 con 0x7f3804104300 2024-08-20T01:33:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f3803fff640 1 --2- 172.21.15.22:0/1282169746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3804104300 0x7f3804199500 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f37f800c970 tx=0x7f37f800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f3801ffb640 1 -- 172.21.15.22:0/1282169746 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f8007bb0 con 0x7f3804104300 2024-08-20T01:33:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f3801ffb640 1 -- 172.21.15.22:0/1282169746 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37f8007d50 con 0x7f3804104300 2024-08-20T01:33:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f380b165640 1 -- 172.21.15.22:0/1282169746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f380419f360 con 0x7f3804104300 2024-08-20T01:33:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.010+0000 7f3801ffb640 1 -- 172.21.15.22:0/1282169746 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f800f7b0 con 0x7f3804104300 2024-08-20T01:33:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.011+0000 7f380b165640 1 -- 172.21.15.22:0/1282169746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38041a5bf0 con 0x7f3804104300 2024-08-20T01:33:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.013+0000 7f3801ffb640 1 -- 172.21.15.22:0/1282169746 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f37f8018480 con 0x7f3804104300 2024-08-20T01:33:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.013+0000 7f380d55e740 1 Processor -- start 2024-08-20T01:33:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.013+0000 7f380d55e740 1 -- start start 2024-08-20T01:33:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.013+0000 7f380d55e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 0x5561ee772c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.013+0000 7f380d55e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee7731a0 0x5561ee783000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:05.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.013+0000 7f380d55e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee783540 0x5561ee785930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:05.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.013+0000 7f380d55e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5561ee6e9930 con 0x5561ee783540 2024-08-20T01:33:05.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.013+0000 7f380d55e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5561ee6d8e30 con 0x5561ee7731a0 2024-08-20T01:33:05.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.013+0000 7f380d55e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5561ee6dce70 con 0x5561ee772880 2024-08-20T01:33:05.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.014+0000 7f3803fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee783540 0x5561ee785930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:05.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.014+0000 7f3803fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee783540 0x5561ee785930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40124/0 (socket says 172.21.15.22:40124) 2024-08-20T01:33:05.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.014+0000 7f3803fff640 1 -- 172.21.15.22:0/2799897485 learned_addr learned my addr 172.21.15.22:0/2799897485 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:05.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.014+0000 7f3808f01640 1 --2- 172.21.15.22:0/2799897485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee7731a0 0x5561ee783000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:05.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.014+0000 7f3809702640 1 --2- 172.21.15.22:0/2799897485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 0x5561ee772c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:05.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.014+0000 7f3801ffb640 1 --2- 172.21.15.22:0/1282169746 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f37ec0b3c50 0x7f37ec0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:05.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.014+0000 7f3808f01640 1 -- 172.21.15.22:0/2799897485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 msgr2=0x5561ee772c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:05.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.014+0000 7f3808f01640 1 --2- 172.21.15.22:0/2799897485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 0x5561ee772c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.014+0000 7f3808f01640 1 -- 172.21.15.22:0/2799897485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee783540 msgr2=0x5561ee785930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:05.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.014+0000 7f3808f01640 1 --2- 172.21.15.22:0/2799897485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee783540 0x5561ee785930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.014+0000 7f3808f01640 1 -- 172.21.15.22:0/2799897485 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561ee438650 con 0x5561ee7731a0 2024-08-20T01:33:05.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.014+0000 7f3809702640 1 --2- 172.21.15.22:0/2799897485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 0x5561ee772c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:33:05.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.014+0000 7f3803fff640 1 --2- 172.21.15.22:0/2799897485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee783540 0x5561ee785930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:05.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.014+0000 7f3809702640 1 --2- 172.21.15.22:0/1282169746 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f37ec0b3c50 0x7f37ec0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:05.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.014+0000 7f3801ffb640 1 -- 172.21.15.22:0/1282169746 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f37f80e3e60 con 0x7f3804104300 2024-08-20T01:33:05.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.014+0000 7f3808f01640 1 --2- 172.21.15.22:0/2799897485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee7731a0 0x5561ee783000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009230 tx=0x7f37f4031de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3a697128d79de7f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:05.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.014+0000 7f37eaffd640 1 -- 172.21.15.22:0/2799897485 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4040070 con 0x5561ee7731a0 2024-08-20T01:33:05.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.014+0000 7f37eaffd640 1 -- 172.21.15.22:0/2799897485 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37f40316a0 con 0x5561ee7731a0 2024-08-20T01:33:05.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.014+0000 7f37eaffd640 1 -- 172.21.15.22:0/2799897485 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4035040 con 0x5561ee7731a0 2024-08-20T01:33:05.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.015+0000 7f380d55e740 1 -- 172.21.15.22:0/2799897485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee7731a0 msgr2=0x5561ee783000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:05.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.015+0000 7f3809702640 1 --2- 172.21.15.22:0/1282169746 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f37ec0b3c50 0x7f37ec0b6110 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f37fc008e00 tx=0x7f37fc004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:05.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.015+0000 7f380d55e740 1 --2- 172.21.15.22:0/2799897485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee7731a0 0x5561ee783000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009230 tx=0x7f37f4031de0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.015+0000 7f380d55e740 1 -- 172.21.15.22:0/2799897485 shutdown_connections 2024-08-20T01:33:05.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.015+0000 7f380d55e740 1 --2- 172.21.15.22:0/2799897485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee783540 0x5561ee785930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.015+0000 7f380d55e740 1 --2- 172.21.15.22:0/2799897485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee7731a0 0x5561ee783000 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.015+0000 7f380d55e740 1 --2- 172.21.15.22:0/2799897485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 0x5561ee772c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.015+0000 7f380d55e740 1 -- 172.21.15.22:0/2799897485 >> 172.21.15.22:0/2799897485 conn(0x5561ee7706b0 msgr2=0x5561ee771850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:05.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.015+0000 7f380d55e740 1 -- 172.21.15.22:0/2799897485 shutdown_connections 2024-08-20T01:33:05.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.015+0000 7f380d55e740 1 -- 172.21.15.22:0/2799897485 wait complete. 2024-08-20T01:33:05.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.016+0000 7f380d55e740 1 -- start start 2024-08-20T01:33:05.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.016+0000 7f380d55e740 1 Processor -- start 2024-08-20T01:33:05.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.016+0000 7f380d55e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 0x5561ee7804d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:05.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.016+0000 7f380d55e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee7731a0 0x5561ee780a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:05.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.016+0000 7f380d55e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee783540 0x5561ee780f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:05.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.016+0000 7f380d55e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5561ee53b700 con 0x5561ee7731a0 2024-08-20T01:33:05.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.016+0000 7f380d55e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5561ee65f810 con 0x5561ee783540 2024-08-20T01:33:05.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.016+0000 7f380d55e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5561ee786190 con 0x5561ee772880 2024-08-20T01:33:05.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.016+0000 7f380d55e740 10 client.0 _ll_register_callbacks cb 0x5561ee6d2700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:05.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.016+0000 7f3803fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee7731a0 0x5561ee780a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:05.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.016+0000 7f3803fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee7731a0 0x5561ee780a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40126/0 (socket says 172.21.15.22:40126) 2024-08-20T01:33:05.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.016+0000 7f3803fff640 1 -- 172.21.15.22:0/4132031457 learned_addr learned my addr 172.21.15.22:0/4132031457 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:05.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.016+0000 7f3809702640 1 --2- 172.21.15.22:0/4132031457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee783540 0x5561ee780f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:05.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.016+0000 7f3808f01640 1 --2- 172.21.15.22:0/4132031457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 0x5561ee7804d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:05.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.017+0000 7f3803fff640 1 -- 172.21.15.22:0/4132031457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 msgr2=0x5561ee7804d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:05.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.017+0000 7f3803fff640 1 --2- 172.21.15.22:0/4132031457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 0x5561ee7804d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.017+0000 7f3803fff640 1 -- 172.21.15.22:0/4132031457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee783540 msgr2=0x5561ee780f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:05.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.017+0000 7f3803fff640 1 --2- 172.21.15.22:0/4132031457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee783540 0x5561ee780f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.017+0000 7f3803fff640 1 -- 172.21.15.22:0/4132031457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561ee78f540 con 0x5561ee7731a0 2024-08-20T01:33:05.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.017+0000 7f3809702640 1 --2- 172.21.15.22:0/4132031457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee783540 0x5561ee780f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:05.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.017+0000 7f3803fff640 1 --2- 172.21.15.22:0/4132031457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee7731a0 0x5561ee780a10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f37f80aab00 tx=0x7f37f80a6d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b76665d269ce45b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:05.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.017+0000 7f37e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:33:05.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.017+0000 7f37e3fff640 1 -- 172.21.15.22:0/4132031457 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f80aa750 con 0x5561ee7731a0 2024-08-20T01:33:05.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.017+0000 7f380d55e740 1 -- 172.21.15.22:0/4132031457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5561ee688150 con 0x5561ee7731a0 2024-08-20T01:33:05.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.017+0000 7f37e3fff640 1 -- 172.21.15.22:0/4132031457 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f37f80b3b90 con 0x5561ee7731a0 2024-08-20T01:33:05.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.017+0000 7f37e3fff640 1 -- 172.21.15.22:0/4132031457 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f37f80aa570 con 0x5561ee7731a0 2024-08-20T01:33:05.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.017+0000 7f380d55e740 10 client.15762 fetch_fsmap learned FSMap version 27 2024-08-20T01:33:05.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.017+0000 7f380d55e740 1 -- 172.21.15.22:0/4132031457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5561ee791fa0 con 0x5561ee7731a0 2024-08-20T01:33:05.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.017+0000 7f37e3fff640 1 -- 172.21.15.22:0/4132031457 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5561ee688150 con 0x5561ee7731a0 2024-08-20T01:33:05.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.018+0000 7f37e3fff640 1 -- 172.21.15.22:0/4132031457 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f37f80e7af0 con 0x5561ee7731a0 2024-08-20T01:33:05.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.018+0000 7f380d55e740 10 client.15762 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:33:05.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.018+0000 7f380d55e740 10 client.15762 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:33:05.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.018+0000 7f380d55e740 20 client.15762 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:05.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.018+0000 7f380d55e740 1 --2- 172.21.15.22:0/4132031457 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5561ee793400 0x5561ee7957f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.018+0000 7f380d55e740 4 client.15762 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:33:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.018+0000 7f380d55e740 1 -- 172.21.15.22:0/4132031457 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561ee6eb880 con 0x5561ee793400 2024-08-20T01:33:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.018+0000 7f3808f01640 1 --2- 172.21.15.22:0/4132031457 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5561ee793400 0x5561ee7957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.018+0000 7f37e3fff640 10 client.15762 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:33:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.018+0000 7f3808f01640 1 --2- 172.21.15.22:0/4132031457 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5561ee793400 0x5561ee7957f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d9d09244b12a1ab server_cookie=7d5392a3fe341834 in_seq=0 out_seq=0 2024-08-20T01:33:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.019+0000 7f37e3fff640 1 -- 172.21.15.22:0/4132031457 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5561ee6eb880 con 0x5561ee793400 2024-08-20T01:33:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.019+0000 7f37e3fff640 10 client.15762 handle_command_reply: tid=0 2024-08-20T01:33:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.019+0000 7f380d55e740 1 client.15762 shutdown 2024-08-20T01:33:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.019+0000 7f380d55e740 1 -- 172.21.15.22:0/4132031457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee7731a0 msgr2=0x5561ee780a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.019+0000 7f380d55e740 1 --2- 172.21.15.22:0/4132031457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee7731a0 0x5561ee780a10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f37f80aab00 tx=0x7f37f80a6d60 comp rx=0 tx=0).stop 2024-08-20T01:33:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.019+0000 7f380d55e740 1 -- 172.21.15.22:0/4132031457 shutdown_connections 2024-08-20T01:33:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.019+0000 7f380d55e740 1 --2- 172.21.15.22:0/4132031457 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5561ee793400 0x5561ee7957f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.019+0000 7f380d55e740 1 --2- 172.21.15.22:0/4132031457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee783540 0x5561ee780f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.019+0000 7f380d55e740 1 --2- 172.21.15.22:0/4132031457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee7731a0 0x5561ee780a10 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.019+0000 7f37e3fff640 0 client.15762 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:33:05.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.019+0000 7f380d55e740 1 --2- 172.21.15.22:0/4132031457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 0x5561ee7804d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.019+0000 7f380d55e740 1 -- 172.21.15.22:0/4132031457 >> 172.21.15.22:0/4132031457 conn(0x5561ee7706b0 msgr2=0x5561ee7761e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:05.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.019+0000 7f380d55e740 1 -- 172.21.15.22:0/4132031457 shutdown_connections 2024-08-20T01:33:05.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.019+0000 7f380d55e740 1 -- 172.21.15.22:0/4132031457 wait complete. 2024-08-20T01:33:05.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.019+0000 7f380d55e740 20 client.15762 trim_cache size 0 max 16384 2024-08-20T01:33:05.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.032+0000 7f380d55e740 1 Processor -- start 2024-08-20T01:33:05.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.032+0000 7f380d55e740 1 -- start start 2024-08-20T01:33:05.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.033+0000 7f380d55e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 0x5561ee77dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.033+0000 7f380d55e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee7731a0 0x5561ee782320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.033+0000 7f380d55e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee783540 0x5561ee79b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.033+0000 7f380d55e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f38041ae8d0 con 0x5561ee783540 2024-08-20T01:33:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.033+0000 7f380d55e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f38041ac1a0 con 0x5561ee7731a0 2024-08-20T01:33:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.033+0000 7f380d55e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f38041a9ff0 con 0x5561ee772880 2024-08-20T01:33:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.033+0000 7f3808f01640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 0x5561ee77dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.033+0000 7f3808f01640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 0x5561ee77dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:40846/0 (socket says 172.21.15.22:40846) 2024-08-20T01:33:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.033+0000 7f3808f01640 1 -- 172.21.15.22:0/733698541 learned_addr learned my addr 172.21.15.22:0/733698541 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.033+0000 7f3803fff640 1 --2- 172.21.15.22:0/733698541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee7731a0 0x5561ee782320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.033+0000 7f3809702640 1 --2- 172.21.15.22:0/733698541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee783540 0x5561ee79b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.033+0000 7f3808f01640 1 -- 172.21.15.22:0/733698541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee7731a0 msgr2=0x5561ee782320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.033+0000 7f3808f01640 1 --2- 172.21.15.22:0/733698541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee7731a0 0x5561ee782320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.033+0000 7f3808f01640 1 -- 172.21.15.22:0/733698541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee783540 msgr2=0x5561ee79b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.033+0000 7f3808f01640 1 --2- 172.21.15.22:0/733698541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee783540 0x5561ee79b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.033+0000 7f3808f01640 1 -- 172.21.15.22:0/733698541 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561ee771110 con 0x5561ee772880 2024-08-20T01:33:05.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.033+0000 7f3808f01640 1 --2- 172.21.15.22:0/733698541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 0x5561ee77dfd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x5561ee776ac0 tx=0x7f37f4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2251bb883e9773d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:05.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.034+0000 7f37ea7fc640 1 -- 172.21.15.22:0/733698541 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4035040 con 0x5561ee772880 2024-08-20T01:33:05.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.034+0000 7f37ea7fc640 1 -- 172.21.15.22:0/733698541 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37f4005020 con 0x5561ee772880 2024-08-20T01:33:05.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.034+0000 7f37ea7fc640 1 -- 172.21.15.22:0/733698541 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4040040 con 0x5561ee772880 2024-08-20T01:33:05.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.034+0000 7f380d55e740 1 -- 172.21.15.22:0/733698541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 msgr2=0x5561ee77dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:05.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.034+0000 7f380d55e740 1 --2- 172.21.15.22:0/733698541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 0x5561ee77dfd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x5561ee776ac0 tx=0x7f37f4009260 comp rx=0 tx=0).stop 2024-08-20T01:33:05.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.034+0000 7f380d55e740 1 -- 172.21.15.22:0/733698541 shutdown_connections 2024-08-20T01:33:05.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.034+0000 7f380d55e740 1 --2- 172.21.15.22:0/733698541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee783540 0x5561ee79b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.034+0000 7f380d55e740 1 --2- 172.21.15.22:0/733698541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee7731a0 0x5561ee782320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.034+0000 7f380d55e740 1 --2- 172.21.15.22:0/733698541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 0x5561ee77dfd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.034+0000 7f380d55e740 1 -- 172.21.15.22:0/733698541 >> 172.21.15.22:0/733698541 conn(0x5561ee7706b0 msgr2=0x5561ee771d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:05.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.034+0000 7f380d55e740 1 -- 172.21.15.22:0/733698541 shutdown_connections 2024-08-20T01:33:05.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.034+0000 7f380d55e740 1 -- 172.21.15.22:0/733698541 wait complete. 2024-08-20T01:33:05.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.035+0000 7f380d55e740 1 -- start start 2024-08-20T01:33:05.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.035+0000 7f380d55e740 1 Processor -- start 2024-08-20T01:33:05.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.035+0000 7f380d55e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 0x5561ee788d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:05.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.035+0000 7f380d55e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee7731a0 0x5561ee789280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:05.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.035+0000 7f380d55e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee783540 0x5561ee7f6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:05.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.035+0000 7f380d55e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f38041aa660 con 0x5561ee783540 2024-08-20T01:33:05.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.035+0000 7f380d55e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f38041abad0 con 0x5561ee7731a0 2024-08-20T01:33:05.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.035+0000 7f380d55e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f38041aad30 con 0x5561ee772880 2024-08-20T01:33:05.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.035+0000 7f380d55e740 10 client.0 _ll_register_callbacks cb 0x7f37f8018d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:05.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.035+0000 7f3803fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee7731a0 0x5561ee789280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:05.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.036+0000 7f3803fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee7731a0 0x5561ee789280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:57156/0 (socket says 172.21.15.22:57156) 2024-08-20T01:33:05.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.036+0000 7f3803fff640 1 -- 172.21.15.22:0/4198588562 learned_addr learned my addr 172.21.15.22:0/4198588562 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:05.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.036+0000 7f3809702640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee783540 0x5561ee7f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:05.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.036+0000 7f3808f01640 1 --2- 172.21.15.22:0/4198588562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 0x5561ee788d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:05.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.036+0000 7f3803fff640 1 -- 172.21.15.22:0/4198588562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 msgr2=0x5561ee788d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:05.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.036+0000 7f3803fff640 1 --2- 172.21.15.22:0/4198588562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 0x5561ee788d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.036+0000 7f3803fff640 1 -- 172.21.15.22:0/4198588562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee783540 msgr2=0x5561ee7f6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:05.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.036+0000 7f3803fff640 1 --2- 172.21.15.22:0/4198588562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee783540 0x5561ee7f6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.036+0000 7f3803fff640 1 -- 172.21.15.22:0/4198588562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561ee7f6750 con 0x5561ee7731a0 2024-08-20T01:33:05.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.036+0000 7f3803fff640 1 --2- 172.21.15.22:0/4198588562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee7731a0 0x5561ee789280 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f37f80aad90 tx=0x7f37f80b3bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1800c859d6c0524a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:05.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.036+0000 7f37e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:33:05.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.036+0000 7f37e3fff640 1 -- 172.21.15.22:0/4198588562 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f80aa750 con 0x5561ee7731a0 2024-08-20T01:33:05.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.036+0000 7f37e3fff640 1 -- 172.21.15.22:0/4198588562 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f37f80aa270 con 0x5561ee7731a0 2024-08-20T01:33:05.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.036+0000 7f380d55e740 1 -- 172.21.15.22:0/4198588562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37f4005020 con 0x5561ee7731a0 2024-08-20T01:33:05.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.036+0000 7f37e3fff640 1 -- 172.21.15.22:0/4198588562 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f37f80aa910 con 0x5561ee7731a0 2024-08-20T01:33:05.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.037+0000 7f380d55e740 10 client.25364 fetch_fsmap learned FSMap version 27 2024-08-20T01:33:05.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.037+0000 7f380d55e740 1 -- 172.21.15.22:0/4198588562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5561ee7fdbf0 con 0x5561ee7731a0 2024-08-20T01:33:05.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.037+0000 7f37e3fff640 1 -- 172.21.15.22:0/4198588562 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37f4005020 con 0x5561ee7731a0 2024-08-20T01:33:05.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.037+0000 7f37e3fff640 1 -- 172.21.15.22:0/4198588562 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f37f80a9ad0 con 0x5561ee7731a0 2024-08-20T01:33:05.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.037+0000 7f380d55e740 10 client.25364 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:33:05.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.037+0000 7f380d55e740 10 client.25364 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:33:05.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.037+0000 7f380d55e740 20 client.25364 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:05.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.037+0000 7f380d55e740 1 --2- 172.21.15.22:0/4198588562 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5561ee7fe370 0x5561ee800790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:05.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.037+0000 7f380d55e740 4 client.25364 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:33:05.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.037+0000 7f380d55e740 1 -- 172.21.15.22:0/4198588562 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5561ee6e7320 con 0x5561ee7fe370 2024-08-20T01:33:05.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.037+0000 7f3808f01640 1 --2- 172.21.15.22:0/4198588562 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5561ee7fe370 0x5561ee800790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:05.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.037+0000 7f37e3fff640 10 client.25364 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:33:05.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.038+0000 7f3808f01640 1 --2- 172.21.15.22:0/4198588562 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5561ee7fe370 0x5561ee800790 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cb8935cf0c35dc1a server_cookie=b0e9119b67646c1b in_seq=0 out_seq=0 2024-08-20T01:33:05.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.038+0000 7f37e3fff640 1 -- 172.21.15.22:0/4198588562 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5561ee6e7320 con 0x5561ee7fe370 2024-08-20T01:33:05.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.038+0000 7f37e3fff640 10 client.25364 handle_command_reply: tid=0 2024-08-20T01:33:05.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.038+0000 7f380d55e740 1 client.25364 shutdown 2024-08-20T01:33:05.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.038+0000 7f380d55e740 1 -- 172.21.15.22:0/4198588562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee7731a0 msgr2=0x5561ee789280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:05.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.038+0000 7f380d55e740 1 --2- 172.21.15.22:0/4198588562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee7731a0 0x5561ee789280 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f37f80aad90 tx=0x7f37f80b3bc0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.038+0000 7f380d55e740 1 -- 172.21.15.22:0/4198588562 shutdown_connections 2024-08-20T01:33:05.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.038+0000 7f380d55e740 1 --2- 172.21.15.22:0/4198588562 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5561ee7fe370 0x5561ee800790 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.038+0000 7f380d55e740 1 --2- 172.21.15.22:0/4198588562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5561ee783540 0x5561ee7f6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.038+0000 7f380d55e740 1 --2- 172.21.15.22:0/4198588562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5561ee7731a0 0x5561ee789280 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.070 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:33:05.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.038+0000 7f37e3fff640 0 client.25364 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:33:05.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.038+0000 7f380d55e740 1 --2- 172.21.15.22:0/4198588562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561ee772880 0x5561ee788d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.038+0000 7f380d55e740 1 -- 172.21.15.22:0/4198588562 >> 172.21.15.22:0/4198588562 conn(0x5561ee7706b0 msgr2=0x5561ee782320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:05.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.038+0000 7f380d55e740 1 -- 172.21.15.22:0/4198588562 shutdown_connections 2024-08-20T01:33:05.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.038+0000 7f380d55e740 1 -- 172.21.15.22:0/4198588562 wait complete. 2024-08-20T01:33:05.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.039+0000 7f380d55e740 20 client.25364 trim_cache size 0 max 16384 2024-08-20T01:33:05.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.039+0000 7f380b165640 1 -- 172.21.15.22:0/1282169746 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f37ec0b3c50 msgr2=0x7f37ec0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:05.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.039+0000 7f380b165640 1 --2- 172.21.15.22:0/1282169746 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f37ec0b3c50 0x7f37ec0b6110 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f37fc008e00 tx=0x7f37fc004a40 comp rx=0 tx=0).stop 2024-08-20T01:33:05.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.039+0000 7f380b165640 1 -- 172.21.15.22:0/1282169746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3804104300 msgr2=0x7f3804199500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:05.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.039+0000 7f380b165640 1 --2- 172.21.15.22:0/1282169746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3804104300 0x7f3804199500 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f37f800c970 tx=0x7f37f800ce30 comp rx=0 tx=0).stop 2024-08-20T01:33:05.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.039+0000 7f380b165640 1 -- 172.21.15.22:0/1282169746 shutdown_connections 2024-08-20T01:33:05.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.039+0000 7f380b165640 1 --2- 172.21.15.22:0/1282169746 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f37ec0b3c50 0x7f37ec0b6110 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.039+0000 7f380b165640 1 --2- 172.21.15.22:0/1282169746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f380410ce40 0x7f380419e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.039+0000 7f380b165640 1 --2- 172.21.15.22:0/1282169746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3804104300 0x7f3804199500 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.039+0000 7f380b165640 1 --2- 172.21.15.22:0/1282169746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38041039e0 0x7f3804198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:05.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.039+0000 7f380b165640 1 -- 172.21.15.22:0/1282169746 >> 172.21.15.22:0/1282169746 conn(0x7f38040fd440 msgr2=0x7f38040fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:05.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.040+0000 7f380b165640 1 -- 172.21.15.22:0/1282169746 shutdown_connections 2024-08-20T01:33:05.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:05.040+0000 7f380b165640 1 -- 172.21.15.22:0/1282169746 wait complete. 2024-08-20T01:33:05.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:04 smithi134 ceph-mon[22511]: pgmap v404: 97 pgs: 97 active+clean; 228 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.2 MiB/s wr, 386 op/s 2024-08-20T01:33:05.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:04 smithi077 ceph-mon[22251]: pgmap v404: 97 pgs: 97 active+clean; 228 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.2 MiB/s wr, 386 op/s 2024-08-20T01:33:05.714 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:33:05.975 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:33:06.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.879+0000 7fc2a205c640 1 -- 172.21.15.22:0/1133679539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c10aa50 msgr2=0x7fc29c10f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:06.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.879+0000 7fc2a205c640 1 --2- 172.21.15.22:0/1133679539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c10aa50 0x7fc29c10f4f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc294009cd0 tx=0x7fc29402a930 comp rx=0 tx=0).stop 2024-08-20T01:33:06.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.879+0000 7fc2a205c640 1 -- 172.21.15.22:0/1133679539 shutdown_connections 2024-08-20T01:33:06.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.879+0000 7fc2a205c640 1 --2- 172.21.15.22:0/1133679539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc29c114090 0x7fc29c116480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.879+0000 7fc2a205c640 1 --2- 172.21.15.22:0/1133679539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c10aa50 0x7fc29c10f4f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.879+0000 7fc2a205c640 1 --2- 172.21.15.22:0/1133679539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc29c06a740 0x7fc29c10efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.879+0000 7fc2a205c640 1 -- 172.21.15.22:0/1133679539 >> 172.21.15.22:0/1133679539 conn(0x7fc29c06dfe0 msgr2=0x7fc29c06e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:06.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.887+0000 7fc2a205c640 1 -- 172.21.15.22:0/1133679539 shutdown_connections 2024-08-20T01:33:06.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.887+0000 7fc2a205c640 1 -- 172.21.15.22:0/1133679539 wait complete. 2024-08-20T01:33:06.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.888+0000 7fc2a205c640 1 Processor -- start 2024-08-20T01:33:06.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.889+0000 7fc2a205c640 1 -- start start 2024-08-20T01:33:06.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.889+0000 7fc2a205c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc29c06a740 0x7fc29c112e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:06.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.889+0000 7fc2a205c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c10aa50 0x7fc29c113340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:06.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.889+0000 7fc2a205c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc29c114090 0x7fc29c1263b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:06.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.889+0000 7fc2a205c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c118a20 con 0x7fc29c06a740 2024-08-20T01:33:06.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.889+0000 7fc2a205c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c1188a0 con 0x7fc29c10aa50 2024-08-20T01:33:06.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.889+0000 7fc2a205c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c118ba0 con 0x7fc29c114090 2024-08-20T01:33:06.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.890+0000 7fc29bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc29c114090 0x7fc29c1263b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:06.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.890+0000 7fc29bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc29c114090 0x7fc29c1263b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:40888/0 (socket says 172.21.15.22:40888) 2024-08-20T01:33:06.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.890+0000 7fc29bfff640 1 -- 172.21.15.22:0/1237823364 learned_addr learned my addr 172.21.15.22:0/1237823364 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:06.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.892+0000 7fc29bfff640 1 -- 172.21.15.22:0/1237823364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c10aa50 msgr2=0x7fc29c113340 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T01:33:06.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.892+0000 7fc29bfff640 1 --2- 172.21.15.22:0/1237823364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c10aa50 0x7fc29c113340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.892+0000 7fc29bfff640 1 -- 172.21.15.22:0/1237823364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc29c06a740 msgr2=0x7fc29c112e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:06.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.892+0000 7fc29bfff640 1 --2- 172.21.15.22:0/1237823364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc29c06a740 0x7fc29c112e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.892+0000 7fc29bfff640 1 -- 172.21.15.22:0/1237823364 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29c126ae0 con 0x7fc29c114090 2024-08-20T01:33:06.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.893+0000 7fc29bfff640 1 --2- 172.21.15.22:0/1237823364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc29c114090 0x7fc29c1263b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc29000dae0 tx=0x7fc29000a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:06.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.893+0000 7fc298ff9640 1 -- 172.21.15.22:0/1237823364 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29000ae30 con 0x7fc29c114090 2024-08-20T01:33:06.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.893+0000 7fc298ff9640 1 -- 172.21.15.22:0/1237823364 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2900054d0 con 0x7fc29c114090 2024-08-20T01:33:06.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.893+0000 7fc298ff9640 1 -- 172.21.15.22:0/1237823364 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29000e6b0 con 0x7fc29c114090 2024-08-20T01:33:06.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.894+0000 7fc2a205c640 1 -- 172.21.15.22:0/1237823364 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc29c126dd0 con 0x7fc29c114090 2024-08-20T01:33:06.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.895+0000 7fc2a205c640 1 -- 172.21.15.22:0/1237823364 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc29c1272c0 con 0x7fc29c114090 2024-08-20T01:33:06.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.907+0000 7fc2a4455740 1 Processor -- start 2024-08-20T01:33:06.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.915+0000 7fc298ff9640 1 -- 172.21.15.22:0/1237823364 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc29001d020 con 0x7fc29c114090 2024-08-20T01:33:06.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.916+0000 7fc298ff9640 1 --2- 172.21.15.22:0/1237823364 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc2840b3c80 0x7fc2840b6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:06.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.916+0000 7fc298ff9640 1 -- 172.21.15.22:0/1237823364 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fc2900e3bf0 con 0x7fc29c114090 2024-08-20T01:33:06.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.917+0000 7fc2a4455740 1 -- start start 2024-08-20T01:33:06.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.917+0000 7fc29affd640 1 --2- 172.21.15.22:0/1237823364 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc2840b3c80 0x7fc2840b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:06.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.917+0000 7fc2a4455740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea232c730 0x556ea232cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:06.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.917+0000 7fc2a4455740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea232d050 0x556ea2338aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:06.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.917+0000 7fc2a4455740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea2338fe0 0x556ea233b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:06.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.917+0000 7fc2a4455740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556ea22a3930 con 0x556ea232c730 2024-08-20T01:33:06.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.917+0000 7fc2a4455740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556ea2292e30 con 0x556ea2338fe0 2024-08-20T01:33:06.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.917+0000 7fc2a4455740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556ea2296e70 con 0x556ea232d050 2024-08-20T01:33:06.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.917+0000 7fc29b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea232c730 0x556ea232cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:06.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.918+0000 7fc29b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea232c730 0x556ea232cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40180/0 (socket says 172.21.15.22:40180) 2024-08-20T01:33:06.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.918+0000 7fc29b7fe640 1 -- 172.21.15.22:0/3671670913 learned_addr learned my addr 172.21.15.22:0/3671670913 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:06.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.918+0000 7fc29affd640 1 --2- 172.21.15.22:0/3671670913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea232d050 0x556ea2338aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:06.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.918+0000 7fc29bfff640 1 --2- 172.21.15.22:0/3671670913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea2338fe0 0x556ea233b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:06.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.919+0000 7fc29affd640 1 --2- 172.21.15.22:0/1237823364 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc2840b3c80 0x7fc2840b6140 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc29402af20 tx=0x7fc294009910 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:06.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.919+0000 7fc29b7fe640 1 -- 172.21.15.22:0/3671670913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea232d050 msgr2=0x556ea2338aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:06.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.920+0000 7fc29b7fe640 1 --2- 172.21.15.22:0/3671670913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea232d050 0x556ea2338aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.920+0000 7fc29b7fe640 1 -- 172.21.15.22:0/3671670913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea2338fe0 msgr2=0x556ea233b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:06.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.920+0000 7fc29b7fe640 1 --2- 172.21.15.22:0/3671670913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea2338fe0 0x556ea233b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.920+0000 7fc29b7fe640 1 -- 172.21.15.22:0/3671670913 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ea1ff2650 con 0x556ea232c730 2024-08-20T01:33:06.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.920+0000 7fc29affd640 1 --2- 172.21.15.22:0/3671670913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea232d050 0x556ea2338aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:06.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.920+0000 7fc29bfff640 1 --2- 172.21.15.22:0/3671670913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea2338fe0 0x556ea233b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:33:06.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.920+0000 7fc29b7fe640 1 --2- 172.21.15.22:0/3671670913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea232c730 0x556ea232cb10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc28c00bb40 tx=0x7fc28c00d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc64a6b8b66c4f09 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:06.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.920+0000 7fc281ffb640 1 -- 172.21.15.22:0/3671670913 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c016070 con 0x556ea232c730 2024-08-20T01:33:06.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.921+0000 7fc281ffb640 1 -- 172.21.15.22:0/3671670913 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc28c0054d0 con 0x556ea232c730 2024-08-20T01:33:06.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.921+0000 7fc281ffb640 1 -- 172.21.15.22:0/3671670913 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c010460 con 0x556ea232c730 2024-08-20T01:33:06.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.922+0000 7fc2a4455740 1 -- 172.21.15.22:0/3671670913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea232c730 msgr2=0x556ea232cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:06.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.922+0000 7fc2a4455740 1 --2- 172.21.15.22:0/3671670913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea232c730 0x556ea232cb10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc28c00bb40 tx=0x7fc28c00d2e0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.925+0000 7fc2a4455740 1 -- 172.21.15.22:0/3671670913 shutdown_connections 2024-08-20T01:33:06.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.926+0000 7fc2a4455740 1 --2- 172.21.15.22:0/3671670913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea2338fe0 0x556ea233b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.926+0000 7fc2a4455740 1 --2- 172.21.15.22:0/3671670913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea232d050 0x556ea2338aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.926+0000 7fc2a4455740 1 --2- 172.21.15.22:0/3671670913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea232c730 0x556ea232cb10 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.926+0000 7fc2a4455740 1 -- 172.21.15.22:0/3671670913 >> 172.21.15.22:0/3671670913 conn(0x556ea232a560 msgr2=0x556ea232b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:06.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.928+0000 7fc2a4455740 1 -- 172.21.15.22:0/3671670913 shutdown_connections 2024-08-20T01:33:06.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.929+0000 7fc2a4455740 1 -- 172.21.15.22:0/3671670913 wait complete. 2024-08-20T01:33:06.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.930+0000 7fc2a4455740 1 -- start start 2024-08-20T01:33:06.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.931+0000 7fc2a4455740 1 Processor -- start 2024-08-20T01:33:06.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.932+0000 7fc2a4455740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea232c730 0x556ea2335ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:06.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.932+0000 7fc2a4455740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea232d050 0x556ea2336530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:06.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.932+0000 7fc2a4455740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea2338fe0 0x556ea2336a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:06.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.932+0000 7fc2a4455740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556ea20f5700 con 0x556ea232c730 2024-08-20T01:33:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.932+0000 7fc2a4455740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556ea2219810 con 0x556ea232d050 2024-08-20T01:33:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.932+0000 7fc2a4455740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556ea233bc90 con 0x556ea2338fe0 2024-08-20T01:33:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.932+0000 7fc2a4455740 10 client.0 _ll_register_callbacks cb 0x556ea228c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.938+0000 7fc29bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea2338fe0 0x556ea2336a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.938+0000 7fc29bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea2338fe0 0x556ea2336a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:40906/0 (socket says 172.21.15.22:40906) 2024-08-20T01:33:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.938+0000 7fc29bfff640 1 -- 172.21.15.22:0/2457221544 learned_addr learned my addr 172.21.15.22:0/2457221544 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.938+0000 7fc29b7fe640 1 --2- 172.21.15.22:0/2457221544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea232c730 0x556ea2335ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.938+0000 7fc29affd640 1 --2- 172.21.15.22:0/2457221544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea232d050 0x556ea2336530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.938+0000 7fc29bfff640 1 -- 172.21.15.22:0/2457221544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea232d050 msgr2=0x556ea2336530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.938+0000 7fc29bfff640 1 --2- 172.21.15.22:0/2457221544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea232d050 0x556ea2336530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.938+0000 7fc29bfff640 1 -- 172.21.15.22:0/2457221544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea232c730 msgr2=0x556ea2335ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.938+0000 7fc29bfff640 1 --2- 172.21.15.22:0/2457221544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea232c730 0x556ea2335ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.938+0000 7fc29bfff640 1 -- 172.21.15.22:0/2457221544 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ea23450c0 con 0x556ea2338fe0 2024-08-20T01:33:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.938+0000 7fc29b7fe640 1 --2- 172.21.15.22:0/2457221544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea232c730 0x556ea2335ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:33:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.939+0000 7fc29bfff640 1 --2- 172.21.15.22:0/2457221544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea2338fe0 0x556ea2336a70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc29000a750 tx=0x7fc2900ab1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61a823d3c4f1420d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.939+0000 7fc27affd640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:33:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.939+0000 7fc27affd640 1 -- 172.21.15.22:0/2457221544 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2900b3b50 con 0x556ea2338fe0 2024-08-20T01:33:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.939+0000 7fc2a4455740 1 -- 172.21.15.22:0/2457221544 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556ea2242150 con 0x556ea2338fe0 2024-08-20T01:33:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.939+0000 7fc27affd640 1 -- 172.21.15.22:0/2457221544 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fc290004910 con 0x556ea2338fe0 2024-08-20T01:33:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.939+0000 7fc27affd640 1 -- 172.21.15.22:0/2457221544 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc2900c52f0 con 0x556ea2338fe0 2024-08-20T01:33:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.939+0000 7fc2a4455740 10 client.25396 fetch_fsmap learned FSMap version 27 2024-08-20T01:33:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.939+0000 7fc2a4455740 1 -- 172.21.15.22:0/2457221544 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556ea2347a30 con 0x556ea2338fe0 2024-08-20T01:33:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.941+0000 7fc27affd640 1 -- 172.21.15.22:0/2457221544 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556ea2242150 con 0x556ea2338fe0 2024-08-20T01:33:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.943+0000 7fc27affd640 1 -- 172.21.15.22:0/2457221544 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc29000b040 con 0x556ea2338fe0 2024-08-20T01:33:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.943+0000 7fc2a4455740 10 client.25396 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:33:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.943+0000 7fc2a4455740 10 client.25396 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:33:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.943+0000 7fc2a4455740 20 client.25396 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.943+0000 7fc2a4455740 1 --2- 172.21.15.22:0/2457221544 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x556ea2349260 0x556ea234b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.943+0000 7fc2a4455740 4 client.25396 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:33:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.943+0000 7fc2a4455740 1 -- 172.21.15.22:0/2457221544 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ea22a5880 con 0x556ea2349260 2024-08-20T01:33:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.943+0000 7fc29b7fe640 1 --2- 172.21.15.22:0/2457221544 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x556ea2349260 0x556ea234b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:06.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.945+0000 7fc27affd640 10 client.25396 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:33:06.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.945+0000 7fc29b7fe640 1 --2- 172.21.15.22:0/2457221544 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x556ea2349260 0x556ea234b670 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c9b2bd9ac4b43d8a server_cookie=8328fb0be251c5e7 in_seq=0 out_seq=0 2024-08-20T01:33:06.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.948+0000 7fc27affd640 1 -- 172.21.15.22:0/2457221544 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ea22a5880 con 0x556ea2349260 2024-08-20T01:33:06.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.948+0000 7fc27affd640 10 client.25396 handle_command_reply: tid=0 2024-08-20T01:33:06.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.948+0000 7fc2a4455740 1 client.25396 shutdown 2024-08-20T01:33:06.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.952+0000 7fc2a4455740 1 -- 172.21.15.22:0/2457221544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea2338fe0 msgr2=0x556ea2336a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:06.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.952+0000 7fc2a4455740 1 --2- 172.21.15.22:0/2457221544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea2338fe0 0x556ea2336a70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc29000a750 tx=0x7fc2900ab1a0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.952+0000 7fc2a4455740 1 -- 172.21.15.22:0/2457221544 shutdown_connections 2024-08-20T01:33:06.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.952+0000 7fc2a4455740 1 --2- 172.21.15.22:0/2457221544 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x556ea2349260 0x556ea234b670 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.952+0000 7fc2a4455740 1 --2- 172.21.15.22:0/2457221544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea2338fe0 0x556ea2336a70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.952+0000 7fc2a4455740 1 --2- 172.21.15.22:0/2457221544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea232d050 0x556ea2336530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.952+0000 7fc2a4455740 1 --2- 172.21.15.22:0/2457221544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea232c730 0x556ea2335ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.952+0000 7fc27affd640 0 client.25396 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:33:06.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.952+0000 7fc2a4455740 1 -- 172.21.15.22:0/2457221544 >> 172.21.15.22:0/2457221544 conn(0x556ea232a560 msgr2=0x556ea2330100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:06.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.952+0000 7fc2a4455740 1 -- 172.21.15.22:0/2457221544 shutdown_connections 2024-08-20T01:33:06.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.952+0000 7fc2a4455740 1 -- 172.21.15.22:0/2457221544 wait complete. 2024-08-20T01:33:06.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.952+0000 7fc2a4455740 20 client.25396 trim_cache size 0 max 16384 2024-08-20T01:33:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.984+0000 7fc2a4455740 1 Processor -- start 2024-08-20T01:33:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.984+0000 7fc2a4455740 1 -- start start 2024-08-20T01:33:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.984+0000 7fc2a4455740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea232c730 0x556ea23308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.984+0000 7fc2a4455740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea232d050 0x556ea2350f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.985+0000 7fc2a4455740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea2338fe0 0x556ea23514c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.985+0000 7fc2a4455740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c132240 con 0x556ea232d050 2024-08-20T01:33:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.985+0000 7fc2a4455740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c12fb50 con 0x556ea232c730 2024-08-20T01:33:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.985+0000 7fc2a4455740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c10efb0 con 0x556ea2338fe0 2024-08-20T01:33:06.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.985+0000 7fc29b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea232c730 0x556ea23308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:06.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.985+0000 7fc29bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea2338fe0 0x556ea23514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:06.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.985+0000 7fc29affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea232d050 0x556ea2350f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:06.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.985+0000 7fc29affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea232d050 0x556ea2350f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40192/0 (socket says 172.21.15.22:40192) 2024-08-20T01:33:06.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.985+0000 7fc29affd640 1 -- 172.21.15.22:0/4182195139 learned_addr learned my addr 172.21.15.22:0/4182195139 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:06.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.986+0000 7fc29bfff640 1 -- 172.21.15.22:0/4182195139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea232c730 msgr2=0x556ea23308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:06.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.986+0000 7fc29bfff640 1 --2- 172.21.15.22:0/4182195139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea232c730 0x556ea23308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.986+0000 7fc29bfff640 1 -- 172.21.15.22:0/4182195139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea232d050 msgr2=0x556ea2350f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:06.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.986+0000 7fc29bfff640 1 --2- 172.21.15.22:0/4182195139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea232d050 0x556ea2350f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.986+0000 7fc29bfff640 1 -- 172.21.15.22:0/4182195139 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ea232afe0 con 0x556ea2338fe0 2024-08-20T01:33:06.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.986+0000 7fc29bfff640 1 --2- 172.21.15.22:0/4182195139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea2338fe0 0x556ea23514c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc2900aaa30 tx=0x7fc290005cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce463dcd11f12855 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:06.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.990+0000 7fc2817fa640 1 -- 172.21.15.22:0/4182195139 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2900a6230 con 0x556ea2338fe0 2024-08-20T01:33:06.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.990+0000 7fc2817fa640 1 -- 172.21.15.22:0/4182195139 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2900b3b50 con 0x556ea2338fe0 2024-08-20T01:33:06.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.990+0000 7fc2817fa640 1 -- 172.21.15.22:0/4182195139 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2900aa3f0 con 0x556ea2338fe0 2024-08-20T01:33:06.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.991+0000 7fc2a4455740 1 -- 172.21.15.22:0/4182195139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea2338fe0 msgr2=0x556ea23514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:06.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.991+0000 7fc2a4455740 1 --2- 172.21.15.22:0/4182195139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea2338fe0 0x556ea23514c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc2900aaa30 tx=0x7fc290005cc0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.991+0000 7fc2a4455740 1 -- 172.21.15.22:0/4182195139 shutdown_connections 2024-08-20T01:33:06.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.992+0000 7fc2a4455740 1 --2- 172.21.15.22:0/4182195139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea2338fe0 0x556ea23514c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.992+0000 7fc2a4455740 1 --2- 172.21.15.22:0/4182195139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea232d050 0x556ea2350f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.992+0000 7fc2a4455740 1 --2- 172.21.15.22:0/4182195139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea232c730 0x556ea23308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:06.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.992+0000 7fc2a4455740 1 -- 172.21.15.22:0/4182195139 >> 172.21.15.22:0/4182195139 conn(0x556ea232a560 msgr2=0x556ea23312c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:06.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.992+0000 7fc2a4455740 1 -- 172.21.15.22:0/4182195139 shutdown_connections 2024-08-20T01:33:06.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.992+0000 7fc2a4455740 1 -- 172.21.15.22:0/4182195139 wait complete. 2024-08-20T01:33:06.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.993+0000 7fc2a4455740 1 -- start start 2024-08-20T01:33:06.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.994+0000 7fc2a4455740 1 Processor -- start 2024-08-20T01:33:06.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.994+0000 7fc2a4455740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea232c730 0x556ea2341100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:06.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.995+0000 7fc2a4455740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea232d050 0x556ea2341640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:06.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.995+0000 7fc2a4455740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea2338fe0 0x556ea2332980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:06.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.995+0000 7fc2a4455740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c12e010 con 0x556ea2338fe0 2024-08-20T01:33:06.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.995+0000 7fc2a4455740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c12f480 con 0x556ea232c730 2024-08-20T01:33:06.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.995+0000 7fc2a4455740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c12e6e0 con 0x556ea232d050 2024-08-20T01:33:06.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.995+0000 7fc2a4455740 10 client.0 _ll_register_callbacks cb 0x7fc2900aa210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:07.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.998+0000 7fc29bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea2338fe0 0x556ea2332980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:07.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.998+0000 7fc29bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea2338fe0 0x556ea2332980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40194/0 (socket says 172.21.15.22:40194) 2024-08-20T01:33:07.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.998+0000 7fc29bfff640 1 -- 172.21.15.22:0/996809266 learned_addr learned my addr 172.21.15.22:0/996809266 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:07.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.999+0000 7fc29bfff640 1 -- 172.21.15.22:0/996809266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea232d050 msgr2=0x556ea2341640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:33:07.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.999+0000 7fc29bfff640 1 --2- 172.21.15.22:0/996809266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea232d050 0x556ea2341640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:07.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.999+0000 7fc29bfff640 1 -- 172.21.15.22:0/996809266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea232c730 msgr2=0x556ea2341100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:07.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.999+0000 7fc29bfff640 1 --2- 172.21.15.22:0/996809266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea232c730 0x556ea2341100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:07.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.999+0000 7fc29bfff640 1 -- 172.21.15.22:0/996809266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ea23331b0 con 0x556ea2338fe0 2024-08-20T01:33:07.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:06.999+0000 7fc29bfff640 1 --2- 172.21.15.22:0/996809266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea2338fe0 0x556ea2332980 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc2900a7d10 tx=0x7fc2900a6960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b89729a4ba442 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:07.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.000+0000 7fc27affd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:33:07.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.000+0000 7fc27affd640 1 -- 172.21.15.22:0/996809266 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2900aa3f0 con 0x556ea2338fe0 2024-08-20T01:33:07.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.000+0000 7fc27affd640 1 -- 172.21.15.22:0/996809266 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fc290014340 con 0x556ea2338fe0 2024-08-20T01:33:07.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.000+0000 7fc2a4455740 1 -- 172.21.15.22:0/996809266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2900b3b50 con 0x556ea2338fe0 2024-08-20T01:33:07.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.001+0000 7fc27affd640 1 -- 172.21.15.22:0/996809266 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc290089050 con 0x556ea2338fe0 2024-08-20T01:33:07.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.003+0000 7fc2a4455740 10 client.15783 fetch_fsmap learned FSMap version 27 2024-08-20T01:33:07.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.003+0000 7fc2a4455740 1 -- 172.21.15.22:0/996809266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556ea23331b0 con 0x556ea2338fe0 2024-08-20T01:33:07.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.006+0000 7fc27affd640 1 -- 172.21.15.22:0/996809266 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc290014540 con 0x556ea2338fe0 2024-08-20T01:33:07.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.006+0000 7fc27affd640 1 -- 172.21.15.22:0/996809266 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc290004fb0 con 0x556ea2338fe0 2024-08-20T01:33:07.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.006+0000 7fc2a4455740 10 client.15783 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:33:07.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.006+0000 7fc2a4455740 10 client.15783 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:33:07.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.006+0000 7fc2a4455740 20 client.15783 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:07.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.006+0000 7fc2a4455740 1 --2- 172.21.15.22:0/996809266 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x556ea23b3d30 0x556ea23b6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:07.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.007+0000 7fc2a4455740 4 client.15783 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:33:07.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.007+0000 7fc2a4455740 1 -- 172.21.15.22:0/996809266 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fc2900b3b50 con 0x556ea23b3d30 2024-08-20T01:33:07.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.013+0000 7fc29b7fe640 1 --2- 172.21.15.22:0/996809266 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x556ea23b3d30 0x556ea23b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:07.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.018+0000 7fc29b7fe640 1 --2- 172.21.15.22:0/996809266 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x556ea23b3d30 0x556ea23b6150 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=74e1bd314d14d23 server_cookie=b13ed5b1e3869e74 in_seq=0 out_seq=0 2024-08-20T01:33:07.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.018+0000 7fc27affd640 10 client.15783 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:33:07.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.022+0000 7fc27affd640 1 -- 172.21.15.22:0/996809266 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fc2900b3b50 con 0x556ea23b3d30 2024-08-20T01:33:07.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.022+0000 7fc27affd640 10 client.15783 handle_command_reply: tid=0 2024-08-20T01:33:07.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.022+0000 7fc2a4455740 1 client.15783 shutdown 2024-08-20T01:33:07.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.025+0000 7fc2a4455740 1 -- 172.21.15.22:0/996809266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea2338fe0 msgr2=0x556ea2332980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:07.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.025+0000 7fc2a4455740 1 --2- 172.21.15.22:0/996809266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea2338fe0 0x556ea2332980 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc2900a7d10 tx=0x7fc2900a6960 comp rx=0 tx=0).stop 2024-08-20T01:33:07.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.028+0000 7fc2a4455740 1 -- 172.21.15.22:0/996809266 shutdown_connections 2024-08-20T01:33:07.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.028+0000 7fc2a4455740 1 --2- 172.21.15.22:0/996809266 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x556ea23b3d30 0x556ea23b6150 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:07.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.028+0000 7fc2a4455740 1 --2- 172.21.15.22:0/996809266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ea2338fe0 0x556ea2332980 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:07.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.028+0000 7fc27affd640 0 client.15783 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:33:07.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.029+0000 7fc2a4455740 1 --2- 172.21.15.22:0/996809266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ea232d050 0x556ea2341640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:07.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.029+0000 7fc2a4455740 1 --2- 172.21.15.22:0/996809266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ea232c730 0x556ea2341100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:07.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.029+0000 7fc2a4455740 1 -- 172.21.15.22:0/996809266 >> 172.21.15.22:0/996809266 conn(0x556ea232a560 msgr2=0x556ea2337620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:07.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.030+0000 7fc2a4455740 1 -- 172.21.15.22:0/996809266 shutdown_connections 2024-08-20T01:33:07.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.030+0000 7fc2a4455740 1 -- 172.21.15.22:0/996809266 wait complete. 2024-08-20T01:33:07.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.030+0000 7fc2a4455740 20 client.15783 trim_cache size 0 max 16384 2024-08-20T01:33:07.035 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:33:07.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.037+0000 7fc2a205c640 1 -- 172.21.15.22:0/1237823364 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc2840b3c80 msgr2=0x7fc2840b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:07.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.037+0000 7fc2a205c640 1 --2- 172.21.15.22:0/1237823364 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc2840b3c80 0x7fc2840b6140 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc29402af20 tx=0x7fc294009910 comp rx=0 tx=0).stop 2024-08-20T01:33:07.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.037+0000 7fc2a205c640 1 -- 172.21.15.22:0/1237823364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc29c114090 msgr2=0x7fc29c1263b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:07.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.037+0000 7fc2a205c640 1 --2- 172.21.15.22:0/1237823364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc29c114090 0x7fc29c1263b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc29000dae0 tx=0x7fc29000a250 comp rx=0 tx=0).stop 2024-08-20T01:33:07.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.037+0000 7fc2a205c640 1 -- 172.21.15.22:0/1237823364 shutdown_connections 2024-08-20T01:33:07.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.037+0000 7fc2a205c640 1 --2- 172.21.15.22:0/1237823364 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc2840b3c80 0x7fc2840b6140 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:07.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.037+0000 7fc2a205c640 1 --2- 172.21.15.22:0/1237823364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc29c114090 0x7fc29c1263b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:07.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.037+0000 7fc2a205c640 1 --2- 172.21.15.22:0/1237823364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c10aa50 0x7fc29c113340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:07.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.037+0000 7fc2a205c640 1 --2- 172.21.15.22:0/1237823364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc29c06a740 0x7fc29c112e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:07.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.038+0000 7fc2a205c640 1 -- 172.21.15.22:0/1237823364 >> 172.21.15.22:0/1237823364 conn(0x7fc29c06dfe0 msgr2=0x7fc29c115560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:07.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.038+0000 7fc2a205c640 1 -- 172.21.15.22:0/1237823364 shutdown_connections 2024-08-20T01:33:07.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:07.038+0000 7fc2a205c640 1 -- 172.21.15.22:0/1237823364 wait complete. 2024-08-20T01:33:07.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:06 smithi134 ceph-mon[22511]: pgmap v405: 97 pgs: 97 active+clean; 230 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 1.9 MiB/s wr, 515 op/s 2024-08-20T01:33:07.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:06 smithi077 ceph-mon[22251]: pgmap v405: 97 pgs: 97 active+clean; 230 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 1.9 MiB/s wr, 515 op/s 2024-08-20T01:33:07.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:06 smithi022 ceph-mon[18709]: pgmap v405: 97 pgs: 97 active+clean; 230 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 1.9 MiB/s wr, 515 op/s 2024-08-20T01:33:09.275 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:08 smithi134 ceph-mon[22511]: pgmap v406: 97 pgs: 97 active+clean; 218 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 2.4 MiB/s wr, 771 op/s 2024-08-20T01:33:09.318 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:08 smithi077 ceph-mon[22251]: pgmap v406: 97 pgs: 97 active+clean; 218 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 2.4 MiB/s wr, 771 op/s 2024-08-20T01:33:09.396 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:08 smithi022 ceph-mon[18709]: pgmap v406: 97 pgs: 97 active+clean; 218 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 2.4 MiB/s wr, 771 op/s 2024-08-20T01:33:09.636 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:33:09.924 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:33:10.022 INFO:tasks.workunit.client.0.smithi022.stdout: 107 1128668 612 818237 672 298932 642 2024-08-20T01:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.536+0000 7f1cf612f640 1 -- 172.21.15.22:0/1811030408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf011bdd0 msgr2=0x7f1cf011e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.536+0000 7f1cf612f640 1 --2- 172.21.15.22:0/1811030408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf011bdd0 0x7f1cf011e1c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8009be0 tx=0x7f1ce802a790 comp rx=0 tx=0).stop 2024-08-20T01:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.539+0000 7f1cf612f640 1 -- 172.21.15.22:0/1811030408 shutdown_connections 2024-08-20T01:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.539+0000 7f1cf612f640 1 --2- 172.21.15.22:0/1811030408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf011bdd0 0x7f1cf011e1c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.539+0000 7f1cf612f640 1 --2- 172.21.15.22:0/1811030408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cf010a260 0x7f1cf010a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.539+0000 7f1cf612f640 1 --2- 172.21.15.22:0/1811030408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cf0109e80 0x7f1cf0110ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.539+0000 7f1cf612f640 1 -- 172.21.15.22:0/1811030408 >> 172.21.15.22:0/1811030408 conn(0x7f1cf006dcc0 msgr2=0x7f1cf006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:10.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.540+0000 7f1cf612f640 1 -- 172.21.15.22:0/1811030408 shutdown_connections 2024-08-20T01:33:10.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.540+0000 7f1cf612f640 1 -- 172.21.15.22:0/1811030408 wait complete. 2024-08-20T01:33:10.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.541+0000 7f1cf612f640 1 Processor -- start 2024-08-20T01:33:10.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.541+0000 7f1cf612f640 1 -- start start 2024-08-20T01:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.541+0000 7f1cf612f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cf0109e80 0x7f1cf0115220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.545+0000 7f1cf612f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf010a260 0x7f1cf0115760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.545+0000 7f1cf612f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cf011bdd0 0x7f1cf011aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.545+0000 7f1cf612f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf0111a80 con 0x7f1cf011bdd0 2024-08-20T01:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.545+0000 7f1cf612f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf0111900 con 0x7f1cf010a260 2024-08-20T01:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.545+0000 7f1cf612f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf0111c00 con 0x7f1cf0109e80 2024-08-20T01:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.545+0000 7f1cef7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cf0109e80 0x7f1cf0115220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.545+0000 7f1ceeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf010a260 0x7f1cf0115760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.545+0000 7f1ceeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf010a260 0x7f1cf0115760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:33368/0 (socket says 172.21.15.22:33368) 2024-08-20T01:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.545+0000 7f1ceeffd640 1 -- 172.21.15.22:0/399941267 learned_addr learned my addr 172.21.15.22:0/399941267 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.545+0000 7f1ceffff640 1 --2- 172.21.15.22:0/399941267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cf011bdd0 0x7f1cf011aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.546+0000 7f1cef7fe640 1 -- 172.21.15.22:0/399941267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf010a260 msgr2=0x7f1cf0115760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.546+0000 7f1cef7fe640 1 --2- 172.21.15.22:0/399941267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf010a260 0x7f1cf0115760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.546+0000 7f1cef7fe640 1 -- 172.21.15.22:0/399941267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cf011bdd0 msgr2=0x7f1cf011aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:10.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.546+0000 7f1cef7fe640 1 --2- 172.21.15.22:0/399941267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cf011bdd0 0x7f1cf011aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.546+0000 7f1cef7fe640 1 -- 172.21.15.22:0/399941267 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf011b1c0 con 0x7f1cf0109e80 2024-08-20T01:33:10.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.546+0000 7f1ceffff640 1 --2- 172.21.15.22:0/399941267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cf011bdd0 0x7f1cf011aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:10.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.547+0000 7f1cef7fe640 1 --2- 172.21.15.22:0/399941267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cf0109e80 0x7f1cf0115220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000e790 tx=0x7f1ce000ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:10.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.547+0000 7f1cecff9640 1 -- 172.21.15.22:0/399941267 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce000eea0 con 0x7f1cf0109e80 2024-08-20T01:33:10.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.547+0000 7f1cf612f640 1 -- 172.21.15.22:0/399941267 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf011b450 con 0x7f1cf0109e80 2024-08-20T01:33:10.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.547+0000 7f1cf612f640 1 -- 172.21.15.22:0/399941267 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf0121440 con 0x7f1cf0109e80 2024-08-20T01:33:10.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.548+0000 7f1cecff9640 1 -- 172.21.15.22:0/399941267 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ce000ccc0 con 0x7f1cf0109e80 2024-08-20T01:33:10.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.548+0000 7f1cecff9640 1 -- 172.21.15.22:0/399941267 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0018680 con 0x7f1cf0109e80 2024-08-20T01:33:10.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.553+0000 7f1cf8528740 1 Processor -- start 2024-08-20T01:33:10.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.564+0000 7f1cecff9640 1 -- 172.21.15.22:0/399941267 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1ce0018820 con 0x7f1cf0109e80 2024-08-20T01:33:10.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.566+0000 7f1cecff9640 1 --2- 172.21.15.22:0/399941267 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f1cd80b3c80 0x7f1cd80b6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:10.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.572+0000 7f1ceffff640 1 --2- 172.21.15.22:0/399941267 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f1cd80b3c80 0x7f1cd80b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:10.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.573+0000 7f1cf8528740 1 -- start start 2024-08-20T01:33:10.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.573+0000 7f1cf8528740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558549098880 0x558549098c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:10.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.573+0000 7f1cf8528740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585490991a0 0x5585490a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:10.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.573+0000 7f1cf8528740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 0x5585490a7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:10.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.573+0000 7f1cf8528740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55854900f930 con 0x5585490a5130 2024-08-20T01:33:10.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.573+0000 7f1cf8528740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558548ffee30 con 0x558549098880 2024-08-20T01:33:10.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.573+0000 7f1cf8528740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558549002e70 con 0x5585490991a0 2024-08-20T01:33:10.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.575+0000 7f1ceffff640 1 --2- 172.21.15.22:0/399941267 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f1cd80b3c80 0x7f1cd80b6140 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80099a0 tx=0x7f1ce8005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:10.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.575+0000 7f1ceffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 0x5585490a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:10.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.576+0000 7f1ceffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 0x5585490a7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34444/0 (socket says 172.21.15.22:34444) 2024-08-20T01:33:10.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.576+0000 7f1ceffff640 1 -- 172.21.15.22:0/3906520907 learned_addr learned my addr 172.21.15.22:0/3906520907 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:10.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.576+0000 7f1ceffff640 1 -- 172.21.15.22:0/3906520907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585490991a0 msgr2=0x5585490a4bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:33:10.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.576+0000 7f1ceffff640 1 --2- 172.21.15.22:0/3906520907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585490991a0 0x5585490a4bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.576+0000 7f1ceffff640 1 -- 172.21.15.22:0/3906520907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558549098880 msgr2=0x558549098c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:33:10.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.576+0000 7f1ceffff640 1 --2- 172.21.15.22:0/3906520907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558549098880 0x558549098c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.576+0000 7f1ceffff640 1 -- 172.21.15.22:0/3906520907 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558548d5e650 con 0x5585490a5130 2024-08-20T01:33:10.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.576+0000 7f1ceffff640 1 --2- 172.21.15.22:0/3906520907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 0x5585490a7520 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8030ac0 tx=0x7f1ce805e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc7b026d6dd907b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:10.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.578+0000 7f1cd5ffb640 1 -- 172.21.15.22:0/3906520907 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce806f070 con 0x5585490a5130 2024-08-20T01:33:10.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.578+0000 7f1cd5ffb640 1 -- 172.21.15.22:0/3906520907 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ce8065070 con 0x5585490a5130 2024-08-20T01:33:10.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.578+0000 7f1cecff9640 1 -- 172.21.15.22:0/399941267 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f1ce0010490 con 0x7f1cf0109e80 2024-08-20T01:33:10.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.579+0000 7f1cf8528740 1 -- 172.21.15.22:0/3906520907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 msgr2=0x5585490a7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:10.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.579+0000 7f1cf8528740 1 --2- 172.21.15.22:0/3906520907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 0x5585490a7520 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8030ac0 tx=0x7f1ce805e000 comp rx=0 tx=0).stop 2024-08-20T01:33:10.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.580+0000 7f1cf8528740 1 -- 172.21.15.22:0/3906520907 shutdown_connections 2024-08-20T01:33:10.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.580+0000 7f1cf8528740 1 --2- 172.21.15.22:0/3906520907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 0x5585490a7520 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.580+0000 7f1cf8528740 1 --2- 172.21.15.22:0/3906520907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585490991a0 0x5585490a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.580+0000 7f1cf8528740 1 --2- 172.21.15.22:0/3906520907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558549098880 0x558549098c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.580+0000 7f1cf8528740 1 -- 172.21.15.22:0/3906520907 >> 172.21.15.22:0/3906520907 conn(0x5585490966b0 msgr2=0x558549097850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:10.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.580+0000 7f1cf8528740 1 -- 172.21.15.22:0/3906520907 shutdown_connections 2024-08-20T01:33:10.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.580+0000 7f1cf8528740 1 -- 172.21.15.22:0/3906520907 wait complete. 2024-08-20T01:33:10.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.581+0000 7f1cf8528740 1 -- start start 2024-08-20T01:33:10.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.581+0000 7f1cf8528740 1 Processor -- start 2024-08-20T01:33:10.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.582+0000 7f1cf8528740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558549098880 0x5585490a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:10.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.582+0000 7f1cf8528740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585490991a0 0x5585490a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:10.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.582+0000 7f1cf8528740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 0x5585490a2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:10.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.582+0000 7f1ceeffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585490991a0 0x5585490a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:10.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.582+0000 7f1ceffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 0x5585490a2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:10.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.582+0000 7f1ceffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 0x5585490a2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34450/0 (socket says 172.21.15.22:34450) 2024-08-20T01:33:10.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.582+0000 7f1ceeffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585490991a0 0x5585490a1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:45668/0 (socket says 172.21.15.22:45668) 2024-08-20T01:33:10.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.582+0000 7f1cef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558549098880 0x5585490a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:10.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.583+0000 7f1ceffff640 1 -- 172.21.15.22:0/609262357 learned_addr learned my addr 172.21.15.22:0/609262357 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:10.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.583+0000 7f1cf8528740 1 -- 172.21.15.22:0/609262357 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558548e61700 con 0x5585490a5130 2024-08-20T01:33:10.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.583+0000 7f1cf8528740 1 -- 172.21.15.22:0/609262357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558548f85810 con 0x558549098880 2024-08-20T01:33:10.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.583+0000 7f1cf8528740 1 -- 172.21.15.22:0/609262357 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5585490a7dd0 con 0x5585490991a0 2024-08-20T01:33:10.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.583+0000 7f1cf8528740 10 client.0 _ll_register_callbacks cb 0x558548ff8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:10.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.584+0000 7f1ceffff640 1 -- 172.21.15.22:0/609262357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585490991a0 msgr2=0x5585490a1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:10.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.584+0000 7f1ceffff640 1 --2- 172.21.15.22:0/609262357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585490991a0 0x5585490a1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.584+0000 7f1ceffff640 1 -- 172.21.15.22:0/609262357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558549098880 msgr2=0x5585490a4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:10.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.584+0000 7f1ceffff640 1 --2- 172.21.15.22:0/609262357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558549098880 0x5585490a4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.584+0000 7f1ceffff640 1 -- 172.21.15.22:0/609262357 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585490b1220 con 0x5585490a5130 2024-08-20T01:33:10.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.585+0000 7f1ceffff640 1 --2- 172.21.15.22:0/609262357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 0x5585490a2700 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8030a90 tx=0x7f1ce8031bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45c5b1ac5539af1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:10.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.585+0000 7f1cceffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:33:10.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.585+0000 7f1cceffd640 1 -- 172.21.15.22:0/609262357 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce806f040 con 0x5585490a5130 2024-08-20T01:33:10.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.586+0000 7f1cceffd640 1 -- 172.21.15.22:0/609262357 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f1ce807d670 con 0x5585490a5130 2024-08-20T01:33:10.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.586+0000 7f1cf8528740 1 -- 172.21.15.22:0/609262357 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558548fae150 con 0x5585490a5130 2024-08-20T01:33:10.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.587+0000 7f1cceffd640 1 -- 172.21.15.22:0/609262357 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1ce8030c70 con 0x5585490a5130 2024-08-20T01:33:10.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.587+0000 7f1cf8528740 10 client.15795 fetch_fsmap learned FSMap version 27 2024-08-20T01:33:10.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.587+0000 7f1cf8528740 1 -- 172.21.15.22:0/609262357 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5585490b3af0 con 0x5585490a5130 2024-08-20T01:33:10.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.588+0000 7f1cceffd640 1 -- 172.21.15.22:0/609262357 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ce8083030 con 0x5585490a5130 2024-08-20T01:33:10.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.588+0000 7f1cceffd640 1 -- 172.21.15.22:0/609262357 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1ce806a070 con 0x5585490a5130 2024-08-20T01:33:10.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.589+0000 7f1cf8528740 10 client.15795 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:33:10.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.589+0000 7f1cf8528740 10 client.15795 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:33:10.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.589+0000 7f1cf8528740 20 client.15795 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:10.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.589+0000 7f1cf8528740 1 --2- 172.21.15.22:0/609262357 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5585490b4e40 0x5585490b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:10.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.589+0000 7f1cf8528740 4 client.15795 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:33:10.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.589+0000 7f1cf8528740 1 -- 172.21.15.22:0/609262357 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558548fae150 con 0x5585490b4e40 2024-08-20T01:33:10.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.589+0000 7f1cef7fe640 1 --2- 172.21.15.22:0/609262357 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5585490b4e40 0x5585490b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:10.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.591+0000 7f1cef7fe640 1 --2- 172.21.15.22:0/609262357 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5585490b4e40 0x5585490b7230 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef6b516c9fb3d695 server_cookie=95f9ff784800e7b7 in_seq=0 out_seq=0 2024-08-20T01:33:10.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.591+0000 7f1cceffd640 10 client.15795 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:10.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.594+0000 7f1cceffd640 1 -- 172.21.15.22:0/609262357 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558548fae150 con 0x5585490b4e40 2024-08-20T01:33:10.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.594+0000 7f1cceffd640 10 client.15795 handle_command_reply: tid=0 2024-08-20T01:33:10.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.594+0000 7f1cf8528740 1 client.15795 shutdown 2024-08-20T01:33:10.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.602+0000 7f1cf8528740 1 -- 172.21.15.22:0/609262357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 msgr2=0x5585490a2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:10.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.602+0000 7f1cf8528740 1 --2- 172.21.15.22:0/609262357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 0x5585490a2700 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8030a90 tx=0x7f1ce8031bf0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.602+0000 7f1cf8528740 1 -- 172.21.15.22:0/609262357 shutdown_connections 2024-08-20T01:33:10.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.602+0000 7f1cf8528740 1 --2- 172.21.15.22:0/609262357 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5585490b4e40 0x5585490b7230 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.602+0000 7f1cf8528740 1 --2- 172.21.15.22:0/609262357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 0x5585490a2700 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.602+0000 7f1cf8528740 1 --2- 172.21.15.22:0/609262357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585490991a0 0x5585490a1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.602+0000 7f1cf8528740 1 --2- 172.21.15.22:0/609262357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558549098880 0x5585490a4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.602+0000 7f1cf8528740 1 -- 172.21.15.22:0/609262357 >> 172.21.15.22:0/609262357 conn(0x5585490966b0 msgr2=0x55854909c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:10.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.603+0000 7f1cceffd640 0 client.15795 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:10.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.603+0000 7f1cf8528740 1 -- 172.21.15.22:0/609262357 shutdown_connections 2024-08-20T01:33:10.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.603+0000 7f1cf8528740 1 -- 172.21.15.22:0/609262357 wait complete. 2024-08-20T01:33:10.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.603+0000 7f1cf8528740 20 client.15795 trim_cache size 0 max 16384 2024-08-20T01:33:10.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.647+0000 7f1cf8528740 1 Processor -- start 2024-08-20T01:33:10.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.651+0000 7f1cf8528740 1 -- start start 2024-08-20T01:33:10.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.651+0000 7f1cf8528740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558549098880 0x558549097ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:10.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.651+0000 7f1cf8528740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585490991a0 0x55854909f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:10.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.651+0000 7f1cf8528740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585490a5130 0x55854909f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:10.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.651+0000 7f1cf8528740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc010fb0 con 0x558549098880 2024-08-20T01:33:10.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.651+0000 7f1cf8528740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc00e880 con 0x5585490a5130 2024-08-20T01:33:10.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.651+0000 7f1cf8528740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc00c6d0 con 0x5585490991a0 2024-08-20T01:33:10.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.652+0000 7f1cef7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558549098880 0x558549097ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:10.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.652+0000 7f1cef7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558549098880 0x558549097ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34462/0 (socket says 172.21.15.22:34462) 2024-08-20T01:33:10.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.652+0000 7f1cef7fe640 1 -- 172.21.15.22:0/1636044223 learned_addr learned my addr 172.21.15.22:0/1636044223 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:10.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.652+0000 7f1cef7fe640 1 -- 172.21.15.22:0/1636044223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585490991a0 msgr2=0x55854909f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:10.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.652+0000 7f1cef7fe640 1 --2- 172.21.15.22:0/1636044223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585490991a0 0x55854909f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.653+0000 7f1ceffff640 1 --2- 172.21.15.22:0/1636044223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585490a5130 0x55854909f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:10.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.653+0000 7f1cef7fe640 1 -- 172.21.15.22:0/1636044223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585490a5130 msgr2=0x55854909f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:10.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.653+0000 7f1cef7fe640 1 --2- 172.21.15.22:0/1636044223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585490a5130 0x55854909f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.653+0000 7f1cef7fe640 1 -- 172.21.15.22:0/1636044223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558549098fd0 con 0x558549098880 2024-08-20T01:33:10.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.653+0000 7f1ceffff640 1 --2- 172.21.15.22:0/1636044223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585490a5130 0x55854909f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:33:10.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.653+0000 7f1cef7fe640 1 --2- 172.21.15.22:0/1636044223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558549098880 0x558549097ed0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00aaee0 tx=0x7f1ce0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44b011b9f42be49 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:10.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.654+0000 7f1cd57fa640 1 -- 172.21.15.22:0/1636044223 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce00b3f50 con 0x558549098880 2024-08-20T01:33:10.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.654+0000 7f1cd57fa640 1 -- 172.21.15.22:0/1636044223 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ce00a7540 con 0x558549098880 2024-08-20T01:33:10.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.654+0000 7f1cd57fa640 1 -- 172.21.15.22:0/1636044223 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0018b10 con 0x558549098880 2024-08-20T01:33:10.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.658+0000 7f1cf8528740 1 -- 172.21.15.22:0/1636044223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558549098880 msgr2=0x558549097ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:10.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.658+0000 7f1cf8528740 1 --2- 172.21.15.22:0/1636044223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558549098880 0x558549097ed0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00aaee0 tx=0x7f1ce0014000 comp rx=0 tx=0).stop 2024-08-20T01:33:10.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.665+0000 7f1cf8528740 1 -- 172.21.15.22:0/1636044223 shutdown_connections 2024-08-20T01:33:10.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.665+0000 7f1cf8528740 1 --2- 172.21.15.22:0/1636044223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585490a5130 0x55854909f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.665+0000 7f1cf8528740 1 --2- 172.21.15.22:0/1636044223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585490991a0 0x55854909f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.665+0000 7f1cf8528740 1 --2- 172.21.15.22:0/1636044223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558549098880 0x558549097ed0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.665+0000 7f1cf8528740 1 -- 172.21.15.22:0/1636044223 >> 172.21.15.22:0/1636044223 conn(0x5585490966b0 msgr2=0x5585490977c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:10.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.673+0000 7f1cf8528740 1 -- 172.21.15.22:0/1636044223 shutdown_connections 2024-08-20T01:33:10.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.673+0000 7f1cf8528740 1 -- 172.21.15.22:0/1636044223 wait complete. 2024-08-20T01:33:10.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.673+0000 7f1cf8528740 1 -- start start 2024-08-20T01:33:10.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.674+0000 7f1cf8528740 1 Processor -- start 2024-08-20T01:33:10.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.674+0000 7f1cf8528740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558549098880 0x5585490b7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:10.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.674+0000 7f1cf8528740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585490991a0 0x5585490b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:10.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.674+0000 7f1cf8528740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 0x55854911d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:10.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.674+0000 7f1cf8528740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc00cd40 con 0x5585490a5130 2024-08-20T01:33:10.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.674+0000 7f1cf8528740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc00e1b0 con 0x558549098880 2024-08-20T01:33:10.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.674+0000 7f1cf8528740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc00d410 con 0x5585490991a0 2024-08-20T01:33:10.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.674+0000 7f1cf8528740 10 client.0 _ll_register_callbacks cb 0x7f1ce8009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:10.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.674+0000 7f1ceffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 0x55854911d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:10.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.674+0000 7f1ceeffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585490991a0 0x5585490b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:10.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.674+0000 7f1ceffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 0x55854911d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34470/0 (socket says 172.21.15.22:34470) 2024-08-20T01:33:10.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.674+0000 7f1ceffff640 1 -- 172.21.15.22:0/4248628522 learned_addr learned my addr 172.21.15.22:0/4248628522 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:10.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.675+0000 7f1cef7fe640 1 --2- 172.21.15.22:0/4248628522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558549098880 0x5585490b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:10.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.675+0000 7f1cef7fe640 1 -- 172.21.15.22:0/4248628522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585490991a0 msgr2=0x5585490b7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:10.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.675+0000 7f1cef7fe640 1 --2- 172.21.15.22:0/4248628522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585490991a0 0x5585490b7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.675+0000 7f1cef7fe640 1 -- 172.21.15.22:0/4248628522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 msgr2=0x55854911d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:10.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.675+0000 7f1cef7fe640 1 --2- 172.21.15.22:0/4248628522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 0x55854911d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.675+0000 7f1cef7fe640 1 -- 172.21.15.22:0/4248628522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55854911de10 con 0x558549098880 2024-08-20T01:33:10.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.677+0000 7f1cef7fe640 1 --2- 172.21.15.22:0/4248628522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558549098880 0x5585490b7520 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x558548fae150 tx=0x7f1ce00af530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=794c79a6325d224c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:10.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.677+0000 7f1cceffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:33:10.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.678+0000 7f1cceffd640 1 -- 172.21.15.22:0/4248628522 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce00c9070 con 0x558549098880 2024-08-20T01:33:10.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.678+0000 7f1cf8528740 1 -- 172.21.15.22:0/4248628522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ce00a7540 con 0x558549098880 2024-08-20T01:33:10.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.678+0000 7f1cceffd640 1 -- 172.21.15.22:0/4248628522 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f1ce00b3c30 con 0x558549098880 2024-08-20T01:33:10.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.679+0000 7f1cceffd640 1 -- 172.21.15.22:0/4248628522 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1ce00a71e0 con 0x558549098880 2024-08-20T01:33:10.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.682+0000 7f1cf8528740 10 client.25385 fetch_fsmap learned FSMap version 27 2024-08-20T01:33:10.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.682+0000 7f1cf8528740 1 -- 172.21.15.22:0/4248628522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55854911f060 con 0x558549098880 2024-08-20T01:33:10.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.683+0000 7f1cceffd640 1 -- 172.21.15.22:0/4248628522 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ce00a7540 con 0x558549098880 2024-08-20T01:33:10.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.683+0000 7f1cceffd640 1 -- 172.21.15.22:0/4248628522 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1ce00b8020 con 0x558549098880 2024-08-20T01:33:10.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.686+0000 7f1cf8528740 10 client.25385 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:33:10.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.686+0000 7f1cf8528740 10 client.25385 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:33:10.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.686+0000 7f1cf8528740 20 client.25385 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:10.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.686+0000 7f1cf8528740 1 --2- 172.21.15.22:0/4248628522 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55854911f710 0x558549121b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:10.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.686+0000 7f1cf8528740 4 client.25385 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:33:10.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.686+0000 7f1cf8528740 1 -- 172.21.15.22:0/4248628522 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558549011880 con 0x55854911f710 2024-08-20T01:33:10.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.689+0000 7f1ceeffd640 1 --2- 172.21.15.22:0/4248628522 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55854911f710 0x558549121b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:10.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.698+0000 7f1ceeffd640 1 --2- 172.21.15.22:0/4248628522 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55854911f710 0x558549121b30 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37a99f2ee37dccfb server_cookie=45387167e45a0c04 in_seq=0 out_seq=0 2024-08-20T01:33:10.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.699+0000 7f1cceffd640 10 client.25385 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:10.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.700+0000 7f1cceffd640 1 -- 172.21.15.22:0/4248628522 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558549011880 con 0x55854911f710 2024-08-20T01:33:10.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.700+0000 7f1cceffd640 10 client.25385 handle_command_reply: tid=0 2024-08-20T01:33:10.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.703+0000 7f1cf8528740 1 client.25385 shutdown 2024-08-20T01:33:10.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.710+0000 7f1cf8528740 1 -- 172.21.15.22:0/4248628522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558549098880 msgr2=0x5585490b7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:10.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.710+0000 7f1cf8528740 1 --2- 172.21.15.22:0/4248628522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558549098880 0x5585490b7520 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x558548fae150 tx=0x7f1ce00af530 comp rx=0 tx=0).stop 2024-08-20T01:33:10.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.715+0000 7f1cf8528740 1 -- 172.21.15.22:0/4248628522 shutdown_connections 2024-08-20T01:33:10.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.715+0000 7f1cf8528740 1 --2- 172.21.15.22:0/4248628522 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55854911f710 0x558549121b30 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.715+0000 7f1cf8528740 1 --2- 172.21.15.22:0/4248628522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585490a5130 0x55854911d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.715+0000 7f1cf8528740 1 --2- 172.21.15.22:0/4248628522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585490991a0 0x5585490b7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.715+0000 7f1cf8528740 1 --2- 172.21.15.22:0/4248628522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558549098880 0x5585490b7520 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.715+0000 7f1cf8528740 1 -- 172.21.15.22:0/4248628522 >> 172.21.15.22:0/4248628522 conn(0x5585490966b0 msgr2=0x5585490a35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:10.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.715+0000 7f1cceffd640 0 client.25385 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:10.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.718+0000 7f1cf8528740 1 -- 172.21.15.22:0/4248628522 shutdown_connections 2024-08-20T01:33:10.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.719+0000 7f1cf8528740 1 -- 172.21.15.22:0/4248628522 wait complete. 2024-08-20T01:33:10.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.719+0000 7f1cf8528740 20 client.25385 trim_cache size 0 max 16384 2024-08-20T01:33:10.724 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:33:10.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.726+0000 7f1cf612f640 1 -- 172.21.15.22:0/399941267 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f1cd80b3c80 msgr2=0x7f1cd80b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:10.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.726+0000 7f1cf612f640 1 --2- 172.21.15.22:0/399941267 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f1cd80b3c80 0x7f1cd80b6140 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80099a0 tx=0x7f1ce8005fd0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.726+0000 7f1cf612f640 1 -- 172.21.15.22:0/399941267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cf0109e80 msgr2=0x7f1cf0115220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:10.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.726+0000 7f1cf612f640 1 --2- 172.21.15.22:0/399941267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cf0109e80 0x7f1cf0115220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000e790 tx=0x7f1ce000ec50 comp rx=0 tx=0).stop 2024-08-20T01:33:10.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.726+0000 7f1cf612f640 1 -- 172.21.15.22:0/399941267 shutdown_connections 2024-08-20T01:33:10.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.726+0000 7f1cf612f640 1 --2- 172.21.15.22:0/399941267 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f1cd80b3c80 0x7f1cd80b6140 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.726+0000 7f1cf612f640 1 --2- 172.21.15.22:0/399941267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cf011bdd0 0x7f1cf011aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.726+0000 7f1cf612f640 1 --2- 172.21.15.22:0/399941267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf010a260 0x7f1cf0115760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:10.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.726+0000 7f1cf612f640 1 --2- 172.21.15.22:0/399941267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cf0109e80 0x7f1cf0115220 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000e790 tx=0x7f1ce000ec50 comp rx=0 tx=0).stop 2024-08-20T01:33:10.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.726+0000 7f1cf612f640 1 -- 172.21.15.22:0/399941267 >> 172.21.15.22:0/399941267 conn(0x7f1cf006dcc0 msgr2=0x7f1cf0072900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:10.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.727+0000 7f1cf612f640 1 -- 172.21.15.22:0/399941267 shutdown_connections 2024-08-20T01:33:10.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:10.727+0000 7f1cf612f640 1 -- 172.21.15.22:0/399941267 wait complete. 2024-08-20T01:33:11.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:10 smithi134 ceph-mon[22511]: pgmap v407: 97 pgs: 97 active+clean; 260 MiB data, 836 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.4 MiB/s wr, 914 op/s 2024-08-20T01:33:11.266 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:10 smithi022 ceph-mon[18709]: pgmap v407: 97 pgs: 97 active+clean; 260 MiB data, 836 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.4 MiB/s wr, 914 op/s 2024-08-20T01:33:11.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:10 smithi077 ceph-mon[22251]: pgmap v407: 97 pgs: 97 active+clean; 260 MiB data, 836 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.4 MiB/s wr, 914 op/s 2024-08-20T01:33:13.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:12 smithi134 ceph-mon[22511]: pgmap v408: 97 pgs: 97 active+clean; 345 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 13 MiB/s wr, 1.26k op/s 2024-08-20T01:33:13.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:12 smithi077 ceph-mon[22251]: pgmap v408: 97 pgs: 97 active+clean; 345 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 13 MiB/s wr, 1.26k op/s 2024-08-20T01:33:13.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:12 smithi022 ceph-mon[18709]: pgmap v408: 97 pgs: 97 active+clean; 345 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 13 MiB/s wr, 1.26k op/s 2024-08-20T01:33:13.437 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:33:13.438 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:33:14.995 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:33:15.250 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:14 smithi022 ceph-mon[18709]: pgmap v409: 97 pgs: 97 active+clean; 355 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 13 MiB/s wr, 1.22k op/s 2024-08-20T01:33:15.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:14 smithi134 ceph-mon[22511]: pgmap v409: 97 pgs: 97 active+clean; 355 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 13 MiB/s wr, 1.22k op/s 2024-08-20T01:33:15.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:14 smithi077 ceph-mon[22251]: pgmap v409: 97 pgs: 97 active+clean; 355 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 13 MiB/s wr, 1.22k op/s 2024-08-20T01:33:15.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.522+0000 7fc04ebad640 1 -- 172.21.15.22:0/3328101303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc04810f160 msgr2=0x7fc048111550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:15.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.522+0000 7fc04ebad640 1 --2- 172.21.15.22:0/3328101303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc04810f160 0x7fc048111550 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc030009900 tx=0x7fc03002a480 comp rx=0 tx=0).stop 2024-08-20T01:33:15.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.523+0000 7fc04ebad640 1 -- 172.21.15.22:0/3328101303 shutdown_connections 2024-08-20T01:33:15.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.523+0000 7fc04ebad640 1 --2- 172.21.15.22:0/3328101303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc04810f160 0x7fc048111550 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.523+0000 7fc04ebad640 1 --2- 172.21.15.22:0/3328101303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc048101ed0 0x7fc04810ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.523+0000 7fc04ebad640 1 --2- 172.21.15.22:0/3328101303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0481015b0 0x7fc048101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.523+0000 7fc04ebad640 1 -- 172.21.15.22:0/3328101303 >> 172.21.15.22:0/3328101303 conn(0x7fc0480fd400 msgr2=0x7fc0480ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:15.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.523+0000 7fc04ebad640 1 -- 172.21.15.22:0/3328101303 shutdown_connections 2024-08-20T01:33:15.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.523+0000 7fc04ebad640 1 -- 172.21.15.22:0/3328101303 wait complete. 2024-08-20T01:33:15.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.523+0000 7fc04ebad640 1 Processor -- start 2024-08-20T01:33:15.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.523+0000 7fc04ebad640 1 -- start start 2024-08-20T01:33:15.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.524+0000 7fc04ebad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0481015b0 0x7fc04819b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:15.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.524+0000 7fc04ebad640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc048101ed0 0x7fc04819b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:15.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.524+0000 7fc04ebad640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc04810f160 0x7fc0481a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:15.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.524+0000 7fc04ebad640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc048114c70 con 0x7fc048101ed0 2024-08-20T01:33:15.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.524+0000 7fc04ebad640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc048114af0 con 0x7fc0481015b0 2024-08-20T01:33:15.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.524+0000 7fc04ebad640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc048114df0 con 0x7fc04810f160 2024-08-20T01:33:15.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.524+0000 7fc047fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc048101ed0 0x7fc04819b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:15.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.524+0000 7fc047fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc048101ed0 0x7fc04819b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34488/0 (socket says 172.21.15.22:34488) 2024-08-20T01:33:15.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.524+0000 7fc047fff640 1 -- 172.21.15.22:0/657521547 learned_addr learned my addr 172.21.15.22:0/657521547 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:15.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.524+0000 7fc04c949640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0481015b0 0x7fc04819b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:15.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.524+0000 7fc04d14a640 1 --2- 172.21.15.22:0/657521547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc04810f160 0x7fc0481a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:15.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.524+0000 7fc047fff640 1 -- 172.21.15.22:0/657521547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc04810f160 msgr2=0x7fc0481a09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:15.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.524+0000 7fc047fff640 1 --2- 172.21.15.22:0/657521547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc04810f160 0x7fc0481a09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.524+0000 7fc047fff640 1 -- 172.21.15.22:0/657521547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0481015b0 msgr2=0x7fc04819b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:15.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.524+0000 7fc047fff640 1 --2- 172.21.15.22:0/657521547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0481015b0 0x7fc04819b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.524+0000 7fc047fff640 1 -- 172.21.15.22:0/657521547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0481a1190 con 0x7fc048101ed0 2024-08-20T01:33:15.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.524+0000 7fc04c949640 1 --2- 172.21.15.22:0/657521547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0481015b0 0x7fc04819b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:15.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.525+0000 7fc047fff640 1 --2- 172.21.15.22:0/657521547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc048101ed0 0x7fc04819b620 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc03800eab0 tx=0x7fc03800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:15.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.525+0000 7fc045ffb640 1 -- 172.21.15.22:0/657521547 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03800ce40 con 0x7fc048101ed0 2024-08-20T01:33:15.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.525+0000 7fc045ffb640 1 -- 172.21.15.22:0/657521547 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc038011920 con 0x7fc048101ed0 2024-08-20T01:33:15.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.525+0000 7fc045ffb640 1 -- 172.21.15.22:0/657521547 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc038010a30 con 0x7fc048101ed0 2024-08-20T01:33:15.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.525+0000 7fc04ebad640 1 -- 172.21.15.22:0/657521547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0481a1480 con 0x7fc048101ed0 2024-08-20T01:33:15.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.525+0000 7fc04ebad640 1 -- 172.21.15.22:0/657521547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0481a7d10 con 0x7fc048101ed0 2024-08-20T01:33:15.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.529+0000 7fc050fa6740 1 Processor -- start 2024-08-20T01:33:15.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.529+0000 7fc050fa6740 1 -- start start 2024-08-20T01:33:15.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.529+0000 7fc045ffb640 1 -- 172.21.15.22:0/657521547 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc038010bd0 con 0x7fc048101ed0 2024-08-20T01:33:15.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.529+0000 7fc050fa6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afa3b0 0x55b050afa790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:15.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.529+0000 7fc050fa6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050afacd0 0x55b050b06720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:15.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.529+0000 7fc050fa6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050b06c60 0x55b050b09050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:15.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.529+0000 7fc050fa6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b050a70940 con 0x55b050b06c60 2024-08-20T01:33:15.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.529+0000 7fc050fa6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b050a5fe40 con 0x55b050afacd0 2024-08-20T01:33:15.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.529+0000 7fc050fa6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b050a63e80 con 0x55b050afa3b0 2024-08-20T01:33:15.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.529+0000 7fc04d14a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afa3b0 0x55b050afa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:15.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.529+0000 7fc04d14a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afa3b0 0x55b050afa790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:45722/0 (socket says 172.21.15.22:45722) 2024-08-20T01:33:15.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.529+0000 7fc04d14a640 1 -- 172.21.15.22:0/500972185 learned_addr learned my addr 172.21.15.22:0/500972185 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:15.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.530+0000 7fc04c949640 1 --2- 172.21.15.22:0/500972185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050afacd0 0x55b050b06720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:15.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.530+0000 7fc047fff640 1 --2- 172.21.15.22:0/500972185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050b06c60 0x55b050b09050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:15.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.530+0000 7fc04d14a640 1 -- 172.21.15.22:0/500972185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050afacd0 msgr2=0x55b050b06720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:15.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.530+0000 7fc04d14a640 1 --2- 172.21.15.22:0/500972185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050afacd0 0x55b050b06720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.530+0000 7fc04d14a640 1 -- 172.21.15.22:0/500972185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050b06c60 msgr2=0x55b050b09050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:15.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.530+0000 7fc04d14a640 1 --2- 172.21.15.22:0/500972185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050b06c60 0x55b050b09050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.530+0000 7fc04d14a640 1 -- 172.21.15.22:0/500972185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0509fc520 con 0x55b050afa3b0 2024-08-20T01:33:15.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.530+0000 7fc047fff640 1 --2- 172.21.15.22:0/500972185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050b06c60 0x55b050b09050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:33:15.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.530+0000 7fc045ffb640 1 --2- 172.21.15.22:0/657521547 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc0340b3c50 0x7fc0340b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:15.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.530+0000 7fc04d14a640 1 --2- 172.21.15.22:0/500972185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afa3b0 0x55b050afa790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc030009900 tx=0x7fc030032ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a997611e7c776977 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:15.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.530+0000 7fc04c949640 1 --2- 172.21.15.22:0/657521547 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc0340b3c50 0x7fc0340b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:15.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.530+0000 7fc03effd640 1 -- 172.21.15.22:0/500972185 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc030035040 con 0x55b050afa3b0 2024-08-20T01:33:15.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.530+0000 7fc045ffb640 1 -- 172.21.15.22:0/657521547 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fc0380e4170 con 0x7fc048101ed0 2024-08-20T01:33:15.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.530+0000 7fc03effd640 1 -- 172.21.15.22:0/500972185 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc030004030 con 0x55b050afa3b0 2024-08-20T01:33:15.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.530+0000 7fc03effd640 1 -- 172.21.15.22:0/500972185 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc030005620 con 0x55b050afa3b0 2024-08-20T01:33:15.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.531+0000 7fc050fa6740 1 -- 172.21.15.22:0/500972185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afa3b0 msgr2=0x55b050afa790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:15.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.531+0000 7fc04c949640 1 --2- 172.21.15.22:0/657521547 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc0340b3c50 0x7fc0340b6110 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55b050afd530 tx=0x7fc040005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:15.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.531+0000 7fc050fa6740 1 --2- 172.21.15.22:0/500972185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afa3b0 0x55b050afa790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc030009900 tx=0x7fc030032ba0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.531+0000 7fc050fa6740 1 -- 172.21.15.22:0/500972185 shutdown_connections 2024-08-20T01:33:15.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.531+0000 7fc050fa6740 1 --2- 172.21.15.22:0/500972185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050b06c60 0x55b050b09050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.531+0000 7fc050fa6740 1 --2- 172.21.15.22:0/500972185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050afacd0 0x55b050b06720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.531+0000 7fc050fa6740 1 --2- 172.21.15.22:0/500972185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afa3b0 0x55b050afa790 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.531+0000 7fc050fa6740 1 -- 172.21.15.22:0/500972185 >> 172.21.15.22:0/500972185 conn(0x55b050af81e0 msgr2=0x55b050af9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:15.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.531+0000 7fc050fa6740 1 -- 172.21.15.22:0/500972185 shutdown_connections 2024-08-20T01:33:15.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.531+0000 7fc050fa6740 1 -- 172.21.15.22:0/500972185 wait complete. 2024-08-20T01:33:15.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.532+0000 7fc050fa6740 1 -- start start 2024-08-20T01:33:15.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.532+0000 7fc050fa6740 1 Processor -- start 2024-08-20T01:33:15.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.532+0000 7fc050fa6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050afa3b0 0x55b050b03cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:15.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.532+0000 7fc050fa6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afacd0 0x55b050b04200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:15.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.532+0000 7fc050fa6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050b06c60 0x55b050b04740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:15.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.532+0000 7fc050fa6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b0508c2890 con 0x55b050b06c60 2024-08-20T01:33:15.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.532+0000 7fc050fa6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b0509e6700 con 0x55b050afa3b0 2024-08-20T01:33:15.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.532+0000 7fc050fa6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b050b09950 con 0x55b050afacd0 2024-08-20T01:33:15.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.532+0000 7fc050fa6740 10 client.0 _ll_register_callbacks cb 0x55b050a5b6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:15.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.533+0000 7fc04c949640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050afa3b0 0x55b050b03cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:15.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.533+0000 7fc047fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afacd0 0x55b050b04200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:15.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.533+0000 7fc04c949640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050afa3b0 0x55b050b03cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:33426/0 (socket says 172.21.15.22:33426) 2024-08-20T01:33:15.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.533+0000 7fc04d14a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050b06c60 0x55b050b04740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:15.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.533+0000 7fc04c949640 1 -- 172.21.15.22:0/1506720859 learned_addr learned my addr 172.21.15.22:0/1506720859 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:15.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.533+0000 7fc04c949640 1 -- 172.21.15.22:0/1506720859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afacd0 msgr2=0x55b050b04200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:15.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.533+0000 7fc04c949640 1 --2- 172.21.15.22:0/1506720859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afacd0 0x55b050b04200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.533+0000 7fc04c949640 1 -- 172.21.15.22:0/1506720859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050b06c60 msgr2=0x55b050b04740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.533+0000 7fc04c949640 1 --2- 172.21.15.22:0/1506720859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050b06c60 0x55b050b04740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.533+0000 7fc04c949640 1 -- 172.21.15.22:0/1506720859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0507bf930 con 0x55b050afa3b0 2024-08-20T01:33:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.533+0000 7fc047fff640 1 --2- 172.21.15.22:0/1506720859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afacd0 0x55b050b04200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.533+0000 7fc04c949640 1 --2- 172.21.15.22:0/1506720859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050afa3b0 0x55b050b03cc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc040013010 tx=0x7fc040004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f992a34e2e16f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.533+0000 7fc027fff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:33:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.533+0000 7fc027fff640 1 -- 172.21.15.22:0/1506720859 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04000f7b0 con 0x55b050afa3b0 2024-08-20T01:33:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.533+0000 7fc027fff640 1 -- 172.21.15.22:0/1506720859 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fc04000f950 con 0x55b050afa3b0 2024-08-20T01:33:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.533+0000 7fc050fa6740 1 -- 172.21.15.22:0/1506720859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc030004030 con 0x55b050afa3b0 2024-08-20T01:33:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.534+0000 7fc027fff640 1 -- 172.21.15.22:0/1506720859 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc04000fb50 con 0x55b050afa3b0 2024-08-20T01:33:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.534+0000 7fc050fa6740 10 client.25397 fetch_fsmap learned FSMap version 27 2024-08-20T01:33:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.534+0000 7fc050fa6740 1 -- 172.21.15.22:0/1506720859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b050b15570 con 0x55b050afa3b0 2024-08-20T01:33:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.534+0000 7fc027fff640 1 -- 172.21.15.22:0/1506720859 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc030004030 con 0x55b050afa3b0 2024-08-20T01:33:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.534+0000 7fc027fff640 1 -- 172.21.15.22:0/1506720859 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc040027070 con 0x55b050afa3b0 2024-08-20T01:33:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.534+0000 7fc050fa6740 10 client.25397 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:33:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.534+0000 7fc050fa6740 10 client.25397 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:33:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.534+0000 7fc050fa6740 20 client.25397 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.534+0000 7fc050fa6740 1 --2- 172.21.15.22:0/1506720859 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55b050b16a20 0x55b050b18e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.534+0000 7fc050fa6740 4 client.25397 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:33:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.534+0000 7fc050fa6740 1 -- 172.21.15.22:0/1506720859 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b050a72890 con 0x55b050b16a20 2024-08-20T01:33:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.535+0000 7fc047fff640 1 --2- 172.21.15.22:0/1506720859 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55b050b16a20 0x55b050b18e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.535+0000 7fc047fff640 1 --2- 172.21.15.22:0/1506720859 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55b050b16a20 0x55b050b18e90 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c429b8880d996a9 server_cookie=afc32da32ec85b98 in_seq=0 out_seq=0 2024-08-20T01:33:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.535+0000 7fc027fff640 10 client.25397 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.536+0000 7fc027fff640 1 -- 172.21.15.22:0/1506720859 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b050a72890 con 0x55b050b16a20 2024-08-20T01:33:15.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.536+0000 7fc027fff640 10 client.25397 handle_command_reply: tid=0 2024-08-20T01:33:15.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.536+0000 7fc050fa6740 1 client.25397 shutdown 2024-08-20T01:33:15.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.536+0000 7fc050fa6740 1 -- 172.21.15.22:0/1506720859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050afa3b0 msgr2=0x55b050b03cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:15.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.536+0000 7fc050fa6740 1 --2- 172.21.15.22:0/1506720859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050afa3b0 0x55b050b03cc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc040013010 tx=0x7fc040004730 comp rx=0 tx=0).stop 2024-08-20T01:33:15.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.536+0000 7fc050fa6740 1 -- 172.21.15.22:0/1506720859 shutdown_connections 2024-08-20T01:33:15.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.536+0000 7fc050fa6740 1 --2- 172.21.15.22:0/1506720859 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55b050b16a20 0x55b050b18e90 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.536+0000 7fc050fa6740 1 --2- 172.21.15.22:0/1506720859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050b06c60 0x55b050b04740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.536+0000 7fc027fff640 0 client.25397 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:15.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.536+0000 7fc050fa6740 1 --2- 172.21.15.22:0/1506720859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afacd0 0x55b050b04200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.536+0000 7fc050fa6740 1 --2- 172.21.15.22:0/1506720859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050afa3b0 0x55b050b03cc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.536+0000 7fc050fa6740 1 -- 172.21.15.22:0/1506720859 >> 172.21.15.22:0/1506720859 conn(0x55b050af81e0 msgr2=0x55b050afdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:15.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.536+0000 7fc050fa6740 1 -- 172.21.15.22:0/1506720859 shutdown_connections 2024-08-20T01:33:15.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.536+0000 7fc050fa6740 1 -- 172.21.15.22:0/1506720859 wait complete. 2024-08-20T01:33:15.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.536+0000 7fc050fa6740 20 client.25397 trim_cache size 0 max 16384 2024-08-20T01:33:15.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.557+0000 7fc050fa6740 1 Processor -- start 2024-08-20T01:33:15.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.557+0000 7fc050fa6740 1 -- start start 2024-08-20T01:33:15.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.557+0000 7fc050fa6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afa3b0 0x55b050afe570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:15.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.557+0000 7fc050fa6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050afacd0 0x55b050b1e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:15.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.557+0000 7fc050fa6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050b06c60 0x55b050b1ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:15.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.557+0000 7fc050fa6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc0481b2c30 con 0x55b050afacd0 2024-08-20T01:33:15.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.557+0000 7fc050fa6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc0481b0500 con 0x55b050b06c60 2024-08-20T01:33:15.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.557+0000 7fc050fa6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc0481ae350 con 0x55b050afa3b0 2024-08-20T01:33:15.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.557+0000 7fc04c949640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afa3b0 0x55b050afe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:15.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.557+0000 7fc04c949640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afa3b0 0x55b050afe570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:45742/0 (socket says 172.21.15.22:45742) 2024-08-20T01:33:15.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.557+0000 7fc04c949640 1 -- 172.21.15.22:0/3889122286 learned_addr learned my addr 172.21.15.22:0/3889122286 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:15.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.557+0000 7fc047fff640 1 --2- 172.21.15.22:0/3889122286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050afacd0 0x55b050b1e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:15.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.557+0000 7fc04d14a640 1 --2- 172.21.15.22:0/3889122286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050b06c60 0x55b050b1ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:15.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.558+0000 7fc04c949640 1 -- 172.21.15.22:0/3889122286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050b06c60 msgr2=0x55b050b1ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:15.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.558+0000 7fc04c949640 1 --2- 172.21.15.22:0/3889122286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050b06c60 0x55b050b1ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.558+0000 7fc04c949640 1 -- 172.21.15.22:0/3889122286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050afacd0 msgr2=0x55b050b1e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:15.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.558+0000 7fc04c949640 1 --2- 172.21.15.22:0/3889122286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050afacd0 0x55b050b1e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.558+0000 7fc04c949640 1 -- 172.21.15.22:0/3889122286 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b050b06130 con 0x55b050afa3b0 2024-08-20T01:33:15.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.558+0000 7fc047fff640 1 --2- 172.21.15.22:0/3889122286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050afacd0 0x55b050b1e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:15.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.558+0000 7fc04c949640 1 --2- 172.21.15.22:0/3889122286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afa3b0 0x55b050afe570 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc040012e30 tx=0x7fc040003e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52fd2f900c87cb59 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:15.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.559+0000 7fc03e7fc640 1 -- 172.21.15.22:0/3889122286 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04000fcf0 con 0x55b050afa3b0 2024-08-20T01:33:15.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.559+0000 7fc03e7fc640 1 -- 172.21.15.22:0/3889122286 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc040038020 con 0x55b050afa3b0 2024-08-20T01:33:15.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.559+0000 7fc03e7fc640 1 -- 172.21.15.22:0/3889122286 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc040029530 con 0x55b050afa3b0 2024-08-20T01:33:15.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.560+0000 7fc050fa6740 1 -- 172.21.15.22:0/3889122286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afa3b0 msgr2=0x55b050afe570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:15.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.560+0000 7fc050fa6740 1 --2- 172.21.15.22:0/3889122286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afa3b0 0x55b050afe570 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc040012e30 tx=0x7fc040003e10 comp rx=0 tx=0).stop 2024-08-20T01:33:15.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.560+0000 7fc050fa6740 1 -- 172.21.15.22:0/3889122286 shutdown_connections 2024-08-20T01:33:15.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.560+0000 7fc050fa6740 1 --2- 172.21.15.22:0/3889122286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050b06c60 0x55b050b1ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.560+0000 7fc050fa6740 1 --2- 172.21.15.22:0/3889122286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050afacd0 0x55b050b1e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.560+0000 7fc050fa6740 1 --2- 172.21.15.22:0/3889122286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afa3b0 0x55b050afe570 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.560+0000 7fc050fa6740 1 -- 172.21.15.22:0/3889122286 >> 172.21.15.22:0/3889122286 conn(0x55b050af81e0 msgr2=0x55b050af7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:15.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.560+0000 7fc050fa6740 1 -- 172.21.15.22:0/3889122286 shutdown_connections 2024-08-20T01:33:15.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.560+0000 7fc050fa6740 1 -- 172.21.15.22:0/3889122286 wait complete. 2024-08-20T01:33:15.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.560+0000 7fc050fa6740 1 -- start start 2024-08-20T01:33:15.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.561+0000 7fc050fa6740 1 Processor -- start 2024-08-20T01:33:15.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.561+0000 7fc050fa6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050afa3b0 0x55b050b0f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:15.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.561+0000 7fc050fa6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afacd0 0x55b050b0a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:15.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.561+0000 7fc050fa6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050b06c60 0x55b050b0ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:15.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.561+0000 7fc050fa6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc0481ae9c0 con 0x55b050b06c60 2024-08-20T01:33:15.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.561+0000 7fc050fa6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc0481afe30 con 0x55b050afa3b0 2024-08-20T01:33:15.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.562+0000 7fc050fa6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc0481af090 con 0x55b050afacd0 2024-08-20T01:33:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.562+0000 7fc04c949640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050afa3b0 0x55b050b0f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.562+0000 7fc04c949640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050afa3b0 0x55b050b0f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:33452/0 (socket says 172.21.15.22:33452) 2024-08-20T01:33:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.562+0000 7fc04c949640 1 -- 172.21.15.22:0/1936279269 learned_addr learned my addr 172.21.15.22:0/1936279269 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.562+0000 7fc04d14a640 1 --2- 172.21.15.22:0/1936279269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050b06c60 0x55b050b0ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.562+0000 7fc050fa6740 10 client.0 _ll_register_callbacks cb 0x7fc040009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.562+0000 7fc04c949640 1 -- 172.21.15.22:0/1936279269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afacd0 msgr2=0x55b050b0a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.562+0000 7fc04c949640 1 --2- 172.21.15.22:0/1936279269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afacd0 0x55b050b0a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.562+0000 7fc04c949640 1 -- 172.21.15.22:0/1936279269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050b06c60 msgr2=0x55b050b0ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.562+0000 7fc04c949640 1 --2- 172.21.15.22:0/1936279269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050b06c60 0x55b050b0ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.562+0000 7fc04c949640 1 -- 172.21.15.22:0/1936279269 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b050b80770 con 0x55b050afa3b0 2024-08-20T01:33:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.562+0000 7fc04d14a640 1 --2- 172.21.15.22:0/1936279269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050b06c60 0x55b050b0ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:33:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.562+0000 7fc027fff640 10 client.25403 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:33:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.562+0000 7fc04c949640 1 --2- 172.21.15.22:0/1936279269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050afa3b0 0x55b050b0f360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc04003a040 tx=0x7fc04000fa50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7e7522847ebe729 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:15.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.562+0000 7fc050fa6740 1 -- 172.21.15.22:0/1936279269 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc040038020 con 0x55b050afa3b0 2024-08-20T01:33:15.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.563+0000 7fc027fff640 1 -- 172.21.15.22:0/1936279269 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc040042060 con 0x55b050afa3b0 2024-08-20T01:33:15.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.563+0000 7fc027fff640 1 -- 172.21.15.22:0/1936279269 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fc040005050 con 0x55b050afa3b0 2024-08-20T01:33:15.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.563+0000 7fc027fff640 1 -- 172.21.15.22:0/1936279269 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc040023040 con 0x55b050afa3b0 2024-08-20T01:33:15.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.563+0000 7fc050fa6740 10 client.25403 fetch_fsmap learned FSMap version 27 2024-08-20T01:33:15.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.563+0000 7fc050fa6740 1 -- 172.21.15.22:0/1936279269 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55b050b81790 con 0x55b050afa3b0 2024-08-20T01:33:15.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.564+0000 7fc027fff640 1 -- 172.21.15.22:0/1936279269 <== mon.2 v2:172.21.15.77:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc040027070 con 0x55b050afa3b0 2024-08-20T01:33:15.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.564+0000 7fc050fa6740 10 client.25403 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:33:15.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.564+0000 7fc050fa6740 10 client.25403 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:33:15.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.564+0000 7fc050fa6740 20 client.25403 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:15.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.564+0000 7fc050fa6740 1 --2- 172.21.15.22:0/1936279269 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55b050b81ea0 0x55b050b842c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:15.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.564+0000 7fc050fa6740 4 client.25403 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:33:15.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.564+0000 7fc050fa6740 1 -- 172.21.15.22:0/1936279269 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b050a6e330 con 0x55b050b81ea0 2024-08-20T01:33:15.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.564+0000 7fc047fff640 1 --2- 172.21.15.22:0/1936279269 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55b050b81ea0 0x55b050b842c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:15.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.564+0000 7fc027fff640 10 client.25403 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:15.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.564+0000 7fc047fff640 1 --2- 172.21.15.22:0/1936279269 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55b050b81ea0 0x55b050b842c0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0f51c1b343f4738 server_cookie=a64d7f2bba7cbcd9 in_seq=0 out_seq=0 2024-08-20T01:33:15.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.565+0000 7fc027fff640 1 -- 172.21.15.22:0/1936279269 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b050a6e330 con 0x55b050b81ea0 2024-08-20T01:33:15.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.565+0000 7fc027fff640 10 client.25403 handle_command_reply: tid=0 2024-08-20T01:33:15.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.565+0000 7fc050fa6740 1 client.25403 shutdown 2024-08-20T01:33:15.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.565+0000 7fc050fa6740 1 -- 172.21.15.22:0/1936279269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050afa3b0 msgr2=0x55b050b0f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:15.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.565+0000 7fc050fa6740 1 --2- 172.21.15.22:0/1936279269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050afa3b0 0x55b050b0f360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc04003a040 tx=0x7fc04000fa50 comp rx=0 tx=0).stop 2024-08-20T01:33:15.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.565+0000 7fc050fa6740 1 -- 172.21.15.22:0/1936279269 shutdown_connections 2024-08-20T01:33:15.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.565+0000 7fc050fa6740 1 --2- 172.21.15.22:0/1936279269 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55b050b81ea0 0x55b050b842c0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.565+0000 7fc050fa6740 1 --2- 172.21.15.22:0/1936279269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b050b06c60 0x55b050b0ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.565+0000 7fc050fa6740 1 --2- 172.21.15.22:0/1936279269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b050afacd0 0x55b050b0a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.565+0000 7fc050fa6740 1 --2- 172.21.15.22:0/1936279269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b050afa3b0 0x55b050b0f360 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.565+0000 7fc050fa6740 1 -- 172.21.15.22:0/1936279269 >> 172.21.15.22:0/1936279269 conn(0x55b050af81e0 msgr2=0x55b050af6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:15.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.566+0000 7fc027fff640 0 client.25403 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:15.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.566+0000 7fc050fa6740 1 -- 172.21.15.22:0/1936279269 shutdown_connections 2024-08-20T01:33:15.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.566+0000 7fc050fa6740 1 -- 172.21.15.22:0/1936279269 wait complete. 2024-08-20T01:33:15.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.566+0000 7fc050fa6740 20 client.25403 trim_cache size 0 max 16384 2024-08-20T01:33:15.571 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:33:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-08-20T01:33:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "9df99341-af11-4bd3-ad37-1933b0db3b26", 2024-08-20T01:33:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-08-20T01:33:15.571 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:33:15.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.567+0000 7fc04ebad640 1 -- 172.21.15.22:0/657521547 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc0340b3c50 msgr2=0x7fc0340b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:15.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.567+0000 7fc04ebad640 1 --2- 172.21.15.22:0/657521547 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc0340b3c50 0x7fc0340b6110 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55b050afd530 tx=0x7fc040005f90 comp rx=0 tx=0).stop 2024-08-20T01:33:15.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.567+0000 7fc04ebad640 1 -- 172.21.15.22:0/657521547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc048101ed0 msgr2=0x7fc04819b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:15.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.567+0000 7fc04ebad640 1 --2- 172.21.15.22:0/657521547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc048101ed0 0x7fc04819b620 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc03800eab0 tx=0x7fc03800ef70 comp rx=0 tx=0).stop 2024-08-20T01:33:15.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.567+0000 7fc04ebad640 1 -- 172.21.15.22:0/657521547 shutdown_connections 2024-08-20T01:33:15.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.567+0000 7fc04ebad640 1 --2- 172.21.15.22:0/657521547 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc0340b3c50 0x7fc0340b6110 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.567+0000 7fc04ebad640 1 --2- 172.21.15.22:0/657521547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc04810f160 0x7fc0481a09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.567+0000 7fc04ebad640 1 --2- 172.21.15.22:0/657521547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc048101ed0 0x7fc04819b620 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.567+0000 7fc04ebad640 1 --2- 172.21.15.22:0/657521547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0481015b0 0x7fc04819b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:15.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.567+0000 7fc04ebad640 1 -- 172.21.15.22:0/657521547 >> 172.21.15.22:0/657521547 conn(0x7fc0480fd400 msgr2=0x7fc048111400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:15.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.567+0000 7fc04ebad640 1 -- 172.21.15.22:0/657521547 shutdown_connections 2024-08-20T01:33:15.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:15.567+0000 7fc04ebad640 1 -- 172.21.15.22:0/657521547 wait complete. 2024-08-20T01:33:16.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:16 smithi134 ceph-mon[22511]: scrub queued for path: / 2024-08-20T01:33:16.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:16 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:16.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:16 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:33:16.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:16 smithi077 ceph-mon[22251]: scrub queued for path: / 2024-08-20T01:33:16.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:16 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:16.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:16 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:33:16.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:16 smithi022 ceph-mon[18709]: scrub queued for path: / 2024-08-20T01:33:16.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:16 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:16.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:16 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:33:16.766 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:33:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.979+0000 7f72f6ffd640 1 -- 172.21.15.22:0/1245514071 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0031cd0 con 0x7f72f81026b0 2024-08-20T01:33:16.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.979+0000 7f72fcbb2640 1 --2- 172.21.15.22:0/1245514071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f8103070 0x7f72f806a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:33:16.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.980+0000 7f72fe615640 1 -- 172.21.15.22:0/1245514071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f81026b0 msgr2=0x7f72f8102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.980+0000 7f72fe615640 1 --2- 172.21.15.22:0/1245514071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f81026b0 0x7f72f8102b30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009ca0 tx=0x7f72f002a8e0 comp rx=0 tx=0).stop 2024-08-20T01:33:16.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.983+0000 7f72fe615640 1 -- 172.21.15.22:0/1245514071 shutdown_connections 2024-08-20T01:33:16.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.983+0000 7f72fe615640 1 --2- 172.21.15.22:0/1245514071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f8103070 0x7f72f806a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:16.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.983+0000 7f72fe615640 1 --2- 172.21.15.22:0/1245514071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f81026b0 0x7f72f8102b30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:16.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.983+0000 7f72fe615640 1 --2- 172.21.15.22:0/1245514071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72f8101560 0x7f72f8101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:16.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.983+0000 7f72fe615640 1 -- 172.21.15.22:0/1245514071 >> 172.21.15.22:0/1245514071 conn(0x7f72f80fce40 msgr2=0x7f72f80ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.994+0000 7f72fe615640 1 -- 172.21.15.22:0/1245514071 shutdown_connections 2024-08-20T01:33:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.994+0000 7f72fe615640 1 -- 172.21.15.22:0/1245514071 wait complete. 2024-08-20T01:33:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.995+0000 7f72fe615640 1 Processor -- start 2024-08-20T01:33:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.996+0000 7f72fe615640 1 -- start start 2024-08-20T01:33:16.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.996+0000 7f72fe615640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f8101560 0x7f72f8111ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.996+0000 7f72fe615640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f81026b0 0x7f72f8112120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.996+0000 7f72fe615640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72f8103070 0x7f72f8117de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.996+0000 7f72fe615640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f72f810c130 con 0x7f72f8101560 2024-08-20T01:33:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.997+0000 7f72fe615640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f72f810bfb0 con 0x7f72f81026b0 2024-08-20T01:33:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.997+0000 7f72fe615640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f72f810c2b0 con 0x7f72f8103070 2024-08-20T01:33:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.997+0000 7f72f7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f8101560 0x7f72f8111ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:16.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.998+0000 7f72f77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f81026b0 0x7f72f8112120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.998+0000 7f72f77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f81026b0 0x7f72f8112120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:33458/0 (socket says 172.21.15.22:33458) 2024-08-20T01:33:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.998+0000 7f72f77fe640 1 -- 172.21.15.22:0/1219880170 learned_addr learned my addr 172.21.15.22:0/1219880170 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:16.998+0000 7f72fcbb2640 1 --2- 172.21.15.22:0/1219880170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72f8103070 0x7f72f8117de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.001+0000 7f72f7fff640 1 -- 172.21.15.22:0/1219880170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72f8103070 msgr2=0x7f72f8117de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.002+0000 7f72f7fff640 1 --2- 172.21.15.22:0/1219880170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72f8103070 0x7f72f8117de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.002+0000 7f72f7fff640 1 -- 172.21.15.22:0/1219880170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f81026b0 msgr2=0x7f72f8112120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.002+0000 7f72f7fff640 1 --2- 172.21.15.22:0/1219880170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f81026b0 0x7f72f8112120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.002+0000 7f72f7fff640 1 -- 172.21.15.22:0/1219880170 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f8112d50 con 0x7f72f8101560 2024-08-20T01:33:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.002+0000 7f72fcbb2640 1 --2- 172.21.15.22:0/1219880170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72f8103070 0x7f72f8117de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.002+0000 7f72f77fe640 1 --2- 172.21.15.22:0/1219880170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f81026b0 0x7f72f8112120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.002+0000 7f72f7fff640 1 --2- 172.21.15.22:0/1219880170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f8101560 0x7f72f8111ad0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f72e800e9f0 tx=0x7f72e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.009+0000 7f72f57fa640 1 -- 172.21.15.22:0/1219880170 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e800ccc0 con 0x7f72f8101560 2024-08-20T01:33:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.010+0000 7f72f57fa640 1 -- 172.21.15.22:0/1219880170 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72e80108e0 con 0x7f72f8101560 2024-08-20T01:33:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.010+0000 7f72f57fa640 1 -- 172.21.15.22:0/1219880170 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e8018880 con 0x7f72f8101560 2024-08-20T01:33:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.010+0000 7f72fe615640 1 -- 172.21.15.22:0/1219880170 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f8113040 con 0x7f72f8101560 2024-08-20T01:33:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.010+0000 7f72fe615640 1 -- 172.21.15.22:0/1219880170 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f8113540 con 0x7f72f8101560 2024-08-20T01:33:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.015+0000 7f730140b740 1 Processor -- start 2024-08-20T01:33:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.015+0000 7f730140b740 1 -- start start 2024-08-20T01:33:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.015+0000 7f730140b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b46630 0x561513b48a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.015+0000 7f730140b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b48f60 0x561513b4b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.015+0000 7f730140b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b4b9a0 0x561513b4de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.015+0000 7f730140b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561513ab9360 con 0x561513b46630 2024-08-20T01:33:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.015+0000 7f730140b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561513aa8860 con 0x561513b48f60 2024-08-20T01:33:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.015+0000 7f730140b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561513aac8a0 con 0x561513b4b9a0 2024-08-20T01:33:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.016+0000 7f72fcbb2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b46630 0x561513b48a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.016+0000 7f72f77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b4b9a0 0x561513b4de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.016+0000 7f72fcbb2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b46630 0x561513b48a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34554/0 (socket says 172.21.15.22:34554) 2024-08-20T01:33:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.016+0000 7f72fcbb2640 1 -- 172.21.15.22:0/247672675 learned_addr learned my addr 172.21.15.22:0/247672675 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.017+0000 7f72f77fe640 1 -- 172.21.15.22:0/247672675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b48f60 msgr2=0x561513b4b350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:33:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.017+0000 7f72f77fe640 1 --2- 172.21.15.22:0/247672675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b48f60 0x561513b4b350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.017+0000 7f72f77fe640 1 -- 172.21.15.22:0/247672675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b46630 msgr2=0x561513b48a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.017+0000 7f72f77fe640 1 --2- 172.21.15.22:0/247672675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b46630 0x561513b48a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.017+0000 7f72f77fe640 1 -- 172.21.15.22:0/247672675 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561513a4fe40 con 0x561513b4b9a0 2024-08-20T01:33:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.017+0000 7f72f57fa640 1 -- 172.21.15.22:0/1219880170 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f72e8010430 con 0x7f72f8101560 2024-08-20T01:33:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.017+0000 7f72f77fe640 1 --2- 172.21.15.22:0/247672675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b4b9a0 0x561513b4de60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f72f0005e30 tx=0x7f72f0030770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=724aacba3ffb1ae4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.018+0000 7f72de7fc640 1 -- 172.21.15.22:0/247672675 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0003970 con 0x561513b4b9a0 2024-08-20T01:33:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.018+0000 7f72de7fc640 1 -- 172.21.15.22:0/247672675 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72f0036030 con 0x561513b4b9a0 2024-08-20T01:33:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.018+0000 7f72de7fc640 1 -- 172.21.15.22:0/247672675 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0004040 con 0x561513b4b9a0 2024-08-20T01:33:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.018+0000 7f72f57fa640 1 --2- 172.21.15.22:0/1219880170 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f72e00b3c50 0x7f72e00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.019+0000 7f72fcbb2640 1 --2- 172.21.15.22:0/1219880170 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f72e00b3c50 0x7f72e00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.019+0000 7f72f57fa640 1 -- 172.21.15.22:0/1219880170 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f72e80e3f30 con 0x7f72f8101560 2024-08-20T01:33:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.019+0000 7f730140b740 1 -- 172.21.15.22:0/247672675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b4b9a0 msgr2=0x561513b4de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.019+0000 7f730140b740 1 --2- 172.21.15.22:0/247672675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b4b9a0 0x561513b4de60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f72f0005e30 tx=0x7f72f0030770 comp rx=0 tx=0).stop 2024-08-20T01:33:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.020+0000 7f72fcbb2640 1 --2- 172.21.15.22:0/1219880170 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f72e00b3c50 0x7f72e00b6110 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f72ec010620 tx=0x7f72ec00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.020+0000 7f730140b740 1 -- 172.21.15.22:0/247672675 shutdown_connections 2024-08-20T01:33:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.020+0000 7f730140b740 1 --2- 172.21.15.22:0/247672675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b4b9a0 0x561513b4de60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.020+0000 7f730140b740 1 --2- 172.21.15.22:0/247672675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b48f60 0x561513b4b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.020+0000 7f730140b740 1 --2- 172.21.15.22:0/247672675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b46630 0x561513b48a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.020+0000 7f730140b740 1 -- 172.21.15.22:0/247672675 >> 172.21.15.22:0/247672675 conn(0x561513b41730 msgr2=0x561513b42510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.020+0000 7f730140b740 1 -- 172.21.15.22:0/247672675 shutdown_connections 2024-08-20T01:33:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.020+0000 7f730140b740 1 -- 172.21.15.22:0/247672675 wait complete. 2024-08-20T01:33:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.020+0000 7f730140b740 1 -- start start 2024-08-20T01:33:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.021+0000 7f730140b740 1 Processor -- start 2024-08-20T01:33:17.025 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.022+0000 7f730140b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 0x561513b50090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:17.025 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.022+0000 7f730140b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b48f60 0x561513b50730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:17.025 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.022+0000 7f730140b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b512e0 0x561513b51760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:17.025 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.022+0000 7f72f7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 0x561513b50090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.025 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.022+0000 7f72f7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 0x561513b50090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:45796/0 (socket says 172.21.15.22:45796) 2024-08-20T01:33:17.025 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.022+0000 7f72f7fff640 1 -- 172.21.15.22:0/3418435021 learned_addr learned my addr 172.21.15.22:0/3418435021 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:17.025 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.023+0000 7f72f77fe640 1 --2- 172.21.15.22:0/3418435021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b48f60 0x561513b50730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.025 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.023+0000 7f72fcbb2640 1 --2- 172.21.15.22:0/3418435021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b512e0 0x561513b51760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.025 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.023+0000 7f730140b740 1 -- 172.21.15.22:0/3418435021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5615139e1ab0 con 0x561513b48f60 2024-08-20T01:33:17.026 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.023+0000 7f730140b740 1 -- 172.21.15.22:0/3418435021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561513a2f780 con 0x561513b512e0 2024-08-20T01:33:17.026 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.023+0000 7f730140b740 1 -- 172.21.15.22:0/3418435021 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561513b4e920 con 0x561513b46630 2024-08-20T01:33:17.026 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.023+0000 7f730140b740 10 client.0 _ll_register_callbacks cb 0x5615137b7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:17.027 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.023+0000 7f72f7fff640 1 -- 172.21.15.22:0/3418435021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b512e0 msgr2=0x561513b51760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.023+0000 7f72f7fff640 1 --2- 172.21.15.22:0/3418435021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b512e0 0x561513b51760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.023+0000 7f72f7fff640 1 -- 172.21.15.22:0/3418435021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b48f60 msgr2=0x561513b50730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.023+0000 7f72f7fff640 1 --2- 172.21.15.22:0/3418435021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b48f60 0x561513b50730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.023+0000 7f72f7fff640 1 -- 172.21.15.22:0/3418435021 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56151380b790 con 0x561513b46630 2024-08-20T01:33:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.024+0000 7f72f7fff640 1 --2- 172.21.15.22:0/3418435021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 0x561513b50090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f72e80a8160 tx=0x7f72e80aaac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=521b9d01dd54c366 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.024+0000 7f72d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:33:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.024+0000 7f72d77fe640 1 -- 172.21.15.22:0/3418435021 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e80ad030 con 0x561513b46630 2024-08-20T01:33:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.024+0000 7f72d77fe640 1 -- 172.21.15.22:0/3418435021 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f72e80a74e0 con 0x561513b46630 2024-08-20T01:33:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.024+0000 7f730140b740 1 -- 172.21.15.22:0/3418435021 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561513a57e00 con 0x561513b46630 2024-08-20T01:33:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.024+0000 7f72d77fe640 1 -- 172.21.15.22:0/3418435021 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f72e80b3ef0 con 0x561513b46630 2024-08-20T01:33:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.024+0000 7f730140b740 10 client.25435 fetch_fsmap learned FSMap version 27 2024-08-20T01:33:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.024+0000 7f730140b740 1 -- 172.21.15.22:0/3418435021 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561513884620 con 0x561513b46630 2024-08-20T01:33:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.024+0000 7f72d77fe640 1 -- 172.21.15.22:0/3418435021 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561513a57e00 con 0x561513b46630 2024-08-20T01:33:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.025+0000 7f72d77fe640 1 -- 172.21.15.22:0/3418435021 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f72e80a9d30 con 0x561513b46630 2024-08-20T01:33:17.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.025+0000 7f730140b740 10 client.25435 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:33:17.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.025+0000 7f730140b740 10 client.25435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:33:17.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.025+0000 7f730140b740 20 client.25435 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:17.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.025+0000 7f730140b740 1 --2- 172.21.15.22:0/3418435021 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561513b5bd20 0x561513b5e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:17.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.025+0000 7f730140b740 4 client.25435 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:33:17.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.025+0000 7f730140b740 1 -- 172.21.15.22:0/3418435021 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561513abb2b0 con 0x561513b5bd20 2024-08-20T01:33:17.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.025+0000 7f72f77fe640 1 --2- 172.21.15.22:0/3418435021 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561513b5bd20 0x561513b5e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.027+0000 7f72d77fe640 10 client.25435 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:17.030 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.027+0000 7f72f77fe640 1 --2- 172.21.15.22:0/3418435021 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561513b5bd20 0x561513b5e180 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2e45a441036aef0 server_cookie=e7f6ce4058e61e92 in_seq=0 out_seq=0 2024-08-20T01:33:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.031+0000 7f72d77fe640 1 -- 172.21.15.22:0/3418435021 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561513abb2b0 con 0x561513b5bd20 2024-08-20T01:33:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.031+0000 7f72d77fe640 10 client.25435 handle_command_reply: tid=0 2024-08-20T01:33:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.031+0000 7f730140b740 1 client.25435 shutdown 2024-08-20T01:33:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.031+0000 7f730140b740 1 -- 172.21.15.22:0/3418435021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 msgr2=0x561513b50090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.031+0000 7f730140b740 1 --2- 172.21.15.22:0/3418435021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 0x561513b50090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f72e80a8160 tx=0x7f72e80aaac0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.032+0000 7f730140b740 1 -- 172.21.15.22:0/3418435021 shutdown_connections 2024-08-20T01:33:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.032+0000 7f730140b740 1 --2- 172.21.15.22:0/3418435021 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561513b5bd20 0x561513b5e180 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.032+0000 7f730140b740 1 --2- 172.21.15.22:0/3418435021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b512e0 0x561513b51760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.032+0000 7f730140b740 1 --2- 172.21.15.22:0/3418435021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b48f60 0x561513b50730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.032+0000 7f730140b740 1 --2- 172.21.15.22:0/3418435021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 0x561513b50090 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.032+0000 7f730140b740 1 -- 172.21.15.22:0/3418435021 >> 172.21.15.22:0/3418435021 conn(0x561513b41730 msgr2=0x561513b40850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.032+0000 7f72d77fe640 0 client.25435 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.032+0000 7f730140b740 1 -- 172.21.15.22:0/3418435021 shutdown_connections 2024-08-20T01:33:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.032+0000 7f730140b740 1 -- 172.21.15.22:0/3418435021 wait complete. 2024-08-20T01:33:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.032+0000 7f730140b740 20 client.25435 trim_cache size 0 max 16384 2024-08-20T01:33:17.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.058+0000 7f730140b740 1 Processor -- start 2024-08-20T01:33:17.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.058+0000 7f730140b740 1 -- start start 2024-08-20T01:33:17.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.058+0000 7f730140b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 0x561513b4bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:17.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.058+0000 7f730140b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b48f60 0x561513b4c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:17.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.058+0000 7f730140b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b512e0 0x561513b4ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:17.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.058+0000 7f730140b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f72f81bb260 con 0x561513b48f60 2024-08-20T01:33:17.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.058+0000 7f730140b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f72f81b8b30 con 0x561513b512e0 2024-08-20T01:33:17.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.058+0000 7f730140b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f72f81b6980 con 0x561513b46630 2024-08-20T01:33:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.058+0000 7f72f7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 0x561513b4bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.058+0000 7f72f7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 0x561513b4bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:45798/0 (socket says 172.21.15.22:45798) 2024-08-20T01:33:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.058+0000 7f72f7fff640 1 -- 172.21.15.22:0/908533523 learned_addr learned my addr 172.21.15.22:0/908533523 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.059+0000 7f72fcbb2640 1 --2- 172.21.15.22:0/908533523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b512e0 0x561513b4ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.059+0000 7f72f77fe640 1 --2- 172.21.15.22:0/908533523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b48f60 0x561513b4c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.059+0000 7f72f7fff640 1 -- 172.21.15.22:0/908533523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b512e0 msgr2=0x561513b4ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.059+0000 7f72f7fff640 1 --2- 172.21.15.22:0/908533523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b512e0 0x561513b4ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.059+0000 7f72f7fff640 1 -- 172.21.15.22:0/908533523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b48f60 msgr2=0x561513b4c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.059+0000 7f72f7fff640 1 --2- 172.21.15.22:0/908533523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b48f60 0x561513b4c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.059+0000 7f72f7fff640 1 -- 172.21.15.22:0/908533523 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561513b51ad0 con 0x561513b46630 2024-08-20T01:33:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.059+0000 7f72f7fff640 1 --2- 172.21.15.22:0/908533523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 0x561513b4bdb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f72e80aae80 tx=0x7f72e80b08f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=343c6745824f2378 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.059+0000 7f72ddffb640 1 -- 172.21.15.22:0/908533523 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e80ad070 con 0x561513b46630 2024-08-20T01:33:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.060+0000 7f72ddffb640 1 -- 172.21.15.22:0/908533523 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72e80aa360 con 0x561513b46630 2024-08-20T01:33:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.060+0000 7f72ddffb640 1 -- 172.21.15.22:0/908533523 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e80a6be0 con 0x561513b46630 2024-08-20T01:33:17.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.060+0000 7f730140b740 1 -- 172.21.15.22:0/908533523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 msgr2=0x561513b4bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:17.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.060+0000 7f730140b740 1 --2- 172.21.15.22:0/908533523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 0x561513b4bdb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f72e80aae80 tx=0x7f72e80b08f0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.060+0000 7f730140b740 1 -- 172.21.15.22:0/908533523 shutdown_connections 2024-08-20T01:33:17.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.060+0000 7f730140b740 1 --2- 172.21.15.22:0/908533523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b512e0 0x561513b4ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.060+0000 7f730140b740 1 --2- 172.21.15.22:0/908533523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b48f60 0x561513b4c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.060+0000 7f730140b740 1 --2- 172.21.15.22:0/908533523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 0x561513b4bdb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.060+0000 7f730140b740 1 -- 172.21.15.22:0/908533523 >> 172.21.15.22:0/908533523 conn(0x561513b41730 msgr2=0x561513b4d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:17.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.061+0000 7f730140b740 1 -- 172.21.15.22:0/908533523 shutdown_connections 2024-08-20T01:33:17.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.061+0000 7f730140b740 1 -- 172.21.15.22:0/908533523 wait complete. 2024-08-20T01:33:17.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.061+0000 7f730140b740 1 -- start start 2024-08-20T01:33:17.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.061+0000 7f730140b740 1 Processor -- start 2024-08-20T01:33:17.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.062+0000 7f730140b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 0x561513b54e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:17.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.062+0000 7f730140b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b48f60 0x561513b55500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:17.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.062+0000 7f730140b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b512e0 0x561513b560d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:17.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.062+0000 7f730140b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f72f81b6ff0 con 0x561513b48f60 2024-08-20T01:33:17.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.062+0000 7f730140b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f72f81b8460 con 0x561513b512e0 2024-08-20T01:33:17.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.062+0000 7f72f77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b48f60 0x561513b55500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.062+0000 7f72f77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b48f60 0x561513b55500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34582/0 (socket says 172.21.15.22:34582) 2024-08-20T01:33:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.062+0000 7f72f77fe640 1 -- 172.21.15.22:0/1799101026 learned_addr learned my addr 172.21.15.22:0/1799101026 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.062+0000 7f72fcbb2640 1 --2- 172.21.15.22:0/1799101026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b512e0 0x561513b560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.062+0000 7f72f7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 0x561513b54e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.062+0000 7f730140b740 1 -- 172.21.15.22:0/1799101026 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f72f81b76c0 con 0x561513b46630 2024-08-20T01:33:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.062+0000 7f730140b740 10 client.0 _ll_register_callbacks cb 0x7f72e80a6df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.063+0000 7f72f77fe640 1 -- 172.21.15.22:0/1799101026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 msgr2=0x561513b54e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.063+0000 7f72f77fe640 1 --2- 172.21.15.22:0/1799101026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 0x561513b54e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.063+0000 7f72f77fe640 1 -- 172.21.15.22:0/1799101026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b512e0 msgr2=0x561513b560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.063+0000 7f72f77fe640 1 --2- 172.21.15.22:0/1799101026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b512e0 0x561513b560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.063+0000 7f72f77fe640 1 -- 172.21.15.22:0/1799101026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561513b56900 con 0x561513b48f60 2024-08-20T01:33:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.063+0000 7f72fcbb2640 1 --2- 172.21.15.22:0/1799101026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b512e0 0x561513b560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.063+0000 7f72f7fff640 1 --2- 172.21.15.22:0/1799101026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 0x561513b54e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.063+0000 7f72f77fe640 1 --2- 172.21.15.22:0/1799101026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b48f60 0x561513b55500 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f72f0000f80 tx=0x7f72f002b080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9431160474770e5a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.063+0000 7f72d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:33:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.063+0000 7f72d77fe640 1 -- 172.21.15.22:0/1799101026 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0003970 con 0x561513b48f60 2024-08-20T01:33:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.064+0000 7f730140b740 1 -- 172.21.15.22:0/1799101026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72e80aa360 con 0x561513b48f60 2024-08-20T01:33:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.064+0000 7f72d77fe640 1 -- 172.21.15.22:0/1799101026 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f72f0003b10 con 0x561513b48f60 2024-08-20T01:33:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.064+0000 7f72d77fe640 1 -- 172.21.15.22:0/1799101026 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f72f005e050 con 0x561513b48f60 2024-08-20T01:33:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.064+0000 7f730140b740 10 client.15831 fetch_fsmap learned FSMap version 27 2024-08-20T01:33:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.064+0000 7f730140b740 1 -- 172.21.15.22:0/1799101026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561513b57c30 con 0x561513b48f60 2024-08-20T01:33:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.064+0000 7f72d77fe640 1 -- 172.21.15.22:0/1799101026 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72e80aa360 con 0x561513b48f60 2024-08-20T01:33:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.065+0000 7f72d77fe640 1 -- 172.21.15.22:0/1799101026 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f72f0042070 con 0x561513b48f60 2024-08-20T01:33:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.065+0000 7f730140b740 10 client.15831 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:33:17.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.065+0000 7f730140b740 10 client.15831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:33:17.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.065+0000 7f730140b740 20 client.15831 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:17.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.066+0000 7f730140b740 1 --2- 172.21.15.22:0/1799101026 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561513bc6a70 0x561513bc8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:17.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.066+0000 7f730140b740 4 client.15831 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:33:17.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.066+0000 7f730140b740 1 -- 172.21.15.22:0/1799101026 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561513ab6d50 con 0x561513bc6a70 2024-08-20T01:33:17.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.066+0000 7f72f7fff640 1 --2- 172.21.15.22:0/1799101026 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561513bc6a70 0x561513bc8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.068+0000 7f72f7fff640 1 --2- 172.21.15.22:0/1799101026 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561513bc6a70 0x561513bc8e60 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c39bac55344c4d9 server_cookie=e5c001afaa610908 in_seq=0 out_seq=0 2024-08-20T01:33:17.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.068+0000 7f72d77fe640 10 client.15831 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:17.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:17 smithi134 ceph-mon[22511]: pgmap v410: 97 pgs: 97 active+clean; 359 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 13 MiB/s wr, 1.21k op/s 2024-08-20T01:33:17.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:17 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:33:17.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:17 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:17.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:17 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:33:17.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:17 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:17.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:17 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:33:17.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:17 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:17.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:17 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:33:17.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:17 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:33:17.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:17 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:33:17.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:17 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:33:17.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:17 smithi077 ceph-mon[22251]: pgmap v410: 97 pgs: 97 active+clean; 359 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 13 MiB/s wr, 1.21k op/s 2024-08-20T01:33:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:17 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:33:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:17 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:17 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:33:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:17 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:17 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:33:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:17 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:17 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:33:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:17 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:33:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:17 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:33:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:17 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:33:17.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:17 smithi022 ceph-mon[18709]: pgmap v410: 97 pgs: 97 active+clean; 359 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 13 MiB/s wr, 1.21k op/s 2024-08-20T01:33:17.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:17 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:33:17.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:17 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:17.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:17 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:33:17.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:17 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:17.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:17 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:33:17.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:17 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:17.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:17 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:33:17.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:17 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:33:17.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:17 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:33:17.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:17 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:33:17.395 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:33:17.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.867+0000 7f72d77fe640 1 -- 172.21.15.22:0/1799101026 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561513ab6d50 con 0x561513bc6a70 2024-08-20T01:33:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.867+0000 7f72d77fe640 10 client.15831 handle_command_reply: tid=0 2024-08-20T01:33:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.868+0000 7f730140b740 1 client.15831 shutdown 2024-08-20T01:33:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.869+0000 7f730140b740 1 -- 172.21.15.22:0/1799101026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b48f60 msgr2=0x561513b55500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.869+0000 7f730140b740 1 --2- 172.21.15.22:0/1799101026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b48f60 0x561513b55500 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f72f0000f80 tx=0x7f72f002b080 comp rx=0 tx=0).stop 2024-08-20T01:33:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.869+0000 7f730140b740 1 -- 172.21.15.22:0/1799101026 shutdown_connections 2024-08-20T01:33:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.869+0000 7f730140b740 1 --2- 172.21.15.22:0/1799101026 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561513bc6a70 0x561513bc8e60 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.869+0000 7f730140b740 1 --2- 172.21.15.22:0/1799101026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561513b512e0 0x561513b560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.869+0000 7f730140b740 1 --2- 172.21.15.22:0/1799101026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561513b48f60 0x561513b55500 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.869+0000 7f730140b740 1 --2- 172.21.15.22:0/1799101026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561513b46630 0x561513b54e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.869+0000 7f730140b740 1 -- 172.21.15.22:0/1799101026 >> 172.21.15.22:0/1799101026 conn(0x561513b41730 msgr2=0x561513b4d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.869+0000 7f72d77fe640 0 client.15831 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:17.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.869+0000 7f730140b740 1 -- 172.21.15.22:0/1799101026 shutdown_connections 2024-08-20T01:33:17.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.869+0000 7f730140b740 1 -- 172.21.15.22:0/1799101026 wait complete. 2024-08-20T01:33:17.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.870+0000 7f730140b740 20 client.15831 trim_cache size 0 max 16384 2024-08-20T01:33:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:33:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:33:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:33:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:33:17.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.902+0000 7f72fe615640 1 -- 172.21.15.22:0/1219880170 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f72e00b3c50 msgr2=0x7f72e00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:17.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.902+0000 7f72fe615640 1 --2- 172.21.15.22:0/1219880170 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f72e00b3c50 0x7f72e00b6110 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f72ec010620 tx=0x7f72ec00a250 comp rx=0 tx=0).stop 2024-08-20T01:33:17.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.902+0000 7f72fe615640 1 -- 172.21.15.22:0/1219880170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f8101560 msgr2=0x7f72f8111ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:17.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.902+0000 7f72fe615640 1 --2- 172.21.15.22:0/1219880170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f8101560 0x7f72f8111ad0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f72e800e9f0 tx=0x7f72e800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.902+0000 7f72fe615640 1 -- 172.21.15.22:0/1219880170 shutdown_connections 2024-08-20T01:33:17.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.902+0000 7f72fe615640 1 --2- 172.21.15.22:0/1219880170 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f72e00b3c50 0x7f72e00b6110 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.903+0000 7f72fe615640 1 --2- 172.21.15.22:0/1219880170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72f8103070 0x7f72f8117de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.903+0000 7f72fe615640 1 --2- 172.21.15.22:0/1219880170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f81026b0 0x7f72f8112120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.903+0000 7f72fe615640 1 --2- 172.21.15.22:0/1219880170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f8101560 0x7f72f8111ad0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.903+0000 7f72fe615640 1 -- 172.21.15.22:0/1219880170 >> 172.21.15.22:0/1219880170 conn(0x7f72f80fce40 msgr2=0x7f72f80fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:17.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.903+0000 7f72fe615640 1 -- 172.21.15.22:0/1219880170 shutdown_connections 2024-08-20T01:33:17.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:17.903+0000 7f72fe615640 1 -- 172.21.15.22:0/1219880170 wait complete. 2024-08-20T01:33:18.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.062+0000 7f5b3bdf8640 1 -- 172.21.15.22:0/3016322679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b34101500 msgr2=0x7f5b341018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:18.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.062+0000 7f5b3bdf8640 1 --2- 172.21.15.22:0/3016322679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b34101500 0x7f5b341018e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009890 tx=0x7f5b3002a360 comp rx=0 tx=0).stop 2024-08-20T01:33:18.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.062+0000 7f5b3bdf8640 1 -- 172.21.15.22:0/3016322679 shutdown_connections 2024-08-20T01:33:18.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.062+0000 7f5b3bdf8640 1 --2- 172.21.15.22:0/3016322679 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b34108f80 0x7f5b3410f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.062+0000 7f5b3bdf8640 1 --2- 172.21.15.22:0/3016322679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b34108600 0x7f5b34108a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.062+0000 7f5b3bdf8640 1 --2- 172.21.15.22:0/3016322679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b34101500 0x7f5b341018e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.062+0000 7f5b3bdf8640 1 -- 172.21.15.22:0/3016322679 >> 172.21.15.22:0/3016322679 conn(0x7f5b34076cc0 msgr2=0x7f5b340770d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:18.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.062+0000 7f5b3bdf8640 1 -- 172.21.15.22:0/3016322679 shutdown_connections 2024-08-20T01:33:18.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.062+0000 7f5b3bdf8640 1 -- 172.21.15.22:0/3016322679 wait complete. 2024-08-20T01:33:18.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.063+0000 7f5b3bdf8640 1 Processor -- start 2024-08-20T01:33:18.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.063+0000 7f5b3bdf8640 1 -- start start 2024-08-20T01:33:18.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.064+0000 7f5b3bdf8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b34101500 0x7f5b34199000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:18.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.064+0000 7f5b3bdf8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b34108600 0x7f5b34199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:18.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.064+0000 7f5b3bdf8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b34108f80 0x7f5b3419e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:18.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.064+0000 7f5b3bdf8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5b34112af0 con 0x7f5b34108600 2024-08-20T01:33:18.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.064+0000 7f5b3bdf8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5b34112970 con 0x7f5b34108f80 2024-08-20T01:33:18.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.064+0000 7f5b3bdf8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5b34112c70 con 0x7f5b34101500 2024-08-20T01:33:18.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.064+0000 7f5b39b94640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b34101500 0x7f5b34199000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:18.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.064+0000 7f5b39393640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b34108600 0x7f5b34199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:18.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.064+0000 7f5b39b94640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b34101500 0x7f5b34199000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:45840/0 (socket says 172.21.15.22:45840) 2024-08-20T01:33:18.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.064+0000 7f5b39b94640 1 -- 172.21.15.22:0/3185348153 learned_addr learned my addr 172.21.15.22:0/3185348153 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:18.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.064+0000 7f5b3a395640 1 --2- 172.21.15.22:0/3185348153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b34108f80 0x7f5b3419e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:18.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.064+0000 7f5b39b94640 1 -- 172.21.15.22:0/3185348153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b34108f80 msgr2=0x7f5b3419e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:18.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.064+0000 7f5b39b94640 1 --2- 172.21.15.22:0/3185348153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b34108f80 0x7f5b3419e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.064+0000 7f5b39b94640 1 -- 172.21.15.22:0/3185348153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b34108600 msgr2=0x7f5b34199540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:18.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.064+0000 7f5b39b94640 1 --2- 172.21.15.22:0/3185348153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b34108600 0x7f5b34199540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.064+0000 7f5b39b94640 1 -- 172.21.15.22:0/3185348153 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3419f0b0 con 0x7f5b34101500 2024-08-20T01:33:18.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.065+0000 7f5b39b94640 1 --2- 172.21.15.22:0/3185348153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b34101500 0x7f5b34199000 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5b30000c00 tx=0x7f5b30032d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:18.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.065+0000 7f5b2affd640 1 -- 172.21.15.22:0/3185348153 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b30040020 con 0x7f5b34101500 2024-08-20T01:33:18.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.065+0000 7f5b3bdf8640 1 -- 172.21.15.22:0/3185348153 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b3419f340 con 0x7f5b34101500 2024-08-20T01:33:18.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.065+0000 7f5b2affd640 1 -- 172.21.15.22:0/3185348153 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b30030d20 con 0x7f5b34101500 2024-08-20T01:33:18.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.065+0000 7f5b2affd640 1 -- 172.21.15.22:0/3185348153 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b30037040 con 0x7f5b34101500 2024-08-20T01:33:18.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.065+0000 7f5b3bdf8640 1 -- 172.21.15.22:0/3185348153 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b341a5a60 con 0x7f5b34101500 2024-08-20T01:33:18.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.068+0000 7f5b2affd640 1 -- 172.21.15.22:0/3185348153 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5b30043020 con 0x7f5b34101500 2024-08-20T01:33:18.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.068+0000 7f5b3e1f1740 1 Processor -- start 2024-08-20T01:33:18.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.068+0000 7f5b3e1f1740 1 -- start start 2024-08-20T01:33:18.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.069+0000 7f5b3e1f1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631960f9830 0x5631960f9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:18.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.069+0000 7f5b3e1f1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563196103b90 0x5631960fa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:18.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.069+0000 7f5b3e1f1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56319610e790 0x563196110b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:18.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.069+0000 7f5b3e1f1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5631960708e0 con 0x56319610e790 2024-08-20T01:33:18.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.069+0000 7f5b3e1f1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56319605fde0 con 0x563196103b90 2024-08-20T01:33:18.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.069+0000 7f5b3e1f1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563196063e20 con 0x5631960f9830 2024-08-20T01:33:18.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.069+0000 7f5b3a395640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631960f9830 0x5631960f9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:18.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.069+0000 7f5b3a395640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631960f9830 0x5631960f9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:45848/0 (socket says 172.21.15.22:45848) 2024-08-20T01:33:18.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.069+0000 7f5b3a395640 1 -- 172.21.15.22:0/277979704 learned_addr learned my addr 172.21.15.22:0/277979704 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:18.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.069+0000 7f5b39393640 1 --2- 172.21.15.22:0/277979704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56319610e790 0x563196110b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:18.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.070+0000 7f5b39393640 1 -- 172.21.15.22:0/277979704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631960f9830 msgr2=0x5631960f9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:18.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.070+0000 7f5b39393640 1 --2- 172.21.15.22:0/277979704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631960f9830 0x5631960f9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.070+0000 7f5b39393640 1 -- 172.21.15.22:0/277979704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563196103b90 msgr2=0x5631960fa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:18.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.070+0000 7f5b39b94640 1 --2- 172.21.15.22:0/277979704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563196103b90 0x5631960fa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:18.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.070+0000 7f5b39393640 1 --2- 172.21.15.22:0/277979704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563196103b90 0x5631960fa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.070+0000 7f5b2affd640 1 --2- 172.21.15.22:0/3185348153 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5b200b3bd0 0x7f5b200b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:18.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.070+0000 7f5b39393640 1 -- 172.21.15.22:0/277979704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563195dbf650 con 0x56319610e790 2024-08-20T01:33:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.070+0000 7f5b3a395640 1 --2- 172.21.15.22:0/277979704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631960f9830 0x5631960f9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.070+0000 7f5b39b94640 1 --2- 172.21.15.22:0/277979704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563196103b90 0x5631960fa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:33:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.070+0000 7f5b39393640 1 --2- 172.21.15.22:0/277979704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56319610e790 0x563196110b80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009bf0 tx=0x7f5b24011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4710cb6822f2538e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.070+0000 7f5b3a395640 1 --2- 172.21.15.22:0/3185348153 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5b200b3bd0 0x7f5b200b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.071+0000 7f5b2affd640 1 -- 172.21.15.22:0/3185348153 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f5b30103c70 con 0x7f5b34101500 2024-08-20T01:33:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.071+0000 7f5b1ffff640 1 -- 172.21.15.22:0/277979704 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b24004050 con 0x56319610e790 2024-08-20T01:33:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.071+0000 7f5b1ffff640 1 -- 172.21.15.22:0/277979704 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b240054d0 con 0x56319610e790 2024-08-20T01:33:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.071+0000 7f5b1ffff640 1 -- 172.21.15.22:0/277979704 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b24004d10 con 0x56319610e790 2024-08-20T01:33:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.072+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/277979704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56319610e790 msgr2=0x563196110b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.072+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/277979704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56319610e790 0x563196110b80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009bf0 tx=0x7f5b24011810 comp rx=0 tx=0).stop 2024-08-20T01:33:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.072+0000 7f5b3a395640 1 --2- 172.21.15.22:0/3185348153 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5b200b3bd0 0x7f5b200b6090 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00e820 tx=0x7f5b2c010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.072+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/277979704 shutdown_connections 2024-08-20T01:33:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.072+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/277979704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56319610e790 0x563196110b80 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.072+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/277979704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563196103b90 0x5631960fa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.072+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/277979704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631960f9830 0x5631960f9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.072+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/277979704 >> 172.21.15.22:0/277979704 conn(0x5631960f7660 msgr2=0x5631960f8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:18.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.072+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/277979704 shutdown_connections 2024-08-20T01:33:18.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.072+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/277979704 wait complete. 2024-08-20T01:33:18.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.073+0000 7f5b3e1f1740 1 -- start start 2024-08-20T01:33:18.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.073+0000 7f5b3e1f1740 1 Processor -- start 2024-08-20T01:33:18.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.073+0000 7f5b3e1f1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631960f9830 0x563196100af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:18.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.074+0000 7f5b3e1f1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563196103b90 0x563196101030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:18.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.074+0000 7f5b3e1f1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56319610e790 0x563196101570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:18.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.074+0000 7f5b3e1f1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563195ec2700 con 0x56319610e790 2024-08-20T01:33:18.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.074+0000 7f5b3e1f1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563195fe67c0 con 0x5631960f9830 2024-08-20T01:33:18.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.074+0000 7f5b3e1f1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563196111580 con 0x563196103b90 2024-08-20T01:33:18.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.074+0000 7f5b39b94640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631960f9830 0x563196100af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:18.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.074+0000 7f5b39b94640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631960f9830 0x563196100af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:33526/0 (socket says 172.21.15.22:33526) 2024-08-20T01:33:18.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.074+0000 7f5b39b94640 1 -- 172.21.15.22:0/4255734443 learned_addr learned my addr 172.21.15.22:0/4255734443 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:18.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.074+0000 7f5b3a395640 1 --2- 172.21.15.22:0/4255734443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56319610e790 0x563196101570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:18.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.074+0000 7f5b39393640 1 --2- 172.21.15.22:0/4255734443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563196103b90 0x563196101030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:18.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.074+0000 7f5b3e1f1740 10 client.0 _ll_register_callbacks cb 0x5631960596b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:18.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.074+0000 7f5b39b94640 1 -- 172.21.15.22:0/4255734443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563196103b90 msgr2=0x563196101030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:18.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.074+0000 7f5b39b94640 1 --2- 172.21.15.22:0/4255734443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563196103b90 0x563196101030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.074+0000 7f5b39b94640 1 -- 172.21.15.22:0/4255734443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56319610e790 msgr2=0x563196101570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:18.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.074+0000 7f5b39b94640 1 --2- 172.21.15.22:0/4255734443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56319610e790 0x563196101570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.074+0000 7f5b39b94640 1 -- 172.21.15.22:0/4255734443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56319611a900 con 0x5631960f9830 2024-08-20T01:33:18.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.074+0000 7f5b39b94640 1 --2- 172.21.15.22:0/4255734443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631960f9830 0x563196100af0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009860 tx=0x7f5b300305c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7338bd6b57568202 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:18.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.074+0000 7f5b1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:33:18.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.075+0000 7f5b1d7fa640 1 -- 172.21.15.22:0/4255734443 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b300b2300 con 0x5631960f9830 2024-08-20T01:33:18.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.075+0000 7f5b1d7fa640 1 -- 172.21.15.22:0/4255734443 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f5b300cade0 con 0x5631960f9830 2024-08-20T01:33:18.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.075+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/4255734443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56319600f100 con 0x5631960f9830 2024-08-20T01:33:18.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.075+0000 7f5b1d7fa640 1 -- 172.21.15.22:0/4255734443 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5b300ca690 con 0x5631960f9830 2024-08-20T01:33:18.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.075+0000 7f5b3e1f1740 10 client.25427 fetch_fsmap learned FSMap version 27 2024-08-20T01:33:18.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.075+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/4255734443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563196103f70 con 0x5631960f9830 2024-08-20T01:33:18.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.075+0000 7f5b1d7fa640 1 -- 172.21.15.22:0/4255734443 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b300cb280 con 0x5631960f9830 2024-08-20T01:33:18.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.075+0000 7f5b1d7fa640 1 -- 172.21.15.22:0/4255734443 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f5b300d37a0 con 0x5631960f9830 2024-08-20T01:33:18.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.075+0000 7f5b3e1f1740 10 client.25427 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:33:18.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.075+0000 7f5b3e1f1740 10 client.25427 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:33:18.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.075+0000 7f5b3e1f1740 20 client.25427 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:18.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.075+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/4255734443 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563196105470 0x5631961078d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:18.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.075+0000 7f5b3e1f1740 4 client.25427 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:33:18.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.075+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/4255734443 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56319600f100 con 0x563196105470 2024-08-20T01:33:18.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.076+0000 7f5b39393640 1 --2- 172.21.15.22:0/4255734443 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563196105470 0x5631961078d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:18.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.076+0000 7f5b1d7fa640 10 client.25427 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:18.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.076+0000 7f5b39393640 1 --2- 172.21.15.22:0/4255734443 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563196105470 0x5631961078d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e460375cc02812a1 server_cookie=86e3be73884c7dcb in_seq=0 out_seq=0 2024-08-20T01:33:18.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.078+0000 7f5b1d7fa640 1 -- 172.21.15.22:0/4255734443 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56319600f100 con 0x563196105470 2024-08-20T01:33:18.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.078+0000 7f5b1d7fa640 10 client.25427 handle_command_reply: tid=0 2024-08-20T01:33:18.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.079+0000 7f5b3e1f1740 1 client.25427 shutdown 2024-08-20T01:33:18.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.079+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/4255734443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631960f9830 msgr2=0x563196100af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:18.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.079+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/4255734443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631960f9830 0x563196100af0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009860 tx=0x7f5b300305c0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.079+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/4255734443 shutdown_connections 2024-08-20T01:33:18.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.079+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/4255734443 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563196105470 0x5631961078d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.079+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/4255734443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56319610e790 0x563196101570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.079+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/4255734443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563196103b90 0x563196101030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.079+0000 7f5b1d7fa640 0 client.25427 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:18.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.079+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/4255734443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631960f9830 0x563196100af0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.079+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/4255734443 >> 172.21.15.22:0/4255734443 conn(0x5631960f7660 msgr2=0x5631960fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:18.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.080+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/4255734443 shutdown_connections 2024-08-20T01:33:18.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.080+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/4255734443 wait complete. 2024-08-20T01:33:18.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.080+0000 7f5b3e1f1740 20 client.25427 trim_cache size 0 max 16384 2024-08-20T01:33:18.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.103+0000 7f5b3e1f1740 1 Processor -- start 2024-08-20T01:33:18.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.103+0000 7f5b3e1f1740 1 -- start start 2024-08-20T01:33:18.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.103+0000 7f5b3e1f1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631960f7660 0x5631960fd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:18.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.103+0000 7f5b3e1f1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631960f9830 0x5631960f8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:18.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.103+0000 7f5b3e1f1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563196103b90 0x5631960f8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:18.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.103+0000 7f5b3e1f1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5b341ae900 con 0x5631960f7660 2024-08-20T01:33:18.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.103+0000 7f5b3e1f1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5b341ac1d0 con 0x563196103b90 2024-08-20T01:33:18.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.103+0000 7f5b3e1f1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5b341aa020 con 0x5631960f9830 2024-08-20T01:33:18.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.103+0000 7f5b39b94640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631960f7660 0x5631960fd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:18.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.103+0000 7f5b39b94640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631960f7660 0x5631960fd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34638/0 (socket says 172.21.15.22:34638) 2024-08-20T01:33:18.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.103+0000 7f5b39b94640 1 -- 172.21.15.22:0/2055343672 learned_addr learned my addr 172.21.15.22:0/2055343672 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:18.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.103+0000 7f5b3a395640 1 --2- 172.21.15.22:0/2055343672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563196103b90 0x5631960f8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:18.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.103+0000 7f5b39393640 1 --2- 172.21.15.22:0/2055343672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631960f9830 0x5631960f8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:18.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.104+0000 7f5b39b94640 1 -- 172.21.15.22:0/2055343672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631960f9830 msgr2=0x5631960f8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:18.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.104+0000 7f5b39b94640 1 --2- 172.21.15.22:0/2055343672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631960f9830 0x5631960f8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.104+0000 7f5b39b94640 1 -- 172.21.15.22:0/2055343672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563196103b90 msgr2=0x5631960f8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:18.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.104+0000 7f5b39b94640 1 --2- 172.21.15.22:0/2055343672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563196103b90 0x5631960f8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.104+0000 7f5b39b94640 1 -- 172.21.15.22:0/2055343672 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56319610eda0 con 0x5631960f7660 2024-08-20T01:33:18.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.104+0000 7f5b3a395640 1 --2- 172.21.15.22:0/2055343672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563196103b90 0x5631960f8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:18.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.104+0000 7f5b39b94640 1 --2- 172.21.15.22:0/2055343672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631960f7660 0x5631960fd080 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5b30041000 tx=0x7f5b30030550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27723ef8dd400917 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:18.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.104+0000 7f5b1f7fe640 1 -- 172.21.15.22:0/2055343672 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b300b2300 con 0x5631960f7660 2024-08-20T01:33:18.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.104+0000 7f5b1f7fe640 1 -- 172.21.15.22:0/2055343672 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b300ea070 con 0x5631960f7660 2024-08-20T01:33:18.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.104+0000 7f5b1f7fe640 1 -- 172.21.15.22:0/2055343672 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b300d3c30 con 0x5631960f7660 2024-08-20T01:33:18.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.105+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/2055343672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631960f7660 msgr2=0x5631960fd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:18.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.105+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/2055343672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631960f7660 0x5631960fd080 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5b30041000 tx=0x7f5b30030550 comp rx=0 tx=0).stop 2024-08-20T01:33:18.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.105+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/2055343672 shutdown_connections 2024-08-20T01:33:18.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.105+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/2055343672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563196103b90 0x5631960f8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.105+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/2055343672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631960f9830 0x5631960f8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.105+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/2055343672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631960f7660 0x5631960fd080 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.105+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/2055343672 >> 172.21.15.22:0/2055343672 conn(0x5631960fa3e0 msgr2=0x5631960fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:18.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.105+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/2055343672 shutdown_connections 2024-08-20T01:33:18.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.105+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/2055343672 wait complete. 2024-08-20T01:33:18.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.106+0000 7f5b3e1f1740 1 -- start start 2024-08-20T01:33:18.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.106+0000 7f5b3e1f1740 1 Processor -- start 2024-08-20T01:33:18.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.106+0000 7f5b3e1f1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631960f7660 0x56319611fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:18.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.106+0000 7f5b3e1f1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631960f9830 0x5631961200b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:18.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.106+0000 7f5b3e1f1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563196103b90 0x5631961781a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:18.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.106+0000 7f5b3e1f1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5b341aa690 con 0x563196103b90 2024-08-20T01:33:18.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.106+0000 7f5b3e1f1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5b341abb00 con 0x5631960f7660 2024-08-20T01:33:18.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.106+0000 7f5b3e1f1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5b341aad60 con 0x5631960f9830 2024-08-20T01:33:18.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.106+0000 7f5b3e1f1740 10 client.0 _ll_register_callbacks cb 0x7f5b30030ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:18.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.106+0000 7f5b3a395640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563196103b90 0x5631961781a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:18.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.106+0000 7f5b3a395640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563196103b90 0x5631961781a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34654/0 (socket says 172.21.15.22:34654) 2024-08-20T01:33:18.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.106+0000 7f5b3a395640 1 -- 172.21.15.22:0/2130029007 learned_addr learned my addr 172.21.15.22:0/2130029007 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:18.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.106+0000 7f5b39393640 1 --2- 172.21.15.22:0/2130029007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631960f9830 0x5631961200b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:18.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.106+0000 7f5b39b94640 1 --2- 172.21.15.22:0/2130029007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631960f7660 0x56319611fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:18.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.107+0000 7f5b3a395640 1 -- 172.21.15.22:0/2130029007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631960f9830 msgr2=0x5631961200b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:18.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.107+0000 7f5b3a395640 1 --2- 172.21.15.22:0/2130029007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631960f9830 0x5631961200b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.107+0000 7f5b3a395640 1 -- 172.21.15.22:0/2130029007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631960f7660 msgr2=0x56319611fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:18.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.107+0000 7f5b3a395640 1 --2- 172.21.15.22:0/2130029007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631960f7660 0x56319611fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.107+0000 7f5b3a395640 1 -- 172.21.15.22:0/2130029007 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631961788e0 con 0x563196103b90 2024-08-20T01:33:18.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.107+0000 7f5b39b94640 1 --2- 172.21.15.22:0/2130029007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631960f7660 0x56319611fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:18.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.107+0000 7f5b3a395640 1 --2- 172.21.15.22:0/2130029007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563196103b90 0x5631961781a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00df70 tx=0x7f5b2c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1969c49ff83111f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:18.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.107+0000 7f5b1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:33:18.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.107+0000 7f5b1d7fa640 1 -- 172.21.15.22:0/2130029007 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c02b070 con 0x563196103b90 2024-08-20T01:33:18.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.107+0000 7f5b1d7fa640 1 -- 172.21.15.22:0/2130029007 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f5b2c0047d0 con 0x563196103b90 2024-08-20T01:33:18.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.107+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/2130029007 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b300ea070 con 0x563196103b90 2024-08-20T01:33:18.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.108+0000 7f5b1d7fa640 1 -- 172.21.15.22:0/2130029007 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5b2c037050 con 0x563196103b90 2024-08-20T01:33:18.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.108+0000 7f5b3e1f1740 10 client.15849 fetch_fsmap learned FSMap version 27 2024-08-20T01:33:18.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.108+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/2130029007 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563196180ea0 con 0x563196103b90 2024-08-20T01:33:18.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.108+0000 7f5b1d7fa640 1 -- 172.21.15.22:0/2130029007 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b300ea070 con 0x563196103b90 2024-08-20T01:33:18.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.108+0000 7f5b1d7fa640 1 -- 172.21.15.22:0/2130029007 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f5b2c00b040 con 0x563196103b90 2024-08-20T01:33:18.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.108+0000 7f5b3e1f1740 10 client.15849 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:33:18.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.108+0000 7f5b3e1f1740 10 client.15849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:33:18.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.108+0000 7f5b3e1f1740 20 client.15849 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:18.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.108+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/2130029007 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563196105470 0x563196183720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:18.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.108+0000 7f5b3e1f1740 4 client.15849 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:33:18.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.108+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/2130029007 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563196072830 con 0x563196105470 2024-08-20T01:33:18.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.109+0000 7f5b39b94640 1 --2- 172.21.15.22:0/2130029007 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563196105470 0x563196183720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:18.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.109+0000 7f5b1d7fa640 10 client.15849 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:18.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.109+0000 7f5b39b94640 1 --2- 172.21.15.22:0/2130029007 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563196105470 0x563196183720 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a75dc474dca5200a server_cookie=4801c577b8908b80 in_seq=0 out_seq=0 2024-08-20T01:33:18.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.111+0000 7f5b1d7fa640 1 -- 172.21.15.22:0/2130029007 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x563196072830 con 0x563196105470 2024-08-20T01:33:18.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.111+0000 7f5b1d7fa640 10 client.15849 handle_command_reply: tid=0 2024-08-20T01:33:18.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.111+0000 7f5b3e1f1740 1 client.15849 shutdown 2024-08-20T01:33:18.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.112+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/2130029007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563196103b90 msgr2=0x5631961781a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:18.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.112+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/2130029007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563196103b90 0x5631961781a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00df70 tx=0x7f5b2c004ab0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.112+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/2130029007 shutdown_connections 2024-08-20T01:33:18.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.112+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/2130029007 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563196105470 0x563196183720 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.112+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/2130029007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563196103b90 0x5631961781a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.112+0000 7f5b1d7fa640 0 client.15849 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:18.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.112+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/2130029007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631960f9830 0x5631961200b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.112+0000 7f5b3e1f1740 1 --2- 172.21.15.22:0/2130029007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631960f7660 0x56319611fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.112+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/2130029007 >> 172.21.15.22:0/2130029007 conn(0x5631960fa3e0 msgr2=0x5631960f8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:18.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.112+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/2130029007 shutdown_connections 2024-08-20T01:33:18.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.112+0000 7f5b3e1f1740 1 -- 172.21.15.22:0/2130029007 wait complete. 2024-08-20T01:33:18.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.112+0000 7f5b3e1f1740 20 client.15849 trim_cache size 0 max 16384 2024-08-20T01:33:18.116 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:33:18.116 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "scrub active (4579 inodes in the stack)", 2024-08-20T01:33:18.116 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-08-20T01:33:18.116 INFO:teuthology.orchestra.run.smithi022.stdout: "9df99341-af11-4bd3-ad37-1933b0db3b26": { 2024-08-20T01:33:18.116 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-08-20T01:33:18.116 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "9df99341-af11-4bd3-ad37-1933b0db3b26", 2024-08-20T01:33:18.117 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-08-20T01:33:18.117 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:33:18.117 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:33:18.117 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:33:18.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.113+0000 7f5b3bdf8640 1 -- 172.21.15.22:0/3185348153 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5b200b3bd0 msgr2=0x7f5b200b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:18.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.113+0000 7f5b3bdf8640 1 --2- 172.21.15.22:0/3185348153 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5b200b3bd0 0x7f5b200b6090 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00e820 tx=0x7f5b2c010040 comp rx=0 tx=0).stop 2024-08-20T01:33:18.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.113+0000 7f5b3bdf8640 1 -- 172.21.15.22:0/3185348153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b34101500 msgr2=0x7f5b34199000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:18.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.113+0000 7f5b3bdf8640 1 --2- 172.21.15.22:0/3185348153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b34101500 0x7f5b34199000 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5b30000c00 tx=0x7f5b30032d20 comp rx=0 tx=0).stop 2024-08-20T01:33:18.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.113+0000 7f5b3bdf8640 1 -- 172.21.15.22:0/3185348153 shutdown_connections 2024-08-20T01:33:18.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.113+0000 7f5b3bdf8640 1 --2- 172.21.15.22:0/3185348153 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5b200b3bd0 0x7f5b200b6090 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.113+0000 7f5b3bdf8640 1 --2- 172.21.15.22:0/3185348153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b34108f80 0x7f5b3419e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.113+0000 7f5b3bdf8640 1 --2- 172.21.15.22:0/3185348153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b34108600 0x7f5b34199540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.113+0000 7f5b3bdf8640 1 --2- 172.21.15.22:0/3185348153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b34101500 0x7f5b34199000 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:18.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.113+0000 7f5b3bdf8640 1 -- 172.21.15.22:0/3185348153 >> 172.21.15.22:0/3185348153 conn(0x7f5b34076cc0 msgr2=0x7f5b34100030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:18.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.113+0000 7f5b3bdf8640 1 -- 172.21.15.22:0/3185348153 shutdown_connections 2024-08-20T01:33:18.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:18.113+0000 7f5b3bdf8640 1 -- 172.21.15.22:0/3185348153 wait complete. 2024-08-20T01:33:18.265 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:18 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:33:18.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:18 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:18.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:18 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:33:18.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:18 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:33:18.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:18 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:33:18.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:18 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:18.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:18 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:33:18.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:18 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:33:18.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:18 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:33:18.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:18 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:18.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:18 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:33:18.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:18 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:33:19.126 INFO:tasks.cephfs.filesystem:scrub status for tag:9df99341-af11-4bd3-ad37-1933b0db3b26 - {'path': '/', 'tag': '9df99341-af11-4bd3-ad37-1933b0db3b26', 'options': 'recursive,force'} 2024-08-20T01:33:19.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:19 smithi134 ceph-mon[22511]: pgmap v411: 97 pgs: 97 active+clean; 369 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 14 MiB/s wr, 1.06k op/s 2024-08-20T01:33:19.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:19 smithi077 ceph-mon[22251]: pgmap v411: 97 pgs: 97 active+clean; 369 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 14 MiB/s wr, 1.06k op/s 2024-08-20T01:33:19.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:19 smithi022 ceph-mon[18709]: pgmap v411: 97 pgs: 97 active+clean; 369 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 14 MiB/s wr, 1.06k op/s 2024-08-20T01:33:20.022 INFO:tasks.workunit.client.0.smithi022.stdout: 139 1532373 1883 1099916 1498 390282 722 2024-08-20T01:33:20.287 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:20 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:20.287 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:20 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:20.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:20 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:20.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:20 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:20.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:20 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:20.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:20 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:21.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:21 smithi077 ceph-mon[22251]: pgmap v412: 97 pgs: 97 active+clean; 369 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.01k op/s 2024-08-20T01:33:21.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:21 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:33:21.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:21 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:21.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:21 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:21.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:21 smithi022 ceph-mon[18709]: pgmap v412: 97 pgs: 97 active+clean; 369 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.01k op/s 2024-08-20T01:33:21.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:21 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:33:21.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:21 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:21.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:21 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:21.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:21 smithi134 ceph-mon[22511]: pgmap v412: 97 pgs: 97 active+clean; 369 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.01k op/s 2024-08-20T01:33:21.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:21 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:33:21.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:21 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:21.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:21 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:33:23.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:23 smithi077 ceph-mon[22251]: pgmap v413: 97 pgs: 97 active+clean; 357 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 10 MiB/s wr, 1.56k op/s 2024-08-20T01:33:23.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:23 smithi022 ceph-mon[18709]: pgmap v413: 97 pgs: 97 active+clean; 357 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 10 MiB/s wr, 1.56k op/s 2024-08-20T01:33:23.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:23 smithi134 ceph-mon[22511]: pgmap v413: 97 pgs: 97 active+clean; 357 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 10 MiB/s wr, 1.56k op/s 2024-08-20T01:33:25.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:25 smithi077 ceph-mon[22251]: pgmap v414: 97 pgs: 97 active+clean; 354 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 1.34k op/s 2024-08-20T01:33:25.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:25 smithi022 ceph-mon[18709]: pgmap v414: 97 pgs: 97 active+clean; 354 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 1.34k op/s 2024-08-20T01:33:25.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:25 smithi134 ceph-mon[22511]: pgmap v414: 97 pgs: 97 active+clean; 354 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 1.34k op/s 2024-08-20T01:33:27.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:27 smithi077 ceph-mon[22251]: pgmap v415: 97 pgs: 97 active+clean; 356 MiB data, 947 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.5 MiB/s wr, 1.40k op/s 2024-08-20T01:33:27.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:27 smithi022 ceph-mon[18709]: pgmap v415: 97 pgs: 97 active+clean; 356 MiB data, 947 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.5 MiB/s wr, 1.40k op/s 2024-08-20T01:33:27.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:27 smithi134 ceph-mon[22511]: pgmap v415: 97 pgs: 97 active+clean; 356 MiB data, 947 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.5 MiB/s wr, 1.40k op/s 2024-08-20T01:33:29.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:29 smithi077 ceph-mon[22251]: pgmap v416: 97 pgs: 97 active+clean; 366 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.2 MiB/s wr, 1.48k op/s 2024-08-20T01:33:29.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:29 smithi022 ceph-mon[18709]: pgmap v416: 97 pgs: 97 active+clean; 366 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.2 MiB/s wr, 1.48k op/s 2024-08-20T01:33:29.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:29 smithi134 ceph-mon[22511]: pgmap v416: 97 pgs: 97 active+clean; 366 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.2 MiB/s wr, 1.48k op/s 2024-08-20T01:33:30.022 INFO:tasks.workunit.client.0.smithi022.stdout: 165 2193905 1499 1534492 1527 582533 2528 2024-08-20T01:33:31.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:31 smithi077 ceph-mon[22251]: pgmap v417: 97 pgs: 97 active+clean; 366 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.1 MiB/s wr, 1.46k op/s 2024-08-20T01:33:31.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:31 smithi022 ceph-mon[18709]: pgmap v417: 97 pgs: 97 active+clean; 366 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.1 MiB/s wr, 1.46k op/s 2024-08-20T01:33:31.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:31 smithi134 ceph-mon[22511]: pgmap v417: 97 pgs: 97 active+clean; 366 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.1 MiB/s wr, 1.46k op/s 2024-08-20T01:33:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.427+0000 7f682f59e640 1 -- 172.21.15.22:0/2388358288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68300741d0 msgr2=0x7f6830119dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.427+0000 7f682f59e640 1 --2- 172.21.15.22:0/2388358288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68300741d0 0x7f6830119dc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6820009900 tx=0x7f682002a410 comp rx=0 tx=0).stop 2024-08-20T01:33:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.429+0000 7f682f59e640 1 -- 172.21.15.22:0/2388358288 shutdown_connections 2024-08-20T01:33:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.429+0000 7f682f59e640 1 --2- 172.21.15.22:0/2388358288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68300741d0 0x7f6830119dc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.429+0000 7f682f59e640 1 --2- 172.21.15.22:0/2388358288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f683010aa30 0x7f6830073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.429+0000 7f682f59e640 1 --2- 172.21.15.22:0/2388358288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f683010a0f0 0x7f683010a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.429+0000 7f682f59e640 1 -- 172.21.15.22:0/2388358288 >> 172.21.15.22:0/2388358288 conn(0x7f683006f550 msgr2=0x7f6830071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.430+0000 7f682f59e640 1 -- 172.21.15.22:0/2388358288 shutdown_connections 2024-08-20T01:33:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.430+0000 7f682f59e640 1 -- 172.21.15.22:0/2388358288 wait complete. 2024-08-20T01:33:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.431+0000 7f682f59e640 1 Processor -- start 2024-08-20T01:33:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.431+0000 7f682f59e640 1 -- start start 2024-08-20T01:33:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.431+0000 7f682f59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68300741d0 0x7f68301a75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.431+0000 7f682f59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f683010a0f0 0x7f68301a7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.431+0000 7f682f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f683010aa30 0x7f68301a8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.432+0000 7f682f59e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f683011cee0 con 0x7f683010aa30 2024-08-20T01:33:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.432+0000 7f682f59e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f683011cd60 con 0x7f68300741d0 2024-08-20T01:33:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.432+0000 7f682f59e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f683011d060 con 0x7f683010a0f0 2024-08-20T01:33:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.432+0000 7f682e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68300741d0 0x7f68301a75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.432+0000 7f682e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68300741d0 0x7f68301a75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:42696/0 (socket says 172.21.15.22:42696) 2024-08-20T01:33:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.432+0000 7f682e59c640 1 -- 172.21.15.22:0/3027435295 learned_addr learned my addr 172.21.15.22:0/3027435295 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.432+0000 7f682e59c640 1 -- 172.21.15.22:0/3027435295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f683010a0f0 msgr2=0x7f68301a7bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T01:33:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.432+0000 7f682e59c640 1 --2- 172.21.15.22:0/3027435295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f683010a0f0 0x7f68301a7bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.432+0000 7f682e59c640 1 -- 172.21.15.22:0/3027435295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f683010aa30 msgr2=0x7f68301a8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.432+0000 7f682e59c640 1 --2- 172.21.15.22:0/3027435295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f683010aa30 0x7f68301a8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.433+0000 7f682e59c640 1 -- 172.21.15.22:0/3027435295 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68301a90e0 con 0x7f68300741d0 2024-08-20T01:33:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.433+0000 7f682e59c640 1 --2- 172.21.15.22:0/3027435295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68300741d0 0x7f68301a75a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f682800db80 tx=0x7f682800b630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.437+0000 7f681f7fe640 1 -- 172.21.15.22:0/3027435295 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828017070 con 0x7f68300741d0 2024-08-20T01:33:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.437+0000 7f681f7fe640 1 -- 172.21.15.22:0/3027435295 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6828003b70 con 0x7f68300741d0 2024-08-20T01:33:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.437+0000 7f682f59e640 1 -- 172.21.15.22:0/3027435295 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68301a93d0 con 0x7f68300741d0 2024-08-20T01:33:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.437+0000 7f682f59e640 1 -- 172.21.15.22:0/3027435295 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68301afaa0 con 0x7f68300741d0 2024-08-20T01:33:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.443+0000 7f68379d0740 1 Processor -- start 2024-08-20T01:33:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.443+0000 7f68379d0740 1 -- start start 2024-08-20T01:33:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.444+0000 7f68379d0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc4810 0x5578dcfc6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.444+0000 7f68379d0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc7140 0x5578dcfc9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.444+0000 7f68379d0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc9b80 0x5578dcfcc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.444+0000 7f68379d0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5578dcf37360 con 0x5578dcfc9b80 2024-08-20T01:33:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.444+0000 7f68379d0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5578dcf26860 con 0x5578dcfc4810 2024-08-20T01:33:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.444+0000 7f68379d0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5578dcf2a8a0 con 0x5578dcfc7140 2024-08-20T01:33:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.444+0000 7f682dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc9b80 0x5578dcfcc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.444+0000 7f682dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc9b80 0x5578dcfcc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47864/0 (socket says 172.21.15.22:47864) 2024-08-20T01:33:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.444+0000 7f682dd9b640 1 -- 172.21.15.22:0/698358289 learned_addr learned my addr 172.21.15.22:0/698358289 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.445+0000 7f682e59c640 1 --2- 172.21.15.22:0/698358289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc7140 0x5578dcfc9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.445+0000 7f682ed9d640 1 --2- 172.21.15.22:0/698358289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc4810 0x5578dcfc6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.445+0000 7f682ed9d640 1 -- 172.21.15.22:0/698358289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc7140 msgr2=0x5578dcfc9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.446+0000 7f682ed9d640 1 --2- 172.21.15.22:0/698358289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc7140 0x5578dcfc9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.446+0000 7f682ed9d640 1 -- 172.21.15.22:0/698358289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc9b80 msgr2=0x5578dcfcc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.446+0000 7f682ed9d640 1 --2- 172.21.15.22:0/698358289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc9b80 0x5578dcfcc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.446+0000 7f682ed9d640 1 -- 172.21.15.22:0/698358289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578dcecde40 con 0x5578dcfc4810 2024-08-20T01:33:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.446+0000 7f682dd9b640 1 --2- 172.21.15.22:0/698358289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc9b80 0x5578dcfcc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.447+0000 7f682ed9d640 1 --2- 172.21.15.22:0/698358289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc4810 0x5578dcfc6c00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6820009230 tx=0x7f68200050f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=721f7a9718d671f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.448+0000 7f681f7fe640 1 -- 172.21.15.22:0/3027435295 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68280106c0 con 0x7f68300741d0 2024-08-20T01:33:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.468+0000 7f681f7fe640 1 -- 172.21.15.22:0/3027435295 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6828004020 con 0x7f68300741d0 2024-08-20T01:33:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.470+0000 7f681f7fe640 1 --2- 172.21.15.22:0/3027435295 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f68180b3de0 0x7f68180b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.471+0000 7f681f7fe640 1 -- 172.21.15.22:0/3027435295 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f68280e4250 con 0x7f68300741d0 2024-08-20T01:33:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.473+0000 7f682e59c640 1 --2- 172.21.15.22:0/3027435295 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f68180b3de0 0x7f68180b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.476+0000 7f682e59c640 1 --2- 172.21.15.22:0/3027435295 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f68180b3de0 0x7f68180b62a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f68280a8370 tx=0x7f682800bf10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.498+0000 7f681cff9640 1 -- 172.21.15.22:0/698358289 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682003e030 con 0x5578dcfc4810 2024-08-20T01:33:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.498+0000 7f681cff9640 1 -- 172.21.15.22:0/698358289 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6820004020 con 0x5578dcfc4810 2024-08-20T01:33:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.499+0000 7f68379d0740 1 -- 172.21.15.22:0/698358289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc4810 msgr2=0x5578dcfc6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.499+0000 7f68379d0740 1 --2- 172.21.15.22:0/698358289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc4810 0x5578dcfc6c00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6820009230 tx=0x7f68200050f0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.518+0000 7f68379d0740 1 -- 172.21.15.22:0/698358289 shutdown_connections 2024-08-20T01:33:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.518+0000 7f68379d0740 1 --2- 172.21.15.22:0/698358289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc9b80 0x5578dcfcc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.518+0000 7f68379d0740 1 --2- 172.21.15.22:0/698358289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc7140 0x5578dcfc9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.518+0000 7f68379d0740 1 --2- 172.21.15.22:0/698358289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc4810 0x5578dcfc6c00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.518+0000 7f68379d0740 1 -- 172.21.15.22:0/698358289 >> 172.21.15.22:0/698358289 conn(0x5578dcfbf960 msgr2=0x5578dcfc06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.521+0000 7f68379d0740 1 -- 172.21.15.22:0/698358289 shutdown_connections 2024-08-20T01:33:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.521+0000 7f68379d0740 1 -- 172.21.15.22:0/698358289 wait complete. 2024-08-20T01:33:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.521+0000 7f68379d0740 1 -- start start 2024-08-20T01:33:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.521+0000 7f68379d0740 1 Processor -- start 2024-08-20T01:33:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.522+0000 7f68379d0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc4810 0x5578dcfce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.522+0000 7f68379d0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc7140 0x5578dcfce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.522+0000 7f68379d0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc9b80 0x5578dcfcf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.522+0000 7f68379d0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5578dce5fab0 con 0x5578dcfc7140 2024-08-20T01:33:32.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.522+0000 7f68379d0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5578dcead780 con 0x5578dcfc4810 2024-08-20T01:33:32.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.522+0000 7f68379d0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5578dcfccb50 con 0x5578dcfc9b80 2024-08-20T01:33:32.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.522+0000 7f68379d0740 10 client.0 _ll_register_callbacks cb 0x5578dcc35a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:32.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.523+0000 7f682ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc4810 0x5578dcfce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:32.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.523+0000 7f682ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc4810 0x5578dcfce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:42710/0 (socket says 172.21.15.22:42710) 2024-08-20T01:33:32.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.523+0000 7f682ed9d640 1 -- 172.21.15.22:0/883397272 learned_addr learned my addr 172.21.15.22:0/883397272 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.523+0000 7f682dd9b640 1 --2- 172.21.15.22:0/883397272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc7140 0x5578dcfce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.523+0000 7f682ed9d640 1 --2- 172.21.15.22:0/883397272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc9b80 0x5578dcfcf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.524+0000 7f682dd9b640 1 -- 172.21.15.22:0/883397272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc9b80 msgr2=0x5578dcfcf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:32.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.524+0000 7f682dd9b640 1 --2- 172.21.15.22:0/883397272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc9b80 0x5578dcfcf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.524+0000 7f682dd9b640 1 -- 172.21.15.22:0/883397272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc4810 msgr2=0x5578dcfce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:32.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.524+0000 7f682dd9b640 1 --2- 172.21.15.22:0/883397272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc4810 0x5578dcfce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.524+0000 7f682dd9b640 1 -- 172.21.15.22:0/883397272 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578dcc89790 con 0x5578dcfc7140 2024-08-20T01:33:32.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.525+0000 7f682ed9d640 1 --2- 172.21.15.22:0/883397272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc9b80 0x5578dcfcf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.529+0000 7f682dd9b640 1 --2- 172.21.15.22:0/883397272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc7140 0x5578dcfce6b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f682400f640 tx=0x7f682400fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66010e1206b706c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.529+0000 7f6815ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:33:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.531+0000 7f6815ffb640 1 -- 172.21.15.22:0/883397272 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824004230 con 0x5578dcfc7140 2024-08-20T01:33:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.531+0000 7f68379d0740 1 -- 172.21.15.22:0/883397272 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5578dced5e00 con 0x5578dcfc7140 2024-08-20T01:33:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.532+0000 7f6815ffb640 1 -- 172.21.15.22:0/883397272 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f68240043d0 con 0x5578dcfc7140 2024-08-20T01:33:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.535+0000 7f6815ffb640 1 -- 172.21.15.22:0/883397272 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6824005020 con 0x5578dcfc7140 2024-08-20T01:33:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.535+0000 7f68379d0740 10 client.15858 fetch_fsmap learned FSMap version 28 2024-08-20T01:33:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.535+0000 7f68379d0740 1 -- 172.21.15.22:0/883397272 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5578dcd02620 con 0x5578dcfc7140 2024-08-20T01:33:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.536+0000 7f6815ffb640 1 -- 172.21.15.22:0/883397272 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5578dced5e00 con 0x5578dcfc7140 2024-08-20T01:33:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.536+0000 7f6815ffb640 1 -- 172.21.15.22:0/883397272 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f68240047a0 con 0x5578dcfc7140 2024-08-20T01:33:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.536+0000 7f68379d0740 10 client.15858 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:33:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.536+0000 7f68379d0740 10 client.15858 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:33:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.536+0000 7f68379d0740 20 client.15858 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.536+0000 7f68379d0740 1 --2- 172.21.15.22:0/883397272 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5578dcfd9df0 0x5578dcfdc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.536+0000 7f68379d0740 4 client.15858 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:33:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.536+0000 7f68379d0740 1 -- 172.21.15.22:0/883397272 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578dcf392b0 con 0x5578dcfd9df0 2024-08-20T01:33:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.537+0000 7f682ed9d640 1 --2- 172.21.15.22:0/883397272 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5578dcfd9df0 0x5578dcfdc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.537+0000 7f682ed9d640 1 --2- 172.21.15.22:0/883397272 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5578dcfd9df0 0x5578dcfdc210 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89f12184c3dcd6d6 server_cookie=aa712dd8af2fc61a in_seq=0 out_seq=0 2024-08-20T01:33:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.537+0000 7f6815ffb640 10 client.15858 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.544+0000 7f6815ffb640 1 -- 172.21.15.22:0/883397272 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5578dcf392b0 con 0x5578dcfd9df0 2024-08-20T01:33:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.544+0000 7f6815ffb640 10 client.15858 handle_command_reply: tid=0 2024-08-20T01:33:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.544+0000 7f68379d0740 1 client.15858 shutdown 2024-08-20T01:33:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.545+0000 7f68379d0740 1 -- 172.21.15.22:0/883397272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc7140 msgr2=0x5578dcfce6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.545+0000 7f68379d0740 1 --2- 172.21.15.22:0/883397272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc7140 0x5578dcfce6b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f682400f640 tx=0x7f682400fb00 comp rx=0 tx=0).stop 2024-08-20T01:33:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.545+0000 7f68379d0740 1 -- 172.21.15.22:0/883397272 shutdown_connections 2024-08-20T01:33:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.545+0000 7f68379d0740 1 --2- 172.21.15.22:0/883397272 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5578dcfd9df0 0x5578dcfdc210 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.545+0000 7f68379d0740 1 --2- 172.21.15.22:0/883397272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc9b80 0x5578dcfcf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.545+0000 7f68379d0740 1 --2- 172.21.15.22:0/883397272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc7140 0x5578dcfce6b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.545+0000 7f68379d0740 1 --2- 172.21.15.22:0/883397272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc4810 0x5578dcfce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.545+0000 7f6815ffb640 0 client.15858 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.545+0000 7f68379d0740 1 -- 172.21.15.22:0/883397272 >> 172.21.15.22:0/883397272 conn(0x5578dcfbf960 msgr2=0x5578dcfbea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:32.547 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.545+0000 7f68379d0740 1 -- 172.21.15.22:0/883397272 shutdown_connections 2024-08-20T01:33:32.547 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.545+0000 7f68379d0740 1 -- 172.21.15.22:0/883397272 wait complete. 2024-08-20T01:33:32.547 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.546+0000 7f68379d0740 20 client.15858 trim_cache size 0 max 16384 2024-08-20T01:33:32.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.650+0000 7f68379d0740 1 Processor -- start 2024-08-20T01:33:32.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.651+0000 7f68379d0740 1 -- start start 2024-08-20T01:33:32.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.653+0000 7f68379d0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc4810 0x5578dcfcdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.654+0000 7f682ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc4810 0x5578dcfcdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.654+0000 7f682ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc4810 0x5578dcfcdff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47882/0 (socket says 172.21.15.22:47882) 2024-08-20T01:33:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.654+0000 7f682ed9d640 1 -- 172.21.15.22:0/1149602775 learned_addr learned my addr 172.21.15.22:0/1149602775 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.655+0000 7f68379d0740 1 --2- 172.21.15.22:0/1149602775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc7140 0x5578dcfce530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.655+0000 7f68379d0740 1 --2- 172.21.15.22:0/1149602775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc9b80 0x5578dcfc9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.655+0000 7f682dd9b640 1 --2- 172.21.15.22:0/1149602775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc7140 0x5578dcfce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.655+0000 7f68379d0740 1 -- 172.21.15.22:0/1149602775 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6810010f90 con 0x5578dcfc4810 2024-08-20T01:33:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.656+0000 7f68379d0740 1 -- 172.21.15.22:0/1149602775 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f681000e830 con 0x5578dcfc9b80 2024-08-20T01:33:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.656+0000 7f68379d0740 1 -- 172.21.15.22:0/1149602775 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f681000c680 con 0x5578dcfc7140 2024-08-20T01:33:32.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.657+0000 7f682ed9d640 1 -- 172.21.15.22:0/1149602775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc7140 msgr2=0x5578dcfce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:32.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.657+0000 7f682ed9d640 1 --2- 172.21.15.22:0/1149602775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc7140 0x5578dcfce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.657+0000 7f682ed9d640 1 -- 172.21.15.22:0/1149602775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc9b80 msgr2=0x5578dcfc9f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:33:32.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.657+0000 7f682ed9d640 1 --2- 172.21.15.22:0/1149602775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc9b80 0x5578dcfc9f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.657+0000 7f682ed9d640 1 -- 172.21.15.22:0/1149602775 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578dcfc98a0 con 0x5578dcfc4810 2024-08-20T01:33:32.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.658+0000 7f682ed9d640 1 --2- 172.21.15.22:0/1149602775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc4810 0x5578dcfcdff0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6820009900 tx=0x7f6820009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b9e3a173381921 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:32.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.677+0000 7f6817fff640 1 -- 172.21.15.22:0/1149602775 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682003e070 con 0x5578dcfc4810 2024-08-20T01:33:32.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.677+0000 7f6817fff640 1 -- 172.21.15.22:0/1149602775 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6820047030 con 0x5578dcfc4810 2024-08-20T01:33:32.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.677+0000 7f6817fff640 1 -- 172.21.15.22:0/1149602775 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682004c040 con 0x5578dcfc4810 2024-08-20T01:33:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.678+0000 7f68379d0740 1 -- 172.21.15.22:0/1149602775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc4810 msgr2=0x5578dcfcdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.678+0000 7f68379d0740 1 --2- 172.21.15.22:0/1149602775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc4810 0x5578dcfcdff0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6820009900 tx=0x7f6820009260 comp rx=0 tx=0).stop 2024-08-20T01:33:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.678+0000 7f68379d0740 1 -- 172.21.15.22:0/1149602775 shutdown_connections 2024-08-20T01:33:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.679+0000 7f68379d0740 1 --2- 172.21.15.22:0/1149602775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc9b80 0x5578dcfc9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.679+0000 7f68379d0740 1 --2- 172.21.15.22:0/1149602775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc7140 0x5578dcfce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.679+0000 7f68379d0740 1 --2- 172.21.15.22:0/1149602775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc4810 0x5578dcfcdff0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.679+0000 7f68379d0740 1 -- 172.21.15.22:0/1149602775 >> 172.21.15.22:0/1149602775 conn(0x5578dcfbf960 msgr2=0x5578dcfcb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.703+0000 7f68379d0740 1 -- 172.21.15.22:0/1149602775 shutdown_connections 2024-08-20T01:33:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.703+0000 7f68379d0740 1 -- 172.21.15.22:0/1149602775 wait complete. 2024-08-20T01:33:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.703+0000 7f68379d0740 1 -- start start 2024-08-20T01:33:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.704+0000 7f68379d0740 1 Processor -- start 2024-08-20T01:33:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.704+0000 7f68379d0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc4810 0x5578dcfd2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.705+0000 7f682ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc4810 0x5578dcfd2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.705+0000 7f682ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc4810 0x5578dcfd2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47888/0 (socket says 172.21.15.22:47888) 2024-08-20T01:33:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.705+0000 7f682ed9d640 1 -- 172.21.15.22:0/1956233131 learned_addr learned my addr 172.21.15.22:0/1956233131 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.705+0000 7f68379d0740 1 --2- 172.21.15.22:0/1956233131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc7140 0x5578dcfd3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.705+0000 7f68379d0740 1 --2- 172.21.15.22:0/1956233131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc9b80 0x5578dcfd4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.705+0000 7f68379d0740 1 -- 172.21.15.22:0/1956233131 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f681000ccf0 con 0x5578dcfc4810 2024-08-20T01:33:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.705+0000 7f68379d0740 1 -- 172.21.15.22:0/1956233131 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f681000e160 con 0x5578dcfc7140 2024-08-20T01:33:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.705+0000 7f68379d0740 1 -- 172.21.15.22:0/1956233131 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f681000d3c0 con 0x5578dcfc9b80 2024-08-20T01:33:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.705+0000 7f68379d0740 10 client.0 _ll_register_callbacks cb 0x7f682400a5e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.706+0000 7f682dd9b640 1 --2- 172.21.15.22:0/1956233131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc7140 0x5578dcfd3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.706+0000 7f682dd9b640 1 -- 172.21.15.22:0/1956233131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc9b80 msgr2=0x5578dcfd4080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:33:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.706+0000 7f682dd9b640 1 --2- 172.21.15.22:0/1956233131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc9b80 0x5578dcfd4080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.706+0000 7f682dd9b640 1 -- 172.21.15.22:0/1956233131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc4810 msgr2=0x5578dcfd2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.707+0000 7f682dd9b640 1 --2- 172.21.15.22:0/1956233131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc4810 0x5578dcfd2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.707+0000 7f682dd9b640 1 -- 172.21.15.22:0/1956233131 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578dcfdc580 con 0x5578dcfc7140 2024-08-20T01:33:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.707+0000 7f682ed9d640 1 --2- 172.21.15.22:0/1956233131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc4810 0x5578dcfd2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.707+0000 7f682dd9b640 1 --2- 172.21.15.22:0/1956233131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc7140 0x5578dcfd3500 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6824004bf0 tx=0x7f6824005870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45c58e4bc2ed127d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.775+0000 7f6815ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:33:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.775+0000 7f6815ffb640 1 -- 172.21.15.22:0/1956233131 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824028050 con 0x5578dcfc7140 2024-08-20T01:33:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.775+0000 7f68379d0740 1 -- 172.21.15.22:0/1956233131 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6820047030 con 0x5578dcfc7140 2024-08-20T01:33:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.775+0000 7f6815ffb640 1 -- 172.21.15.22:0/1956233131 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f68240051c0 con 0x5578dcfc7140 2024-08-20T01:33:32.849 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.776+0000 7f6815ffb640 1 -- 172.21.15.22:0/1956233131 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f68240053e0 con 0x5578dcfc7140 2024-08-20T01:33:32.849 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.777+0000 7f68379d0740 10 client.25448 fetch_fsmap learned FSMap version 28 2024-08-20T01:33:32.849 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.777+0000 7f68379d0740 1 -- 172.21.15.22:0/1956233131 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5578dcfd5aa0 con 0x5578dcfc7140 2024-08-20T01:33:32.849 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.781+0000 7f6815ffb640 1 -- 172.21.15.22:0/1956233131 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6820047030 con 0x5578dcfc7140 2024-08-20T01:33:32.849 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.782+0000 7f6815ffb640 1 -- 172.21.15.22:0/1956233131 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f6824037660 con 0x5578dcfc7140 2024-08-20T01:33:32.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.783+0000 7f68379d0740 10 client.25448 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:33:32.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.783+0000 7f68379d0740 10 client.25448 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:33:32.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.783+0000 7f68379d0740 20 client.25448 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:32.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.783+0000 7f68379d0740 1 --2- 172.21.15.22:0/1956233131 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5578dd044c20 0x5578dd047010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:32.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.783+0000 7f68379d0740 4 client.25448 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:33:32.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.783+0000 7f68379d0740 1 -- 172.21.15.22:0/1956233131 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5578dcf34d50 con 0x5578dd044c20 2024-08-20T01:33:32.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.783+0000 7f682ed9d640 1 --2- 172.21.15.22:0/1956233131 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5578dd044c20 0x5578dd047010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:32.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.784+0000 7f682ed9d640 1 --2- 172.21.15.22:0/1956233131 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5578dd044c20 0x5578dd047010 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0de4074db3cc03 server_cookie=7e28fc43f0f1814f in_seq=0 out_seq=0 2024-08-20T01:33:32.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:32.785+0000 7f6815ffb640 10 client.25448 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:33.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:33 smithi077 ceph-mon[22251]: pgmap v418: 97 pgs: 97 active+clean; 378 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.4 MiB/s wr, 1.28k op/s 2024-08-20T01:33:33.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:33 smithi077 ceph-mon[22251]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:33:33.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:33 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:33:33.389 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:33 smithi022 ceph-mon[18709]: pgmap v418: 97 pgs: 97 active+clean; 378 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.4 MiB/s wr, 1.28k op/s 2024-08-20T01:33:33.389 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:33 smithi022 ceph-mon[18709]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:33:33.389 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:33 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:33:33.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:33 smithi134 ceph-mon[22511]: pgmap v418: 97 pgs: 97 active+clean; 378 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.4 MiB/s wr, 1.28k op/s 2024-08-20T01:33:33.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:33 smithi134 ceph-mon[22511]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:33:33.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:33 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:33:34.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:34 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:33:34.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:34 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:33:34.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:34 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:33:34.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:34 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:33:34.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:34 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:33:34.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:34 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:33:35.373 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.364+0000 7f6815ffb640 1 -- 172.21.15.22:0/1956233131 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5578dcf34d50 con 0x5578dd044c20 2024-08-20T01:33:35.373 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.364+0000 7f6815ffb640 10 client.25448 handle_command_reply: tid=0 2024-08-20T01:33:35.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.364+0000 7f68379d0740 1 client.25448 shutdown 2024-08-20T01:33:35.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.364+0000 7f68379d0740 1 -- 172.21.15.22:0/1956233131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc7140 msgr2=0x5578dcfd3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:35.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.364+0000 7f68379d0740 1 --2- 172.21.15.22:0/1956233131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc7140 0x5578dcfd3500 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6824004bf0 tx=0x7f6824005870 comp rx=0 tx=0).stop 2024-08-20T01:33:35.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.364+0000 7f68379d0740 1 -- 172.21.15.22:0/1956233131 shutdown_connections 2024-08-20T01:33:35.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.364+0000 7f68379d0740 1 --2- 172.21.15.22:0/1956233131 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5578dd044c20 0x5578dd047010 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:35.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.364+0000 7f68379d0740 1 --2- 172.21.15.22:0/1956233131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5578dcfc9b80 0x5578dcfd4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:35.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.364+0000 7f68379d0740 1 --2- 172.21.15.22:0/1956233131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dcfc7140 0x5578dcfd3500 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.364+0000 7f68379d0740 1 --2- 172.21.15.22:0/1956233131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578dcfc4810 0x5578dcfd2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.364+0000 7f68379d0740 1 -- 172.21.15.22:0/1956233131 >> 172.21.15.22:0/1956233131 conn(0x5578dcfbf960 msgr2=0x5578dcfcb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.364+0000 7f6815ffb640 0 client.25448 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.365+0000 7f68379d0740 1 -- 172.21.15.22:0/1956233131 shutdown_connections 2024-08-20T01:33:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.365+0000 7f68379d0740 1 -- 172.21.15.22:0/1956233131 wait complete. 2024-08-20T01:33:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.367+0000 7f68379d0740 20 client.25448 trim_cache size 0 max 16384 2024-08-20T01:33:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:33:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:33:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:33:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:33:35.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:35 smithi022 ceph-mon[18709]: pgmap v419: 97 pgs: 97 active+clean; 382 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.2 MiB/s wr, 551 op/s 2024-08-20T01:33:35.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.410+0000 7f682f59e640 1 -- 172.21.15.22:0/3027435295 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f68180b3de0 msgr2=0x7f68180b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:35.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.410+0000 7f682f59e640 1 --2- 172.21.15.22:0/3027435295 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f68180b3de0 0x7f68180b62a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f68280a8370 tx=0x7f682800bf10 comp rx=0 tx=0).stop 2024-08-20T01:33:35.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.410+0000 7f682f59e640 1 -- 172.21.15.22:0/3027435295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68300741d0 msgr2=0x7f68301a75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:35.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.410+0000 7f682f59e640 1 --2- 172.21.15.22:0/3027435295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68300741d0 0x7f68301a75a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f682800db80 tx=0x7f682800b630 comp rx=0 tx=0).stop 2024-08-20T01:33:35.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.411+0000 7f682f59e640 1 -- 172.21.15.22:0/3027435295 shutdown_connections 2024-08-20T01:33:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.411+0000 7f682f59e640 1 --2- 172.21.15.22:0/3027435295 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f68180b3de0 0x7f68180b62a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.411+0000 7f682f59e640 1 --2- 172.21.15.22:0/3027435295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f683010aa30 0x7f68301a8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.411+0000 7f682f59e640 1 --2- 172.21.15.22:0/3027435295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f683010a0f0 0x7f68301a7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.411+0000 7f682f59e640 1 --2- 172.21.15.22:0/3027435295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68300741d0 0x7f68301a75a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.411+0000 7f682f59e640 1 -- 172.21.15.22:0/3027435295 >> 172.21.15.22:0/3027435295 conn(0x7f683006f550 msgr2=0x7f6830070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.411+0000 7f682f59e640 1 -- 172.21.15.22:0/3027435295 shutdown_connections 2024-08-20T01:33:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:35.413+0000 7f682f59e640 1 -- 172.21.15.22:0/3027435295 wait complete. 2024-08-20T01:33:35.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:35 smithi134 ceph-mon[22511]: pgmap v419: 97 pgs: 97 active+clean; 382 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.2 MiB/s wr, 551 op/s 2024-08-20T01:33:35.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:35 smithi077 ceph-mon[22251]: pgmap v419: 97 pgs: 97 active+clean; 382 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.2 MiB/s wr, 551 op/s 2024-08-20T01:33:37.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:37 smithi022 ceph-mon[18709]: pgmap v420: 97 pgs: 97 active+clean; 401 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.8 MiB/s wr, 676 op/s 2024-08-20T01:33:37.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:37 smithi022 ceph-mon[18709]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:33:37.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:37 smithi134 ceph-mon[22511]: pgmap v420: 97 pgs: 97 active+clean; 401 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.8 MiB/s wr, 676 op/s 2024-08-20T01:33:37.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:37 smithi134 ceph-mon[22511]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:33:37.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:37 smithi077 ceph-mon[22251]: pgmap v420: 97 pgs: 97 active+clean; 401 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.8 MiB/s wr, 676 op/s 2024-08-20T01:33:37.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:37 smithi077 ceph-mon[22251]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:33:39.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:39 smithi022 ceph-mon[18709]: pgmap v421: 97 pgs: 97 active+clean; 415 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 7.1 MiB/s wr, 1.11k op/s 2024-08-20T01:33:39.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:39 smithi134 ceph-mon[22511]: pgmap v421: 97 pgs: 97 active+clean; 415 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 7.1 MiB/s wr, 1.11k op/s 2024-08-20T01:33:39.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:39 smithi077 ceph-mon[22251]: pgmap v421: 97 pgs: 97 active+clean; 415 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 7.1 MiB/s wr, 1.11k op/s 2024-08-20T01:33:40.022 INFO:tasks.workunit.client.0.smithi022.stdout: 178 1724970 1136 1215171 823 513208 1529 2024-08-20T01:33:41.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:41 smithi022 ceph-mon[18709]: pgmap v422: 97 pgs: 97 active+clean; 419 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.4 MiB/s wr, 1.09k op/s 2024-08-20T01:33:41.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:41 smithi134 ceph-mon[22511]: pgmap v422: 97 pgs: 97 active+clean; 419 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.4 MiB/s wr, 1.09k op/s 2024-08-20T01:33:41.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:41 smithi077 ceph-mon[22251]: pgmap v422: 97 pgs: 97 active+clean; 419 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.4 MiB/s wr, 1.09k op/s 2024-08-20T01:33:43.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:43 smithi022 ceph-mon[18709]: pgmap v423: 97 pgs: 97 active+clean; 563 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 19 MiB/s wr, 1.85k op/s 2024-08-20T01:33:43.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:43 smithi134 ceph-mon[22511]: pgmap v423: 97 pgs: 97 active+clean; 563 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 19 MiB/s wr, 1.85k op/s 2024-08-20T01:33:43.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:43 smithi077 ceph-mon[22251]: pgmap v423: 97 pgs: 97 active+clean; 563 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 19 MiB/s wr, 1.85k op/s 2024-08-20T01:33:45.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:45 smithi022 ceph-mon[18709]: pgmap v424: 97 pgs: 97 active+clean; 592 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 21 MiB/s wr, 1.88k op/s 2024-08-20T01:33:45.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:45 smithi134 ceph-mon[22511]: pgmap v424: 97 pgs: 97 active+clean; 592 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 21 MiB/s wr, 1.88k op/s 2024-08-20T01:33:45.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:45 smithi077 ceph-mon[22251]: pgmap v424: 97 pgs: 97 active+clean; 592 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 21 MiB/s wr, 1.88k op/s 2024-08-20T01:33:47.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:47 smithi022 ceph-mon[18709]: pgmap v425: 97 pgs: 97 active+clean; 602 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 21 MiB/s wr, 1.94k op/s 2024-08-20T01:33:47.515 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:47 smithi134 ceph-mon[22511]: pgmap v425: 97 pgs: 97 active+clean; 602 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 21 MiB/s wr, 1.94k op/s 2024-08-20T01:33:47.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:47 smithi077 ceph-mon[22251]: pgmap v425: 97 pgs: 97 active+clean; 602 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 21 MiB/s wr, 1.94k op/s 2024-08-20T01:33:49.127 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:33:49.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:49 smithi022 ceph-mon[18709]: pgmap v426: 97 pgs: 97 active+clean; 609 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 21 MiB/s wr, 1.74k op/s 2024-08-20T01:33:49.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:49 smithi134 ceph-mon[22511]: pgmap v426: 97 pgs: 97 active+clean; 609 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 21 MiB/s wr, 1.74k op/s 2024-08-20T01:33:49.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:49 smithi077 ceph-mon[22251]: pgmap v426: 97 pgs: 97 active+clean; 609 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 21 MiB/s wr, 1.74k op/s 2024-08-20T01:33:50.022 INFO:tasks.workunit.client.0.smithi022.stdout: 200 1797611 1214 1290606 1262 545434 1394 2024-08-20T01:33:50.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:50 smithi134 ceph-mon[22511]: pgmap v427: 97 pgs: 97 active+clean; 608 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 18 MiB/s wr, 1.20k op/s 2024-08-20T01:33:50.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:50 smithi077 ceph-mon[22251]: pgmap v427: 97 pgs: 97 active+clean; 608 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 18 MiB/s wr, 1.20k op/s 2024-08-20T01:33:50.638 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:50 smithi022 ceph-mon[18709]: pgmap v427: 97 pgs: 97 active+clean; 608 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 18 MiB/s wr, 1.20k op/s 2024-08-20T01:33:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.914+0000 7f0812116640 1 -- 172.21.15.22:0/3525512224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f080c074230 msgr2=0x7f080c119dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.914+0000 7f0812116640 1 --2- 172.21.15.22:0/3525512224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f080c074230 0x7f080c119dc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009900 tx=0x7f07fc02a420 comp rx=0 tx=0).stop 2024-08-20T01:33:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.915+0000 7f0812116640 1 -- 172.21.15.22:0/3525512224 shutdown_connections 2024-08-20T01:33:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.915+0000 7f0812116640 1 --2- 172.21.15.22:0/3525512224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f080c074230 0x7f080c119dc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.915+0000 7f0812116640 1 --2- 172.21.15.22:0/3525512224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f080c10aa30 0x7f080c073b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.915+0000 7f0812116640 1 --2- 172.21.15.22:0/3525512224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f080c10a0f0 0x7f080c10a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.915+0000 7f0812116640 1 -- 172.21.15.22:0/3525512224 >> 172.21.15.22:0/3525512224 conn(0x7f080c06f580 msgr2=0x7f080c0719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.919+0000 7f0812116640 1 -- 172.21.15.22:0/3525512224 shutdown_connections 2024-08-20T01:33:50.926 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.921+0000 7f0812116640 1 -- 172.21.15.22:0/3525512224 wait complete. 2024-08-20T01:33:50.926 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.922+0000 7f0812116640 1 Processor -- start 2024-08-20T01:33:50.929 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.926+0000 7f0812116640 1 -- start start 2024-08-20T01:33:50.929 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.927+0000 7f0812116640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f080c10a0f0 0x7f080c116300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:50.929 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.927+0000 7f0812116640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f080c10aa30 0x7f080c116950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:50.929 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.927+0000 7f0812116640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f080c117580 0x7f080c117a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:50.929 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.927+0000 7f0812116640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f080c11cf90 con 0x7f080c117580 2024-08-20T01:33:50.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.927+0000 7f0812116640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f080c11ce10 con 0x7f080c10a0f0 2024-08-20T01:33:50.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.927+0000 7f0812116640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f080c11d110 con 0x7f080c10aa30 2024-08-20T01:33:50.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.927+0000 7f080b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f080c10a0f0 0x7f080c116300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:50.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.927+0000 7f080b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f080c10a0f0 0x7f080c116300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:34556/0 (socket says 172.21.15.22:34556) 2024-08-20T01:33:50.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.927+0000 7f080b7fe640 1 -- 172.21.15.22:0/1923344054 learned_addr learned my addr 172.21.15.22:0/1923344054 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:50.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.927+0000 7f080bfff640 1 --2- 172.21.15.22:0/1923344054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f080c117580 0x7f080c117a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:50.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.928+0000 7f080bfff640 1 -- 172.21.15.22:0/1923344054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f080c10aa30 msgr2=0x7f080c116950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T01:33:50.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.928+0000 7f080bfff640 1 --2- 172.21.15.22:0/1923344054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f080c10aa30 0x7f080c116950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:50.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.928+0000 7f080bfff640 1 -- 172.21.15.22:0/1923344054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f080c10a0f0 msgr2=0x7f080c116300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:50.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.928+0000 7f080bfff640 1 --2- 172.21.15.22:0/1923344054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f080c10a0f0 0x7f080c116300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:50.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.928+0000 7f080bfff640 1 -- 172.21.15.22:0/1923344054 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080c118230 con 0x7f080c117580 2024-08-20T01:33:50.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.929+0000 7f080bfff640 1 --2- 172.21.15.22:0/1923344054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f080c117580 0x7f080c117a30 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f07fc034040 tx=0x7f07fc003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:50.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.965+0000 7f0808ff9640 1 -- 172.21.15.22:0/1923344054 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc03e030 con 0x7f080c117580 2024-08-20T01:33:50.970 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.967+0000 7f0812116640 1 -- 172.21.15.22:0/1923344054 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f080c1185f0 con 0x7f080c117580 2024-08-20T01:33:50.971 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.967+0000 7f0812116640 1 -- 172.21.15.22:0/1923344054 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f080c118b90 con 0x7f080c117580 2024-08-20T01:33:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.982+0000 7f0814fdf740 1 Processor -- start 2024-08-20T01:33:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.983+0000 7f0814fdf740 1 -- start start 2024-08-20T01:33:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.983+0000 7f0814fdf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac03c810 0x55bfac03ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:50.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.984+0000 7f0814fdf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac03f140 0x55bfac041530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:50.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.984+0000 7f080affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac03c810 0x55bfac03ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:50.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.984+0000 7f080affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac03c810 0x55bfac03ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:34570/0 (socket says 172.21.15.22:34570) 2024-08-20T01:33:50.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.985+0000 7f080b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac03f140 0x55bfac041530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:50.987 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.985+0000 7f080b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac03f140 0x55bfac041530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51420/0 (socket says 172.21.15.22:51420) 2024-08-20T01:33:50.987 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.985+0000 7f080affd640 1 -- 172.21.15.22:0/2460866203 learned_addr learned my addr 172.21.15.22:0/2460866203 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:50.987 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.985+0000 7f0814fdf740 1 --2- 172.21.15.22:0/2460866203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac041b80 0x55bfac044040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:50.987 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.985+0000 7f0814fdf740 1 -- 172.21.15.22:0/2460866203 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55bfabfaf360 con 0x55bfac03f140 2024-08-20T01:33:50.987 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.985+0000 7f0814fdf740 1 -- 172.21.15.22:0/2460866203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55bfabf9e860 con 0x55bfac03c810 2024-08-20T01:33:50.987 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.985+0000 7f0814fdf740 1 -- 172.21.15.22:0/2460866203 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bfabfa28a0 con 0x55bfac041b80 2024-08-20T01:33:50.987 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.986+0000 7f080affd640 1 --2- 172.21.15.22:0/2460866203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac041b80 0x55bfac044040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:50.988 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.986+0000 7f080b7fe640 1 -- 172.21.15.22:0/2460866203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac041b80 msgr2=0x55bfac044040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:50.989 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.986+0000 7f080b7fe640 1 --2- 172.21.15.22:0/2460866203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac041b80 0x55bfac044040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:50.989 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.986+0000 7f080b7fe640 1 -- 172.21.15.22:0/2460866203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac03c810 msgr2=0x55bfac03ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:50.989 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.986+0000 7f080b7fe640 1 --2- 172.21.15.22:0/2460866203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac03c810 0x55bfac03ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:50.989 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.986+0000 7f080b7fe640 1 -- 172.21.15.22:0/2460866203 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfabf45e40 con 0x55bfac03f140 2024-08-20T01:33:50.989 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.987+0000 7f080affd640 1 --2- 172.21.15.22:0/2460866203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac03c810 0x55bfac03ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:50.989 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.987+0000 7f080b7fe640 1 --2- 172.21.15.22:0/2460866203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac03f140 0x55bfac041530 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0800007780 tx=0x7f0800007c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf68be066d8712e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.995+0000 7f0808ff9640 1 -- 172.21.15.22:0/1923344054 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07fc031a50 con 0x7f080c117580 2024-08-20T01:33:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.995+0000 7f0808ff9640 1 -- 172.21.15.22:0/1923344054 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc035040 con 0x7f080c117580 2024-08-20T01:33:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:50.995+0000 7f0808ff9640 1 -- 172.21.15.22:0/1923344054 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f07fc041030 con 0x7f080c117580 2024-08-20T01:33:51.006 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.004+0000 7f0808ff9640 1 --2- 172.21.15.22:0/1923344054 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f07f40b3e00 0x7f07f40b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:51.006 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.005+0000 7f080affd640 1 --2- 172.21.15.22:0/1923344054 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f07f40b3e00 0x7f07f40b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:51.006 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.005+0000 7f0808ff9640 1 -- 172.21.15.22:0/1923344054 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f07fc104b90 con 0x7f080c117580 2024-08-20T01:33:51.007 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.005+0000 7f080affd640 1 --2- 172.21.15.22:0/1923344054 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f07f40b3e00 0x7f07f40b62c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0804009fd0 tx=0x7f0804014040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.015+0000 7f07f1ffb640 1 -- 172.21.15.22:0/2460866203 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080000d950 con 0x55bfac03f140 2024-08-20T01:33:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.015+0000 7f07f1ffb640 1 -- 172.21.15.22:0/2460866203 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0800018070 con 0x55bfac03f140 2024-08-20T01:33:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.020+0000 7f0814fdf740 1 -- 172.21.15.22:0/2460866203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac03f140 msgr2=0x55bfac041530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.020+0000 7f0814fdf740 1 --2- 172.21.15.22:0/2460866203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac03f140 0x55bfac041530 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0800007780 tx=0x7f0800007c40 comp rx=0 tx=0).stop 2024-08-20T01:33:51.033 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.030+0000 7f0814fdf740 1 -- 172.21.15.22:0/2460866203 shutdown_connections 2024-08-20T01:33:51.033 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.030+0000 7f0814fdf740 1 --2- 172.21.15.22:0/2460866203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac041b80 0x55bfac044040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:51.033 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.030+0000 7f0814fdf740 1 --2- 172.21.15.22:0/2460866203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac03f140 0x55bfac041530 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:51.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.030+0000 7f0814fdf740 1 --2- 172.21.15.22:0/2460866203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac03c810 0x55bfac03ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:51.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.030+0000 7f0814fdf740 1 -- 172.21.15.22:0/2460866203 >> 172.21.15.22:0/2460866203 conn(0x55bfac037960 msgr2=0x55bfac0386f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.041+0000 7f0814fdf740 1 -- 172.21.15.22:0/2460866203 shutdown_connections 2024-08-20T01:33:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.041+0000 7f0814fdf740 1 -- 172.21.15.22:0/2460866203 wait complete. 2024-08-20T01:33:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.042+0000 7f0814fdf740 1 -- start start 2024-08-20T01:33:51.044 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.042+0000 7f0814fdf740 1 Processor -- start 2024-08-20T01:33:51.046 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.043+0000 7f0814fdf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac03c810 0x55bfac045ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:51.046 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.043+0000 7f0814fdf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac041b80 0x55bfac046690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:51.046 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.043+0000 7f0814fdf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac047240 0x55bfac0476c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:51.046 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.043+0000 7f0814fdf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55bfabed7ab0 con 0x55bfac03c810 2024-08-20T01:33:51.046 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.043+0000 7f0814fdf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55bfabf25780 con 0x55bfac041b80 2024-08-20T01:33:51.047 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.043+0000 7f0814fdf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bfac044bb0 con 0x55bfac047240 2024-08-20T01:33:51.047 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.043+0000 7f0814fdf740 10 client.0 _ll_register_callbacks cb 0x55bfabcada00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:51.047 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.043+0000 7f080affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac041b80 0x55bfac046690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:51.047 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.043+0000 7f080affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac041b80 0x55bfac046690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:34582/0 (socket says 172.21.15.22:34582) 2024-08-20T01:33:51.047 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.043+0000 7f080affd640 1 -- 172.21.15.22:0/3523225722 learned_addr learned my addr 172.21.15.22:0/3523225722 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:51.047 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.043+0000 7f080b7fe640 1 --2- 172.21.15.22:0/3523225722 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac03c810 0x55bfac045ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:51.047 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.044+0000 7f080bfff640 1 --2- 172.21.15.22:0/3523225722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac047240 0x55bfac0476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:51.048 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.044+0000 7f080bfff640 1 -- 172.21.15.22:0/3523225722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac041b80 msgr2=0x55bfac046690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:51.048 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.044+0000 7f080bfff640 1 --2- 172.21.15.22:0/3523225722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac041b80 0x55bfac046690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:51.048 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.044+0000 7f080bfff640 1 -- 172.21.15.22:0/3523225722 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac03c810 msgr2=0x55bfac045ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:51.048 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.044+0000 7f080bfff640 1 --2- 172.21.15.22:0/3523225722 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac03c810 0x55bfac045ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:51.048 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.044+0000 7f080bfff640 1 -- 172.21.15.22:0/3523225722 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfabd01790 con 0x55bfac047240 2024-08-20T01:33:51.048 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.044+0000 7f080affd640 1 --2- 172.21.15.22:0/3523225722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac041b80 0x55bfac046690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:51.048 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.044+0000 7f080b7fe640 1 --2- 172.21.15.22:0/3523225722 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac03c810 0x55bfac045ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:51.048 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.044+0000 7f080bfff640 1 --2- 172.21.15.22:0/3523225722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac047240 0x55bfac0476c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f07fc102670 tx=0x7f07fc0cb690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbe2388d52583370 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:51.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.078+0000 7f07eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:33:51.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.078+0000 7f07eaffd640 1 -- 172.21.15.22:0/3523225722 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc048040 con 0x55bfac047240 2024-08-20T01:33:51.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.078+0000 7f0814fdf740 1 -- 172.21.15.22:0/3523225722 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bfabf4de00 con 0x55bfac047240 2024-08-20T01:33:51.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.078+0000 7f07eaffd640 1 -- 172.21.15.22:0/3523225722 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f07fc009400 con 0x55bfac047240 2024-08-20T01:33:51.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.079+0000 7f07eaffd640 1 -- 172.21.15.22:0/3523225722 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f07fc0d00c0 con 0x55bfac047240 2024-08-20T01:33:51.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.079+0000 7f0814fdf740 10 client.25474 fetch_fsmap learned FSMap version 29 2024-08-20T01:33:51.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.079+0000 7f0814fdf740 1 -- 172.21.15.22:0/3523225722 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bfabd7a620 con 0x55bfac047240 2024-08-20T01:33:51.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.080+0000 7f07eaffd640 1 -- 172.21.15.22:0/3523225722 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55bfabf4de00 con 0x55bfac047240 2024-08-20T01:33:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.082+0000 7f07eaffd640 1 -- 172.21.15.22:0/3523225722 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f07fc031c00 con 0x55bfac047240 2024-08-20T01:33:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.083+0000 7f0814fdf740 10 client.25474 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:33:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.083+0000 7f0814fdf740 10 client.25474 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:33:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.083+0000 7f0814fdf740 20 client.25474 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.083+0000 7f0814fdf740 1 --2- 172.21.15.22:0/3523225722 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55bfac051f10 0x55bfac054390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.083+0000 7f0814fdf740 4 client.25474 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:33:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.083+0000 7f0814fdf740 1 -- 172.21.15.22:0/3523225722 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfabfb12b0 con 0x55bfac051f10 2024-08-20T01:33:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.083+0000 7f080b7fe640 1 --2- 172.21.15.22:0/3523225722 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55bfac051f10 0x55bfac054390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.086+0000 7f080b7fe640 1 --2- 172.21.15.22:0/3523225722 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55bfac051f10 0x55bfac054390 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfd192d330b97d96 server_cookie=dff67be6deaa7bfe in_seq=0 out_seq=0 2024-08-20T01:33:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.086+0000 7f07eaffd640 10 client.25474 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:51.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.091+0000 7f07eaffd640 1 -- 172.21.15.22:0/3523225722 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bfabfb12b0 con 0x55bfac051f10 2024-08-20T01:33:51.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.091+0000 7f07eaffd640 10 client.25474 handle_command_reply: tid=0 2024-08-20T01:33:51.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.091+0000 7f0814fdf740 1 client.25474 shutdown 2024-08-20T01:33:51.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.094+0000 7f0814fdf740 1 -- 172.21.15.22:0/3523225722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac047240 msgr2=0x55bfac0476c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:51.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.094+0000 7f0814fdf740 1 --2- 172.21.15.22:0/3523225722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac047240 0x55bfac0476c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f07fc102670 tx=0x7f07fc0cb690 comp rx=0 tx=0).stop 2024-08-20T01:33:51.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.094+0000 7f0814fdf740 1 -- 172.21.15.22:0/3523225722 shutdown_connections 2024-08-20T01:33:51.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.094+0000 7f0814fdf740 1 --2- 172.21.15.22:0/3523225722 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55bfac051f10 0x55bfac054390 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:51.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.094+0000 7f0814fdf740 1 --2- 172.21.15.22:0/3523225722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac047240 0x55bfac0476c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:51.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.094+0000 7f0814fdf740 1 --2- 172.21.15.22:0/3523225722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac041b80 0x55bfac046690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:51.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.094+0000 7f0814fdf740 1 --2- 172.21.15.22:0/3523225722 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac03c810 0x55bfac045ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:51.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.094+0000 7f0814fdf740 1 -- 172.21.15.22:0/3523225722 >> 172.21.15.22:0/3523225722 conn(0x55bfac037960 msgr2=0x55bfac036a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:51.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.094+0000 7f07eaffd640 0 client.25474 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:51.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.094+0000 7f0814fdf740 1 -- 172.21.15.22:0/3523225722 shutdown_connections 2024-08-20T01:33:51.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.094+0000 7f0814fdf740 1 -- 172.21.15.22:0/3523225722 wait complete. 2024-08-20T01:33:51.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.095+0000 7f0814fdf740 20 client.25474 trim_cache size 0 max 16384 2024-08-20T01:33:51.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.440+0000 7f0814fdf740 1 Processor -- start 2024-08-20T01:33:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.463+0000 7f0814fdf740 1 -- start start 2024-08-20T01:33:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.463+0000 7f0814fdf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac03c810 0x55bfac032a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.463+0000 7f0814fdf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac041b80 0x55bfac03d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.464+0000 7f080b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac03c810 0x55bfac032a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.464+0000 7f080b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac03c810 0x55bfac032a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:34598/0 (socket says 172.21.15.22:34598) 2024-08-20T01:33:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.464+0000 7f080affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac041b80 0x55bfac03d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.464+0000 7f080affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac041b80 0x55bfac03d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51432/0 (socket says 172.21.15.22:51432) 2024-08-20T01:33:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.464+0000 7f0814fdf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac047240 0x55bfac03dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.464+0000 7f080affd640 1 -- 172.21.15.22:0/2924363647 learned_addr learned my addr 172.21.15.22:0/2924363647 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.464+0000 7f0814fdf740 1 -- 172.21.15.22:0/2924363647 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f07f8010e50 con 0x55bfac041b80 2024-08-20T01:33:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.464+0000 7f0814fdf740 1 -- 172.21.15.22:0/2924363647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f07f800e6c0 con 0x55bfac03c810 2024-08-20T01:33:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.464+0000 7f0814fdf740 1 -- 172.21.15.22:0/2924363647 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f07f800c5c0 con 0x55bfac047240 2024-08-20T01:33:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.464+0000 7f080bfff640 1 --2- 172.21.15.22:0/2924363647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac047240 0x55bfac03dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.464+0000 7f080b7fe640 1 -- 172.21.15.22:0/2924363647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac047240 msgr2=0x55bfac03dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.464+0000 7f080b7fe640 1 --2- 172.21.15.22:0/2924363647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac047240 0x55bfac03dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.465+0000 7f080b7fe640 1 -- 172.21.15.22:0/2924363647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac041b80 msgr2=0x55bfac03d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.465+0000 7f080b7fe640 1 --2- 172.21.15.22:0/2924363647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac041b80 0x55bfac03d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.465+0000 7f080b7fe640 1 -- 172.21.15.22:0/2924363647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfac046a00 con 0x55bfac03c810 2024-08-20T01:33:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.465+0000 7f080bfff640 1 --2- 172.21.15.22:0/2924363647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac047240 0x55bfac03dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:33:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.465+0000 7f080affd640 1 --2- 172.21.15.22:0/2924363647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac041b80 0x55bfac03d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.466+0000 7f080b7fe640 1 --2- 172.21.15.22:0/2924363647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac03c810 0x55bfac032a80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55bfac054c40 tx=0x7f0800007f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3216cfe3a6fa38f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.467+0000 7f07f17fa640 1 -- 172.21.15.22:0/2924363647 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800029070 con 0x55bfac03c810 2024-08-20T01:33:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.467+0000 7f07f17fa640 1 -- 172.21.15.22:0/2924363647 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0800018040 con 0x55bfac03c810 2024-08-20T01:33:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.467+0000 7f07f17fa640 1 -- 172.21.15.22:0/2924363647 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800003690 con 0x55bfac03c810 2024-08-20T01:33:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.470+0000 7f0814fdf740 1 -- 172.21.15.22:0/2924363647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac03c810 msgr2=0x55bfac032a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.470+0000 7f0814fdf740 1 --2- 172.21.15.22:0/2924363647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac03c810 0x55bfac032a80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55bfac054c40 tx=0x7f0800007f30 comp rx=0 tx=0).stop 2024-08-20T01:33:51.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.494+0000 7f0814fdf740 1 -- 172.21.15.22:0/2924363647 shutdown_connections 2024-08-20T01:33:51.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.494+0000 7f0814fdf740 1 --2- 172.21.15.22:0/2924363647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac047240 0x55bfac03dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:51.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.494+0000 7f0814fdf740 1 --2- 172.21.15.22:0/2924363647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac041b80 0x55bfac03d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:51.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.494+0000 7f0814fdf740 1 --2- 172.21.15.22:0/2924363647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac03c810 0x55bfac032a80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:51.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.494+0000 7f0814fdf740 1 -- 172.21.15.22:0/2924363647 >> 172.21.15.22:0/2924363647 conn(0x55bfac037960 msgr2=0x55bfac053f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:51.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.495+0000 7f0814fdf740 1 -- 172.21.15.22:0/2924363647 shutdown_connections 2024-08-20T01:33:51.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.495+0000 7f0814fdf740 1 -- 172.21.15.22:0/2924363647 wait complete. 2024-08-20T01:33:51.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.496+0000 7f0814fdf740 1 -- start start 2024-08-20T01:33:51.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.496+0000 7f0814fdf740 1 Processor -- start 2024-08-20T01:33:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.497+0000 7f0814fdf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac03c810 0x55bfac04a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.497+0000 7f0814fdf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac041b80 0x55bfac04ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.497+0000 7f080b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac03c810 0x55bfac04a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.497+0000 7f080b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac03c810 0x55bfac04a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:42702/0 (socket says 172.21.15.22:42702) 2024-08-20T01:33:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.497+0000 7f080b7fe640 1 -- 172.21.15.22:0/3092508424 learned_addr learned my addr 172.21.15.22:0/3092508424 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.498+0000 7f080affd640 1 --2- 172.21.15.22:0/3092508424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac041b80 0x55bfac04ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.498+0000 7f0814fdf740 1 --2- 172.21.15.22:0/3092508424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac047240 0x55bfac04b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.498+0000 7f0814fdf740 1 -- 172.21.15.22:0/3092508424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f07f800cb80 con 0x55bfac047240 2024-08-20T01:33:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.498+0000 7f0814fdf740 1 -- 172.21.15.22:0/3092508424 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f07f800dff0 con 0x55bfac041b80 2024-08-20T01:33:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.498+0000 7f080bfff640 1 --2- 172.21.15.22:0/3092508424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac047240 0x55bfac04b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.498+0000 7f0814fdf740 1 -- 172.21.15.22:0/3092508424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f07f800d250 con 0x55bfac03c810 2024-08-20T01:33:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.499+0000 7f080b7fe640 1 -- 172.21.15.22:0/3092508424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac041b80 msgr2=0x55bfac04ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.499+0000 7f080b7fe640 1 --2- 172.21.15.22:0/3092508424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac041b80 0x55bfac04ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.499+0000 7f080b7fe640 1 -- 172.21.15.22:0/3092508424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac047240 msgr2=0x55bfac04b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.499+0000 7f0814fdf740 10 client.0 _ll_register_callbacks cb 0x7f07fc0c7980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.499+0000 7f080b7fe640 1 --2- 172.21.15.22:0/3092508424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac047240 0x55bfac04b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.499+0000 7f080b7fe640 1 -- 172.21.15.22:0/3092508424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfac04c000 con 0x55bfac03c810 2024-08-20T01:33:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.499+0000 7f080b7fe640 1 --2- 172.21.15.22:0/3092508424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac03c810 0x55bfac04a560 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0800027040 tx=0x7f0800013a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=772daba9520d1dfd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.503+0000 7f0814fdf740 1 -- 172.21.15.22:0/3092508424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0800018040 con 0x55bfac03c810 2024-08-20T01:33:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.503+0000 7f080bfff640 1 --2- 172.21.15.22:0/3092508424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac047240 0x55bfac04b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:33:51.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.518+0000 7f07eaffd640 10 client.25477 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:33:51.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.518+0000 7f07eaffd640 1 -- 172.21.15.22:0/3092508424 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800029070 con 0x55bfac03c810 2024-08-20T01:33:51.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.518+0000 7f07eaffd640 1 -- 172.21.15.22:0/3092508424 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f0800004240 con 0x55bfac03c810 2024-08-20T01:33:51.520 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.518+0000 7f07eaffd640 1 -- 172.21.15.22:0/3092508424 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0800013aa0 con 0x55bfac03c810 2024-08-20T01:33:51.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.526+0000 7f0814fdf740 10 client.25477 fetch_fsmap learned FSMap version 29 2024-08-20T01:33:51.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.526+0000 7f0814fdf740 1 -- 172.21.15.22:0/3092508424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55bfac04d1e0 con 0x55bfac03c810 2024-08-20T01:33:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.527+0000 7f07eaffd640 1 -- 172.21.15.22:0/3092508424 <== mon.1 v2:172.21.15.134:3300/0 4 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0800023070 con 0x55bfac03c810 2024-08-20T01:33:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.527+0000 7f0814fdf740 10 client.25477 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:33:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.527+0000 7f0814fdf740 10 client.25477 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:33:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.528+0000 7f0814fdf740 20 client.25477 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.528+0000 7f0814fdf740 1 --2- 172.21.15.22:0/3092508424 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55bfac04d7e0 0x55bfac04dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.528+0000 7f0814fdf740 4 client.25477 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:33:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.529+0000 7f080affd640 1 --2- 172.21.15.22:0/3092508424 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55bfac04d7e0 0x55bfac04dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.529+0000 7f0814fdf740 1 -- 172.21.15.22:0/3092508424 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bfabfacd50 con 0x55bfac04d7e0 2024-08-20T01:33:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.529+0000 7f080affd640 1 --2- 172.21.15.22:0/3092508424 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55bfac04d7e0 0x55bfac04dbf0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19aaa8f0bfc884a5 server_cookie=b21fd8ccc9285629 in_seq=0 out_seq=0 2024-08-20T01:33:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:51.529+0000 7f07eaffd640 10 client.25477 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:52.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:52 smithi134 ceph-mon[22511]: pgmap v428: 97 pgs: 97 active+clean; 614 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 18 MiB/s wr, 1.29k op/s 2024-08-20T01:33:52.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:52 smithi077 ceph-mon[22251]: pgmap v428: 97 pgs: 97 active+clean; 614 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 18 MiB/s wr, 1.29k op/s 2024-08-20T01:33:52.889 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:52 smithi022 ceph-mon[18709]: pgmap v428: 97 pgs: 97 active+clean; 614 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 18 MiB/s wr, 1.29k op/s 2024-08-20T01:33:54.451 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:33:54.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:54 smithi134 ceph-mon[22511]: pgmap v429: 97 pgs: 97 active+clean; 619 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.0 MiB/s wr, 548 op/s 2024-08-20T01:33:54.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:54 smithi077 ceph-mon[22251]: pgmap v429: 97 pgs: 97 active+clean; 619 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.0 MiB/s wr, 548 op/s 2024-08-20T01:33:54.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:54 smithi022 ceph-mon[18709]: pgmap v429: 97 pgs: 97 active+clean; 619 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.0 MiB/s wr, 548 op/s 2024-08-20T01:33:54.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.929+0000 7f07eaffd640 1 -- 172.21.15.22:0/3092508424 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bfabfacd50 con 0x55bfac04d7e0 2024-08-20T01:33:54.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.929+0000 7f07eaffd640 10 client.25477 handle_command_reply: tid=0 2024-08-20T01:33:54.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.929+0000 7f0814fdf740 1 client.25477 shutdown 2024-08-20T01:33:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.929+0000 7f0814fdf740 1 -- 172.21.15.22:0/3092508424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac03c810 msgr2=0x55bfac04a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.929+0000 7f0814fdf740 1 --2- 172.21.15.22:0/3092508424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac03c810 0x55bfac04a560 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0800027040 tx=0x7f0800013a30 comp rx=0 tx=0).stop 2024-08-20T01:33:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.929+0000 7f0814fdf740 1 -- 172.21.15.22:0/3092508424 shutdown_connections 2024-08-20T01:33:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.929+0000 7f0814fdf740 1 --2- 172.21.15.22:0/3092508424 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55bfac04d7e0 0x55bfac04dbf0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.929+0000 7f0814fdf740 1 --2- 172.21.15.22:0/3092508424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfac047240 0x55bfac04b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.929+0000 7f0814fdf740 1 --2- 172.21.15.22:0/3092508424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfac041b80 0x55bfac04ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.929+0000 7f0814fdf740 1 --2- 172.21.15.22:0/3092508424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bfac03c810 0x55bfac04a560 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.929+0000 7f0814fdf740 1 -- 172.21.15.22:0/3092508424 >> 172.21.15.22:0/3092508424 conn(0x55bfac037960 msgr2=0x55bfac03d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.929+0000 7f07eaffd640 0 client.25477 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.930+0000 7f0814fdf740 1 -- 172.21.15.22:0/3092508424 shutdown_connections 2024-08-20T01:33:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.930+0000 7f0814fdf740 1 -- 172.21.15.22:0/3092508424 wait complete. 2024-08-20T01:33:54.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.937+0000 7f0814fdf740 20 client.25477 trim_cache size 0 max 16384 2024-08-20T01:33:54.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:33:54.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:33:54.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:33:54.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:33:54.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.990+0000 7f0812116640 1 -- 172.21.15.22:0/1923344054 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f07f40b3e00 msgr2=0x7f07f40b62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:54.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.990+0000 7f0812116640 1 --2- 172.21.15.22:0/1923344054 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f07f40b3e00 0x7f07f40b62c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0804009fd0 tx=0x7f0804014040 comp rx=0 tx=0).stop 2024-08-20T01:33:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.990+0000 7f0812116640 1 -- 172.21.15.22:0/1923344054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f080c117580 msgr2=0x7f080c117a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.990+0000 7f0812116640 1 --2- 172.21.15.22:0/1923344054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f080c117580 0x7f080c117a30 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f07fc034040 tx=0x7f07fc003b90 comp rx=0 tx=0).stop 2024-08-20T01:33:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.996+0000 7f0812116640 1 -- 172.21.15.22:0/1923344054 shutdown_connections 2024-08-20T01:33:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.996+0000 7f0812116640 1 --2- 172.21.15.22:0/1923344054 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f07f40b3e00 0x7f07f40b62c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.996+0000 7f0812116640 1 --2- 172.21.15.22:0/1923344054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f080c117580 0x7f080c117a30 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.996+0000 7f0812116640 1 --2- 172.21.15.22:0/1923344054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f080c10aa30 0x7f080c116950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.996+0000 7f0812116640 1 --2- 172.21.15.22:0/1923344054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f080c10a0f0 0x7f080c116300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.996+0000 7f0812116640 1 -- 172.21.15.22:0/1923344054 >> 172.21.15.22:0/1923344054 conn(0x7f080c06f580 msgr2=0x7f080c0711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.997+0000 7f0812116640 1 -- 172.21.15.22:0/1923344054 shutdown_connections 2024-08-20T01:33:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:33:54.997+0000 7f0812116640 1 -- 172.21.15.22:0/1923344054 wait complete. 2024-08-20T01:33:55.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:55.994+0000 7fcd20a37640 1 -- 172.21.15.22:0/3785844704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd1c106a30 msgr2=0x7fcd1c106e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:55.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:55.994+0000 7fcd20a37640 1 --2- 172.21.15.22:0/3785844704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd1c106a30 0x7fcd1c106e80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009f00 tx=0x7fcd1402ab40 comp rx=0 tx=0).stop 2024-08-20T01:33:56.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:55.999+0000 7fcd20a37640 1 -- 172.21.15.22:0/3785844704 shutdown_connections 2024-08-20T01:33:56.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:55.999+0000 7fcd20a37640 1 --2- 172.21.15.22:0/3785844704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd1c106a30 0x7fcd1c106e80 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:55.999+0000 7fcd20a37640 1 --2- 172.21.15.22:0/3785844704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd1c101f10 0x7fcd1c1063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:55.999+0000 7fcd20a37640 1 --2- 172.21.15.22:0/3785844704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd1c1015f0 0x7fcd1c1019d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:55.999+0000 7fcd20a37640 1 -- 172.21.15.22:0/3785844704 >> 172.21.15.22:0/3785844704 conn(0x7fcd1c0fd2a0 msgr2=0x7fcd1c0ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:56.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.009+0000 7fcd20a37640 1 -- 172.21.15.22:0/3785844704 shutdown_connections 2024-08-20T01:33:56.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.009+0000 7fcd20a37640 1 -- 172.21.15.22:0/3785844704 wait complete. 2024-08-20T01:33:56.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.010+0000 7fcd20a37640 1 Processor -- start 2024-08-20T01:33:56.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.012+0000 7fcd20a37640 1 -- start start 2024-08-20T01:33:56.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.013+0000 7fcd20a37640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd1c1015f0 0x7fcd1c0743f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:56.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.013+0000 7fcd20a37640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd1c101f10 0x7fcd1c074930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:56.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.013+0000 7fcd20a37640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd1c106a30 0x7fcd1c06d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:56.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.013+0000 7fcd20a37640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c118f30 con 0x7fcd1c101f10 2024-08-20T01:33:56.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.013+0000 7fcd20a37640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c118db0 con 0x7fcd1c106a30 2024-08-20T01:33:56.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.013+0000 7fcd20a37640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c1190b0 con 0x7fcd1c1015f0 2024-08-20T01:33:56.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.015+0000 7fcd1a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd1c101f10 0x7fcd1c074930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:56.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.015+0000 7fcd1a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd1c101f10 0x7fcd1c074930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51454/0 (socket says 172.21.15.22:51454) 2024-08-20T01:33:56.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.015+0000 7fcd1a59c640 1 -- 172.21.15.22:0/2173683742 learned_addr learned my addr 172.21.15.22:0/2173683742 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:56.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.020+0000 7fcd1b59e640 1 --2- 172.21.15.22:0/2173683742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd1c106a30 0x7fcd1c06d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:56.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.020+0000 7fcd1ad9d640 1 --2- 172.21.15.22:0/2173683742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd1c1015f0 0x7fcd1c0743f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:56.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.024+0000 7fcd1a59c640 1 -- 172.21.15.22:0/2173683742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd1c1015f0 msgr2=0x7fcd1c0743f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:56.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.024+0000 7fcd1a59c640 1 --2- 172.21.15.22:0/2173683742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd1c1015f0 0x7fcd1c0743f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.024+0000 7fcd1a59c640 1 -- 172.21.15.22:0/2173683742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd1c106a30 msgr2=0x7fcd1c06d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:56.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.024+0000 7fcd1a59c640 1 --2- 172.21.15.22:0/2173683742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd1c106a30 0x7fcd1c06d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.024+0000 7fcd1a59c640 1 -- 172.21.15.22:0/2173683742 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1c06df60 con 0x7fcd1c101f10 2024-08-20T01:33:56.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.024+0000 7fcd1a59c640 1 --2- 172.21.15.22:0/2173683742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd1c101f10 0x7fcd1c074930 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009fd0 tx=0x7fcd1000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:56.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.025+0000 7fcd03fff640 1 -- 172.21.15.22:0/2173683742 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10015020 con 0x7fcd1c101f10 2024-08-20T01:33:56.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.025+0000 7fcd03fff640 1 -- 172.21.15.22:0/2173683742 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd10011ce0 con 0x7fcd1c101f10 2024-08-20T01:33:56.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.025+0000 7fcd03fff640 1 -- 172.21.15.22:0/2173683742 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10010e00 con 0x7fcd1c101f10 2024-08-20T01:33:56.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.025+0000 7fcd20a37640 1 -- 172.21.15.22:0/2173683742 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd1c06e250 con 0x7fcd1c101f10 2024-08-20T01:33:56.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.025+0000 7fcd20a37640 1 -- 172.21.15.22:0/2173683742 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd1c0732b0 con 0x7fcd1c101f10 2024-08-20T01:33:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.037+0000 7fcd03fff640 1 -- 172.21.15.22:0/2173683742 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcd10018020 con 0x7fcd1c101f10 2024-08-20T01:33:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.038+0000 7fcd23631740 1 Processor -- start 2024-08-20T01:33:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.038+0000 7fcd03fff640 1 --2- 172.21.15.22:0/2173683742 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcd040b3e40 0x7fcd040b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.039+0000 7fcd03fff640 1 -- 172.21.15.22:0/2173683742 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fcd100e4290 con 0x7fcd1c101f10 2024-08-20T01:33:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.040+0000 7fcd1b59e640 1 --2- 172.21.15.22:0/2173683742 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcd040b3e40 0x7fcd040b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.041+0000 7fcd1b59e640 1 --2- 172.21.15.22:0/2173683742 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcd040b3e40 0x7fcd040b6300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcd140098d0 tx=0x7fcd14005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.042+0000 7fcd23631740 1 -- start start 2024-08-20T01:33:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.042+0000 7fcd23631740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a95ecb48c0 0x55a95ecb4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.042+0000 7fcd23631740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecb51e0 0x55a95ecc0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.042+0000 7fcd23631740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecc1170 0x55a95ecc3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.042+0000 7fcd23631740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a95ec2b8e0 con 0x55a95ecc1170 2024-08-20T01:33:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.042+0000 7fcd23631740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a95ec1ade0 con 0x55a95ecb48c0 2024-08-20T01:33:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.042+0000 7fcd23631740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a95ec1ee20 con 0x55a95ecb51e0 2024-08-20T01:33:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.042+0000 7fcd1a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecb51e0 0x55a95ecc0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:56.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.042+0000 7fcd1a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecb51e0 0x55a95ecc0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:42724/0 (socket says 172.21.15.22:42724) 2024-08-20T01:33:56.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.042+0000 7fcd1a59c640 1 -- 172.21.15.22:0/3931746903 learned_addr learned my addr 172.21.15.22:0/3931746903 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:56.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.043+0000 7fcd1a59c640 1 -- 172.21.15.22:0/3931746903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a95ecb48c0 msgr2=0x55a95ecb4ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:33:56.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.043+0000 7fcd1a59c640 1 --2- 172.21.15.22:0/3931746903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a95ecb48c0 0x55a95ecb4ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.043+0000 7fcd1a59c640 1 -- 172.21.15.22:0/3931746903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecc1170 msgr2=0x55a95ecc3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:56.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.043+0000 7fcd1a59c640 1 --2- 172.21.15.22:0/3931746903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecc1170 0x55a95ecc3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.043+0000 7fcd1a59c640 1 -- 172.21.15.22:0/3931746903 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a95e97a650 con 0x55a95ecb51e0 2024-08-20T01:33:56.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.050+0000 7fcd1a59c640 1 --2- 172.21.15.22:0/3931746903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecb51e0 0x55a95ecc0c30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcd100a71c0 tx=0x7fcd100aa9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee7bf619dec83847 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:56.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.054+0000 7fcd017fa640 1 -- 172.21.15.22:0/3931746903 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd100af740 con 0x55a95ecb51e0 2024-08-20T01:33:56.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.054+0000 7fcd017fa640 1 -- 172.21.15.22:0/3931746903 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd100b41f0 con 0x55a95ecb51e0 2024-08-20T01:33:56.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.054+0000 7fcd017fa640 1 -- 172.21.15.22:0/3931746903 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd100aa3a0 con 0x55a95ecb51e0 2024-08-20T01:33:56.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.059+0000 7fcd23631740 1 -- 172.21.15.22:0/3931746903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecb51e0 msgr2=0x55a95ecc0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:56.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.059+0000 7fcd23631740 1 --2- 172.21.15.22:0/3931746903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecb51e0 0x55a95ecc0c30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcd100a71c0 tx=0x7fcd100aa9b0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.061+0000 7fcd23631740 1 -- 172.21.15.22:0/3931746903 shutdown_connections 2024-08-20T01:33:56.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.061+0000 7fcd23631740 1 --2- 172.21.15.22:0/3931746903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecc1170 0x55a95ecc3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.061+0000 7fcd23631740 1 --2- 172.21.15.22:0/3931746903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecb51e0 0x55a95ecc0c30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.061+0000 7fcd23631740 1 --2- 172.21.15.22:0/3931746903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a95ecb48c0 0x55a95ecb4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.061+0000 7fcd23631740 1 -- 172.21.15.22:0/3931746903 >> 172.21.15.22:0/3931746903 conn(0x55a95ecb26f0 msgr2=0x55a95ecb3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:56.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.067+0000 7fcd23631740 1 -- 172.21.15.22:0/3931746903 shutdown_connections 2024-08-20T01:33:56.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.069+0000 7fcd23631740 1 -- 172.21.15.22:0/3931746903 wait complete. 2024-08-20T01:33:56.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.069+0000 7fcd23631740 1 -- start start 2024-08-20T01:33:56.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.069+0000 7fcd23631740 1 Processor -- start 2024-08-20T01:33:56.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.070+0000 7fcd23631740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecb48c0 0x55a95ecbe0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:56.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.070+0000 7fcd23631740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a95ecb51e0 0x55a95ecbe610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:56.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.070+0000 7fcd23631740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecc1170 0x55a95ecbeb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:56.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.070+0000 7fcd23631740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a95ea7d700 con 0x55a95ecb48c0 2024-08-20T01:33:56.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.070+0000 7fcd23631740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a95eba17c0 con 0x55a95ecb51e0 2024-08-20T01:33:56.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.070+0000 7fcd23631740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a95ecc3e20 con 0x55a95ecc1170 2024-08-20T01:33:56.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.070+0000 7fcd23631740 10 client.0 _ll_register_callbacks cb 0x55a95ec146b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:56.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.071+0000 7fcd1b59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecc1170 0x55a95ecbeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:56.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.071+0000 7fcd1b59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecc1170 0x55a95ecbeb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:42726/0 (socket says 172.21.15.22:42726) 2024-08-20T01:33:56.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.071+0000 7fcd1b59e640 1 -- 172.21.15.22:0/3024124623 learned_addr learned my addr 172.21.15.22:0/3024124623 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:56.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.073+0000 7fcd1b59e640 1 -- 172.21.15.22:0/3024124623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a95ecb51e0 msgr2=0x55a95ecbe610 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:33:56.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.073+0000 7fcd1b59e640 1 --2- 172.21.15.22:0/3024124623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a95ecb51e0 0x55a95ecbe610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.073+0000 7fcd1b59e640 1 -- 172.21.15.22:0/3024124623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecb48c0 msgr2=0x55a95ecbe0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:56.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.073+0000 7fcd1b59e640 1 --2- 172.21.15.22:0/3024124623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecb48c0 0x55a95ecbe0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.073+0000 7fcd1b59e640 1 -- 172.21.15.22:0/3024124623 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a95eccd230 con 0x55a95ecc1170 2024-08-20T01:33:56.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.074+0000 7fcd1b59e640 1 --2- 172.21.15.22:0/3024124623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecc1170 0x55a95ecbeb50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009e50 tx=0x7fcd1402df90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=491a5a349dc84242 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:56.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.074+0000 7fccfeff5640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:33:56.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.074+0000 7fccfeff5640 1 -- 172.21.15.22:0/3024124623 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd14052060 con 0x55a95ecc1170 2024-08-20T01:33:56.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.074+0000 7fcd23631740 1 -- 172.21.15.22:0/3024124623 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a95ebca100 con 0x55a95ecc1170 2024-08-20T01:33:56.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.075+0000 7fccfeff5640 1 -- 172.21.15.22:0/3024124623 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fcd14004720 con 0x55a95ecc1170 2024-08-20T01:33:56.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.075+0000 7fccfeff5640 1 -- 172.21.15.22:0/3024124623 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcd1404d470 con 0x55a95ecc1170 2024-08-20T01:33:56.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.077+0000 7fcd23631740 10 client.25486 fetch_fsmap learned FSMap version 29 2024-08-20T01:33:56.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.077+0000 7fcd23631740 1 -- 172.21.15.22:0/3024124623 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a95eccfc10 con 0x55a95ecc1170 2024-08-20T01:33:56.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.078+0000 7fccfeff5640 1 -- 172.21.15.22:0/3024124623 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a95ebca100 con 0x55a95ecc1170 2024-08-20T01:33:56.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.079+0000 7fccfeff5640 1 -- 172.21.15.22:0/3024124623 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fcd14042630 con 0x55a95ecc1170 2024-08-20T01:33:56.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.081+0000 7fcd23631740 10 client.25486 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:33:56.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.081+0000 7fcd23631740 10 client.25486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:33:56.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.081+0000 7fcd23631740 20 client.25486 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:56.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.081+0000 7fcd23631740 1 --2- 172.21.15.22:0/3024124623 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a95ecd1170 0x55a95ecd35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:56.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.081+0000 7fcd23631740 4 client.25486 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:33:56.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.081+0000 7fcd23631740 1 -- 172.21.15.22:0/3024124623 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a95ec2d830 con 0x55a95ecd1170 2024-08-20T01:33:56.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.085+0000 7fcd1ad9d640 1 --2- 172.21.15.22:0/3024124623 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a95ecd1170 0x55a95ecd35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:56.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.098+0000 7fcd1ad9d640 1 --2- 172.21.15.22:0/3024124623 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a95ecd1170 0x55a95ecd35a0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c208dbfe9f262a96 server_cookie=46a9b1d5430eb5a6 in_seq=0 out_seq=0 2024-08-20T01:33:56.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.112+0000 7fccfeff5640 10 client.25486 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:56.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.112+0000 7fccfeff5640 1 -- 172.21.15.22:0/3024124623 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a95ec2d830 con 0x55a95ecd1170 2024-08-20T01:33:56.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.112+0000 7fccfeff5640 10 client.25486 handle_command_reply: tid=0 2024-08-20T01:33:56.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.112+0000 7fcd23631740 1 client.25486 shutdown 2024-08-20T01:33:56.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.115+0000 7fcd23631740 1 -- 172.21.15.22:0/3024124623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecc1170 msgr2=0x55a95ecbeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:56.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.115+0000 7fcd23631740 1 --2- 172.21.15.22:0/3024124623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecc1170 0x55a95ecbeb50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009e50 tx=0x7fcd1402df90 comp rx=0 tx=0).stop 2024-08-20T01:33:56.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.118+0000 7fcd23631740 1 -- 172.21.15.22:0/3024124623 shutdown_connections 2024-08-20T01:33:56.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.118+0000 7fcd23631740 1 --2- 172.21.15.22:0/3024124623 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a95ecd1170 0x55a95ecd35a0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.118+0000 7fcd23631740 1 --2- 172.21.15.22:0/3024124623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecc1170 0x55a95ecbeb50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.118+0000 7fcd23631740 1 --2- 172.21.15.22:0/3024124623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a95ecb51e0 0x55a95ecbe610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.118+0000 7fcd23631740 1 --2- 172.21.15.22:0/3024124623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecb48c0 0x55a95ecbe0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.118+0000 7fcd23631740 1 -- 172.21.15.22:0/3024124623 >> 172.21.15.22:0/3024124623 conn(0x55a95ecb26f0 msgr2=0x55a95ecb8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:56.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.118+0000 7fccfeff5640 0 client.25486 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:56.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.119+0000 7fcd23631740 1 -- 172.21.15.22:0/3024124623 shutdown_connections 2024-08-20T01:33:56.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.120+0000 7fcd23631740 1 -- 172.21.15.22:0/3024124623 wait complete. 2024-08-20T01:33:56.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.123+0000 7fcd23631740 20 client.25486 trim_cache size 0 max 16384 2024-08-20T01:33:56.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.180+0000 7fcd23631740 1 Processor -- start 2024-08-20T01:33:56.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.180+0000 7fcd23631740 1 -- start start 2024-08-20T01:33:56.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.180+0000 7fcd23631740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecb48c0 0x55a95ecb1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:56.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.180+0000 7fcd23631740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecb51e0 0x55a95ecbfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:56.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.180+0000 7fcd23631740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a95ecc1170 0x55a95ecbe5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:56.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.180+0000 7fcd23631740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcd08010f80 con 0x55a95ecb51e0 2024-08-20T01:33:56.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.180+0000 7fcd23631740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0800e7f0 con 0x55a95ecc1170 2024-08-20T01:33:56.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.180+0000 7fcd1a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecb51e0 0x55a95ecbfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:56.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.181+0000 7fcd1a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecb51e0 0x55a95ecbfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51490/0 (socket says 172.21.15.22:51490) 2024-08-20T01:33:56.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.181+0000 7fcd1a59c640 1 -- 172.21.15.22:0/3979356844 learned_addr learned my addr 172.21.15.22:0/3979356844 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.184+0000 7fcd1b59e640 1 --2- 172.21.15.22:0/3979356844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a95ecc1170 0x55a95ecbe5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.180+0000 7fcd23631740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0800c640 con 0x55a95ecb48c0 2024-08-20T01:33:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.184+0000 7fcd1a59c640 1 -- 172.21.15.22:0/3979356844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecb48c0 msgr2=0x55a95ecb1e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:33:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.184+0000 7fcd1a59c640 1 --2- 172.21.15.22:0/3979356844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecb48c0 0x55a95ecb1e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.184+0000 7fcd1a59c640 1 -- 172.21.15.22:0/3979356844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a95ecc1170 msgr2=0x55a95ecbe5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.184+0000 7fcd1a59c640 1 --2- 172.21.15.22:0/3979356844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a95ecc1170 0x55a95ecbe5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.184+0000 7fcd1a59c640 1 -- 172.21.15.22:0/3979356844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a95ecbd030 con 0x55a95ecb51e0 2024-08-20T01:33:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.185+0000 7fcd1a59c640 1 --2- 172.21.15.22:0/3979356844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecb51e0 0x55a95ecbfe10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fcd100aa980 tx=0x7fcd10010fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb63fedbf655a0b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.186+0000 7fcd00ff9640 1 -- 172.21.15.22:0/3979356844 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd100b41f0 con 0x55a95ecb51e0 2024-08-20T01:33:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.186+0000 7fcd00ff9640 1 -- 172.21.15.22:0/3979356844 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd100ca070 con 0x55a95ecb51e0 2024-08-20T01:33:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.186+0000 7fcd00ff9640 1 -- 172.21.15.22:0/3979356844 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd100a73d0 con 0x55a95ecb51e0 2024-08-20T01:33:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.188+0000 7fcd23631740 1 -- 172.21.15.22:0/3979356844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecb51e0 msgr2=0x55a95ecbfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.188+0000 7fcd23631740 1 --2- 172.21.15.22:0/3979356844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecb51e0 0x55a95ecbfe10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fcd100aa980 tx=0x7fcd10010fa0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.190+0000 7fcd23631740 1 -- 172.21.15.22:0/3979356844 shutdown_connections 2024-08-20T01:33:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.190+0000 7fcd23631740 1 --2- 172.21.15.22:0/3979356844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a95ecc1170 0x55a95ecbe5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.190+0000 7fcd23631740 1 --2- 172.21.15.22:0/3979356844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecb51e0 0x55a95ecbfe10 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.190+0000 7fcd23631740 1 --2- 172.21.15.22:0/3979356844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecb48c0 0x55a95ecb1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.190+0000 7fcd23631740 1 -- 172.21.15.22:0/3979356844 >> 172.21.15.22:0/3979356844 conn(0x55a95ecb26f0 msgr2=0x55a95ecbf700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:56.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.195+0000 7fcd23631740 1 -- 172.21.15.22:0/3979356844 shutdown_connections 2024-08-20T01:33:56.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.195+0000 7fcd23631740 1 -- 172.21.15.22:0/3979356844 wait complete. 2024-08-20T01:33:56.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.196+0000 7fcd23631740 1 -- start start 2024-08-20T01:33:56.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.196+0000 7fcd23631740 1 Processor -- start 2024-08-20T01:33:56.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.197+0000 7fcd23631740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecb48c0 0x55a95ecc4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:56.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.197+0000 7fcd23631740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecb51e0 0x55a95ecc4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:56.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.197+0000 7fcd1ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecb48c0 0x55a95ecc4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:56.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.197+0000 7fcd1a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecb51e0 0x55a95ecc4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:56.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.198+0000 7fcd1ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecb48c0 0x55a95ecc4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:42736/0 (socket says 172.21.15.22:42736) 2024-08-20T01:33:56.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.198+0000 7fcd1a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecb51e0 0x55a95ecc4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51504/0 (socket says 172.21.15.22:51504) 2024-08-20T01:33:56.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.198+0000 7fcd1ad9d640 1 -- 172.21.15.22:0/2469488991 learned_addr learned my addr 172.21.15.22:0/2469488991 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:33:56.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.198+0000 7fcd23631740 1 --2- 172.21.15.22:0/2469488991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a95ecc1170 0x55a95ecc4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:56.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.198+0000 7fcd23631740 1 -- 172.21.15.22:0/2469488991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0800ccb0 con 0x55a95ecb51e0 2024-08-20T01:33:56.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.198+0000 7fcd23631740 1 -- 172.21.15.22:0/2469488991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0800e120 con 0x55a95ecc1170 2024-08-20T01:33:56.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.198+0000 7fcd1b59e640 1 --2- 172.21.15.22:0/2469488991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a95ecc1170 0x55a95ecc4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:56.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.198+0000 7fcd23631740 1 -- 172.21.15.22:0/2469488991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0800d380 con 0x55a95ecb48c0 2024-08-20T01:33:56.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.199+0000 7fcd1a59c640 1 -- 172.21.15.22:0/2469488991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecb48c0 msgr2=0x55a95ecc4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:56.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.199+0000 7fcd1a59c640 1 --2- 172.21.15.22:0/2469488991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecb48c0 0x55a95ecc4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.199+0000 7fcd1a59c640 1 -- 172.21.15.22:0/2469488991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a95ecc1170 msgr2=0x55a95ecc4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:33:56.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.199+0000 7fcd1a59c640 1 --2- 172.21.15.22:0/2469488991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a95ecc1170 0x55a95ecc4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.199+0000 7fcd1a59c640 1 -- 172.21.15.22:0/2469488991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a95ed39eb0 con 0x55a95ecb51e0 2024-08-20T01:33:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.200+0000 7fcd1a59c640 1 --2- 172.21.15.22:0/2469488991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecb51e0 0x55a95ecc4640 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x55a95ecb79e0 tx=0x7fcd100a75e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b084ec3f8b538b1c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.201+0000 7fcd23631740 10 client.0 _ll_register_callbacks cb 0x7fcd14005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:33:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.201+0000 7fcd23631740 1 -- 172.21.15.22:0/2469488991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd100ca070 con 0x55a95ecb51e0 2024-08-20T01:33:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.202+0000 7fccfeff5640 10 client.15894 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:33:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.202+0000 7fccfeff5640 1 -- 172.21.15.22:0/2469488991 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd100b8070 con 0x55a95ecb51e0 2024-08-20T01:33:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.202+0000 7fccfeff5640 1 -- 172.21.15.22:0/2469488991 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fcd100a7730 con 0x55a95ecb51e0 2024-08-20T01:33:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.202+0000 7fccfeff5640 1 -- 172.21.15.22:0/2469488991 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcd100ab840 con 0x55a95ecb51e0 2024-08-20T01:33:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.205+0000 7fcd23631740 10 client.15894 fetch_fsmap learned FSMap version 29 2024-08-20T01:33:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.205+0000 7fcd23631740 1 -- 172.21.15.22:0/2469488991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55a95ed3ae80 con 0x55a95ecb51e0 2024-08-20T01:33:56.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.209+0000 7fccfeff5640 1 -- 172.21.15.22:0/2469488991 <== mon.0 v2:172.21.15.22:3300/0 4 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fcd10011830 con 0x55a95ecb51e0 2024-08-20T01:33:56.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.209+0000 7fcd23631740 10 client.15894 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:33:56.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.209+0000 7fcd23631740 10 client.15894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:33:56.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.209+0000 7fcd23631740 20 client.15894 populate_metadata read hostname 'smithi022' 2024-08-20T01:33:56.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.209+0000 7fcd23631740 1 --2- 172.21.15.22:0/2469488991 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a95ed3b360 0x55a95ed3d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:56.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.209+0000 7fcd23631740 4 client.15894 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:33:56.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.209+0000 7fcd23631740 1 -- 172.21.15.22:0/2469488991 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fcd100ca070 con 0x55a95ed3b360 2024-08-20T01:33:56.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.210+0000 7fcd1ad9d640 1 --2- 172.21.15.22:0/2469488991 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a95ed3b360 0x55a95ed3d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:56.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.212+0000 7fcd1ad9d640 1 --2- 172.21.15.22:0/2469488991 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a95ed3b360 0x55a95ed3d820 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56d831eabc0b0e9c server_cookie=9f69dea3c18ab678 in_seq=0 out_seq=0 2024-08-20T01:33:56.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.212+0000 7fccfeff5640 10 client.15894 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:56.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.216+0000 7fccfeff5640 1 -- 172.21.15.22:0/2469488991 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7fcd100ca070 con 0x55a95ed3b360 2024-08-20T01:33:56.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.216+0000 7fccfeff5640 10 client.15894 handle_command_reply: tid=0 2024-08-20T01:33:56.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.217+0000 7fcd23631740 1 client.15894 shutdown 2024-08-20T01:33:56.226 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:33:56.226 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-08-20T01:33:56.226 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-08-20T01:33:56.226 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:33:56.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.222+0000 7fcd23631740 1 -- 172.21.15.22:0/2469488991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecb51e0 msgr2=0x55a95ecc4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:56.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.222+0000 7fcd23631740 1 --2- 172.21.15.22:0/2469488991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecb51e0 0x55a95ecc4640 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x55a95ecb79e0 tx=0x7fcd100a75e0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.223+0000 7fcd23631740 1 -- 172.21.15.22:0/2469488991 shutdown_connections 2024-08-20T01:33:56.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.223+0000 7fcd23631740 1 --2- 172.21.15.22:0/2469488991 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a95ed3b360 0x55a95ed3d820 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.223+0000 7fcd23631740 1 --2- 172.21.15.22:0/2469488991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a95ecc1170 0x55a95ecc4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.223+0000 7fcd23631740 1 --2- 172.21.15.22:0/2469488991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a95ecb51e0 0x55a95ecc4640 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.223+0000 7fcd23631740 1 --2- 172.21.15.22:0/2469488991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a95ecb48c0 0x55a95ecc4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.223+0000 7fcd23631740 1 -- 172.21.15.22:0/2469488991 >> 172.21.15.22:0/2469488991 conn(0x55a95ecb26f0 msgr2=0x55a95ecbff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:56.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.223+0000 7fccfeff5640 0 client.15894 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:33:56.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.224+0000 7fcd23631740 1 -- 172.21.15.22:0/2469488991 shutdown_connections 2024-08-20T01:33:56.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.224+0000 7fcd23631740 1 -- 172.21.15.22:0/2469488991 wait complete. 2024-08-20T01:33:56.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.224+0000 7fcd23631740 20 client.15894 trim_cache size 0 max 16384 2024-08-20T01:33:56.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.225+0000 7fcd20a37640 1 -- 172.21.15.22:0/2173683742 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcd040b3e40 msgr2=0x7fcd040b6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:56.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.225+0000 7fcd20a37640 1 --2- 172.21.15.22:0/2173683742 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcd040b3e40 0x7fcd040b6300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcd140098d0 tx=0x7fcd14005bd0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.225+0000 7fcd20a37640 1 -- 172.21.15.22:0/2173683742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd1c101f10 msgr2=0x7fcd1c074930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:56.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.225+0000 7fcd20a37640 1 --2- 172.21.15.22:0/2173683742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd1c101f10 0x7fcd1c074930 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009fd0 tx=0x7fcd1000b870 comp rx=0 tx=0).stop 2024-08-20T01:33:56.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.226+0000 7fcd20a37640 1 -- 172.21.15.22:0/2173683742 shutdown_connections 2024-08-20T01:33:56.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.226+0000 7fcd20a37640 1 --2- 172.21.15.22:0/2173683742 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcd040b3e40 0x7fcd040b6300 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.226+0000 7fcd20a37640 1 --2- 172.21.15.22:0/2173683742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd1c106a30 0x7fcd1c06d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.226+0000 7fcd20a37640 1 --2- 172.21.15.22:0/2173683742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd1c101f10 0x7fcd1c074930 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.226+0000 7fcd20a37640 1 --2- 172.21.15.22:0/2173683742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd1c1015f0 0x7fcd1c0743f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:56.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.226+0000 7fcd20a37640 1 -- 172.21.15.22:0/2173683742 >> 172.21.15.22:0/2173683742 conn(0x7fcd1c0fd2a0 msgr2=0x7fcd1c104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:56.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.226+0000 7fcd20a37640 1 -- 172.21.15.22:0/2173683742 shutdown_connections 2024-08-20T01:33:56.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:33:56.230+0000 7fcd20a37640 1 -- 172.21.15.22:0/2173683742 wait complete. 2024-08-20T01:33:56.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:56 smithi022 ceph-mon[18709]: pgmap v430: 97 pgs: 97 active+clean; 610 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.9 MiB/s wr, 761 op/s 2024-08-20T01:33:56.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:56 smithi134 ceph-mon[22511]: pgmap v430: 97 pgs: 97 active+clean; 610 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.9 MiB/s wr, 761 op/s 2024-08-20T01:33:56.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:56 smithi077 ceph-mon[22251]: pgmap v430: 97 pgs: 97 active+clean; 610 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.9 MiB/s wr, 761 op/s 2024-08-20T01:33:57.686 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:33:57.687 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:33:58.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:33:58 smithi022 ceph-mon[18709]: pgmap v431: 97 pgs: 97 active+clean; 604 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 3.7 MiB/s wr, 1.25k op/s 2024-08-20T01:33:58.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:33:58 smithi134 ceph-mon[22511]: pgmap v431: 97 pgs: 97 active+clean; 604 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 3.7 MiB/s wr, 1.25k op/s 2024-08-20T01:33:58.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:33:58 smithi077 ceph-mon[22251]: pgmap v431: 97 pgs: 97 active+clean; 604 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 3.7 MiB/s wr, 1.25k op/s 2024-08-20T01:34:00.022 INFO:tasks.workunit.client.0.smithi022.stdout: 223 2115089 1463 1515248 1253 681162 1788 2024-08-20T01:34:00.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:00 smithi134 ceph-mon[22511]: pgmap v432: 97 pgs: 97 active+clean; 605 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.9 MiB/s wr, 1.26k op/s 2024-08-20T01:34:00.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:00 smithi077 ceph-mon[22251]: pgmap v432: 97 pgs: 97 active+clean; 605 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.9 MiB/s wr, 1.26k op/s 2024-08-20T01:34:00.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:00 smithi022 ceph-mon[18709]: pgmap v432: 97 pgs: 97 active+clean; 605 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.9 MiB/s wr, 1.26k op/s 2024-08-20T01:34:02.686 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:02.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:02 smithi134 ceph-mon[22511]: pgmap v433: 97 pgs: 97 active+clean; 613 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.0 MiB/s wr, 1.37k op/s 2024-08-20T01:34:02.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:02 smithi077 ceph-mon[22251]: pgmap v433: 97 pgs: 97 active+clean; 613 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.0 MiB/s wr, 1.37k op/s 2024-08-20T01:34:02.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:02 smithi022 ceph-mon[18709]: pgmap v433: 97 pgs: 97 active+clean; 613 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.0 MiB/s wr, 1.37k op/s 2024-08-20T01:34:03.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.846+0000 7f3622265640 1 -- 172.21.15.22:0/955988287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f361c106bd0 msgr2=0x7f361c107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:03.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.846+0000 7f3622265640 1 --2- 172.21.15.22:0/955988287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f361c106bd0 0x7f361c107020 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3614009f00 tx=0x7f361402ab40 comp rx=0 tx=0).stop 2024-08-20T01:34:03.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.848+0000 7f3622265640 1 -- 172.21.15.22:0/955988287 shutdown_connections 2024-08-20T01:34:03.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.848+0000 7f3622265640 1 --2- 172.21.15.22:0/955988287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f361c106bd0 0x7f361c107020 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:03.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.848+0000 7f3622265640 1 --2- 172.21.15.22:0/955988287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f361c1020b0 0x7f361c106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:03.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.848+0000 7f3622265640 1 --2- 172.21.15.22:0/955988287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f361c101790 0x7f361c101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:03.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.848+0000 7f3622265640 1 -- 172.21.15.22:0/955988287 >> 172.21.15.22:0/955988287 conn(0x7f361c0fd400 msgr2=0x7f361c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:03.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.849+0000 7f3622265640 1 -- 172.21.15.22:0/955988287 shutdown_connections 2024-08-20T01:34:03.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.849+0000 7f3622265640 1 -- 172.21.15.22:0/955988287 wait complete. 2024-08-20T01:34:03.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.850+0000 7f3622265640 1 Processor -- start 2024-08-20T01:34:03.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.850+0000 7f3622265640 1 -- start start 2024-08-20T01:34:03.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.850+0000 7f3622265640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f361c101790 0x7f361c19f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:03.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.850+0000 7f3622265640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f361c1020b0 0x7f361c19f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:03.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.850+0000 7f3622265640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f361c1a4c50 0x7f361c1a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:03.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.850+0000 7f3622265640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f361c119120 con 0x7f361c1a4c50 2024-08-20T01:34:03.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.850+0000 7f3622265640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f361c118fa0 con 0x7f361c1020b0 2024-08-20T01:34:03.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.850+0000 7f3622265640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f361c1192a0 con 0x7f361c101790 2024-08-20T01:34:03.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.851+0000 7f361bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f361c101790 0x7f361c19f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:03.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.851+0000 7f361bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f361c101790 0x7f361c19f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:52622/0 (socket says 172.21.15.22:52622) 2024-08-20T01:34:03.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.851+0000 7f361bfff640 1 -- 172.21.15.22:0/2747132088 learned_addr learned my addr 172.21.15.22:0/2747132088 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:03.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.851+0000 7f3620802640 1 --2- 172.21.15.22:0/2747132088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f361c1a4c50 0x7f361c1a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:03.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.852+0000 7f361bfff640 1 -- 172.21.15.22:0/2747132088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f361c1020b0 msgr2=0x7f361c19f8b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T01:34:03.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.852+0000 7f361bfff640 1 --2- 172.21.15.22:0/2747132088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f361c1020b0 0x7f361c19f8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:03.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.852+0000 7f361bfff640 1 -- 172.21.15.22:0/2747132088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f361c1a4c50 msgr2=0x7f361c1a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:03.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.852+0000 7f361bfff640 1 --2- 172.21.15.22:0/2747132088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f361c1a4c50 0x7f361c1a5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:03.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.852+0000 7f361bfff640 1 -- 172.21.15.22:0/2747132088 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361c1a5880 con 0x7f361c101790 2024-08-20T01:34:03.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.853+0000 7f3620802640 1 --2- 172.21.15.22:0/2747132088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f361c1a4c50 0x7f361c1a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:34:03.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.855+0000 7f361bfff640 1 --2- 172.21.15.22:0/2747132088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f361c101790 0x7f361c19f370 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f360c00e9f0 tx=0x7f360c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:03.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.856+0000 7f36197fa640 1 -- 172.21.15.22:0/2747132088 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c00cd80 con 0x7f361c101790 2024-08-20T01:34:03.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.857+0000 7f3622265640 1 -- 172.21.15.22:0/2747132088 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f361c107b50 con 0x7f361c101790 2024-08-20T01:34:03.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.857+0000 7f3622265640 1 -- 172.21.15.22:0/2747132088 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f361c108090 con 0x7f361c101790 2024-08-20T01:34:03.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.859+0000 7f36197fa640 1 -- 172.21.15.22:0/2747132088 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f360c0108e0 con 0x7f361c101790 2024-08-20T01:34:03.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.860+0000 7f36197fa640 1 -- 172.21.15.22:0/2747132088 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c018860 con 0x7f361c101790 2024-08-20T01:34:03.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.861+0000 7f3622265640 1 -- 172.21.15.22:0/2747132088 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36080052c0 con 0x7f361c101790 2024-08-20T01:34:03.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.865+0000 7f36197fa640 1 -- 172.21.15.22:0/2747132088 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f360c010430 con 0x7f361c101790 2024-08-20T01:34:03.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.872+0000 7f36197fa640 1 --2- 172.21.15.22:0/2747132088 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f36040b3cb0 0x7f36040b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:03.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.873+0000 7f36197fa640 1 -- 172.21.15.22:0/2747132088 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f360c0e3f40 con 0x7f361c101790 2024-08-20T01:34:03.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.873+0000 7f36197fa640 1 -- 172.21.15.22:0/2747132088 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f360c0e4360 con 0x7f361c101790 2024-08-20T01:34:03.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.879+0000 7f361b7fe640 1 --2- 172.21.15.22:0/2747132088 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f36040b3cb0 0x7f36040b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:03.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:03.880+0000 7f361b7fe640 1 --2- 172.21.15.22:0/2747132088 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f36040b3cb0 0x7f36040b6170 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f361c106870 tx=0x7f3610007b20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:04.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:04.404+0000 7f3622265640 1 -- 172.21.15.22:0/2747132088 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36080055b0 con 0x7f361c101790 2024-08-20T01:34:04.414 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:34:04.414 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":29,"btime":"2024-08-20T01:33:36:089197+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:33:36.059684+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24586,24575,24565]},"id":1}]} 2024-08-20T01:34:04.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:04.409+0000 7f36197fa640 1 -- 172.21.15.22:0/2747132088 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11912 (secure 0 0 0) 0x7f360c0aaf20 con 0x7f361c101790 2024-08-20T01:34:04.414 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 29 2024-08-20T01:34:04.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:04.417+0000 7f3622265640 1 -- 172.21.15.22:0/2747132088 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f36040b3cb0 msgr2=0x7f36040b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:04.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:04.417+0000 7f3622265640 1 --2- 172.21.15.22:0/2747132088 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f36040b3cb0 0x7f36040b6170 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f361c106870 tx=0x7f3610007b20 comp rx=0 tx=0).stop 2024-08-20T01:34:04.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:04.417+0000 7f3622265640 1 -- 172.21.15.22:0/2747132088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f361c101790 msgr2=0x7f361c19f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:04.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:04.417+0000 7f3622265640 1 --2- 172.21.15.22:0/2747132088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f361c101790 0x7f361c19f370 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f360c00e9f0 tx=0x7f360c00eeb0 comp rx=0 tx=0).stop 2024-08-20T01:34:04.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:04.422+0000 7f3622265640 1 -- 172.21.15.22:0/2747132088 shutdown_connections 2024-08-20T01:34:04.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:04.422+0000 7f3622265640 1 --2- 172.21.15.22:0/2747132088 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f36040b3cb0 0x7f36040b6170 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:04.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:04.422+0000 7f3622265640 1 --2- 172.21.15.22:0/2747132088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f361c1a4c50 0x7f361c1a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:04.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:04.422+0000 7f3622265640 1 --2- 172.21.15.22:0/2747132088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f361c1020b0 0x7f361c19f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:04.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:04.422+0000 7f3622265640 1 --2- 172.21.15.22:0/2747132088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f361c101790 0x7f361c19f370 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:04.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:04.422+0000 7f3622265640 1 -- 172.21.15.22:0/2747132088 >> 172.21.15.22:0/2747132088 conn(0x7f361c0fd400 msgr2=0x7f361c0fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:04.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:04.426+0000 7f3622265640 1 -- 172.21.15.22:0/2747132088 shutdown_connections 2024-08-20T01:34:04.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:04.426+0000 7f3622265640 1 -- 172.21.15.22:0/2747132088 wait complete. 2024-08-20T01:34:04.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:04 smithi134 ceph-mon[22511]: pgmap v434: 97 pgs: 97 active+clean; 620 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.6 MiB/s wr, 1.23k op/s 2024-08-20T01:34:04.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:04 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2747132088' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:04.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:04 smithi077 ceph-mon[22251]: pgmap v434: 97 pgs: 97 active+clean; 620 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.6 MiB/s wr, 1.23k op/s 2024-08-20T01:34:04.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:04 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2747132088' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:04.820 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:04 smithi022 ceph-mon[18709]: pgmap v434: 97 pgs: 97 active+clean; 620 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.6 MiB/s wr, 1.23k op/s 2024-08-20T01:34:04.820 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:04 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2747132088' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:05.717 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:34:06.558 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:06.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:06 smithi134 ceph-mon[22511]: pgmap v435: 97 pgs: 97 active+clean; 626 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 1.22k op/s 2024-08-20T01:34:06.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:06 smithi077 ceph-mon[22251]: pgmap v435: 97 pgs: 97 active+clean; 626 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 1.22k op/s 2024-08-20T01:34:06.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:06 smithi022 ceph-mon[18709]: pgmap v435: 97 pgs: 97 active+clean; 626 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 1.22k op/s 2024-08-20T01:34:07.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.715+0000 7f059c8ac640 1 -- 172.21.15.22:0/315554115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f059811bdd0 msgr2=0x7f059811e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:07.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.717+0000 7f059c8ac640 1 --2- 172.21.15.22:0/315554115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f059811bdd0 0x7f059811e1c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0590009ca0 tx=0x7f059002a980 comp rx=0 tx=0).stop 2024-08-20T01:34:07.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.719+0000 7f059c8ac640 1 -- 172.21.15.22:0/315554115 shutdown_connections 2024-08-20T01:34:07.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.719+0000 7f059c8ac640 1 --2- 172.21.15.22:0/315554115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f059811bdd0 0x7f059811e1c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.719+0000 7f059c8ac640 1 --2- 172.21.15.22:0/315554115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f059810a260 0x7f059810a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.719+0000 7f059c8ac640 1 --2- 172.21.15.22:0/315554115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0598109e80 0x7f0598110ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.719+0000 7f059c8ac640 1 -- 172.21.15.22:0/315554115 >> 172.21.15.22:0/315554115 conn(0x7f059806dcc0 msgr2=0x7f059806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:07.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.723+0000 7f059c8ac640 1 -- 172.21.15.22:0/315554115 shutdown_connections 2024-08-20T01:34:07.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.727+0000 7f059c8ac640 1 -- 172.21.15.22:0/315554115 wait complete. 2024-08-20T01:34:07.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.729+0000 7f059c8ac640 1 Processor -- start 2024-08-20T01:34:07.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.729+0000 7f059c8ac640 1 -- start start 2024-08-20T01:34:07.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.732+0000 7f059c8ac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0598109e80 0x7f05981a7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:07.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.732+0000 7f059c8ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f059810a260 0x7f05981a8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:07.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.732+0000 7f059c8ac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f059811bdd0 0x7f05981ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.733+0000 7f059c8ac640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f05981218a0 con 0x7f059811bdd0 2024-08-20T01:34:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.733+0000 7f059c8ac640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0598121720 con 0x7f059810a260 2024-08-20T01:34:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.733+0000 7f059c8ac640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0598121a20 con 0x7f0598109e80 2024-08-20T01:34:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.734+0000 7f0595d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f059810a260 0x7f05981a8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.734+0000 7f059659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0598109e80 0x7f05981a7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.734+0000 7f059659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0598109e80 0x7f05981a7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:52640/0 (socket says 172.21.15.22:52640) 2024-08-20T01:34:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.734+0000 7f059659c640 1 -- 172.21.15.22:0/383305104 learned_addr learned my addr 172.21.15.22:0/383305104 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.734+0000 7f0596d9d640 1 --2- 172.21.15.22:0/383305104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f059811bdd0 0x7f05981ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.735+0000 7f0595d9b640 1 -- 172.21.15.22:0/383305104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0598109e80 msgr2=0x7f05981a7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.735+0000 7f0595d9b640 1 --2- 172.21.15.22:0/383305104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0598109e80 0x7f05981a7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.735+0000 7f0595d9b640 1 -- 172.21.15.22:0/383305104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f059811bdd0 msgr2=0x7f05981ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.735+0000 7f0595d9b640 1 --2- 172.21.15.22:0/383305104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f059811bdd0 0x7f05981ad4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.735+0000 7f0595d9b640 1 -- 172.21.15.22:0/383305104 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05981adca0 con 0x7f059810a260 2024-08-20T01:34:07.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.735+0000 7f0595d9b640 1 --2- 172.21.15.22:0/383305104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f059810a260 0x7f05981a8130 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f058c00b3f0 tx=0x7f058c00b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:07.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.739+0000 7f05877fe640 1 -- 172.21.15.22:0/383305104 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058c015020 con 0x7f059810a260 2024-08-20T01:34:07.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.739+0000 7f059c8ac640 1 -- 172.21.15.22:0/383305104 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05981adf90 con 0x7f059810a260 2024-08-20T01:34:07.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.739+0000 7f059c8ac640 1 -- 172.21.15.22:0/383305104 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05981b4650 con 0x7f059810a260 2024-08-20T01:34:07.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.739+0000 7f05877fe640 1 -- 172.21.15.22:0/383305104 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f058c011ce0 con 0x7f059810a260 2024-08-20T01:34:07.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.748+0000 7f059eca5740 1 Processor -- start 2024-08-20T01:34:07.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.749+0000 7f059eca5740 1 -- start start 2024-08-20T01:34:07.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.749+0000 7f059eca5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab27880 0x55a66ab27c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:07.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.753+0000 7f0596d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab27880 0x55a66ab27c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:07.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.753+0000 7f0596d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab27880 0x55a66ab27c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43646/0 (socket says 172.21.15.22:43646) 2024-08-20T01:34:07.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.753+0000 7f059eca5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab281a0 0x55a66ab33bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:07.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.754+0000 7f059eca5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 0x55a66ab36520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:07.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.754+0000 7f059659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab281a0 0x55a66ab33bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:07.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.754+0000 7f059659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab281a0 0x55a66ab33bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:52642/0 (socket says 172.21.15.22:52642) 2024-08-20T01:34:07.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.754+0000 7f059659c640 1 -- 172.21.15.22:0/1762940018 learned_addr learned my addr 172.21.15.22:0/1762940018 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:07.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.755+0000 7f059eca5740 1 -- 172.21.15.22:0/1762940018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a66aa9e930 con 0x55a66ab27880 2024-08-20T01:34:07.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.755+0000 7f059eca5740 1 -- 172.21.15.22:0/1762940018 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a66aa8de30 con 0x55a66ab34130 2024-08-20T01:34:07.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.755+0000 7f059eca5740 1 -- 172.21.15.22:0/1762940018 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a66aa91e70 con 0x55a66ab281a0 2024-08-20T01:34:07.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.756+0000 7f0596d9d640 1 -- 172.21.15.22:0/1762940018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab281a0 msgr2=0x55a66ab33bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:07.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.756+0000 7f0596d9d640 1 --2- 172.21.15.22:0/1762940018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab281a0 0x55a66ab33bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.756+0000 7f0596d9d640 1 -- 172.21.15.22:0/1762940018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 msgr2=0x55a66ab36520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:34:07.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.756+0000 7f0596d9d640 1 --2- 172.21.15.22:0/1762940018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 0x55a66ab36520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.756+0000 7f0596d9d640 1 -- 172.21.15.22:0/1762940018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a66a7ed650 con 0x55a66ab27880 2024-08-20T01:34:07.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.757+0000 7f0596d9d640 1 --2- 172.21.15.22:0/1762940018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab27880 0x55a66ab27c60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f059002af70 tx=0x7f059002fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0e1418245b1b89 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:07.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.758+0000 7f05877fe640 1 -- 172.21.15.22:0/383305104 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058c010de0 con 0x7f059810a260 2024-08-20T01:34:07.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.758+0000 7f0584ff9640 1 -- 172.21.15.22:0/1762940018 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0590034040 con 0x55a66ab27880 2024-08-20T01:34:07.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.758+0000 7f05877fe640 1 -- 172.21.15.22:0/383305104 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f058c018020 con 0x7f059810a260 2024-08-20T01:34:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.760+0000 7f0584ff9640 1 -- 172.21.15.22:0/1762940018 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0590003e20 con 0x55a66ab27880 2024-08-20T01:34:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.761+0000 7f059eca5740 1 -- 172.21.15.22:0/1762940018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab27880 msgr2=0x55a66ab27c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.761+0000 7f059eca5740 1 --2- 172.21.15.22:0/1762940018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab27880 0x55a66ab27c60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f059002af70 tx=0x7f059002fdd0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.762+0000 7f05877fe640 1 --2- 172.21.15.22:0/383305104 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f05800b3d30 0x7f05800b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.763+0000 7f0596d9d640 1 --2- 172.21.15.22:0/383305104 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f05800b3d30 0x7f05800b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.764+0000 7f0596d9d640 1 --2- 172.21.15.22:0/383305104 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f05800b3d30 0x7f05800b61f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0590009940 tx=0x7f0590030b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:07.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.765+0000 7f05877fe640 1 -- 172.21.15.22:0/383305104 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f058c0e43e0 con 0x7f059810a260 2024-08-20T01:34:07.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.769+0000 7f059eca5740 1 -- 172.21.15.22:0/1762940018 shutdown_connections 2024-08-20T01:34:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.769+0000 7f059eca5740 1 --2- 172.21.15.22:0/1762940018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 0x55a66ab36520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.769+0000 7f059eca5740 1 --2- 172.21.15.22:0/1762940018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab281a0 0x55a66ab33bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.769+0000 7f059eca5740 1 --2- 172.21.15.22:0/1762940018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab27880 0x55a66ab27c60 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.769+0000 7f059eca5740 1 -- 172.21.15.22:0/1762940018 >> 172.21.15.22:0/1762940018 conn(0x55a66ab256b0 msgr2=0x55a66ab26850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.770+0000 7f059eca5740 1 -- 172.21.15.22:0/1762940018 shutdown_connections 2024-08-20T01:34:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.771+0000 7f059eca5740 1 -- 172.21.15.22:0/1762940018 wait complete. 2024-08-20T01:34:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.771+0000 7f059eca5740 1 -- start start 2024-08-20T01:34:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.772+0000 7f059eca5740 1 Processor -- start 2024-08-20T01:34:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.772+0000 7f059eca5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab27880 0x55a66ab33be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.772+0000 7f059eca5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab281a0 0x55a66ab31070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.772+0000 7f059eca5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 0x55a66ab31800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.772+0000 7f059eca5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a66a8f0700 con 0x55a66ab27880 2024-08-20T01:34:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.772+0000 7f059eca5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a66aa14810 con 0x55a66ab34130 2024-08-20T01:34:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.772+0000 7f059eca5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a66ab36dd0 con 0x55a66ab281a0 2024-08-20T01:34:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.772+0000 7f059eca5740 10 client.0 _ll_register_callbacks cb 0x55a66aa87700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:34:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.772+0000 7f0595d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab281a0 0x55a66ab31070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.772+0000 7f0595d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab281a0 0x55a66ab31070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:52644/0 (socket says 172.21.15.22:52644) 2024-08-20T01:34:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.772+0000 7f0595d9b640 1 -- 172.21.15.22:0/2146944916 learned_addr learned my addr 172.21.15.22:0/2146944916 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.774+0000 7f059659c640 1 --2- 172.21.15.22:0/2146944916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab27880 0x55a66ab33be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.774+0000 7f0596d9d640 1 --2- 172.21.15.22:0/2146944916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 0x55a66ab31800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.774+0000 7f0595d9b640 1 -- 172.21.15.22:0/2146944916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 msgr2=0x55a66ab31800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.774+0000 7f0595d9b640 1 --2- 172.21.15.22:0/2146944916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 0x55a66ab31800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.774+0000 7f0595d9b640 1 -- 172.21.15.22:0/2146944916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab27880 msgr2=0x55a66ab33be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.774+0000 7f0595d9b640 1 --2- 172.21.15.22:0/2146944916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab27880 0x55a66ab33be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.774+0000 7f0595d9b640 1 -- 172.21.15.22:0/2146944916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a66ab40200 con 0x55a66ab281a0 2024-08-20T01:34:07.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.774+0000 7f0596d9d640 1 --2- 172.21.15.22:0/2146944916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 0x55a66ab31800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:34:07.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.775+0000 7f0595d9b640 1 --2- 172.21.15.22:0/2146944916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab281a0 0x55a66ab31070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f058c0a7390 tx=0x7f058c0aae20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a059099b69a9c978 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:07.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.775+0000 7f057dffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:34:07.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.777+0000 7f057dffb640 1 -- 172.21.15.22:0/2146944916 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058c0c4020 con 0x55a66ab281a0 2024-08-20T01:34:07.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.777+0000 7f059eca5740 1 -- 172.21.15.22:0/2146944916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a66aa3d150 con 0x55a66ab281a0 2024-08-20T01:34:07.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.777+0000 7f057dffb640 1 -- 172.21.15.22:0/2146944916 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f058c0b3f30 con 0x55a66ab281a0 2024-08-20T01:34:07.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.777+0000 7f057dffb640 1 -- 172.21.15.22:0/2146944916 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f058c0ab310 con 0x55a66ab281a0 2024-08-20T01:34:07.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.777+0000 7f059eca5740 10 client.25501 fetch_fsmap learned FSMap version 29 2024-08-20T01:34:07.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.777+0000 7f059eca5740 1 -- 172.21.15.22:0/2146944916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a66ab42bb0 con 0x55a66ab281a0 2024-08-20T01:34:07.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.779+0000 7f057dffb640 1 -- 172.21.15.22:0/2146944916 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a66aa3d150 con 0x55a66ab281a0 2024-08-20T01:34:07.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.779+0000 7f057dffb640 1 -- 172.21.15.22:0/2146944916 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f058c0cc280 con 0x55a66ab281a0 2024-08-20T01:34:07.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.780+0000 7f059eca5740 10 client.25501 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:34:07.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.780+0000 7f059eca5740 10 client.25501 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:34:07.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.780+0000 7f059eca5740 20 client.25501 populate_metadata read hostname 'smithi022' 2024-08-20T01:34:07.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.780+0000 7f059eca5740 1 --2- 172.21.15.22:0/2146944916 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55a66ab44470 0x55a66ab468b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:07.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.780+0000 7f059eca5740 4 client.25501 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:34:07.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.780+0000 7f059eca5740 1 -- 172.21.15.22:0/2146944916 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a66aaa0880 con 0x55a66ab44470 2024-08-20T01:34:07.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.781+0000 7f059659c640 1 --2- 172.21.15.22:0/2146944916 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55a66ab44470 0x55a66ab468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.790+0000 7f059659c640 1 --2- 172.21.15.22:0/2146944916 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55a66ab44470 0x55a66ab468b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e67ca8906a4e69d4 server_cookie=bc184382c9925aff in_seq=0 out_seq=0 2024-08-20T01:34:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.790+0000 7f057dffb640 10 client.25501 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:34:07.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.795+0000 7f057dffb640 1 -- 172.21.15.22:0/2146944916 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a66aaa0880 con 0x55a66ab44470 2024-08-20T01:34:07.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.795+0000 7f057dffb640 10 client.25501 handle_command_reply: tid=0 2024-08-20T01:34:07.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.795+0000 7f059eca5740 1 client.25501 shutdown 2024-08-20T01:34:07.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.795+0000 7f059eca5740 1 -- 172.21.15.22:0/2146944916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab281a0 msgr2=0x55a66ab31070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:07.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.795+0000 7f059eca5740 1 --2- 172.21.15.22:0/2146944916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab281a0 0x55a66ab31070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f058c0a7390 tx=0x7f058c0aae20 comp rx=0 tx=0).stop 2024-08-20T01:34:07.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.798+0000 7f059eca5740 1 -- 172.21.15.22:0/2146944916 shutdown_connections 2024-08-20T01:34:07.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.798+0000 7f059eca5740 1 --2- 172.21.15.22:0/2146944916 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55a66ab44470 0x55a66ab468b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.798+0000 7f059eca5740 1 --2- 172.21.15.22:0/2146944916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 0x55a66ab31800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.798+0000 7f059eca5740 1 --2- 172.21.15.22:0/2146944916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab281a0 0x55a66ab31070 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.798+0000 7f059eca5740 1 --2- 172.21.15.22:0/2146944916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab27880 0x55a66ab33be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.798+0000 7f059eca5740 1 -- 172.21.15.22:0/2146944916 >> 172.21.15.22:0/2146944916 conn(0x55a66ab256b0 msgr2=0x55a66ab2b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:07.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.798+0000 7f057dffb640 0 client.25501 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:34:07.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.804+0000 7f059eca5740 1 -- 172.21.15.22:0/2146944916 shutdown_connections 2024-08-20T01:34:07.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.804+0000 7f059eca5740 1 -- 172.21.15.22:0/2146944916 wait complete. 2024-08-20T01:34:07.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.804+0000 7f059eca5740 20 client.25501 trim_cache size 0 max 16384 2024-08-20T01:34:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.840+0000 7f059eca5740 1 Processor -- start 2024-08-20T01:34:07.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.845+0000 7f059eca5740 1 -- start start 2024-08-20T01:34:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.845+0000 7f059eca5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab27880 0x55a66ab201a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.846+0000 7f059659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab27880 0x55a66ab201a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.846+0000 7f059659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab27880 0x55a66ab201a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43664/0 (socket says 172.21.15.22:43664) 2024-08-20T01:34:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.846+0000 7f059659c640 1 -- 172.21.15.22:0/1026406791 learned_addr learned my addr 172.21.15.22:0/1026406791 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.846+0000 7f059eca5740 1 --2- 172.21.15.22:0/1026406791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab281a0 0x55a66ab2f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.846+0000 7f059eca5740 1 --2- 172.21.15.22:0/1026406791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 0x55a66ab2fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.846+0000 7f0595d9b640 1 --2- 172.21.15.22:0/1026406791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab281a0 0x55a66ab2f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.847+0000 7f059eca5740 1 -- 172.21.15.22:0/1026406791 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0578010fc0 con 0x55a66ab27880 2024-08-20T01:34:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.847+0000 7f0596d9d640 1 --2- 172.21.15.22:0/1026406791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 0x55a66ab2fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:07.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.847+0000 7f059eca5740 1 -- 172.21.15.22:0/1026406791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f057800e830 con 0x55a66ab34130 2024-08-20T01:34:07.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.847+0000 7f059eca5740 1 -- 172.21.15.22:0/1026406791 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f057800c680 con 0x55a66ab281a0 2024-08-20T01:34:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.849+0000 7f0596d9d640 1 -- 172.21.15.22:0/1026406791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab281a0 msgr2=0x55a66ab2f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.849+0000 7f0596d9d640 1 --2- 172.21.15.22:0/1026406791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab281a0 0x55a66ab2f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.849+0000 7f0596d9d640 1 -- 172.21.15.22:0/1026406791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab27880 msgr2=0x55a66ab201a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.850+0000 7f0596d9d640 1 --2- 172.21.15.22:0/1026406791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab27880 0x55a66ab201a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.850+0000 7f0596d9d640 1 -- 172.21.15.22:0/1026406791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a66ab27fd0 con 0x55a66ab34130 2024-08-20T01:34:07.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.850+0000 7f059659c640 1 --2- 172.21.15.22:0/1026406791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab27880 0x55a66ab201a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:34:07.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.850+0000 7f0596d9d640 1 --2- 172.21.15.22:0/1026406791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 0x55a66ab2fdf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0590001190 tx=0x7f0590052000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=484cd20935b0a25c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:07.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.852+0000 7f057ffff640 1 -- 172.21.15.22:0/1026406791 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0590034070 con 0x55a66ab34130 2024-08-20T01:34:07.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.852+0000 7f057ffff640 1 -- 172.21.15.22:0/1026406791 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f059004b040 con 0x55a66ab34130 2024-08-20T01:34:07.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.852+0000 7f057ffff640 1 -- 172.21.15.22:0/1026406791 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059004a050 con 0x55a66ab34130 2024-08-20T01:34:07.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.853+0000 7f059eca5740 1 -- 172.21.15.22:0/1026406791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 msgr2=0x55a66ab2fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:07.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.853+0000 7f059eca5740 1 --2- 172.21.15.22:0/1026406791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 0x55a66ab2fdf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0590001190 tx=0x7f0590052000 comp rx=0 tx=0).stop 2024-08-20T01:34:07.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.854+0000 7f059eca5740 1 -- 172.21.15.22:0/1026406791 shutdown_connections 2024-08-20T01:34:07.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.854+0000 7f059eca5740 1 --2- 172.21.15.22:0/1026406791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 0x55a66ab2fdf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.854+0000 7f059eca5740 1 --2- 172.21.15.22:0/1026406791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab281a0 0x55a66ab2f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.854+0000 7f059eca5740 1 --2- 172.21.15.22:0/1026406791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab27880 0x55a66ab201a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.854+0000 7f059eca5740 1 -- 172.21.15.22:0/1026406791 >> 172.21.15.22:0/1026406791 conn(0x55a66ab256b0 msgr2=0x55a66ab2c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:07.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.856+0000 7f059eca5740 1 -- 172.21.15.22:0/1026406791 shutdown_connections 2024-08-20T01:34:07.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.856+0000 7f059eca5740 1 -- 172.21.15.22:0/1026406791 wait complete. 2024-08-20T01:34:07.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.856+0000 7f059eca5740 1 -- start start 2024-08-20T01:34:07.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.857+0000 7f059eca5740 1 Processor -- start 2024-08-20T01:34:07.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.858+0000 7f059eca5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab27880 0x55a66ab37120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:07.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.859+0000 7f059eca5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab281a0 0x55a66ab37660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:07.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.859+0000 7f059659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab27880 0x55a66ab37120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:07.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.859+0000 7f059659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab27880 0x55a66ab37120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:52666/0 (socket says 172.21.15.22:52666) 2024-08-20T01:34:07.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.862+0000 7f0595d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab281a0 0x55a66ab37660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:07.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.862+0000 7f059659c640 1 -- 172.21.15.22:0/3136769042 learned_addr learned my addr 172.21.15.22:0/3136769042 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:07.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.862+0000 7f059eca5740 1 --2- 172.21.15.22:0/3136769042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 0x55a66ab37ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:07.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.862+0000 7f059eca5740 1 -- 172.21.15.22:0/3136769042 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f057800ccf0 con 0x55a66ab281a0 2024-08-20T01:34:07.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.862+0000 7f0596d9d640 1 --2- 172.21.15.22:0/3136769042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 0x55a66ab37ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:07.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.863+0000 7f059eca5740 1 -- 172.21.15.22:0/3136769042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f057800e160 con 0x55a66ab34130 2024-08-20T01:34:07.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.863+0000 7f059eca5740 1 -- 172.21.15.22:0/3136769042 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f057800d3c0 con 0x55a66ab27880 2024-08-20T01:34:07.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.863+0000 7f059eca5740 10 client.0 _ll_register_callbacks cb 0x7f058c0aac60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:34:07.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.864+0000 7f0595d9b640 1 -- 172.21.15.22:0/3136769042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab27880 msgr2=0x55a66ab37120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:07.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.864+0000 7f0595d9b640 1 --2- 172.21.15.22:0/3136769042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab27880 0x55a66ab37120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.864+0000 7f0595d9b640 1 -- 172.21.15.22:0/3136769042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 msgr2=0x55a66ab37ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:07.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.864+0000 7f0595d9b640 1 --2- 172.21.15.22:0/3136769042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 0x55a66ab37ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.864+0000 7f0595d9b640 1 -- 172.21.15.22:0/3136769042 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a66abad230 con 0x55a66ab281a0 2024-08-20T01:34:07.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.865+0000 7f0595d9b640 1 --2- 172.21.15.22:0/3136769042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab281a0 0x55a66ab37660 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f058c0a8580 tx=0x7f058c0aa780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12bc828c614bf6fc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:07.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.865+0000 7f057dffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:34:07.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.868+0000 7f057dffb640 1 -- 172.21.15.22:0/3136769042 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058c0c4040 con 0x55a66ab281a0 2024-08-20T01:34:07.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.868+0000 7f057dffb640 1 -- 172.21.15.22:0/3136769042 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f058c0a7900 con 0x55a66ab281a0 2024-08-20T01:34:07.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.868+0000 7f059eca5740 1 -- 172.21.15.22:0/3136769042 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f059004b040 con 0x55a66ab281a0 2024-08-20T01:34:07.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.869+0000 7f057dffb640 1 -- 172.21.15.22:0/3136769042 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f058c08a050 con 0x55a66ab281a0 2024-08-20T01:34:07.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.870+0000 7f059eca5740 10 client.15915 fetch_fsmap learned FSMap version 29 2024-08-20T01:34:07.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.870+0000 7f059eca5740 1 -- 172.21.15.22:0/3136769042 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a66abae530 con 0x55a66ab281a0 2024-08-20T01:34:07.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.871+0000 7f057dffb640 1 -- 172.21.15.22:0/3136769042 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f058c0c5e50 con 0x55a66ab281a0 2024-08-20T01:34:07.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.871+0000 7f057dffb640 1 -- 172.21.15.22:0/3136769042 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f058c0a6c80 con 0x55a66ab281a0 2024-08-20T01:34:07.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.875+0000 7f059eca5740 10 client.15915 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:34:07.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.875+0000 7f059eca5740 10 client.15915 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:34:07.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.875+0000 7f059eca5740 20 client.15915 populate_metadata read hostname 'smithi022' 2024-08-20T01:34:07.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.875+0000 7f059eca5740 1 --2- 172.21.15.22:0/3136769042 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55a66abaec80 0x55a66abb10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:07.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.875+0000 7f059eca5740 4 client.15915 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:34:07.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.875+0000 7f059eca5740 1 -- 172.21.15.22:0/3136769042 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f059004b040 con 0x55a66abaec80 2024-08-20T01:34:07.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.881+0000 7f059659c640 1 --2- 172.21.15.22:0/3136769042 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55a66abaec80 0x55a66abb10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:07.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.881+0000 7f059659c640 1 --2- 172.21.15.22:0/3136769042 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55a66abaec80 0x55a66abb10a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8b129528b5b53167 server_cookie=71910cc20d76b2d0 in_seq=0 out_seq=0 2024-08-20T01:34:07.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.881+0000 7f057dffb640 10 client.15915 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:34:07.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.882+0000 7f057dffb640 1 -- 172.21.15.22:0/3136769042 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f059004b040 con 0x55a66abaec80 2024-08-20T01:34:07.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.882+0000 7f057dffb640 10 client.15915 handle_command_reply: tid=0 2024-08-20T01:34:07.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.883+0000 7f059eca5740 1 client.15915 shutdown 2024-08-20T01:34:07.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.886+0000 7f059eca5740 1 -- 172.21.15.22:0/3136769042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab281a0 msgr2=0x55a66ab37660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:07.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.886+0000 7f059eca5740 1 --2- 172.21.15.22:0/3136769042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab281a0 0x55a66ab37660 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f058c0a8580 tx=0x7f058c0aa780 comp rx=0 tx=0).stop 2024-08-20T01:34:07.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.895+0000 7f059eca5740 1 -- 172.21.15.22:0/3136769042 shutdown_connections 2024-08-20T01:34:07.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.895+0000 7f059eca5740 1 --2- 172.21.15.22:0/3136769042 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55a66abaec80 0x55a66abb10a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.895+0000 7f059eca5740 1 --2- 172.21.15.22:0/3136769042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a66ab34130 0x55a66ab37ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.895+0000 7f059eca5740 1 --2- 172.21.15.22:0/3136769042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a66ab281a0 0x55a66ab37660 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.895+0000 7f059eca5740 1 --2- 172.21.15.22:0/3136769042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a66ab27880 0x55a66ab37120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.895+0000 7f059eca5740 1 -- 172.21.15.22:0/3136769042 >> 172.21.15.22:0/3136769042 conn(0x55a66ab256b0 msgr2=0x55a66ab2f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:07.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.895+0000 7f057dffb640 0 client.15915 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:34:07.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.895+0000 7f059eca5740 1 -- 172.21.15.22:0/3136769042 shutdown_connections 2024-08-20T01:34:07.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.896+0000 7f059eca5740 1 -- 172.21.15.22:0/3136769042 wait complete. 2024-08-20T01:34:07.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.896+0000 7f059eca5740 20 client.15915 trim_cache size 0 max 16384 2024-08-20T01:34:07.900 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:34:07.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.898+0000 7f059c8ac640 1 -- 172.21.15.22:0/383305104 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f05800b3d30 msgr2=0x7f05800b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:07.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.898+0000 7f059c8ac640 1 --2- 172.21.15.22:0/383305104 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f05800b3d30 0x7f05800b61f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0590009940 tx=0x7f0590030b40 comp rx=0 tx=0).stop 2024-08-20T01:34:07.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.898+0000 7f059c8ac640 1 -- 172.21.15.22:0/383305104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f059810a260 msgr2=0x7f05981a8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:07.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.898+0000 7f059c8ac640 1 --2- 172.21.15.22:0/383305104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f059810a260 0x7f05981a8130 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f058c00b3f0 tx=0x7f058c00b8b0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.898+0000 7f059c8ac640 1 -- 172.21.15.22:0/383305104 shutdown_connections 2024-08-20T01:34:07.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.898+0000 7f059c8ac640 1 --2- 172.21.15.22:0/383305104 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f05800b3d30 0x7f05800b61f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.898+0000 7f059c8ac640 1 --2- 172.21.15.22:0/383305104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f059811bdd0 0x7f05981ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.898+0000 7f059c8ac640 1 --2- 172.21.15.22:0/383305104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f059810a260 0x7f05981a8130 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.898+0000 7f059c8ac640 1 --2- 172.21.15.22:0/383305104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0598109e80 0x7f05981a7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.898+0000 7f059c8ac640 1 -- 172.21.15.22:0/383305104 >> 172.21.15.22:0/383305104 conn(0x7f059806dcc0 msgr2=0x7f059811d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:07.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.899+0000 7f059c8ac640 1 -- 172.21.15.22:0/383305104 shutdown_connections 2024-08-20T01:34:07.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:07.899+0000 7f059c8ac640 1 -- 172.21.15.22:0/383305104 wait complete. 2024-08-20T01:34:08.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:08 smithi022 ceph-mon[18709]: pgmap v436: 97 pgs: 97 active+clean; 692 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 9.1 MiB/s wr, 1.22k op/s 2024-08-20T01:34:08.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:08 smithi134 ceph-mon[22511]: pgmap v436: 97 pgs: 97 active+clean; 692 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 9.1 MiB/s wr, 1.22k op/s 2024-08-20T01:34:08.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:08 smithi077 ceph-mon[22251]: pgmap v436: 97 pgs: 97 active+clean; 692 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 9.1 MiB/s wr, 1.22k op/s 2024-08-20T01:34:09.236 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:34:10.023 INFO:tasks.workunit.client.0.smithi022.stdout: 249 1897225 1458 1361830 1487 601291 1843 2024-08-20T01:34:10.483 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:10 smithi022 ceph-mon[18709]: pgmap v437: 97 pgs: 97 active+clean; 698 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.8 MiB/s wr, 687 op/s 2024-08-20T01:34:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.693+0000 7fea2359e640 1 -- 172.21.15.22:0/2419983258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea240741d0 msgr2=0x7fea24119dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.693+0000 7fea2359e640 1 --2- 172.21.15.22:0/2419983258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea240741d0 0x7fea24119dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009ca0 tx=0x7fea1c02a8d0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.694+0000 7fea2359e640 1 -- 172.21.15.22:0/2419983258 shutdown_connections 2024-08-20T01:34:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.694+0000 7fea2359e640 1 --2- 172.21.15.22:0/2419983258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea240741d0 0x7fea24119dc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.694+0000 7fea2359e640 1 --2- 172.21.15.22:0/2419983258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea2410aa30 0x7fea24073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.694+0000 7fea2359e640 1 --2- 172.21.15.22:0/2419983258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea2410a0f0 0x7fea2410a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.694+0000 7fea2359e640 1 -- 172.21.15.22:0/2419983258 >> 172.21.15.22:0/2419983258 conn(0x7fea2406f550 msgr2=0x7fea24071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.701+0000 7fea2359e640 1 -- 172.21.15.22:0/2419983258 shutdown_connections 2024-08-20T01:34:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.701+0000 7fea2359e640 1 -- 172.21.15.22:0/2419983258 wait complete. 2024-08-20T01:34:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.702+0000 7fea2359e640 1 Processor -- start 2024-08-20T01:34:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.713+0000 7fea2359e640 1 -- start start 2024-08-20T01:34:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.713+0000 7fea2359e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea2410a0f0 0x7fea24116450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.713+0000 7fea2359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea2410aa30 0x7fea24116aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.713+0000 7fea2359e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea241176d0 0x7fea24117b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.713+0000 7fea2359e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea2411cf60 con 0x7fea2410aa30 2024-08-20T01:34:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.713+0000 7fea2359e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea2411cde0 con 0x7fea2410a0f0 2024-08-20T01:34:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.713+0000 7fea2359e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fea2411d0e0 con 0x7fea241176d0 2024-08-20T01:34:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.713+0000 7fea22d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea241176d0 0x7fea24117b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.713+0000 7fea22d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea241176d0 0x7fea24117b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:48022/0 (socket says 172.21.15.22:48022) 2024-08-20T01:34:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.713+0000 7fea22d9d640 1 -- 172.21.15.22:0/168446396 learned_addr learned my addr 172.21.15.22:0/168446396 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.714+0000 7fea22d9d640 1 -- 172.21.15.22:0/168446396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea2410a0f0 msgr2=0x7fea24116450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.714+0000 7fea22d9d640 1 --2- 172.21.15.22:0/168446396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea2410a0f0 0x7fea24116450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.714+0000 7fea22d9d640 1 -- 172.21.15.22:0/168446396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea2410aa30 msgr2=0x7fea24116aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.714+0000 7fea22d9d640 1 --2- 172.21.15.22:0/168446396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea2410aa30 0x7fea24116aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.714+0000 7fea22d9d640 1 -- 172.21.15.22:0/168446396 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea241183f0 con 0x7fea241176d0 2024-08-20T01:34:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.720+0000 7fea22d9d640 1 --2- 172.21.15.22:0/168446396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea241176d0 0x7fea24117b80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009bf0 tx=0x7fea1c031970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.730+0000 7fea137fe640 1 -- 172.21.15.22:0/168446396 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c004240 con 0x7fea241176d0 2024-08-20T01:34:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.730+0000 7fea2359e640 1 -- 172.21.15.22:0/168446396 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea24118740 con 0x7fea241176d0 2024-08-20T01:34:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.730+0000 7fea2359e640 1 -- 172.21.15.22:0/168446396 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea24118c30 con 0x7fea241176d0 2024-08-20T01:34:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.736+0000 7fea137fe640 1 -- 172.21.15.22:0/168446396 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea1c036070 con 0x7fea241176d0 2024-08-20T01:34:10.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.736+0000 7fea137fe640 1 -- 172.21.15.22:0/168446396 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c030c80 con 0x7fea241176d0 2024-08-20T01:34:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.744+0000 7fea2b8c5740 1 Processor -- start 2024-08-20T01:34:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.745+0000 7fea2b8c5740 1 -- start start 2024-08-20T01:34:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.746+0000 7fea137fe640 1 -- 172.21.15.22:0/168446396 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fea1c04d430 con 0x7fea241176d0 2024-08-20T01:34:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.746+0000 7fea2b8c5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff3da20 0x5588dff3fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.746+0000 7fea2b8c5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff40350 0x5588dff42740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.746+0000 7fea2b8c5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff42d90 0x5588dff45250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.746+0000 7fea2b8c5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5588dfeb0360 con 0x5588dff42d90 2024-08-20T01:34:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.746+0000 7fea2b8c5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5588dfe9f860 con 0x5588dff3da20 2024-08-20T01:34:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.746+0000 7fea2b8c5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5588dfea38a0 con 0x5588dff40350 2024-08-20T01:34:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.747+0000 7fea21d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff42d90 0x5588dff45250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.747+0000 7fea21d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff42d90 0x5588dff45250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41864/0 (socket says 172.21.15.22:41864) 2024-08-20T01:34:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.747+0000 7fea21d9b640 1 -- 172.21.15.22:0/1754464200 learned_addr learned my addr 172.21.15.22:0/1754464200 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.747+0000 7fea2259c640 1 --2- 172.21.15.22:0/1754464200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff40350 0x5588dff42740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.747+0000 7fea21d9b640 1 --2- 172.21.15.22:0/1754464200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff3da20 0x5588dff3fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:10.752 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.747+0000 7fea2259c640 1 -- 172.21.15.22:0/1754464200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff3da20 msgr2=0x5588dff3fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:10.752 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.747+0000 7fea2259c640 1 --2- 172.21.15.22:0/1754464200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff3da20 0x5588dff3fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.752 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.748+0000 7fea2259c640 1 -- 172.21.15.22:0/1754464200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff42d90 msgr2=0x5588dff45250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:10.752 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.748+0000 7fea2259c640 1 --2- 172.21.15.22:0/1754464200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff42d90 0x5588dff45250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.752 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.748+0000 7fea2259c640 1 -- 172.21.15.22:0/1754464200 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588dfe46e40 con 0x5588dff40350 2024-08-20T01:34:10.752 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.748+0000 7fea2259c640 1 --2- 172.21.15.22:0/1754464200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff40350 0x5588dff42740 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fea1400ba40 tx=0x7fea1400bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d31e4dc608923647 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:10.752 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.749+0000 7fea137fe640 1 --2- 172.21.15.22:0/168446396 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fea0c0b3dd0 0x7fea0c0b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.756+0000 7fea137fe640 1 -- 172.21.15.22:0/168446396 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fea1c104c50 con 0x7fea241176d0 2024-08-20T01:34:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.757+0000 7fea21d9b640 1 --2- 172.21.15.22:0/168446396 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fea0c0b3dd0 0x7fea0c0b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.757+0000 7fea21d9b640 1 --2- 172.21.15.22:0/168446396 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fea0c0b3dd0 0x7fea0c0b6290 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fea180058c0 tx=0x7fea1800a550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:10.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:10 smithi134 ceph-mon[22511]: pgmap v437: 97 pgs: 97 active+clean; 698 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.8 MiB/s wr, 687 op/s 2024-08-20T01:34:10.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.765+0000 7fea10ff9640 1 -- 172.21.15.22:0/1754464200 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1400dc40 con 0x5588dff40350 2024-08-20T01:34:10.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.767+0000 7fea10ff9640 1 -- 172.21.15.22:0/1754464200 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea1400dde0 con 0x5588dff40350 2024-08-20T01:34:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.767+0000 7fea10ff9640 1 -- 172.21.15.22:0/1754464200 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14004a00 con 0x5588dff40350 2024-08-20T01:34:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.776+0000 7fea2b8c5740 1 -- 172.21.15.22:0/1754464200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff40350 msgr2=0x5588dff42740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.776+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/1754464200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff40350 0x5588dff42740 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fea1400ba40 tx=0x7fea1400bf00 comp rx=0 tx=0).stop 2024-08-20T01:34:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.782+0000 7fea2b8c5740 1 -- 172.21.15.22:0/1754464200 shutdown_connections 2024-08-20T01:34:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.783+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/1754464200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff42d90 0x5588dff45250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.783+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/1754464200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff40350 0x5588dff42740 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.783+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/1754464200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff3da20 0x5588dff3fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.783+0000 7fea2b8c5740 1 -- 172.21.15.22:0/1754464200 >> 172.21.15.22:0/1754464200 conn(0x5588dff38b70 msgr2=0x5588dff39900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.785+0000 7fea2b8c5740 1 -- 172.21.15.22:0/1754464200 shutdown_connections 2024-08-20T01:34:10.794 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.793+0000 7fea2b8c5740 1 -- 172.21.15.22:0/1754464200 wait complete. 2024-08-20T01:34:10.794 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.793+0000 7fea2b8c5740 1 -- start start 2024-08-20T01:34:10.795 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.793+0000 7fea2b8c5740 1 Processor -- start 2024-08-20T01:34:10.795 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.794+0000 7fea2b8c5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff3da20 0x5588dff47260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.794+0000 7fea2b8c5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff40350 0x5588dff47900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.794+0000 7fea2b8c5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff42d90 0x5588dff484d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.794+0000 7fea2b8c5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5588dfdd8ab0 con 0x5588dff42d90 2024-08-20T01:34:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.794+0000 7fea2b8c5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5588dfe26780 con 0x5588dff40350 2024-08-20T01:34:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.794+0000 7fea2b8c5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5588dff45dc0 con 0x5588dff3da20 2024-08-20T01:34:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.794+0000 7fea2b8c5740 10 client.0 _ll_register_callbacks cb 0x5588dfbaea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:34:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.794+0000 7fea2259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff3da20 0x5588dff47260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.794+0000 7fea2259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff3da20 0x5588dff47260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:48042/0 (socket says 172.21.15.22:48042) 2024-08-20T01:34:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.794+0000 7fea2259c640 1 -- 172.21.15.22:0/3981080890 learned_addr learned my addr 172.21.15.22:0/3981080890 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.794+0000 7fea21d9b640 1 --2- 172.21.15.22:0/3981080890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff40350 0x5588dff47900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.795+0000 7fea21d9b640 1 -- 172.21.15.22:0/3981080890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff3da20 msgr2=0x5588dff47260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.795+0000 7fea21d9b640 1 --2- 172.21.15.22:0/3981080890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff3da20 0x5588dff47260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.795+0000 7fea21d9b640 1 -- 172.21.15.22:0/3981080890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff42d90 msgr2=0x5588dff484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.795+0000 7fea21d9b640 1 --2- 172.21.15.22:0/3981080890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff42d90 0x5588dff484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.795+0000 7fea21d9b640 1 -- 172.21.15.22:0/3981080890 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588dfc02790 con 0x5588dff40350 2024-08-20T01:34:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.795+0000 7fea21d9b640 1 --2- 172.21.15.22:0/3981080890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff40350 0x5588dff47900 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fea18005d00 tx=0x7fea18005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ed4ddc11705b46 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.801+0000 7fea09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:34:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.801+0000 7fea09ffb640 1 -- 172.21.15.22:0/3981080890 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18005220 con 0x5588dff40350 2024-08-20T01:34:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.801+0000 7fea2b8c5740 1 -- 172.21.15.22:0/3981080890 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5588dfe4ee00 con 0x5588dff40350 2024-08-20T01:34:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.801+0000 7fea09ffb640 1 -- 172.21.15.22:0/3981080890 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fea180053c0 con 0x5588dff40350 2024-08-20T01:34:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.808+0000 7fea09ffb640 1 -- 172.21.15.22:0/3981080890 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fea1802e050 con 0x5588dff40350 2024-08-20T01:34:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.808+0000 7fea2b8c5740 10 client.25499 fetch_fsmap learned FSMap version 29 2024-08-20T01:34:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.808+0000 7fea2b8c5740 1 -- 172.21.15.22:0/3981080890 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5588dfc7b620 con 0x5588dff40350 2024-08-20T01:34:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.809+0000 7fea09ffb640 1 -- 172.21.15.22:0/3981080890 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5588dfe4ee00 con 0x5588dff40350 2024-08-20T01:34:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.809+0000 7fea09ffb640 1 -- 172.21.15.22:0/3981080890 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fea1801e040 con 0x5588dff40350 2024-08-20T01:34:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.809+0000 7fea2b8c5740 10 client.25499 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:34:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.809+0000 7fea2b8c5740 10 client.25499 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:34:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.809+0000 7fea2b8c5740 20 client.25499 populate_metadata read hostname 'smithi022' 2024-08-20T01:34:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.809+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/3981080890 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5588dff53110 0x5588dff555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.809+0000 7fea2b8c5740 4 client.25499 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:34:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.809+0000 7fea2b8c5740 1 -- 172.21.15.22:0/3981080890 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588dfeb22b0 con 0x5588dff53110 2024-08-20T01:34:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.809+0000 7fea2259c640 1 --2- 172.21.15.22:0/3981080890 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5588dff53110 0x5588dff555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.810+0000 7fea2259c640 1 --2- 172.21.15.22:0/3981080890 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5588dff53110 0x5588dff555d0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2e793dc379d57f1 server_cookie=12ea76ea72a0b457 in_seq=0 out_seq=0 2024-08-20T01:34:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.810+0000 7fea09ffb640 10 client.25499 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:10.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:10 smithi077 ceph-mon[22251]: pgmap v437: 97 pgs: 97 active+clean; 698 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.8 MiB/s wr, 687 op/s 2024-08-20T01:34:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.813+0000 7fea09ffb640 1 -- 172.21.15.22:0/3981080890 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5588dfeb22b0 con 0x5588dff53110 2024-08-20T01:34:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.813+0000 7fea09ffb640 10 client.25499 handle_command_reply: tid=0 2024-08-20T01:34:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.814+0000 7fea2b8c5740 1 client.25499 shutdown 2024-08-20T01:34:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.827+0000 7fea2b8c5740 1 -- 172.21.15.22:0/3981080890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff40350 msgr2=0x5588dff47900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.827+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/3981080890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff40350 0x5588dff47900 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fea18005d00 tx=0x7fea18005850 comp rx=0 tx=0).stop 2024-08-20T01:34:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.830+0000 7fea2b8c5740 1 -- 172.21.15.22:0/3981080890 shutdown_connections 2024-08-20T01:34:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.830+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/3981080890 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5588dff53110 0x5588dff555d0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.830+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/3981080890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff42d90 0x5588dff484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.830+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/3981080890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff40350 0x5588dff47900 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.830+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/3981080890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff3da20 0x5588dff47260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.830+0000 7fea2b8c5740 1 -- 172.21.15.22:0/3981080890 >> 172.21.15.22:0/3981080890 conn(0x5588dff38b70 msgr2=0x5588dff37c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.830+0000 7fea09ffb640 0 client.25499 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.830+0000 7fea2b8c5740 1 -- 172.21.15.22:0/3981080890 shutdown_connections 2024-08-20T01:34:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.830+0000 7fea2b8c5740 1 -- 172.21.15.22:0/3981080890 wait complete. 2024-08-20T01:34:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:10.831+0000 7fea2b8c5740 20 client.25499 trim_cache size 0 max 16384 2024-08-20T01:34:11.036 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.034+0000 7fea2b8c5740 1 Processor -- start 2024-08-20T01:34:11.036 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.035+0000 7fea2b8c5740 1 -- start start 2024-08-20T01:34:11.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.036+0000 7fea2b8c5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff3da20 0x5588dff43170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.037+0000 7fea2b8c5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff40350 0x5588dff436b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.037+0000 7fea2259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff3da20 0x5588dff43170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.037+0000 7fea2259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff3da20 0x5588dff43170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:39758/0 (socket says 172.21.15.22:39758) 2024-08-20T01:34:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.037+0000 7fea2b8c5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff42d90 0x5588dff43bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:11.039 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.037+0000 7fea2259c640 1 -- 172.21.15.22:0/2183746947 learned_addr learned my addr 172.21.15.22:0/2183746947 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:11.039 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.037+0000 7fea22d9d640 1 --2- 172.21.15.22:0/2183746947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff42d90 0x5588dff43bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:11.039 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.037+0000 7fea2b8c5740 1 -- 172.21.15.22:0/2183746947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea04010ff0 con 0x5588dff40350 2024-08-20T01:34:11.039 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.037+0000 7fea2b8c5740 1 -- 172.21.15.22:0/2183746947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea0400e860 con 0x5588dff3da20 2024-08-20T01:34:11.039 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.038+0000 7fea2b8c5740 1 -- 172.21.15.22:0/2183746947 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fea0400c6b0 con 0x5588dff42d90 2024-08-20T01:34:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.038+0000 7fea2259c640 1 -- 172.21.15.22:0/2183746947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff42d90 msgr2=0x5588dff43bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.038+0000 7fea2259c640 1 --2- 172.21.15.22:0/2183746947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff42d90 0x5588dff43bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.038+0000 7fea2259c640 1 -- 172.21.15.22:0/2183746947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff40350 msgr2=0x5588dff436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.038+0000 7fea2259c640 1 --2- 172.21.15.22:0/2183746947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff40350 0x5588dff436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.038+0000 7fea2259c640 1 -- 172.21.15.22:0/2183746947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588dff48840 con 0x5588dff3da20 2024-08-20T01:34:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.038+0000 7fea22d9d640 1 --2- 172.21.15.22:0/2183746947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff42d90 0x5588dff43bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:34:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.039+0000 7fea2259c640 1 --2- 172.21.15.22:0/2183746947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff3da20 0x5588dff43170 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fea1400b960 tx=0x7fea1400b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=523dd4dde9ce7d21 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.052+0000 7fea0bfff640 1 -- 172.21.15.22:0/2183746947 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1400dc40 con 0x5588dff3da20 2024-08-20T01:34:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.053+0000 7fea0bfff640 1 -- 172.21.15.22:0/2183746947 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea14005690 con 0x5588dff3da20 2024-08-20T01:34:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.054+0000 7fea0bfff640 1 -- 172.21.15.22:0/2183746947 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14027460 con 0x5588dff3da20 2024-08-20T01:34:11.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.055+0000 7fea2b8c5740 1 -- 172.21.15.22:0/2183746947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff3da20 msgr2=0x5588dff43170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:11.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.057+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/2183746947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff3da20 0x5588dff43170 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fea1400b960 tx=0x7fea1400b390 comp rx=0 tx=0).stop 2024-08-20T01:34:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.060+0000 7fea2b8c5740 1 -- 172.21.15.22:0/2183746947 shutdown_connections 2024-08-20T01:34:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.061+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/2183746947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff42d90 0x5588dff43bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.061+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/2183746947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff40350 0x5588dff436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.061+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/2183746947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff3da20 0x5588dff43170 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.061+0000 7fea2b8c5740 1 -- 172.21.15.22:0/2183746947 >> 172.21.15.22:0/2183746947 conn(0x5588dff38b70 msgr2=0x5588dff446c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:11.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.066+0000 7fea2b8c5740 1 -- 172.21.15.22:0/2183746947 shutdown_connections 2024-08-20T01:34:11.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.066+0000 7fea2b8c5740 1 -- 172.21.15.22:0/2183746947 wait complete. 2024-08-20T01:34:11.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.067+0000 7fea2b8c5740 1 -- start start 2024-08-20T01:34:11.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.067+0000 7fea2b8c5740 1 Processor -- start 2024-08-20T01:34:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.068+0000 7fea2b8c5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff3da20 0x5588dff4c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.068+0000 7fea2b8c5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff40350 0x5588dff4c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.068+0000 7fea2b8c5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff42d90 0x5588dff4d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:11.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.068+0000 7fea2259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff3da20 0x5588dff4c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:11.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.068+0000 7fea2259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff3da20 0x5588dff4c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:39772/0 (socket says 172.21.15.22:39772) 2024-08-20T01:34:11.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.068+0000 7fea2b8c5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea0400cd20 con 0x5588dff42d90 2024-08-20T01:34:11.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.069+0000 7fea2b8c5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea0400e190 con 0x5588dff3da20 2024-08-20T01:34:11.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.069+0000 7fea2b8c5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fea0400d3f0 con 0x5588dff40350 2024-08-20T01:34:11.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.069+0000 7fea2b8c5740 10 client.0 _ll_register_callbacks cb 0x7fea18014f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:34:11.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.071+0000 7fea22d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff42d90 0x5588dff4d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:11.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.071+0000 7fea22d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff42d90 0x5588dff4d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41890/0 (socket says 172.21.15.22:41890) 2024-08-20T01:34:11.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.071+0000 7fea22d9d640 1 -- 172.21.15.22:0/410422556 learned_addr learned my addr 172.21.15.22:0/410422556 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:11.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.072+0000 7fea22d9d640 1 -- 172.21.15.22:0/410422556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff40350 msgr2=0x5588dff4c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:11.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.072+0000 7fea22d9d640 1 --2- 172.21.15.22:0/410422556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff40350 0x5588dff4c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:11.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.072+0000 7fea22d9d640 1 -- 172.21.15.22:0/410422556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff3da20 msgr2=0x5588dff4c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:11.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.072+0000 7fea22d9d640 1 --2- 172.21.15.22:0/410422556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff3da20 0x5588dff4c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:11.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.072+0000 7fea22d9d640 1 -- 172.21.15.22:0/410422556 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588dff40180 con 0x5588dff42d90 2024-08-20T01:34:11.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.073+0000 7fea22d9d640 1 --2- 172.21.15.22:0/410422556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff42d90 0x5588dff4d240 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0c8d70 tx=0x7fea1c0cb360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b9b5094f559cf7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:11.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.073+0000 7fea09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:34:11.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.073+0000 7fea09ffb640 1 -- 172.21.15.22:0/410422556 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c0cc200 con 0x5588dff42d90 2024-08-20T01:34:11.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.073+0000 7fea2b8c5740 1 -- 172.21.15.22:0/410422556 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5588dfeadd50 con 0x5588dff42d90 2024-08-20T01:34:11.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.074+0000 7fea2259c640 1 --2- 172.21.15.22:0/410422556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff3da20 0x5588dff4c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-08-20T01:34:11.077 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.074+0000 7fea09ffb640 1 -- 172.21.15.22:0/410422556 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fea1c0d4e00 con 0x5588dff42d90 2024-08-20T01:34:11.077 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.075+0000 7fea09ffb640 1 -- 172.21.15.22:0/410422556 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fea1c0cbb00 con 0x5588dff42d90 2024-08-20T01:34:11.077 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.075+0000 7fea2b8c5740 10 client.15924 fetch_fsmap learned FSMap version 29 2024-08-20T01:34:11.077 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.075+0000 7fea2b8c5740 1 -- 172.21.15.22:0/410422556 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5588dff4ec60 con 0x5588dff42d90 2024-08-20T01:34:11.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.076+0000 7fea09ffb640 1 -- 172.21.15.22:0/410422556 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea1c0d0100 con 0x5588dff42d90 2024-08-20T01:34:11.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.077+0000 7fea09ffb640 1 -- 172.21.15.22:0/410422556 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fea1c102b70 con 0x5588dff42d90 2024-08-20T01:34:11.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.078+0000 7fea2b8c5740 10 client.15924 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:34:11.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.078+0000 7fea2b8c5740 10 client.15924 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:34:11.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.078+0000 7fea2b8c5740 20 client.15924 populate_metadata read hostname 'smithi022' 2024-08-20T01:34:11.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.078+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/410422556 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5588dffbde70 0x5588dffc0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:11.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.078+0000 7fea2b8c5740 4 client.15924 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:34:11.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.078+0000 7fea2b8c5740 1 -- 172.21.15.22:0/410422556 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5588dfeadd50 con 0x5588dffbde70 2024-08-20T01:34:11.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.078+0000 7fea2259c640 1 --2- 172.21.15.22:0/410422556 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5588dffbde70 0x5588dffc0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:11.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.079+0000 7fea2259c640 1 --2- 172.21.15.22:0/410422556 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5588dffbde70 0x5588dffc0260 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebb454f5e99e3505 server_cookie=ecaf24620a4f01 in_seq=0 out_seq=0 2024-08-20T01:34:11.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:11.082+0000 7fea09ffb640 10 client.15924 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:12.607 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:12.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:12 smithi134 ceph-mon[22511]: pgmap v438: 97 pgs: 97 active+clean; 769 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 15 MiB/s wr, 973 op/s 2024-08-20T01:34:12.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:12 smithi077 ceph-mon[22251]: pgmap v438: 97 pgs: 97 active+clean; 769 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 15 MiB/s wr, 973 op/s 2024-08-20T01:34:12.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:12 smithi022 ceph-mon[18709]: pgmap v438: 97 pgs: 97 active+clean; 769 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 15 MiB/s wr, 973 op/s 2024-08-20T01:34:14.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:14 smithi134 ceph-mon[22511]: pgmap v439: 97 pgs: 97 active+clean; 819 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 18 MiB/s wr, 1.11k op/s 2024-08-20T01:34:14.811 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:14 smithi022 ceph-mon[18709]: pgmap v439: 97 pgs: 97 active+clean; 819 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 18 MiB/s wr, 1.11k op/s 2024-08-20T01:34:14.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:14 smithi077 ceph-mon[22251]: pgmap v439: 97 pgs: 97 active+clean; 819 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 18 MiB/s wr, 1.11k op/s 2024-08-20T01:34:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.723+0000 7fea09ffb640 1 -- 172.21.15.22:0/410422556 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5588dfeadd50 con 0x5588dffbde70 2024-08-20T01:34:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.723+0000 7fea09ffb640 10 client.15924 handle_command_reply: tid=0 2024-08-20T01:34:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.723+0000 7fea2b8c5740 1 client.15924 shutdown 2024-08-20T01:34:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.723+0000 7fea2b8c5740 1 -- 172.21.15.22:0/410422556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff42d90 msgr2=0x5588dff4d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.723+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/410422556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff42d90 0x5588dff4d240 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0c8d70 tx=0x7fea1c0cb360 comp rx=0 tx=0).stop 2024-08-20T01:34:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.723+0000 7fea2b8c5740 1 -- 172.21.15.22:0/410422556 shutdown_connections 2024-08-20T01:34:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.723+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/410422556 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5588dffbde70 0x5588dffc0260 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.723+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/410422556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5588dff42d90 0x5588dff4d240 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.723+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/410422556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588dff40350 0x5588dff4c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.723+0000 7fea2b8c5740 1 --2- 172.21.15.22:0/410422556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588dff3da20 0x5588dff4c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.723+0000 7fea2b8c5740 1 -- 172.21.15.22:0/410422556 >> 172.21.15.22:0/410422556 conn(0x5588dff38b70 msgr2=0x5588dff37410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.723+0000 7fea09ffb640 0 client.15924 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.724+0000 7fea2b8c5740 1 -- 172.21.15.22:0/410422556 shutdown_connections 2024-08-20T01:34:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.724+0000 7fea2b8c5740 1 -- 172.21.15.22:0/410422556 wait complete. 2024-08-20T01:34:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.724+0000 7fea2b8c5740 20 client.15924 trim_cache size 0 max 16384 2024-08-20T01:34:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:34:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:34:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:34:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:34:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.732+0000 7fea2359e640 1 -- 172.21.15.22:0/168446396 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fea0c0b3dd0 msgr2=0x7fea0c0b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.732+0000 7fea2359e640 1 --2- 172.21.15.22:0/168446396 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fea0c0b3dd0 0x7fea0c0b6290 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fea180058c0 tx=0x7fea1800a550 comp rx=0 tx=0).stop 2024-08-20T01:34:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.734+0000 7fea2359e640 1 -- 172.21.15.22:0/168446396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea241176d0 msgr2=0x7fea24117b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.734+0000 7fea2359e640 1 --2- 172.21.15.22:0/168446396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea241176d0 0x7fea24117b80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009bf0 tx=0x7fea1c031970 comp rx=0 tx=0).stop 2024-08-20T01:34:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.736+0000 7fea2359e640 1 -- 172.21.15.22:0/168446396 shutdown_connections 2024-08-20T01:34:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.736+0000 7fea2359e640 1 --2- 172.21.15.22:0/168446396 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fea0c0b3dd0 0x7fea0c0b6290 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.736+0000 7fea2359e640 1 --2- 172.21.15.22:0/168446396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea241176d0 0x7fea24117b80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.736+0000 7fea2359e640 1 --2- 172.21.15.22:0/168446396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea2410aa30 0x7fea24116aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.736+0000 7fea2359e640 1 --2- 172.21.15.22:0/168446396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea2410a0f0 0x7fea24116450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:15.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.736+0000 7fea2359e640 1 -- 172.21.15.22:0/168446396 >> 172.21.15.22:0/168446396 conn(0x7fea2406f550 msgr2=0x7fea24070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:15.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.737+0000 7fea2359e640 1 -- 172.21.15.22:0/168446396 shutdown_connections 2024-08-20T01:34:15.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:15.737+0000 7fea2359e640 1 -- 172.21.15.22:0/168446396 wait complete. 2024-08-20T01:34:16.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:16 smithi022 ceph-mon[18709]: pgmap v440: 97 pgs: 97 active+clean; 829 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 19 MiB/s wr, 1.22k op/s 2024-08-20T01:34:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.539+0000 7fe06ffff640 1 -- 172.21.15.22:0/3047127055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe07010a3c0 msgr2=0x7fe07010a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.539+0000 7fe06ffff640 1 --2- 172.21.15.22:0/3047127055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe07010a3c0 0x7fe07010a7e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe068009be0 tx=0x7fe06802a710 comp rx=0 tx=0).stop 2024-08-20T01:34:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.540+0000 7fe06ffff640 1 -- 172.21.15.22:0/3047127055 shutdown_connections 2024-08-20T01:34:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.540+0000 7fe06ffff640 1 --2- 172.21.15.22:0/3047127055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe070117680 0x7fe070119b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.540+0000 7fe06ffff640 1 --2- 172.21.15.22:0/3047127055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe07010a3c0 0x7fe07010a7e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.540+0000 7fe06ffff640 1 --2- 172.21.15.22:0/3047127055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe070074c00 0x7fe070109e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.540+0000 7fe06ffff640 1 -- 172.21.15.22:0/3047127055 >> 172.21.15.22:0/3047127055 conn(0x7fe07006c830 msgr2=0x7fe07006cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.542+0000 7fe06ffff640 1 -- 172.21.15.22:0/3047127055 shutdown_connections 2024-08-20T01:34:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.545+0000 7fe06ffff640 1 -- 172.21.15.22:0/3047127055 wait complete. 2024-08-20T01:34:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.546+0000 7fe06ffff640 1 Processor -- start 2024-08-20T01:34:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.547+0000 7fe06ffff640 1 -- start start 2024-08-20T01:34:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.548+0000 7fe06ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe070074c00 0x7fe0701a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:16.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.548+0000 7fe06ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe07010a3c0 0x7fe0701a3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:16.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.548+0000 7fe06ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe070117680 0x7fe0701a90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:16.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.548+0000 7fe06ffff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe07011d390 con 0x7fe070117680 2024-08-20T01:34:16.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.548+0000 7fe06ffff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe07011d210 con 0x7fe07010a3c0 2024-08-20T01:34:16.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.549+0000 7fe06effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe070074c00 0x7fe0701a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:16.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.549+0000 7fe06effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe070074c00 0x7fe0701a3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:48086/0 (socket says 172.21.15.22:48086) 2024-08-20T01:34:16.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.549+0000 7fe06effd640 1 -- 172.21.15.22:0/3974603958 learned_addr learned my addr 172.21.15.22:0/3974603958 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:16.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.549+0000 7fe06e7fc640 1 --2- 172.21.15.22:0/3974603958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe07010a3c0 0x7fe0701a3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:16.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.551+0000 7fe06ffff640 1 -- 172.21.15.22:0/3974603958 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe07011d510 con 0x7fe070074c00 2024-08-20T01:34:16.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.551+0000 7fe06f7fe640 1 --2- 172.21.15.22:0/3974603958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe070117680 0x7fe0701a90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:16.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.551+0000 7fe06effd640 1 -- 172.21.15.22:0/3974603958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe07010a3c0 msgr2=0x7fe0701a3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:16.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.552+0000 7fe06effd640 1 --2- 172.21.15.22:0/3974603958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe07010a3c0 0x7fe0701a3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.552+0000 7fe06effd640 1 -- 172.21.15.22:0/3974603958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe070117680 msgr2=0x7fe0701a90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.552+0000 7fe06effd640 1 --2- 172.21.15.22:0/3974603958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe070117680 0x7fe0701a90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.552+0000 7fe06effd640 1 -- 172.21.15.22:0/3974603958 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0701a98b0 con 0x7fe070074c00 2024-08-20T01:34:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.552+0000 7fe06f7fe640 1 --2- 172.21.15.22:0/3974603958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe070117680 0x7fe0701a90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:34:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.552+0000 7fe06effd640 1 --2- 172.21.15.22:0/3974603958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe070074c00 0x7fe0701a3800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe06400e9c0 tx=0x7fe06400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.552+0000 7fe05ffff640 1 -- 172.21.15.22:0/3974603958 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06400cde0 con 0x7fe070074c00 2024-08-20T01:34:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.553+0000 7fe05ffff640 1 -- 172.21.15.22:0/3974603958 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0640035f0 con 0x7fe070074c00 2024-08-20T01:34:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.553+0000 7fe05ffff640 1 -- 172.21.15.22:0/3974603958 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064010690 con 0x7fe070074c00 2024-08-20T01:34:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.556+0000 7fe06ffff640 1 -- 172.21.15.22:0/3974603958 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0701a9ba0 con 0x7fe070074c00 2024-08-20T01:34:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.556+0000 7fe06ffff640 1 -- 172.21.15.22:0/3974603958 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0701b0260 con 0x7fe070074c00 2024-08-20T01:34:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.561+0000 7fe077b0d740 1 Processor -- start 2024-08-20T01:34:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.561+0000 7fe077b0d740 1 -- start start 2024-08-20T01:34:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.562+0000 7fe077b0d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596a8910a30 0x5596a8910e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.562+0000 7fe077b0d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8911350 0x5596a89255b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.562+0000 7fe077b0d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8925af0 0x5596a8927ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.565+0000 7fe077b0d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5596a8887930 con 0x5596a8911350 2024-08-20T01:34:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.565+0000 7fe077b0d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5596a8876e30 con 0x5596a8925af0 2024-08-20T01:34:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.565+0000 7fe077b0d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5596a887ae70 con 0x5596a8910a30 2024-08-20T01:34:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.565+0000 7fe06e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8925af0 0x5596a8927ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.565+0000 7fe06e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8925af0 0x5596a8927ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:39800/0 (socket says 172.21.15.22:39800) 2024-08-20T01:34:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.565+0000 7fe06e7fc640 1 -- 172.21.15.22:0/1044147798 learned_addr learned my addr 172.21.15.22:0/1044147798 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.567+0000 7fe06e7fc640 1 -- 172.21.15.22:0/1044147798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596a8910a30 msgr2=0x5596a8910e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:34:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.567+0000 7fe06e7fc640 1 --2- 172.21.15.22:0/1044147798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596a8910a30 0x5596a8910e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.567+0000 7fe06e7fc640 1 -- 172.21.15.22:0/1044147798 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8911350 msgr2=0x5596a89255b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.567+0000 7fe06effd640 1 --2- 172.21.15.22:0/1044147798 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8911350 0x5596a89255b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.567+0000 7fe06e7fc640 1 --2- 172.21.15.22:0/1044147798 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8911350 0x5596a89255b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.567+0000 7fe06e7fc640 1 -- 172.21.15.22:0/1044147798 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596a85d6650 con 0x5596a8925af0 2024-08-20T01:34:16.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.567+0000 7fe06effd640 1 --2- 172.21.15.22:0/1044147798 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8911350 0x5596a89255b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:34:16.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.568+0000 7fe06e7fc640 1 --2- 172.21.15.22:0/1044147798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8925af0 0x5596a8927ee0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe068009370 tx=0x7fe068032f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=256a77f3cc28f090 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:16.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.568+0000 7fe05d7fa640 1 -- 172.21.15.22:0/1044147798 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe068041030 con 0x5596a8925af0 2024-08-20T01:34:16.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.569+0000 7fe05d7fa640 1 -- 172.21.15.22:0/1044147798 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe068003e20 con 0x5596a8925af0 2024-08-20T01:34:16.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.570+0000 7fe077b0d740 1 -- 172.21.15.22:0/1044147798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8925af0 msgr2=0x5596a8927ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:16.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.570+0000 7fe077b0d740 1 --2- 172.21.15.22:0/1044147798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8925af0 0x5596a8927ee0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe068009370 tx=0x7fe068032f90 comp rx=0 tx=0).stop 2024-08-20T01:34:16.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.570+0000 7fe077b0d740 1 -- 172.21.15.22:0/1044147798 shutdown_connections 2024-08-20T01:34:16.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.571+0000 7fe077b0d740 1 --2- 172.21.15.22:0/1044147798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8925af0 0x5596a8927ee0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.571+0000 7fe077b0d740 1 --2- 172.21.15.22:0/1044147798 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8911350 0x5596a89255b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.571+0000 7fe077b0d740 1 --2- 172.21.15.22:0/1044147798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596a8910a30 0x5596a8910e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.571+0000 7fe077b0d740 1 -- 172.21.15.22:0/1044147798 >> 172.21.15.22:0/1044147798 conn(0x5596a890e860 msgr2=0x5596a890fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:16.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.571+0000 7fe05ffff640 1 -- 172.21.15.22:0/3974603958 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe0640037a0 con 0x7fe070074c00 2024-08-20T01:34:16.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.572+0000 7fe05ffff640 1 --2- 172.21.15.22:0/3974603958 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe0580b3d70 0x7fe0580b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:16.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.573+0000 7fe077b0d740 1 -- 172.21.15.22:0/1044147798 shutdown_connections 2024-08-20T01:34:16.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.575+0000 7fe06e7fc640 1 --2- 172.21.15.22:0/3974603958 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe0580b3d70 0x7fe0580b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:16.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.576+0000 7fe06e7fc640 1 --2- 172.21.15.22:0/3974603958 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe0580b3d70 0x7fe0580b6230 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe068032ed0 tx=0x7fe0680098b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:16.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.576+0000 7fe077b0d740 1 -- 172.21.15.22:0/1044147798 wait complete. 2024-08-20T01:34:16.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.577+0000 7fe077b0d740 1 -- start start 2024-08-20T01:34:16.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.577+0000 7fe077b0d740 1 Processor -- start 2024-08-20T01:34:16.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.578+0000 7fe077b0d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8910a30 0x5596a8925510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:16.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.578+0000 7fe077b0d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8911350 0x5596a8922960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:16.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.578+0000 7fe077b0d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596a8925af0 0x5596a89230f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:16.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.579+0000 7fe05ffff640 1 -- 172.21.15.22:0/3974603958 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fe0640e4430 con 0x7fe070074c00 2024-08-20T01:34:16.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.579+0000 7fe06effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8910a30 0x5596a8925510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:16.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.579+0000 7fe06effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8910a30 0x5596a8925510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41930/0 (socket says 172.21.15.22:41930) 2024-08-20T01:34:16.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.579+0000 7fe06e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8911350 0x5596a8922960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:16.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.579+0000 7fe077b0d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5596a86d9700 con 0x5596a8910a30 2024-08-20T01:34:16.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.579+0000 7fe077b0d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5596a87fd810 con 0x5596a8911350 2024-08-20T01:34:16.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.579+0000 7fe077b0d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5596a89287b0 con 0x5596a8925af0 2024-08-20T01:34:16.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.579+0000 7fe06e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8911350 0x5596a8922960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:39808/0 (socket says 172.21.15.22:39808) 2024-08-20T01:34:16.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.579+0000 7fe06e7fc640 1 -- 172.21.15.22:0/1275296667 learned_addr learned my addr 172.21.15.22:0/1275296667 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:16.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.579+0000 7fe077b0d740 10 client.0 _ll_register_callbacks cb 0x5596a8870700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:34:16.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.579+0000 7fe06e7fc640 1 -- 172.21.15.22:0/1275296667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596a8925af0 msgr2=0x5596a89230f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:34:16.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.579+0000 7fe06e7fc640 1 --2- 172.21.15.22:0/1275296667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596a8925af0 0x5596a89230f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.579+0000 7fe06e7fc640 1 -- 172.21.15.22:0/1275296667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8910a30 msgr2=0x5596a8925510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:16.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.579+0000 7fe06e7fc640 1 --2- 172.21.15.22:0/1275296667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8910a30 0x5596a8925510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.579+0000 7fe06e7fc640 1 -- 172.21.15.22:0/1275296667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596a8931b30 con 0x5596a8911350 2024-08-20T01:34:16.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.580+0000 7fe06e7fc640 1 --2- 172.21.15.22:0/1275296667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8911350 0x5596a8922960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe068030a90 tx=0x7fe068032f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b40372f7ccf08e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:16.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.581+0000 7fe0527fc640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:34:16.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.581+0000 7fe0527fc640 1 -- 172.21.15.22:0/1275296667 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06804a070 con 0x5596a8911350 2024-08-20T01:34:16.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.581+0000 7fe077b0d740 1 -- 172.21.15.22:0/1275296667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5596a8826150 con 0x5596a8911350 2024-08-20T01:34:16.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.582+0000 7fe0527fc640 1 -- 172.21.15.22:0/1275296667 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fe068004410 con 0x5596a8911350 2024-08-20T01:34:16.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.582+0000 7fe0527fc640 1 -- 172.21.15.22:0/1275296667 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe068041040 con 0x5596a8911350 2024-08-20T01:34:16.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.582+0000 7fe077b0d740 10 client.25511 fetch_fsmap learned FSMap version 29 2024-08-20T01:34:16.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.582+0000 7fe077b0d740 1 -- 172.21.15.22:0/1275296667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5596a89343a0 con 0x5596a8911350 2024-08-20T01:34:16.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.582+0000 7fe0527fc640 1 -- 172.21.15.22:0/1275296667 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5596a8826150 con 0x5596a8911350 2024-08-20T01:34:16.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.583+0000 7fe0527fc640 1 -- 172.21.15.22:0/1275296667 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe06803db80 con 0x5596a8911350 2024-08-20T01:34:16.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.583+0000 7fe077b0d740 10 client.25511 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:34:16.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.583+0000 7fe077b0d740 10 client.25511 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:34:16.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.583+0000 7fe077b0d740 20 client.25511 populate_metadata read hostname 'smithi022' 2024-08-20T01:34:16.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.583+0000 7fe077b0d740 1 --2- 172.21.15.22:0/1275296667 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5596a8935a20 0x5596a8937ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:16.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.583+0000 7fe077b0d740 4 client.25511 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:34:16.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.583+0000 7fe077b0d740 1 -- 172.21.15.22:0/1275296667 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596a8889880 con 0x5596a8935a20 2024-08-20T01:34:16.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.584+0000 7fe06effd640 1 --2- 172.21.15.22:0/1275296667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8910a30 0x5596a8925510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:34:16.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.584+0000 7fe06effd640 1 --2- 172.21.15.22:0/1275296667 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5596a8935a20 0x5596a8937ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:16.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.588+0000 7fe06effd640 1 --2- 172.21.15.22:0/1275296667 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5596a8935a20 0x5596a8937ee0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=759b8b07971cc78c server_cookie=caf1da186c86f53e in_seq=0 out_seq=0 2024-08-20T01:34:16.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.588+0000 7fe0527fc640 10 client.25511 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:34:16.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.589+0000 7fe0527fc640 1 -- 172.21.15.22:0/1275296667 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5596a8889880 con 0x5596a8935a20 2024-08-20T01:34:16.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.589+0000 7fe0527fc640 10 client.25511 handle_command_reply: tid=0 2024-08-20T01:34:16.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.589+0000 7fe077b0d740 1 client.25511 shutdown 2024-08-20T01:34:16.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.589+0000 7fe077b0d740 1 -- 172.21.15.22:0/1275296667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8911350 msgr2=0x5596a8922960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:16.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.589+0000 7fe077b0d740 1 --2- 172.21.15.22:0/1275296667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8911350 0x5596a8922960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe068030a90 tx=0x7fe068032f90 comp rx=0 tx=0).stop 2024-08-20T01:34:16.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.590+0000 7fe077b0d740 1 -- 172.21.15.22:0/1275296667 shutdown_connections 2024-08-20T01:34:16.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.590+0000 7fe077b0d740 1 --2- 172.21.15.22:0/1275296667 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5596a8935a20 0x5596a8937ee0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.590+0000 7fe077b0d740 1 --2- 172.21.15.22:0/1275296667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596a8925af0 0x5596a89230f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.590+0000 7fe077b0d740 1 --2- 172.21.15.22:0/1275296667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8911350 0x5596a8922960 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.590+0000 7fe077b0d740 1 --2- 172.21.15.22:0/1275296667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8910a30 0x5596a8925510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.590+0000 7fe077b0d740 1 -- 172.21.15.22:0/1275296667 >> 172.21.15.22:0/1275296667 conn(0x5596a890e860 msgr2=0x5596a8914400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:16.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.590+0000 7fe0527fc640 0 client.25511 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:34:16.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.590+0000 7fe077b0d740 1 -- 172.21.15.22:0/1275296667 shutdown_connections 2024-08-20T01:34:16.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.592+0000 7fe077b0d740 1 -- 172.21.15.22:0/1275296667 wait complete. 2024-08-20T01:34:16.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.592+0000 7fe077b0d740 20 client.25511 trim_cache size 0 max 16384 2024-08-20T01:34:16.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.648+0000 7fe077b0d740 1 Processor -- start 2024-08-20T01:34:16.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.648+0000 7fe077b0d740 1 -- start start 2024-08-20T01:34:16.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.649+0000 7fe077b0d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596a8910a30 0x5596a89221f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:16.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.649+0000 7fe077b0d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8911350 0x5596a8923f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:16.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.650+0000 7fe06effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596a8910a30 0x5596a89221f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:16.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.650+0000 7fe06effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596a8910a30 0x5596a89221f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:48112/0 (socket says 172.21.15.22:48112) 2024-08-20T01:34:16.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.650+0000 7fe06e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8911350 0x5596a8923f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:16.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.650+0000 7fe06e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8911350 0x5596a8923f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41942/0 (socket says 172.21.15.22:41942) 2024-08-20T01:34:16.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.650+0000 7fe06effd640 1 -- 172.21.15.22:0/1872667647 learned_addr learned my addr 172.21.15.22:0/1872667647 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:16.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.650+0000 7fe077b0d740 1 --2- 172.21.15.22:0/1872667647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8925af0 0x5596a89244d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:16.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.651+0000 7fe077b0d740 1 -- 172.21.15.22:0/1872667647 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701b6fe0 con 0x5596a8911350 2024-08-20T01:34:16.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.651+0000 7fe06f7fe640 1 --2- 172.21.15.22:0/1872667647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8925af0 0x5596a89244d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:16.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.651+0000 7fe077b0d740 1 -- 172.21.15.22:0/1872667647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701b4850 con 0x5596a8925af0 2024-08-20T01:34:16.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.651+0000 7fe077b0d740 1 -- 172.21.15.22:0/1872667647 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701b2700 con 0x5596a8910a30 2024-08-20T01:34:16.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.654+0000 7fe06f7fe640 1 -- 172.21.15.22:0/1872667647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596a8910a30 msgr2=0x5596a89221f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:16.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.654+0000 7fe06f7fe640 1 --2- 172.21.15.22:0/1872667647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596a8910a30 0x5596a89221f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.654+0000 7fe06f7fe640 1 -- 172.21.15.22:0/1872667647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8911350 msgr2=0x5596a8923f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:16.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.654+0000 7fe06f7fe640 1 --2- 172.21.15.22:0/1872667647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8911350 0x5596a8923f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.654+0000 7fe06f7fe640 1 -- 172.21.15.22:0/1872667647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596a8923460 con 0x5596a8925af0 2024-08-20T01:34:16.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.655+0000 7fe06f7fe640 1 --2- 172.21.15.22:0/1872667647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8925af0 0x5596a89244d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe06000a6f0 tx=0x7fe06000abb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1938ff09753147b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:16.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.655+0000 7fe05cff9640 1 -- 172.21.15.22:0/1872667647 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060015070 con 0x5596a8925af0 2024-08-20T01:34:16.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.655+0000 7fe05cff9640 1 -- 172.21.15.22:0/1872667647 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe06000cdf0 con 0x5596a8925af0 2024-08-20T01:34:16.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.655+0000 7fe05cff9640 1 -- 172.21.15.22:0/1872667647 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0600185c0 con 0x5596a8925af0 2024-08-20T01:34:16.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.656+0000 7fe077b0d740 1 -- 172.21.15.22:0/1872667647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8925af0 msgr2=0x5596a89244d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:16.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.656+0000 7fe077b0d740 1 --2- 172.21.15.22:0/1872667647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8925af0 0x5596a89244d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe06000a6f0 tx=0x7fe06000abb0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.661+0000 7fe077b0d740 1 -- 172.21.15.22:0/1872667647 shutdown_connections 2024-08-20T01:34:16.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.661+0000 7fe077b0d740 1 --2- 172.21.15.22:0/1872667647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8925af0 0x5596a89244d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.661+0000 7fe077b0d740 1 --2- 172.21.15.22:0/1872667647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8911350 0x5596a8923f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.661+0000 7fe077b0d740 1 --2- 172.21.15.22:0/1872667647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596a8910a30 0x5596a89221f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.661+0000 7fe077b0d740 1 -- 172.21.15.22:0/1872667647 >> 172.21.15.22:0/1872667647 conn(0x5596a890e860 msgr2=0x5596a8926a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:16.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.664+0000 7fe077b0d740 1 -- 172.21.15.22:0/1872667647 shutdown_connections 2024-08-20T01:34:16.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.668+0000 7fe077b0d740 1 -- 172.21.15.22:0/1872667647 wait complete. 2024-08-20T01:34:16.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.669+0000 7fe077b0d740 1 -- start start 2024-08-20T01:34:16.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.669+0000 7fe077b0d740 1 Processor -- start 2024-08-20T01:34:16.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.670+0000 7fe077b0d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596a8910a30 0x5596a8912db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:16.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.670+0000 7fe077b0d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8911350 0x5596a8913330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:16.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.670+0000 7fe077b0d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8925af0 0x5596a893d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:16.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.670+0000 7fe077b0d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701b2d50 con 0x5596a8925af0 2024-08-20T01:34:16.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.670+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8925af0 0x5596a893d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:16.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.670+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8925af0 0x5596a893d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41952/0 (socket says 172.21.15.22:41952) 2024-08-20T01:34:16.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.670+0000 7fe06f7fe640 1 -- 172.21.15.22:0/3192046525 learned_addr learned my addr 172.21.15.22:0/3192046525 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:16.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.670+0000 7fe077b0d740 1 -- 172.21.15.22:0/3192046525 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701b4180 con 0x5596a8911350 2024-08-20T01:34:16.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.670+0000 7fe077b0d740 1 -- 172.21.15.22:0/3192046525 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701b33e0 con 0x5596a8910a30 2024-08-20T01:34:16.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.671+0000 7fe077b0d740 10 client.0 _ll_register_callbacks cb 0x7fe068009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:34:16.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.673+0000 7fe06f7fe640 1 -- 172.21.15.22:0/3192046525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596a8910a30 msgr2=0x5596a8912db0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:34:16.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.673+0000 7fe06f7fe640 1 --2- 172.21.15.22:0/3192046525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596a8910a30 0x5596a8912db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.673+0000 7fe06f7fe640 1 -- 172.21.15.22:0/3192046525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8911350 msgr2=0x5596a8913330 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:34:16.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.673+0000 7fe06f7fe640 1 --2- 172.21.15.22:0/3192046525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8911350 0x5596a8913330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.673+0000 7fe06f7fe640 1 -- 172.21.15.22:0/3192046525 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596a893e1e0 con 0x5596a8925af0 2024-08-20T01:34:16.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.674+0000 7fe06f7fe640 1 --2- 172.21.15.22:0/3192046525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8925af0 0x5596a893d9b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe060006ed0 tx=0x7fe060011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b840766e3f6336d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:16.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.674+0000 7fe0527fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:34:16.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.675+0000 7fe0527fc640 1 -- 172.21.15.22:0/3192046525 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060029060 con 0x5596a8925af0 2024-08-20T01:34:16.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.675+0000 7fe0527fc640 1 -- 172.21.15.22:0/3192046525 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fe0600115f0 con 0x5596a8925af0 2024-08-20T01:34:16.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.675+0000 7fe077b0d740 1 -- 172.21.15.22:0/3192046525 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe06000cdf0 con 0x5596a8925af0 2024-08-20T01:34:16.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.676+0000 7fe0527fc640 1 -- 172.21.15.22:0/3192046525 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe060015040 con 0x5596a8925af0 2024-08-20T01:34:16.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.680+0000 7fe077b0d740 10 client.15933 fetch_fsmap learned FSMap version 29 2024-08-20T01:34:16.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.680+0000 7fe077b0d740 1 -- 172.21.15.22:0/3192046525 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5596a8911ae0 con 0x5596a8925af0 2024-08-20T01:34:16.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.686+0000 7fe0527fc640 1 -- 172.21.15.22:0/3192046525 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe06000cdf0 con 0x5596a8925af0 2024-08-20T01:34:16.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.686+0000 7fe0527fc640 1 -- 172.21.15.22:0/3192046525 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe06002f440 con 0x5596a8925af0 2024-08-20T01:34:16.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.690+0000 7fe077b0d740 10 client.15933 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:34:16.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.690+0000 7fe077b0d740 10 client.15933 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:34:16.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.690+0000 7fe077b0d740 20 client.15933 populate_metadata read hostname 'smithi022' 2024-08-20T01:34:16.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.690+0000 7fe077b0d740 1 --2- 172.21.15.22:0/3192046525 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5596a8912120 0x5596a8912550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:16.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.690+0000 7fe077b0d740 4 client.15933 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:34:16.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.690+0000 7fe077b0d740 1 -- 172.21.15.22:0/3192046525 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5596a8885320 con 0x5596a8912120 2024-08-20T01:34:16.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.692+0000 7fe06effd640 1 --2- 172.21.15.22:0/3192046525 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5596a8912120 0x5596a8912550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:16.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.695+0000 7fe06effd640 1 --2- 172.21.15.22:0/3192046525 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5596a8912120 0x5596a8912550 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c9e776834e90aa75 server_cookie=99fcd066e1bb5c45 in_seq=0 out_seq=0 2024-08-20T01:34:16.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.695+0000 7fe0527fc640 10 client.15933 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:34:16.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.695+0000 7fe0527fc640 1 -- 172.21.15.22:0/3192046525 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5596a8885320 con 0x5596a8912120 2024-08-20T01:34:16.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.695+0000 7fe0527fc640 10 client.15933 handle_command_reply: tid=0 2024-08-20T01:34:16.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.697+0000 7fe077b0d740 1 client.15933 shutdown 2024-08-20T01:34:16.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.701+0000 7fe077b0d740 1 -- 172.21.15.22:0/3192046525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8925af0 msgr2=0x5596a893d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:16.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.701+0000 7fe077b0d740 1 --2- 172.21.15.22:0/3192046525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8925af0 0x5596a893d9b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe060006ed0 tx=0x7fe060011a60 comp rx=0 tx=0).stop 2024-08-20T01:34:16.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.702+0000 7fe077b0d740 1 -- 172.21.15.22:0/3192046525 shutdown_connections 2024-08-20T01:34:16.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.702+0000 7fe077b0d740 1 --2- 172.21.15.22:0/3192046525 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5596a8912120 0x5596a8912550 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.702+0000 7fe077b0d740 1 --2- 172.21.15.22:0/3192046525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596a8925af0 0x5596a893d9b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.702+0000 7fe077b0d740 1 --2- 172.21.15.22:0/3192046525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5596a8911350 0x5596a8913330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.702+0000 7fe077b0d740 1 --2- 172.21.15.22:0/3192046525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596a8910a30 0x5596a8912db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.702+0000 7fe077b0d740 1 -- 172.21.15.22:0/3192046525 >> 172.21.15.22:0/3192046525 conn(0x5596a890e860 msgr2=0x5596a8923f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:16.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.703+0000 7fe0527fc640 0 client.15933 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:34:16.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.703+0000 7fe077b0d740 1 -- 172.21.15.22:0/3192046525 shutdown_connections 2024-08-20T01:34:16.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.704+0000 7fe077b0d740 1 -- 172.21.15.22:0/3192046525 wait complete. 2024-08-20T01:34:16.707 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:34:16.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.705+0000 7fe077b0d740 20 client.15933 trim_cache size 0 max 16384 2024-08-20T01:34:16.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.707+0000 7fe06ffff640 1 -- 172.21.15.22:0/3974603958 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe0580b3d70 msgr2=0x7fe0580b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:16.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.707+0000 7fe06ffff640 1 --2- 172.21.15.22:0/3974603958 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe0580b3d70 0x7fe0580b6230 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe068032ed0 tx=0x7fe0680098b0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.707+0000 7fe06ffff640 1 -- 172.21.15.22:0/3974603958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe070074c00 msgr2=0x7fe0701a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:16.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.707+0000 7fe06ffff640 1 --2- 172.21.15.22:0/3974603958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe070074c00 0x7fe0701a3800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe06400e9c0 tx=0x7fe06400ee80 comp rx=0 tx=0).stop 2024-08-20T01:34:16.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.713+0000 7fe06ffff640 1 -- 172.21.15.22:0/3974603958 shutdown_connections 2024-08-20T01:34:16.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.713+0000 7fe06ffff640 1 --2- 172.21.15.22:0/3974603958 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe0580b3d70 0x7fe0580b6230 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.713+0000 7fe06ffff640 1 --2- 172.21.15.22:0/3974603958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe070117680 0x7fe0701a90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.713+0000 7fe06ffff640 1 --2- 172.21.15.22:0/3974603958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe07010a3c0 0x7fe0701a3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.713+0000 7fe06ffff640 1 --2- 172.21.15.22:0/3974603958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe070074c00 0x7fe0701a3800 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:16.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.713+0000 7fe06ffff640 1 -- 172.21.15.22:0/3974603958 >> 172.21.15.22:0/3974603958 conn(0x7fe07006c830 msgr2=0x7fe070118c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:16.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.714+0000 7fe06ffff640 1 -- 172.21.15.22:0/3974603958 shutdown_connections 2024-08-20T01:34:16.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:16.718+0000 7fe06ffff640 1 -- 172.21.15.22:0/3974603958 wait complete. 2024-08-20T01:34:16.765 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:16 smithi134 ceph-mon[22511]: pgmap v440: 97 pgs: 97 active+clean; 829 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 19 MiB/s wr, 1.22k op/s 2024-08-20T01:34:16.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:16 smithi077 ceph-mon[22251]: pgmap v440: 97 pgs: 97 active+clean; 829 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 19 MiB/s wr, 1.22k op/s 2024-08-20T01:34:18.378 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:34:18.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:18 smithi022 ceph-mon[18709]: pgmap v441: 97 pgs: 97 active+clean; 861 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 24 MiB/s wr, 1.93k op/s 2024-08-20T01:34:18.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:18 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:34:18.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:18 smithi077 ceph-mon[22251]: pgmap v441: 97 pgs: 97 active+clean; 861 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 24 MiB/s wr, 1.93k op/s 2024-08-20T01:34:18.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:18 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:34:19.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:18 smithi134 ceph-mon[22511]: pgmap v441: 97 pgs: 97 active+clean; 861 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 24 MiB/s wr, 1.93k op/s 2024-08-20T01:34:19.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:18 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:34:20.023 INFO:tasks.workunit.client.0.smithi022.stdout: 266 1777392 1027 1273551 910 586653 1463 2024-08-20T01:34:20.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:20 smithi077 ceph-mon[22251]: pgmap v442: 97 pgs: 97 active+clean; 861 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 18 MiB/s wr, 1.64k op/s 2024-08-20T01:34:20.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:20 smithi022 ceph-mon[18709]: pgmap v442: 97 pgs: 97 active+clean; 861 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 18 MiB/s wr, 1.64k op/s 2024-08-20T01:34:21.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:20 smithi134 ceph-mon[22511]: pgmap v442: 97 pgs: 97 active+clean; 861 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 18 MiB/s wr, 1.64k op/s 2024-08-20T01:34:22.715 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:22.802 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:22 smithi022 ceph-mon[18709]: pgmap v443: 97 pgs: 97 active+clean; 861 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 18 MiB/s wr, 1.70k op/s 2024-08-20T01:34:22.820 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:22 smithi077 ceph-mon[22251]: pgmap v443: 97 pgs: 97 active+clean; 861 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 18 MiB/s wr, 1.70k op/s 2024-08-20T01:34:23.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:22 smithi134 ceph-mon[22511]: pgmap v443: 97 pgs: 97 active+clean; 861 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 18 MiB/s wr, 1.70k op/s 2024-08-20T01:34:23.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.634+0000 7f7bd5ffb640 1 -- 172.21.15.22:0/3617909562 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd002e320 con 0x7f7bd811bdd0 2024-08-20T01:34:23.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.634+0000 7f7bdd85f640 1 -- 172.21.15.22:0/3617909562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd811bdd0 msgr2=0x7f7bd811e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:23.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.634+0000 7f7bdd85f640 1 --2- 172.21.15.22:0/3617909562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd811bdd0 0x7f7bd811e1c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0009ca0 tx=0x7f7bd002a970 comp rx=0 tx=0).stop 2024-08-20T01:34:23.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.635+0000 7f7bdd85f640 1 -- 172.21.15.22:0/3617909562 shutdown_connections 2024-08-20T01:34:23.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.635+0000 7f7bdd85f640 1 --2- 172.21.15.22:0/3617909562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd811bdd0 0x7f7bd811e1c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.635+0000 7f7bdd85f640 1 --2- 172.21.15.22:0/3617909562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bd810a260 0x7f7bd810a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.635+0000 7f7bdd85f640 1 --2- 172.21.15.22:0/3617909562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bd8109e80 0x7f7bd8110ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.635+0000 7f7bdd85f640 1 -- 172.21.15.22:0/3617909562 >> 172.21.15.22:0/3617909562 conn(0x7f7bd806dcc0 msgr2=0x7f7bd806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:23.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.635+0000 7f7bdd85f640 1 -- 172.21.15.22:0/3617909562 shutdown_connections 2024-08-20T01:34:23.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.635+0000 7f7bdd85f640 1 -- 172.21.15.22:0/3617909562 wait complete. 2024-08-20T01:34:23.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.635+0000 7f7bdd85f640 1 Processor -- start 2024-08-20T01:34:23.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.636+0000 7f7bdd85f640 1 -- start start 2024-08-20T01:34:23.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.636+0000 7f7bdd85f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bd8109e80 0x7f7bd81a7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:23.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.636+0000 7f7bdd85f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bd810a260 0x7f7bd81a8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:23.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.636+0000 7f7bdd85f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd811bdd0 0x7f7bd81ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:23.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.636+0000 7f7bdd85f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd81218f0 con 0x7f7bd8109e80 2024-08-20T01:34:23.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.636+0000 7f7bdd85f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd8121770 con 0x7f7bd811bdd0 2024-08-20T01:34:23.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.636+0000 7f7bdd85f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd8121a70 con 0x7f7bd810a260 2024-08-20T01:34:23.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.636+0000 7f7bd77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd811bdd0 0x7f7bd81ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:23.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.637+0000 7f7bd77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd811bdd0 0x7f7bd81ad6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:54226/0 (socket says 172.21.15.22:54226) 2024-08-20T01:34:23.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.637+0000 7f7bd77fe640 1 -- 172.21.15.22:0/4248290220 learned_addr learned my addr 172.21.15.22:0/4248290220 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:23.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.637+0000 7f7bd67fc640 1 --2- 172.21.15.22:0/4248290220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bd810a260 0x7f7bd81a8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:23.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.637+0000 7f7bd6ffd640 1 --2- 172.21.15.22:0/4248290220 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bd8109e80 0x7f7bd81a7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:23.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.637+0000 7f7bd77fe640 1 -- 172.21.15.22:0/4248290220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bd810a260 msgr2=0x7f7bd81a8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:23.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.637+0000 7f7bd77fe640 1 --2- 172.21.15.22:0/4248290220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bd810a260 0x7f7bd81a8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.637+0000 7f7bd77fe640 1 -- 172.21.15.22:0/4248290220 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bd8109e80 msgr2=0x7f7bd81a7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:23.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.637+0000 7f7bd77fe640 1 --2- 172.21.15.22:0/4248290220 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bd8109e80 0x7f7bd81a7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.637+0000 7f7bd77fe640 1 -- 172.21.15.22:0/4248290220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd81adeb0 con 0x7f7bd811bdd0 2024-08-20T01:34:23.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.637+0000 7f7bd77fe640 1 --2- 172.21.15.22:0/4248290220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd811bdd0 0x7f7bd81ad6e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00098d0 tx=0x7f7bd002f960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:23.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.638+0000 7f7bdc85d640 1 -- 172.21.15.22:0/4248290220 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0034050 con 0x7f7bd811bdd0 2024-08-20T01:34:23.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.638+0000 7f7bdd85f640 1 -- 172.21.15.22:0/4248290220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd81ae140 con 0x7f7bd811bdd0 2024-08-20T01:34:23.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.638+0000 7f7bdd85f640 1 -- 172.21.15.22:0/4248290220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd81b4860 con 0x7f7bd811bdd0 2024-08-20T01:34:23.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.638+0000 7f7bdc85d640 1 -- 172.21.15.22:0/4248290220 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bd0030b00 con 0x7f7bd811bdd0 2024-08-20T01:34:23.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.638+0000 7f7bdc85d640 1 -- 172.21.15.22:0/4248290220 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0039e40 con 0x7f7bd811bdd0 2024-08-20T01:34:23.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.643+0000 7f7bdfc58740 1 Processor -- start 2024-08-20T01:34:23.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.644+0000 7f7bdc85d640 1 -- 172.21.15.22:0/4248290220 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7bd0037020 con 0x7f7bd811bdd0 2024-08-20T01:34:23.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.645+0000 7f7bdfc58740 1 -- start start 2024-08-20T01:34:23.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.645+0000 7f7bdfc58740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf0106880 0x55daf0106c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:23.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.645+0000 7f7bdfc58740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf01071a0 0x55daf0112bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:23.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.645+0000 7f7bdfc58740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0113130 0x55daf0115520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:23.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.645+0000 7f7bdfc58740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55daf007d930 con 0x55daf01071a0 2024-08-20T01:34:23.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.645+0000 7f7bdfc58740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55daf006ce30 con 0x55daf0106880 2024-08-20T01:34:23.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.645+0000 7f7bdfc58740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55daf0070e70 con 0x55daf0113130 2024-08-20T01:34:23.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.645+0000 7f7bd6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf01071a0 0x55daf0112bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:23.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.645+0000 7f7bd6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf01071a0 0x55daf0112bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55126/0 (socket says 172.21.15.22:55126) 2024-08-20T01:34:23.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.645+0000 7f7bd6ffd640 1 -- 172.21.15.22:0/2608108490 learned_addr learned my addr 172.21.15.22:0/2608108490 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.645+0000 7f7bd67fc640 1 --2- 172.21.15.22:0/2608108490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf0106880 0x55daf0106c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.646+0000 7f7bd67fc640 1 --2- 172.21.15.22:0/2608108490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0113130 0x55daf0115520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.646+0000 7f7bd6ffd640 1 -- 172.21.15.22:0/2608108490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0113130 msgr2=0x55daf0115520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.646+0000 7f7bdc85d640 1 --2- 172.21.15.22:0/4248290220 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f7bc00b3c90 0x7f7bc00b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.646+0000 7f7bd6ffd640 1 --2- 172.21.15.22:0/2608108490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0113130 0x55daf0115520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.646+0000 7f7bd6ffd640 1 -- 172.21.15.22:0/2608108490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf0106880 msgr2=0x55daf0106c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.646+0000 7f7bd6ffd640 1 --2- 172.21.15.22:0/2608108490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf0106880 0x55daf0106c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.646+0000 7f7bd6ffd640 1 -- 172.21.15.22:0/2608108490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daefdcc650 con 0x55daf01071a0 2024-08-20T01:34:23.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.646+0000 7f7bd67fc640 1 --2- 172.21.15.22:0/2608108490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf0106880 0x55daf0106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:34:23.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.647+0000 7f7bdc85d640 1 -- 172.21.15.22:0/4248290220 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f7bd0104870 con 0x7f7bd811bdd0 2024-08-20T01:34:23.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.647+0000 7f7bd6ffd640 1 --2- 172.21.15.22:0/2608108490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf01071a0 0x55daf0112bf0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8009d20 tx=0x7f7bc8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5390a5e02cb2ef10 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:23.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.647+0000 7f7bd77fe640 1 --2- 172.21.15.22:0/4248290220 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f7bc00b3c90 0x7f7bc00b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:23.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.648+0000 7f7bbdffb640 1 -- 172.21.15.22:0/2608108490 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8004230 con 0x55daf01071a0 2024-08-20T01:34:23.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.648+0000 7f7bbdffb640 1 -- 172.21.15.22:0/2608108490 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bc80043d0 con 0x55daf01071a0 2024-08-20T01:34:23.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.649+0000 7f7bbdffb640 1 -- 172.21.15.22:0/2608108490 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc80198c0 con 0x55daf01071a0 2024-08-20T01:34:23.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.649+0000 7f7bdfc58740 1 -- 172.21.15.22:0/2608108490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf01071a0 msgr2=0x55daf0112bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:23.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.649+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/2608108490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf01071a0 0x55daf0112bf0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8009d20 tx=0x7f7bc8011810 comp rx=0 tx=0).stop 2024-08-20T01:34:23.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.650+0000 7f7bd77fe640 1 --2- 172.21.15.22:0/4248290220 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f7bc00b3c90 0x7f7bc00b6150 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0005e30 tx=0x7f7bd002a970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:23.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.650+0000 7f7bdfc58740 1 -- 172.21.15.22:0/2608108490 shutdown_connections 2024-08-20T01:34:23.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.650+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/2608108490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0113130 0x55daf0115520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.650+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/2608108490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf01071a0 0x55daf0112bf0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.650+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/2608108490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf0106880 0x55daf0106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.650+0000 7f7bdfc58740 1 -- 172.21.15.22:0/2608108490 >> 172.21.15.22:0/2608108490 conn(0x55daf01046b0 msgr2=0x55daf0105850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:23.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.651+0000 7f7bdfc58740 1 -- 172.21.15.22:0/2608108490 shutdown_connections 2024-08-20T01:34:23.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.651+0000 7f7bdfc58740 1 -- 172.21.15.22:0/2608108490 wait complete. 2024-08-20T01:34:23.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.652+0000 7f7bdfc58740 1 -- start start 2024-08-20T01:34:23.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.653+0000 7f7bdfc58740 1 Processor -- start 2024-08-20T01:34:23.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.653+0000 7f7bdfc58740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0106880 0x55daf0112b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:23.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.653+0000 7f7bd67fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0106880 0x55daf0112b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:23.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.654+0000 7f7bd67fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0106880 0x55daf0112b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:38802/0 (socket says 172.21.15.22:38802) 2024-08-20T01:34:23.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.654+0000 7f7bd67fc640 1 -- 172.21.15.22:0/703466442 learned_addr learned my addr 172.21.15.22:0/703466442 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:23.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.654+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/703466442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf01071a0 0x55daf010ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:23.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.654+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/703466442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf0113130 0x55daf0110730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:23.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.654+0000 7f7bd6ffd640 1 --2- 172.21.15.22:0/703466442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf01071a0 0x55daf010ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:23.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.654+0000 7f7bdfc58740 1 -- 172.21.15.22:0/703466442 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55daefecf700 con 0x55daf01071a0 2024-08-20T01:34:23.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.654+0000 7f7bdfc58740 1 -- 172.21.15.22:0/703466442 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55daefff3810 con 0x55daf0113130 2024-08-20T01:34:23.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.654+0000 7f7bdfc58740 1 -- 172.21.15.22:0/703466442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55daf0115e30 con 0x55daf0106880 2024-08-20T01:34:23.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.655+0000 7f7bd67fc640 1 --2- 172.21.15.22:0/703466442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf0113130 0x55daf0110730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:23.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.655+0000 7f7bd67fc640 1 -- 172.21.15.22:0/703466442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf0113130 msgr2=0x55daf0110730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:23.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.655+0000 7f7bd67fc640 1 --2- 172.21.15.22:0/703466442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf0113130 0x55daf0110730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.655+0000 7f7bd67fc640 1 -- 172.21.15.22:0/703466442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf01071a0 msgr2=0x55daf010ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:23.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.655+0000 7f7bd67fc640 1 --2- 172.21.15.22:0/703466442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf01071a0 0x55daf010ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.655+0000 7f7bd67fc640 1 -- 172.21.15.22:0/703466442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daf011f240 con 0x55daf0106880 2024-08-20T01:34:23.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.655+0000 7f7bd67fc640 1 --2- 172.21.15.22:0/703466442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0106880 0x55daf0112b50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc019b40 tx=0x7f7bcc009110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=216cb9154c23e4a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:23.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.655+0000 7f7bb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:34:23.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.656+0000 7f7bdfc58740 10 client.0 _ll_register_callbacks cb 0x55daf0066700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:34:23.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.656+0000 7f7bdfc58740 1 -- 172.21.15.22:0/703466442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55daf001c150 con 0x55daf0106880 2024-08-20T01:34:23.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.656+0000 7f7bb6ffd640 1 -- 172.21.15.22:0/703466442 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc028050 con 0x55daf0106880 2024-08-20T01:34:23.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.656+0000 7f7bb6ffd640 1 -- 172.21.15.22:0/703466442 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f7bcc013860 con 0x55daf0106880 2024-08-20T01:34:23.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.657+0000 7f7bb6ffd640 1 -- 172.21.15.22:0/703466442 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7bcc01e070 con 0x55daf0106880 2024-08-20T01:34:23.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.657+0000 7f7bdfc58740 10 client.25543 fetch_fsmap learned FSMap version 29 2024-08-20T01:34:23.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.657+0000 7f7bdfc58740 1 -- 172.21.15.22:0/703466442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55daf0121a20 con 0x55daf0106880 2024-08-20T01:34:23.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.657+0000 7f7bb6ffd640 1 -- 172.21.15.22:0/703466442 <== mon.1 v2:172.21.15.134:3300/0 4 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7bcc015050 con 0x55daf0106880 2024-08-20T01:34:23.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.657+0000 7f7bdfc58740 10 client.25543 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:34:23.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.657+0000 7f7bdfc58740 10 client.25543 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:34:23.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.657+0000 7f7bdfc58740 20 client.25543 populate_metadata read hostname 'smithi022' 2024-08-20T01:34:23.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.657+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/703466442 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55daf0122e20 0x55daf01252e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:23.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.657+0000 7f7bdfc58740 4 client.25543 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:34:23.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.657+0000 7f7bdfc58740 1 -- 172.21.15.22:0/703466442 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55daf001c150 con 0x55daf0122e20 2024-08-20T01:34:23.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.658+0000 7f7bd6ffd640 1 --2- 172.21.15.22:0/703466442 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55daf0122e20 0x55daf01252e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:23.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.658+0000 7f7bb6ffd640 10 client.25543 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:23.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.658+0000 7f7bd6ffd640 1 --2- 172.21.15.22:0/703466442 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55daf0122e20 0x55daf01252e0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23dc2a75075ecce7 server_cookie=f21752e66a2db497 in_seq=0 out_seq=0 2024-08-20T01:34:23.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.663+0000 7f7bb6ffd640 1 -- 172.21.15.22:0/703466442 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55daf001c150 con 0x55daf0122e20 2024-08-20T01:34:23.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.663+0000 7f7bb6ffd640 10 client.25543 handle_command_reply: tid=0 2024-08-20T01:34:23.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.663+0000 7f7bdfc58740 1 client.25543 shutdown 2024-08-20T01:34:23.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.664+0000 7f7bdfc58740 1 -- 172.21.15.22:0/703466442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0106880 msgr2=0x55daf0112b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:23.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.664+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/703466442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0106880 0x55daf0112b50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc019b40 tx=0x7f7bcc009110 comp rx=0 tx=0).stop 2024-08-20T01:34:23.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.664+0000 7f7bdfc58740 1 -- 172.21.15.22:0/703466442 shutdown_connections 2024-08-20T01:34:23.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.664+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/703466442 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55daf0122e20 0x55daf01252e0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.664+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/703466442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf0113130 0x55daf0110730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.664+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/703466442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf01071a0 0x55daf010ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.664+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/703466442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0106880 0x55daf0112b50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.664+0000 7f7bdfc58740 1 -- 172.21.15.22:0/703466442 >> 172.21.15.22:0/703466442 conn(0x55daf01046b0 msgr2=0x55daf010a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:23.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.664+0000 7f7bb6ffd640 0 client.25543 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:23.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.664+0000 7f7bdfc58740 1 -- 172.21.15.22:0/703466442 shutdown_connections 2024-08-20T01:34:23.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.664+0000 7f7bdfc58740 1 -- 172.21.15.22:0/703466442 wait complete. 2024-08-20T01:34:23.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.665+0000 7f7bdfc58740 20 client.25543 trim_cache size 0 max 16384 2024-08-20T01:34:23.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.693+0000 7f7bdfc58740 1 Processor -- start 2024-08-20T01:34:23.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.693+0000 7f7bdfc58740 1 -- start start 2024-08-20T01:34:23.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.694+0000 7f7bdfc58740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0106880 0x55daf01055a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:23.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.694+0000 7f7bdfc58740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf01071a0 0x55daf0105ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:23.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.694+0000 7f7bd67fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0106880 0x55daf01055a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:23.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.694+0000 7f7bd67fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0106880 0x55daf01055a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:38818/0 (socket says 172.21.15.22:38818) 2024-08-20T01:34:23.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.695+0000 7f7bd67fc640 1 -- 172.21.15.22:0/1632851555 learned_addr learned my addr 172.21.15.22:0/1632851555 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:23.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.695+0000 7f7bd6ffd640 1 --2- 172.21.15.22:0/1632851555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf01071a0 0x55daf0105ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:23.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.695+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/1632851555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf0113130 0x55daf012abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:23.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.695+0000 7f7bdfc58740 1 -- 172.21.15.22:0/1632851555 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc4010f00 con 0x55daf0113130 2024-08-20T01:34:23.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.695+0000 7f7bdfc58740 1 -- 172.21.15.22:0/1632851555 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc400e770 con 0x55daf01071a0 2024-08-20T01:34:23.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.695+0000 7f7bdfc58740 1 -- 172.21.15.22:0/1632851555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc400c5c0 con 0x55daf0106880 2024-08-20T01:34:23.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.696+0000 7f7bd67fc640 1 -- 172.21.15.22:0/1632851555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf01071a0 msgr2=0x55daf0105ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:23.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.696+0000 7f7bd67fc640 1 --2- 172.21.15.22:0/1632851555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf01071a0 0x55daf0105ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.696+0000 7f7bd67fc640 1 -- 172.21.15.22:0/1632851555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf0113130 msgr2=0x55daf012abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:23.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.696+0000 7f7bd67fc640 1 --2- 172.21.15.22:0/1632851555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf0113130 0x55daf012abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.696+0000 7f7bd67fc640 1 -- 172.21.15.22:0/1632851555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daf0110aa0 con 0x55daf0106880 2024-08-20T01:34:23.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.696+0000 7f7bd67fc640 1 --2- 172.21.15.22:0/1632851555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0106880 0x55daf01055a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc013b50 tx=0x7f7bcc0047d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=787f1cce607dc309 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:23.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.697+0000 7f7bbd7fa640 1 -- 172.21.15.22:0/1632851555 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc031070 con 0x55daf0106880 2024-08-20T01:34:23.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.697+0000 7f7bbd7fa640 1 -- 172.21.15.22:0/1632851555 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bcc013e70 con 0x55daf0106880 2024-08-20T01:34:23.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.697+0000 7f7bbd7fa640 1 -- 172.21.15.22:0/1632851555 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc028040 con 0x55daf0106880 2024-08-20T01:34:23.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.699+0000 7f7bdfc58740 1 -- 172.21.15.22:0/1632851555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0106880 msgr2=0x55daf01055a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:23.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.700+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/1632851555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0106880 0x55daf01055a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc013b50 tx=0x7f7bcc0047d0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.702+0000 7f7bdfc58740 1 -- 172.21.15.22:0/1632851555 shutdown_connections 2024-08-20T01:34:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.702+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/1632851555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf0113130 0x55daf012abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.702+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/1632851555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf01071a0 0x55daf0105ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.702+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/1632851555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0106880 0x55daf01055a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.702+0000 7f7bdfc58740 1 -- 172.21.15.22:0/1632851555 >> 172.21.15.22:0/1632851555 conn(0x55daf01046b0 msgr2=0x55daf010b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:23.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.705+0000 7f7bdfc58740 1 -- 172.21.15.22:0/1632851555 shutdown_connections 2024-08-20T01:34:23.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.705+0000 7f7bdfc58740 1 -- 172.21.15.22:0/1632851555 wait complete. 2024-08-20T01:34:23.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.706+0000 7f7bdfc58740 1 -- start start 2024-08-20T01:34:23.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.706+0000 7f7bdfc58740 1 Processor -- start 2024-08-20T01:34:23.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.707+0000 7f7bdfc58740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf0106880 0x55daf011b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:23.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.707+0000 7f7bdfc58740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf01071a0 0x55daf011b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:23.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.708+0000 7f7bd67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf0106880 0x55daf011b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:23.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.708+0000 7f7bd67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf0106880 0x55daf011b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55154/0 (socket says 172.21.15.22:55154) 2024-08-20T01:34:23.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.708+0000 7f7bd6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf01071a0 0x55daf011b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:23.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.708+0000 7f7bd6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf01071a0 0x55daf011b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:54262/0 (socket says 172.21.15.22:54262) 2024-08-20T01:34:23.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.708+0000 7f7bdfc58740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0113130 0x55daf0113cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:23.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.708+0000 7f7bd67fc640 1 -- 172.21.15.22:0/3819952692 learned_addr learned my addr 172.21.15.22:0/3819952692 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:23.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.708+0000 7f7bdfc58740 1 -- 172.21.15.22:0/3819952692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc400cc30 con 0x55daf0106880 2024-08-20T01:34:23.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.708+0000 7f7bdfc58740 1 -- 172.21.15.22:0/3819952692 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc400e0a0 con 0x55daf01071a0 2024-08-20T01:34:23.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.708+0000 7f7bdfc58740 1 -- 172.21.15.22:0/3819952692 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc400d300 con 0x55daf0113130 2024-08-20T01:34:23.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.708+0000 7f7bdfc58740 10 client.0 _ll_register_callbacks cb 0x7f7bcc019750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:34:23.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.710+0000 7f7bd67fc640 1 --2- 172.21.15.22:0/3819952692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0113130 0x55daf0113cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:23.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.710+0000 7f7bd6ffd640 1 -- 172.21.15.22:0/3819952692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0113130 msgr2=0x55daf0113cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:23.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.710+0000 7f7bd6ffd640 1 --2- 172.21.15.22:0/3819952692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0113130 0x55daf0113cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.710+0000 7f7bd6ffd640 1 -- 172.21.15.22:0/3819952692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf0106880 msgr2=0x55daf011b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:23.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.710+0000 7f7bd6ffd640 1 --2- 172.21.15.22:0/3819952692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf0106880 0x55daf011b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.710+0000 7f7bd6ffd640 1 -- 172.21.15.22:0/3819952692 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daf0114430 con 0x55daf01071a0 2024-08-20T01:34:23.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.710+0000 7f7bd67fc640 1 --2- 172.21.15.22:0/3819952692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0113130 0x55daf0113cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:34:23.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.711+0000 7f7bd6ffd640 1 --2- 172.21.15.22:0/3819952692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf01071a0 0x55daf011b790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7bc801b040 tx=0x7f7bc8003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18c8d49eeedb2e09 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:23.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.712+0000 7f7bb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:34:23.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.712+0000 7f7bb6ffd640 1 -- 172.21.15.22:0/3819952692 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8009910 con 0x55daf01071a0 2024-08-20T01:34:23.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.712+0000 7f7bb6ffd640 1 -- 172.21.15.22:0/3819952692 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f7bc80035f0 con 0x55daf01071a0 2024-08-20T01:34:23.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.715+0000 7f7bdfc58740 1 -- 172.21.15.22:0/3819952692 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bcc013e70 con 0x55daf01071a0 2024-08-20T01:34:23.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.719+0000 7f7bb6ffd640 1 -- 172.21.15.22:0/3819952692 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7bc8003810 con 0x55daf01071a0 2024-08-20T01:34:23.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.719+0000 7f7bdfc58740 10 client.25532 fetch_fsmap learned FSMap version 29 2024-08-20T01:34:23.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.719+0000 7f7bdfc58740 1 -- 172.21.15.22:0/3819952692 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55daf011a9b0 con 0x55daf01071a0 2024-08-20T01:34:23.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.721+0000 7f7bb6ffd640 1 -- 172.21.15.22:0/3819952692 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bc802f070 con 0x55daf01071a0 2024-08-20T01:34:23.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.721+0000 7f7bb6ffd640 1 -- 172.21.15.22:0/3819952692 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7bc802bb40 con 0x55daf01071a0 2024-08-20T01:34:23.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.721+0000 7f7bdfc58740 10 client.25532 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:34:23.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.721+0000 7f7bdfc58740 10 client.25532 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:34:23.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.721+0000 7f7bdfc58740 20 client.25532 populate_metadata read hostname 'smithi022' 2024-08-20T01:34:23.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.721+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/3819952692 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55daf018dda0 0x55daf01901c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:23.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.721+0000 7f7bdfc58740 4 client.25532 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:34:23.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.721+0000 7f7bdfc58740 1 -- 172.21.15.22:0/3819952692 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f7bcc013e70 con 0x55daf018dda0 2024-08-20T01:34:23.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.722+0000 7f7bd67fc640 1 --2- 172.21.15.22:0/3819952692 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55daf018dda0 0x55daf01901c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:23.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.727+0000 7f7bd67fc640 1 --2- 172.21.15.22:0/3819952692 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55daf018dda0 0x55daf01901c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4520bf7dbd75e048 server_cookie=9f1cbc7bb2c45e99 in_seq=0 out_seq=0 2024-08-20T01:34:23.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.728+0000 7f7bb6ffd640 10 client.25532 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:23.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.737+0000 7f7bb6ffd640 1 -- 172.21.15.22:0/3819952692 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f7bcc013e70 con 0x55daf018dda0 2024-08-20T01:34:23.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.737+0000 7f7bb6ffd640 10 client.25532 handle_command_reply: tid=0 2024-08-20T01:34:23.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.737+0000 7f7bdfc58740 1 client.25532 shutdown 2024-08-20T01:34:23.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.741+0000 7f7bdfc58740 1 -- 172.21.15.22:0/3819952692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf01071a0 msgr2=0x55daf011b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:23.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.741+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/3819952692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf01071a0 0x55daf011b790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7bc801b040 tx=0x7f7bc8003f10 comp rx=0 tx=0).stop 2024-08-20T01:34:23.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.741+0000 7f7bdfc58740 1 -- 172.21.15.22:0/3819952692 shutdown_connections 2024-08-20T01:34:23.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.741+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/3819952692 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55daf018dda0 0x55daf01901c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.742+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/3819952692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf0113130 0x55daf0113cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.742+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/3819952692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55daf01071a0 0x55daf011b790 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.742+0000 7f7bdfc58740 1 --2- 172.21.15.22:0/3819952692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55daf0106880 0x55daf011b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.742+0000 7f7bdfc58740 1 -- 172.21.15.22:0/3819952692 >> 172.21.15.22:0/3819952692 conn(0x55daf01046b0 msgr2=0x55daf01055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:23.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.742+0000 7f7bb6ffd640 0 client.25532 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:23.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.742+0000 7f7bdfc58740 1 -- 172.21.15.22:0/3819952692 shutdown_connections 2024-08-20T01:34:23.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.742+0000 7f7bdfc58740 1 -- 172.21.15.22:0/3819952692 wait complete. 2024-08-20T01:34:23.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.743+0000 7f7bdfc58740 20 client.25532 trim_cache size 0 max 16384 2024-08-20T01:34:23.746 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:34:23.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.746+0000 7f7bdd85f640 1 -- 172.21.15.22:0/4248290220 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f7bc00b3c90 msgr2=0x7f7bc00b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:23.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.746+0000 7f7bdd85f640 1 --2- 172.21.15.22:0/4248290220 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f7bc00b3c90 0x7f7bc00b6150 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0005e30 tx=0x7f7bd002a970 comp rx=0 tx=0).stop 2024-08-20T01:34:23.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.746+0000 7f7bdd85f640 1 -- 172.21.15.22:0/4248290220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd811bdd0 msgr2=0x7f7bd81ad6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:23.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.746+0000 7f7bdd85f640 1 --2- 172.21.15.22:0/4248290220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd811bdd0 0x7f7bd81ad6e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00098d0 tx=0x7f7bd002f960 comp rx=0 tx=0).stop 2024-08-20T01:34:23.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.749+0000 7f7bdd85f640 1 -- 172.21.15.22:0/4248290220 shutdown_connections 2024-08-20T01:34:23.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.749+0000 7f7bdd85f640 1 --2- 172.21.15.22:0/4248290220 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f7bc00b3c90 0x7f7bc00b6150 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.749+0000 7f7bdd85f640 1 --2- 172.21.15.22:0/4248290220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd811bdd0 0x7f7bd81ad6e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.749+0000 7f7bdd85f640 1 --2- 172.21.15.22:0/4248290220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bd810a260 0x7f7bd81a8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.749+0000 7f7bdd85f640 1 --2- 172.21.15.22:0/4248290220 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bd8109e80 0x7f7bd81a7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:23.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.749+0000 7f7bdd85f640 1 -- 172.21.15.22:0/4248290220 >> 172.21.15.22:0/4248290220 conn(0x7f7bd806dcc0 msgr2=0x7f7bd811c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:23.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.754+0000 7f7bdd85f640 1 -- 172.21.15.22:0/4248290220 shutdown_connections 2024-08-20T01:34:23.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:23.754+0000 7f7bdd85f640 1 -- 172.21.15.22:0/4248290220 wait complete. 2024-08-20T01:34:24.529 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:24 smithi022 ceph-mon[18709]: pgmap v444: 97 pgs: 97 active+clean; 861 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 12 MiB/s wr, 1.40k op/s 2024-08-20T01:34:24.530 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:24.530 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:34:24.530 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:24 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:34:24.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:24 smithi077 ceph-mon[22251]: pgmap v444: 97 pgs: 97 active+clean; 861 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 12 MiB/s wr, 1.40k op/s 2024-08-20T01:34:24.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:24.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:34:24.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:24 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:34:25.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:24 smithi134 ceph-mon[22511]: pgmap v444: 97 pgs: 97 active+clean; 861 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 12 MiB/s wr, 1.40k op/s 2024-08-20T01:34:25.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:25.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:34:25.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:24 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:34:25.953 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:34:25.953 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:34:26.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:26 smithi077 ceph-mon[22251]: pgmap v445: 97 pgs: 97 active+clean; 866 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.7 MiB/s wr, 1.17k op/s 2024-08-20T01:34:26.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:26 smithi022 ceph-mon[18709]: pgmap v445: 97 pgs: 97 active+clean; 866 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.7 MiB/s wr, 1.17k op/s 2024-08-20T01:34:27.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:26 smithi134 ceph-mon[22511]: pgmap v445: 97 pgs: 97 active+clean; 866 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.7 MiB/s wr, 1.17k op/s 2024-08-20T01:34:28.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:28 smithi077 ceph-mon[22251]: pgmap v446: 97 pgs: 97 active+clean; 876 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 7.9 MiB/s wr, 1.23k op/s 2024-08-20T01:34:28.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:28 smithi022 ceph-mon[18709]: pgmap v446: 97 pgs: 97 active+clean; 876 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 7.9 MiB/s wr, 1.23k op/s 2024-08-20T01:34:29.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:28 smithi134 ceph-mon[22511]: pgmap v446: 97 pgs: 97 active+clean; 876 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 7.9 MiB/s wr, 1.23k op/s 2024-08-20T01:34:30.023 INFO:tasks.workunit.client.0.smithi022.stdout: 302 2125880 1955 1499483 1741 694077 2237 2024-08-20T01:34:30.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.669+0000 7fc62e467640 1 -- 172.21.15.22:0/2993445168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc62810aa30 msgr2=0x7fc628073b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:30.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.669+0000 7fc62e467640 1 --2- 172.21.15.22:0/2993445168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc62810aa30 0x7fc628073b40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009950 tx=0x7fc61c02a460 comp rx=0 tx=0).stop 2024-08-20T01:34:30.675 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.673+0000 7fc62e467640 1 -- 172.21.15.22:0/2993445168 shutdown_connections 2024-08-20T01:34:30.675 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.673+0000 7fc62e467640 1 --2- 172.21.15.22:0/2993445168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc628074230 0x7fc628119dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.675 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.673+0000 7fc62e467640 1 --2- 172.21.15.22:0/2993445168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc62810aa30 0x7fc628073b40 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.675 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.673+0000 7fc62e467640 1 --2- 172.21.15.22:0/2993445168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc62810a0f0 0x7fc62810a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.675 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.673+0000 7fc62e467640 1 -- 172.21.15.22:0/2993445168 >> 172.21.15.22:0/2993445168 conn(0x7fc62806f580 msgr2=0x7fc6280719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:30.676 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.674+0000 7fc62e467640 1 -- 172.21.15.22:0/2993445168 shutdown_connections 2024-08-20T01:34:30.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.674+0000 7fc62e467640 1 -- 172.21.15.22:0/2993445168 wait complete. 2024-08-20T01:34:30.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.675+0000 7fc62e467640 1 Processor -- start 2024-08-20T01:34:30.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.675+0000 7fc62e467640 1 -- start start 2024-08-20T01:34:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.676+0000 7fc62e467640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc628074230 0x7fc6281165d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.676+0000 7fc62e467640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc62810a0f0 0x7fc628116c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.676+0000 7fc62e467640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc62810aa30 0x7fc628117850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.676+0000 7fc62e467640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc62811cf90 con 0x7fc628074230 2024-08-20T01:34:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.676+0000 7fc62e467640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc62811ce10 con 0x7fc62810aa30 2024-08-20T01:34:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.676+0000 7fc62e467640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc62811d110 con 0x7fc62810a0f0 2024-08-20T01:34:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.676+0000 7fc62ca04640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc62810aa30 0x7fc628117850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.676+0000 7fc62ca04640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc62810aa30 0x7fc628117850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:42110/0 (socket says 172.21.15.22:42110) 2024-08-20T01:34:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.676+0000 7fc62ca04640 1 -- 172.21.15.22:0/2852173596 learned_addr learned my addr 172.21.15.22:0/2852173596 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.676+0000 7fc6277fe640 1 --2- 172.21.15.22:0/2852173596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc62810a0f0 0x7fc628116c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.676+0000 7fc627fff640 1 --2- 172.21.15.22:0/2852173596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc628074230 0x7fc6281165d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.677+0000 7fc6277fe640 1 -- 172.21.15.22:0/2852173596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc62810aa30 msgr2=0x7fc628117850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:30.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.677+0000 7fc6277fe640 1 --2- 172.21.15.22:0/2852173596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc62810aa30 0x7fc628117850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.677+0000 7fc6277fe640 1 -- 172.21.15.22:0/2852173596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc628074230 msgr2=0x7fc6281165d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.677+0000 7fc6277fe640 1 --2- 172.21.15.22:0/2852173596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc628074230 0x7fc6281165d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.677+0000 7fc6277fe640 1 -- 172.21.15.22:0/2852173596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc628118110 con 0x7fc62810a0f0 2024-08-20T01:34:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.677+0000 7fc627fff640 1 --2- 172.21.15.22:0/2852173596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc628074230 0x7fc6281165d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:34:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.677+0000 7fc62ca04640 1 --2- 172.21.15.22:0/2852173596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc62810aa30 0x7fc628117850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:34:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.677+0000 7fc6277fe640 1 --2- 172.21.15.22:0/2852173596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc62810a0f0 0x7fc628116c20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc61c031500 tx=0x7fc61c004950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:30.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.690+0000 7fc6257fa640 1 -- 172.21.15.22:0/2852173596 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c040070 con 0x7fc62810a0f0 2024-08-20T01:34:30.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.690+0000 7fc62e467640 1 -- 172.21.15.22:0/2852173596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6281183a0 con 0x7fc62810a0f0 2024-08-20T01:34:30.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.690+0000 7fc62e467640 1 -- 172.21.15.22:0/2852173596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc628118aa0 con 0x7fc62810a0f0 2024-08-20T01:34:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.695+0000 7fc631262740 1 Processor -- start 2024-08-20T01:34:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.695+0000 7fc6257fa640 1 -- 172.21.15.22:0/2852173596 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc61c0054d0 con 0x7fc62810a0f0 2024-08-20T01:34:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.695+0000 7fc6257fa640 1 -- 172.21.15.22:0/2852173596 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c035030 con 0x7fc62810a0f0 2024-08-20T01:34:30.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.697+0000 7fc631262740 1 -- start start 2024-08-20T01:34:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.698+0000 7fc631262740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97a810 0x55eabf97cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.701+0000 7fc62ca04640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97a810 0x55eabf97cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.701+0000 7fc62ca04640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97a810 0x55eabf97cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44542/0 (socket says 172.21.15.22:44542) 2024-08-20T01:34:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.701+0000 7fc62ca04640 1 -- 172.21.15.22:0/4251770457 learned_addr learned my addr 172.21.15.22:0/4251770457 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.701+0000 7fc631262740 1 --2- 172.21.15.22:0/4251770457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf97d140 0x55eabf97f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.701+0000 7fc631262740 1 --2- 172.21.15.22:0/4251770457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf97fb80 0x55eabf982040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.701+0000 7fc631262740 1 -- 172.21.15.22:0/4251770457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55eabf8ed360 con 0x55eabf97a810 2024-08-20T01:34:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.701+0000 7fc631262740 1 -- 172.21.15.22:0/4251770457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55eabf8dc860 con 0x55eabf97d140 2024-08-20T01:34:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.701+0000 7fc631262740 1 -- 172.21.15.22:0/4251770457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55eabf8e08a0 con 0x55eabf97fb80 2024-08-20T01:34:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.701+0000 7fc627fff640 1 --2- 172.21.15.22:0/4251770457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf97d140 0x55eabf97f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.701+0000 7fc6277fe640 1 --2- 172.21.15.22:0/4251770457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf97fb80 0x55eabf982040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.702+0000 7fc627fff640 1 -- 172.21.15.22:0/4251770457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf97fb80 msgr2=0x55eabf982040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.702+0000 7fc627fff640 1 --2- 172.21.15.22:0/4251770457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf97fb80 0x55eabf982040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.702+0000 7fc627fff640 1 -- 172.21.15.22:0/4251770457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97a810 msgr2=0x55eabf97cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.702+0000 7fc627fff640 1 --2- 172.21.15.22:0/4251770457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97a810 0x55eabf97cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.702+0000 7fc6257fa640 1 -- 172.21.15.22:0/2852173596 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc61c043070 con 0x7fc62810a0f0 2024-08-20T01:34:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.702+0000 7fc627fff640 1 -- 172.21.15.22:0/4251770457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eabf883e40 con 0x55eabf97d140 2024-08-20T01:34:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.702+0000 7fc6277fe640 1 --2- 172.21.15.22:0/4251770457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf97fb80 0x55eabf982040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:34:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.702+0000 7fc62ca04640 1 --2- 172.21.15.22:0/4251770457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97a810 0x55eabf97cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:34:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.702+0000 7fc627fff640 1 --2- 172.21.15.22:0/4251770457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf97d140 0x55eabf97f530 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc61800bc80 tx=0x7fc61800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b55351208c9bdc14 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.704+0000 7fc6257fa640 1 --2- 172.21.15.22:0/2852173596 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc6100b3dd0 0x7fc6100b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.704+0000 7fc62ca04640 1 --2- 172.21.15.22:0/2852173596 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc6100b3dd0 0x7fc6100b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.704+0000 7fc6257fa640 1 -- 172.21.15.22:0/2852173596 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fc61c104780 con 0x7fc62810a0f0 2024-08-20T01:34:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.705+0000 7fc62ca04640 1 --2- 172.21.15.22:0/2852173596 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc6100b3dd0 0x7fc6100b6290 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc6200077d0 tx=0x7fc6200099f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:30.710 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.708+0000 7fc6167fc640 1 -- 172.21.15.22:0/4251770457 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc618015070 con 0x55eabf97d140 2024-08-20T01:34:30.710 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.708+0000 7fc6167fc640 1 -- 172.21.15.22:0/4251770457 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc61801a910 con 0x55eabf97d140 2024-08-20T01:34:30.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.709+0000 7fc631262740 1 -- 172.21.15.22:0/4251770457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf97d140 msgr2=0x55eabf97f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:30.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.709+0000 7fc631262740 1 --2- 172.21.15.22:0/4251770457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf97d140 0x55eabf97f530 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc61800bc80 tx=0x7fc61800f730 comp rx=0 tx=0).stop 2024-08-20T01:34:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.709+0000 7fc631262740 1 -- 172.21.15.22:0/4251770457 shutdown_connections 2024-08-20T01:34:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.709+0000 7fc631262740 1 --2- 172.21.15.22:0/4251770457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf97fb80 0x55eabf982040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.709+0000 7fc631262740 1 --2- 172.21.15.22:0/4251770457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf97d140 0x55eabf97f530 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.709+0000 7fc631262740 1 --2- 172.21.15.22:0/4251770457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97a810 0x55eabf97cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.709+0000 7fc631262740 1 -- 172.21.15.22:0/4251770457 >> 172.21.15.22:0/4251770457 conn(0x55eabf975960 msgr2=0x55eabf9766f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:30.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.736+0000 7fc631262740 1 -- 172.21.15.22:0/4251770457 shutdown_connections 2024-08-20T01:34:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.736+0000 7fc631262740 1 -- 172.21.15.22:0/4251770457 wait complete. 2024-08-20T01:34:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.736+0000 7fc631262740 1 -- start start 2024-08-20T01:34:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.737+0000 7fc631262740 1 Processor -- start 2024-08-20T01:34:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.737+0000 7fc631262740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf97a810 0x55eabf984010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.737+0000 7fc631262740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf97fb80 0x55eabf9846b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.737+0000 7fc631262740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf985260 0x55eabf9856e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.737+0000 7fc631262740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55eabf815ab0 con 0x55eabf985260 2024-08-20T01:34:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.737+0000 7fc631262740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55eabf863780 con 0x55eabf97fb80 2024-08-20T01:34:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.737+0000 7fc631262740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55eabf982bb0 con 0x55eabf97a810 2024-08-20T01:34:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.737+0000 7fc631262740 10 client.0 _ll_register_callbacks cb 0x55eabf5eba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:34:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.738+0000 7fc627fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf97a810 0x55eabf984010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.738+0000 7fc627fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf97a810 0x55eabf984010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:58170/0 (socket says 172.21.15.22:58170) 2024-08-20T01:34:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.738+0000 7fc627fff640 1 -- 172.21.15.22:0/3708121947 learned_addr learned my addr 172.21.15.22:0/3708121947 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.738+0000 7fc6277fe640 1 --2- 172.21.15.22:0/3708121947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf97fb80 0x55eabf9846b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.738+0000 7fc62ca04640 1 --2- 172.21.15.22:0/3708121947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf985260 0x55eabf9856e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.738+0000 7fc6277fe640 1 -- 172.21.15.22:0/3708121947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf97a810 msgr2=0x55eabf984010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.738+0000 7fc6277fe640 1 --2- 172.21.15.22:0/3708121947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf97a810 0x55eabf984010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.738+0000 7fc6277fe640 1 -- 172.21.15.22:0/3708121947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf985260 msgr2=0x55eabf9856e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.738+0000 7fc6277fe640 1 --2- 172.21.15.22:0/3708121947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf985260 0x55eabf9856e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.738+0000 7fc6277fe640 1 -- 172.21.15.22:0/3708121947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eabf63f790 con 0x55eabf97fb80 2024-08-20T01:34:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.739+0000 7fc6277fe640 1 --2- 172.21.15.22:0/3708121947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf97fb80 0x55eabf9846b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009950 tx=0x7fc61c009560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95ee533ecb7fb28c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:30.745 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.743+0000 7fc60b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:34:30.745 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.743+0000 7fc60b7fe640 1 -- 172.21.15.22:0/3708121947 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c04a040 con 0x55eabf97fb80 2024-08-20T01:34:30.745 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.743+0000 7fc631262740 1 -- 172.21.15.22:0/3708121947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eabf88be00 con 0x55eabf97fb80 2024-08-20T01:34:30.745 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.743+0000 7fc60b7fe640 1 -- 172.21.15.22:0/3708121947 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fc61c031640 con 0x55eabf97fb80 2024-08-20T01:34:30.746 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.743+0000 7fc60b7fe640 1 -- 172.21.15.22:0/3708121947 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc61c0caf80 con 0x55eabf97fb80 2024-08-20T01:34:30.746 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.744+0000 7fc631262740 10 client.25541 fetch_fsmap learned FSMap version 29 2024-08-20T01:34:30.746 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.744+0000 7fc631262740 1 -- 172.21.15.22:0/3708121947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55eabf6b8620 con 0x55eabf97fb80 2024-08-20T01:34:30.747 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.744+0000 7fc60b7fe640 1 -- 172.21.15.22:0/3708121947 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55eabf88be00 con 0x55eabf97fb80 2024-08-20T01:34:30.747 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.744+0000 7fc60b7fe640 1 -- 172.21.15.22:0/3708121947 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc61c03a040 con 0x55eabf97fb80 2024-08-20T01:34:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.744+0000 7fc631262740 10 client.25541 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:34:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.744+0000 7fc631262740 10 client.25541 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:34:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.745+0000 7fc631262740 20 client.25541 populate_metadata read hostname 'smithi022' 2024-08-20T01:34:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.745+0000 7fc631262740 1 --2- 172.21.15.22:0/3708121947 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55eabf98fe60 0x55eabf992300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.745+0000 7fc631262740 4 client.25541 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:34:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.745+0000 7fc631262740 1 -- 172.21.15.22:0/3708121947 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eabf8ef2b0 con 0x55eabf98fe60 2024-08-20T01:34:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.746+0000 7fc627fff640 1 --2- 172.21.15.22:0/3708121947 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55eabf98fe60 0x55eabf992300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.746+0000 7fc627fff640 1 --2- 172.21.15.22:0/3708121947 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55eabf98fe60 0x55eabf992300 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea43ba6bdffce9a7 server_cookie=f55fd15e75d9aea5 in_seq=0 out_seq=0 2024-08-20T01:34:30.751 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.749+0000 7fc60b7fe640 10 client.25541 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:30.753 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.751+0000 7fc60b7fe640 1 -- 172.21.15.22:0/3708121947 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eabf8ef2b0 con 0x55eabf98fe60 2024-08-20T01:34:30.753 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.751+0000 7fc60b7fe640 10 client.25541 handle_command_reply: tid=0 2024-08-20T01:34:30.754 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.751+0000 7fc631262740 1 client.25541 shutdown 2024-08-20T01:34:30.754 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.751+0000 7fc631262740 1 -- 172.21.15.22:0/3708121947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf97fb80 msgr2=0x55eabf9846b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:30.754 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.751+0000 7fc631262740 1 --2- 172.21.15.22:0/3708121947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf97fb80 0x55eabf9846b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009950 tx=0x7fc61c009560 comp rx=0 tx=0).stop 2024-08-20T01:34:30.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.751+0000 7fc631262740 1 -- 172.21.15.22:0/3708121947 shutdown_connections 2024-08-20T01:34:30.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.751+0000 7fc631262740 1 --2- 172.21.15.22:0/3708121947 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55eabf98fe60 0x55eabf992300 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.751+0000 7fc631262740 1 --2- 172.21.15.22:0/3708121947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf985260 0x55eabf9856e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.751+0000 7fc631262740 1 --2- 172.21.15.22:0/3708121947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf97fb80 0x55eabf9846b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.751+0000 7fc631262740 1 --2- 172.21.15.22:0/3708121947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf97a810 0x55eabf984010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.751+0000 7fc631262740 1 -- 172.21.15.22:0/3708121947 >> 172.21.15.22:0/3708121947 conn(0x55eabf975960 msgr2=0x55eabf974a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:30.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.752+0000 7fc60b7fe640 0 client.25541 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:30.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.752+0000 7fc631262740 1 -- 172.21.15.22:0/3708121947 shutdown_connections 2024-08-20T01:34:30.756 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.752+0000 7fc631262740 1 -- 172.21.15.22:0/3708121947 wait complete. 2024-08-20T01:34:30.756 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.752+0000 7fc631262740 20 client.25541 trim_cache size 0 max 16384 2024-08-20T01:34:30.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:30 smithi077 ceph-mon[22251]: pgmap v447: 97 pgs: 97 active+clean; 876 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.5 MiB/s wr, 466 op/s 2024-08-20T01:34:30.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.816+0000 7fc631262740 1 Processor -- start 2024-08-20T01:34:30.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.816+0000 7fc631262740 1 -- start start 2024-08-20T01:34:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.827+0000 7fc631262740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf97a810 0x55eabf970a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.828+0000 7fc631262740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97fb80 0x55eabf97b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.829+0000 7fc627fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf97a810 0x55eabf970a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.829+0000 7fc627fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf97a810 0x55eabf970a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:58174/0 (socket says 172.21.15.22:58174) 2024-08-20T01:34:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.829+0000 7fc6277fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97fb80 0x55eabf97b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.829+0000 7fc6277fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97fb80 0x55eabf97b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44550/0 (socket says 172.21.15.22:44550) 2024-08-20T01:34:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.829+0000 7fc627fff640 1 -- 172.21.15.22:0/3079803070 learned_addr learned my addr 172.21.15.22:0/3079803070 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.829+0000 7fc631262740 1 --2- 172.21.15.22:0/3079803070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf985260 0x55eabf97bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.830+0000 7fc631262740 1 -- 172.21.15.22:0/3079803070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c010fc0 con 0x55eabf97fb80 2024-08-20T01:34:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.830+0000 7fc62ca04640 1 --2- 172.21.15.22:0/3079803070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf985260 0x55eabf97bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.830+0000 7fc631262740 1 -- 172.21.15.22:0/3079803070 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c00e830 con 0x55eabf985260 2024-08-20T01:34:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.830+0000 7fc631262740 1 -- 172.21.15.22:0/3079803070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c00c680 con 0x55eabf97a810 2024-08-20T01:34:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.831+0000 7fc627fff640 1 -- 172.21.15.22:0/3079803070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf985260 msgr2=0x55eabf97bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.831+0000 7fc627fff640 1 --2- 172.21.15.22:0/3079803070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf985260 0x55eabf97bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.831+0000 7fc627fff640 1 -- 172.21.15.22:0/3079803070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97fb80 msgr2=0x55eabf97b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.831+0000 7fc627fff640 1 --2- 172.21.15.22:0/3079803070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97fb80 0x55eabf97b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.831+0000 7fc627fff640 1 -- 172.21.15.22:0/3079803070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eabf983b10 con 0x55eabf97a810 2024-08-20T01:34:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.832+0000 7fc627fff640 1 --2- 172.21.15.22:0/3079803070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf97a810 0x55eabf970a80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc61800ba40 tx=0x7fc61801c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58512ad51062c1c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.832+0000 7fc6277fe640 1 --2- 172.21.15.22:0/3079803070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97fb80 0x55eabf97b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:34:30.848 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.846+0000 7fc615ffb640 1 -- 172.21.15.22:0/3079803070 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc618015040 con 0x55eabf97a810 2024-08-20T01:34:30.848 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.846+0000 7fc615ffb640 1 -- 172.21.15.22:0/3079803070 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc618004020 con 0x55eabf97a810 2024-08-20T01:34:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.847+0000 7fc631262740 1 -- 172.21.15.22:0/3079803070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf97a810 msgr2=0x55eabf970a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.847+0000 7fc631262740 1 --2- 172.21.15.22:0/3079803070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf97a810 0x55eabf970a80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc61800ba40 tx=0x7fc61801c040 comp rx=0 tx=0).stop 2024-08-20T01:34:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.848+0000 7fc631262740 1 -- 172.21.15.22:0/3079803070 shutdown_connections 2024-08-20T01:34:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.848+0000 7fc631262740 1 --2- 172.21.15.22:0/3079803070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf985260 0x55eabf97bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.848+0000 7fc631262740 1 --2- 172.21.15.22:0/3079803070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97fb80 0x55eabf97b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.848+0000 7fc631262740 1 --2- 172.21.15.22:0/3079803070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf97a810 0x55eabf970a80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.848+0000 7fc631262740 1 -- 172.21.15.22:0/3079803070 >> 172.21.15.22:0/3079803070 conn(0x55eabf975960 msgr2=0x55eabf991e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.849+0000 7fc631262740 1 -- 172.21.15.22:0/3079803070 shutdown_connections 2024-08-20T01:34:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.849+0000 7fc631262740 1 -- 172.21.15.22:0/3079803070 wait complete. 2024-08-20T01:34:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.849+0000 7fc631262740 1 -- start start 2024-08-20T01:34:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.850+0000 7fc631262740 1 Processor -- start 2024-08-20T01:34:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.851+0000 7fc631262740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97a810 0x55eabf9888c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.851+0000 7fc627fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97a810 0x55eabf9888c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.852+0000 7fc627fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97a810 0x55eabf9888c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44560/0 (socket says 172.21.15.22:44560) 2024-08-20T01:34:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.852+0000 7fc627fff640 1 -- 172.21.15.22:0/1488085767 learned_addr learned my addr 172.21.15.22:0/1488085767 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.852+0000 7fc631262740 1 --2- 172.21.15.22:0/1488085767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf97fb80 0x55eabf988f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.852+0000 7fc631262740 1 --2- 172.21.15.22:0/1488085767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf985260 0x55eabf989b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.852+0000 7fc631262740 1 -- 172.21.15.22:0/1488085767 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c00ccf0 con 0x55eabf97a810 2024-08-20T01:34:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.852+0000 7fc6277fe640 1 --2- 172.21.15.22:0/1488085767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf97fb80 0x55eabf988f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.852+0000 7fc631262740 1 -- 172.21.15.22:0/1488085767 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c00e160 con 0x55eabf97fb80 2024-08-20T01:34:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.852+0000 7fc631262740 1 -- 172.21.15.22:0/1488085767 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c00d3c0 con 0x55eabf985260 2024-08-20T01:34:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.852+0000 7fc62ca04640 1 --2- 172.21.15.22:0/1488085767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf985260 0x55eabf989b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.853+0000 7fc631262740 10 client.0 _ll_register_callbacks cb 0x7fc61c02a960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:34:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.853+0000 7fc6277fe640 1 -- 172.21.15.22:0/1488085767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf985260 msgr2=0x55eabf989b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.853+0000 7fc6277fe640 1 --2- 172.21.15.22:0/1488085767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf985260 0x55eabf989b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.853+0000 7fc6277fe640 1 -- 172.21.15.22:0/1488085767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97a810 msgr2=0x55eabf9888c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.853+0000 7fc6277fe640 1 --2- 172.21.15.22:0/1488085767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97a810 0x55eabf9888c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.853+0000 7fc6277fe640 1 -- 172.21.15.22:0/1488085767 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eabf98a360 con 0x55eabf97fb80 2024-08-20T01:34:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.853+0000 7fc631262740 1 -- 172.21.15.22:0/1488085767 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc618004020 con 0x55eabf97fb80 2024-08-20T01:34:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.853+0000 7fc6277fe640 1 --2- 172.21.15.22:0/1488085767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf97fb80 0x55eabf988f60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0098a0 tx=0x7fc61c0317d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4ef172dc5fc5625 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.876+0000 7fc60b7fe640 10 client.25547 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:34:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.876+0000 7fc60b7fe640 1 -- 172.21.15.22:0/1488085767 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c04a070 con 0x55eabf97fb80 2024-08-20T01:34:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.876+0000 7fc60b7fe640 1 -- 172.21.15.22:0/1488085767 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fc61c0c7970 con 0x55eabf97fb80 2024-08-20T01:34:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.877+0000 7fc60b7fe640 1 -- 172.21.15.22:0/1488085767 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc61c0e7020 con 0x55eabf97fb80 2024-08-20T01:34:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.877+0000 7fc631262740 10 client.25547 fetch_fsmap learned FSMap version 29 2024-08-20T01:34:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.877+0000 7fc631262740 1 -- 172.21.15.22:0/1488085767 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55eabf98a360 con 0x55eabf97fb80 2024-08-20T01:34:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.881+0000 7fc60b7fe640 1 -- 172.21.15.22:0/1488085767 <== mon.2 v2:172.21.15.77:3300/0 4 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc61c0ecb30 con 0x55eabf97fb80 2024-08-20T01:34:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.881+0000 7fc631262740 10 client.25547 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:34:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.881+0000 7fc631262740 10 client.25547 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:34:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.881+0000 7fc631262740 20 client.25547 populate_metadata read hostname 'smithi022' 2024-08-20T01:34:30.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.881+0000 7fc631262740 1 --2- 172.21.15.22:0/1488085767 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55eabf98bbe0 0x55eabf98bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.881+0000 7fc631262740 4 client.25547 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:34:30.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.881+0000 7fc631262740 1 -- 172.21.15.22:0/1488085767 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eabf8ead50 con 0x55eabf98bbe0 2024-08-20T01:34:30.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.881+0000 7fc627fff640 1 --2- 172.21.15.22:0/1488085767 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55eabf98bbe0 0x55eabf98bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.882+0000 7fc627fff640 1 --2- 172.21.15.22:0/1488085767 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55eabf98bbe0 0x55eabf98bff0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6450a14041fedef server_cookie=86cba5222c6077a3 in_seq=0 out_seq=0 2024-08-20T01:34:30.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:30.882+0000 7fc60b7fe640 10 client.25547 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:30.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:30 smithi022 ceph-mon[18709]: pgmap v447: 97 pgs: 97 active+clean; 876 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.5 MiB/s wr, 466 op/s 2024-08-20T01:34:30.910 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:31.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:30 smithi134 ceph-mon[22511]: pgmap v447: 97 pgs: 97 active+clean; 876 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.5 MiB/s wr, 466 op/s 2024-08-20T01:34:31.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.770+0000 7f18369b6640 1 -- 172.21.15.22:0/3058994027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f183010a260 msgr2=0x7f183010a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:31.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.770+0000 7f18369b6640 1 --2- 172.21.15.22:0/3058994027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f183010a260 0x7f183010a6a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1824009900 tx=0x7f182402a4d0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.775+0000 7f18369b6640 1 -- 172.21.15.22:0/3058994027 shutdown_connections 2024-08-20T01:34:31.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.775+0000 7f18369b6640 1 --2- 172.21.15.22:0/3058994027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183011bdd0 0x7f183011e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.775+0000 7f18369b6640 1 --2- 172.21.15.22:0/3058994027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f183010a260 0x7f183010a6a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.775+0000 7f18369b6640 1 --2- 172.21.15.22:0/3058994027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1830109e80 0x7f1830110ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.775+0000 7f18369b6640 1 -- 172.21.15.22:0/3058994027 >> 172.21.15.22:0/3058994027 conn(0x7f183006dcc0 msgr2=0x7f183006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:31.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.778+0000 7f18369b6640 1 -- 172.21.15.22:0/3058994027 shutdown_connections 2024-08-20T01:34:31.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.779+0000 7f18369b6640 1 -- 172.21.15.22:0/3058994027 wait complete. 2024-08-20T01:34:31.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.780+0000 7f18369b6640 1 Processor -- start 2024-08-20T01:34:31.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.784+0000 7f18369b6640 1 -- start start 2024-08-20T01:34:31.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.784+0000 7f18369b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1830109e80 0x7f1830119220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:31.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.784+0000 7f18369b6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f183010a260 0x7f1830119760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:31.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.784+0000 7f18369b6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183011bdd0 0x7f18301125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:31.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.784+0000 7f18369b6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1830121870 con 0x7f183010a260 2024-08-20T01:34:31.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.784+0000 7f18369b6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f18301216f0 con 0x7f1830109e80 2024-08-20T01:34:31.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.784+0000 7f18369b6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f18301219f0 con 0x7f183011bdd0 2024-08-20T01:34:31.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.785+0000 7f182ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1830109e80 0x7f1830119220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:31.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.785+0000 7f1834f53640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183011bdd0 0x7f18301125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:31.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.785+0000 7f1834f53640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183011bdd0 0x7f18301125f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:58206/0 (socket says 172.21.15.22:58206) 2024-08-20T01:34:31.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.785+0000 7f1834f53640 1 -- 172.21.15.22:0/353641104 learned_addr learned my addr 172.21.15.22:0/353641104 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:31.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.785+0000 7f182f7fe640 1 --2- 172.21.15.22:0/353641104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f183010a260 0x7f1830119760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:31.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.786+0000 7f182f7fe640 1 -- 172.21.15.22:0/353641104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183011bdd0 msgr2=0x7f18301125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:31.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.786+0000 7f182f7fe640 1 --2- 172.21.15.22:0/353641104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183011bdd0 0x7f18301125f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.786+0000 7f182f7fe640 1 -- 172.21.15.22:0/353641104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1830109e80 msgr2=0x7f1830119220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:31.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.786+0000 7f182f7fe640 1 --2- 172.21.15.22:0/353641104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1830109e80 0x7f1830119220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.786+0000 7f182f7fe640 1 -- 172.21.15.22:0/353641104 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1830112eb0 con 0x7f183010a260 2024-08-20T01:34:31.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.786+0000 7f182f7fe640 1 --2- 172.21.15.22:0/353641104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f183010a260 0x7f1830119760 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1824009850 tx=0x7f1824031b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:31.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.791+0000 7f182d7fa640 1 -- 172.21.15.22:0/353641104 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1824040030 con 0x7f183010a260 2024-08-20T01:34:31.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.791+0000 7f182d7fa640 1 -- 172.21.15.22:0/353641104 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f182403c8f0 con 0x7f183010a260 2024-08-20T01:34:31.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.791+0000 7f182d7fa640 1 -- 172.21.15.22:0/353641104 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1824044890 con 0x7f183010a260 2024-08-20T01:34:31.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.791+0000 7f18369b6640 1 -- 172.21.15.22:0/353641104 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1830113140 con 0x7f183010a260 2024-08-20T01:34:31.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.791+0000 7f18369b6640 1 -- 172.21.15.22:0/353641104 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1830118060 con 0x7f183010a260 2024-08-20T01:34:31.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.801+0000 7f182d7fa640 1 -- 172.21.15.22:0/353641104 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1824043030 con 0x7f183010a260 2024-08-20T01:34:31.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.802+0000 7f1838daf740 1 Processor -- start 2024-08-20T01:34:31.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.803+0000 7f182d7fa640 1 --2- 172.21.15.22:0/353641104 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18180b3d60 0x7f18180b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:31.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.808+0000 7f182d7fa640 1 -- 172.21.15.22:0/353641104 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f1824104090 con 0x7f183010a260 2024-08-20T01:34:31.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.809+0000 7f1838daf740 1 -- start start 2024-08-20T01:34:31.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.809+0000 7f1838daf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b343b0 0x557a42b34790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:31.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.809+0000 7f1838daf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b34cd0 0x557a42b40720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:31.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.809+0000 7f1838daf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b43050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:31.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.809+0000 7f1838daf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557a42aaa940 con 0x557a42b40c60 2024-08-20T01:34:31.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.809+0000 7f1838daf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557a42a99e40 con 0x557a42b34cd0 2024-08-20T01:34:31.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.809+0000 7f1838daf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557a42a9de80 con 0x557a42b343b0 2024-08-20T01:34:31.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.811+0000 7f182f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b34cd0 0x557a42b40720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:31.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.813+0000 7f1834f53640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b43050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:31.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.813+0000 7f1834f53640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b43050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44596/0 (socket says 172.21.15.22:44596) 2024-08-20T01:34:31.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.813+0000 7f1834f53640 1 -- 172.21.15.22:0/3543483428 learned_addr learned my addr 172.21.15.22:0/3543483428 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:31.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.814+0000 7f1834f53640 1 -- 172.21.15.22:0/3543483428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b343b0 msgr2=0x557a42b34790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:34:31.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.814+0000 7f1834f53640 1 --2- 172.21.15.22:0/3543483428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b343b0 0x557a42b34790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.814+0000 7f1834f53640 1 -- 172.21.15.22:0/3543483428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b34cd0 msgr2=0x557a42b40720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:31.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.814+0000 7f1834f53640 1 --2- 172.21.15.22:0/3543483428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b34cd0 0x557a42b40720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.814+0000 7f1834f53640 1 -- 172.21.15.22:0/3543483428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a42a36520 con 0x557a42b40c60 2024-08-20T01:34:31.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.815+0000 7f1834f53640 1 --2- 172.21.15.22:0/3543483428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b43050 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f18280137e0 tx=0x7f1828013ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31114ef40aa04b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:31.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.816+0000 7f18167fc640 1 -- 172.21.15.22:0/3543483428 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18280119c0 con 0x557a42b40c60 2024-08-20T01:34:31.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.819+0000 7f18167fc640 1 -- 172.21.15.22:0/3543483428 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1828011b60 con 0x557a42b40c60 2024-08-20T01:34:31.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.820+0000 7f1838daf740 1 -- 172.21.15.22:0/3543483428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 msgr2=0x557a42b43050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:31.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.820+0000 7f1838daf740 1 --2- 172.21.15.22:0/3543483428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b43050 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f18280137e0 tx=0x7f1828013ca0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.821+0000 7f1838daf740 1 -- 172.21.15.22:0/3543483428 shutdown_connections 2024-08-20T01:34:31.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.821+0000 7f1838daf740 1 --2- 172.21.15.22:0/3543483428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b43050 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.821+0000 7f1838daf740 1 --2- 172.21.15.22:0/3543483428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b34cd0 0x557a42b40720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.821+0000 7f1838daf740 1 --2- 172.21.15.22:0/3543483428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b343b0 0x557a42b34790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.821+0000 7f1838daf740 1 -- 172.21.15.22:0/3543483428 >> 172.21.15.22:0/3543483428 conn(0x557a42b321e0 msgr2=0x557a42b33380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:31.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.824+0000 7f1834f53640 1 --2- 172.21.15.22:0/353641104 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18180b3d60 0x7f18180b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:31.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.824+0000 7f1838daf740 1 -- 172.21.15.22:0/3543483428 shutdown_connections 2024-08-20T01:34:31.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.824+0000 7f1838daf740 1 -- 172.21.15.22:0/3543483428 wait complete. 2024-08-20T01:34:31.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.825+0000 7f1838daf740 1 -- start start 2024-08-20T01:34:31.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.826+0000 7f1834f53640 1 --2- 172.21.15.22:0/353641104 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18180b3d60 0x7f18180b6220 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f182801cc90 tx=0x7f1828009ce0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:31.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.837+0000 7f1838daf740 1 Processor -- start 2024-08-20T01:34:31.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.843+0000 7f1838daf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b343b0 0x557a42b3dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:31.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.843+0000 7f1838daf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b3e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:31.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.843+0000 7f1838daf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b3e660 0x557a42b6ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:31.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.843+0000 7f1838daf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557a428fc890 con 0x557a42b40c60 2024-08-20T01:34:31.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.843+0000 7f1838daf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557a42a20700 con 0x557a42b3e660 2024-08-20T01:34:31.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.843+0000 7f1838daf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557a42b65a60 con 0x557a42b343b0 2024-08-20T01:34:31.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.843+0000 7f1838daf740 10 client.0 _ll_register_callbacks cb 0x557a42a956f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:34:31.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.844+0000 7f182f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b3e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:31.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.844+0000 7f182f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b3e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44610/0 (socket says 172.21.15.22:44610) 2024-08-20T01:34:31.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.844+0000 7f182f7fe640 1 -- 172.21.15.22:0/3198087078 learned_addr learned my addr 172.21.15.22:0/3198087078 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:31.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.844+0000 7f182f7fe640 1 -- 172.21.15.22:0/3198087078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b343b0 msgr2=0x557a42b3dbe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:34:31.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.844+0000 7f182f7fe640 1 --2- 172.21.15.22:0/3198087078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b343b0 0x557a42b3dbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.844+0000 7f182f7fe640 1 -- 172.21.15.22:0/3198087078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b3e660 msgr2=0x557a42b6ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:31.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.844+0000 7f182f7fe640 1 --2- 172.21.15.22:0/3198087078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b3e660 0x557a42b6ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.845+0000 7f182f7fe640 1 -- 172.21.15.22:0/3198087078 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a427f9930 con 0x557a42b40c60 2024-08-20T01:34:31.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.845+0000 7f182f7fe640 1 --2- 172.21.15.22:0/3198087078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b3e120 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1824009900 tx=0x7f182403cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa4d6486d506acf server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:31.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.846+0000 7f180f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:34:31.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.848+0000 7f180f7fe640 1 -- 172.21.15.22:0/3198087078 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18240e5060 con 0x557a42b40c60 2024-08-20T01:34:31.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.848+0000 7f180f7fe640 1 -- 172.21.15.22:0/3198087078 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f18240c7280 con 0x557a42b40c60 2024-08-20T01:34:31.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.852+0000 7f1838daf740 1 -- 172.21.15.22:0/3198087078 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1828011b60 con 0x557a42b40c60 2024-08-20T01:34:31.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.858+0000 7f180f7fe640 1 -- 172.21.15.22:0/3198087078 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f18240ea050 con 0x557a42b40c60 2024-08-20T01:34:31.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.860+0000 7f1838daf740 10 client.15975 fetch_fsmap learned FSMap version 29 2024-08-20T01:34:31.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.860+0000 7f1838daf740 1 -- 172.21.15.22:0/3198087078 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557a42b71a10 con 0x557a42b40c60 2024-08-20T01:34:31.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.865+0000 7f180f7fe640 1 -- 172.21.15.22:0/3198087078 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1828011b60 con 0x557a42b40c60 2024-08-20T01:34:31.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.865+0000 7f180f7fe640 1 -- 172.21.15.22:0/3198087078 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f18240cb290 con 0x557a42b40c60 2024-08-20T01:34:31.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.868+0000 7f1838daf740 10 client.15975 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:34:31.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.868+0000 7f1838daf740 10 client.15975 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:34:31.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.868+0000 7f1838daf740 20 client.15975 populate_metadata read hostname 'smithi022' 2024-08-20T01:34:31.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.868+0000 7f1838daf740 1 --2- 172.21.15.22:0/3198087078 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557a42b72ec0 0x557a42b75300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:31.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.868+0000 7f1838daf740 4 client.15975 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:34:31.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.868+0000 7f1838daf740 1 -- 172.21.15.22:0/3198087078 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a42aac890 con 0x557a42b72ec0 2024-08-20T01:34:31.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.877+0000 7f182ffff640 1 --2- 172.21.15.22:0/3198087078 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557a42b72ec0 0x557a42b75300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:31.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.894+0000 7f182ffff640 1 --2- 172.21.15.22:0/3198087078 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557a42b72ec0 0x557a42b75300 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc4b667ea341be1c server_cookie=193cd7d1ee07343e in_seq=0 out_seq=0 2024-08-20T01:34:31.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.894+0000 7f180f7fe640 10 client.15975 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:31.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.899+0000 7f180f7fe640 1 -- 172.21.15.22:0/3198087078 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a42aac890 con 0x557a42b72ec0 2024-08-20T01:34:31.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.899+0000 7f180f7fe640 10 client.15975 handle_command_reply: tid=0 2024-08-20T01:34:31.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.902+0000 7f1838daf740 1 client.15975 shutdown 2024-08-20T01:34:31.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.902+0000 7f1838daf740 1 -- 172.21.15.22:0/3198087078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 msgr2=0x557a42b3e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:31.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.902+0000 7f1838daf740 1 --2- 172.21.15.22:0/3198087078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b3e120 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1824009900 tx=0x7f182403cca0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.902+0000 7f1838daf740 1 -- 172.21.15.22:0/3198087078 shutdown_connections 2024-08-20T01:34:31.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.902+0000 7f1838daf740 1 --2- 172.21.15.22:0/3198087078 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557a42b72ec0 0x557a42b75300 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.902+0000 7f1838daf740 1 --2- 172.21.15.22:0/3198087078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b3e660 0x557a42b6ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.902+0000 7f1838daf740 1 --2- 172.21.15.22:0/3198087078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b3e120 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.902+0000 7f1838daf740 1 --2- 172.21.15.22:0/3198087078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b343b0 0x557a42b3dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.902+0000 7f1838daf740 1 -- 172.21.15.22:0/3198087078 >> 172.21.15.22:0/3198087078 conn(0x557a42b321e0 msgr2=0x557a42b37d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:31.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.903+0000 7f180f7fe640 0 client.15975 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:31.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.903+0000 7f1838daf740 1 -- 172.21.15.22:0/3198087078 shutdown_connections 2024-08-20T01:34:31.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.903+0000 7f1838daf740 1 -- 172.21.15.22:0/3198087078 wait complete. 2024-08-20T01:34:31.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.903+0000 7f1838daf740 20 client.15975 trim_cache size 0 max 16384 2024-08-20T01:34:31.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.945+0000 7f1838daf740 1 Processor -- start 2024-08-20T01:34:31.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.946+0000 7f1838daf740 1 -- start start 2024-08-20T01:34:31.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.947+0000 7f1838daf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b343b0 0x557a42b311f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:31.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.947+0000 7f1838daf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b3e660 0x557a42b6ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:31.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.947+0000 7f1838daf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b6f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:31.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.948+0000 7f182f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b3e660 0x557a42b6ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:31.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.948+0000 7f182f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b3e660 0x557a42b6ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:58222/0 (socket says 172.21.15.22:58222) 2024-08-20T01:34:31.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.948+0000 7f182f7fe640 1 -- 172.21.15.22:0/3346011430 learned_addr learned my addr 172.21.15.22:0/3346011430 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:31.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.948+0000 7f1838daf740 1 -- 172.21.15.22:0/3346011430 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f183007f500 con 0x557a42b40c60 2024-08-20T01:34:31.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.948+0000 7f1838daf740 1 -- 172.21.15.22:0/3346011430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f183007cd70 con 0x557a42b343b0 2024-08-20T01:34:31.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.948+0000 7f1838daf740 1 -- 172.21.15.22:0/3346011430 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f183007abc0 con 0x557a42b3e660 2024-08-20T01:34:31.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.948+0000 7f182ffff640 1 --2- 172.21.15.22:0/3346011430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b343b0 0x557a42b311f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:31.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.949+0000 7f1834f53640 1 --2- 172.21.15.22:0/3346011430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b6f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:31.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.950+0000 7f182f7fe640 1 -- 172.21.15.22:0/3346011430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b343b0 msgr2=0x557a42b311f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:31.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.950+0000 7f182f7fe640 1 --2- 172.21.15.22:0/3346011430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b343b0 0x557a42b311f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.950+0000 7f182f7fe640 1 -- 172.21.15.22:0/3346011430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 msgr2=0x557a42b6f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:31.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.950+0000 7f182f7fe640 1 --2- 172.21.15.22:0/3346011430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b6f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.950+0000 7f182f7fe640 1 -- 172.21.15.22:0/3346011430 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a42b32c60 con 0x557a42b3e660 2024-08-20T01:34:31.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.952+0000 7f182f7fe640 1 --2- 172.21.15.22:0/3346011430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b3e660 0x557a42b6ebd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1824006010 tx=0x7f182403caa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=147c948e2c07f1b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:31.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.952+0000 7f1815ffb640 1 -- 172.21.15.22:0/3346011430 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182404a070 con 0x557a42b3e660 2024-08-20T01:34:31.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.952+0000 7f1815ffb640 1 -- 172.21.15.22:0/3346011430 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18240cf540 con 0x557a42b3e660 2024-08-20T01:34:31.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.952+0000 7f1815ffb640 1 -- 172.21.15.22:0/3346011430 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18240c7280 con 0x557a42b3e660 2024-08-20T01:34:31.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.954+0000 7f1838daf740 1 -- 172.21.15.22:0/3346011430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b3e660 msgr2=0x557a42b6ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:31.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.954+0000 7f1838daf740 1 --2- 172.21.15.22:0/3346011430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b3e660 0x557a42b6ebd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1824006010 tx=0x7f182403caa0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.957+0000 7f1838daf740 1 -- 172.21.15.22:0/3346011430 shutdown_connections 2024-08-20T01:34:31.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.957+0000 7f1838daf740 1 --2- 172.21.15.22:0/3346011430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b6f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.957+0000 7f1838daf740 1 --2- 172.21.15.22:0/3346011430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b3e660 0x557a42b6ebd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.957+0000 7f1838daf740 1 --2- 172.21.15.22:0/3346011430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b343b0 0x557a42b311f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.957+0000 7f1838daf740 1 -- 172.21.15.22:0/3346011430 >> 172.21.15.22:0/3346011430 conn(0x557a42b321e0 msgr2=0x557a42b30ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:31.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.962+0000 7f1838daf740 1 -- 172.21.15.22:0/3346011430 shutdown_connections 2024-08-20T01:34:31.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.962+0000 7f1838daf740 1 -- 172.21.15.22:0/3346011430 wait complete. 2024-08-20T01:34:31.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.963+0000 7f1838daf740 1 -- start start 2024-08-20T01:34:31.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.963+0000 7f1838daf740 1 Processor -- start 2024-08-20T01:34:31.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.964+0000 7f1838daf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b343b0 0x557a42b6ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:31.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.964+0000 7f1838daf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b3e660 0x557a42b6b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.965+0000 7f1838daf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b65d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.965+0000 7f182f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b3e660 0x557a42b6b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.965+0000 7f182f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b3e660 0x557a42b6b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:42208/0 (socket says 172.21.15.22:42208) 2024-08-20T01:34:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.965+0000 7f182f7fe640 1 -- 172.21.15.22:0/1167648533 learned_addr learned my addr 172.21.15.22:0/1167648533 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.966+0000 7f1834f53640 1 --2- 172.21.15.22:0/1167648533 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b65d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.966+0000 7f1838daf740 1 -- 172.21.15.22:0/1167648533 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f183007b230 con 0x557a42b40c60 2024-08-20T01:34:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.966+0000 7f1838daf740 1 -- 172.21.15.22:0/1167648533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f183007c6a0 con 0x557a42b3e660 2024-08-20T01:34:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.966+0000 7f1838daf740 1 -- 172.21.15.22:0/1167648533 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f183007b900 con 0x557a42b343b0 2024-08-20T01:34:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.967+0000 7f1838daf740 10 client.0 _ll_register_callbacks cb 0x7f1824009230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:34:31.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.971+0000 7f182ffff640 1 --2- 172.21.15.22:0/1167648533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b343b0 0x557a42b6ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:31.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.972+0000 7f182f7fe640 1 -- 172.21.15.22:0/1167648533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b343b0 msgr2=0x557a42b6ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:31.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.972+0000 7f182f7fe640 1 --2- 172.21.15.22:0/1167648533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b343b0 0x557a42b6ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.972+0000 7f182f7fe640 1 -- 172.21.15.22:0/1167648533 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 msgr2=0x557a42b65d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:31.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.972+0000 7f182f7fe640 1 --2- 172.21.15.22:0/1167648533 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b65d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:31.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.972+0000 7f182f7fe640 1 -- 172.21.15.22:0/1167648533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a42b66340 con 0x557a42b3e660 2024-08-20T01:34:31.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.980+0000 7f182f7fe640 1 --2- 172.21.15.22:0/1167648533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b3e660 0x557a42b6b290 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f18240cacf0 tx=0x7f18240443c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2da8c1ad0de43524 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:31.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.980+0000 7f180f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:34:31.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.983+0000 7f180f7fe640 1 -- 172.21.15.22:0/1167648533 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182404a070 con 0x557a42b3e660 2024-08-20T01:34:31.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.983+0000 7f180f7fe640 1 -- 172.21.15.22:0/1167648533 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f18240ca4e0 con 0x557a42b3e660 2024-08-20T01:34:31.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.983+0000 7f1838daf740 1 -- 172.21.15.22:0/1167648533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18240cf540 con 0x557a42b3e660 2024-08-20T01:34:31.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.987+0000 7f180f7fe640 1 -- 172.21.15.22:0/1167648533 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f18240c6eb0 con 0x557a42b3e660 2024-08-20T01:34:31.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.988+0000 7f1838daf740 10 client.25559 fetch_fsmap learned FSMap version 29 2024-08-20T01:34:31.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.988+0000 7f1838daf740 1 -- 172.21.15.22:0/1167648533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557a42b66340 con 0x557a42b3e660 2024-08-20T01:34:31.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.993+0000 7f180f7fe640 1 -- 172.21.15.22:0/1167648533 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18240cf540 con 0x557a42b3e660 2024-08-20T01:34:31.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.993+0000 7f180f7fe640 1 -- 172.21.15.22:0/1167648533 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f18240c9cc0 con 0x557a42b3e660 2024-08-20T01:34:31.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.994+0000 7f1838daf740 10 client.25559 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:34:31.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.994+0000 7f1838daf740 10 client.25559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:34:31.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.994+0000 7f1838daf740 20 client.25559 populate_metadata read hostname 'smithi022' 2024-08-20T01:34:31.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.994+0000 7f1838daf740 1 --2- 172.21.15.22:0/1167648533 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557a42bde8c0 0x557a42be0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:31.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.994+0000 7f1838daf740 4 client.25559 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:34:31.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.994+0000 7f1838daf740 1 -- 172.21.15.22:0/1167648533 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557a42aa8330 con 0x557a42bde8c0 2024-08-20T01:34:31.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:31.995+0000 7f182ffff640 1 --2- 172.21.15.22:0/1167648533 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557a42bde8c0 0x557a42be0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:32.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.004+0000 7f180f7fe640 10 client.25559 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:32.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.004+0000 7f182ffff640 1 --2- 172.21.15.22:0/1167648533 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557a42bde8c0 0x557a42be0ce0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=860480dd0b40abe5 server_cookie=901fb858e483341b in_seq=0 out_seq=0 2024-08-20T01:34:32.195 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:34:32.195 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-08-20T01:34:32.195 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "956ed84a-0df2-4bcf-8fa3-83d88836bcdd", 2024-08-20T01:34:32.196 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-08-20T01:34:32.196 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:34:32.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.172+0000 7f180f7fe640 1 -- 172.21.15.22:0/1167648533 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557a42aa8330 con 0x557a42bde8c0 2024-08-20T01:34:32.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.172+0000 7f180f7fe640 10 client.25559 handle_command_reply: tid=0 2024-08-20T01:34:32.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.172+0000 7f1838daf740 1 client.25559 shutdown 2024-08-20T01:34:32.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.173+0000 7f1838daf740 1 -- 172.21.15.22:0/1167648533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b3e660 msgr2=0x557a42b6b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:32.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.173+0000 7f1838daf740 1 --2- 172.21.15.22:0/1167648533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b3e660 0x557a42b6b290 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f18240cacf0 tx=0x7f18240443c0 comp rx=0 tx=0).stop 2024-08-20T01:34:32.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.173+0000 7f1838daf740 1 -- 172.21.15.22:0/1167648533 shutdown_connections 2024-08-20T01:34:32.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.173+0000 7f1838daf740 1 --2- 172.21.15.22:0/1167648533 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557a42bde8c0 0x557a42be0ce0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:32.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.173+0000 7f1838daf740 1 --2- 172.21.15.22:0/1167648533 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a42b40c60 0x557a42b65d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:32.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.173+0000 7f1838daf740 1 --2- 172.21.15.22:0/1167648533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557a42b3e660 0x557a42b6b290 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:32.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.173+0000 7f1838daf740 1 --2- 172.21.15.22:0/1167648533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a42b343b0 0x557a42b6ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:32.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.173+0000 7f1838daf740 1 -- 172.21.15.22:0/1167648533 >> 172.21.15.22:0/1167648533 conn(0x557a42b321e0 msgr2=0x557a42b31300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:32.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.173+0000 7f180f7fe640 0 client.25559 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:32.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.173+0000 7f1838daf740 1 -- 172.21.15.22:0/1167648533 shutdown_connections 2024-08-20T01:34:32.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.173+0000 7f1838daf740 1 -- 172.21.15.22:0/1167648533 wait complete. 2024-08-20T01:34:32.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.174+0000 7f1838daf740 20 client.25559 trim_cache size 0 max 16384 2024-08-20T01:34:32.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.177+0000 7f18369b6640 1 -- 172.21.15.22:0/353641104 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18180b3d60 msgr2=0x7f18180b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:32.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.177+0000 7f18369b6640 1 --2- 172.21.15.22:0/353641104 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18180b3d60 0x7f18180b6220 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f182801cc90 tx=0x7f1828009ce0 comp rx=0 tx=0).stop 2024-08-20T01:34:32.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.177+0000 7f18369b6640 1 -- 172.21.15.22:0/353641104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f183010a260 msgr2=0x7f1830119760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:32.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.177+0000 7f18369b6640 1 --2- 172.21.15.22:0/353641104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f183010a260 0x7f1830119760 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1824009850 tx=0x7f1824031b90 comp rx=0 tx=0).stop 2024-08-20T01:34:32.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.178+0000 7f18369b6640 1 -- 172.21.15.22:0/353641104 shutdown_connections 2024-08-20T01:34:32.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.178+0000 7f18369b6640 1 --2- 172.21.15.22:0/353641104 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18180b3d60 0x7f18180b6220 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:32.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.178+0000 7f18369b6640 1 --2- 172.21.15.22:0/353641104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183011bdd0 0x7f18301125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:32.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.178+0000 7f18369b6640 1 --2- 172.21.15.22:0/353641104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f183010a260 0x7f1830119760 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:32.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.178+0000 7f18369b6640 1 --2- 172.21.15.22:0/353641104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1830109e80 0x7f1830119220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:32.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.178+0000 7f18369b6640 1 -- 172.21.15.22:0/353641104 >> 172.21.15.22:0/353641104 conn(0x7f183006dcc0 msgr2=0x7f183011c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:32.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.179+0000 7f18369b6640 1 -- 172.21.15.22:0/353641104 shutdown_connections 2024-08-20T01:34:32.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:32.182+0000 7f18369b6640 1 -- 172.21.15.22:0/353641104 wait complete. 2024-08-20T01:34:32.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:32 smithi077 ceph-mon[22251]: pgmap v448: 97 pgs: 97 active+clean; 882 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.3 MiB/s wr, 530 op/s 2024-08-20T01:34:32.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:32 smithi077 ceph-mon[22251]: scrub queued for path: / 2024-08-20T01:34:32.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:32 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:34:32.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:32 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:34:32.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:32 smithi022 ceph-mon[18709]: pgmap v448: 97 pgs: 97 active+clean; 882 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.3 MiB/s wr, 530 op/s 2024-08-20T01:34:32.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:32 smithi022 ceph-mon[18709]: scrub queued for path: / 2024-08-20T01:34:32.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:32 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:34:32.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:32 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:34:33.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:32 smithi134 ceph-mon[22511]: pgmap v448: 97 pgs: 97 active+clean; 882 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.3 MiB/s wr, 530 op/s 2024-08-20T01:34:33.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:32 smithi134 ceph-mon[22511]: scrub queued for path: / 2024-08-20T01:34:33.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:32 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:34:33.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:32 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:34:33.251 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:34:33.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:34:33.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:34:33.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:33 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:34:33.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:33 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:34:33.661 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.728+0000 7fc60b7fe640 1 -- 172.21.15.22:0/1488085767 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eabf8ead50 con 0x55eabf98bbe0 2024-08-20T01:34:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.728+0000 7fc60b7fe640 10 client.25547 handle_command_reply: tid=0 2024-08-20T01:34:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.728+0000 7fc631262740 1 client.25547 shutdown 2024-08-20T01:34:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.728+0000 7fc631262740 1 -- 172.21.15.22:0/1488085767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf97fb80 msgr2=0x55eabf988f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.728+0000 7fc631262740 1 --2- 172.21.15.22:0/1488085767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf97fb80 0x55eabf988f60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0098a0 tx=0x7fc61c0317d0 comp rx=0 tx=0).stop 2024-08-20T01:34:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.728+0000 7fc631262740 1 -- 172.21.15.22:0/1488085767 shutdown_connections 2024-08-20T01:34:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.728+0000 7fc631262740 1 --2- 172.21.15.22:0/1488085767 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55eabf98bbe0 0x55eabf98bff0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.728+0000 7fc631262740 1 --2- 172.21.15.22:0/1488085767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eabf985260 0x55eabf989b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.728+0000 7fc631262740 1 --2- 172.21.15.22:0/1488085767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55eabf97fb80 0x55eabf988f60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.728+0000 7fc631262740 1 --2- 172.21.15.22:0/1488085767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eabf97a810 0x55eabf9888c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.728+0000 7fc60b7fe640 0 client.25547 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.728+0000 7fc631262740 1 -- 172.21.15.22:0/1488085767 >> 172.21.15.22:0/1488085767 conn(0x55eabf975960 msgr2=0x55eabf97b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.729+0000 7fc631262740 1 -- 172.21.15.22:0/1488085767 shutdown_connections 2024-08-20T01:34:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.729+0000 7fc631262740 1 -- 172.21.15.22:0/1488085767 wait complete. 2024-08-20T01:34:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.729+0000 7fc631262740 20 client.25547 trim_cache size 0 max 16384 2024-08-20T01:34:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:34:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:34:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:34:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:34:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.729+0000 7fc62e467640 1 -- 172.21.15.22:0/2852173596 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc6100b3dd0 msgr2=0x7fc6100b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.729+0000 7fc62e467640 1 --2- 172.21.15.22:0/2852173596 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc6100b3dd0 0x7fc6100b6290 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc6200077d0 tx=0x7fc6200099f0 comp rx=0 tx=0).stop 2024-08-20T01:34:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.729+0000 7fc62e467640 1 -- 172.21.15.22:0/2852173596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc62810a0f0 msgr2=0x7fc628116c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.729+0000 7fc62e467640 1 --2- 172.21.15.22:0/2852173596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc62810a0f0 0x7fc628116c20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc61c031500 tx=0x7fc61c004950 comp rx=0 tx=0).stop 2024-08-20T01:34:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.729+0000 7fc62e467640 1 -- 172.21.15.22:0/2852173596 shutdown_connections 2024-08-20T01:34:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.729+0000 7fc62e467640 1 --2- 172.21.15.22:0/2852173596 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc6100b3dd0 0x7fc6100b6290 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.729+0000 7fc62e467640 1 --2- 172.21.15.22:0/2852173596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc62810aa30 0x7fc628117850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.729+0000 7fc62e467640 1 --2- 172.21.15.22:0/2852173596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc62810a0f0 0x7fc628116c20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.729+0000 7fc62e467640 1 --2- 172.21.15.22:0/2852173596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc628074230 0x7fc6281165d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.729+0000 7fc62e467640 1 -- 172.21.15.22:0/2852173596 >> 172.21.15.22:0/2852173596 conn(0x7fc62806f580 msgr2=0x7fc628071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.729+0000 7fc62e467640 1 -- 172.21.15.22:0/2852173596 shutdown_connections 2024-08-20T01:34:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:33.729+0000 7fc62e467640 1 -- 172.21.15.22:0/2852173596 wait complete. 2024-08-20T01:34:33.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:34:33.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:34:33.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:33 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:34:33.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:33 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:34:34.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:34:34.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:34:34.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:33 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:34:34.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:33 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:34:34.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.160+0000 7fea99870640 1 -- 172.21.15.22:0/1915193592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea94101990 msgr2=0x7fea94101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:34.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.160+0000 7fea99870640 1 --2- 172.21.15.22:0/1915193592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea94101990 0x7fea94101d70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fea84009860 tx=0x7fea8402a340 comp rx=0 tx=0).stop 2024-08-20T01:34:34.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.160+0000 7fea99870640 1 -- 172.21.15.22:0/1915193592 shutdown_connections 2024-08-20T01:34:34.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.160+0000 7fea99870640 1 --2- 172.21.15.22:0/1915193592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea94107d20 0x7fea9410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.160+0000 7fea99870640 1 --2- 172.21.15.22:0/1915193592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea941073a0 0x7fea941077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.160+0000 7fea99870640 1 --2- 172.21.15.22:0/1915193592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea94101990 0x7fea94101d70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.160+0000 7fea99870640 1 -- 172.21.15.22:0/1915193592 >> 172.21.15.22:0/1915193592 conn(0x7fea940fd400 msgr2=0x7fea940ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:34.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.161+0000 7fea99870640 1 -- 172.21.15.22:0/1915193592 shutdown_connections 2024-08-20T01:34:34.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.161+0000 7fea99870640 1 -- 172.21.15.22:0/1915193592 wait complete. 2024-08-20T01:34:34.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.161+0000 7fea99870640 1 Processor -- start 2024-08-20T01:34:34.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.161+0000 7fea99870640 1 -- start start 2024-08-20T01:34:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.162+0000 7fea99870640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea94101990 0x7fea940fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.162+0000 7fea99870640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea941073a0 0x7fea940fde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.162+0000 7fea99870640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea94107d20 0x7fea940fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.162+0000 7fea99870640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea941119e0 con 0x7fea94107d20 2024-08-20T01:34:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.162+0000 7fea99870640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea94111860 con 0x7fea94101990 2024-08-20T01:34:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.162+0000 7fea99870640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fea94111b60 con 0x7fea941073a0 2024-08-20T01:34:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.162+0000 7fea937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea94107d20 0x7fea940fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.162+0000 7fea92ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea94101990 0x7fea940fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.162+0000 7fea937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea94107d20 0x7fea940fe380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44650/0 (socket says 172.21.15.22:44650) 2024-08-20T01:34:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.162+0000 7fea937fe640 1 -- 172.21.15.22:0/3847553639 learned_addr learned my addr 172.21.15.22:0/3847553639 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.162+0000 7fea927fc640 1 --2- 172.21.15.22:0/3847553639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea941073a0 0x7fea940fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.162+0000 7fea92ffd640 1 -- 172.21.15.22:0/3847553639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea941073a0 msgr2=0x7fea940fde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.163+0000 7fea92ffd640 1 --2- 172.21.15.22:0/3847553639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea941073a0 0x7fea940fde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.163+0000 7fea92ffd640 1 -- 172.21.15.22:0/3847553639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea94107d20 msgr2=0x7fea940fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.163+0000 7fea92ffd640 1 --2- 172.21.15.22:0/3847553639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea94107d20 0x7fea940fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.163+0000 7fea92ffd640 1 -- 172.21.15.22:0/3847553639 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea941a73c0 con 0x7fea94101990 2024-08-20T01:34:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.163+0000 7fea92ffd640 1 --2- 172.21.15.22:0/3847553639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea94101990 0x7fea940fd900 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fea84035040 tx=0x7fea84032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.163+0000 7fea9886e640 1 -- 172.21.15.22:0/3847553639 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84037040 con 0x7fea94101990 2024-08-20T01:34:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.163+0000 7fea9886e640 1 -- 172.21.15.22:0/3847553639 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea84004050 con 0x7fea94101990 2024-08-20T01:34:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.163+0000 7fea99870640 1 -- 172.21.15.22:0/3847553639 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea941a7650 con 0x7fea94101990 2024-08-20T01:34:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.163+0000 7fea9886e640 1 -- 172.21.15.22:0/3847553639 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea840035f0 con 0x7fea94101990 2024-08-20T01:34:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.163+0000 7fea99870640 1 -- 172.21.15.22:0/3847553639 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea941a7b20 con 0x7fea94101990 2024-08-20T01:34:34.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.166+0000 7fea9bc69740 1 Processor -- start 2024-08-20T01:34:34.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.166+0000 7fea9bc69740 1 -- start start 2024-08-20T01:34:34.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.166+0000 7fea9bc69740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc7ffcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:34.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.166+0000 7fea9bc69740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc7ffd150 0x559cc8008ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:34.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.166+0000 7fea9bc69740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc80090e0 0x559cc800b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:34.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.166+0000 7fea9bc69740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559cc7f738e0 con 0x559cc80090e0 2024-08-20T01:34:34.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.166+0000 7fea9bc69740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559cc7f62de0 con 0x559cc7ffc830 2024-08-20T01:34:34.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.166+0000 7fea9bc69740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559cc7f66e20 con 0x559cc7ffd150 2024-08-20T01:34:34.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.166+0000 7fea9886e640 1 -- 172.21.15.22:0/3847553639 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fea84043020 con 0x7fea94101990 2024-08-20T01:34:34.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.167+0000 7fea927fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc80090e0 0x559cc800b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:34.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.167+0000 7fea937fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc7ffcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:34.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.167+0000 7fea927fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc80090e0 0x559cc800b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44666/0 (socket says 172.21.15.22:44666) 2024-08-20T01:34:34.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.167+0000 7fea927fc640 1 -- 172.21.15.22:0/1681738991 learned_addr learned my addr 172.21.15.22:0/1681738991 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:34.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.167+0000 7fea937fe640 1 --2- 172.21.15.22:0/1681738991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc7ffcc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:42248/0 (socket says 172.21.15.22:42248) 2024-08-20T01:34:34.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.167+0000 7fea92ffd640 1 --2- 172.21.15.22:0/1681738991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc7ffd150 0x559cc8008ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.167+0000 7fea927fc640 1 -- 172.21.15.22:0/1681738991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc7ffd150 msgr2=0x559cc8008ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.167+0000 7fea927fc640 1 --2- 172.21.15.22:0/1681738991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc7ffd150 0x559cc8008ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.167+0000 7fea927fc640 1 -- 172.21.15.22:0/1681738991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 msgr2=0x559cc7ffcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.167+0000 7fea927fc640 1 --2- 172.21.15.22:0/1681738991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc7ffcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.167+0000 7fea927fc640 1 -- 172.21.15.22:0/1681738991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cc7cc2650 con 0x559cc80090e0 2024-08-20T01:34:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.167+0000 7fea927fc640 1 --2- 172.21.15.22:0/1681738991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc80090e0 0x559cc800b4d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fea88009cd0 tx=0x7fea88011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1543c90b5579574a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.167+0000 7fea79ffb640 1 -- 172.21.15.22:0/1681738991 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea88004230 con 0x559cc80090e0 2024-08-20T01:34:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.168+0000 7fea79ffb640 1 -- 172.21.15.22:0/1681738991 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea880043d0 con 0x559cc80090e0 2024-08-20T01:34:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.168+0000 7fea79ffb640 1 -- 172.21.15.22:0/1681738991 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea88004d50 con 0x559cc80090e0 2024-08-20T01:34:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.168+0000 7fea9886e640 1 --2- 172.21.15.22:0/3847553639 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fea7c0b3c50 0x7fea7c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.168+0000 7fea937fe640 1 --2- 172.21.15.22:0/3847553639 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fea7c0b3c50 0x7fea7c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.168+0000 7fea9886e640 1 -- 172.21.15.22:0/3847553639 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fea84102ff0 con 0x7fea94101990 2024-08-20T01:34:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.168+0000 7fea937fe640 1 --2- 172.21.15.22:0/3847553639 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fea7c0b3c50 0x7fea7c0b6110 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fea940ff9c0 tx=0x7fea8c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.168+0000 7fea9bc69740 1 -- 172.21.15.22:0/1681738991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc80090e0 msgr2=0x559cc800b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.168+0000 7fea9bc69740 1 --2- 172.21.15.22:0/1681738991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc80090e0 0x559cc800b4d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fea88009cd0 tx=0x7fea88011810 comp rx=0 tx=0).stop 2024-08-20T01:34:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.169+0000 7fea9bc69740 1 -- 172.21.15.22:0/1681738991 shutdown_connections 2024-08-20T01:34:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.169+0000 7fea9bc69740 1 --2- 172.21.15.22:0/1681738991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc80090e0 0x559cc800b4d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.169+0000 7fea9bc69740 1 --2- 172.21.15.22:0/1681738991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc7ffd150 0x559cc8008ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.169+0000 7fea9bc69740 1 --2- 172.21.15.22:0/1681738991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc7ffcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.169+0000 7fea9bc69740 1 -- 172.21.15.22:0/1681738991 >> 172.21.15.22:0/1681738991 conn(0x559cc7ffa660 msgr2=0x559cc7ffb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:34.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.169+0000 7fea9bc69740 1 -- 172.21.15.22:0/1681738991 shutdown_connections 2024-08-20T01:34:34.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.169+0000 7fea9bc69740 1 -- 172.21.15.22:0/1681738991 wait complete. 2024-08-20T01:34:34.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.169+0000 7fea9bc69740 1 -- start start 2024-08-20T01:34:34.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.169+0000 7fea9bc69740 1 Processor -- start 2024-08-20T01:34:34.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.170+0000 7fea9bc69740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc8006090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:34.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.170+0000 7fea9bc69740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc7ffd150 0x559cc80065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:34.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.170+0000 7fea9bc69740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc80090e0 0x559cc8006b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:34.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.170+0000 7fea9bc69740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559cc7dc5700 con 0x559cc7ffd150 2024-08-20T01:34:34.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.170+0000 7fea9bc69740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559cc7ee97c0 con 0x559cc7ffc830 2024-08-20T01:34:34.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.170+0000 7fea9bc69740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559cc800bd90 con 0x559cc80090e0 2024-08-20T01:34:34.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.170+0000 7fea9bc69740 10 client.0 _ll_register_callbacks cb 0x559cc7f5c6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:34:34.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.170+0000 7fea92ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc8006090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:34.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.170+0000 7fea92ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc8006090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:42252/0 (socket says 172.21.15.22:42252) 2024-08-20T01:34:34.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.170+0000 7fea92ffd640 1 -- 172.21.15.22:0/1355694493 learned_addr learned my addr 172.21.15.22:0/1355694493 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:34.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.170+0000 7fea927fc640 1 --2- 172.21.15.22:0/1355694493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc7ffd150 0x559cc80065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:34.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.170+0000 7fea937fe640 1 --2- 172.21.15.22:0/1355694493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc80090e0 0x559cc8006b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:34.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.170+0000 7fea92ffd640 1 -- 172.21.15.22:0/1355694493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc80090e0 msgr2=0x559cc8006b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:34.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.170+0000 7fea92ffd640 1 --2- 172.21.15.22:0/1355694493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc80090e0 0x559cc8006b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.170+0000 7fea92ffd640 1 -- 172.21.15.22:0/1355694493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc7ffd150 msgr2=0x559cc80065d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:34.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.170+0000 7fea92ffd640 1 --2- 172.21.15.22:0/1355694493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc7ffd150 0x559cc80065d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.170+0000 7fea92ffd640 1 -- 172.21.15.22:0/1355694493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cc80151a0 con 0x559cc7ffc830 2024-08-20T01:34:34.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.170+0000 7fea927fc640 1 --2- 172.21.15.22:0/1355694493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc7ffd150 0x559cc80065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:34:34.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.171+0000 7fea92ffd640 1 --2- 172.21.15.22:0/1355694493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc8006090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fea840c9e70 tx=0x7fea84005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bce85abb019aba04 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:34.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.171+0000 7fea72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:34:34.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.171+0000 7fea72ffd640 1 -- 172.21.15.22:0/1355694493 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea840c9830 con 0x559cc7ffc830 2024-08-20T01:34:34.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.171+0000 7fea72ffd640 1 -- 172.21.15.22:0/1355694493 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fea84105110 con 0x559cc7ffc830 2024-08-20T01:34:34.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.171+0000 7fea9bc69740 1 -- 172.21.15.22:0/1355694493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559cc7f12100 con 0x559cc7ffc830 2024-08-20T01:34:34.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.171+0000 7fea72ffd640 1 -- 172.21.15.22:0/1355694493 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fea840c9650 con 0x559cc7ffc830 2024-08-20T01:34:34.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.171+0000 7fea9bc69740 10 client.25571 fetch_fsmap learned FSMap version 29 2024-08-20T01:34:34.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.171+0000 7fea9bc69740 1 -- 172.21.15.22:0/1355694493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559cc8017b30 con 0x559cc7ffc830 2024-08-20T01:34:34.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.171+0000 7fea72ffd640 1 -- 172.21.15.22:0/1355694493 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x559cc7f12100 con 0x559cc7ffc830 2024-08-20T01:34:34.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.172+0000 7fea72ffd640 1 -- 172.21.15.22:0/1355694493 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fea840ca140 con 0x559cc7ffc830 2024-08-20T01:34:34.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.172+0000 7fea9bc69740 10 client.25571 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:34:34.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.172+0000 7fea9bc69740 10 client.25571 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:34:34.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.172+0000 7fea9bc69740 20 client.25571 populate_metadata read hostname 'smithi022' 2024-08-20T01:34:34.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.172+0000 7fea9bc69740 1 --2- 172.21.15.22:0/1355694493 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559cc80190d0 0x559cc801b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:34.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.172+0000 7fea9bc69740 4 client.25571 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:34:34.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.172+0000 7fea9bc69740 1 -- 172.21.15.22:0/1355694493 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559cc7f75830 con 0x559cc80190d0 2024-08-20T01:34:34.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.172+0000 7fea927fc640 1 --2- 172.21.15.22:0/1355694493 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559cc80190d0 0x559cc801b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:34.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.173+0000 7fea927fc640 1 --2- 172.21.15.22:0/1355694493 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559cc80190d0 0x559cc801b570 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=297e7de9b8ff8fdb server_cookie=61c786a45d9483f2 in_seq=0 out_seq=0 2024-08-20T01:34:34.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.173+0000 7fea72ffd640 10 client.25571 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:34.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.190+0000 7fea72ffd640 1 -- 172.21.15.22:0/1355694493 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559cc7f75830 con 0x559cc80190d0 2024-08-20T01:34:34.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.190+0000 7fea72ffd640 10 client.25571 handle_command_reply: tid=0 2024-08-20T01:34:34.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.190+0000 7fea9bc69740 1 client.25571 shutdown 2024-08-20T01:34:34.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.190+0000 7fea9bc69740 1 -- 172.21.15.22:0/1355694493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 msgr2=0x559cc8006090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:34.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.190+0000 7fea9bc69740 1 --2- 172.21.15.22:0/1355694493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc8006090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fea840c9e70 tx=0x7fea84005bd0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.190+0000 7fea9bc69740 1 -- 172.21.15.22:0/1355694493 shutdown_connections 2024-08-20T01:34:34.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.190+0000 7fea9bc69740 1 --2- 172.21.15.22:0/1355694493 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559cc80190d0 0x559cc801b570 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.190+0000 7fea9bc69740 1 --2- 172.21.15.22:0/1355694493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc80090e0 0x559cc8006b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.190+0000 7fea9bc69740 1 --2- 172.21.15.22:0/1355694493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc7ffd150 0x559cc80065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.190+0000 7fea72ffd640 0 client.25571 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:34.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.190+0000 7fea9bc69740 1 --2- 172.21.15.22:0/1355694493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc8006090 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.190+0000 7fea9bc69740 1 -- 172.21.15.22:0/1355694493 >> 172.21.15.22:0/1355694493 conn(0x559cc7ffa660 msgr2=0x559cc8000200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:34.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.190+0000 7fea9bc69740 1 -- 172.21.15.22:0/1355694493 shutdown_connections 2024-08-20T01:34:34.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.190+0000 7fea9bc69740 1 -- 172.21.15.22:0/1355694493 wait complete. 2024-08-20T01:34:34.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.190+0000 7fea9bc69740 20 client.25571 trim_cache size 0 max 16384 2024-08-20T01:34:34.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.212+0000 7fea9bc69740 1 Processor -- start 2024-08-20T01:34:34.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.212+0000 7fea9bc69740 1 -- start start 2024-08-20T01:34:34.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.213+0000 7fea9bc69740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc8005920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:34.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.213+0000 7fea9bc69740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc7ffd150 0x559cc8006710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:34.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.213+0000 7fea9bc69740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc80090e0 0x559cc8020e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:34.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.213+0000 7fea9bc69740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea941b2c60 con 0x559cc80090e0 2024-08-20T01:34:34.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.213+0000 7fea9bc69740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea941b04d0 con 0x559cc7ffc830 2024-08-20T01:34:34.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.213+0000 7fea9bc69740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fea941ae320 con 0x559cc7ffd150 2024-08-20T01:34:34.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.213+0000 7fea92ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc8005920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:34.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.213+0000 7fea927fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc7ffd150 0x559cc8006710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:34.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.213+0000 7fea92ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc8005920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:42268/0 (socket says 172.21.15.22:42268) 2024-08-20T01:34:34.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.213+0000 7fea92ffd640 1 -- 172.21.15.22:0/3538334271 learned_addr learned my addr 172.21.15.22:0/3538334271 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:34.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.213+0000 7fea937fe640 1 --2- 172.21.15.22:0/3538334271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc80090e0 0x559cc8020e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:34.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.213+0000 7fea92ffd640 1 -- 172.21.15.22:0/3538334271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc7ffd150 msgr2=0x559cc8006710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:34.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.213+0000 7fea92ffd640 1 --2- 172.21.15.22:0/3538334271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc7ffd150 0x559cc8006710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.213+0000 7fea92ffd640 1 -- 172.21.15.22:0/3538334271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc80090e0 msgr2=0x559cc8020e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:34.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.213+0000 7fea92ffd640 1 --2- 172.21.15.22:0/3538334271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc80090e0 0x559cc8020e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.213+0000 7fea92ffd640 1 -- 172.21.15.22:0/3538334271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cc7ffcf40 con 0x559cc7ffc830 2024-08-20T01:34:34.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.214+0000 7fea92ffd640 1 --2- 172.21.15.22:0/3538334271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc8005920 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fea84005c40 tx=0x7fea84005760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20a47cd81b6f4338 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:34.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.214+0000 7fea797fa640 1 -- 172.21.15.22:0/3538334271 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea840c9830 con 0x559cc7ffc830 2024-08-20T01:34:34.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.214+0000 7fea797fa640 1 -- 172.21.15.22:0/3538334271 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea84004490 con 0x559cc7ffc830 2024-08-20T01:34:34.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.214+0000 7fea797fa640 1 -- 172.21.15.22:0/3538334271 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea840ce4e0 con 0x559cc7ffc830 2024-08-20T01:34:34.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.215+0000 7fea9bc69740 1 -- 172.21.15.22:0/3538334271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 msgr2=0x559cc8005920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:34.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.215+0000 7fea9bc69740 1 --2- 172.21.15.22:0/3538334271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc8005920 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fea84005c40 tx=0x7fea84005760 comp rx=0 tx=0).stop 2024-08-20T01:34:34.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.215+0000 7fea9bc69740 1 -- 172.21.15.22:0/3538334271 shutdown_connections 2024-08-20T01:34:34.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.215+0000 7fea9bc69740 1 --2- 172.21.15.22:0/3538334271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc80090e0 0x559cc8020e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.215+0000 7fea9bc69740 1 --2- 172.21.15.22:0/3538334271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc7ffd150 0x559cc8006710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.215+0000 7fea9bc69740 1 --2- 172.21.15.22:0/3538334271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc8005920 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.215+0000 7fea9bc69740 1 -- 172.21.15.22:0/3538334271 >> 172.21.15.22:0/3538334271 conn(0x559cc7ffa660 msgr2=0x559cc8006000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:34.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.215+0000 7fea9bc69740 1 -- 172.21.15.22:0/3538334271 shutdown_connections 2024-08-20T01:34:34.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.215+0000 7fea9bc69740 1 -- 172.21.15.22:0/3538334271 wait complete. 2024-08-20T01:34:34.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.215+0000 7fea9bc69740 1 -- start start 2024-08-20T01:34:34.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.216+0000 7fea9bc69740 1 Processor -- start 2024-08-20T01:34:34.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.216+0000 7fea9bc69740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc800c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:34.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.216+0000 7fea9bc69740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc7ffd150 0x559cc800cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:34.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.216+0000 7fea9bc69740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc80090e0 0x559cc8081e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:34.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.216+0000 7fea9bc69740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea941ae990 con 0x559cc7ffd150 2024-08-20T01:34:34.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.216+0000 7fea9bc69740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea941afe00 con 0x559cc7ffc830 2024-08-20T01:34:34.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.216+0000 7fea9bc69740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fea941af060 con 0x559cc80090e0 2024-08-20T01:34:34.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.216+0000 7fea9bc69740 10 client.0 _ll_register_callbacks cb 0x7fea84106760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:34:34.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.216+0000 7fea927fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc7ffd150 0x559cc800cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:34.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.216+0000 7fea927fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc7ffd150 0x559cc800cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44694/0 (socket says 172.21.15.22:44694) 2024-08-20T01:34:34.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.216+0000 7fea937fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc80090e0 0x559cc8081e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:34.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.216+0000 7fea927fc640 1 -- 172.21.15.22:0/2313260606 learned_addr learned my addr 172.21.15.22:0/2313260606 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:34.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.216+0000 7fea92ffd640 1 --2- 172.21.15.22:0/2313260606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc800c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:34.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.217+0000 7fea92ffd640 1 -- 172.21.15.22:0/2313260606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc80090e0 msgr2=0x559cc8081e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:34.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.217+0000 7fea92ffd640 1 --2- 172.21.15.22:0/2313260606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc80090e0 0x559cc8081e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.217+0000 7fea92ffd640 1 -- 172.21.15.22:0/2313260606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc7ffd150 msgr2=0x559cc800cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:34.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.217+0000 7fea92ffd640 1 --2- 172.21.15.22:0/2313260606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc7ffd150 0x559cc800cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.217+0000 7fea92ffd640 1 -- 172.21.15.22:0/2313260606 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cc8082500 con 0x559cc7ffc830 2024-08-20T01:34:34.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.217+0000 7fea937fe640 1 --2- 172.21.15.22:0/2313260606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc80090e0 0x559cc8081e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:34:34.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.217+0000 7fea927fc640 1 --2- 172.21.15.22:0/2313260606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc7ffd150 0x559cc800cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:34:34.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.217+0000 7fea92ffd640 1 --2- 172.21.15.22:0/2313260606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc800c800 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fea840c6480 tx=0x7fea840303b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30e0e5813677239 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:34.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.217+0000 7fea72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:34:34.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.217+0000 7fea72ffd640 1 -- 172.21.15.22:0/2313260606 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea840c9830 con 0x559cc7ffc830 2024-08-20T01:34:34.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.217+0000 7fea9bc69740 1 -- 172.21.15.22:0/2313260606 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559cc7f712d0 con 0x559cc7ffc830 2024-08-20T01:34:34.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.217+0000 7fea72ffd640 1 -- 172.21.15.22:0/2313260606 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fea840c9140 con 0x559cc7ffc830 2024-08-20T01:34:34.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.217+0000 7fea72ffd640 1 -- 172.21.15.22:0/2313260606 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fea840c99f0 con 0x559cc7ffc830 2024-08-20T01:34:34.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.217+0000 7fea9bc69740 10 client.25577 fetch_fsmap learned FSMap version 29 2024-08-20T01:34:34.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.217+0000 7fea9bc69740 1 -- 172.21.15.22:0/2313260606 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559cc8082500 con 0x559cc7ffc830 2024-08-20T01:34:34.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.217+0000 7fea72ffd640 1 -- 172.21.15.22:0/2313260606 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x559cc7f712d0 con 0x559cc7ffc830 2024-08-20T01:34:34.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.218+0000 7fea72ffd640 1 -- 172.21.15.22:0/2313260606 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fea840c5850 con 0x559cc7ffc830 2024-08-20T01:34:34.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.218+0000 7fea9bc69740 10 client.25577 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:34:34.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.218+0000 7fea9bc69740 10 client.25577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:34:34.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.218+0000 7fea9bc69740 20 client.25577 populate_metadata read hostname 'smithi022' 2024-08-20T01:34:34.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.218+0000 7fea9bc69740 1 --2- 172.21.15.22:0/2313260606 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559cc8083b30 0x559cc8085f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:34.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.218+0000 7fea9bc69740 4 client.25577 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:34:34.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.218+0000 7fea9bc69740 1 -- 172.21.15.22:0/2313260606 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559cc7f6ea10 con 0x559cc8083b30 2024-08-20T01:34:34.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.218+0000 7fea927fc640 1 --2- 172.21.15.22:0/2313260606 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559cc8083b30 0x559cc8085f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:34.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.218+0000 7fea927fc640 1 --2- 172.21.15.22:0/2313260606 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559cc8083b30 0x559cc8085f50 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26ebea4df918d32 server_cookie=2b80756b4f3861d9 in_seq=0 out_seq=0 2024-08-20T01:34:34.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.218+0000 7fea72ffd640 10 client.25577 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:34.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.236+0000 7fea72ffd640 1 -- 172.21.15.22:0/2313260606 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x559cc7f6ea10 con 0x559cc8083b30 2024-08-20T01:34:34.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.236+0000 7fea72ffd640 10 client.25577 handle_command_reply: tid=0 2024-08-20T01:34:34.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.236+0000 7fea9bc69740 1 client.25577 shutdown 2024-08-20T01:34:34.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.236+0000 7fea9bc69740 1 -- 172.21.15.22:0/2313260606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 msgr2=0x559cc800c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:34.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.236+0000 7fea9bc69740 1 --2- 172.21.15.22:0/2313260606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc800c800 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fea840c6480 tx=0x7fea840303b0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.237+0000 7fea9bc69740 1 -- 172.21.15.22:0/2313260606 shutdown_connections 2024-08-20T01:34:34.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.237+0000 7fea9bc69740 1 --2- 172.21.15.22:0/2313260606 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559cc8083b30 0x559cc8085f50 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.237+0000 7fea9bc69740 1 --2- 172.21.15.22:0/2313260606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559cc80090e0 0x559cc8081e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.237+0000 7fea72ffd640 0 client.25577 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:34.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.237+0000 7fea9bc69740 1 --2- 172.21.15.22:0/2313260606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559cc7ffd150 0x559cc800cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.237+0000 7fea9bc69740 1 --2- 172.21.15.22:0/2313260606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559cc7ffc830 0x559cc800c800 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.237+0000 7fea9bc69740 1 -- 172.21.15.22:0/2313260606 >> 172.21.15.22:0/2313260606 conn(0x559cc7ffa660 msgr2=0x559cc8007ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:34.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.237+0000 7fea9bc69740 1 -- 172.21.15.22:0/2313260606 shutdown_connections 2024-08-20T01:34:34.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.237+0000 7fea9bc69740 1 -- 172.21.15.22:0/2313260606 wait complete. 2024-08-20T01:34:34.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.237+0000 7fea9bc69740 20 client.25577 trim_cache size 0 max 16384 2024-08-20T01:34:34.241 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:34:34.241 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "scrub active (1610 inodes in the stack)", 2024-08-20T01:34:34.241 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-08-20T01:34:34.241 INFO:teuthology.orchestra.run.smithi022.stdout: "956ed84a-0df2-4bcf-8fa3-83d88836bcdd": { 2024-08-20T01:34:34.241 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-08-20T01:34:34.241 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "956ed84a-0df2-4bcf-8fa3-83d88836bcdd", 2024-08-20T01:34:34.241 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-08-20T01:34:34.241 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:34:34.241 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:34:34.241 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:34:34.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.238+0000 7fea99870640 1 -- 172.21.15.22:0/3847553639 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fea7c0b3c50 msgr2=0x7fea7c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:34.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.238+0000 7fea99870640 1 --2- 172.21.15.22:0/3847553639 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fea7c0b3c50 0x7fea7c0b6110 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fea940ff9c0 tx=0x7fea8c009500 comp rx=0 tx=0).stop 2024-08-20T01:34:34.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.238+0000 7fea99870640 1 -- 172.21.15.22:0/3847553639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea94101990 msgr2=0x7fea940fd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:34.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.238+0000 7fea99870640 1 --2- 172.21.15.22:0/3847553639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea94101990 0x7fea940fd900 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fea84035040 tx=0x7fea84032d50 comp rx=0 tx=0).stop 2024-08-20T01:34:34.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.238+0000 7fea99870640 1 -- 172.21.15.22:0/3847553639 shutdown_connections 2024-08-20T01:34:34.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.238+0000 7fea99870640 1 --2- 172.21.15.22:0/3847553639 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fea7c0b3c50 0x7fea7c0b6110 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.238+0000 7fea99870640 1 --2- 172.21.15.22:0/3847553639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea94107d20 0x7fea940fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.238+0000 7fea99870640 1 --2- 172.21.15.22:0/3847553639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea941073a0 0x7fea940fde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.238+0000 7fea99870640 1 --2- 172.21.15.22:0/3847553639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea94101990 0x7fea940fd900 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.238+0000 7fea99870640 1 -- 172.21.15.22:0/3847553639 >> 172.21.15.22:0/3847553639 conn(0x7fea940fd400 msgr2=0x7fea9406aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:34.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.238+0000 7fea99870640 1 -- 172.21.15.22:0/3847553639 shutdown_connections 2024-08-20T01:34:34.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:34:34.238+0000 7fea99870640 1 -- 172.21.15.22:0/3847553639 wait complete. 2024-08-20T01:34:34.811 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:34 smithi022 ceph-mon[18709]: pgmap v449: 97 pgs: 97 active+clean; 891 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.5 MiB/s wr, 593 op/s 2024-08-20T01:34:34.811 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:34 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:34:34.811 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:34 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:34:34.812 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:34 smithi134 ceph-mon[22511]: pgmap v449: 97 pgs: 97 active+clean; 891 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.5 MiB/s wr, 593 op/s 2024-08-20T01:34:34.812 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:34 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:34:34.813 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:34 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:34:34.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:34 smithi077 ceph-mon[22251]: pgmap v449: 97 pgs: 97 active+clean; 891 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.5 MiB/s wr, 593 op/s 2024-08-20T01:34:34.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:34 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:34:34.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:34 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:34:35.017 INFO:tasks.cephfs.filesystem:scrub status for tag:956ed84a-0df2-4bcf-8fa3-83d88836bcdd - {'path': '/', 'tag': '956ed84a-0df2-4bcf-8fa3-83d88836bcdd', 'options': 'recursive,force'} 2024-08-20T01:34:35.082 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:34:34 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i[52992]: 2024-08-20T01:34:34.810+0000 7f7703adc640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023d9 [...2,head] /volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/ auth{2=1} v130229 ap=2 f(v4 m2024-08-20T01:33:36.108609+0000 73=73+0) n(v6 rc2024-08-20T01:33:36.108609+0000 b1033884 74=73+1) (inest sync->mix g=2) caps={24937=pAsLsXsFs/pAsLsXsFsx@57} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x56492199eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000023d9:[<0x10000000399/blog-51 v85657>,<0x10000000208/blogtest_in v682>,<0x10000000201/src v2089>,<0x10000000006/blogbench-1.0 v1841>,<0x10000000005/tmp v120>,<0x100000001fb/client.0 v114>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v129>,<0x10000000001/sv_1 v145>,<0x10000000000/qa v134>,<0x1/volumes v126>]//[]","memoryvalue":"(2)0x100000023d9:[<0x10000000399/blog-51 v130229>,<0x10000000208/blogtest_in v2410>,<0x10000000201/src v2362>,<0x10000000006/blogbench-1.0 v2076>,<0x10000000005/tmp v345>,<0x100000001fb/client.0 v339>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v346>,<0x10000000001/sv_1 v354>,<0x10000000000/qa v344>,<0x1/volumes v339>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-20T01:33:32.415657+0000 46=46+0)","ondisk_value.rstat":"n(v0 rc2024-08-20T01:33:36.108609+0000 b1033884 74=73+1)","memory_value.dirstat":"f(v4 m2024-08-20T01:33:36.108609+0000 73=73+0)","memory_value.rstat":"n(v6 rc2024-08-20T01:33:36.108609+0000 b1033884 74=73+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-20T01:34:35.082 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:34:34 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i[52992]: 2024-08-20T01:34:34.833+0000 7f7703adc640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017f0 [...2,head] /volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/ auth{1=1,2=1} v133468 ap=2 f(v7 m2024-08-20T01:34:19.005048+0000 91=91+0) n(v9 rc2024-08-20T01:34:19.005048+0000 b1956880 92=91+1) (inest sync->mix g=1,2) caps={24937=pAsLsXsFs/pAsLsXsFsx@229} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x564923755080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000017f0:[<0x10000000399/blog-26 v40775>,<0x10000000208/blogtest_in v363>,<0x10000000201/src v2025>,<0x10000000006/blogbench-1.0 v1777>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v56>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v71>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v82>,<0x1/volumes v76>]//[]","memoryvalue":"(2)0x100000017f0:[<0x10000000399/blog-26 v133468>,<0x10000000208/blogtest_in v2410>,<0x10000000201/src v2362>,<0x10000000006/blogbench-1.0 v2076>,<0x10000000005/tmp v345>,<0x100000001fb/client.0 v339>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v346>,<0x10000000001/sv_1 v354>,<0x10000000000/qa v344>,<0x1/volumes v339>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-20T01:34:03.959245+0000 90=90+0)","ondisk_value.rstat":"n(v0 rc2024-08-20T01:34:19.005048+0000 b1956880 92=91+1)","memory_value.dirstat":"f(v7 m2024-08-20T01:34:19.005048+0000 91=91+0)","memory_value.rstat":"n(v9 rc2024-08-20T01:34:19.005048+0000 b1956880 92=91+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-20T01:34:35.082 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:34:34 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i[52992]: 2024-08-20T01:34:34.842+0000 7f7703adc640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b3d [...2,head] /volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/ auth{1=1,2=1} fragtree_t(*^3) v131052 ap=2 f(v7 m2024-08-20T01:34:02.568263+0000 185=185+0) n(v8 rc2024-08-20T01:34:02.568263+0000 b4261355 186=185+1) (inest sync->mix g=1,2) caps={24937=pAsLsXsFs/pAsLsXsFsx@242} | dirtyscattered=0 request=0 lock=0 dirfrag=8 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x564927bfdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000002b3d:[<0x10000000399/blog-66 v85749>,<0x10000000208/blogtest_in v682>,<0x10000000201/src v2089>,<0x10000000006/blogbench-1.0 v1841>,<0x10000000005/tmp v120>,<0x100000001fb/client.0 v114>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v129>,<0x10000000001/sv_1 v145>,<0x10000000000/qa v134>,<0x1/volumes v126>]//[]","memoryvalue":"(2)0x10000002b3d:[<0x10000000399/blog-66 v131052>,<0x10000000208/blogtest_in v2410>,<0x10000000201/src v2362>,<0x10000000006/blogbench-1.0 v2076>,<0x10000000005/tmp v345>,<0x100000001fb/client.0 v339>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v346>,<0x10000000001/sv_1 v354>,<0x10000000000/qa v344>,<0x1/volumes v339>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-20T01:33:50.019427+0000 183=183+0)","ondisk_value.rstat":"n(v0 rc2024-08-20T01:34:02.568263+0000 b4261355 186=185+1)","memory_value.dirstat":"f(v7 m2024-08-20T01:34:02.568263+0000 185=185+0)","memory_value.rstat":"n(v8 rc2024-08-20T01:34:02.568263+0000 b4261355 186=185+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-20T01:34:35.083 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:34:34 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i[52992]: 2024-08-20T01:34:34.941+0000 7f7703adc640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000141d [...2,head] /volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/ auth{1=1,2=1} v131050 ap=2 f(v6 m2024-08-20T01:34:03.646249+0000 56=56+0) n(v9 rc2024-08-20T01:34:03.646249+0000 b1280470 57=56+1) (inest sync->mix g=1,2) caps={24937=pAsLsXsFs/pAsLsXsFsx@121} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5649234d5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000141d:[<0x10000000399/blog-20 v37916>,<0x10000000208/blogtest_in v363>,<0x10000000201/src v2025>,<0x10000000006/blogbench-1.0 v1777>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v56>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v71>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v82>,<0x1/volumes v76>]//[]","memoryvalue":"(2)0x1000000141d:[<0x10000000399/blog-20 v131050>,<0x10000000208/blogtest_in v2416>,<0x10000000201/src v2362>,<0x10000000006/blogbench-1.0 v2076>,<0x10000000005/tmp v345>,<0x100000001fb/client.0 v339>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v346>,<0x10000000001/sv_1 v354>,<0x10000000000/qa v344>,<0x1/volumes v339>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-20T01:33:51.055414+0000 53=53+0)","ondisk_value.rstat":"n(v0 rc2024-08-20T01:34:03.646249+0000 b1280470 57=56+1)","memory_value.dirstat":"f(v6 m2024-08-20T01:34:03.646249+0000 56=56+0)","memory_value.rstat":"n(v9 rc2024-08-20T01:34:03.646249+0000 b1280470 57=56+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-20T01:34:35.083 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:34:35 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i[52992]: 2024-08-20T01:34:35.081+0000 7f7703adc640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b8d [...2,head] /volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/ auth{1=1,2=1} fragtree_t(*^3) v145883 ap=2 f(v6 m2024-08-20T01:33:56.641341+0000 198=198+0) n(v8 rc2024-08-20T01:33:56.641341+0000 b3900978 199=198+1) (inest sync->mix g=1,2) caps={24937=pAsLsXsFs/pAsLsXsFsx@318} mcw={1=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=8 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x564922c20580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000001b8d:[<0x10000000399/blog-31 v55487>,<0x10000000208/blogtest_in v498>,<0x10000000201/src v2059>,<0x10000000006/blogbench-1.0 v1811>,<0x10000000005/tmp v94>,<0x100000001fb/client.0 v90>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v105>,<0x10000000001/sv_1 v122>,<0x10000000000/qa v112>,<0x1/volumes v104>]//[]","memoryvalue":"(2)0x10000001b8d:[<0x10000000399/blog-31 v145883>,<0x10000000208/blogtest_in v2420>,<0x10000000201/src v2362>,<0x10000000006/blogbench-1.0 v2076>,<0x10000000005/tmp v345>,<0x100000001fb/client.0 v339>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v346>,<0x10000000001/sv_1 v354>,<0x10000000000/qa v344>,<0x1/volumes v339>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-20T01:33:30.895677+0000 196=196+0)","ondisk_value.rstat":"n(v0 rc2024-08-20T01:33:56.641341+0000 b3900978 199=198+1)","memory_value.dirstat":"f(v6 m2024-08-20T01:33:56.641341+0000 198=198+0)","memory_value.rstat":"n(v8 rc2024-08-20T01:33:56.641341+0000 b3900978 199=198+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-20T01:34:35.516 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:34:35 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i[52992]: 2024-08-20T01:34:35.279+0000 7f7703adc640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002da0 [...2,head] /volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/ auth{1=1,2=1} v148721 ap=2 f(v8 m2024-08-20T01:34:17.818064+0000 81=81+0) n(v9 rc2024-08-20T01:34:17.818064+0000 b2075756 82=81+1) (inest sync->mix g=1,2) caps={24937=pAsLsXsFs/pAsLsXsFsx@92} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x564927fcf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000002da0:[<0x10000000399/blog-71 v86835>,<0x10000000208/blogtest_in v682>,<0x10000000201/src v2089>,<0x10000000006/blogbench-1.0 v1841>,<0x10000000005/tmp v120>,<0x100000001fb/client.0 v114>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v129>,<0x10000000001/sv_1 v145>,<0x10000000000/qa v134>,<0x1/volumes v126>]//[]","memoryvalue":"(2)0x10000002da0:[<0x10000000399/blog-71 v148721>,<0x10000000208/blogtest_in v2424>,<0x10000000201/src v2362>,<0x10000000006/blogbench-1.0 v2076>,<0x10000000005/tmp v345>,<0x100000001fb/client.0 v339>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v346>,<0x10000000001/sv_1 v354>,<0x10000000000/qa v344>,<0x1/volumes v339>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-20T01:33:59.272306+0000 79=79+0)","ondisk_value.rstat":"n(v0 rc2024-08-20T01:34:17.818064+0000 b2075756 82=81+1)","memory_value.dirstat":"f(v8 m2024-08-20T01:34:17.818064+0000 81=81+0)","memory_value.rstat":"n(v9 rc2024-08-20T01:34:17.818064+0000 b2075756 82=81+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-20T01:34:35.516 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:34:35 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i[52992]: 2024-08-20T01:34:35.285+0000 7f7703adc640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001585 [...2,head] /volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/ auth{1=1,2=1} fragtree_t(*^3) v148717 ap=2 f(v9 m2024-08-20T01:34:18.547054+0000 225=225+0) n(v12 rc2024-08-20T01:34:18.547054+0000 b4855270 226=225+1) (inest sync->mix g=1,2) caps={24937=pAsLsXsFs/pAsLsXsFsx@1694} | dirtyscattered=0 request=0 lock=0 dirfrag=8 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5649236e5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000001585:[<0x10000000399/blog-23 v38650>,<0x10000000208/blogtest_in v363>,<0x10000000201/src v2025>,<0x10000000006/blogbench-1.0 v1777>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v56>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v71>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v82>,<0x1/volumes v76>]//[]","memoryvalue":"(2)0x10000001585:[<0x10000000399/blog-23 v148717>,<0x10000000208/blogtest_in v2424>,<0x10000000201/src v2362>,<0x10000000006/blogbench-1.0 v2076>,<0x10000000005/tmp v345>,<0x100000001fb/client.0 v339>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v346>,<0x10000000001/sv_1 v354>,<0x10000000000/qa v344>,<0x1/volumes v339>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-20T01:34:18.236058+0000 224=224+0)","ondisk_value.rstat":"n(v0 rc2024-08-20T01:34:18.547054+0000 b4855270 226=225+1)","memory_value.dirstat":"f(v9 m2024-08-20T01:34:18.547054+0000 225=225+0)","memory_value.rstat":"n(v12 rc2024-08-20T01:34:18.547054+0000 b4855270 226=225+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-20T01:34:35.815 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:34:35 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-b[51871]: 2024-08-20T01:34:35.348+0000 7f55efeee640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000350f [...2,head] /volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-92/ auth{0=1,2=1} fragtree_t(*^3) v132571 ap=2 f(v5 m2024-08-20T01:34:02.830260+0000 139=139+0) n(v6 rc2024-08-20T01:34:02.830260+0000 b4019761 140=139+1) (inest sync->mix g=0,2) caps={24937=pAsLsXsFs/pAsLsXsFsx@1551} | dirtyscattered=0 request=0 lock=0 importingcaps=0 importing=0 dirfrag=8 caps=1 stickydirs=0 replicated=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55fb02eaa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000350f:[<0x10000000399/blog-92 v105959>,<0x10000000208/blogtest_in v1020>,<0x10000000201/src v2129>,<0x10000000006/blogbench-1.0 v1881>,<0x10000000005/tmp v158>,<0x100000001fb/client.0 v152>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v167>,<0x10000000001/sv_1 v183>,<0x10000000000/qa v172>,<0x1/volumes v164>]//[]","memoryvalue":"(2)0x1000000350f:[<0x10000000399/blog-92 v132571>,<0x10000000208/blogtest_in v2410>,<0x10000000201/src v2356>,<0x10000000006/blogbench-1.0 v2070>,<0x10000000005/tmp v339>,<0x100000001fb/client.0 v333>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v340>,<0x10000000001/sv_1 v350>,<0x10000000000/qa v303>,<0x1/volumes v337>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-20T01:33:49.875429+0000 137=137+0)","ondisk_value.rstat":"n(v0 rc2024-08-20T01:34:02.830260+0000 b4019761 140=139+1)","memory_value.dirstat":"f(v5 m2024-08-20T01:34:02.830260+0000 139=139+0)","memory_value.rstat":"n(v6 rc2024-08-20T01:34:02.830260+0000 b4019761 140=139+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-20T01:34:35.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:35 smithi077 ceph-mon[22251]: Scrub error on inode 0x100000023d9 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51) see mds.i log and `damage ls` output for details 2024-08-20T01:34:35.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:35 smithi077 ceph-mon[22251]: Scrub error on inode 0x100000017f0 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26) see mds.i log and `damage ls` output for details 2024-08-20T01:34:35.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:35 smithi077 ceph-mon[22251]: Scrub error on inode 0x10000002b3d (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66) see mds.i log and `damage ls` output for details 2024-08-20T01:34:35.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:35 smithi077 ceph-mon[22251]: Scrub error on inode 0x1000000141d (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20) see mds.i log and `damage ls` output for details 2024-08-20T01:34:35.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:35 smithi077 ceph-mon[22251]: Scrub error on inode 0x10000001b8d (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31) see mds.i log and `damage ls` output for details 2024-08-20T01:34:35.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:35 smithi022 ceph-mon[18709]: Scrub error on inode 0x100000023d9 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51) see mds.i log and `damage ls` output for details 2024-08-20T01:34:35.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:35 smithi022 ceph-mon[18709]: Scrub error on inode 0x100000017f0 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26) see mds.i log and `damage ls` output for details 2024-08-20T01:34:35.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:35 smithi022 ceph-mon[18709]: Scrub error on inode 0x10000002b3d (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66) see mds.i log and `damage ls` output for details 2024-08-20T01:34:35.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:35 smithi022 ceph-mon[18709]: Scrub error on inode 0x1000000141d (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20) see mds.i log and `damage ls` output for details 2024-08-20T01:34:35.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:35 smithi022 ceph-mon[18709]: Scrub error on inode 0x10000001b8d (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31) see mds.i log and `damage ls` output for details 2024-08-20T01:34:36.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:35 smithi134 ceph-mon[22511]: Scrub error on inode 0x100000023d9 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51) see mds.i log and `damage ls` output for details 2024-08-20T01:34:36.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:35 smithi134 ceph-mon[22511]: Scrub error on inode 0x100000017f0 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26) see mds.i log and `damage ls` output for details 2024-08-20T01:34:36.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:35 smithi134 ceph-mon[22511]: Scrub error on inode 0x10000002b3d (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66) see mds.i log and `damage ls` output for details 2024-08-20T01:34:36.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:35 smithi134 ceph-mon[22511]: Scrub error on inode 0x1000000141d (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20) see mds.i log and `damage ls` output for details 2024-08-20T01:34:36.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:35 smithi134 ceph-mon[22511]: Scrub error on inode 0x10000001b8d (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31) see mds.i log and `damage ls` output for details 2024-08-20T01:34:36.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:36 smithi022 ceph-mon[18709]: Scrub error on inode 0x10000002da0 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71) see mds.i log and `damage ls` output for details 2024-08-20T01:34:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:36 smithi022 ceph-mon[18709]: Scrub error on inode 0x10000001585 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23) see mds.i log and `damage ls` output for details 2024-08-20T01:34:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:36 smithi022 ceph-mon[18709]: Scrub error on inode 0x1000000350f (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-92) see mds.b log and `damage ls` output for details 2024-08-20T01:34:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:36 smithi022 ceph-mon[18709]: pgmap v450: 97 pgs: 97 active+clean; 891 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.8 MiB/s wr, 694 op/s 2024-08-20T01:34:37.138 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:36 smithi077 ceph-mon[22251]: Scrub error on inode 0x10000002da0 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71) see mds.i log and `damage ls` output for details 2024-08-20T01:34:37.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:36 smithi077 ceph-mon[22251]: Scrub error on inode 0x10000001585 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23) see mds.i log and `damage ls` output for details 2024-08-20T01:34:37.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:36 smithi077 ceph-mon[22251]: Scrub error on inode 0x1000000350f (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-92) see mds.b log and `damage ls` output for details 2024-08-20T01:34:37.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:36 smithi077 ceph-mon[22251]: pgmap v450: 97 pgs: 97 active+clean; 891 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.8 MiB/s wr, 694 op/s 2024-08-20T01:34:37.139 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:36 smithi134 ceph-mon[22511]: Scrub error on inode 0x10000002da0 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71) see mds.i log and `damage ls` output for details 2024-08-20T01:34:37.139 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:36 smithi134 ceph-mon[22511]: Scrub error on inode 0x10000001585 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23) see mds.i log and `damage ls` output for details 2024-08-20T01:34:37.139 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:36 smithi134 ceph-mon[22511]: Scrub error on inode 0x1000000350f (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-92) see mds.b log and `damage ls` output for details 2024-08-20T01:34:37.139 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:36 smithi134 ceph-mon[22511]: pgmap v450: 97 pgs: 97 active+clean; 891 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.8 MiB/s wr, 694 op/s 2024-08-20T01:34:38.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:38 smithi022 ceph-mon[18709]: pgmap v451: 97 pgs: 97 active+clean; 921 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 8.0 MiB/s wr, 1.73k op/s 2024-08-20T01:34:39.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:38 smithi134 ceph-mon[22511]: pgmap v451: 97 pgs: 97 active+clean; 921 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 8.0 MiB/s wr, 1.73k op/s 2024-08-20T01:34:39.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:38 smithi077 ceph-mon[22251]: pgmap v451: 97 pgs: 97 active+clean; 921 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 8.0 MiB/s wr, 1.73k op/s 2024-08-20T01:34:39.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:39 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:34:40.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:39 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:34:40.023 INFO:tasks.workunit.client.0.smithi022.stdout: 310 645511 380 459026 556 211879 885 2024-08-20T01:34:40.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:39 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:34:40.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:40 smithi022 ceph-mon[18709]: pgmap v452: 97 pgs: 97 active+clean; 941 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.6 MiB/s wr, 1.83k op/s 2024-08-20T01:34:40.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:40 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:34:41.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:40 smithi134 ceph-mon[22511]: pgmap v452: 97 pgs: 97 active+clean; 941 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.6 MiB/s wr, 1.83k op/s 2024-08-20T01:34:41.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:40 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:34:41.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:40 smithi077 ceph-mon[22251]: pgmap v452: 97 pgs: 97 active+clean; 941 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.6 MiB/s wr, 1.83k op/s 2024-08-20T01:34:41.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:40 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:34:42.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:42 smithi022 ceph-mon[18709]: pgmap v453: 97 pgs: 97 active+clean; 995 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 13 MiB/s wr, 2.75k op/s 2024-08-20T01:34:43.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:42 smithi134 ceph-mon[22511]: pgmap v453: 97 pgs: 97 active+clean; 995 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 13 MiB/s wr, 2.75k op/s 2024-08-20T01:34:43.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:42 smithi077 ceph-mon[22251]: pgmap v453: 97 pgs: 97 active+clean; 995 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 13 MiB/s wr, 2.75k op/s 2024-08-20T01:34:44.866 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:44 smithi077 ceph-mon[22251]: pgmap v454: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 18 MiB/s wr, 3.42k op/s 2024-08-20T01:34:44.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:44 smithi022 ceph-mon[18709]: pgmap v454: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 18 MiB/s wr, 3.42k op/s 2024-08-20T01:34:45.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:44 smithi134 ceph-mon[22511]: pgmap v454: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 18 MiB/s wr, 3.42k op/s 2024-08-20T01:34:46.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.878+0000 7f10a052a640 1 -- 172.21.15.22:0/3679735615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1098103070 msgr2=0x7f10981099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.878+0000 7f10a052a640 1 --2- 172.21.15.22:0/3679735615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1098103070 0x7f10981099f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1090009cd0 tx=0x7f109002a8f0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.878+0000 7f10a052a640 1 -- 172.21.15.22:0/3679735615 shutdown_connections 2024-08-20T01:34:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.878+0000 7f10a052a640 1 --2- 172.21.15.22:0/3679735615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1098103070 0x7f10981099f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.878+0000 7f10a052a640 1 --2- 172.21.15.22:0/3679735615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10981026b0 0x7f1098102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.878+0000 7f10a052a640 1 --2- 172.21.15.22:0/3679735615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1098101560 0x7f1098101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.878+0000 7f10a052a640 1 -- 172.21.15.22:0/3679735615 >> 172.21.15.22:0/3679735615 conn(0x7f10980fce40 msgr2=0x7f10980ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.879+0000 7f10a052a640 1 -- 172.21.15.22:0/3679735615 shutdown_connections 2024-08-20T01:34:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.879+0000 7f10a052a640 1 -- 172.21.15.22:0/3679735615 wait complete. 2024-08-20T01:34:46.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.879+0000 7f10a052a640 1 Processor -- start 2024-08-20T01:34:46.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.879+0000 7f10a052a640 1 -- start start 2024-08-20T01:34:46.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.880+0000 7f10a052a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1098101560 0x7f109810cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.880+0000 7f10a052a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10981026b0 0x7f109810b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.880+0000 7f10a052a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1098103070 0x7f109810bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.880+0000 7f10a052a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f109810e320 con 0x7f1098103070 2024-08-20T01:34:46.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.880+0000 7f10a052a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f109810e1a0 con 0x7f10981026b0 2024-08-20T01:34:46.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.880+0000 7f10a052a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f109810e4a0 con 0x7f1098101560 2024-08-20T01:34:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.880+0000 7f109eac7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1098103070 0x7f109810bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.880+0000 7f109e2c6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1098101560 0x7f109810cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.880+0000 7f109eac7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1098103070 0x7f109810bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44772/0 (socket says 172.21.15.22:44772) 2024-08-20T01:34:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.880+0000 7f109eac7640 1 -- 172.21.15.22:0/2023342888 learned_addr learned my addr 172.21.15.22:0/2023342888 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.880+0000 7f109e2c6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1098101560 0x7f109810cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:53686/0 (socket says 172.21.15.22:53686) 2024-08-20T01:34:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.880+0000 7f109dac5640 1 --2- 172.21.15.22:0/2023342888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10981026b0 0x7f109810b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.880+0000 7f109dac5640 1 -- 172.21.15.22:0/2023342888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1098101560 msgr2=0x7f109810cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.880+0000 7f109dac5640 1 --2- 172.21.15.22:0/2023342888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1098101560 0x7f109810cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.880+0000 7f109dac5640 1 -- 172.21.15.22:0/2023342888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1098103070 msgr2=0x7f109810bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.880+0000 7f109dac5640 1 --2- 172.21.15.22:0/2023342888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1098103070 0x7f109810bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.880+0000 7f109dac5640 1 -- 172.21.15.22:0/2023342888 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109810c3f0 con 0x7f10981026b0 2024-08-20T01:34:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.881+0000 7f109dac5640 1 --2- 172.21.15.22:0/2023342888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10981026b0 0x7f109810b640 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f108800e9f0 tx=0x7f108800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.881+0000 7f108f7fe640 1 -- 172.21.15.22:0/2023342888 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108800ccc0 con 0x7f10981026b0 2024-08-20T01:34:46.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.881+0000 7f108f7fe640 1 -- 172.21.15.22:0/2023342888 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1088005020 con 0x7f10981026b0 2024-08-20T01:34:46.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.881+0000 7f108f7fe640 1 -- 172.21.15.22:0/2023342888 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1088004a00 con 0x7f10981026b0 2024-08-20T01:34:46.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.881+0000 7f10a052a640 1 -- 172.21.15.22:0/2023342888 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10981a2930 con 0x7f10981026b0 2024-08-20T01:34:46.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.881+0000 7f10a052a640 1 -- 172.21.15.22:0/2023342888 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10981a2e00 con 0x7f10981026b0 2024-08-20T01:34:46.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.884+0000 7f10a33f5740 1 Processor -- start 2024-08-20T01:34:46.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.885+0000 7f10a33f5740 1 -- start start 2024-08-20T01:34:46.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.885+0000 7f10a33f5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec21978d0 0x564ec2199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.885+0000 7f10a33f5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219a200 0x564ec219c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:46 smithi022 ceph-mon[18709]: pgmap v455: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 19 MiB/s wr, 3.34k op/s 2024-08-20T01:34:46.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.885+0000 7f10a33f5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec219cc40 0x564ec219f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.885+0000 7f10a33f5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564ec210a360 con 0x564ec219cc40 2024-08-20T01:34:46.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.885+0000 7f10a33f5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564ec20f9860 con 0x564ec219a200 2024-08-20T01:34:46.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.885+0000 7f10a33f5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564ec20fd8a0 con 0x564ec21978d0 2024-08-20T01:34:46.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.885+0000 7f109eac7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec21978d0 0x564ec2199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:46.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.885+0000 7f109eac7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec21978d0 0x564ec2199cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:53688/0 (socket says 172.21.15.22:53688) 2024-08-20T01:34:46.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.885+0000 7f109eac7640 1 -- 172.21.15.22:0/928859283 learned_addr learned my addr 172.21.15.22:0/928859283 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:46.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.885+0000 7f109e2c6640 1 --2- 172.21.15.22:0/928859283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219a200 0x564ec219c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:46.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.886+0000 7f109eac7640 1 -- 172.21.15.22:0/928859283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219a200 msgr2=0x564ec219c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:46.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.886+0000 7f109eac7640 1 --2- 172.21.15.22:0/928859283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219a200 0x564ec219c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.886+0000 7f109eac7640 1 -- 172.21.15.22:0/928859283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec219cc40 msgr2=0x564ec219f100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:34:46.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.886+0000 7f109eac7640 1 --2- 172.21.15.22:0/928859283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec219cc40 0x564ec219f100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.886+0000 7f109eac7640 1 -- 172.21.15.22:0/928859283 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ec20a0e40 con 0x564ec21978d0 2024-08-20T01:34:46.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.886+0000 7f109e2c6640 1 --2- 172.21.15.22:0/928859283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219a200 0x564ec219c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:34:46.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.886+0000 7f109eac7640 1 --2- 172.21.15.22:0/928859283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec21978d0 0x564ec2199cc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1090009a50 tx=0x7f1090030f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f23349a2418b62a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:46.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.886+0000 7f108f7fe640 1 -- 172.21.15.22:0/2023342888 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1088004ba0 con 0x7f10981026b0 2024-08-20T01:34:46.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.886+0000 7f108cbfe640 1 -- 172.21.15.22:0/928859283 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1090030a70 con 0x564ec21978d0 2024-08-20T01:34:46.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.886+0000 7f108cbfe640 1 -- 172.21.15.22:0/928859283 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1090036030 con 0x564ec21978d0 2024-08-20T01:34:46.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.886+0000 7f108cbfe640 1 -- 172.21.15.22:0/928859283 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10900044b0 con 0x564ec21978d0 2024-08-20T01:34:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.887+0000 7f10a33f5740 1 -- 172.21.15.22:0/928859283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec21978d0 msgr2=0x564ec2199cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.887+0000 7f10a33f5740 1 --2- 172.21.15.22:0/928859283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec21978d0 0x564ec2199cc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1090009a50 tx=0x7f1090030f00 comp rx=0 tx=0).stop 2024-08-20T01:34:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.887+0000 7f10a33f5740 1 -- 172.21.15.22:0/928859283 shutdown_connections 2024-08-20T01:34:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.887+0000 7f10a33f5740 1 --2- 172.21.15.22:0/928859283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec219cc40 0x564ec219f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.887+0000 7f10a33f5740 1 --2- 172.21.15.22:0/928859283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219a200 0x564ec219c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.887+0000 7f10a33f5740 1 --2- 172.21.15.22:0/928859283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec21978d0 0x564ec2199cc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.887+0000 7f10a33f5740 1 -- 172.21.15.22:0/928859283 >> 172.21.15.22:0/928859283 conn(0x564ec2192a20 msgr2=0x564ec21937b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.888+0000 7f10a33f5740 1 -- 172.21.15.22:0/928859283 shutdown_connections 2024-08-20T01:34:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.888+0000 7f108f7fe640 1 --2- 172.21.15.22:0/2023342888 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f10840b3b60 0x7f10840b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.888+0000 7f10a33f5740 1 -- 172.21.15.22:0/928859283 wait complete. 2024-08-20T01:34:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.888+0000 7f109e2c6640 1 --2- 172.21.15.22:0/2023342888 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f10840b3b60 0x7f10840b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.888+0000 7f108f7fe640 1 -- 172.21.15.22:0/2023342888 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f10880e3ba0 con 0x7f10981026b0 2024-08-20T01:34:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.888+0000 7f10a33f5740 1 -- start start 2024-08-20T01:34:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.888+0000 7f10a33f5740 1 Processor -- start 2024-08-20T01:34:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.888+0000 7f109e2c6640 1 --2- 172.21.15.22:0/2023342888 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f10840b3b60 0x7f10840b6020 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1094009b50 tx=0x7f1094005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.889+0000 7f10a33f5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec21978d0 0x564ec21a1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.889+0000 7f10a33f5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec219a200 0x564ec21a1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.889+0000 7f10a33f5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219cc40 0x564ec21a22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.889+0000 7f109e2c6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec21978d0 0x564ec21a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.889+0000 7f109e2c6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec21978d0 0x564ec21a1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:53704/0 (socket says 172.21.15.22:53704) 2024-08-20T01:34:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.889+0000 7f109dac5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec219a200 0x564ec21a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.889+0000 7f109dac5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec219a200 0x564ec21a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44780/0 (socket says 172.21.15.22:44780) 2024-08-20T01:34:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.889+0000 7f109eac7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219cc40 0x564ec21a22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.889+0000 7f109eac7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219cc40 0x564ec21a22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:34436/0 (socket says 172.21.15.22:34436) 2024-08-20T01:34:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.889+0000 7f109e2c6640 1 -- 172.21.15.22:0/2253692237 learned_addr learned my addr 172.21.15.22:0/2253692237 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.889+0000 7f10a33f5740 1 -- 172.21.15.22:0/2253692237 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564ec2032ab0 con 0x564ec219a200 2024-08-20T01:34:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.889+0000 7f10a33f5740 1 -- 172.21.15.22:0/2253692237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564ec2080780 con 0x564ec219cc40 2024-08-20T01:34:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.890+0000 7f10a33f5740 1 -- 172.21.15.22:0/2253692237 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564ec219fbc0 con 0x564ec21978d0 2024-08-20T01:34:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.890+0000 7f109e2c6640 1 -- 172.21.15.22:0/2253692237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219cc40 msgr2=0x564ec21a22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.890+0000 7f109e2c6640 1 --2- 172.21.15.22:0/2253692237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219cc40 0x564ec21a22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.890+0000 7f109e2c6640 1 -- 172.21.15.22:0/2253692237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec219a200 msgr2=0x564ec21a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.890+0000 7f109e2c6640 1 --2- 172.21.15.22:0/2253692237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec219a200 0x564ec21a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.890+0000 7f109e2c6640 1 -- 172.21.15.22:0/2253692237 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ec1e5c790 con 0x564ec21978d0 2024-08-20T01:34:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.890+0000 7f109e2c6640 1 --2- 172.21.15.22:0/2253692237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec21978d0 0x564ec21a1070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1094004300 tx=0x7f1094004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=278f74a35827cbfe server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.890+0000 7f1081ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:34:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.890+0000 7f10a33f5740 10 client.0 _ll_register_callbacks cb 0x564ec1e08a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:34:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.891+0000 7f10a33f5740 1 -- 172.21.15.22:0/2253692237 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564ec20a8e00 con 0x564ec21978d0 2024-08-20T01:34:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.891+0000 7f1081ffb640 1 -- 172.21.15.22:0/2253692237 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094029440 con 0x564ec21978d0 2024-08-20T01:34:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.891+0000 7f1081ffb640 1 -- 172.21.15.22:0/2253692237 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f10940295e0 con 0x564ec21978d0 2024-08-20T01:34:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.891+0000 7f1081ffb640 1 -- 172.21.15.22:0/2253692237 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1094029820 con 0x564ec21978d0 2024-08-20T01:34:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.891+0000 7f10a33f5740 10 client.25609 fetch_fsmap learned FSMap version 29 2024-08-20T01:34:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.891+0000 7f10a33f5740 1 -- 172.21.15.22:0/2253692237 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({fsmap=29}) -- 0x564ec1ed5620 con 0x564ec21978d0 2024-08-20T01:34:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.892+0000 7f1081ffb640 1 -- 172.21.15.22:0/2253692237 <== mon.1 v2:172.21.15.134:3300/0 4 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f1094027070 con 0x564ec21978d0 2024-08-20T01:34:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.892+0000 7f10a33f5740 10 client.25609 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:34:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.892+0000 7f10a33f5740 10 client.25609 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:34:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.892+0000 7f10a33f5740 20 client.25609 populate_metadata read hostname 'smithi022' 2024-08-20T01:34:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.892+0000 7f10a33f5740 1 --2- 172.21.15.22:0/2253692237 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564ec21ac770 0x564ec21aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.892+0000 7f10a33f5740 4 client.25609 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:34:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.892+0000 7f10a33f5740 1 -- 172.21.15.22:0/2253692237 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ec210c2b0 con 0x564ec21ac770 2024-08-20T01:34:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.892+0000 7f109dac5640 1 --2- 172.21.15.22:0/2253692237 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564ec21ac770 0x564ec21aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.893+0000 7f109dac5640 1 --2- 172.21.15.22:0/2253692237 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564ec21ac770 0x564ec21aeb80 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=857a5753b00f4d18 server_cookie=933e84130daa4912 in_seq=0 out_seq=0 2024-08-20T01:34:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.893+0000 7f1081ffb640 10 client.25609 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.893+0000 7f1081ffb640 1 -- 172.21.15.22:0/2253692237 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ec210c2b0 con 0x564ec21ac770 2024-08-20T01:34:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.893+0000 7f1081ffb640 10 client.25609 handle_command_reply: tid=0 2024-08-20T01:34:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.894+0000 7f10a33f5740 1 client.25609 shutdown 2024-08-20T01:34:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.894+0000 7f10a33f5740 1 -- 172.21.15.22:0/2253692237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec21978d0 msgr2=0x564ec21a1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.894+0000 7f10a33f5740 1 --2- 172.21.15.22:0/2253692237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec21978d0 0x564ec21a1070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1094004300 tx=0x7f1094004730 comp rx=0 tx=0).stop 2024-08-20T01:34:46.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.894+0000 7f10a33f5740 1 -- 172.21.15.22:0/2253692237 shutdown_connections 2024-08-20T01:34:46.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.894+0000 7f10a33f5740 1 --2- 172.21.15.22:0/2253692237 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564ec21ac770 0x564ec21aeb80 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.894+0000 7f1081ffb640 0 client.25609 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:46.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.894+0000 7f10a33f5740 1 --2- 172.21.15.22:0/2253692237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219cc40 0x564ec21a22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.894+0000 7f10a33f5740 1 --2- 172.21.15.22:0/2253692237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec219a200 0x564ec21a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.894+0000 7f10a33f5740 1 --2- 172.21.15.22:0/2253692237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec21978d0 0x564ec21a1070 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.894+0000 7f10a33f5740 1 -- 172.21.15.22:0/2253692237 >> 172.21.15.22:0/2253692237 conn(0x564ec2192a20 msgr2=0x564ec2191ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:46.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.894+0000 7f10a33f5740 1 -- 172.21.15.22:0/2253692237 shutdown_connections 2024-08-20T01:34:46.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.894+0000 7f10a33f5740 1 -- 172.21.15.22:0/2253692237 wait complete. 2024-08-20T01:34:46.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.894+0000 7f10a33f5740 20 client.25609 trim_cache size 0 max 16384 2024-08-20T01:34:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.911+0000 7f10a33f5740 1 Processor -- start 2024-08-20T01:34:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.911+0000 7f10a33f5740 1 -- start start 2024-08-20T01:34:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.911+0000 7f10a33f5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec21978d0 0x564ec21a22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.911+0000 7f10a33f5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec219a200 0x564ec21a1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.911+0000 7f10a33f5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219cc40 0x564ec219e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.911+0000 7f10a33f5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f10981ae920 con 0x564ec21978d0 2024-08-20T01:34:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.911+0000 7f10a33f5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f10981ac190 con 0x564ec219cc40 2024-08-20T01:34:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.911+0000 7f10a33f5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f10981a9fe0 con 0x564ec219a200 2024-08-20T01:34:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.911+0000 7f109e2c6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec21978d0 0x564ec21a22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.911+0000 7f109eac7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219cc40 0x564ec219e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.911+0000 7f109eac7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219cc40 0x564ec219e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:34442/0 (socket says 172.21.15.22:34442) 2024-08-20T01:34:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.911+0000 7f109e2c6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec21978d0 0x564ec21a22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44784/0 (socket says 172.21.15.22:44784) 2024-08-20T01:34:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.912+0000 7f109e2c6640 1 -- 172.21.15.22:0/3436004370 learned_addr learned my addr 172.21.15.22:0/3436004370 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.912+0000 7f109dac5640 1 --2- 172.21.15.22:0/3436004370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec219a200 0x564ec21a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.912+0000 7f109e2c6640 1 -- 172.21.15.22:0/3436004370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec219a200 msgr2=0x564ec21a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.912+0000 7f109e2c6640 1 --2- 172.21.15.22:0/3436004370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec219a200 0x564ec21a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.912+0000 7f109e2c6640 1 -- 172.21.15.22:0/3436004370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219cc40 msgr2=0x564ec219e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.912+0000 7f109e2c6640 1 --2- 172.21.15.22:0/3436004370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219cc40 0x564ec219e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.912+0000 7f109e2c6640 1 -- 172.21.15.22:0/3436004370 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ec219a030 con 0x564ec21978d0 2024-08-20T01:34:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.912+0000 7f109dac5640 1 --2- 172.21.15.22:0/3436004370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec219a200 0x564ec21a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:34:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.912+0000 7f109e2c6640 1 --2- 172.21.15.22:0/3436004370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec21978d0 0x564ec21a22c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f10940058c0 tx=0x7f1094023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e847f711fa874c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.912+0000 7f1083fff640 1 -- 172.21.15.22:0/3436004370 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109403a070 con 0x564ec21978d0 2024-08-20T01:34:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.912+0000 7f1083fff640 1 -- 172.21.15.22:0/3436004370 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564ec20a8e00 con 0x564ec21978d0 2024-08-20T01:34:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.912+0000 7f1083fff640 1 -- 172.21.15.22:0/3436004370 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094005040 con 0x564ec21978d0 2024-08-20T01:34:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.913+0000 7f10a33f5740 1 -- 172.21.15.22:0/3436004370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec21978d0 msgr2=0x564ec21a22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.913+0000 7f10a33f5740 1 --2- 172.21.15.22:0/3436004370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec21978d0 0x564ec21a22c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f10940058c0 tx=0x7f1094023000 comp rx=0 tx=0).stop 2024-08-20T01:34:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.913+0000 7f10a33f5740 1 -- 172.21.15.22:0/3436004370 shutdown_connections 2024-08-20T01:34:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.913+0000 7f10a33f5740 1 --2- 172.21.15.22:0/3436004370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219cc40 0x564ec219e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.913+0000 7f10a33f5740 1 --2- 172.21.15.22:0/3436004370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec219a200 0x564ec21a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.913+0000 7f10a33f5740 1 --2- 172.21.15.22:0/3436004370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec21978d0 0x564ec21a22c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.913+0000 7f10a33f5740 1 -- 172.21.15.22:0/3436004370 >> 172.21.15.22:0/3436004370 conn(0x564ec2192a20 msgr2=0x564ec21934c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.913+0000 7f10a33f5740 1 -- 172.21.15.22:0/3436004370 shutdown_connections 2024-08-20T01:34:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.913+0000 7f10a33f5740 1 -- 172.21.15.22:0/3436004370 wait complete. 2024-08-20T01:34:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.913+0000 7f10a33f5740 1 -- start start 2024-08-20T01:34:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.913+0000 7f10a33f5740 1 Processor -- start 2024-08-20T01:34:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f10a33f5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec21978d0 0x564ec21a86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f10a33f5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219a200 0x564ec21a73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f10a33f5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec219cc40 0x564ec21a78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f10a33f5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f10981aa650 con 0x564ec219cc40 2024-08-20T01:34:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f10a33f5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f10981abac0 con 0x564ec219a200 2024-08-20T01:34:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f10a33f5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f10981aad20 con 0x564ec21978d0 2024-08-20T01:34:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f10a33f5740 10 client.0 _ll_register_callbacks cb 0x7f1094009f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:34:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f109dac5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219a200 0x564ec21a73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f109eac7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec219cc40 0x564ec21a78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f109e2c6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec21978d0 0x564ec21a86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f109dac5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219a200 0x564ec21a73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:34452/0 (socket says 172.21.15.22:34452) 2024-08-20T01:34:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f109dac5640 1 -- 172.21.15.22:0/1697749456 learned_addr learned my addr 172.21.15.22:0/1697749456 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:34:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f109dac5640 1 -- 172.21.15.22:0/1697749456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec21978d0 msgr2=0x564ec21a86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f109dac5640 1 --2- 172.21.15.22:0/1697749456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec21978d0 0x564ec21a86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f109dac5640 1 -- 172.21.15.22:0/1697749456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec219cc40 msgr2=0x564ec21a78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:34:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f109dac5640 1 --2- 172.21.15.22:0/1697749456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec219cc40 0x564ec21a78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f109dac5640 1 -- 172.21.15.22:0/1697749456 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ec21a2f20 con 0x564ec219a200 2024-08-20T01:34:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f109dac5640 1 --2- 172.21.15.22:0/1697749456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219a200 0x564ec21a73b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f10880a6b30 tx=0x7f10880096e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e14e9ef7dc165349 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f1081ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:34:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.914+0000 7f1081ffb640 1 -- 172.21.15.22:0/1697749456 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108801c040 con 0x564ec219a200 2024-08-20T01:34:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.915+0000 7f1081ffb640 1 -- 172.21.15.22:0/1697749456 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f10880a70a0 con 0x564ec219a200 2024-08-20T01:34:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.915+0000 7f10a33f5740 1 -- 172.21.15.22:0/1697749456 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564ec20a8e00 con 0x564ec219a200 2024-08-20T01:34:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.915+0000 7f1081ffb640 1 -- 172.21.15.22:0/1697749456 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f10880c53f0 con 0x564ec219a200 2024-08-20T01:34:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.915+0000 7f10a33f5740 10 client.25595 fetch_fsmap learned FSMap version 29 2024-08-20T01:34:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.915+0000 7f10a33f5740 1 -- 172.21.15.22:0/1697749456 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564ec21a6c70 con 0x564ec219a200 2024-08-20T01:34:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.915+0000 7f1081ffb640 1 -- 172.21.15.22:0/1697749456 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564ec20a8e00 con 0x564ec219a200 2024-08-20T01:34:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.915+0000 7f1081ffb640 1 -- 172.21.15.22:0/1697749456 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f10880c4070 con 0x564ec219a200 2024-08-20T01:34:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.915+0000 7f10a33f5740 10 client.25595 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:34:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.915+0000 7f10a33f5740 10 client.25595 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:34:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.915+0000 7f10a33f5740 20 client.25595 populate_metadata read hostname 'smithi022' 2024-08-20T01:34:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.915+0000 7f10a33f5740 1 --2- 172.21.15.22:0/1697749456 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564ec21ac770 0x564ec2219bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.915+0000 7f10a33f5740 4 client.25595 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:34:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.915+0000 7f10a33f5740 1 -- 172.21.15.22:0/1697749456 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564ec2107d50 con 0x564ec21ac770 2024-08-20T01:34:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.915+0000 7f109e2c6640 1 --2- 172.21.15.22:0/1697749456 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564ec21ac770 0x564ec2219bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.916+0000 7f109e2c6640 1 --2- 172.21.15.22:0/1697749456 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564ec21ac770 0x564ec2219bb0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9df488324a63a3aa server_cookie=dc14c253bd749a85 in_seq=0 out_seq=0 2024-08-20T01:34:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:46.916+0000 7f1081ffb640 10 client.25595 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:47.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:46 smithi134 ceph-mon[22511]: pgmap v455: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 19 MiB/s wr, 3.34k op/s 2024-08-20T01:34:47.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:46 smithi077 ceph-mon[22251]: pgmap v455: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 19 MiB/s wr, 3.34k op/s 2024-08-20T01:34:47.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.463+0000 7f1081ffb640 1 -- 172.21.15.22:0/1697749456 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564ec2107d50 con 0x564ec21ac770 2024-08-20T01:34:47.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.463+0000 7f1081ffb640 10 client.25595 handle_command_reply: tid=0 2024-08-20T01:34:47.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.463+0000 7f10a33f5740 1 client.25595 shutdown 2024-08-20T01:34:47.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.463+0000 7f10a33f5740 1 -- 172.21.15.22:0/1697749456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219a200 msgr2=0x564ec21a73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:47.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.463+0000 7f10a33f5740 1 --2- 172.21.15.22:0/1697749456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219a200 0x564ec21a73b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f10880a6b30 tx=0x7f10880096e0 comp rx=0 tx=0).stop 2024-08-20T01:34:47.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.463+0000 7f10a33f5740 1 -- 172.21.15.22:0/1697749456 shutdown_connections 2024-08-20T01:34:47.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.463+0000 7f10a33f5740 1 --2- 172.21.15.22:0/1697749456 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564ec21ac770 0x564ec2219bb0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:47.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.463+0000 7f10a33f5740 1 --2- 172.21.15.22:0/1697749456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ec219cc40 0x564ec21a78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:47.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.463+0000 7f10a33f5740 1 --2- 172.21.15.22:0/1697749456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ec219a200 0x564ec21a73b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.463+0000 7f1081ffb640 0 client.25595 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:34:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.463+0000 7f10a33f5740 1 --2- 172.21.15.22:0/1697749456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564ec21978d0 0x564ec21a86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.463+0000 7f10a33f5740 1 -- 172.21.15.22:0/1697749456 >> 172.21.15.22:0/1697749456 conn(0x564ec2192a20 msgr2=0x564ec2196cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.464+0000 7f10a33f5740 1 -- 172.21.15.22:0/1697749456 shutdown_connections 2024-08-20T01:34:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.464+0000 7f10a33f5740 1 -- 172.21.15.22:0/1697749456 wait complete. 2024-08-20T01:34:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.464+0000 7f10a33f5740 20 client.25595 trim_cache size 0 max 16384 2024-08-20T01:34:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:34:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:34:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:34:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:34:47.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.464+0000 7f10a052a640 1 -- 172.21.15.22:0/2023342888 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f10840b3b60 msgr2=0x7f10840b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:47.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.464+0000 7f10a052a640 1 --2- 172.21.15.22:0/2023342888 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f10840b3b60 0x7f10840b6020 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1094009b50 tx=0x7f1094005f90 comp rx=0 tx=0).stop 2024-08-20T01:34:47.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.464+0000 7f10a052a640 1 -- 172.21.15.22:0/2023342888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10981026b0 msgr2=0x7f109810b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:47.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.464+0000 7f10a052a640 1 --2- 172.21.15.22:0/2023342888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10981026b0 0x7f109810b640 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f108800e9f0 tx=0x7f108800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:34:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.464+0000 7f10a052a640 1 -- 172.21.15.22:0/2023342888 shutdown_connections 2024-08-20T01:34:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.464+0000 7f10a052a640 1 --2- 172.21.15.22:0/2023342888 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f10840b3b60 0x7f10840b6020 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.464+0000 7f10a052a640 1 --2- 172.21.15.22:0/2023342888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1098103070 0x7f109810bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.464+0000 7f10a052a640 1 --2- 172.21.15.22:0/2023342888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10981026b0 0x7f109810b640 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.464+0000 7f10a052a640 1 --2- 172.21.15.22:0/2023342888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1098101560 0x7f109810cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.464+0000 7f10a052a640 1 -- 172.21.15.22:0/2023342888 >> 172.21.15.22:0/2023342888 conn(0x7f10980fce40 msgr2=0x7f10981059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.464+0000 7f10a052a640 1 -- 172.21.15.22:0/2023342888 shutdown_connections 2024-08-20T01:34:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:34:47.464+0000 7f10a052a640 1 -- 172.21.15.22:0/2023342888 wait complete. 2024-08-20T01:34:47.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:47 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:34:48.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:47 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:34:48.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:47 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:34:48.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:48 smithi022 ceph-mon[18709]: pgmap v456: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 24 MiB/s wr, 3.61k op/s 2024-08-20T01:34:49.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:48 smithi134 ceph-mon[22511]: pgmap v456: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 24 MiB/s wr, 3.61k op/s 2024-08-20T01:34:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:48 smithi077 ceph-mon[22251]: pgmap v456: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 24 MiB/s wr, 3.61k op/s 2024-08-20T01:34:50.023 INFO:tasks.workunit.client.0.smithi022.stdout: 311 346609 270 245219 105 112482 410 2024-08-20T01:34:50.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:50 smithi022 ceph-mon[18709]: pgmap v457: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 19 MiB/s wr, 2.67k op/s 2024-08-20T01:34:51.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:50 smithi134 ceph-mon[22511]: pgmap v457: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 19 MiB/s wr, 2.67k op/s 2024-08-20T01:34:51.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:50 smithi077 ceph-mon[22251]: pgmap v457: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 19 MiB/s wr, 2.67k op/s 2024-08-20T01:34:52.892 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:52 smithi022 ceph-mon[18709]: pgmap v458: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 18 MiB/s wr, 2.66k op/s 2024-08-20T01:34:53.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:52 smithi134 ceph-mon[22511]: pgmap v458: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 18 MiB/s wr, 2.66k op/s 2024-08-20T01:34:53.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:52 smithi077 ceph-mon[22251]: pgmap v458: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 18 MiB/s wr, 2.66k op/s 2024-08-20T01:34:53.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:53 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:34:53.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:53 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:34:53.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:53 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:34:54.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:53 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:34:54.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:53 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:34:54.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:53 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:34:54.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:53 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:34:54.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:53 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:34:54.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:53 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:34:54.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:54 smithi022 ceph-mon[18709]: pgmap v459: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 13 MiB/s wr, 1.83k op/s 2024-08-20T01:34:55.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:54 smithi134 ceph-mon[22511]: pgmap v459: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 13 MiB/s wr, 1.83k op/s 2024-08-20T01:34:55.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:54 smithi077 ceph-mon[22251]: pgmap v459: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 13 MiB/s wr, 1.83k op/s 2024-08-20T01:34:56.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:56 smithi022 ceph-mon[18709]: pgmap v460: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.5 MiB/s wr, 1.04k op/s 2024-08-20T01:34:57.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:56 smithi134 ceph-mon[22511]: pgmap v460: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.5 MiB/s wr, 1.04k op/s 2024-08-20T01:34:57.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:56 smithi077 ceph-mon[22251]: pgmap v460: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.5 MiB/s wr, 1.04k op/s 2024-08-20T01:34:58.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:34:58 smithi022 ceph-mon[18709]: pgmap v461: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.6 MiB/s wr, 1.05k op/s 2024-08-20T01:34:59.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:34:58 smithi134 ceph-mon[22511]: pgmap v461: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.6 MiB/s wr, 1.05k op/s 2024-08-20T01:34:59.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:34:58 smithi077 ceph-mon[22251]: pgmap v461: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.6 MiB/s wr, 1.05k op/s 2024-08-20T01:35:00.023 INFO:tasks.workunit.client.0.smithi022.stdout: 343 2199730 2085 1555740 1794 753093 2531 2024-08-20T01:35:00.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:00 smithi022 ceph-mon[18709]: pgmap v462: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 643 op/s 2024-08-20T01:35:01.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:00 smithi134 ceph-mon[22511]: pgmap v462: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 643 op/s 2024-08-20T01:35:01.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:00 smithi077 ceph-mon[22251]: pgmap v462: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 643 op/s 2024-08-20T01:35:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.241+0000 7fda0d031640 1 -- 172.21.15.22:0/2749825496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda08074230 msgr2=0x7fda08119dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.241+0000 7fda0d031640 1 --2- 172.21.15.22:0/2749825496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda08074230 0x7fda08119dc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fda0001acb0 tx=0x7fda0003b900 comp rx=0 tx=0).stop 2024-08-20T01:35:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.241+0000 7fda0d031640 1 -- 172.21.15.22:0/2749825496 shutdown_connections 2024-08-20T01:35:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.241+0000 7fda0d031640 1 --2- 172.21.15.22:0/2749825496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda08074230 0x7fda08119dc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.241+0000 7fda0d031640 1 --2- 172.21.15.22:0/2749825496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda0810aa30 0x7fda08073b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.241+0000 7fda0d031640 1 --2- 172.21.15.22:0/2749825496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda0810a0f0 0x7fda0810a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.241+0000 7fda0d031640 1 -- 172.21.15.22:0/2749825496 >> 172.21.15.22:0/2749825496 conn(0x7fda0806f580 msgr2=0x7fda080719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:02.245 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.242+0000 7fda0d031640 1 -- 172.21.15.22:0/2749825496 shutdown_connections 2024-08-20T01:35:02.245 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.243+0000 7fda0d031640 1 -- 172.21.15.22:0/2749825496 wait complete. 2024-08-20T01:35:02.245 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.244+0000 7fda0d031640 1 Processor -- start 2024-08-20T01:35:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.246+0000 7fda0d031640 1 -- start start 2024-08-20T01:35:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.246+0000 7fda0d031640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda08074230 0x7fda081a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.246+0000 7fda0d031640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda0810a0f0 0x7fda081a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.246+0000 7fda0d031640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda0810aa30 0x7fda081a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.246+0000 7fda0d031640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fda081140a0 con 0x7fda0810aa30 2024-08-20T01:35:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.246+0000 7fda0d031640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fda08113f20 con 0x7fda0810a0f0 2024-08-20T01:35:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.246+0000 7fda0d031640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fda08114220 con 0x7fda08074230 2024-08-20T01:35:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.246+0000 7fda06d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda08074230 0x7fda081a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.246+0000 7fda06d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda08074230 0x7fda081a1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:43870/0 (socket says 172.21.15.22:43870) 2024-08-20T01:35:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.246+0000 7fda06d9d640 1 -- 172.21.15.22:0/3330998868 learned_addr learned my addr 172.21.15.22:0/3330998868 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.247+0000 7fda0759e640 1 --2- 172.21.15.22:0/3330998868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda0810aa30 0x7fda081a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.247+0000 7fda06d9d640 1 -- 172.21.15.22:0/3330998868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda0810a0f0 msgr2=0x7fda081a3a70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T01:35:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.247+0000 7fda06d9d640 1 --2- 172.21.15.22:0/3330998868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda0810a0f0 0x7fda081a3a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.248+0000 7fda06d9d640 1 -- 172.21.15.22:0/3330998868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda0810aa30 msgr2=0x7fda081a61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.248+0000 7fda06d9d640 1 --2- 172.21.15.22:0/3330998868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda0810aa30 0x7fda081a61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.248+0000 7fda06d9d640 1 -- 172.21.15.22:0/3330998868 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda081a6a90 con 0x7fda08074230 2024-08-20T01:35:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.248+0000 7fda0759e640 1 --2- 172.21.15.22:0/3330998868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda0810aa30 0x7fda081a61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.248+0000 7fda06d9d640 1 --2- 172.21.15.22:0/3330998868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda08074230 0x7fda081a1410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9f800b4a0 tx=0x7fd9f800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:02.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.272+0000 7fd9effff640 1 -- 172.21.15.22:0/3330998868 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8014070 con 0x7fda08074230 2024-08-20T01:35:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.274+0000 7fda0d031640 1 -- 172.21.15.22:0/3330998868 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda081a6d80 con 0x7fda08074230 2024-08-20T01:35:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.274+0000 7fda0d031640 1 -- 172.21.15.22:0/3330998868 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda081a7290 con 0x7fda08074230 2024-08-20T01:35:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.279+0000 7fda0fe1d740 1 Processor -- start 2024-08-20T01:35:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.281+0000 7fda0fe1d740 1 -- start start 2024-08-20T01:35:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.281+0000 7fda0fe1d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092f9c810 0x560092f9ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.281+0000 7fda0fe1d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560092f9f140 0x560092fa1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.281+0000 7fda0fe1d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092fa1b80 0x560092fa4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.281+0000 7fda0fe1d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560092f0f360 con 0x560092f9c810 2024-08-20T01:35:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.281+0000 7fda0fe1d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560092efe860 con 0x560092fa1b80 2024-08-20T01:35:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.281+0000 7fda0fe1d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560092f028a0 con 0x560092f9f140 2024-08-20T01:35:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.282+0000 7fda0659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092fa1b80 0x560092fa4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.282+0000 7fda0659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092fa1b80 0x560092fa4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:36904/0 (socket says 172.21.15.22:36904) 2024-08-20T01:35:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.282+0000 7fda0659c640 1 -- 172.21.15.22:0/3640414836 learned_addr learned my addr 172.21.15.22:0/3640414836 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.282+0000 7fda0659c640 1 -- 172.21.15.22:0/3640414836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560092f9f140 msgr2=0x560092fa1530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:35:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.282+0000 7fda0659c640 1 --2- 172.21.15.22:0/3640414836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560092f9f140 0x560092fa1530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.282+0000 7fda0659c640 1 -- 172.21.15.22:0/3640414836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092f9c810 msgr2=0x560092f9ec00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:35:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.282+0000 7fda0659c640 1 --2- 172.21.15.22:0/3640414836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092f9c810 0x560092f9ec00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.282+0000 7fda0659c640 1 -- 172.21.15.22:0/3640414836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560092ea5e40 con 0x560092fa1b80 2024-08-20T01:35:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.282+0000 7fda0659c640 1 --2- 172.21.15.22:0/3640414836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092fa1b80 0x560092fa4040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009770 tx=0x7fd9fc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b457ffdb2973ce server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.283+0000 7fd9effff640 1 -- 172.21.15.22:0/3330998868 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9f8010ac0 con 0x7fda08074230 2024-08-20T01:35:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.283+0000 7fd9effff640 1 -- 172.21.15.22:0/3330998868 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8017c00 con 0x7fda08074230 2024-08-20T01:35:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.284+0000 7fd9effff640 1 -- 172.21.15.22:0/3330998868 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd9f8017070 con 0x7fda08074230 2024-08-20T01:35:02.291 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.290+0000 7fd9effff640 1 --2- 172.21.15.22:0/3330998868 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9f00b3de0 0x7fd9f00b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:02.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.291+0000 7fda0759e640 1 --2- 172.21.15.22:0/3330998868 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9f00b3de0 0x7fd9f00b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:02.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.293+0000 7fda0759e640 1 --2- 172.21.15.22:0/3330998868 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9f00b3de0 0x7fd9f00b62a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fda0001aa70 tx=0x7fda00005f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:02.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.298+0000 7fd9effff640 1 -- 172.21.15.22:0/3330998868 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fd9f80e3f90 con 0x7fda08074230 2024-08-20T01:35:02.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.351+0000 7fd9ed7fa640 1 -- 172.21.15.22:0/3640414836 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc015020 con 0x560092fa1b80 2024-08-20T01:35:02.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.351+0000 7fd9ed7fa640 1 -- 172.21.15.22:0/3640414836 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9fc011420 con 0x560092fa1b80 2024-08-20T01:35:02.353 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.352+0000 7fda0fe1d740 1 -- 172.21.15.22:0/3640414836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092fa1b80 msgr2=0x560092fa4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.352+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/3640414836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092fa1b80 0x560092fa4040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009770 tx=0x7fd9fc009c30 comp rx=0 tx=0).stop 2024-08-20T01:35:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.354+0000 7fda0fe1d740 1 -- 172.21.15.22:0/3640414836 shutdown_connections 2024-08-20T01:35:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.354+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/3640414836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092fa1b80 0x560092fa4040 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.354+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/3640414836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560092f9f140 0x560092fa1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.354+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/3640414836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092f9c810 0x560092f9ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.354+0000 7fda0fe1d740 1 -- 172.21.15.22:0/3640414836 >> 172.21.15.22:0/3640414836 conn(0x560092f97960 msgr2=0x560092f986f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.354+0000 7fda0fe1d740 1 -- 172.21.15.22:0/3640414836 shutdown_connections 2024-08-20T01:35:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.354+0000 7fda0fe1d740 1 -- 172.21.15.22:0/3640414836 wait complete. 2024-08-20T01:35:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.355+0000 7fda0fe1d740 1 -- start start 2024-08-20T01:35:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.355+0000 7fda0fe1d740 1 Processor -- start 2024-08-20T01:35:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.355+0000 7fda0fe1d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560092f9c810 0x560092fa6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.355+0000 7fda0fe1d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9f140 0x560092fa66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.355+0000 7fda0fe1d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092fa1b80 0x560092fa72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.355+0000 7fda0fe1d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560092e37ab0 con 0x560092fa1b80 2024-08-20T01:35:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.355+0000 7fda0fe1d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560092e85780 con 0x560092f9f140 2024-08-20T01:35:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.355+0000 7fda0fe1d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560092fa4bb0 con 0x560092f9c810 2024-08-20T01:35:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.356+0000 7fda0fe1d740 10 client.0 _ll_register_callbacks cb 0x560092c0da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:35:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.356+0000 7fda0659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9f140 0x560092fa66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.356+0000 7fda0659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9f140 0x560092fa66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:36916/0 (socket says 172.21.15.22:36916) 2024-08-20T01:35:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.356+0000 7fda0659c640 1 -- 172.21.15.22:0/4272792159 learned_addr learned my addr 172.21.15.22:0/4272792159 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.356+0000 7fda0759e640 1 --2- 172.21.15.22:0/4272792159 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092fa1b80 0x560092fa72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.356+0000 7fda06d9d640 1 --2- 172.21.15.22:0/4272792159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560092f9c810 0x560092fa6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.356+0000 7fda0659c640 1 -- 172.21.15.22:0/4272792159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560092f9c810 msgr2=0x560092fa6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:02.360 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.356+0000 7fda0659c640 1 --2- 172.21.15.22:0/4272792159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560092f9c810 0x560092fa6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.360 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.356+0000 7fda0659c640 1 -- 172.21.15.22:0/4272792159 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092fa1b80 msgr2=0x560092fa72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:02.360 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.356+0000 7fda0659c640 1 --2- 172.21.15.22:0/4272792159 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092fa1b80 0x560092fa72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.360 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.356+0000 7fda0659c640 1 -- 172.21.15.22:0/4272792159 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560092c61790 con 0x560092f9f140 2024-08-20T01:35:02.360 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.357+0000 7fda0659c640 1 --2- 172.21.15.22:0/4272792159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9f140 0x560092fa66f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc006a50 tx=0x7fd9fc011650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8a466029fbc2285 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.409+0000 7fd9eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:35:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.409+0000 7fd9eaff5640 1 -- 172.21.15.22:0/4272792159 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc004230 con 0x560092f9f140 2024-08-20T01:35:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.409+0000 7fda0fe1d740 1 -- 172.21.15.22:0/4272792159 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560092eade00 con 0x560092f9f140 2024-08-20T01:35:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.409+0000 7fd9eaff5640 1 -- 172.21.15.22:0/4272792159 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fd9fc0043d0 con 0x560092f9f140 2024-08-20T01:35:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.412+0000 7fd9eaff5640 1 -- 172.21.15.22:0/4272792159 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd9fc009360 con 0x560092f9f140 2024-08-20T01:35:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.412+0000 7fda0fe1d740 10 client.25604 fetch_fsmap learned FSMap version 29 2024-08-20T01:35:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.412+0000 7fda0fe1d740 1 -- 172.21.15.22:0/4272792159 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560092cda620 con 0x560092f9f140 2024-08-20T01:35:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.413+0000 7fd9eaff5640 1 -- 172.21.15.22:0/4272792159 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560092eade00 con 0x560092f9f140 2024-08-20T01:35:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.414+0000 7fd9eaff5640 1 -- 172.21.15.22:0/4272792159 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd9fc010cf0 con 0x560092f9f140 2024-08-20T01:35:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.414+0000 7fda0fe1d740 10 client.25604 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:35:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.414+0000 7fda0fe1d740 10 client.25604 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:35:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.414+0000 7fda0fe1d740 20 client.25604 populate_metadata read hostname 'smithi022' 2024-08-20T01:35:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.414+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/4272792159 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560092fb1ca0 0x560092fb4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.414+0000 7fda0fe1d740 4 client.25604 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:35:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.414+0000 7fda0fe1d740 1 -- 172.21.15.22:0/4272792159 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560092f112b0 con 0x560092fb1ca0 2024-08-20T01:35:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.414+0000 7fda06d9d640 1 --2- 172.21.15.22:0/4272792159 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560092fb1ca0 0x560092fb4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.415+0000 7fd9eaff5640 10 client.25604 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.415+0000 7fda06d9d640 1 --2- 172.21.15.22:0/4272792159 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560092fb1ca0 0x560092fb4100 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2041973163546b8c server_cookie=3416ea124867d994 in_seq=0 out_seq=0 2024-08-20T01:35:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.416+0000 7fd9eaff5640 1 -- 172.21.15.22:0/4272792159 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560092f112b0 con 0x560092fb1ca0 2024-08-20T01:35:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.416+0000 7fd9eaff5640 10 client.25604 handle_command_reply: tid=0 2024-08-20T01:35:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.416+0000 7fda0fe1d740 1 client.25604 shutdown 2024-08-20T01:35:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.418+0000 7fda0fe1d740 1 -- 172.21.15.22:0/4272792159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9f140 msgr2=0x560092fa66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.418+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/4272792159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9f140 0x560092fa66f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc006a50 tx=0x7fd9fc011650 comp rx=0 tx=0).stop 2024-08-20T01:35:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.421+0000 7fda0fe1d740 1 -- 172.21.15.22:0/4272792159 shutdown_connections 2024-08-20T01:35:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.421+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/4272792159 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560092fb1ca0 0x560092fb4100 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.421+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/4272792159 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092fa1b80 0x560092fa72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.421+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/4272792159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9f140 0x560092fa66f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.421+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/4272792159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560092f9c810 0x560092fa6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.421+0000 7fda0fe1d740 1 -- 172.21.15.22:0/4272792159 >> 172.21.15.22:0/4272792159 conn(0x560092f97960 msgr2=0x560092f96a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.421+0000 7fd9eaff5640 0 client.25604 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.421+0000 7fda0fe1d740 1 -- 172.21.15.22:0/4272792159 shutdown_connections 2024-08-20T01:35:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.421+0000 7fda0fe1d740 1 -- 172.21.15.22:0/4272792159 wait complete. 2024-08-20T01:35:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.423+0000 7fda0fe1d740 20 client.25604 trim_cache size 0 max 16384 2024-08-20T01:35:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.601+0000 7fda0fe1d740 1 Processor -- start 2024-08-20T01:35:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.601+0000 7fda0fe1d740 1 -- start start 2024-08-20T01:35:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.602+0000 7fda0fe1d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9c810 0x560092fb3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.602+0000 7fda0fe1d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092f9f140 0x560092fa3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.602+0000 7fda06d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9c810 0x560092fb3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.602+0000 7fda0fe1d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560092fa1b80 0x560092fa39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.602+0000 7fda06d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9c810 0x560092fb3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:36928/0 (socket says 172.21.15.22:36928) 2024-08-20T01:35:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.602+0000 7fda0fe1d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f4011030 con 0x560092f9f140 2024-08-20T01:35:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.602+0000 7fda0fe1d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f400e8a0 con 0x560092f9c810 2024-08-20T01:35:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.602+0000 7fda0fe1d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f400c6f0 con 0x560092fa1b80 2024-08-20T01:35:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.602+0000 7fda0659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092f9f140 0x560092fa3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.602+0000 7fda0659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092f9f140 0x560092fa3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40554/0 (socket says 172.21.15.22:40554) 2024-08-20T01:35:02.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.602+0000 7fda0659c640 1 -- 172.21.15.22:0/1346076789 learned_addr learned my addr 172.21.15.22:0/1346076789 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:02.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.603+0000 7fda0759e640 1 --2- 172.21.15.22:0/1346076789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560092fa1b80 0x560092fa39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:02.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.603+0000 7fda06d9d640 1 -- 172.21.15.22:0/1346076789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560092fa1b80 msgr2=0x560092fa39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:02.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.603+0000 7fda06d9d640 1 --2- 172.21.15.22:0/1346076789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560092fa1b80 0x560092fa39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.603+0000 7fda06d9d640 1 -- 172.21.15.22:0/1346076789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092f9f140 msgr2=0x560092fa3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:02.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.603+0000 7fda06d9d640 1 --2- 172.21.15.22:0/1346076789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092f9f140 0x560092fa3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.603+0000 7fda06d9d640 1 -- 172.21.15.22:0/1346076789 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560092fa7630 con 0x560092f9c810 2024-08-20T01:35:02.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.603+0000 7fda0659c640 1 --2- 172.21.15.22:0/1346076789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092f9f140 0x560092fa3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:35:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.603+0000 7fda06d9d640 1 --2- 172.21.15.22:0/1346076789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9c810 0x560092fb3cb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8017730 tx=0x7fd9f80047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=583ac655947c7650 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:02.634 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.629+0000 7fd9ecff9640 1 -- 172.21.15.22:0/1346076789 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80ad040 con 0x560092f9c810 2024-08-20T01:35:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.631+0000 7fd9ecff9640 1 -- 172.21.15.22:0/1346076789 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9f80af440 con 0x560092f9c810 2024-08-20T01:35:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.631+0000 7fd9ecff9640 1 -- 172.21.15.22:0/1346076789 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f801e040 con 0x560092f9c810 2024-08-20T01:35:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.632+0000 7fda0fe1d740 1 -- 172.21.15.22:0/1346076789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9c810 msgr2=0x560092fb3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.632+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/1346076789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9c810 0x560092fb3cb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8017730 tx=0x7fd9f80047d0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.633+0000 7fda0fe1d740 1 -- 172.21.15.22:0/1346076789 shutdown_connections 2024-08-20T01:35:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.633+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/1346076789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560092fa1b80 0x560092fa39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.633+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/1346076789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092f9f140 0x560092fa3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.633+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/1346076789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9c810 0x560092fb3cb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.633+0000 7fda0fe1d740 1 -- 172.21.15.22:0/1346076789 >> 172.21.15.22:0/1346076789 conn(0x560092f97960 msgr2=0x560092f9bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.634+0000 7fda0fe1d740 1 -- 172.21.15.22:0/1346076789 shutdown_connections 2024-08-20T01:35:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.634+0000 7fda0fe1d740 1 -- 172.21.15.22:0/1346076789 wait complete. 2024-08-20T01:35:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.635+0000 7fda0fe1d740 1 -- start start 2024-08-20T01:35:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.635+0000 7fda0fe1d740 1 Processor -- start 2024-08-20T01:35:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.636+0000 7fda0fe1d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092f9c810 0x560092faa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.636+0000 7fda0fe1d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9f140 0x560092faac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.636+0000 7fda06d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092f9c810 0x560092faa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.636+0000 7fda06d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092f9c810 0x560092faa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40560/0 (socket says 172.21.15.22:40560) 2024-08-20T01:35:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.636+0000 7fda06d9d640 1 -- 172.21.15.22:0/1111367734 learned_addr learned my addr 172.21.15.22:0/1111367734 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.637+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/1111367734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560092fa1b80 0x560092fab480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.637+0000 7fda0659c640 1 --2- 172.21.15.22:0/1111367734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9f140 0x560092faac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.637+0000 7fda0fe1d740 1 -- 172.21.15.22:0/1111367734 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f400cd60 con 0x560092f9c810 2024-08-20T01:35:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.637+0000 7fda0fe1d740 1 -- 172.21.15.22:0/1111367734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f400e1d0 con 0x560092f9f140 2024-08-20T01:35:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.637+0000 7fda0fe1d740 1 -- 172.21.15.22:0/1111367734 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f400d430 con 0x560092fa1b80 2024-08-20T01:35:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.637+0000 7fda0fe1d740 10 client.0 _ll_register_callbacks cb 0x7fd9fc0095c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:35:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.637+0000 7fda0759e640 1 --2- 172.21.15.22:0/1111367734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560092fa1b80 0x560092fab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.637+0000 7fda06d9d640 1 -- 172.21.15.22:0/1111367734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560092fa1b80 msgr2=0x560092fab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.637+0000 7fda06d9d640 1 --2- 172.21.15.22:0/1111367734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560092fa1b80 0x560092fab480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.637+0000 7fda06d9d640 1 -- 172.21.15.22:0/1111367734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9f140 msgr2=0x560092faac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.637+0000 7fda06d9d640 1 --2- 172.21.15.22:0/1111367734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9f140 0x560092faac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.637+0000 7fda06d9d640 1 -- 172.21.15.22:0/1111367734 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560092f9ef70 con 0x560092f9c810 2024-08-20T01:35:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.637+0000 7fda0659c640 1 --2- 172.21.15.22:0/1111367734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9f140 0x560092faac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:35:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.638+0000 7fda06d9d640 1 --2- 172.21.15.22:0/1111367734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092f9c810 0x560092faa570 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80aadd0 tx=0x7fd9f80af370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ccb8fc5bd6b264 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:02.642 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.641+0000 7fda0fe1d740 1 -- 172.21.15.22:0/1111367734 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9f80af440 con 0x560092f9c810 2024-08-20T01:35:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.665+0000 7fd9eaff5640 10 client.16023 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:35:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.665+0000 7fd9eaff5640 1 -- 172.21.15.22:0/1111367734 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80ca060 con 0x560092f9c810 2024-08-20T01:35:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.665+0000 7fd9eaff5640 1 -- 172.21.15.22:0/1111367734 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fd9f8010610 con 0x560092f9c810 2024-08-20T01:35:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.666+0000 7fd9eaff5640 1 -- 172.21.15.22:0/1111367734 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd9f80ad070 con 0x560092f9c810 2024-08-20T01:35:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.666+0000 7fda0fe1d740 10 client.16023 fetch_fsmap learned FSMap version 29 2024-08-20T01:35:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.666+0000 7fda0fe1d740 1 -- 172.21.15.22:0/1111367734 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({fsmap=29}) -- 0x560092face00 con 0x560092f9c810 2024-08-20T01:35:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.667+0000 7fd9eaff5640 1 -- 172.21.15.22:0/1111367734 <== mon.0 v2:172.21.15.22:3300/0 4 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd9f80aa0a0 con 0x560092f9c810 2024-08-20T01:35:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.667+0000 7fda0fe1d740 10 client.16023 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:35:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.667+0000 7fda0fe1d740 10 client.16023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:35:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.667+0000 7fda0fe1d740 20 client.16023 populate_metadata read hostname 'smithi022' 2024-08-20T01:35:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.667+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/1111367734 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560092fad710 0x560092fadb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.668+0000 7fda0fe1d740 4 client.16023 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:35:02.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.668+0000 7fda0fe1d740 1 -- 172.21.15.22:0/1111367734 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fd9f80af440 con 0x560092fad710 2024-08-20T01:35:02.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.668+0000 7fda0659c640 1 --2- 172.21.15.22:0/1111367734 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560092fad710 0x560092fadb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:02.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.668+0000 7fda0659c640 1 --2- 172.21.15.22:0/1111367734 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560092fad710 0x560092fadb20 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db87dc177ae916f7 server_cookie=97fdf32b62d9f486 in_seq=0 out_seq=0 2024-08-20T01:35:02.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:02.668+0000 7fd9eaff5640 10 client.16023 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:02.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:02 smithi022 ceph-mon[18709]: pgmap v463: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 640 op/s 2024-08-20T01:35:03.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:02 smithi134 ceph-mon[22511]: pgmap v463: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 640 op/s 2024-08-20T01:35:03.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:02 smithi077 ceph-mon[22251]: pgmap v463: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 640 op/s 2024-08-20T01:35:04.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:04.960+0000 7fd9eaff5640 1 -- 172.21.15.22:0/1111367734 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fd9f80af440 con 0x560092fad710 2024-08-20T01:35:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:04.960+0000 7fd9eaff5640 10 client.16023 handle_command_reply: tid=0 2024-08-20T01:35:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:04.960+0000 7fda0fe1d740 1 client.16023 shutdown 2024-08-20T01:35:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:04.961+0000 7fda0fe1d740 1 -- 172.21.15.22:0/1111367734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092f9c810 msgr2=0x560092faa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:04.961+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/1111367734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092f9c810 0x560092faa570 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80aadd0 tx=0x7fd9f80af370 comp rx=0 tx=0).stop 2024-08-20T01:35:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:04.961+0000 7fda0fe1d740 1 -- 172.21.15.22:0/1111367734 shutdown_connections 2024-08-20T01:35:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:04.961+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/1111367734 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x560092fad710 0x560092fadb20 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:04.961+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/1111367734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560092fa1b80 0x560092fab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:04.961+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/1111367734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560092f9f140 0x560092faac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:04.961+0000 7fda0fe1d740 1 --2- 172.21.15.22:0/1111367734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560092f9c810 0x560092faa570 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:04.961+0000 7fda0fe1d740 1 -- 172.21.15.22:0/1111367734 >> 172.21.15.22:0/1111367734 conn(0x560092f97960 msgr2=0x560092f9bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:04.964 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:04.961+0000 7fd9eaff5640 0 client.16023 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:04.964 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:04.961+0000 7fda0fe1d740 1 -- 172.21.15.22:0/1111367734 shutdown_connections 2024-08-20T01:35:04.964 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:04.962+0000 7fda0fe1d740 1 -- 172.21.15.22:0/1111367734 wait complete. 2024-08-20T01:35:04.964 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:04.962+0000 7fda0fe1d740 20 client.16023 trim_cache size 0 max 16384 2024-08-20T01:35:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:35:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:35:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:35:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:35:05.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:05.012+0000 7fda0d031640 1 -- 172.21.15.22:0/3330998868 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9f00b3de0 msgr2=0x7fd9f00b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:05.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:05.012+0000 7fda0d031640 1 --2- 172.21.15.22:0/3330998868 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9f00b3de0 0x7fd9f00b62a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fda0001aa70 tx=0x7fda00005f80 comp rx=0 tx=0).stop 2024-08-20T01:35:05.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:05.012+0000 7fda0d031640 1 -- 172.21.15.22:0/3330998868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda08074230 msgr2=0x7fda081a1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:05.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:05.014+0000 7fda0d031640 1 --2- 172.21.15.22:0/3330998868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda08074230 0x7fda081a1410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9f800b4a0 tx=0x7fd9f800b960 comp rx=0 tx=0).stop 2024-08-20T01:35:05.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:05.014+0000 7fda0d031640 1 -- 172.21.15.22:0/3330998868 shutdown_connections 2024-08-20T01:35:05.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:05.014+0000 7fda0d031640 1 --2- 172.21.15.22:0/3330998868 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd9f00b3de0 0x7fd9f00b62a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:05.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:05.014+0000 7fda0d031640 1 --2- 172.21.15.22:0/3330998868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda0810aa30 0x7fda081a61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:05.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:05.014+0000 7fda0d031640 1 --2- 172.21.15.22:0/3330998868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda0810a0f0 0x7fda081a3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:05.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:05.014+0000 7fda0d031640 1 --2- 172.21.15.22:0/3330998868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda08074230 0x7fda081a1410 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:05.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:05.014+0000 7fda0d031640 1 -- 172.21.15.22:0/3330998868 >> 172.21.15.22:0/3330998868 conn(0x7fda0806f580 msgr2=0x7fda080702d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:05.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:04 smithi134 ceph-mon[22511]: pgmap v464: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.2 MiB/s wr, 455 op/s 2024-08-20T01:35:05.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:05.015+0000 7fda0d031640 1 -- 172.21.15.22:0/3330998868 shutdown_connections 2024-08-20T01:35:05.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:05.015+0000 7fda0d031640 1 -- 172.21.15.22:0/3330998868 wait complete. 2024-08-20T01:35:05.017 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:35:05.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:04 smithi077 ceph-mon[22251]: pgmap v464: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.2 MiB/s wr, 455 op/s 2024-08-20T01:35:05.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:04 smithi022 ceph-mon[18709]: pgmap v464: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.2 MiB/s wr, 455 op/s 2024-08-20T01:35:07.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:06 smithi134 ceph-mon[22511]: pgmap v465: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.0 MiB/s wr, 455 op/s 2024-08-20T01:35:07.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:06 smithi077 ceph-mon[22251]: pgmap v465: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.0 MiB/s wr, 455 op/s 2024-08-20T01:35:07.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:06 smithi022 ceph-mon[18709]: pgmap v465: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.0 MiB/s wr, 455 op/s 2024-08-20T01:35:09.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:08 smithi134 ceph-mon[22511]: pgmap v466: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.7 MiB/s wr, 842 op/s 2024-08-20T01:35:09.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:08 smithi077 ceph-mon[22251]: pgmap v466: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.7 MiB/s wr, 842 op/s 2024-08-20T01:35:09.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:08 smithi022 ceph-mon[18709]: pgmap v466: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.7 MiB/s wr, 842 op/s 2024-08-20T01:35:09.558 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:10.026 INFO:tasks.workunit.client.0.smithi022.stdout: 361 1820902 1232 1265000 1057 648017 1559 2024-08-20T01:35:10.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.387+0000 7f5499649640 1 -- 172.21.15.22:0/3130700182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5494109e80 msgr2=0x7f5494110ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:10.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.387+0000 7f5499649640 1 --2- 172.21.15.22:0/3130700182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5494109e80 0x7f5494110ee0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5484009be0 tx=0x7f548402a750 comp rx=0 tx=0).stop 2024-08-20T01:35:10.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.388+0000 7f5499649640 1 -- 172.21.15.22:0/3130700182 shutdown_connections 2024-08-20T01:35:10.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.388+0000 7f5499649640 1 --2- 172.21.15.22:0/3130700182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f549411bdd0 0x7f549411e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.388+0000 7f5499649640 1 --2- 172.21.15.22:0/3130700182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f549410a260 0x7f549410a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.388+0000 7f5499649640 1 --2- 172.21.15.22:0/3130700182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5494109e80 0x7f5494110ee0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.388+0000 7f5499649640 1 -- 172.21.15.22:0/3130700182 >> 172.21.15.22:0/3130700182 conn(0x7f549406dcc0 msgr2=0x7f549406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:10.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.389+0000 7f5499649640 1 -- 172.21.15.22:0/3130700182 shutdown_connections 2024-08-20T01:35:10.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.393+0000 7f5499649640 1 -- 172.21.15.22:0/3130700182 wait complete. 2024-08-20T01:35:10.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.394+0000 7f5499649640 1 Processor -- start 2024-08-20T01:35:10.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.394+0000 7f5499649640 1 -- start start 2024-08-20T01:35:10.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.395+0000 7f5499649640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5494109e80 0x7f549411b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:10.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.395+0000 7f5499649640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f549410a260 0x7f549411b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:10.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.395+0000 7f5499649640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f549411bdd0 0x7f5494114670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:10.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.395+0000 7f5499649640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f54941218b0 con 0x7f549410a260 2024-08-20T01:35:10.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.395+0000 7f54937fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f549411bdd0 0x7f5494114670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:10.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.395+0000 7f54937fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f549411bdd0 0x7f5494114670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:55372/0 (socket says 172.21.15.22:55372) 2024-08-20T01:35:10.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.395+0000 7f54937fe640 1 -- 172.21.15.22:0/3289115337 learned_addr learned my addr 172.21.15.22:0/3289115337 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:10.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.396+0000 7f5499649640 1 -- 172.21.15.22:0/3289115337 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5494121730 con 0x7f549411bdd0 2024-08-20T01:35:10.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.396+0000 7f5499649640 1 -- 172.21.15.22:0/3289115337 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5494121a30 con 0x7f5494109e80 2024-08-20T01:35:10.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.401+0000 7f5492ffd640 1 --2- 172.21.15.22:0/3289115337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5494109e80 0x7f549411b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:10.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.403+0000 7f54927fc640 1 --2- 172.21.15.22:0/3289115337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f549410a260 0x7f549411b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:10.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.403+0000 7f54937fe640 1 -- 172.21.15.22:0/3289115337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5494109e80 msgr2=0x7f549411b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:10.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.403+0000 7f54937fe640 1 --2- 172.21.15.22:0/3289115337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5494109e80 0x7f549411b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.403+0000 7f54937fe640 1 -- 172.21.15.22:0/3289115337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f549410a260 msgr2=0x7f549411b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:10.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.403+0000 7f54937fe640 1 --2- 172.21.15.22:0/3289115337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f549410a260 0x7f549411b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.403+0000 7f54937fe640 1 -- 172.21.15.22:0/3289115337 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5494114f30 con 0x7f549411bdd0 2024-08-20T01:35:10.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.403+0000 7f54937fe640 1 --2- 172.21.15.22:0/3289115337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f549411bdd0 0x7f5494114670 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f548c00e970 tx=0x7f548c00ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:10.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.405+0000 7f547bfff640 1 -- 172.21.15.22:0/3289115337 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548c00ccc0 con 0x7f549411bdd0 2024-08-20T01:35:10.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.405+0000 7f547bfff640 1 -- 172.21.15.22:0/3289115337 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f548c0054d0 con 0x7f549411bdd0 2024-08-20T01:35:10.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.405+0000 7f5499649640 1 -- 172.21.15.22:0/3289115337 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5494115220 con 0x7f549411bdd0 2024-08-20T01:35:10.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.405+0000 7f5499649640 1 -- 172.21.15.22:0/3289115337 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f549411a1c0 con 0x7f549411bdd0 2024-08-20T01:35:10.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.412+0000 7f549ba42740 1 Processor -- start 2024-08-20T01:35:10.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.412+0000 7f547bfff640 1 -- 172.21.15.22:0/3289115337 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548c010430 con 0x7f549411bdd0 2024-08-20T01:35:10.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.420+0000 7f549ba42740 1 -- start start 2024-08-20T01:35:10.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.420+0000 7f549ba42740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 0x55e30bac5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:10.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.420+0000 7f549ba42740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bac6150 0x55e30bad1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:10.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.420+0000 7f549ba42740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bad20e0 0x55e30bad44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:10.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.420+0000 7f549ba42740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e30ba3c8e0 con 0x55e30bad20e0 2024-08-20T01:35:10.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.420+0000 7f549ba42740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e30ba2bde0 con 0x55e30bac5830 2024-08-20T01:35:10.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.420+0000 7f549ba42740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e30ba2fe20 con 0x55e30bac6150 2024-08-20T01:35:10.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.421+0000 7f547bfff640 1 -- 172.21.15.22:0/3289115337 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f548c005020 con 0x7f549411bdd0 2024-08-20T01:35:10.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.422+0000 7f547bfff640 1 --2- 172.21.15.22:0/3289115337 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f547c0b3de0 0x7f547c0b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:10.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.423+0000 7f54937fe640 1 --2- 172.21.15.22:0/3289115337 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f547c0b3de0 0x7f547c0b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:10.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.424+0000 7f547bfff640 1 -- 172.21.15.22:0/3289115337 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f548c0e3ee0 con 0x7f549411bdd0 2024-08-20T01:35:10.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.424+0000 7f54927fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bad20e0 0x55e30bad44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:10.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.425+0000 7f54927fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 0x55e30bac5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:10.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.425+0000 7f54927fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 0x55e30bac5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:55388/0 (socket says 172.21.15.22:55388) 2024-08-20T01:35:10.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.425+0000 7f54927fc640 1 -- 172.21.15.22:0/75286643 learned_addr learned my addr 172.21.15.22:0/75286643 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:10.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.425+0000 7f54937fe640 1 --2- 172.21.15.22:0/3289115337 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f547c0b3de0 0x7f547c0b62a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f548c0defd0 tx=0x7f548c0a6d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:10.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.426+0000 7f54927fc640 1 -- 172.21.15.22:0/75286643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bac6150 msgr2=0x55e30bad1ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:35:10.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.426+0000 7f54927fc640 1 --2- 172.21.15.22:0/75286643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bac6150 0x55e30bad1ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.426+0000 7f54927fc640 1 -- 172.21.15.22:0/75286643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bad20e0 msgr2=0x55e30bad44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:10.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.426+0000 7f54927fc640 1 --2- 172.21.15.22:0/75286643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bad20e0 0x55e30bad44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.427+0000 7f54927fc640 1 -- 172.21.15.22:0/75286643 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e30b78b650 con 0x55e30bac5830 2024-08-20T01:35:10.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.427+0000 7f54927fc640 1 --2- 172.21.15.22:0/75286643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 0x55e30bac5c10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5488013530 tx=0x7f5488004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=316167669e120d14 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:10.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.430+0000 7f54797fa640 1 -- 172.21.15.22:0/75286643 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5488010630 con 0x55e30bac5830 2024-08-20T01:35:10.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.431+0000 7f54797fa640 1 -- 172.21.15.22:0/75286643 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5488010c80 con 0x55e30bac5830 2024-08-20T01:35:10.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.432+0000 7f549ba42740 1 -- 172.21.15.22:0/75286643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 msgr2=0x55e30bac5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:10.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.432+0000 7f549ba42740 1 --2- 172.21.15.22:0/75286643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 0x55e30bac5c10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5488013530 tx=0x7f5488004730 comp rx=0 tx=0).stop 2024-08-20T01:35:10.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.432+0000 7f549ba42740 1 -- 172.21.15.22:0/75286643 shutdown_connections 2024-08-20T01:35:10.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.432+0000 7f549ba42740 1 --2- 172.21.15.22:0/75286643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bad20e0 0x55e30bad44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.432+0000 7f549ba42740 1 --2- 172.21.15.22:0/75286643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bac6150 0x55e30bad1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.432+0000 7f549ba42740 1 --2- 172.21.15.22:0/75286643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 0x55e30bac5c10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.432+0000 7f549ba42740 1 -- 172.21.15.22:0/75286643 >> 172.21.15.22:0/75286643 conn(0x55e30bac3660 msgr2=0x55e30bac4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:10.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.434+0000 7f549ba42740 1 -- 172.21.15.22:0/75286643 shutdown_connections 2024-08-20T01:35:10.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.437+0000 7f549ba42740 1 -- 172.21.15.22:0/75286643 wait complete. 2024-08-20T01:35:10.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.437+0000 7f549ba42740 1 -- start start 2024-08-20T01:35:10.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.437+0000 7f549ba42740 1 Processor -- start 2024-08-20T01:35:10.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.438+0000 7f549ba42740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 0x55e30bacf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:10.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.438+0000 7f549ba42740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bac6150 0x55e30bacf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:10.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.438+0000 7f549ba42740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bad20e0 0x55e30bacfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:10.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.438+0000 7f549ba42740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e30b88e700 con 0x55e30bad20e0 2024-08-20T01:35:10.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.438+0000 7f549ba42740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e30b9b27c0 con 0x55e30bac5830 2024-08-20T01:35:10.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.438+0000 7f549ba42740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e30bad4de0 con 0x55e30bac6150 2024-08-20T01:35:10.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.438+0000 7f549ba42740 10 client.0 _ll_register_callbacks cb 0x55e30ba256b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:35:10.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.441+0000 7f54927fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 0x55e30bacf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:10.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.441+0000 7f54927fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 0x55e30bacf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:55402/0 (socket says 172.21.15.22:55402) 2024-08-20T01:35:10.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.441+0000 7f54927fc640 1 -- 172.21.15.22:0/2830658878 learned_addr learned my addr 172.21.15.22:0/2830658878 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:10.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.441+0000 7f5492ffd640 1 --2- 172.21.15.22:0/2830658878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bac6150 0x55e30bacf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:10.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.442+0000 7f54927fc640 1 --2- 172.21.15.22:0/2830658878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bad20e0 0x55e30bacfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:10.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.442+0000 7f54927fc640 1 -- 172.21.15.22:0/2830658878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bac6150 msgr2=0x55e30bacf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:10.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.442+0000 7f54927fc640 1 --2- 172.21.15.22:0/2830658878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bac6150 0x55e30bacf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.442+0000 7f54927fc640 1 -- 172.21.15.22:0/2830658878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bad20e0 msgr2=0x55e30bacfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:10.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.442+0000 7f54927fc640 1 --2- 172.21.15.22:0/2830658878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bad20e0 0x55e30bacfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.442+0000 7f54927fc640 1 -- 172.21.15.22:0/2830658878 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e30bade270 con 0x55e30bac5830 2024-08-20T01:35:10.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.444+0000 7f54927fc640 1 --2- 172.21.15.22:0/2830658878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 0x55e30bacf090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f548801e910 tx=0x7f54880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=916289c3f2fd7f54 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:10.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.444+0000 7f5476ff5640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:35:10.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.448+0000 7f5476ff5640 1 -- 172.21.15.22:0/2830658878 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54880108d0 con 0x55e30bac5830 2024-08-20T01:35:10.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.448+0000 7f549ba42740 1 -- 172.21.15.22:0/2830658878 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e30b9db100 con 0x55e30bac5830 2024-08-20T01:35:10.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.448+0000 7f5476ff5640 1 -- 172.21.15.22:0/2830658878 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f5488010a70 con 0x55e30bac5830 2024-08-20T01:35:10.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.448+0000 7f5476ff5640 1 -- 172.21.15.22:0/2830658878 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5488010c70 con 0x55e30bac5830 2024-08-20T01:35:10.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.448+0000 7f549ba42740 10 client.25622 fetch_fsmap learned FSMap version 29 2024-08-20T01:35:10.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.448+0000 7f549ba42740 1 -- 172.21.15.22:0/2830658878 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e30bae0c90 con 0x55e30bac5830 2024-08-20T01:35:10.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.450+0000 7f5476ff5640 1 -- 172.21.15.22:0/2830658878 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e30b9db100 con 0x55e30bac5830 2024-08-20T01:35:10.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.451+0000 7f5476ff5640 1 -- 172.21.15.22:0/2830658878 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f548801d030 con 0x55e30bac5830 2024-08-20T01:35:10.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.452+0000 7f549ba42740 10 client.25622 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:35:10.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.452+0000 7f549ba42740 10 client.25622 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:35:10.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.452+0000 7f549ba42740 20 client.25622 populate_metadata read hostname 'smithi022' 2024-08-20T01:35:10.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.452+0000 7f549ba42740 1 --2- 172.21.15.22:0/2830658878 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e30bae2470 0x55e30bae48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:10.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.452+0000 7f549ba42740 4 client.25622 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:35:10.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.452+0000 7f549ba42740 1 -- 172.21.15.22:0/2830658878 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e30ba3e830 con 0x55e30bae2470 2024-08-20T01:35:10.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.453+0000 7f5492ffd640 1 --2- 172.21.15.22:0/2830658878 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e30bae2470 0x55e30bae48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:10.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.461+0000 7f5476ff5640 10 client.25622 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:10.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.461+0000 7f5492ffd640 1 --2- 172.21.15.22:0/2830658878 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e30bae2470 0x55e30bae48b0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48a284ff290a3fd0 server_cookie=df184784e9a130c6 in_seq=0 out_seq=0 2024-08-20T01:35:10.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.462+0000 7f5476ff5640 1 -- 172.21.15.22:0/2830658878 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e30ba3e830 con 0x55e30bae2470 2024-08-20T01:35:10.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.462+0000 7f5476ff5640 10 client.25622 handle_command_reply: tid=0 2024-08-20T01:35:10.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.462+0000 7f549ba42740 1 client.25622 shutdown 2024-08-20T01:35:10.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.465+0000 7f549ba42740 1 -- 172.21.15.22:0/2830658878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 msgr2=0x55e30bacf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:10.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.465+0000 7f549ba42740 1 --2- 172.21.15.22:0/2830658878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 0x55e30bacf090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f548801e910 tx=0x7f54880046c0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.469+0000 7f549ba42740 1 -- 172.21.15.22:0/2830658878 shutdown_connections 2024-08-20T01:35:10.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.469+0000 7f549ba42740 1 --2- 172.21.15.22:0/2830658878 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e30bae2470 0x55e30bae48b0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.469+0000 7f549ba42740 1 --2- 172.21.15.22:0/2830658878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bad20e0 0x55e30bacfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.469+0000 7f549ba42740 1 --2- 172.21.15.22:0/2830658878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bac6150 0x55e30bacf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.469+0000 7f549ba42740 1 --2- 172.21.15.22:0/2830658878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 0x55e30bacf090 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.469+0000 7f549ba42740 1 -- 172.21.15.22:0/2830658878 >> 172.21.15.22:0/2830658878 conn(0x55e30bac3660 msgr2=0x55e30bac9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:10.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.469+0000 7f5476ff5640 0 client.25622 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:10.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.469+0000 7f549ba42740 1 -- 172.21.15.22:0/2830658878 shutdown_connections 2024-08-20T01:35:10.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.469+0000 7f549ba42740 1 -- 172.21.15.22:0/2830658878 wait complete. 2024-08-20T01:35:10.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.471+0000 7f549ba42740 20 client.25622 trim_cache size 0 max 16384 2024-08-20T01:35:10.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.520+0000 7f549ba42740 1 Processor -- start 2024-08-20T01:35:10.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.520+0000 7f549ba42740 1 -- start start 2024-08-20T01:35:10.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.521+0000 7f549ba42740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 0x55e30bac98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:10.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.521+0000 7f549ba42740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bac6150 0x55e30baea1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:10.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.521+0000 7f549ba42740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bad20e0 0x55e30baea700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:10.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.521+0000 7f549ba42740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5480010e80 con 0x55e30bac6150 2024-08-20T01:35:10.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.521+0000 7f549ba42740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f548000e6f0 con 0x55e30bac5830 2024-08-20T01:35:10.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.521+0000 7f549ba42740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f548000c5f0 con 0x55e30bad20e0 2024-08-20T01:35:10.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.522+0000 7f54927fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 0x55e30bac98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:10.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.522+0000 7f54927fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 0x55e30bac98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:55408/0 (socket says 172.21.15.22:55408) 2024-08-20T01:35:10.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.522+0000 7f54927fc640 1 -- 172.21.15.22:0/528676116 learned_addr learned my addr 172.21.15.22:0/528676116 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:10.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.522+0000 7f54927fc640 1 --2- 172.21.15.22:0/528676116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bad20e0 0x55e30baea700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:10.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.522+0000 7f5492ffd640 1 --2- 172.21.15.22:0/528676116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bac6150 0x55e30baea1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:10.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.523+0000 7f5492ffd640 1 -- 172.21.15.22:0/528676116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bad20e0 msgr2=0x55e30baea700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:10.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.523+0000 7f5492ffd640 1 --2- 172.21.15.22:0/528676116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bad20e0 0x55e30baea700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.523+0000 7f5492ffd640 1 -- 172.21.15.22:0/528676116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 msgr2=0x55e30bac98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:10.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.523+0000 7f5492ffd640 1 --2- 172.21.15.22:0/528676116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 0x55e30bac98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.523+0000 7f5492ffd640 1 -- 172.21.15.22:0/528676116 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e30bac40e0 con 0x55e30bac6150 2024-08-20T01:35:10.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.523+0000 7f5492ffd640 1 --2- 172.21.15.22:0/528676116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bac6150 0x55e30baea1c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f548402ad40 tx=0x7f5484030610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492129c61bf7b6d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:10.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.525+0000 7f5478ff9640 1 -- 172.21.15.22:0/528676116 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484036040 con 0x55e30bac6150 2024-08-20T01:35:10.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.525+0000 7f5478ff9640 1 -- 172.21.15.22:0/528676116 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5484048030 con 0x55e30bac6150 2024-08-20T01:35:10.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.526+0000 7f549ba42740 1 -- 172.21.15.22:0/528676116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bac6150 msgr2=0x55e30baea1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:10.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.526+0000 7f549ba42740 1 --2- 172.21.15.22:0/528676116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bac6150 0x55e30baea1c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f548402ad40 tx=0x7f5484030610 comp rx=0 tx=0).stop 2024-08-20T01:35:10.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.526+0000 7f549ba42740 1 -- 172.21.15.22:0/528676116 shutdown_connections 2024-08-20T01:35:10.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.526+0000 7f549ba42740 1 --2- 172.21.15.22:0/528676116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bad20e0 0x55e30baea700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.526+0000 7f549ba42740 1 --2- 172.21.15.22:0/528676116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bac6150 0x55e30baea1c0 secure :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f548402ad40 tx=0x7f5484030610 comp rx=0 tx=0).stop 2024-08-20T01:35:10.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.526+0000 7f549ba42740 1 --2- 172.21.15.22:0/528676116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bac5830 0x55e30bac98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.526+0000 7f549ba42740 1 -- 172.21.15.22:0/528676116 >> 172.21.15.22:0/528676116 conn(0x55e30bac3660 msgr2=0x55e30bacd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:10.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.531+0000 7f549ba42740 1 -- 172.21.15.22:0/528676116 shutdown_connections 2024-08-20T01:35:10.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.531+0000 7f549ba42740 1 -- 172.21.15.22:0/528676116 wait complete. 2024-08-20T01:35:10.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.531+0000 7f549ba42740 1 -- start start 2024-08-20T01:35:10.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.532+0000 7f549ba42740 1 Processor -- start 2024-08-20T01:35:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.536+0000 7f549ba42740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bac5830 0x55e30bad5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.536+0000 7f549ba42740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bad20e0 0x55e30bad5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.536+0000 7f549ba42740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bad5d70 0x55e30bb4b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.536+0000 7f549ba42740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f548000cbb0 con 0x55e30bad20e0 2024-08-20T01:35:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.536+0000 7f549ba42740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f548000e020 con 0x55e30bad5d70 2024-08-20T01:35:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.536+0000 7f549ba42740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f548000d280 con 0x55e30bac5830 2024-08-20T01:35:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.536+0000 7f549ba42740 10 client.0 _ll_register_callbacks cb 0x7f5488013400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:35:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.537+0000 7f54927fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bac5830 0x55e30bad5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.537+0000 7f54927fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bac5830 0x55e30bad5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:37122/0 (socket says 172.21.15.22:37122) 2024-08-20T01:35:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.537+0000 7f54927fc640 1 -- 172.21.15.22:0/2505148905 learned_addr learned my addr 172.21.15.22:0/2505148905 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.537+0000 7f54927fc640 1 --2- 172.21.15.22:0/2505148905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bad5d70 0x55e30bb4b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.538+0000 7f54927fc640 1 -- 172.21.15.22:0/2505148905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bac5830 msgr2=0x55e30bad5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.538+0000 7f54927fc640 1 --2- 172.21.15.22:0/2505148905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bac5830 0x55e30bad5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.538+0000 7f54927fc640 1 -- 172.21.15.22:0/2505148905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bad20e0 msgr2=0x55e30bad5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.538+0000 7f54927fc640 1 --2- 172.21.15.22:0/2505148905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bad20e0 0x55e30bad5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.538+0000 7f54927fc640 1 -- 172.21.15.22:0/2505148905 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e30bb4b960 con 0x55e30bad5d70 2024-08-20T01:35:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.538+0000 7f54927fc640 1 --2- 172.21.15.22:0/2505148905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bad5d70 0x55e30bb4b180 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5488005d40 tx=0x7f5488016040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55286c424d16b0ac server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.538+0000 7f5476ff5640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:35:10.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.539+0000 7f5476ff5640 1 -- 172.21.15.22:0/2505148905 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54880099b0 con 0x55e30bad5d70 2024-08-20T01:35:10.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.539+0000 7f5476ff5640 1 -- 172.21.15.22:0/2505148905 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f5488004250 con 0x55e30bad5d70 2024-08-20T01:35:10.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.543+0000 7f549ba42740 1 -- 172.21.15.22:0/2505148905 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5484048030 con 0x55e30bad5d70 2024-08-20T01:35:10.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.545+0000 7f5476ff5640 1 -- 172.21.15.22:0/2505148905 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5488004450 con 0x55e30bad5d70 2024-08-20T01:35:10.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.545+0000 7f549ba42740 10 client.25628 fetch_fsmap learned FSMap version 29 2024-08-20T01:35:10.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.545+0000 7f549ba42740 1 -- 172.21.15.22:0/2505148905 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e30bb4cc50 con 0x55e30bad5d70 2024-08-20T01:35:10.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.549+0000 7f5476ff5640 1 -- 172.21.15.22:0/2505148905 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5484048030 con 0x55e30bad5d70 2024-08-20T01:35:10.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.549+0000 7f5476ff5640 1 -- 172.21.15.22:0/2505148905 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f548801d040 con 0x55e30bad5d70 2024-08-20T01:35:10.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.551+0000 7f549ba42740 10 client.25628 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:35:10.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.551+0000 7f549ba42740 10 client.25628 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:35:10.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.551+0000 7f549ba42740 20 client.25628 populate_metadata read hostname 'smithi022' 2024-08-20T01:35:10.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.551+0000 7f549ba42740 1 --2- 172.21.15.22:0/2505148905 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e30bb4d380 0x55e30bb4f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:10.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.551+0000 7f549ba42740 4 client.25628 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:35:10.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.551+0000 7f549ba42740 1 -- 172.21.15.22:0/2505148905 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e30ba3a2d0 con 0x55e30bb4d380 2024-08-20T01:35:10.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.551+0000 7f5492ffd640 1 --2- 172.21.15.22:0/2505148905 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e30bb4d380 0x55e30bb4f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:10.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.554+0000 7f5492ffd640 1 --2- 172.21.15.22:0/2505148905 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e30bb4d380 0x55e30bb4f7a0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a689a05a90efb12 server_cookie=77ddb39898feb6c7 in_seq=0 out_seq=0 2024-08-20T01:35:10.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.554+0000 7f5476ff5640 10 client.25628 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:10.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.555+0000 7f5476ff5640 1 -- 172.21.15.22:0/2505148905 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e30ba3a2d0 con 0x55e30bb4d380 2024-08-20T01:35:10.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.555+0000 7f5476ff5640 10 client.25628 handle_command_reply: tid=0 2024-08-20T01:35:10.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.557+0000 7f549ba42740 1 client.25628 shutdown 2024-08-20T01:35:10.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.557+0000 7f549ba42740 1 -- 172.21.15.22:0/2505148905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bad5d70 msgr2=0x55e30bb4b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:10.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.557+0000 7f549ba42740 1 --2- 172.21.15.22:0/2505148905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bad5d70 0x55e30bb4b180 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5488005d40 tx=0x7f5488016040 comp rx=0 tx=0).stop 2024-08-20T01:35:10.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.557+0000 7f549ba42740 1 -- 172.21.15.22:0/2505148905 shutdown_connections 2024-08-20T01:35:10.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.557+0000 7f549ba42740 1 --2- 172.21.15.22:0/2505148905 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e30bb4d380 0x55e30bb4f7a0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.557+0000 7f549ba42740 1 --2- 172.21.15.22:0/2505148905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e30bad5d70 0x55e30bb4b180 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.557+0000 7f549ba42740 1 --2- 172.21.15.22:0/2505148905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e30bad20e0 0x55e30bad5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.557+0000 7f549ba42740 1 --2- 172.21.15.22:0/2505148905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e30bac5830 0x55e30bad5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.557+0000 7f5476ff5640 0 client.25628 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:10.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.557+0000 7f549ba42740 1 -- 172.21.15.22:0/2505148905 >> 172.21.15.22:0/2505148905 conn(0x55e30bac3660 msgr2=0x55e30bacdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:10.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.558+0000 7f549ba42740 1 -- 172.21.15.22:0/2505148905 shutdown_connections 2024-08-20T01:35:10.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.558+0000 7f549ba42740 1 -- 172.21.15.22:0/2505148905 wait complete. 2024-08-20T01:35:10.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.558+0000 7f549ba42740 20 client.25628 trim_cache size 0 max 16384 2024-08-20T01:35:10.560 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:35:10.560 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-08-20T01:35:10.560 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-08-20T01:35:10.561 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:35:10.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.563+0000 7f5499649640 1 -- 172.21.15.22:0/3289115337 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f547c0b3de0 msgr2=0x7f547c0b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:10.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.563+0000 7f5499649640 1 --2- 172.21.15.22:0/3289115337 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f547c0b3de0 0x7f547c0b62a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f548c0defd0 tx=0x7f548c0a6d30 comp rx=0 tx=0).stop 2024-08-20T01:35:10.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.563+0000 7f5499649640 1 -- 172.21.15.22:0/3289115337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f549411bdd0 msgr2=0x7f5494114670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:10.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.563+0000 7f5499649640 1 --2- 172.21.15.22:0/3289115337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f549411bdd0 0x7f5494114670 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f548c00e970 tx=0x7f548c00ee30 comp rx=0 tx=0).stop 2024-08-20T01:35:10.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.563+0000 7f5499649640 1 -- 172.21.15.22:0/3289115337 shutdown_connections 2024-08-20T01:35:10.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.563+0000 7f5499649640 1 --2- 172.21.15.22:0/3289115337 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f547c0b3de0 0x7f547c0b62a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.563+0000 7f5499649640 1 --2- 172.21.15.22:0/3289115337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f549411bdd0 0x7f5494114670 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.563+0000 7f5499649640 1 --2- 172.21.15.22:0/3289115337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f549410a260 0x7f549411b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.563+0000 7f5499649640 1 --2- 172.21.15.22:0/3289115337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5494109e80 0x7f549411b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:10.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.563+0000 7f5499649640 1 -- 172.21.15.22:0/3289115337 >> 172.21.15.22:0/3289115337 conn(0x7f549406dcc0 msgr2=0x7f54940716b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:10.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.564+0000 7f5499649640 1 -- 172.21.15.22:0/3289115337 shutdown_connections 2024-08-20T01:35:10.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:10.564+0000 7f5499649640 1 -- 172.21.15.22:0/3289115337 wait complete. 2024-08-20T01:35:10.888 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:10 smithi022 ceph-mon[18709]: pgmap v467: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.5 MiB/s wr, 1.03k op/s 2024-08-20T01:35:11.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:10 smithi134 ceph-mon[22511]: pgmap v467: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.5 MiB/s wr, 1.03k op/s 2024-08-20T01:35:11.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:10 smithi077 ceph-mon[22251]: pgmap v467: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.5 MiB/s wr, 1.03k op/s 2024-08-20T01:35:11.693 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:35:11.693 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:35:13.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:12 smithi134 ceph-mon[22511]: pgmap v468: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 13 MiB/s wr, 1.45k op/s 2024-08-20T01:35:13.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:12 smithi077 ceph-mon[22251]: pgmap v468: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 13 MiB/s wr, 1.45k op/s 2024-08-20T01:35:13.097 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:12 smithi022 ceph-mon[18709]: pgmap v468: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 13 MiB/s wr, 1.45k op/s 2024-08-20T01:35:14.247 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:14.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:14 smithi022 ceph-mon[18709]: pgmap v469: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 17 MiB/s wr, 1.62k op/s 2024-08-20T01:35:15.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:14 smithi134 ceph-mon[22511]: pgmap v469: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 17 MiB/s wr, 1.62k op/s 2024-08-20T01:35:15.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:14 smithi077 ceph-mon[22251]: pgmap v469: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 17 MiB/s wr, 1.62k op/s 2024-08-20T01:35:16.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.365+0000 7fd547913640 1 -- 172.21.15.22:0/1463385492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd540109e80 msgr2=0x7fd540110ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:16.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.365+0000 7fd547913640 1 --2- 172.21.15.22:0/1463385492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd540109e80 0x7fd540110ee0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd53c009860 tx=0x7fd53c02a3f0 comp rx=0 tx=0).stop 2024-08-20T01:35:16.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.366+0000 7fd547913640 1 -- 172.21.15.22:0/1463385492 shutdown_connections 2024-08-20T01:35:16.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.366+0000 7fd547913640 1 --2- 172.21.15.22:0/1463385492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd54011bdd0 0x7fd54011e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:16.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.366+0000 7fd547913640 1 --2- 172.21.15.22:0/1463385492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd54010a260 0x7fd54010a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:16.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.366+0000 7fd547913640 1 --2- 172.21.15.22:0/1463385492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd540109e80 0x7fd540110ee0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:16.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.366+0000 7fd547913640 1 -- 172.21.15.22:0/1463385492 >> 172.21.15.22:0/1463385492 conn(0x7fd54006dcc0 msgr2=0x7fd54006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:16.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.366+0000 7fd547913640 1 -- 172.21.15.22:0/1463385492 shutdown_connections 2024-08-20T01:35:16.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.370+0000 7fd547913640 1 -- 172.21.15.22:0/1463385492 wait complete. 2024-08-20T01:35:16.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.371+0000 7fd547913640 1 Processor -- start 2024-08-20T01:35:16.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.371+0000 7fd547913640 1 -- start start 2024-08-20T01:35:16.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.372+0000 7fd547913640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd54010a260 0x7fd540117360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:16.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.372+0000 7fd547913640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd54011bdd0 0x7fd5401178a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:16.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.372+0000 7fd547913640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5401a8d60 0x7fd5401ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:16.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.372+0000 7fd547913640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd540113e40 con 0x7fd5401a8d60 2024-08-20T01:35:16.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.372+0000 7fd547913640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd540113cc0 con 0x7fd54011bdd0 2024-08-20T01:35:16.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.372+0000 7fd547913640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd540113fc0 con 0x7fd54010a260 2024-08-20T01:35:16.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.372+0000 7fd5456af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd54010a260 0x7fd540117360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:16.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.372+0000 7fd5456af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd54010a260 0x7fd540117360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:37148/0 (socket says 172.21.15.22:37148) 2024-08-20T01:35:16.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.372+0000 7fd5456af640 1 -- 172.21.15.22:0/3579826420 learned_addr learned my addr 172.21.15.22:0/3579826420 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:16.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.372+0000 7fd544eae640 1 --2- 172.21.15.22:0/3579826420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd54011bdd0 0x7fd5401178a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:16.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.373+0000 7fd545eb0640 1 --2- 172.21.15.22:0/3579826420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5401a8d60 0x7fd5401ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:16.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.373+0000 7fd544eae640 1 -- 172.21.15.22:0/3579826420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd54010a260 msgr2=0x7fd540117360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:16.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.373+0000 7fd544eae640 1 --2- 172.21.15.22:0/3579826420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd54010a260 0x7fd540117360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:16.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.373+0000 7fd544eae640 1 -- 172.21.15.22:0/3579826420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5401a8d60 msgr2=0x7fd5401ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:16.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.376+0000 7fd544eae640 1 --2- 172.21.15.22:0/3579826420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5401a8d60 0x7fd5401ab150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:16.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.376+0000 7fd544eae640 1 -- 172.21.15.22:0/3579826420 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5401ab920 con 0x7fd54011bdd0 2024-08-20T01:35:16.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.377+0000 7fd545eb0640 1 --2- 172.21.15.22:0/3579826420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5401a8d60 0x7fd5401ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:35:16.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.377+0000 7fd544eae640 1 --2- 172.21.15.22:0/3579826420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd54011bdd0 0x7fd5401178a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd53801fbd0 tx=0x7fd53801d750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:16.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.379+0000 7fd5367fc640 1 -- 172.21.15.22:0/3579826420 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53802c070 con 0x7fd54011bdd0 2024-08-20T01:35:16.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.379+0000 7fd5367fc640 1 -- 172.21.15.22:0/3579826420 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd53801ca30 con 0x7fd54011bdd0 2024-08-20T01:35:16.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.379+0000 7fd5367fc640 1 -- 172.21.15.22:0/3579826420 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd538027b00 con 0x7fd54011bdd0 2024-08-20T01:35:16.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.379+0000 7fd547913640 1 -- 172.21.15.22:0/3579826420 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5401abbb0 con 0x7fd54011bdd0 2024-08-20T01:35:16.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.379+0000 7fd547913640 1 -- 172.21.15.22:0/3579826420 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5401ac0a0 con 0x7fd54011bdd0 2024-08-20T01:35:16.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.383+0000 7fd547913640 1 -- 172.21.15.22:0/3579826420 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd524005290 con 0x7fd54011bdd0 2024-08-20T01:35:16.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.385+0000 7fd5367fc640 1 -- 172.21.15.22:0/3579826420 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd53802f070 con 0x7fd54011bdd0 2024-08-20T01:35:16.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.387+0000 7fd5367fc640 1 --2- 172.21.15.22:0/3579826420 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd52c0b3dd0 0x7fd52c0b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:16.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.388+0000 7fd5367fc640 1 -- 172.21.15.22:0/3579826420 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fd5380f49e0 con 0x7fd54011bdd0 2024-08-20T01:35:16.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.388+0000 7fd5456af640 1 --2- 172.21.15.22:0/3579826420 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd52c0b3dd0 0x7fd52c0b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:16.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.391+0000 7fd5367fc640 1 -- 172.21.15.22:0/3579826420 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd5380bb940 con 0x7fd54011bdd0 2024-08-20T01:35:16.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.398+0000 7fd5456af640 1 --2- 172.21.15.22:0/3579826420 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd52c0b3dd0 0x7fd52c0b6290 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0092e0 tx=0x7fd53c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:16.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.885+0000 7fd547913640 1 -- 172.21.15.22:0/3579826420 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd524005580 con 0x7fd54011bdd0 2024-08-20T01:35:16.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.891+0000 7fd5367fc640 1 -- 172.21.15.22:0/3579826420 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11912 (secure 0 0 0) 0x7fd5380bfe90 con 0x7fd54011bdd0 2024-08-20T01:35:16.893 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:35:16.893 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":29,"btime":"2024-08-20T01:33:36:089197+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:33:36.059684+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24586,24575,24565]},"id":1}]} 2024-08-20T01:35:16.893 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 29 2024-08-20T01:35:16.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:16 smithi022 ceph-mon[18709]: pgmap v470: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 17 MiB/s wr, 1.55k op/s 2024-08-20T01:35:16.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.902+0000 7fd52bfff640 1 -- 172.21.15.22:0/3579826420 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd52c0b3dd0 msgr2=0x7fd52c0b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:16.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.902+0000 7fd52bfff640 1 --2- 172.21.15.22:0/3579826420 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd52c0b3dd0 0x7fd52c0b6290 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0092e0 tx=0x7fd53c005850 comp rx=0 tx=0).stop 2024-08-20T01:35:16.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.902+0000 7fd52bfff640 1 -- 172.21.15.22:0/3579826420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd54011bdd0 msgr2=0x7fd5401178a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:16.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.902+0000 7fd52bfff640 1 --2- 172.21.15.22:0/3579826420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd54011bdd0 0x7fd5401178a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd53801fbd0 tx=0x7fd53801d750 comp rx=0 tx=0).stop 2024-08-20T01:35:16.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.902+0000 7fd52bfff640 1 -- 172.21.15.22:0/3579826420 shutdown_connections 2024-08-20T01:35:16.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.902+0000 7fd52bfff640 1 --2- 172.21.15.22:0/3579826420 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd52c0b3dd0 0x7fd52c0b6290 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:16.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.902+0000 7fd52bfff640 1 --2- 172.21.15.22:0/3579826420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5401a8d60 0x7fd5401ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:16.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.902+0000 7fd52bfff640 1 --2- 172.21.15.22:0/3579826420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd54011bdd0 0x7fd5401178a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:16.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.902+0000 7fd52bfff640 1 --2- 172.21.15.22:0/3579826420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd54010a260 0x7fd540117360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:16.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.903+0000 7fd52bfff640 1 -- 172.21.15.22:0/3579826420 >> 172.21.15.22:0/3579826420 conn(0x7fd54006dcc0 msgr2=0x7fd5400713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:16.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.903+0000 7fd52bfff640 1 -- 172.21.15.22:0/3579826420 shutdown_connections 2024-08-20T01:35:16.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:16.904+0000 7fd52bfff640 1 -- 172.21.15.22:0/3579826420 wait complete. 2024-08-20T01:35:17.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:16 smithi134 ceph-mon[22511]: pgmap v470: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 17 MiB/s wr, 1.55k op/s 2024-08-20T01:35:17.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:16 smithi077 ceph-mon[22251]: pgmap v470: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 17 MiB/s wr, 1.55k op/s 2024-08-20T01:35:18.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:17 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3579826420' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:35:18.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:17 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3579826420' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:35:18.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:17 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3579826420' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:35:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:18.995+0000 7f76f3ebc640 1 -- 172.21.15.22:0/832957679 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76ec10aa30 msgr2=0x7f76ec073b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:18.995+0000 7f76f3ebc640 1 --2- 172.21.15.22:0/832957679 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76ec10aa30 0x7f76ec073b40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f76e80098b0 tx=0x7f76e802a3b0 comp rx=0 tx=0).stop 2024-08-20T01:35:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:18.995+0000 7f76f3ebc640 1 -- 172.21.15.22:0/832957679 shutdown_connections 2024-08-20T01:35:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:18.995+0000 7f76f3ebc640 1 --2- 172.21.15.22:0/832957679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76ec074230 0x7f76ec119dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:18.995+0000 7f76f3ebc640 1 --2- 172.21.15.22:0/832957679 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76ec10aa30 0x7f76ec073b40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:18.995+0000 7f76f3ebc640 1 --2- 172.21.15.22:0/832957679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76ec10a0f0 0x7f76ec10a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:18.995+0000 7f76f3ebc640 1 -- 172.21.15.22:0/832957679 >> 172.21.15.22:0/832957679 conn(0x7f76ec06f580 msgr2=0x7f76ec0719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:18.996+0000 7f76f3ebc640 1 -- 172.21.15.22:0/832957679 shutdown_connections 2024-08-20T01:35:19.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:18.999+0000 7f76f3ebc640 1 -- 172.21.15.22:0/832957679 wait complete. 2024-08-20T01:35:19.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.000+0000 7f76f3ebc640 1 Processor -- start 2024-08-20T01:35:19.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.000+0000 7f76f3ebc640 1 -- start start 2024-08-20T01:35:19.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.000+0000 7f76f3ebc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76ec074230 0x7f76ec1a79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.000+0000 7f76f3ebc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76ec10a0f0 0x7f76ec1a8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.000+0000 7f76f3ebc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76ec1a8c50 0x7f76ec1a9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.000+0000 7f76f3ebc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec11cef0 con 0x7f76ec1a8c50 2024-08-20T01:35:19.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.000+0000 7f76f3ebc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec11cd70 con 0x7f76ec10a0f0 2024-08-20T01:35:19.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.000+0000 7f76f3ebc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec11d070 con 0x7f76ec074230 2024-08-20T01:35:19.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.000+0000 7f76f1c58640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76ec074230 0x7f76ec1a79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.000+0000 7f76f1457640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76ec10a0f0 0x7f76ec1a8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.005 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.000+0000 7f76f1457640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76ec10a0f0 0x7f76ec1a8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:55462/0 (socket says 172.21.15.22:55462) 2024-08-20T01:35:19.005 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.000+0000 7f76f1457640 1 -- 172.21.15.22:0/1797760683 learned_addr learned my addr 172.21.15.22:0/1797760683 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:19.005 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.001+0000 7f76f2459640 1 --2- 172.21.15.22:0/1797760683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76ec1a8c50 0x7f76ec1a9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.005 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.001+0000 7f76f1457640 1 -- 172.21.15.22:0/1797760683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76ec074230 msgr2=0x7f76ec1a79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:19.005 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.001+0000 7f76f1457640 1 --2- 172.21.15.22:0/1797760683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76ec074230 0x7f76ec1a79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.005 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.001+0000 7f76f1457640 1 -- 172.21.15.22:0/1797760683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76ec1a8c50 msgr2=0x7f76ec1a9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:19.005 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.001+0000 7f76f1457640 1 --2- 172.21.15.22:0/1797760683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76ec1a8c50 0x7f76ec1a9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.005 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.001+0000 7f76f1457640 1 -- 172.21.15.22:0/1797760683 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ec1a9970 con 0x7f76ec10a0f0 2024-08-20T01:35:19.005 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.001+0000 7f76f2459640 1 --2- 172.21.15.22:0/1797760683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76ec1a8c50 0x7f76ec1a9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.002+0000 7f76f1457640 1 --2- 172.21.15.22:0/1797760683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76ec10a0f0 0x7f76ec1a8020 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f76e8000c00 tx=0x7f76e80045e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.003+0000 7f76f1c58640 1 --2- 172.21.15.22:0/1797760683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76ec074230 0x7f76ec1a79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:19.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:18 smithi134 ceph-mon[22511]: pgmap v471: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 18 MiB/s wr, 1.59k op/s 2024-08-20T01:35:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.017+0000 7f76e2ffd640 1 -- 172.21.15.22:0/1797760683 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8037070 con 0x7f76ec10a0f0 2024-08-20T01:35:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.018+0000 7f76f3ebc640 1 -- 172.21.15.22:0/1797760683 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76ec1115b0 con 0x7f76ec10a0f0 2024-08-20T01:35:19.020 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.018+0000 7f76e2ffd640 1 -- 172.21.15.22:0/1797760683 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76e8038040 con 0x7f76ec10a0f0 2024-08-20T01:35:19.020 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.018+0000 7f76f3ebc640 1 -- 172.21.15.22:0/1797760683 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76ec111a20 con 0x7f76ec10a0f0 2024-08-20T01:35:19.020 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.018+0000 7f76e2ffd640 1 -- 172.21.15.22:0/1797760683 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8003850 con 0x7f76ec10a0f0 2024-08-20T01:35:19.025 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.024+0000 7f76e2ffd640 1 -- 172.21.15.22:0/1797760683 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f76e8043020 con 0x7f76ec10a0f0 2024-08-20T01:35:19.025 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.024+0000 7f76f6cad740 1 Processor -- start 2024-08-20T01:35:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.024+0000 7f76f6cad740 1 -- start start 2024-08-20T01:35:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.025+0000 7f76f6cad740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56164711c810 0x56164711ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.025+0000 7f76f6cad740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56164711f140 0x561647121530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.025+0000 7f76f6cad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561647121b80 0x561647124040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.025+0000 7f76f6cad740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56164708f360 con 0x561647121b80 2024-08-20T01:35:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.025+0000 7f76f6cad740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56164707e860 con 0x56164711f140 2024-08-20T01:35:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.025+0000 7f76f1c58640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56164711f140 0x561647121530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.025+0000 7f76f1c58640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56164711f140 0x561647121530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:55478/0 (socket says 172.21.15.22:55478) 2024-08-20T01:35:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.025+0000 7f76f1c58640 1 -- 172.21.15.22:0/3747595321 learned_addr learned my addr 172.21.15.22:0/3747595321 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.025+0000 7f76f6cad740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5616470828a0 con 0x56164711c810 2024-08-20T01:35:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.025+0000 7f76f2459640 1 --2- 172.21.15.22:0/3747595321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56164711c810 0x56164711ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.026+0000 7f76f1457640 1 --2- 172.21.15.22:0/3747595321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561647121b80 0x561647124040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.026+0000 7f76f1c58640 1 -- 172.21.15.22:0/3747595321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56164711c810 msgr2=0x56164711ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.026+0000 7f76f1c58640 1 --2- 172.21.15.22:0/3747595321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56164711c810 0x56164711ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.026+0000 7f76f1c58640 1 -- 172.21.15.22:0/3747595321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561647121b80 msgr2=0x561647124040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.026+0000 7f76f1c58640 1 --2- 172.21.15.22:0/3747595321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561647121b80 0x561647124040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.026+0000 7f76f1c58640 1 -- 172.21.15.22:0/3747595321 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561647025e40 con 0x56164711f140 2024-08-20T01:35:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.026+0000 7f76f2459640 1 --2- 172.21.15.22:0/3747595321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56164711c810 0x56164711ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:35:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.027+0000 7f76f1457640 1 --2- 172.21.15.22:0/3747595321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561647121b80 0x561647124040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.027+0000 7f76f1c58640 1 --2- 172.21.15.22:0/3747595321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56164711f140 0x561647121530 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00bb70 tx=0x7f76dc00d710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9b0439c1f8f4ba server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.035+0000 7f76d7fff640 1 -- 172.21.15.22:0/3747595321 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc017620 con 0x56164711f140 2024-08-20T01:35:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.042+0000 7f76d7fff640 1 -- 172.21.15.22:0/3747595321 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76dc017c70 con 0x56164711f140 2024-08-20T01:35:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.043+0000 7f76f6cad740 1 -- 172.21.15.22:0/3747595321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56164711f140 msgr2=0x561647121530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.043+0000 7f76f6cad740 1 --2- 172.21.15.22:0/3747595321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56164711f140 0x561647121530 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00bb70 tx=0x7f76dc00d710 comp rx=0 tx=0).stop 2024-08-20T01:35:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.044+0000 7f76e2ffd640 1 --2- 172.21.15.22:0/1797760683 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f76d80b3dd0 0x7f76d80b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.044+0000 7f76f2459640 1 --2- 172.21.15.22:0/1797760683 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f76d80b3dd0 0x7f76d80b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.045+0000 7f76f2459640 1 --2- 172.21.15.22:0/1797760683 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f76d80b3dd0 0x7f76d80b6290 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f76e4005fd0 tx=0x7f76e40095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.045+0000 7f76e2ffd640 1 -- 172.21.15.22:0/1797760683 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f76e8103930 con 0x7f76ec10a0f0 2024-08-20T01:35:19.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.054+0000 7f76f6cad740 1 -- 172.21.15.22:0/3747595321 shutdown_connections 2024-08-20T01:35:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.054+0000 7f76f6cad740 1 --2- 172.21.15.22:0/3747595321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561647121b80 0x561647124040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.054+0000 7f76f6cad740 1 --2- 172.21.15.22:0/3747595321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56164711f140 0x561647121530 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.054+0000 7f76f6cad740 1 --2- 172.21.15.22:0/3747595321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56164711c810 0x56164711ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.054+0000 7f76f6cad740 1 -- 172.21.15.22:0/3747595321 >> 172.21.15.22:0/3747595321 conn(0x561647117960 msgr2=0x5616471186f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:19.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.058+0000 7f76f6cad740 1 -- 172.21.15.22:0/3747595321 shutdown_connections 2024-08-20T01:35:19.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.059+0000 7f76f6cad740 1 -- 172.21.15.22:0/3747595321 wait complete. 2024-08-20T01:35:19.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.059+0000 7f76f6cad740 1 -- start start 2024-08-20T01:35:19.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.059+0000 7f76f6cad740 1 Processor -- start 2024-08-20T01:35:19.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.060+0000 7f76f6cad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56164711c810 0x561647126020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.060+0000 7f76f6cad740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56164711f140 0x5616471266c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.060+0000 7f76f6cad740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561647121b80 0x561647127290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.060+0000 7f76f6cad740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561646fb7ab0 con 0x56164711c810 2024-08-20T01:35:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.060+0000 7f76f6cad740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561647005780 con 0x561647121b80 2024-08-20T01:35:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.060+0000 7f76f6cad740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561647124bb0 con 0x56164711f140 2024-08-20T01:35:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.060+0000 7f76f6cad740 10 client.0 _ll_register_callbacks cb 0x561646d8da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:35:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.061+0000 7f76f2459640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561647121b80 0x561647127290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.061+0000 7f76f2459640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561647121b80 0x561647127290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:55484/0 (socket says 172.21.15.22:55484) 2024-08-20T01:35:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.061+0000 7f76f2459640 1 -- 172.21.15.22:0/2009961794 learned_addr learned my addr 172.21.15.22:0/2009961794 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.061+0000 7f76f1c58640 1 --2- 172.21.15.22:0/2009961794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56164711c810 0x561647126020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.061+0000 7f76f1457640 1 --2- 172.21.15.22:0/2009961794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56164711f140 0x5616471266c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.062+0000 7f76f2459640 1 -- 172.21.15.22:0/2009961794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56164711f140 msgr2=0x5616471266c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.062+0000 7f76f2459640 1 --2- 172.21.15.22:0/2009961794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56164711f140 0x5616471266c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.062+0000 7f76f2459640 1 -- 172.21.15.22:0/2009961794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56164711c810 msgr2=0x561647126020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.062+0000 7f76f2459640 1 --2- 172.21.15.22:0/2009961794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56164711c810 0x561647126020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.062+0000 7f76f2459640 1 -- 172.21.15.22:0/2009961794 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561646de1790 con 0x561647121b80 2024-08-20T01:35:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.062+0000 7f76f1457640 1 --2- 172.21.15.22:0/2009961794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56164711f140 0x5616471266c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:35:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.062+0000 7f76f1c58640 1 --2- 172.21.15.22:0/2009961794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56164711c810 0x561647126020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:35:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.062+0000 7f76f2459640 1 --2- 172.21.15.22:0/2009961794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561647121b80 0x561647127290 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f76e4010f90 tx=0x7f76e4004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5b249b54143f688 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:19.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:18 smithi077 ceph-mon[22251]: pgmap v471: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 18 MiB/s wr, 1.59k op/s 2024-08-20T01:35:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.078+0000 7f76d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:35:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.078+0000 7f76d57fa640 1 -- 172.21.15.22:0/2009961794 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e402c060 con 0x561647121b80 2024-08-20T01:35:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.078+0000 7f76f6cad740 1 -- 172.21.15.22:0/2009961794 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56164702de00 con 0x561647121b80 2024-08-20T01:35:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.078+0000 7f76d57fa640 1 -- 172.21.15.22:0/2009961794 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f76e4016030 con 0x561647121b80 2024-08-20T01:35:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.083+0000 7f76d57fa640 1 -- 172.21.15.22:0/2009961794 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f76e401c8a0 con 0x561647121b80 2024-08-20T01:35:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.083+0000 7f76f6cad740 10 client.25643 fetch_fsmap learned FSMap version 29 2024-08-20T01:35:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.083+0000 7f76f6cad740 1 -- 172.21.15.22:0/2009961794 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561646e5a620 con 0x561647121b80 2024-08-20T01:35:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.083+0000 7f76d57fa640 1 -- 172.21.15.22:0/2009961794 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56164702de00 con 0x561647121b80 2024-08-20T01:35:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.086+0000 7f76d57fa640 1 -- 172.21.15.22:0/2009961794 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f76e400b040 con 0x561647121b80 2024-08-20T01:35:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.086+0000 7f76f6cad740 10 client.25643 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:35:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.086+0000 7f76f6cad740 10 client.25643 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:35:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.086+0000 7f76f6cad740 20 client.25643 populate_metadata read hostname 'smithi022' 2024-08-20T01:35:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.086+0000 7f76f6cad740 1 --2- 172.21.15.22:0/2009961794 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561647131d20 0x5616471341c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.086+0000 7f76f6cad740 4 client.25643 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:35:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.086+0000 7f76f6cad740 1 -- 172.21.15.22:0/2009961794 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616470912b0 con 0x561647131d20 2024-08-20T01:35:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.087+0000 7f76f1c58640 1 --2- 172.21.15.22:0/2009961794 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561647131d20 0x5616471341c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.087+0000 7f76f1c58640 1 --2- 172.21.15.22:0/2009961794 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561647131d20 0x5616471341c0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c012bac21afe9796 server_cookie=a68057d34e0d13f8 in_seq=0 out_seq=0 2024-08-20T01:35:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.088+0000 7f76d57fa640 10 client.25643 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:19.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.090+0000 7f76d57fa640 1 -- 172.21.15.22:0/2009961794 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5616470912b0 con 0x561647131d20 2024-08-20T01:35:19.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.091+0000 7f76d57fa640 10 client.25643 handle_command_reply: tid=0 2024-08-20T01:35:19.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.091+0000 7f76f6cad740 1 client.25643 shutdown 2024-08-20T01:35:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.091+0000 7f76f6cad740 1 -- 172.21.15.22:0/2009961794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561647121b80 msgr2=0x561647127290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.091+0000 7f76f6cad740 1 --2- 172.21.15.22:0/2009961794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561647121b80 0x561647127290 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f76e4010f90 tx=0x7f76e4004ab0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.091+0000 7f76f6cad740 1 -- 172.21.15.22:0/2009961794 shutdown_connections 2024-08-20T01:35:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.091+0000 7f76f6cad740 1 --2- 172.21.15.22:0/2009961794 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x561647131d20 0x5616471341c0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.091+0000 7f76f6cad740 1 --2- 172.21.15.22:0/2009961794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561647121b80 0x561647127290 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.091+0000 7f76f6cad740 1 --2- 172.21.15.22:0/2009961794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56164711f140 0x5616471266c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.091+0000 7f76f6cad740 1 --2- 172.21.15.22:0/2009961794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56164711c810 0x561647126020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.091+0000 7f76f6cad740 1 -- 172.21.15.22:0/2009961794 >> 172.21.15.22:0/2009961794 conn(0x561647117960 msgr2=0x561647116a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.091+0000 7f76d57fa640 0 client.25643 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.092+0000 7f76f6cad740 1 -- 172.21.15.22:0/2009961794 shutdown_connections 2024-08-20T01:35:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.092+0000 7f76f6cad740 1 -- 172.21.15.22:0/2009961794 wait complete. 2024-08-20T01:35:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.092+0000 7f76f6cad740 20 client.25643 trim_cache size 0 max 16384 2024-08-20T01:35:19.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:18 smithi022 ceph-mon[18709]: pgmap v471: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 18 MiB/s wr, 1.59k op/s 2024-08-20T01:35:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.293+0000 7f76f6cad740 1 Processor -- start 2024-08-20T01:35:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.293+0000 7f76f6cad740 1 -- start start 2024-08-20T01:35:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.296+0000 7f76f6cad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56164711c810 0x561647118400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.296+0000 7f76f1c58640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56164711c810 0x561647118400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.296+0000 7f76f1c58640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56164711c810 0x561647118400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39150/0 (socket says 172.21.15.22:39150) 2024-08-20T01:35:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.296+0000 7f76f1c58640 1 -- 172.21.15.22:0/3052530058 learned_addr learned my addr 172.21.15.22:0/3052530058 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.297+0000 7f76f6cad740 1 --2- 172.21.15.22:0/3052530058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56164711f140 0x561647118940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.297+0000 7f76f6cad740 1 --2- 172.21.15.22:0/3052530058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561647121b80 0x561647123400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.297+0000 7f76f6cad740 1 -- 172.21.15.22:0/3052530058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f76d0010fe0 con 0x56164711c810 2024-08-20T01:35:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.297+0000 7f76f2459640 1 --2- 172.21.15.22:0/3052530058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561647121b80 0x561647123400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.297+0000 7f76f6cad740 1 -- 172.21.15.22:0/3052530058 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f76d000e850 con 0x561647121b80 2024-08-20T01:35:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.297+0000 7f76f6cad740 1 -- 172.21.15.22:0/3052530058 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f76d000c6a0 con 0x56164711f140 2024-08-20T01:35:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.298+0000 7f76f1457640 1 --2- 172.21.15.22:0/3052530058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56164711f140 0x561647118940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.299+0000 7f76f1c58640 1 -- 172.21.15.22:0/3052530058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56164711f140 msgr2=0x561647118940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.299+0000 7f76f1c58640 1 --2- 172.21.15.22:0/3052530058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56164711f140 0x561647118940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.299+0000 7f76f1c58640 1 -- 172.21.15.22:0/3052530058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561647121b80 msgr2=0x561647123400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.299+0000 7f76f1c58640 1 --2- 172.21.15.22:0/3052530058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561647121b80 0x561647123400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.299+0000 7f76f1c58640 1 -- 172.21.15.22:0/3052530058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561647126a30 con 0x56164711c810 2024-08-20T01:35:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.300+0000 7f76f1c58640 1 --2- 172.21.15.22:0/3052530058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56164711c810 0x561647118400 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00dc10 tx=0x7f76dc00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8d96700ae97c59 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.348+0000 7f76d77fe640 1 -- 172.21.15.22:0/3052530058 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc017730 con 0x56164711c810 2024-08-20T01:35:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.348+0000 7f76d77fe640 1 -- 172.21.15.22:0/3052530058 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76dc017d80 con 0x56164711c810 2024-08-20T01:35:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.348+0000 7f76d77fe640 1 -- 172.21.15.22:0/3052530058 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc02aa50 con 0x56164711c810 2024-08-20T01:35:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.349+0000 7f76f6cad740 1 -- 172.21.15.22:0/3052530058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56164711c810 msgr2=0x561647118400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.349+0000 7f76f6cad740 1 --2- 172.21.15.22:0/3052530058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56164711c810 0x561647118400 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00dc10 tx=0x7f76dc00b4a0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.350+0000 7f76f6cad740 1 -- 172.21.15.22:0/3052530058 shutdown_connections 2024-08-20T01:35:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.350+0000 7f76f6cad740 1 --2- 172.21.15.22:0/3052530058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561647121b80 0x561647123400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.350+0000 7f76f6cad740 1 --2- 172.21.15.22:0/3052530058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56164711f140 0x561647118940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.350+0000 7f76f6cad740 1 --2- 172.21.15.22:0/3052530058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56164711c810 0x561647118400 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.350+0000 7f76f6cad740 1 -- 172.21.15.22:0/3052530058 >> 172.21.15.22:0/3052530058 conn(0x561647117960 msgr2=0x56164711bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.351+0000 7f76f6cad740 1 -- 172.21.15.22:0/3052530058 shutdown_connections 2024-08-20T01:35:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.351+0000 7f76f6cad740 1 -- 172.21.15.22:0/3052530058 wait complete. 2024-08-20T01:35:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.351+0000 7f76f6cad740 1 -- start start 2024-08-20T01:35:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.351+0000 7f76f6cad740 1 Processor -- start 2024-08-20T01:35:19.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.352+0000 7f76f6cad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56164711c810 0x56164712a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.352+0000 7f76f6cad740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56164711f140 0x56164712b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.352+0000 7f76f6cad740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561647121b80 0x56164712bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.352+0000 7f76f6cad740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f76d000cd10 con 0x56164711c810 2024-08-20T01:35:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.352+0000 7f76f6cad740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f76d000e180 con 0x56164711f140 2024-08-20T01:35:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.352+0000 7f76f6cad740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f76d000d3e0 con 0x561647121b80 2024-08-20T01:35:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.352+0000 7f76f6cad740 10 client.0 _ll_register_callbacks cb 0x7f76e4010530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:35:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.352+0000 7f76f1457640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56164711f140 0x56164712b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.352+0000 7f76f1457640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56164711f140 0x56164712b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:55506/0 (socket says 172.21.15.22:55506) 2024-08-20T01:35:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.352+0000 7f76f1457640 1 -- 172.21.15.22:0/1398084091 learned_addr learned my addr 172.21.15.22:0/1398084091 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.353+0000 7f76f1c58640 1 --2- 172.21.15.22:0/1398084091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56164711c810 0x56164712a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.353+0000 7f76f2459640 1 --2- 172.21.15.22:0/1398084091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561647121b80 0x56164712bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.353+0000 7f76f1457640 1 -- 172.21.15.22:0/1398084091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561647121b80 msgr2=0x56164712bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.353+0000 7f76f1457640 1 --2- 172.21.15.22:0/1398084091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561647121b80 0x56164712bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.353+0000 7f76f1457640 1 -- 172.21.15.22:0/1398084091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56164711c810 msgr2=0x56164712a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.353+0000 7f76f1457640 1 --2- 172.21.15.22:0/1398084091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56164711c810 0x56164712a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.353+0000 7f76f1457640 1 -- 172.21.15.22:0/1398084091 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56164712c440 con 0x56164711f140 2024-08-20T01:35:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.353+0000 7f76f1c58640 1 --2- 172.21.15.22:0/1398084091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56164711c810 0x56164712a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:35:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.354+0000 7f76f1457640 1 --2- 172.21.15.22:0/1398084091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56164711f140 0x56164712b040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f76e80097d0 tx=0x7f76e80cae10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7da1488c58c0a739 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.368+0000 7f76d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:35:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.368+0000 7f76d57fa640 1 -- 172.21.15.22:0/1398084091 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8043520 con 0x56164711f140 2024-08-20T01:35:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.368+0000 7f76f6cad740 1 -- 172.21.15.22:0/1398084091 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76dc017d80 con 0x56164711f140 2024-08-20T01:35:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.368+0000 7f76d57fa640 1 -- 172.21.15.22:0/1398084091 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f76e80cb5f0 con 0x56164711f140 2024-08-20T01:35:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.369+0000 7f76d57fa640 1 -- 172.21.15.22:0/1398084091 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f76e80caea0 con 0x56164711f140 2024-08-20T01:35:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.369+0000 7f76f6cad740 10 client.25649 fetch_fsmap learned FSMap version 29 2024-08-20T01:35:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.369+0000 7f76f6cad740 1 -- 172.21.15.22:0/1398084091 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56164712d820 con 0x56164711f140 2024-08-20T01:35:19.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.371+0000 7f76d57fa640 1 -- 172.21.15.22:0/1398084091 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76dc017d80 con 0x56164711f140 2024-08-20T01:35:19.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.371+0000 7f76d57fa640 1 -- 172.21.15.22:0/1398084091 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f76e80d3fb0 con 0x56164711f140 2024-08-20T01:35:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.371+0000 7f76f6cad740 10 client.25649 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:35:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.371+0000 7f76f6cad740 10 client.25649 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:35:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.371+0000 7f76f6cad740 20 client.25649 populate_metadata read hostname 'smithi022' 2024-08-20T01:35:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.371+0000 7f76f6cad740 1 --2- 172.21.15.22:0/1398084091 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56164719caa0 0x56164719ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.371+0000 7f76f6cad740 4 client.25649 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:35:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.371+0000 7f76f6cad740 1 -- 172.21.15.22:0/1398084091 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56164708cd50 con 0x56164719caa0 2024-08-20T01:35:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.372+0000 7f76f1c58640 1 --2- 172.21.15.22:0/1398084091 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56164719caa0 0x56164719ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.375+0000 7f76f1c58640 1 --2- 172.21.15.22:0/1398084091 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56164719caa0 0x56164719ee90 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7c821d4492cf2c1 server_cookie=64f17754bddeef1 in_seq=0 out_seq=0 2024-08-20T01:35:19.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:19.375+0000 7f76d57fa640 10 client.25649 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:19.517 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:35:20.032 INFO:tasks.workunit.client.0.smithi022.stdout: 388 1850818 1509 1286888 1374 665962 2216 2024-08-20T01:35:20.740 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:20 smithi022 ceph-mon[18709]: pgmap v472: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 18 MiB/s wr, 1.27k op/s 2024-08-20T01:35:21.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:20 smithi134 ceph-mon[22511]: pgmap v472: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 18 MiB/s wr, 1.27k op/s 2024-08-20T01:35:21.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:20 smithi077 ceph-mon[22251]: pgmap v472: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 18 MiB/s wr, 1.27k op/s 2024-08-20T01:35:21.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.677+0000 7f76d57fa640 1 -- 172.21.15.22:0/1398084091 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56164708cd50 con 0x56164719caa0 2024-08-20T01:35:21.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.677+0000 7f76d57fa640 10 client.25649 handle_command_reply: tid=0 2024-08-20T01:35:21.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.677+0000 7f76f6cad740 1 client.25649 shutdown 2024-08-20T01:35:21.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.677+0000 7f76f6cad740 1 -- 172.21.15.22:0/1398084091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56164711f140 msgr2=0x56164712b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:21.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.677+0000 7f76f6cad740 1 --2- 172.21.15.22:0/1398084091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56164711f140 0x56164712b040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f76e80097d0 tx=0x7f76e80cae10 comp rx=0 tx=0).stop 2024-08-20T01:35:21.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.677+0000 7f76f6cad740 1 -- 172.21.15.22:0/1398084091 shutdown_connections 2024-08-20T01:35:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.677+0000 7f76f6cad740 1 --2- 172.21.15.22:0/1398084091 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56164719caa0 0x56164719ee90 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.677+0000 7f76f6cad740 1 --2- 172.21.15.22:0/1398084091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561647121b80 0x56164712bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.677+0000 7f76f6cad740 1 --2- 172.21.15.22:0/1398084091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56164711f140 0x56164712b040 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.677+0000 7f76f6cad740 1 --2- 172.21.15.22:0/1398084091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56164711c810 0x56164712a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.678+0000 7f76f6cad740 1 -- 172.21.15.22:0/1398084091 >> 172.21.15.22:0/1398084091 conn(0x561647117960 msgr2=0x561647123400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.678+0000 7f76d57fa640 0 client.25649 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.678+0000 7f76f6cad740 1 -- 172.21.15.22:0/1398084091 shutdown_connections 2024-08-20T01:35:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.678+0000 7f76f6cad740 1 -- 172.21.15.22:0/1398084091 wait complete. 2024-08-20T01:35:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.678+0000 7f76f6cad740 20 client.25649 trim_cache size 0 max 16384 2024-08-20T01:35:21.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:35:21.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:35:21.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:35:21.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:35:21.716 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.715+0000 7f76f3ebc640 1 -- 172.21.15.22:0/1797760683 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f76d80b3dd0 msgr2=0x7f76d80b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:21.717 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.715+0000 7f76f3ebc640 1 --2- 172.21.15.22:0/1797760683 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f76d80b3dd0 0x7f76d80b6290 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f76e4005fd0 tx=0x7f76e40095c0 comp rx=0 tx=0).stop 2024-08-20T01:35:21.717 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.715+0000 7f76f3ebc640 1 -- 172.21.15.22:0/1797760683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76ec10a0f0 msgr2=0x7f76ec1a8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:21.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.715+0000 7f76f3ebc640 1 --2- 172.21.15.22:0/1797760683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76ec10a0f0 0x7f76ec1a8020 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f76e8000c00 tx=0x7f76e80045e0 comp rx=0 tx=0).stop 2024-08-20T01:35:21.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.715+0000 7f76f3ebc640 1 -- 172.21.15.22:0/1797760683 shutdown_connections 2024-08-20T01:35:21.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.715+0000 7f76f3ebc640 1 --2- 172.21.15.22:0/1797760683 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f76d80b3dd0 0x7f76d80b6290 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:21.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.715+0000 7f76f3ebc640 1 --2- 172.21.15.22:0/1797760683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76ec1a8c50 0x7f76ec1a9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:21.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.715+0000 7f76f3ebc640 1 --2- 172.21.15.22:0/1797760683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76ec10a0f0 0x7f76ec1a8020 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:21.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.716+0000 7f76f3ebc640 1 --2- 172.21.15.22:0/1797760683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76ec074230 0x7f76ec1a79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:21.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.716+0000 7f76f3ebc640 1 -- 172.21.15.22:0/1797760683 >> 172.21.15.22:0/1797760683 conn(0x7f76ec06f580 msgr2=0x7f76ec071360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:21.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.716+0000 7f76f3ebc640 1 -- 172.21.15.22:0/1797760683 shutdown_connections 2024-08-20T01:35:21.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:21.716+0000 7f76f3ebc640 1 -- 172.21.15.22:0/1797760683 wait complete. 2024-08-20T01:35:23.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:22 smithi134 ceph-mon[22511]: pgmap v473: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 17 MiB/s wr, 1.31k op/s 2024-08-20T01:35:23.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:22 smithi077 ceph-mon[22251]: pgmap v473: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 17 MiB/s wr, 1.31k op/s 2024-08-20T01:35:23.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:22 smithi022 ceph-mon[18709]: pgmap v473: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 17 MiB/s wr, 1.31k op/s 2024-08-20T01:35:25.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:24 smithi134 ceph-mon[22511]: pgmap v474: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.3 MiB/s wr, 1.19k op/s 2024-08-20T01:35:25.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:24 smithi077 ceph-mon[22251]: pgmap v474: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.3 MiB/s wr, 1.19k op/s 2024-08-20T01:35:25.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:24 smithi022 ceph-mon[18709]: pgmap v474: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.3 MiB/s wr, 1.19k op/s 2024-08-20T01:35:26.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:25 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:35:26.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:25 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:35:26.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:25 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:35:26.611 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:27.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:26 smithi134 ceph-mon[22511]: pgmap v475: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.4 MiB/s wr, 950 op/s 2024-08-20T01:35:27.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:26 smithi077 ceph-mon[22251]: pgmap v475: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.4 MiB/s wr, 950 op/s 2024-08-20T01:35:27.104 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:26 smithi022 ceph-mon[18709]: pgmap v475: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.4 MiB/s wr, 950 op/s 2024-08-20T01:35:28.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.951+0000 7f5d75244640 1 -- 172.21.15.22:0/206573945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7010a260 msgr2=0x7f5d7010a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:28.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.951+0000 7f5d75244640 1 --2- 172.21.15.22:0/206573945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7010a260 0x7f5d7010a6a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009ca0 tx=0x7f5d6802a980 comp rx=0 tx=0).stop 2024-08-20T01:35:28.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.952+0000 7f5d75244640 1 -- 172.21.15.22:0/206573945 shutdown_connections 2024-08-20T01:35:28.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.952+0000 7f5d75244640 1 --2- 172.21.15.22:0/206573945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d7011bdd0 0x7f5d7011e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.952+0000 7f5d75244640 1 --2- 172.21.15.22:0/206573945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7010a260 0x7f5d7010a6a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.952+0000 7f5d75244640 1 --2- 172.21.15.22:0/206573945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d70109e80 0x7f5d70110ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.952+0000 7f5d75244640 1 -- 172.21.15.22:0/206573945 >> 172.21.15.22:0/206573945 conn(0x7f5d7006dcc0 msgr2=0x7f5d7006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:28.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.962+0000 7f5d75244640 1 -- 172.21.15.22:0/206573945 shutdown_connections 2024-08-20T01:35:28.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.962+0000 7f5d75244640 1 -- 172.21.15.22:0/206573945 wait complete. 2024-08-20T01:35:28.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.963+0000 7f5d75244640 1 Processor -- start 2024-08-20T01:35:28.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.963+0000 7f5d75244640 1 -- start start 2024-08-20T01:35:28.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.964+0000 7f5d75244640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d70109e80 0x7f5d7011b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:28.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.964+0000 7f5d75244640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d7010a260 0x7f5d7011b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:28.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.964+0000 7f5d75244640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7011bdd0 0x7f5d70115660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:28.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.964+0000 7f5d75244640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5d70111eb0 con 0x7f5d7010a260 2024-08-20T01:35:28.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.964+0000 7f5d75244640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d70111d30 con 0x7f5d7011bdd0 2024-08-20T01:35:28.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.964+0000 7f5d75244640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5d70112030 con 0x7f5d70109e80 2024-08-20T01:35:28.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.964+0000 7f5d6e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d7010a260 0x7f5d7011b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:28.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.964+0000 7f5d6e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d7010a260 0x7f5d7011b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42282/0 (socket says 172.21.15.22:42282) 2024-08-20T01:35:28.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.964+0000 7f5d6e59c640 1 -- 172.21.15.22:0/1530663757 learned_addr learned my addr 172.21.15.22:0/1530663757 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:28.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.964+0000 7f5d6ed9d640 1 --2- 172.21.15.22:0/1530663757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d70109e80 0x7f5d7011b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:28.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.966+0000 7f5d6e59c640 1 -- 172.21.15.22:0/1530663757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d70109e80 msgr2=0x7f5d7011b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:28.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.966+0000 7f5d6e59c640 1 --2- 172.21.15.22:0/1530663757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d70109e80 0x7f5d7011b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.966+0000 7f5d6e59c640 1 -- 172.21.15.22:0/1530663757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7011bdd0 msgr2=0x7f5d70115660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:28.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.965+0000 7f5d6f59e640 1 --2- 172.21.15.22:0/1530663757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7011bdd0 0x7f5d70115660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:28.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.966+0000 7f5d6e59c640 1 --2- 172.21.15.22:0/1530663757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7011bdd0 0x7f5d70115660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.966+0000 7f5d6e59c640 1 -- 172.21.15.22:0/1530663757 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d70115f20 con 0x7f5d7010a260 2024-08-20T01:35:28.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.966+0000 7f5d6f59e640 1 --2- 172.21.15.22:0/1530663757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7011bdd0 0x7f5d70115660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:28.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.967+0000 7f5d6e59c640 1 --2- 172.21.15.22:0/1530663757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d7010a260 0x7f5d7011b7c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5d68005e30 tx=0x7f5d68003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:28.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.972+0000 7f5d57fff640 1 -- 172.21.15.22:0/1530663757 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d68034050 con 0x7f5d7010a260 2024-08-20T01:35:28.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.972+0000 7f5d75244640 1 -- 172.21.15.22:0/1530663757 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d701161b0 con 0x7f5d7010a260 2024-08-20T01:35:28.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.972+0000 7f5d75244640 1 -- 172.21.15.22:0/1530663757 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d701bd000 con 0x7f5d7010a260 2024-08-20T01:35:28.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.973+0000 7f5d57fff640 1 -- 172.21.15.22:0/1530663757 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d6802f880 con 0x7f5d7010a260 2024-08-20T01:35:28.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.973+0000 7f5d57fff640 1 -- 172.21.15.22:0/1530663757 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d68039420 con 0x7f5d7010a260 2024-08-20T01:35:28.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.976+0000 7f5d7763d740 1 Processor -- start 2024-08-20T01:35:28.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.977+0000 7f5d7763d740 1 -- start start 2024-08-20T01:35:28.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.978+0000 7f5d7763d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b4880 0x5605ff6b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:28.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.978+0000 7f5d7763d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b51a0 0x5605ff6c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:28.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.978+0000 7f5d7763d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 0x5605ff6c3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:28.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.978+0000 7f5d7763d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5605ff62b930 con 0x5605ff6b4880 2024-08-20T01:35:28.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.978+0000 7f5d7763d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5605ff61ae30 con 0x5605ff6b51a0 2024-08-20T01:35:28.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.978+0000 7f5d7763d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5605ff61ee70 con 0x5605ff6c1130 2024-08-20T01:35:28.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.978+0000 7f5d6ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b51a0 0x5605ff6c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:28.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.979+0000 7f5d6f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b4880 0x5605ff6b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:28.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.979+0000 7f5d6f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b4880 0x5605ff6b4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42298/0 (socket says 172.21.15.22:42298) 2024-08-20T01:35:28.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.979+0000 7f5d6f59e640 1 -- 172.21.15.22:0/1472835537 learned_addr learned my addr 172.21.15.22:0/1472835537 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:28.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.979+0000 7f5d6f59e640 1 -- 172.21.15.22:0/1472835537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 msgr2=0x5605ff6c3520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:35:28.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.979+0000 7f5d6f59e640 1 --2- 172.21.15.22:0/1472835537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 0x5605ff6c3520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.979+0000 7f5d6f59e640 1 -- 172.21.15.22:0/1472835537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b51a0 msgr2=0x5605ff6c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:28.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.979+0000 7f5d6f59e640 1 --2- 172.21.15.22:0/1472835537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b51a0 0x5605ff6c0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.979+0000 7f5d6f59e640 1 -- 172.21.15.22:0/1472835537 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605ff37a650 con 0x5605ff6b4880 2024-08-20T01:35:28.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.980+0000 7f5d6f59e640 1 --2- 172.21.15.22:0/1472835537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b4880 0x5605ff6b4c60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400a970 tx=0x7f5d6400ae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577d89a507ba9909 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:28.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.983+0000 7f5d557fa640 1 -- 172.21.15.22:0/1472835537 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64015070 con 0x5605ff6b4880 2024-08-20T01:35:28.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.983+0000 7f5d557fa640 1 -- 172.21.15.22:0/1472835537 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d6400cc00 con 0x5605ff6b4880 2024-08-20T01:35:28.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.985+0000 7f5d7763d740 1 -- 172.21.15.22:0/1472835537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b4880 msgr2=0x5605ff6b4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:28.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.985+0000 7f5d7763d740 1 --2- 172.21.15.22:0/1472835537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b4880 0x5605ff6b4c60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400a970 tx=0x7f5d6400ae30 comp rx=0 tx=0).stop 2024-08-20T01:35:28.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.990+0000 7f5d57fff640 1 -- 172.21.15.22:0/1530663757 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5d68037020 con 0x7f5d7010a260 2024-08-20T01:35:28.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.992+0000 7f5d57fff640 1 --2- 172.21.15.22:0/1530663757 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5d580b3d60 0x7f5d580b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:28.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.992+0000 7f5d57fff640 1 -- 172.21.15.22:0/1530663757 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f5d68104d10 con 0x7f5d7010a260 2024-08-20T01:35:28.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.992+0000 7f5d7763d740 1 -- 172.21.15.22:0/1472835537 shutdown_connections 2024-08-20T01:35:28.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.992+0000 7f5d7763d740 1 --2- 172.21.15.22:0/1472835537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 0x5605ff6c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.992+0000 7f5d7763d740 1 --2- 172.21.15.22:0/1472835537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b51a0 0x5605ff6c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.992+0000 7f5d7763d740 1 --2- 172.21.15.22:0/1472835537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b4880 0x5605ff6b4c60 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.992+0000 7f5d7763d740 1 -- 172.21.15.22:0/1472835537 >> 172.21.15.22:0/1472835537 conn(0x5605ff6b26b0 msgr2=0x5605ff6b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:28.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.993+0000 7f5d7763d740 1 -- 172.21.15.22:0/1472835537 shutdown_connections 2024-08-20T01:35:28.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.993+0000 7f5d6f59e640 1 --2- 172.21.15.22:0/1530663757 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5d580b3d60 0x7f5d580b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:28.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.993+0000 7f5d7763d740 1 -- 172.21.15.22:0/1472835537 wait complete. 2024-08-20T01:35:28.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.993+0000 7f5d7763d740 1 -- start start 2024-08-20T01:35:28.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.993+0000 7f5d7763d740 1 Processor -- start 2024-08-20T01:35:28.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.995+0000 7f5d7763d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b4880 0x5605ff6c0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:28.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.995+0000 7f5d7763d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b51a0 0x5605ff6bdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:28.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.995+0000 7f5d7763d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 0x5605ff6be720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:28.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.995+0000 7f5d7763d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5605ff47d700 con 0x5605ff6b51a0 2024-08-20T01:35:28.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.995+0000 7f5d7763d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5605ff5a1810 con 0x5605ff6b4880 2024-08-20T01:35:28.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.995+0000 7f5d7763d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5605ff6c3e80 con 0x5605ff6c1130 2024-08-20T01:35:28.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.995+0000 7f5d7763d740 10 client.0 _ll_register_callbacks cb 0x5605ff614700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:35:28.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.996+0000 7f5d6f59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 0x5605ff6be720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:28.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.996+0000 7f5d6f59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 0x5605ff6be720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:47010/0 (socket says 172.21.15.22:47010) 2024-08-20T01:35:28.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.997+0000 7f5d6f59e640 1 -- 172.21.15.22:0/2757336062 learned_addr learned my addr 172.21.15.22:0/2757336062 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:28.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.998+0000 7f5d6f59e640 1 -- 172.21.15.22:0/2757336062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b4880 msgr2=0x5605ff6c0b40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:35:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.998+0000 7f5d6ed9d640 1 --2- 172.21.15.22:0/2757336062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b4880 0x5605ff6c0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.998+0000 7f5d6f59e640 1 --2- 172.21.15.22:0/2757336062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b4880 0x5605ff6c0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.998+0000 7f5d6f59e640 1 -- 172.21.15.22:0/2757336062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b51a0 msgr2=0x5605ff6bdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.998+0000 7f5d6f59e640 1 --2- 172.21.15.22:0/2757336062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b51a0 0x5605ff6bdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.998+0000 7f5d6f59e640 1 -- 172.21.15.22:0/2757336062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605ff6cd290 con 0x5605ff6c1130 2024-08-20T01:35:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.998+0000 7f5d6f59e640 1 --2- 172.21.15.22:0/1530663757 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5d580b3d60 0x7f5d580b6220 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400a120 tx=0x7f5d64011cf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.999+0000 7f5d6f59e640 1 --2- 172.21.15.22:0/2757336062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 0x5605ff6be720 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5d64017000 tx=0x7f5d6400ae30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=525de5fedbd753cc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.999+0000 7f5d52ff5640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:35:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.999+0000 7f5d52ff5640 1 -- 172.21.15.22:0/2757336062 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64020070 con 0x5605ff6c1130 2024-08-20T01:35:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.999+0000 7f5d7763d740 1 -- 172.21.15.22:0/2757336062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5605ff5ca150 con 0x5605ff6c1130 2024-08-20T01:35:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:27.999+0000 7f5d52ff5640 1 -- 172.21.15.22:0/2757336062 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f5d64018820 con 0x5605ff6c1130 2024-08-20T01:35:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.000+0000 7f5d52ff5640 1 -- 172.21.15.22:0/2757336062 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5d64015040 con 0x5605ff6c1130 2024-08-20T01:35:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.004+0000 7f5d7763d740 10 client.25669 fetch_fsmap learned FSMap version 29 2024-08-20T01:35:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.004+0000 7f5d7763d740 1 -- 172.21.15.22:0/2757336062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5605ff6cfbb0 con 0x5605ff6c1130 2024-08-20T01:35:28.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.005+0000 7f5d52ff5640 1 -- 172.21.15.22:0/2757336062 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5605ff5ca150 con 0x5605ff6c1130 2024-08-20T01:35:28.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.005+0000 7f5d52ff5640 1 -- 172.21.15.22:0/2757336062 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5d6401a450 con 0x5605ff6c1130 2024-08-20T01:35:28.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.006+0000 7f5d7763d740 10 client.25669 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:35:28.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.006+0000 7f5d7763d740 10 client.25669 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:35:28.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.006+0000 7f5d7763d740 20 client.25669 populate_metadata read hostname 'smithi022' 2024-08-20T01:35:28.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.006+0000 7f5d7763d740 1 --2- 172.21.15.22:0/2757336062 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5605ff6d1430 0x5605ff6d38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:28.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.006+0000 7f5d7763d740 4 client.25669 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:35:28.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.006+0000 7f5d7763d740 1 -- 172.21.15.22:0/2757336062 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605ff62d880 con 0x5605ff6d1430 2024-08-20T01:35:28.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.012+0000 7f5d6ed9d640 1 --2- 172.21.15.22:0/2757336062 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5605ff6d1430 0x5605ff6d38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:28.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.021+0000 7f5d6ed9d640 1 --2- 172.21.15.22:0/2757336062 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5605ff6d1430 0x5605ff6d38f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2c2d3991e9890ad1 server_cookie=1ecf18df6197f05c in_seq=0 out_seq=0 2024-08-20T01:35:28.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.021+0000 7f5d52ff5640 10 client.25669 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:35:28.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.039+0000 7f5d52ff5640 1 -- 172.21.15.22:0/2757336062 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5605ff62d880 con 0x5605ff6d1430 2024-08-20T01:35:28.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.040+0000 7f5d52ff5640 10 client.25669 handle_command_reply: tid=0 2024-08-20T01:35:28.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.042+0000 7f5d7763d740 1 client.25669 shutdown 2024-08-20T01:35:28.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.048+0000 7f5d7763d740 1 -- 172.21.15.22:0/2757336062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 msgr2=0x5605ff6be720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:28.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.048+0000 7f5d7763d740 1 --2- 172.21.15.22:0/2757336062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 0x5605ff6be720 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5d64017000 tx=0x7f5d6400ae30 comp rx=0 tx=0).stop 2024-08-20T01:35:28.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.048+0000 7f5d7763d740 1 -- 172.21.15.22:0/2757336062 shutdown_connections 2024-08-20T01:35:28.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.048+0000 7f5d7763d740 1 --2- 172.21.15.22:0/2757336062 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5605ff6d1430 0x5605ff6d38f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.048+0000 7f5d7763d740 1 --2- 172.21.15.22:0/2757336062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 0x5605ff6be720 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.048+0000 7f5d7763d740 1 --2- 172.21.15.22:0/2757336062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b51a0 0x5605ff6bdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.048+0000 7f5d7763d740 1 --2- 172.21.15.22:0/2757336062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b4880 0x5605ff6c0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.048+0000 7f5d7763d740 1 -- 172.21.15.22:0/2757336062 >> 172.21.15.22:0/2757336062 conn(0x5605ff6b26b0 msgr2=0x5605ff6b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:28.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.048+0000 7f5d52ff5640 0 client.25669 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:35:28.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.048+0000 7f5d7763d740 1 -- 172.21.15.22:0/2757336062 shutdown_connections 2024-08-20T01:35:28.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.049+0000 7f5d7763d740 1 -- 172.21.15.22:0/2757336062 wait complete. 2024-08-20T01:35:28.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.049+0000 7f5d7763d740 20 client.25669 trim_cache size 0 max 16384 2024-08-20T01:35:28.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.086+0000 7f5d7763d740 1 Processor -- start 2024-08-20T01:35:28.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.090+0000 7f5d7763d740 1 -- start start 2024-08-20T01:35:28.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.090+0000 7f5d7763d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b4880 0x5605ff6bc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:28.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.090+0000 7f5d7763d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b51a0 0x5605ff6bcd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:28.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.090+0000 7f5d7763d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 0x5605ff6b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:28.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.090+0000 7f5d7763d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5c011010 con 0x5605ff6b4880 2024-08-20T01:35:28.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.090+0000 7f5d7763d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5c00e880 con 0x5605ff6b51a0 2024-08-20T01:35:28.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.090+0000 7f5d7763d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5c00c6d0 con 0x5605ff6c1130 2024-08-20T01:35:28.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.094+0000 7f5d6e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b51a0 0x5605ff6bcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:28.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.094+0000 7f5d6e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b51a0 0x5605ff6bcd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:58436/0 (socket says 172.21.15.22:58436) 2024-08-20T01:35:28.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.094+0000 7f5d6e59c640 1 -- 172.21.15.22:0/4281786444 learned_addr learned my addr 172.21.15.22:0/4281786444 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:28.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.094+0000 7f5d6f59e640 1 --2- 172.21.15.22:0/4281786444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 0x5605ff6b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:28.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.094+0000 7f5d6ed9d640 1 --2- 172.21.15.22:0/4281786444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b4880 0x5605ff6bc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:28.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.094+0000 7f5d6f59e640 1 -- 172.21.15.22:0/4281786444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b51a0 msgr2=0x5605ff6bcd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:28.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.094+0000 7f5d6f59e640 1 --2- 172.21.15.22:0/4281786444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b51a0 0x5605ff6bcd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.094+0000 7f5d6f59e640 1 -- 172.21.15.22:0/4281786444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b4880 msgr2=0x5605ff6bc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:28.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.094+0000 7f5d6f59e640 1 --2- 172.21.15.22:0/4281786444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b4880 0x5605ff6bc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.094+0000 7f5d6f59e640 1 -- 172.21.15.22:0/4281786444 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605ff6b4fd0 con 0x5605ff6c1130 2024-08-20T01:35:28.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.095+0000 7f5d6f59e640 1 --2- 172.21.15.22:0/4281786444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 0x5605ff6b3700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400e010 tx=0x7f5d64011d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1477e40b449395c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:28.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.096+0000 7f5d54ff9640 1 -- 172.21.15.22:0/4281786444 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6403e030 con 0x5605ff6c1130 2024-08-20T01:35:28.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.096+0000 7f5d54ff9640 1 -- 172.21.15.22:0/4281786444 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d64004540 con 0x5605ff6c1130 2024-08-20T01:35:28.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.096+0000 7f5d54ff9640 1 -- 172.21.15.22:0/4281786444 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64020040 con 0x5605ff6c1130 2024-08-20T01:35:28.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.098+0000 7f5d7763d740 1 -- 172.21.15.22:0/4281786444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 msgr2=0x5605ff6b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:28.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.098+0000 7f5d7763d740 1 --2- 172.21.15.22:0/4281786444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 0x5605ff6b3700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400e010 tx=0x7f5d64011d60 comp rx=0 tx=0).stop 2024-08-20T01:35:28.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.099+0000 7f5d7763d740 1 -- 172.21.15.22:0/4281786444 shutdown_connections 2024-08-20T01:35:28.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.099+0000 7f5d7763d740 1 --2- 172.21.15.22:0/4281786444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 0x5605ff6b3700 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.099+0000 7f5d7763d740 1 --2- 172.21.15.22:0/4281786444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b51a0 0x5605ff6bcd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.099+0000 7f5d7763d740 1 --2- 172.21.15.22:0/4281786444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b4880 0x5605ff6bc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.099+0000 7f5d7763d740 1 -- 172.21.15.22:0/4281786444 >> 172.21.15.22:0/4281786444 conn(0x5605ff6b26b0 msgr2=0x5605ff6b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:28.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.103+0000 7f5d7763d740 1 -- 172.21.15.22:0/4281786444 shutdown_connections 2024-08-20T01:35:28.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.103+0000 7f5d7763d740 1 -- 172.21.15.22:0/4281786444 wait complete. 2024-08-20T01:35:28.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.103+0000 7f5d7763d740 1 -- start start 2024-08-20T01:35:28.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.103+0000 7f5d7763d740 1 Processor -- start 2024-08-20T01:35:28.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.104+0000 7f5d7763d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b4880 0x5605ff6c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:28.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.104+0000 7f5d7763d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b51a0 0x5605ff6c9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:28.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.104+0000 7f5d7763d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 0x5605ff6bb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:28.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.104+0000 7f5d7763d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5c00cd40 con 0x5605ff6b51a0 2024-08-20T01:35:28.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.105+0000 7f5d6ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b4880 0x5605ff6c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:28.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.105+0000 7f5d6e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b51a0 0x5605ff6c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:28.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.105+0000 7f5d6e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b51a0 0x5605ff6c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42308/0 (socket says 172.21.15.22:42308) 2024-08-20T01:35:28.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.105+0000 7f5d6e59c640 1 -- 172.21.15.22:0/4224631299 learned_addr learned my addr 172.21.15.22:0/4224631299 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:28.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.105+0000 7f5d6f59e640 1 --2- 172.21.15.22:0/4224631299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 0x5605ff6bb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:28.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.105+0000 7f5d7763d740 1 -- 172.21.15.22:0/4224631299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5c00e1b0 con 0x5605ff6b4880 2024-08-20T01:35:28.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.105+0000 7f5d7763d740 1 -- 172.21.15.22:0/4224631299 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5c00d410 con 0x5605ff6c1130 2024-08-20T01:35:28.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.105+0000 7f5d7763d740 10 client.0 _ll_register_callbacks cb 0x7f5d6400a790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:35:28.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.111+0000 7f5d6e59c640 1 -- 172.21.15.22:0/4224631299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 msgr2=0x5605ff6bb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:28.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.111+0000 7f5d6e59c640 1 --2- 172.21.15.22:0/4224631299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 0x5605ff6bb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.111+0000 7f5d6e59c640 1 -- 172.21.15.22:0/4224631299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b4880 msgr2=0x5605ff6c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:28.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.111+0000 7f5d6e59c640 1 --2- 172.21.15.22:0/4224631299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b4880 0x5605ff6c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.111+0000 7f5d6e59c640 1 -- 172.21.15.22:0/4224631299 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605ff6bba10 con 0x5605ff6b51a0 2024-08-20T01:35:28.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.116+0000 7f5d6e59c640 1 --2- 172.21.15.22:0/4224631299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b51a0 0x5605ff6c9910 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5d680049d0 tx=0x7f5d68030b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3bbae083e859d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:28.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.116+0000 7f5d52ff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:35:28.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.128+0000 7f5d52ff5640 1 -- 172.21.15.22:0/4224631299 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d680cb730 con 0x5605ff6b51a0 2024-08-20T01:35:28.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.128+0000 7f5d52ff5640 1 -- 172.21.15.22:0/4224631299 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f5d6802f5e0 con 0x5605ff6b51a0 2024-08-20T01:35:28.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.128+0000 7f5d7763d740 1 -- 172.21.15.22:0/4224631299 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d64004540 con 0x5605ff6b51a0 2024-08-20T01:35:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.132+0000 7f5d52ff5640 1 -- 172.21.15.22:0/4224631299 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5d680cc320 con 0x5605ff6b51a0 2024-08-20T01:35:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.133+0000 7f5d7763d740 10 client.16065 fetch_fsmap learned FSMap version 29 2024-08-20T01:35:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.134+0000 7f5d7763d740 1 -- 172.21.15.22:0/4224631299 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5605ff6c20b0 con 0x5605ff6b51a0 2024-08-20T01:35:28.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.139+0000 7f5d52ff5640 1 -- 172.21.15.22:0/4224631299 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d680cbc20 con 0x5605ff6b51a0 2024-08-20T01:35:28.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.139+0000 7f5d52ff5640 1 -- 172.21.15.22:0/4224631299 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5d68041070 con 0x5605ff6b51a0 2024-08-20T01:35:28.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.140+0000 7f5d7763d740 10 client.16065 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:35:28.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.140+0000 7f5d7763d740 10 client.16065 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:35:28.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.140+0000 7f5d7763d740 20 client.16065 populate_metadata read hostname 'smithi022' 2024-08-20T01:35:28.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.140+0000 7f5d7763d740 1 --2- 172.21.15.22:0/4224631299 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5605ff6c27e0 0x5605ff6c2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:28.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.140+0000 7f5d7763d740 4 client.16065 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:35:28.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.140+0000 7f5d7763d740 1 -- 172.21.15.22:0/4224631299 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f5d64004540 con 0x5605ff6c27e0 2024-08-20T01:35:28.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.143+0000 7f5d6ed9d640 1 --2- 172.21.15.22:0/4224631299 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5605ff6c27e0 0x5605ff6c2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:28.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.153+0000 7f5d6ed9d640 1 --2- 172.21.15.22:0/4224631299 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5605ff6c27e0 0x5605ff6c2bf0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fd7a6b096a2ca363 server_cookie=c33cbe6384ff4c04 in_seq=0 out_seq=0 2024-08-20T01:35:28.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.153+0000 7f5d52ff5640 10 client.16065 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:35:28.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.167+0000 7f5d52ff5640 1 -- 172.21.15.22:0/4224631299 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f5d64004540 con 0x5605ff6c27e0 2024-08-20T01:35:28.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.167+0000 7f5d52ff5640 10 client.16065 handle_command_reply: tid=0 2024-08-20T01:35:28.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.167+0000 7f5d7763d740 1 client.16065 shutdown 2024-08-20T01:35:28.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.167+0000 7f5d7763d740 1 -- 172.21.15.22:0/4224631299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b51a0 msgr2=0x5605ff6c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:28.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.167+0000 7f5d7763d740 1 --2- 172.21.15.22:0/4224631299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b51a0 0x5605ff6c9910 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5d680049d0 tx=0x7f5d68030b90 comp rx=0 tx=0).stop 2024-08-20T01:35:28.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.167+0000 7f5d7763d740 1 -- 172.21.15.22:0/4224631299 shutdown_connections 2024-08-20T01:35:28.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.167+0000 7f5d7763d740 1 --2- 172.21.15.22:0/4224631299 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5605ff6c27e0 0x5605ff6c2bf0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.167+0000 7f5d7763d740 1 --2- 172.21.15.22:0/4224631299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605ff6c1130 0x5605ff6bb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.167+0000 7f5d7763d740 1 --2- 172.21.15.22:0/4224631299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605ff6b51a0 0x5605ff6c9910 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.167+0000 7f5d7763d740 1 --2- 172.21.15.22:0/4224631299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5605ff6b4880 0x5605ff6c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.167+0000 7f5d7763d740 1 -- 172.21.15.22:0/4224631299 >> 172.21.15.22:0/4224631299 conn(0x5605ff6b26b0 msgr2=0x5605ff6bc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:28.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.167+0000 7f5d52ff5640 0 client.16065 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:35:28.172 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:35:28.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.167+0000 7f5d7763d740 1 -- 172.21.15.22:0/4224631299 shutdown_connections 2024-08-20T01:35:28.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.167+0000 7f5d7763d740 1 -- 172.21.15.22:0/4224631299 wait complete. 2024-08-20T01:35:28.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.168+0000 7f5d7763d740 20 client.16065 trim_cache size 0 max 16384 2024-08-20T01:35:28.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.168+0000 7f5d75244640 1 -- 172.21.15.22:0/1530663757 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5d580b3d60 msgr2=0x7f5d580b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:28.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.168+0000 7f5d75244640 1 --2- 172.21.15.22:0/1530663757 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5d580b3d60 0x7f5d580b6220 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400a120 tx=0x7f5d64011cf0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.169+0000 7f5d75244640 1 -- 172.21.15.22:0/1530663757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d7010a260 msgr2=0x7f5d7011b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:28.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.169+0000 7f5d75244640 1 --2- 172.21.15.22:0/1530663757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d7010a260 0x7f5d7011b7c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5d68005e30 tx=0x7f5d68003f30 comp rx=0 tx=0).stop 2024-08-20T01:35:28.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.169+0000 7f5d75244640 1 -- 172.21.15.22:0/1530663757 shutdown_connections 2024-08-20T01:35:28.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.169+0000 7f5d75244640 1 --2- 172.21.15.22:0/1530663757 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5d580b3d60 0x7f5d580b6220 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.169+0000 7f5d75244640 1 --2- 172.21.15.22:0/1530663757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7011bdd0 0x7f5d70115660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.169+0000 7f5d75244640 1 --2- 172.21.15.22:0/1530663757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d7010a260 0x7f5d7011b7c0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.169+0000 7f5d75244640 1 --2- 172.21.15.22:0/1530663757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d70109e80 0x7f5d7011b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:28.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.169+0000 7f5d75244640 1 -- 172.21.15.22:0/1530663757 >> 172.21.15.22:0/1530663757 conn(0x7f5d7006dcc0 msgr2=0x7f5d70071510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.169+0000 7f5d75244640 1 -- 172.21.15.22:0/1530663757 shutdown_connections 2024-08-20T01:35:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:28.169+0000 7f5d75244640 1 -- 172.21.15.22:0/1530663757 wait complete. 2024-08-20T01:35:29.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:28 smithi077 ceph-mon[22251]: pgmap v476: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 1.02k op/s 2024-08-20T01:35:29.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:28 smithi022 ceph-mon[18709]: pgmap v476: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 1.02k op/s 2024-08-20T01:35:29.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:28 smithi134 ceph-mon[22511]: pgmap v476: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 1.02k op/s 2024-08-20T01:35:30.007 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:35:30.053 INFO:tasks.workunit.client.0.smithi022.stdout: 415 1955915 1473 1360252 1416 705163 2304 2024-08-20T01:35:31.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:30 smithi077 ceph-mon[22251]: pgmap v477: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 893 op/s 2024-08-20T01:35:31.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:30 smithi022 ceph-mon[18709]: pgmap v477: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 893 op/s 2024-08-20T01:35:31.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:30 smithi134 ceph-mon[22511]: pgmap v477: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 893 op/s 2024-08-20T01:35:33.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:32 smithi077 ceph-mon[22251]: pgmap v478: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 8.1 MiB/s wr, 1.11k op/s 2024-08-20T01:35:33.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:32 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:35:33.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:32 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:35:33.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:32 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:35:33.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:32 smithi022 ceph-mon[18709]: pgmap v478: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 8.1 MiB/s wr, 1.11k op/s 2024-08-20T01:35:33.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:32 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:35:33.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:32 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:35:33.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:32 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:35:33.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:32 smithi134 ceph-mon[22511]: pgmap v478: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 8.1 MiB/s wr, 1.11k op/s 2024-08-20T01:35:33.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:32 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:35:33.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:32 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:35:33.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:32 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:35:34.388 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:35.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:34 smithi077 ceph-mon[22251]: pgmap v479: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.4 MiB/s wr, 898 op/s 2024-08-20T01:35:35.082 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:34 smithi022 ceph-mon[18709]: pgmap v479: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.4 MiB/s wr, 898 op/s 2024-08-20T01:35:35.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:34 smithi134 ceph-mon[22511]: pgmap v479: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.4 MiB/s wr, 898 op/s 2024-08-20T01:35:36.346 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:35:36.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.038+0000 7fb6ff2ce640 1 -- 172.21.15.22:0/3719920860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6f810f4f0 msgr2=0x7fb6f810f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:36.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.038+0000 7fb6ff2ce640 1 --2- 172.21.15.22:0/3719920860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6f810f4f0 0x7fb6f810f980 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8009900 tx=0x7fb6e802a400 comp rx=0 tx=0).stop 2024-08-20T01:35:36.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.045+0000 7fb6ff2ce640 1 -- 172.21.15.22:0/3719920860 shutdown_connections 2024-08-20T01:35:36.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.045+0000 7fb6ff2ce640 1 --2- 172.21.15.22:0/3719920860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6f810f4f0 0x7fb6f810f980 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.045+0000 7fb6ff2ce640 1 --2- 172.21.15.22:0/3719920860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6f810a7a0 0x7fb6f810efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.045+0000 7fb6ff2ce640 1 --2- 172.21.15.22:0/3719920860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6f8109e80 0x7fb6f810a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.045+0000 7fb6ff2ce640 1 -- 172.21.15.22:0/3719920860 >> 172.21.15.22:0/3719920860 conn(0x7fb6f806dfe0 msgr2=0x7fb6f806e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:36.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.049+0000 7fb6ff2ce640 1 -- 172.21.15.22:0/3719920860 shutdown_connections 2024-08-20T01:35:36.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.049+0000 7fb6ff2ce640 1 -- 172.21.15.22:0/3719920860 wait complete. 2024-08-20T01:35:36.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.050+0000 7fb6ff2ce640 1 Processor -- start 2024-08-20T01:35:36.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.052+0000 7fb6ff2ce640 1 -- start start 2024-08-20T01:35:36.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.052+0000 7fb6ff2ce640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6f8109e80 0x7fb6f81194e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.052+0000 7fb6ff2ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6f810a7a0 0x7fb6f8119a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.052+0000 7fb6ff2ce640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6f810f4f0 0x7fb6f8119f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.052+0000 7fb6ff2ce640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f8113070 con 0x7fb6f810f4f0 2024-08-20T01:35:36.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.052+0000 7fb6ff2ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f8112ef0 con 0x7fb6f810a7a0 2024-08-20T01:35:36.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.052+0000 7fb6ff2ce640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f81131f0 con 0x7fb6f8109e80 2024-08-20T01:35:36.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.053+0000 7fb6fd06a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6f8109e80 0x7fb6f81194e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:36.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.053+0000 7fb6fd06a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6f8109e80 0x7fb6f81194e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:54916/0 (socket says 172.21.15.22:54916) 2024-08-20T01:35:36.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.053+0000 7fb6fd06a640 1 -- 172.21.15.22:0/3636783163 learned_addr learned my addr 172.21.15.22:0/3636783163 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:36.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.053+0000 7fb6fd06a640 1 -- 172.21.15.22:0/3636783163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6f810a7a0 msgr2=0x7fb6f8119a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T01:35:36.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.053+0000 7fb6fd06a640 1 --2- 172.21.15.22:0/3636783163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6f810a7a0 0x7fb6f8119a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.053+0000 7fb6fd06a640 1 -- 172.21.15.22:0/3636783163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6f810f4f0 msgr2=0x7fb6f8119f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:36.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.053+0000 7fb6fd06a640 1 --2- 172.21.15.22:0/3636783163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6f810f4f0 0x7fb6f8119f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.054+0000 7fb6fd06a640 1 -- 172.21.15.22:0/3636783163 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f81a3730 con 0x7fb6f8109e80 2024-08-20T01:35:36.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.054+0000 7fb6fd06a640 1 --2- 172.21.15.22:0/3636783163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6f8109e80 0x7fb6f81194e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000ebc0 tx=0x7fb6f000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:36.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.057+0000 7fb6ee7fc640 1 -- 172.21.15.22:0/3636783163 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0010630 con 0x7fb6f8109e80 2024-08-20T01:35:36.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.057+0000 7fb6ff2ce640 1 -- 172.21.15.22:0/3636783163 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f81a3a20 con 0x7fb6f8109e80 2024-08-20T01:35:36.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.057+0000 7fb6ff2ce640 1 -- 172.21.15.22:0/3636783163 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f81a3fe0 con 0x7fb6f8109e80 2024-08-20T01:35:36.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.061+0000 7fb6ee7fc640 1 -- 172.21.15.22:0/3636783163 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6f0010c80 con 0x7fb6f8109e80 2024-08-20T01:35:36.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.061+0000 7fb6ee7fc640 1 -- 172.21.15.22:0/3636783163 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0018b00 con 0x7fb6f8109e80 2024-08-20T01:35:36.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.064+0000 7fb6ee7fc640 1 -- 172.21.15.22:0/3636783163 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb6f00173d0 con 0x7fb6f8109e80 2024-08-20T01:35:36.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.065+0000 7fb7016c7740 1 Processor -- start 2024-08-20T01:35:36.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.065+0000 7fb7016c7740 1 -- start start 2024-08-20T01:35:36.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.066+0000 7fb7016c7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e199880 0x55b40e199c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.067+0000 7fb7016c7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e19a1a0 0x55b40e1a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.067+0000 7fb7016c7740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e1a6130 0x55b40e1a8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.067+0000 7fb6fd86b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e199880 0x55b40e199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:36.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.067+0000 7fb6fd86b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e199880 0x55b40e199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:54922/0 (socket says 172.21.15.22:54922) 2024-08-20T01:35:36.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.067+0000 7fb7016c7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b40e110930 con 0x55b40e19a1a0 2024-08-20T01:35:36.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.067+0000 7fb7016c7740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b40e0ffe30 con 0x55b40e1a6130 2024-08-20T01:35:36.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.067+0000 7fb6ee7fc640 1 --2- 172.21.15.22:0/3636783163 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb6e40b3de0 0x7fb6e40b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.067+0000 7fb7016c7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b40e103e70 con 0x55b40e199880 2024-08-20T01:35:36.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.069+0000 7fb6ee7fc640 1 -- 172.21.15.22:0/3636783163 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb6f00e51f0 con 0x7fb6f8109e80 2024-08-20T01:35:36.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.069+0000 7fb6fd06a640 1 --2- 172.21.15.22:0/3631315403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e19a1a0 0x55b40e1a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:36.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.070+0000 7fb6fd06a640 1 -- 172.21.15.22:0/3631315403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e199880 msgr2=0x55b40e199c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:36.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.070+0000 7fb6fd06a640 1 --2- 172.21.15.22:0/3631315403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e199880 0x55b40e199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.070+0000 7fb6fd06a640 1 -- 172.21.15.22:0/3631315403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e1a6130 msgr2=0x55b40e1a8520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:35:36.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.070+0000 7fb6fd06a640 1 --2- 172.21.15.22:0/3631315403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e1a6130 0x55b40e1a8520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.070+0000 7fb6fd06a640 1 -- 172.21.15.22:0/3631315403 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b40de5f650 con 0x55b40e19a1a0 2024-08-20T01:35:36.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.071+0000 7fb6fd06a640 1 --2- 172.21.15.22:0/3631315403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e19a1a0 0x55b40e1a5bf0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00e2bf0 tx=0x7fb6f00ab9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbf7cf1964c614f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:36.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.071+0000 7fb6e37fe640 1 -- 172.21.15.22:0/3631315403 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f00abbb0 con 0x55b40e19a1a0 2024-08-20T01:35:36.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.071+0000 7fb6e37fe640 1 -- 172.21.15.22:0/3631315403 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6f00ac7a0 con 0x55b40e19a1a0 2024-08-20T01:35:36.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.068+0000 7fb6fd86b640 1 -- 172.21.15.22:0/3631315403 learned_addr learned my addr 172.21.15.22:0/3631315403 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:36.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.072+0000 7fb6fd86b640 1 --2- 172.21.15.22:0/3631315403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e199880 0x55b40e199c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-08-20T01:35:36.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.073+0000 7fb6fd86b640 1 --2- 172.21.15.22:0/3636783163 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb6e40b3de0 0x7fb6e40b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:36.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.077+0000 7fb7016c7740 1 -- 172.21.15.22:0/3631315403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e19a1a0 msgr2=0x55b40e1a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:36.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.077+0000 7fb7016c7740 1 --2- 172.21.15.22:0/3631315403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e19a1a0 0x55b40e1a5bf0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00e2bf0 tx=0x7fb6f00ab9f0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.077+0000 7fb6fd86b640 1 --2- 172.21.15.22:0/3636783163 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb6e40b3de0 0x7fb6e40b62a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80096c0 tx=0x7fb6e8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:36.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.078+0000 7fb7016c7740 1 -- 172.21.15.22:0/3631315403 shutdown_connections 2024-08-20T01:35:36.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.078+0000 7fb7016c7740 1 --2- 172.21.15.22:0/3631315403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e1a6130 0x55b40e1a8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.078+0000 7fb7016c7740 1 --2- 172.21.15.22:0/3631315403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e19a1a0 0x55b40e1a5bf0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.078+0000 7fb7016c7740 1 --2- 172.21.15.22:0/3631315403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e199880 0x55b40e199c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.078+0000 7fb7016c7740 1 -- 172.21.15.22:0/3631315403 >> 172.21.15.22:0/3631315403 conn(0x55b40e1976b0 msgr2=0x55b40e198850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:36.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.078+0000 7fb7016c7740 1 -- 172.21.15.22:0/3631315403 shutdown_connections 2024-08-20T01:35:36.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.078+0000 7fb7016c7740 1 -- 172.21.15.22:0/3631315403 wait complete. 2024-08-20T01:35:36.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.079+0000 7fb7016c7740 1 -- start start 2024-08-20T01:35:36.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.079+0000 7fb7016c7740 1 Processor -- start 2024-08-20T01:35:36.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.080+0000 7fb7016c7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e199880 0x55b40e1a5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.081+0000 7fb7016c7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e19a1a0 0x55b40e1a2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.081+0000 7fb6fd06a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e199880 0x55b40e1a5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:36.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.081+0000 7fb6fd06a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e199880 0x55b40e1a5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:54932/0 (socket says 172.21.15.22:54932) 2024-08-20T01:35:36.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.081+0000 7fb6fd06a640 1 -- 172.21.15.22:0/3311355359 learned_addr learned my addr 172.21.15.22:0/3311355359 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:36.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.082+0000 7fb6fc869640 1 --2- 172.21.15.22:0/3311355359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e19a1a0 0x55b40e1a2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:36.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.082+0000 7fb7016c7740 1 --2- 172.21.15.22:0/3311355359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e1a6130 0x55b40e1a3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.082+0000 7fb7016c7740 1 -- 172.21.15.22:0/3311355359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b40df62700 con 0x55b40e19a1a0 2024-08-20T01:35:36.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.082+0000 7fb7016c7740 1 -- 172.21.15.22:0/3311355359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b40e086810 con 0x55b40e1a6130 2024-08-20T01:35:36.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.082+0000 7fb7016c7740 1 -- 172.21.15.22:0/3311355359 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b40e1a8e30 con 0x55b40e199880 2024-08-20T01:35:36.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.083+0000 7fb6fd06a640 1 -- 172.21.15.22:0/3311355359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e1a6130 msgr2=0x55b40e1a3710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:35:36.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.083+0000 7fb6fd06a640 1 --2- 172.21.15.22:0/3311355359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e1a6130 0x55b40e1a3710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.083+0000 7fb6fd06a640 1 -- 172.21.15.22:0/3311355359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e19a1a0 msgr2=0x55b40e1a2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:36.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.083+0000 7fb6fd06a640 1 --2- 172.21.15.22:0/3311355359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e19a1a0 0x55b40e1a2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.083+0000 7fb6fd06a640 1 -- 172.21.15.22:0/3311355359 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b40e1b2240 con 0x55b40e199880 2024-08-20T01:35:36.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.084+0000 7fb6fd06a640 1 --2- 172.21.15.22:0/3311355359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e199880 0x55b40e1a5b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00b4d20 tx=0x7fb6f00ac8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f84e04b4b2f9cc28 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:36.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.083+0000 7fb7016c7740 10 client.0 _ll_register_callbacks cb 0x55b40e0f9700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:35:36.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.085+0000 7fb7016c7740 1 -- 172.21.15.22:0/3311355359 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b40e0af150 con 0x55b40e199880 2024-08-20T01:35:36.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.085+0000 7fb6e0ff9640 10 client.25684 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:35:36.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.085+0000 7fb6e0ff9640 1 -- 172.21.15.22:0/3311355359 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f00cb060 con 0x55b40e199880 2024-08-20T01:35:36.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.085+0000 7fb6e0ff9640 1 -- 172.21.15.22:0/3311355359 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb6f00cd280 con 0x55b40e199880 2024-08-20T01:35:36.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.086+0000 7fb6e0ff9640 1 -- 172.21.15.22:0/3311355359 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb6f00abbb0 con 0x55b40e199880 2024-08-20T01:35:36.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.090+0000 7fb7016c7740 10 client.25684 fetch_fsmap learned FSMap version 29 2024-08-20T01:35:36.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.090+0000 7fb7016c7740 1 -- 172.21.15.22:0/3311355359 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55b40e1b49a0 con 0x55b40e199880 2024-08-20T01:35:36.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.095+0000 7fb6e0ff9640 1 -- 172.21.15.22:0/3311355359 <== mon.1 v2:172.21.15.134:3300/0 4 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb6f00c6be0 con 0x55b40e199880 2024-08-20T01:35:36.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.103+0000 7fb7016c7740 10 client.25684 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:35:36.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.103+0000 7fb7016c7740 10 client.25684 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:35:36.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.103+0000 7fb7016c7740 20 client.25684 populate_metadata read hostname 'smithi022' 2024-08-20T01:35:36.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.103+0000 7fb7016c7740 1 --2- 172.21.15.22:0/3311355359 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55b40e1b5b20 0x55b40e1b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.103+0000 7fb7016c7740 4 client.25684 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:35:36.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.103+0000 7fb7016c7740 1 -- 172.21.15.22:0/3311355359 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b40e0af150 con 0x55b40e1b5b20 2024-08-20T01:35:36.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.104+0000 7fb6fc869640 1 --2- 172.21.15.22:0/3311355359 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55b40e1b5b20 0x55b40e1b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:36.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.111+0000 7fb6e0ff9640 10 client.25684 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:35:36.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.111+0000 7fb6fc869640 1 --2- 172.21.15.22:0/3311355359 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55b40e1b5b20 0x55b40e1b7f10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bfb3701bbc3f8dec server_cookie=abca95d4533dca55 in_seq=0 out_seq=0 2024-08-20T01:35:36.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.114+0000 7fb6e0ff9640 1 -- 172.21.15.22:0/3311355359 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b40e0af150 con 0x55b40e1b5b20 2024-08-20T01:35:36.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.114+0000 7fb6e0ff9640 10 client.25684 handle_command_reply: tid=0 2024-08-20T01:35:36.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.114+0000 7fb7016c7740 1 client.25684 shutdown 2024-08-20T01:35:36.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.114+0000 7fb7016c7740 1 -- 172.21.15.22:0/3311355359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e199880 msgr2=0x55b40e1a5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:36.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.114+0000 7fb7016c7740 1 --2- 172.21.15.22:0/3311355359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e199880 0x55b40e1a5b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00b4d20 tx=0x7fb6f00ac8e0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.114+0000 7fb7016c7740 1 -- 172.21.15.22:0/3311355359 shutdown_connections 2024-08-20T01:35:36.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.114+0000 7fb7016c7740 1 --2- 172.21.15.22:0/3311355359 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55b40e1b5b20 0x55b40e1b7f10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.114+0000 7fb7016c7740 1 --2- 172.21.15.22:0/3311355359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e1a6130 0x55b40e1a3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.114+0000 7fb7016c7740 1 --2- 172.21.15.22:0/3311355359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e19a1a0 0x55b40e1a2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.114+0000 7fb7016c7740 1 --2- 172.21.15.22:0/3311355359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e199880 0x55b40e1a5b30 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00b4d20 tx=0x7fb6f00ac8e0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.114+0000 7fb7016c7740 1 -- 172.21.15.22:0/3311355359 >> 172.21.15.22:0/3311355359 conn(0x55b40e1976b0 msgr2=0x55b40e19d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:36.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.115+0000 7fb6e0ff9640 0 client.25684 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:35:36.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.118+0000 7fb7016c7740 1 -- 172.21.15.22:0/3311355359 shutdown_connections 2024-08-20T01:35:36.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.120+0000 7fb7016c7740 1 -- 172.21.15.22:0/3311355359 wait complete. 2024-08-20T01:35:36.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.122+0000 7fb7016c7740 20 client.25684 trim_cache size 0 max 16384 2024-08-20T01:35:36.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.159+0000 7fb7016c7740 1 Processor -- start 2024-08-20T01:35:36.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.159+0000 7fb7016c7740 1 -- start start 2024-08-20T01:35:36.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.160+0000 7fb7016c7740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e19a1a0 0x55b40e1a27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.160+0000 7fb7016c7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e1a6130 0x55b40e1a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.160+0000 7fb7016c7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e1a01b0 0x55b40e1a0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.160+0000 7fb7016c7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc010fd0 con 0x55b40e1a6130 2024-08-20T01:35:36.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.160+0000 7fb7016c7740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc00e840 con 0x55b40e19a1a0 2024-08-20T01:35:36.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.160+0000 7fb7016c7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc00c690 con 0x55b40e1a01b0 2024-08-20T01:35:36.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.160+0000 7fb6fd06a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e19a1a0 0x55b40e1a27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:36.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.160+0000 7fb6fd06a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e19a1a0 0x55b40e1a27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:48252/0 (socket says 172.21.15.22:48252) 2024-08-20T01:35:36.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.160+0000 7fb6fd06a640 1 -- 172.21.15.22:0/739258667 learned_addr learned my addr 172.21.15.22:0/739258667 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:36.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.160+0000 7fb6fd86b640 1 --2- 172.21.15.22:0/739258667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e1a01b0 0x55b40e1a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:36.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.160+0000 7fb6fc869640 1 --2- 172.21.15.22:0/739258667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e1a6130 0x55b40e1a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:36.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.160+0000 7fb6fd06a640 1 -- 172.21.15.22:0/739258667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e1a01b0 msgr2=0x55b40e1a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:36.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.160+0000 7fb6fd06a640 1 --2- 172.21.15.22:0/739258667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e1a01b0 0x55b40e1a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.160+0000 7fb6fd06a640 1 -- 172.21.15.22:0/739258667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e1a6130 msgr2=0x55b40e1a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:36.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.160+0000 7fb6fd06a640 1 --2- 172.21.15.22:0/739258667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e1a6130 0x55b40e1a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.160+0000 7fb6fd06a640 1 -- 172.21.15.22:0/739258667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b40e199fd0 con 0x55b40e19a1a0 2024-08-20T01:35:36.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.162+0000 7fb6fd06a640 1 --2- 172.21.15.22:0/739258667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e19a1a0 0x55b40e1a27f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00abda0 tx=0x7fb6f00ce000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65b7dfcafead4243 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:36.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.163+0000 7fb6e2ffd640 1 -- 172.21.15.22:0/739258667 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f00cb070 con 0x55b40e19a1a0 2024-08-20T01:35:36.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.163+0000 7fb6e2ffd640 1 -- 172.21.15.22:0/739258667 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6f00cd2d0 con 0x55b40e19a1a0 2024-08-20T01:35:36.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.164+0000 7fb7016c7740 1 -- 172.21.15.22:0/739258667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e19a1a0 msgr2=0x55b40e1a27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:36.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.164+0000 7fb7016c7740 1 --2- 172.21.15.22:0/739258667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e19a1a0 0x55b40e1a27f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00abda0 tx=0x7fb6f00ce000 comp rx=0 tx=0).stop 2024-08-20T01:35:36.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.164+0000 7fb7016c7740 1 -- 172.21.15.22:0/739258667 shutdown_connections 2024-08-20T01:35:36.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.164+0000 7fb7016c7740 1 --2- 172.21.15.22:0/739258667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e1a01b0 0x55b40e1a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.164+0000 7fb7016c7740 1 --2- 172.21.15.22:0/739258667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e1a6130 0x55b40e1a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.164+0000 7fb7016c7740 1 --2- 172.21.15.22:0/739258667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e19a1a0 0x55b40e1a27f0 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00abda0 tx=0x7fb6f00ce000 comp rx=0 tx=0).stop 2024-08-20T01:35:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.164+0000 7fb7016c7740 1 -- 172.21.15.22:0/739258667 >> 172.21.15.22:0/739258667 conn(0x55b40e1976b0 msgr2=0x55b40e1a1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.164+0000 7fb7016c7740 1 -- 172.21.15.22:0/739258667 shutdown_connections 2024-08-20T01:35:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.164+0000 7fb7016c7740 1 -- 172.21.15.22:0/739258667 wait complete. 2024-08-20T01:35:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.165+0000 7fb7016c7740 1 -- start start 2024-08-20T01:35:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.165+0000 7fb7016c7740 1 Processor -- start 2024-08-20T01:35:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.168+0000 7fb7016c7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e1a01b0 0x55b40e1bafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.168+0000 7fb7016c7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e1a6130 0x55b40e1a6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.168+0000 7fb7016c7740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e1a72d0 0x55b40e1a7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.168+0000 7fb7016c7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc00cd00 con 0x55b40e1a01b0 2024-08-20T01:35:36.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.168+0000 7fb7016c7740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc00e170 con 0x55b40e1a72d0 2024-08-20T01:35:36.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.168+0000 7fb7016c7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc00d3d0 con 0x55b40e1a6130 2024-08-20T01:35:36.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.168+0000 7fb7016c7740 10 client.0 _ll_register_callbacks cb 0x7fb6f00ac7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:35:36.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.169+0000 7fb6fc869640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e1a6130 0x55b40e1a6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:36.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.169+0000 7fb6fc869640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e1a6130 0x55b40e1a6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:54948/0 (socket says 172.21.15.22:54948) 2024-08-20T01:35:36.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.169+0000 7fb6fc869640 1 -- 172.21.15.22:0/3191115963 learned_addr learned my addr 172.21.15.22:0/3191115963 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:36.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.169+0000 7fb6fd86b640 1 --2- 172.21.15.22:0/3191115963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e1a72d0 0x55b40e1a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:36.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.169+0000 7fb6fd06a640 1 --2- 172.21.15.22:0/3191115963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e1a01b0 0x55b40e1bafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:36.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.170+0000 7fb6fd86b640 1 -- 172.21.15.22:0/3191115963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e1a6130 msgr2=0x55b40e1a6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:36.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.170+0000 7fb6fd86b640 1 --2- 172.21.15.22:0/3191115963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e1a6130 0x55b40e1a6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.170+0000 7fb6fd86b640 1 -- 172.21.15.22:0/3191115963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e1a01b0 msgr2=0x55b40e1bafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:36.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.170+0000 7fb6fd86b640 1 --2- 172.21.15.22:0/3191115963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e1a01b0 0x55b40e1bafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.170+0000 7fb6fd86b640 1 -- 172.21.15.22:0/3191115963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b40e21f450 con 0x55b40e1a72d0 2024-08-20T01:35:36.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.173+0000 7fb6fd86b640 1 --2- 172.21.15.22:0/3191115963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e1a72d0 0x55b40e1a7750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8009230 tx=0x7fb6e8031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78068c378ba6b1e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:36.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.173+0000 7fb6e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:35:36.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.173+0000 7fb6e0ff9640 1 -- 172.21.15.22:0/3191115963 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e803f040 con 0x55b40e1a72d0 2024-08-20T01:35:36.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.173+0000 7fb7016c7740 1 -- 172.21.15.22:0/3191115963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b40e192880 con 0x55b40e1a72d0 2024-08-20T01:35:36.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.173+0000 7fb6e0ff9640 1 -- 172.21.15.22:0/3191115963 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb6e8004d90 con 0x55b40e1a72d0 2024-08-20T01:35:36.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.174+0000 7fb6e0ff9640 1 -- 172.21.15.22:0/3191115963 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb6e8035040 con 0x55b40e1a72d0 2024-08-20T01:35:36.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.174+0000 7fb7016c7740 10 client.25667 fetch_fsmap learned FSMap version 29 2024-08-20T01:35:36.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.175+0000 7fb7016c7740 1 -- 172.21.15.22:0/3191115963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b40e220630 con 0x55b40e1a72d0 2024-08-20T01:35:36.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.175+0000 7fb6e0ff9640 1 -- 172.21.15.22:0/3191115963 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b40e192880 con 0x55b40e1a72d0 2024-08-20T01:35:36.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.177+0000 7fb6e0ff9640 1 -- 172.21.15.22:0/3191115963 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb6e8031780 con 0x55b40e1a72d0 2024-08-20T01:35:36.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.177+0000 7fb7016c7740 10 client.25667 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:35:36.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.177+0000 7fb7016c7740 10 client.25667 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:35:36.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.177+0000 7fb7016c7740 20 client.25667 populate_metadata read hostname 'smithi022' 2024-08-20T01:35:36.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.177+0000 7fb7016c7740 1 --2- 172.21.15.22:0/3191115963 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55b40e220e40 0x55b40e223260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.177+0000 7fb7016c7740 4 client.25667 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:35:36.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.177+0000 7fb7016c7740 1 -- 172.21.15.22:0/3191115963 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b40e112880 con 0x55b40e220e40 2024-08-20T01:35:36.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.178+0000 7fb6fd06a640 1 --2- 172.21.15.22:0/3191115963 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55b40e220e40 0x55b40e223260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:36.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.179+0000 7fb6fd06a640 1 --2- 172.21.15.22:0/3191115963 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55b40e220e40 0x55b40e223260 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9bfd2544a141807f server_cookie=af86e854c5e4e59 in_seq=0 out_seq=0 2024-08-20T01:35:36.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.179+0000 7fb6e0ff9640 10 client.25667 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:35:36.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.180+0000 7fb6e0ff9640 1 -- 172.21.15.22:0/3191115963 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b40e112880 con 0x55b40e220e40 2024-08-20T01:35:36.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.180+0000 7fb6e0ff9640 10 client.25667 handle_command_reply: tid=0 2024-08-20T01:35:36.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.180+0000 7fb7016c7740 1 client.25667 shutdown 2024-08-20T01:35:36.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.191+0000 7fb7016c7740 1 -- 172.21.15.22:0/3191115963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e1a72d0 msgr2=0x55b40e1a7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:36.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.191+0000 7fb7016c7740 1 --2- 172.21.15.22:0/3191115963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e1a72d0 0x55b40e1a7750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8009230 tx=0x7fb6e8031400 comp rx=0 tx=0).stop 2024-08-20T01:35:36.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.191+0000 7fb7016c7740 1 -- 172.21.15.22:0/3191115963 shutdown_connections 2024-08-20T01:35:36.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.191+0000 7fb7016c7740 1 --2- 172.21.15.22:0/3191115963 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55b40e220e40 0x55b40e223260 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.191+0000 7fb7016c7740 1 --2- 172.21.15.22:0/3191115963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b40e1a72d0 0x55b40e1a7750 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.191+0000 7fb7016c7740 1 --2- 172.21.15.22:0/3191115963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b40e1a6130 0x55b40e1a6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.191+0000 7fb7016c7740 1 --2- 172.21.15.22:0/3191115963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b40e1a01b0 0x55b40e1bafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.191+0000 7fb7016c7740 1 -- 172.21.15.22:0/3191115963 >> 172.21.15.22:0/3191115963 conn(0x55b40e1976b0 msgr2=0x55b40e195f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:36.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.191+0000 7fb6e0ff9640 0 client.25667 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:35:36.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.191+0000 7fb7016c7740 1 -- 172.21.15.22:0/3191115963 shutdown_connections 2024-08-20T01:35:36.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.196+0000 7fb7016c7740 1 -- 172.21.15.22:0/3191115963 wait complete. 2024-08-20T01:35:36.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.196+0000 7fb7016c7740 20 client.25667 trim_cache size 0 max 16384 2024-08-20T01:35:36.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.197+0000 7fb6ff2ce640 1 -- 172.21.15.22:0/3636783163 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb6e40b3de0 msgr2=0x7fb6e40b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:36.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.197+0000 7fb6ff2ce640 1 --2- 172.21.15.22:0/3636783163 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb6e40b3de0 0x7fb6e40b62a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80096c0 tx=0x7fb6e8009260 comp rx=0 tx=0).stop 2024-08-20T01:35:36.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.197+0000 7fb6ff2ce640 1 -- 172.21.15.22:0/3636783163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6f8109e80 msgr2=0x7fb6f81194e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:36.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.197+0000 7fb6ff2ce640 1 --2- 172.21.15.22:0/3636783163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6f8109e80 0x7fb6f81194e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000ebc0 tx=0x7fb6f000c6a0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.201+0000 7fb6ff2ce640 1 -- 172.21.15.22:0/3636783163 shutdown_connections 2024-08-20T01:35:36.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.201+0000 7fb6ff2ce640 1 --2- 172.21.15.22:0/3636783163 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb6e40b3de0 0x7fb6e40b62a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.201+0000 7fb6ff2ce640 1 --2- 172.21.15.22:0/3636783163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6f810f4f0 0x7fb6f8119f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.201+0000 7fb6ff2ce640 1 --2- 172.21.15.22:0/3636783163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6f810a7a0 0x7fb6f8119a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.201+0000 7fb6ff2ce640 1 --2- 172.21.15.22:0/3636783163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6f8109e80 0x7fb6f81194e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.201+0000 7fb6ff2ce640 1 -- 172.21.15.22:0/3636783163 >> 172.21.15.22:0/3636783163 conn(0x7fb6f806dfe0 msgr2=0x7fb6f810cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:36.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.202+0000 7fb6ff2ce640 1 -- 172.21.15.22:0/3636783163 shutdown_connections 2024-08-20T01:35:36.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:36.206+0000 7fb6ff2ce640 1 -- 172.21.15.22:0/3636783163 wait complete. 2024-08-20T01:35:37.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:36 smithi022 ceph-mon[18709]: pgmap v480: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.7 MiB/s wr, 659 op/s 2024-08-20T01:35:37.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:36 smithi134 ceph-mon[22511]: pgmap v480: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.7 MiB/s wr, 659 op/s 2024-08-20T01:35:37.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:36 smithi077 ceph-mon[22251]: pgmap v480: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.7 MiB/s wr, 659 op/s 2024-08-20T01:35:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.862+0000 7f4ceab6a640 1 -- 172.21.15.22:0/3263825748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ce410aa30 msgr2=0x7f4ce4073b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.862+0000 7f4ceab6a640 1 --2- 172.21.15.22:0/3263825748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ce410aa30 0x7f4ce4073b40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009ca0 tx=0x7f4cdc02a8f0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.879+0000 7f4ceab6a640 1 -- 172.21.15.22:0/3263825748 shutdown_connections 2024-08-20T01:35:37.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.879+0000 7f4ceab6a640 1 --2- 172.21.15.22:0/3263825748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce4074230 0x7f4ce4119dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.879+0000 7f4ceab6a640 1 --2- 172.21.15.22:0/3263825748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ce410aa30 0x7f4ce4073b40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.879+0000 7f4ceab6a640 1 --2- 172.21.15.22:0/3263825748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce410a0f0 0x7f4ce410a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.879+0000 7f4ceab6a640 1 -- 172.21.15.22:0/3263825748 >> 172.21.15.22:0/3263825748 conn(0x7f4ce406f580 msgr2=0x7f4ce40719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.879+0000 7f4ceab6a640 1 -- 172.21.15.22:0/3263825748 shutdown_connections 2024-08-20T01:35:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.879+0000 7f4ceab6a640 1 -- 172.21.15.22:0/3263825748 wait complete. 2024-08-20T01:35:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.880+0000 7f4ceab6a640 1 Processor -- start 2024-08-20T01:35:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.880+0000 7f4ceab6a640 1 -- start start 2024-08-20T01:35:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.881+0000 7f4ceab6a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ce4074230 0x7f4ce41a7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.881+0000 7f4ceab6a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce410a0f0 0x7f4ce41a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.881+0000 7f4ceab6a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce410aa30 0x7f4ce41a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.881+0000 7f4ceab6a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce411cf30 con 0x7f4ce4074230 2024-08-20T01:35:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.881+0000 7f4ceab6a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce411cdb0 con 0x7f4ce410a0f0 2024-08-20T01:35:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.881+0000 7f4ceab6a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce411d0b0 con 0x7f4ce410aa30 2024-08-20T01:35:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.881+0000 7f4ce3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce410a0f0 0x7f4ce41a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.881+0000 7f4ce3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce410a0f0 0x7f4ce41a7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:48292/0 (socket says 172.21.15.22:48292) 2024-08-20T01:35:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.881+0000 7f4ce3fff640 1 -- 172.21.15.22:0/4044922968 learned_addr learned my addr 172.21.15.22:0/4044922968 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.882+0000 7f4ce3fff640 1 -- 172.21.15.22:0/4044922968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce410aa30 msgr2=0x7f4ce41a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.882+0000 7f4ce3fff640 1 --2- 172.21.15.22:0/4044922968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce410aa30 0x7f4ce41a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.882+0000 7f4ce3fff640 1 -- 172.21.15.22:0/4044922968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ce4074230 msgr2=0x7f4ce41a7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.882+0000 7f4ce3fff640 1 --2- 172.21.15.22:0/4044922968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ce4074230 0x7f4ce41a7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.882+0000 7f4ce3fff640 1 -- 172.21.15.22:0/4044922968 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce41a9190 con 0x7f4ce410a0f0 2024-08-20T01:35:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.882+0000 7f4ce3fff640 1 --2- 172.21.15.22:0/4044922968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce410a0f0 0x7f4ce41a7ca0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc031b50 tx=0x7f4cdc003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.904+0000 7f4ce1ffb640 1 -- 172.21.15.22:0/4044922968 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc004610 con 0x7f4ce410a0f0 2024-08-20T01:35:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.904+0000 7f4ceab6a640 1 -- 172.21.15.22:0/4044922968 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce41a9420 con 0x7f4ce410a0f0 2024-08-20T01:35:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.904+0000 7f4ceab6a640 1 -- 172.21.15.22:0/4044922968 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce4111790 con 0x7f4ce410a0f0 2024-08-20T01:35:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.908+0000 7f4ceda39740 1 Processor -- start 2024-08-20T01:35:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.909+0000 7f4ceda39740 1 -- start start 2024-08-20T01:35:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.909+0000 7f4ceda39740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e351026a20 0x55e351028e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.909+0000 7f4ceda39740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351029350 0x55e35102b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.909+0000 7f4ceda39740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e35102bd90 0x55e35102e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.909+0000 7f4ceda39740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e350f99360 con 0x55e351026a20 2024-08-20T01:35:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.909+0000 7f4ceda39740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e350f88860 con 0x55e351029350 2024-08-20T01:35:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.909+0000 7f4ceda39740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e350f8c8a0 con 0x55e35102bd90 2024-08-20T01:35:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.910+0000 7f4ce1ffb640 1 -- 172.21.15.22:0/4044922968 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cdc040070 con 0x7f4ce410a0f0 2024-08-20T01:35:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.910+0000 7f4ce1ffb640 1 -- 172.21.15.22:0/4044922968 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc030a80 con 0x7f4ce410a0f0 2024-08-20T01:35:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.911+0000 7f4ce9107640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e351026a20 0x55e351028e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.911+0000 7f4ce9107640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e351026a20 0x55e351028e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35850/0 (socket says 172.21.15.22:35850) 2024-08-20T01:35:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.911+0000 7f4ce9107640 1 -- 172.21.15.22:0/2864133251 learned_addr learned my addr 172.21.15.22:0/2864133251 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.912+0000 7f4ce3fff640 1 --2- 172.21.15.22:0/2864133251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e35102bd90 0x55e35102e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.912+0000 7f4ce8906640 1 --2- 172.21.15.22:0/2864133251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351029350 0x55e35102b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.913+0000 7f4ce3fff640 1 -- 172.21.15.22:0/2864133251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351029350 msgr2=0x55e35102b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.913+0000 7f4ce3fff640 1 --2- 172.21.15.22:0/2864133251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351029350 0x55e35102b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.913+0000 7f4ce3fff640 1 -- 172.21.15.22:0/2864133251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e351026a20 msgr2=0x55e351028e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.913+0000 7f4ce3fff640 1 --2- 172.21.15.22:0/2864133251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e351026a20 0x55e351028e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.913+0000 7f4ce3fff640 1 -- 172.21.15.22:0/2864133251 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e350f2fe40 con 0x55e35102bd90 2024-08-20T01:35:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.913+0000 7f4ce3fff640 1 --2- 172.21.15.22:0/2864133251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e35102bd90 0x55e35102e250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc1046c0 tx=0x7f4cdc10ac60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34f06630d1c956c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.915+0000 7f4ce1ffb640 1 -- 172.21.15.22:0/4044922968 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4cdc030ca0 con 0x7f4ce410a0f0 2024-08-20T01:35:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.916+0000 7f4ce1ffb640 1 --2- 172.21.15.22:0/4044922968 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4ccc0b3dd0 0x7f4ccc0b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.917+0000 7f4ce1ffb640 1 -- 172.21.15.22:0/4044922968 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f4cdc106cc0 con 0x7f4ce410a0f0 2024-08-20T01:35:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.920+0000 7f4ce9107640 1 --2- 172.21.15.22:0/4044922968 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4ccc0b3dd0 0x7f4ccc0b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.932+0000 7f4ce9107640 1 --2- 172.21.15.22:0/4044922968 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4ccc0b3dd0 0x7f4ccc0b6290 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400aab0 tx=0x7f4cd4005e90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.944+0000 7f4cd2ffd640 1 -- 172.21.15.22:0/2864133251 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc10fa10 con 0x55e35102bd90 2024-08-20T01:35:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.944+0000 7f4cd2ffd640 1 -- 172.21.15.22:0/2864133251 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cdc118070 con 0x55e35102bd90 2024-08-20T01:35:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.945+0000 7f4ceda39740 1 -- 172.21.15.22:0/2864133251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e35102bd90 msgr2=0x55e35102e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.945+0000 7f4ceda39740 1 --2- 172.21.15.22:0/2864133251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e35102bd90 0x55e35102e250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc1046c0 tx=0x7f4cdc10ac60 comp rx=0 tx=0).stop 2024-08-20T01:35:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.946+0000 7f4ceda39740 1 -- 172.21.15.22:0/2864133251 shutdown_connections 2024-08-20T01:35:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.946+0000 7f4ceda39740 1 --2- 172.21.15.22:0/2864133251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e35102bd90 0x55e35102e250 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.946+0000 7f4ceda39740 1 --2- 172.21.15.22:0/2864133251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351029350 0x55e35102b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.946+0000 7f4ceda39740 1 --2- 172.21.15.22:0/2864133251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e351026a20 0x55e351028e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.946+0000 7f4ceda39740 1 -- 172.21.15.22:0/2864133251 >> 172.21.15.22:0/2864133251 conn(0x55e351021b70 msgr2=0x55e351022900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.948+0000 7f4ceda39740 1 -- 172.21.15.22:0/2864133251 shutdown_connections 2024-08-20T01:35:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.948+0000 7f4ceda39740 1 -- 172.21.15.22:0/2864133251 wait complete. 2024-08-20T01:35:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.948+0000 7f4ceda39740 1 -- start start 2024-08-20T01:35:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.949+0000 7f4ceda39740 1 Processor -- start 2024-08-20T01:35:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.949+0000 7f4ceda39740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351026a20 0x55e35102fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.949+0000 7f4ceda39740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e351029350 0x55e3510303d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.949+0000 7f4ceda39740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e35102bd90 0x55e351030fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.949+0000 7f4ceda39740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e350ec1ab0 con 0x55e35102bd90 2024-08-20T01:35:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.949+0000 7f4ceda39740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e350f0f780 con 0x55e351026a20 2024-08-20T01:35:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.949+0000 7f4ceda39740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e350f8c8a0 con 0x55e351029350 2024-08-20T01:35:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.949+0000 7f4ceda39740 10 client.0 _ll_register_callbacks cb 0x55e350c97a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:35:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.950+0000 7f4ce3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e351029350 0x55e3510303d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.950+0000 7f4ce3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e351029350 0x55e3510303d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:54988/0 (socket says 172.21.15.22:54988) 2024-08-20T01:35:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.950+0000 7f4ce3fff640 1 -- 172.21.15.22:0/3526438127 learned_addr learned my addr 172.21.15.22:0/3526438127 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.950+0000 7f4ce8906640 1 --2- 172.21.15.22:0/3526438127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351026a20 0x55e35102fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.950+0000 7f4ce9107640 1 --2- 172.21.15.22:0/3526438127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e35102bd90 0x55e351030fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.950+0000 7f4ce3fff640 1 -- 172.21.15.22:0/3526438127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351026a20 msgr2=0x55e35102fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.950+0000 7f4ce3fff640 1 --2- 172.21.15.22:0/3526438127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351026a20 0x55e35102fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.950+0000 7f4ce3fff640 1 -- 172.21.15.22:0/3526438127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e35102bd90 msgr2=0x55e351030fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.950+0000 7f4ce3fff640 1 --2- 172.21.15.22:0/3526438127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e35102bd90 0x55e351030fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.950+0000 7f4ce3fff640 1 -- 172.21.15.22:0/3526438127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e350ceb790 con 0x55e351029350 2024-08-20T01:35:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.951+0000 7f4ce3fff640 1 --2- 172.21.15.22:0/3526438127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e351029350 0x55e3510303d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc006010 tx=0x7f4cdc02aff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb99d7247393b244 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:37.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.976+0000 7f4cc7fff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:35:37.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.976+0000 7f4cc7fff640 1 -- 172.21.15.22:0/3526438127 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc0c9a30 con 0x55e351029350 2024-08-20T01:35:37.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.976+0000 7f4ceda39740 1 -- 172.21.15.22:0/3526438127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e350f37e00 con 0x55e351029350 2024-08-20T01:35:37.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.976+0000 7f4cc7fff640 1 -- 172.21.15.22:0/3526438127 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f4cdc104830 con 0x55e351029350 2024-08-20T01:35:37.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.977+0000 7f4cc7fff640 1 -- 172.21.15.22:0/3526438127 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4cdc02f340 con 0x55e351029350 2024-08-20T01:35:37.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.977+0000 7f4ceda39740 10 client.25696 fetch_fsmap learned FSMap version 29 2024-08-20T01:35:37.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.977+0000 7f4ceda39740 1 -- 172.21.15.22:0/3526438127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e350d64620 con 0x55e351029350 2024-08-20T01:35:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.980+0000 7f4cc7fff640 1 -- 172.21.15.22:0/3526438127 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e350f37e00 con 0x55e351029350 2024-08-20T01:35:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.980+0000 7f4cc7fff640 1 -- 172.21.15.22:0/3526438127 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4cdc04d070 con 0x55e351029350 2024-08-20T01:35:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.980+0000 7f4ceda39740 10 client.25696 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:35:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.980+0000 7f4ceda39740 10 client.25696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:35:37.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.980+0000 7f4ceda39740 20 client.25696 populate_metadata read hostname 'smithi022' 2024-08-20T01:35:37.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.980+0000 7f4ceda39740 1 --2- 172.21.15.22:0/3526438127 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e35103b670 0x55e35103dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.980+0000 7f4ceda39740 4 client.25696 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:35:37.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.980+0000 7f4ceda39740 1 -- 172.21.15.22:0/3526438127 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e350f9b2b0 con 0x55e35103b670 2024-08-20T01:35:37.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.980+0000 7f4ce8906640 1 --2- 172.21.15.22:0/3526438127 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e35103b670 0x55e35103dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:37.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.982+0000 7f4ce8906640 1 --2- 172.21.15.22:0/3526438127 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e35103b670 0x55e35103dab0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3f48693658fcb0a server_cookie=5690b3c791d46d8f in_seq=0 out_seq=0 2024-08-20T01:35:37.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.982+0000 7f4cc7fff640 10 client.25696 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.987+0000 7f4cc7fff640 1 -- 172.21.15.22:0/3526438127 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e350f9b2b0 con 0x55e35103b670 2024-08-20T01:35:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.987+0000 7f4cc7fff640 10 client.25696 handle_command_reply: tid=0 2024-08-20T01:35:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.987+0000 7f4ceda39740 1 client.25696 shutdown 2024-08-20T01:35:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.998+0000 7f4ceda39740 1 -- 172.21.15.22:0/3526438127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e351029350 msgr2=0x55e3510303d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.998+0000 7f4ceda39740 1 --2- 172.21.15.22:0/3526438127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e351029350 0x55e3510303d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc006010 tx=0x7f4cdc02aff0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.998+0000 7f4ceda39740 1 -- 172.21.15.22:0/3526438127 shutdown_connections 2024-08-20T01:35:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.998+0000 7f4ceda39740 1 --2- 172.21.15.22:0/3526438127 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e35103b670 0x55e35103dab0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.998+0000 7f4ceda39740 1 --2- 172.21.15.22:0/3526438127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e35102bd90 0x55e351030fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.998+0000 7f4ceda39740 1 --2- 172.21.15.22:0/3526438127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e351029350 0x55e3510303d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.998+0000 7f4ceda39740 1 --2- 172.21.15.22:0/3526438127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351026a20 0x55e35102fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.998+0000 7f4ceda39740 1 -- 172.21.15.22:0/3526438127 >> 172.21.15.22:0/3526438127 conn(0x55e351021b70 msgr2=0x55e351020c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.998+0000 7f4cc7fff640 0 client.25696 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.999+0000 7f4ceda39740 1 -- 172.21.15.22:0/3526438127 shutdown_connections 2024-08-20T01:35:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.999+0000 7f4ceda39740 1 -- 172.21.15.22:0/3526438127 wait complete. 2024-08-20T01:35:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:37.999+0000 7f4ceda39740 20 client.25696 trim_cache size 0 max 16384 2024-08-20T01:35:38.073 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:35:38.214 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.213+0000 7f4ceda39740 1 Processor -- start 2024-08-20T01:35:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.217+0000 7f4ceda39740 1 -- start start 2024-08-20T01:35:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.218+0000 7f4ceda39740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351026a20 0x55e35101c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.218+0000 7f4ceda39740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e351029350 0x55e351025d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.218+0000 7f4ce8906640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351026a20 0x55e35101c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.218+0000 7f4ce8906640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351026a20 0x55e35101c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:48322/0 (socket says 172.21.15.22:48322) 2024-08-20T01:35:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.218+0000 7f4ce3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e351029350 0x55e351025d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.219+0000 7f4ceda39740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e35102bd90 0x55e351026290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.219+0000 7f4ce8906640 1 -- 172.21.15.22:0/1377554622 learned_addr learned my addr 172.21.15.22:0/1377554622 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.219+0000 7f4ceda39740 1 -- 172.21.15.22:0/1377554622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8011000 con 0x55e351029350 2024-08-20T01:35:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.219+0000 7f4ceda39740 1 -- 172.21.15.22:0/1377554622 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc800e870 con 0x55e351026a20 2024-08-20T01:35:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.219+0000 7f4ceda39740 1 -- 172.21.15.22:0/1377554622 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc800c6c0 con 0x55e35102bd90 2024-08-20T01:35:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.219+0000 7f4ce9107640 1 --2- 172.21.15.22:0/1377554622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e35102bd90 0x55e351026290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.219+0000 7f4ce8906640 1 -- 172.21.15.22:0/1377554622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e35102bd90 msgr2=0x55e351026290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.219+0000 7f4ce8906640 1 --2- 172.21.15.22:0/1377554622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e35102bd90 0x55e351026290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.219+0000 7f4ce8906640 1 -- 172.21.15.22:0/1377554622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e351029350 msgr2=0x55e351025d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.219+0000 7f4ce8906640 1 --2- 172.21.15.22:0/1377554622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e351029350 0x55e351025d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.219+0000 7f4ce8906640 1 -- 172.21.15.22:0/1377554622 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e35101d1a0 con 0x55e351026a20 2024-08-20T01:35:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.219+0000 7f4ce8906640 1 --2- 172.21.15.22:0/1377554622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351026a20 0x55e35101c9d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55e35103e320 tx=0x7f4cd800a2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95a2db4f174f36de server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.229+0000 7f4cd27fc640 1 -- 172.21.15.22:0/1377554622 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8013110 con 0x55e351026a20 2024-08-20T01:35:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.230+0000 7f4cd27fc640 1 -- 172.21.15.22:0/1377554622 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cd80132b0 con 0x55e351026a20 2024-08-20T01:35:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.230+0000 7f4cd27fc640 1 -- 172.21.15.22:0/1377554622 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd801a350 con 0x55e351026a20 2024-08-20T01:35:38.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.232+0000 7f4ceda39740 1 -- 172.21.15.22:0/1377554622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351026a20 msgr2=0x55e35101c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:38.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.232+0000 7f4ceda39740 1 --2- 172.21.15.22:0/1377554622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351026a20 0x55e35101c9d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55e35103e320 tx=0x7f4cd800a2c0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.259+0000 7f4ceda39740 1 -- 172.21.15.22:0/1377554622 shutdown_connections 2024-08-20T01:35:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.259+0000 7f4ceda39740 1 --2- 172.21.15.22:0/1377554622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e35102bd90 0x55e351026290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.259+0000 7f4ceda39740 1 --2- 172.21.15.22:0/1377554622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e351029350 0x55e351025d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.259+0000 7f4ceda39740 1 --2- 172.21.15.22:0/1377554622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351026a20 0x55e35101c9d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.259+0000 7f4ceda39740 1 -- 172.21.15.22:0/1377554622 >> 172.21.15.22:0/1377554622 conn(0x55e351021b70 msgr2=0x55e35102fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.259+0000 7f4ceda39740 1 -- 172.21.15.22:0/1377554622 shutdown_connections 2024-08-20T01:35:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.259+0000 7f4ceda39740 1 -- 172.21.15.22:0/1377554622 wait complete. 2024-08-20T01:35:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.260+0000 7f4ceda39740 1 -- start start 2024-08-20T01:35:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.260+0000 7f4ceda39740 1 Processor -- start 2024-08-20T01:35:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.261+0000 7f4ceda39740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351026a20 0x55e3510349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.261+0000 7f4ceda39740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e351029350 0x55e351035060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.261+0000 7f4ce8906640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351026a20 0x55e3510349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.261+0000 7f4ce8906640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351026a20 0x55e3510349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:48328/0 (socket says 172.21.15.22:48328) 2024-08-20T01:35:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.261+0000 7f4ce8906640 1 -- 172.21.15.22:0/1044442772 learned_addr learned my addr 172.21.15.22:0/1044442772 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.262+0000 7f4ce3fff640 1 --2- 172.21.15.22:0/1044442772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e351029350 0x55e351035060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.262+0000 7f4ceda39740 1 --2- 172.21.15.22:0/1044442772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e35102bd90 0x55e351035c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.262+0000 7f4ceda39740 1 -- 172.21.15.22:0/1044442772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc800cd30 con 0x55e35102bd90 2024-08-20T01:35:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.262+0000 7f4ceda39740 1 -- 172.21.15.22:0/1044442772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc800e1a0 con 0x55e351026a20 2024-08-20T01:35:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.262+0000 7f4ceda39740 1 -- 172.21.15.22:0/1044442772 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc800d400 con 0x55e351029350 2024-08-20T01:35:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.262+0000 7f4ceda39740 10 client.0 _ll_register_callbacks cb 0x7f4cd8005e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:35:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.262+0000 7f4ce3fff640 1 -- 172.21.15.22:0/1044442772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351026a20 msgr2=0x55e3510349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.262+0000 7f4ce3fff640 1 --2- 172.21.15.22:0/1044442772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351026a20 0x55e3510349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.262+0000 7f4ce9107640 1 --2- 172.21.15.22:0/1044442772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e35102bd90 0x55e351035c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.262+0000 7f4ce3fff640 1 -- 172.21.15.22:0/1044442772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e35102bd90 msgr2=0x55e351035c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.262+0000 7f4ce3fff640 1 --2- 172.21.15.22:0/1044442772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e35102bd90 0x55e351035c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.262+0000 7f4ce3fff640 1 -- 172.21.15.22:0/1044442772 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e351031310 con 0x55e351029350 2024-08-20T01:35:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.262+0000 7f4ce9107640 1 --2- 172.21.15.22:0/1044442772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e35102bd90 0x55e351035c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.263+0000 7f4ce3fff640 1 --2- 172.21.15.22:0/1044442772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e351029350 0x55e351035060 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009dc0 tx=0x7f4cdc030f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab7cfd1d87aa001f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:38.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.272+0000 7f4cc7fff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:35:38.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.272+0000 7f4cc7fff640 1 -- 172.21.15.22:0/1044442772 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc10a040 con 0x55e351029350 2024-08-20T01:35:38.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.272+0000 7f4ceda39740 1 -- 172.21.15.22:0/1044442772 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cd80132b0 con 0x55e351029350 2024-08-20T01:35:38.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.272+0000 7f4cc7fff640 1 -- 172.21.15.22:0/1044442772 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f4cdc02fc10 con 0x55e351029350 2024-08-20T01:35:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.272+0000 7f4cc7fff640 1 -- 172.21.15.22:0/1044442772 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4cdc0cd2e0 con 0x55e351029350 2024-08-20T01:35:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.272+0000 7f4ceda39740 10 client.25702 fetch_fsmap learned FSMap version 29 2024-08-20T01:35:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.272+0000 7f4ceda39740 1 -- 172.21.15.22:0/1044442772 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e351031310 con 0x55e351029350 2024-08-20T01:35:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.274+0000 7f4cc7fff640 1 -- 172.21.15.22:0/1044442772 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cd80132b0 con 0x55e351029350 2024-08-20T01:35:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.275+0000 7f4cc7fff640 1 -- 172.21.15.22:0/1044442772 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4cdc04d070 con 0x55e351029350 2024-08-20T01:35:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.275+0000 7f4ceda39740 10 client.25702 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:35:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.275+0000 7f4ceda39740 10 client.25702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:35:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.275+0000 7f4ceda39740 20 client.25702 populate_metadata read hostname 'smithi022' 2024-08-20T01:35:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.275+0000 7f4ceda39740 1 --2- 172.21.15.22:0/1044442772 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e3510a6350 0x55e3510a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.275+0000 7f4ceda39740 4 client.25702 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:35:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.275+0000 7f4ceda39740 1 -- 172.21.15.22:0/1044442772 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e350f96d50 con 0x55e3510a6350 2024-08-20T01:35:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.276+0000 7f4ce8906640 1 --2- 172.21.15.22:0/1044442772 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e3510a6350 0x55e3510a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.278+0000 7f4ce8906640 1 --2- 172.21.15.22:0/1044442772 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e3510a6350 0x55e3510a8740 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0b23ccea8a5f137 server_cookie=c3b055cfcce555b2 in_seq=0 out_seq=0 2024-08-20T01:35:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:38.286+0000 7f4cc7fff640 10 client.25702 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:39.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:38 smithi022 ceph-mon[18709]: pgmap v481: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 18 MiB/s wr, 1.09k op/s 2024-08-20T01:35:39.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:38 smithi134 ceph-mon[22511]: pgmap v481: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 18 MiB/s wr, 1.09k op/s 2024-08-20T01:35:39.557 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:38 smithi077 ceph-mon[22251]: pgmap v481: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 18 MiB/s wr, 1.09k op/s 2024-08-20T01:35:40.033 INFO:tasks.workunit.client.0.smithi022.stdout: 433 1627981 907 1128775 1081 592509 1907 2024-08-20T01:35:41.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:40 smithi022 ceph-mon[18709]: pgmap v482: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 18 MiB/s wr, 1.03k op/s 2024-08-20T01:35:41.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:40 smithi134 ceph-mon[22511]: pgmap v482: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 18 MiB/s wr, 1.03k op/s 2024-08-20T01:35:41.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:40 smithi077 ceph-mon[22251]: pgmap v482: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 18 MiB/s wr, 1.03k op/s 2024-08-20T01:35:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.438+0000 7f4cc7fff640 1 -- 172.21.15.22:0/1044442772 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e350f96d50 con 0x55e3510a6350 2024-08-20T01:35:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.438+0000 7f4cc7fff640 10 client.25702 handle_command_reply: tid=0 2024-08-20T01:35:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.438+0000 7f4ceda39740 1 client.25702 shutdown 2024-08-20T01:35:42.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.446+0000 7f4ceda39740 1 -- 172.21.15.22:0/1044442772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e351029350 msgr2=0x55e351035060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:42.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.446+0000 7f4ceda39740 1 --2- 172.21.15.22:0/1044442772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e351029350 0x55e351035060 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009dc0 tx=0x7f4cdc030f90 comp rx=0 tx=0).stop 2024-08-20T01:35:42.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.447+0000 7f4ceda39740 1 -- 172.21.15.22:0/1044442772 shutdown_connections 2024-08-20T01:35:42.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.447+0000 7f4ceda39740 1 --2- 172.21.15.22:0/1044442772 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e3510a6350 0x55e3510a8740 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:42.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.447+0000 7f4ceda39740 1 --2- 172.21.15.22:0/1044442772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e35102bd90 0x55e351035c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:42.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.447+0000 7f4ceda39740 1 --2- 172.21.15.22:0/1044442772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e351029350 0x55e351035060 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:42.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.447+0000 7f4ceda39740 1 --2- 172.21.15.22:0/1044442772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e351026a20 0x55e3510349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:42.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.447+0000 7f4ceda39740 1 -- 172.21.15.22:0/1044442772 >> 172.21.15.22:0/1044442772 conn(0x55e351021b70 msgr2=0x55e351025d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:42.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.447+0000 7f4cc7fff640 0 client.25702 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:42.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.447+0000 7f4ceda39740 1 -- 172.21.15.22:0/1044442772 shutdown_connections 2024-08-20T01:35:42.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.447+0000 7f4ceda39740 1 -- 172.21.15.22:0/1044442772 wait complete. 2024-08-20T01:35:42.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.447+0000 7f4ceda39740 20 client.25702 trim_cache size 0 max 16384 2024-08-20T01:35:42.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:35:42.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:35:42.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:35:42.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:35:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.489+0000 7f4ceab6a640 1 -- 172.21.15.22:0/4044922968 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4ccc0b3dd0 msgr2=0x7f4ccc0b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.489+0000 7f4ceab6a640 1 --2- 172.21.15.22:0/4044922968 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4ccc0b3dd0 0x7f4ccc0b6290 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400aab0 tx=0x7f4cd4005e90 comp rx=0 tx=0).stop 2024-08-20T01:35:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.489+0000 7f4ceab6a640 1 -- 172.21.15.22:0/4044922968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce410a0f0 msgr2=0x7f4ce41a7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.489+0000 7f4ceab6a640 1 --2- 172.21.15.22:0/4044922968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce410a0f0 0x7f4ce41a7ca0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc031b50 tx=0x7f4cdc003f10 comp rx=0 tx=0).stop 2024-08-20T01:35:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.490+0000 7f4ceab6a640 1 -- 172.21.15.22:0/4044922968 shutdown_connections 2024-08-20T01:35:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.490+0000 7f4ceab6a640 1 --2- 172.21.15.22:0/4044922968 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4ccc0b3dd0 0x7f4ccc0b6290 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.490+0000 7f4ceab6a640 1 --2- 172.21.15.22:0/4044922968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce410aa30 0x7f4ce41a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.490+0000 7f4ceab6a640 1 --2- 172.21.15.22:0/4044922968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce410a0f0 0x7f4ce41a7ca0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.490+0000 7f4ceab6a640 1 --2- 172.21.15.22:0/4044922968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ce4074230 0x7f4ce41a7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.490+0000 7f4ceab6a640 1 -- 172.21.15.22:0/4044922968 >> 172.21.15.22:0/4044922968 conn(0x7f4ce406f580 msgr2=0x7f4ce4071040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.490+0000 7f4ceab6a640 1 -- 172.21.15.22:0/4044922968 shutdown_connections 2024-08-20T01:35:42.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:42.490+0000 7f4ceab6a640 1 -- 172.21.15.22:0/4044922968 wait complete. 2024-08-20T01:35:43.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:42 smithi022 ceph-mon[18709]: pgmap v483: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 20 MiB/s wr, 1.58k op/s 2024-08-20T01:35:43.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:42 smithi134 ceph-mon[22511]: pgmap v483: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 20 MiB/s wr, 1.58k op/s 2024-08-20T01:35:43.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:42 smithi077 ceph-mon[22251]: pgmap v483: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 20 MiB/s wr, 1.58k op/s 2024-08-20T01:35:43.778 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:45.116 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:44 smithi077 ceph-mon[22251]: pgmap v484: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 16 MiB/s wr, 1.46k op/s 2024-08-20T01:35:45.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:44 smithi022 ceph-mon[18709]: pgmap v484: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 16 MiB/s wr, 1.46k op/s 2024-08-20T01:35:45.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:44 smithi134 ceph-mon[22511]: pgmap v484: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 16 MiB/s wr, 1.46k op/s 2024-08-20T01:35:45.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.679+0000 7fad772f8640 1 -- 172.21.15.22:0/3583365153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad70113670 msgr2=0x7fad70115a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:45.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.679+0000 7fad772f8640 1 --2- 172.21.15.22:0/3583365153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad70113670 0x7fad70115a60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fad68009ca0 tx=0x7fad6802a8e0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.684+0000 7fad772f8640 1 -- 172.21.15.22:0/3583365153 shutdown_connections 2024-08-20T01:35:45.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.684+0000 7fad772f8640 1 --2- 172.21.15.22:0/3583365153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad70113670 0x7fad70115a60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.684+0000 7fad772f8640 1 --2- 172.21.15.22:0/3583365153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad70075b90 0x7fad70113130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.684+0000 7fad772f8640 1 --2- 172.21.15.22:0/3583365153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad70075270 0x7fad70075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.684+0000 7fad772f8640 1 -- 172.21.15.22:0/3583365153 >> 172.21.15.22:0/3583365153 conn(0x7fad700fe3c0 msgr2=0x7fad701007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:45.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.689+0000 7fad772f8640 1 -- 172.21.15.22:0/3583365153 shutdown_connections 2024-08-20T01:35:45.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.692+0000 7fad772f8640 1 -- 172.21.15.22:0/3583365153 wait complete. 2024-08-20T01:35:45.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.693+0000 7fad772f8640 1 Processor -- start 2024-08-20T01:35:45.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.697+0000 7fad772f8640 1 -- start start 2024-08-20T01:35:45.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.697+0000 7fad772f8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad70075270 0x7fad700743f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.697+0000 7fad772f8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad70075b90 0x7fad70074930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.697+0000 7fad772f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad70113670 0x7fad7006d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.697+0000 7fad772f8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fad70118f50 con 0x7fad70075270 2024-08-20T01:35:45.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.697+0000 7fad772f8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fad70118dd0 con 0x7fad70075b90 2024-08-20T01:35:45.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.697+0000 7fad772f8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fad701190d0 con 0x7fad70113670 2024-08-20T01:35:45.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.698+0000 7fad76af7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad70113670 0x7fad7006d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:45.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.698+0000 7fad76af7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad70113670 0x7fad7006d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:49256/0 (socket says 172.21.15.22:49256) 2024-08-20T01:35:45.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.698+0000 7fad76af7640 1 -- 172.21.15.22:0/3620189883 learned_addr learned my addr 172.21.15.22:0/3620189883 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:45.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.698+0000 7fad762f6640 1 --2- 172.21.15.22:0/3620189883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad70075270 0x7fad700743f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:45.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.699+0000 7fad75af5640 1 --2- 172.21.15.22:0/3620189883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad70075b90 0x7fad70074930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:45.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.700+0000 7fad76af7640 1 -- 172.21.15.22:0/3620189883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad70075b90 msgr2=0x7fad70074930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:45.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.700+0000 7fad76af7640 1 --2- 172.21.15.22:0/3620189883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad70075b90 0x7fad70074930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.700+0000 7fad76af7640 1 -- 172.21.15.22:0/3620189883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad70075270 msgr2=0x7fad700743f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:45.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.700+0000 7fad76af7640 1 --2- 172.21.15.22:0/3620189883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad70075270 0x7fad700743f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.701+0000 7fad76af7640 1 -- 172.21.15.22:0/3620189883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7006df60 con 0x7fad70113670 2024-08-20T01:35:45.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.701+0000 7fad75af5640 1 --2- 172.21.15.22:0/3620189883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad70075b90 0x7fad70074930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:45.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.701+0000 7fad762f6640 1 --2- 172.21.15.22:0/3620189883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad70075270 0x7fad700743f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:45.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.701+0000 7fad76af7640 1 --2- 172.21.15.22:0/3620189883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad70113670 0x7fad7006d6a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fad68004af0 tx=0x7fad68003970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:45.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.703+0000 7fad677fe640 1 -- 172.21.15.22:0/3620189883 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68003c90 con 0x7fad70113670 2024-08-20T01:35:45.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.703+0000 7fad772f8640 1 -- 172.21.15.22:0/3620189883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad7006e1f0 con 0x7fad70113670 2024-08-20T01:35:45.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.703+0000 7fad772f8640 1 -- 172.21.15.22:0/3620189883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad700732b0 con 0x7fad70113670 2024-08-20T01:35:45.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.710+0000 7fad7a953740 1 Processor -- start 2024-08-20T01:35:45.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.711+0000 7fad7a953740 1 -- start start 2024-08-20T01:35:45.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.711+0000 7fad7a953740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56344493ba30 0x56344493be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.711+0000 7fad7a953740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56344493c350 0x563444947da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.711+0000 7fad7a953740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634449482e0 0x56344494a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.712+0000 7fad7a953740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5634448b2930 con 0x56344493ba30 2024-08-20T01:35:45.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.712+0000 7fad7a953740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5634448a1e30 con 0x5634449482e0 2024-08-20T01:35:45.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.712+0000 7fad7a953740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5634448a5e70 con 0x56344493c350 2024-08-20T01:35:45.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.712+0000 7fad677fe640 1 -- 172.21.15.22:0/3620189883 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad68003e30 con 0x7fad70113670 2024-08-20T01:35:45.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.712+0000 7fad762f6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56344493c350 0x563444947da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:45.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.712+0000 7fad762f6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56344493c350 0x563444947da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:49264/0 (socket says 172.21.15.22:49264) 2024-08-20T01:35:45.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.712+0000 7fad762f6640 1 -- 172.21.15.22:0/3332489677 learned_addr learned my addr 172.21.15.22:0/3332489677 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:45.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.712+0000 7fad75af5640 1 --2- 172.21.15.22:0/3332489677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634449482e0 0x56344494a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:45.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.712+0000 7fad75af5640 1 --2- 172.21.15.22:0/3332489677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56344493ba30 0x56344493be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:45.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.712+0000 7fad762f6640 1 -- 172.21.15.22:0/3332489677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634449482e0 msgr2=0x56344494a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:45.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.712+0000 7fad762f6640 1 --2- 172.21.15.22:0/3332489677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634449482e0 0x56344494a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.712+0000 7fad762f6640 1 -- 172.21.15.22:0/3332489677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56344493ba30 msgr2=0x56344493be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:45.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.712+0000 7fad762f6640 1 --2- 172.21.15.22:0/3332489677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56344493ba30 0x56344493be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.712+0000 7fad762f6640 1 -- 172.21.15.22:0/3332489677 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563444601650 con 0x56344493c350 2024-08-20T01:35:45.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.713+0000 7fad762f6640 1 --2- 172.21.15.22:0/3332489677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56344493c350 0x563444947da0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fad60009c60 tx=0x7fad60010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4a68ebf73340859 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:45.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.714+0000 7fad64ff9640 1 -- 172.21.15.22:0/3332489677 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad60004030 con 0x56344493c350 2024-08-20T01:35:45.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.716+0000 7fad75af5640 1 --2- 172.21.15.22:0/3332489677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56344493ba30 0x56344493be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:45.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.716+0000 7fad64ff9640 1 -- 172.21.15.22:0/3332489677 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad600041d0 con 0x56344493c350 2024-08-20T01:35:45.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.716+0000 7fad64ff9640 1 -- 172.21.15.22:0/3332489677 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad600126b0 con 0x56344493c350 2024-08-20T01:35:45.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.722+0000 7fad7a953740 1 -- 172.21.15.22:0/3332489677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56344493c350 msgr2=0x563444947da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:45.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.722+0000 7fad7a953740 1 --2- 172.21.15.22:0/3332489677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56344493c350 0x563444947da0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fad60009c60 tx=0x7fad60010740 comp rx=0 tx=0).stop 2024-08-20T01:35:45.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.722+0000 7fad677fe640 1 -- 172.21.15.22:0/3620189883 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68030c10 con 0x7fad70113670 2024-08-20T01:35:45.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.722+0000 7fad7a953740 1 -- 172.21.15.22:0/3332489677 shutdown_connections 2024-08-20T01:35:45.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.722+0000 7fad7a953740 1 --2- 172.21.15.22:0/3332489677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5634449482e0 0x56344494a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.722+0000 7fad7a953740 1 --2- 172.21.15.22:0/3332489677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56344493c350 0x563444947da0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.722+0000 7fad7a953740 1 --2- 172.21.15.22:0/3332489677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56344493ba30 0x56344493be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.722+0000 7fad7a953740 1 -- 172.21.15.22:0/3332489677 >> 172.21.15.22:0/3332489677 conn(0x563444939860 msgr2=0x56344493aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:45.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.723+0000 7fad677fe640 1 -- 172.21.15.22:0/3620189883 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fad6804d430 con 0x7fad70113670 2024-08-20T01:35:45.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.728+0000 7fad677fe640 1 --2- 172.21.15.22:0/3620189883 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fad5c0b3dd0 0x7fad5c0b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.729+0000 7fad762f6640 1 --2- 172.21.15.22:0/3620189883 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fad5c0b3dd0 0x7fad5c0b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:45.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.729+0000 7fad677fe640 1 -- 172.21.15.22:0/3620189883 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fad68105fc0 con 0x7fad70113670 2024-08-20T01:35:45.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.730+0000 7fad7a953740 1 -- 172.21.15.22:0/3332489677 shutdown_connections 2024-08-20T01:35:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.731+0000 7fad762f6640 1 --2- 172.21.15.22:0/3620189883 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fad5c0b3dd0 0x7fad5c0b6290 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fad60009460 tx=0x7fad60003dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.731+0000 7fad7a953740 1 -- 172.21.15.22:0/3332489677 wait complete. 2024-08-20T01:35:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.731+0000 7fad7a953740 1 -- start start 2024-08-20T01:35:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.731+0000 7fad7a953740 1 Processor -- start 2024-08-20T01:35:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.732+0000 7fad7a953740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56344493ba30 0x563444945300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.732+0000 7fad7a953740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56344493c350 0x563444945840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.732+0000 7fad7a953740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634449482e0 0x563444945d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.732+0000 7fad7a953740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563444704700 con 0x5634449482e0 2024-08-20T01:35:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.732+0000 7fad7a953740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563444828810 con 0x56344493c350 2024-08-20T01:35:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.732+0000 7fad7a953740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56344494af90 con 0x56344493ba30 2024-08-20T01:35:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.732+0000 7fad7a953740 10 client.0 _ll_register_callbacks cb 0x56344489b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:35:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.732+0000 7fad75af5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56344493c350 0x563444945840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.732+0000 7fad75af5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56344493c350 0x563444945840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:53986/0 (socket says 172.21.15.22:53986) 2024-08-20T01:35:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.732+0000 7fad75af5640 1 -- 172.21.15.22:0/2316675131 learned_addr learned my addr 172.21.15.22:0/2316675131 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.733+0000 7fad75af5640 1 -- 172.21.15.22:0/2316675131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56344493ba30 msgr2=0x563444945300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:35:45.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.733+0000 7fad75af5640 1 --2- 172.21.15.22:0/2316675131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56344493ba30 0x563444945300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.733+0000 7fad75af5640 1 -- 172.21.15.22:0/2316675131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634449482e0 msgr2=0x563444945d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:45.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.733+0000 7fad75af5640 1 --2- 172.21.15.22:0/2316675131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634449482e0 0x563444945d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.733+0000 7fad75af5640 1 -- 172.21.15.22:0/2316675131 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563444954450 con 0x56344493c350 2024-08-20T01:35:45.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.737+0000 7fad75af5640 1 --2- 172.21.15.22:0/2316675131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56344493c350 0x563444945840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00e4d0 tx=0x7fad6c00e990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=738996eece03acd8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:45.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.737+0000 7fad59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:35:45.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.740+0000 7fad59ffb640 1 -- 172.21.15.22:0/2316675131 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c017020 con 0x56344493c350 2024-08-20T01:35:45.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.741+0000 7fad7a953740 1 -- 172.21.15.22:0/2316675131 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563444851150 con 0x56344493c350 2024-08-20T01:35:45.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.741+0000 7fad59ffb640 1 -- 172.21.15.22:0/2316675131 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fad6c013680 con 0x56344493c350 2024-08-20T01:35:45.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.741+0000 7fad59ffb640 1 -- 172.21.15.22:0/2316675131 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fad6c022050 con 0x56344493c350 2024-08-20T01:35:45.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.745+0000 7fad7a953740 10 client.25688 fetch_fsmap learned FSMap version 29 2024-08-20T01:35:45.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.745+0000 7fad7a953740 1 -- 172.21.15.22:0/2316675131 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563444978de0 con 0x56344493c350 2024-08-20T01:35:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.748+0000 7fad59ffb640 1 -- 172.21.15.22:0/2316675131 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x563444851150 con 0x56344493c350 2024-08-20T01:35:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.748+0000 7fad59ffb640 1 -- 172.21.15.22:0/2316675131 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fad6c012a10 con 0x56344493c350 2024-08-20T01:35:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.749+0000 7fad7a953740 10 client.25688 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:35:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.749+0000 7fad7a953740 10 client.25688 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:35:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.749+0000 7fad7a953740 20 client.25688 populate_metadata read hostname 'smithi022' 2024-08-20T01:35:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.749+0000 7fad7a953740 1 --2- 172.21.15.22:0/2316675131 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56344497a370 0x56344497c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.749+0000 7fad7a953740 4 client.25688 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:35:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.749+0000 7fad7a953740 1 -- 172.21.15.22:0/2316675131 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634448b4880 con 0x56344497a370 2024-08-20T01:35:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.749+0000 7fad762f6640 1 --2- 172.21.15.22:0/2316675131 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56344497a370 0x56344497c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.750+0000 7fad59ffb640 10 client.25688 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.750+0000 7fad762f6640 1 --2- 172.21.15.22:0/2316675131 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56344497a370 0x56344497c810 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e4c665e7a78a59b server_cookie=78e815d8b6461ffe in_seq=0 out_seq=0 2024-08-20T01:35:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.758+0000 7fad59ffb640 1 -- 172.21.15.22:0/2316675131 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5634448b4880 con 0x56344497a370 2024-08-20T01:35:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.758+0000 7fad59ffb640 10 client.25688 handle_command_reply: tid=0 2024-08-20T01:35:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.758+0000 7fad7a953740 1 client.25688 shutdown 2024-08-20T01:35:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.764+0000 7fad7a953740 1 -- 172.21.15.22:0/2316675131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56344493c350 msgr2=0x563444945840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.764+0000 7fad7a953740 1 --2- 172.21.15.22:0/2316675131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56344493c350 0x563444945840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00e4d0 tx=0x7fad6c00e990 comp rx=0 tx=0).stop 2024-08-20T01:35:45.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.766+0000 7fad7a953740 1 -- 172.21.15.22:0/2316675131 shutdown_connections 2024-08-20T01:35:45.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.766+0000 7fad7a953740 1 --2- 172.21.15.22:0/2316675131 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56344497a370 0x56344497c810 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.766+0000 7fad7a953740 1 --2- 172.21.15.22:0/2316675131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634449482e0 0x563444945d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.766+0000 7fad7a953740 1 --2- 172.21.15.22:0/2316675131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56344493c350 0x563444945840 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00e4d0 tx=0x7fad6c00e990 comp rx=0 tx=0).stop 2024-08-20T01:35:45.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.766+0000 7fad7a953740 1 --2- 172.21.15.22:0/2316675131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56344493ba30 0x563444945300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.766+0000 7fad7a953740 1 -- 172.21.15.22:0/2316675131 >> 172.21.15.22:0/2316675131 conn(0x563444939860 msgr2=0x56344493f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:45.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.770+0000 7fad59ffb640 0 client.25688 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:45.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.770+0000 7fad7a953740 1 -- 172.21.15.22:0/2316675131 shutdown_connections 2024-08-20T01:35:45.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.773+0000 7fad7a953740 1 -- 172.21.15.22:0/2316675131 wait complete. 2024-08-20T01:35:45.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.773+0000 7fad7a953740 20 client.25688 trim_cache size 0 max 16384 2024-08-20T01:35:45.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.820+0000 7fad7a953740 1 Processor -- start 2024-08-20T01:35:45.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.820+0000 7fad7a953740 1 -- start start 2024-08-20T01:35:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.821+0000 7fad7a953740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56344493ba30 0x563444982120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.821+0000 7fad7a953740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634449482e0 0x563444982660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.821+0000 7fad7a953740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563444938fe0 0x563444946930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.822+0000 7fad7a953740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fad701a0360 con 0x56344493ba30 2024-08-20T01:35:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.822+0000 7fad7a953740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fad7010e5d0 con 0x563444938fe0 2024-08-20T01:35:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.822+0000 7fad7a953740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fad7010c420 con 0x5634449482e0 2024-08-20T01:35:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.822+0000 7fad762f6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56344493ba30 0x563444982120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.822+0000 7fad762f6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56344493ba30 0x563444982120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58202/0 (socket says 172.21.15.22:58202) 2024-08-20T01:35:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.822+0000 7fad762f6640 1 -- 172.21.15.22:0/530093198 learned_addr learned my addr 172.21.15.22:0/530093198 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.823+0000 7fad762f6640 1 -- 172.21.15.22:0/530093198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634449482e0 msgr2=0x563444982660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:35:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.823+0000 7fad762f6640 1 --2- 172.21.15.22:0/530093198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634449482e0 0x563444982660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.823+0000 7fad762f6640 1 -- 172.21.15.22:0/530093198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563444938fe0 msgr2=0x563444946930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.823+0000 7fad762f6640 1 --2- 172.21.15.22:0/530093198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563444938fe0 0x563444946930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.823+0000 7fad762f6640 1 -- 172.21.15.22:0/530093198 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563444933b10 con 0x56344493ba30 2024-08-20T01:35:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.823+0000 7fad762f6640 1 --2- 172.21.15.22:0/530093198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56344493ba30 0x563444982120 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fad60003d00 tx=0x7fad60025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7429b4e6ebdcf8b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.824+0000 7fad5bfff640 1 -- 172.21.15.22:0/530093198 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad60032480 con 0x56344493ba30 2024-08-20T01:35:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.824+0000 7fad5bfff640 1 -- 172.21.15.22:0/530093198 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad60005bf0 con 0x56344493ba30 2024-08-20T01:35:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.824+0000 7fad5bfff640 1 -- 172.21.15.22:0/530093198 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6001b690 con 0x56344493ba30 2024-08-20T01:35:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.825+0000 7fad7a953740 1 -- 172.21.15.22:0/530093198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56344493ba30 msgr2=0x563444982120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.825+0000 7fad7a953740 1 --2- 172.21.15.22:0/530093198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56344493ba30 0x563444982120 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fad60003d00 tx=0x7fad60025000 comp rx=0 tx=0).stop 2024-08-20T01:35:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.826+0000 7fad7a953740 1 -- 172.21.15.22:0/530093198 shutdown_connections 2024-08-20T01:35:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.826+0000 7fad7a953740 1 --2- 172.21.15.22:0/530093198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563444938fe0 0x563444946930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.826+0000 7fad7a953740 1 --2- 172.21.15.22:0/530093198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634449482e0 0x563444982660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.826+0000 7fad7a953740 1 --2- 172.21.15.22:0/530093198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56344493ba30 0x563444982120 secure :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fad60003d00 tx=0x7fad60025000 comp rx=0 tx=0).stop 2024-08-20T01:35:45.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.826+0000 7fad7a953740 1 -- 172.21.15.22:0/530093198 >> 172.21.15.22:0/530093198 conn(0x563444939860 msgr2=0x563444943b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:45.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.831+0000 7fad7a953740 1 -- 172.21.15.22:0/530093198 shutdown_connections 2024-08-20T01:35:45.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.832+0000 7fad7a953740 1 -- 172.21.15.22:0/530093198 wait complete. 2024-08-20T01:35:45.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.832+0000 7fad7a953740 1 -- start start 2024-08-20T01:35:45.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.832+0000 7fad7a953740 1 Processor -- start 2024-08-20T01:35:45.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.833+0000 7fad7a953740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563444938fe0 0x56344494b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.833+0000 7fad7a953740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634449482e0 0x56344494be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.833+0000 7fad7a953740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634449e10d0 0x5634449e34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.833+0000 7fad7a953740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fad7010ca90 con 0x5634449e10d0 2024-08-20T01:35:45.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.833+0000 7fad7a953740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fad7010df00 con 0x563444938fe0 2024-08-20T01:35:45.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.833+0000 7fad7a953740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fad7010d160 con 0x5634449482e0 2024-08-20T01:35:45.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.833+0000 7fad7a953740 10 client.0 _ll_register_callbacks cb 0x7fad6c00b360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:35:45.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.834+0000 7fad762f6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563444938fe0 0x56344494b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:45.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.834+0000 7fad762f6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563444938fe0 0x56344494b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:54018/0 (socket says 172.21.15.22:54018) 2024-08-20T01:35:45.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.834+0000 7fad762f6640 1 -- 172.21.15.22:0/3884803114 learned_addr learned my addr 172.21.15.22:0/3884803114 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:45.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.834+0000 7fad75af5640 1 --2- 172.21.15.22:0/3884803114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634449482e0 0x56344494be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:45.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.834+0000 7fad762f6640 1 -- 172.21.15.22:0/3884803114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634449482e0 msgr2=0x56344494be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:45.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.834+0000 7fad762f6640 1 --2- 172.21.15.22:0/3884803114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634449482e0 0x56344494be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.834+0000 7fad762f6640 1 -- 172.21.15.22:0/3884803114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634449e10d0 msgr2=0x5634449e34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:45.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.834+0000 7fad76af7640 1 --2- 172.21.15.22:0/3884803114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634449e10d0 0x5634449e34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:45.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.834+0000 7fad762f6640 1 --2- 172.21.15.22:0/3884803114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634449e10d0 0x5634449e34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.835+0000 7fad762f6640 1 -- 172.21.15.22:0/3884803114 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634449e3a00 con 0x563444938fe0 2024-08-20T01:35:45.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.835+0000 7fad76af7640 1 --2- 172.21.15.22:0/3884803114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634449e10d0 0x5634449e34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:45.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.837+0000 7fad762f6640 1 --2- 172.21.15.22:0/3884803114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563444938fe0 0x56344494b900 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fad600093d0 tx=0x7fad60005510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ae9d5fd901a49b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:45.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.837+0000 7fad59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:35:45.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.837+0000 7fad59ffb640 1 -- 172.21.15.22:0/3884803114 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad60012650 con 0x563444938fe0 2024-08-20T01:35:45.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.837+0000 7fad7a953740 1 -- 172.21.15.22:0/3884803114 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5634448b0320 con 0x563444938fe0 2024-08-20T01:35:45.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.838+0000 7fad59ffb640 1 -- 172.21.15.22:0/3884803114 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fad600127f0 con 0x563444938fe0 2024-08-20T01:35:45.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.839+0000 7fad59ffb640 1 -- 172.21.15.22:0/3884803114 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fad60012a10 con 0x563444938fe0 2024-08-20T01:35:45.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.841+0000 7fad7a953740 10 client.25691 fetch_fsmap learned FSMap version 29 2024-08-20T01:35:45.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.841+0000 7fad7a953740 1 -- 172.21.15.22:0/3884803114 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5634449e4d00 con 0x563444938fe0 2024-08-20T01:35:45.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.845+0000 7fad59ffb640 1 -- 172.21.15.22:0/3884803114 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5634448b0320 con 0x563444938fe0 2024-08-20T01:35:45.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.845+0000 7fad59ffb640 1 -- 172.21.15.22:0/3884803114 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fad6000f040 con 0x563444938fe0 2024-08-20T01:35:45.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.845+0000 7fad7a953740 10 client.25691 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:35:45.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.845+0000 7fad7a953740 10 client.25691 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:35:45.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.845+0000 7fad7a953740 20 client.25691 populate_metadata read hostname 'smithi022' 2024-08-20T01:35:45.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.845+0000 7fad7a953740 1 --2- 172.21.15.22:0/3884803114 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5634449e51e0 0x5634449e7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.845+0000 7fad7a953740 4 client.25691 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:35:45.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.845+0000 7fad7a953740 1 -- 172.21.15.22:0/3884803114 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5634448ada60 con 0x5634449e51e0 2024-08-20T01:35:45.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.846+0000 7fad75af5640 1 --2- 172.21.15.22:0/3884803114 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5634449e51e0 0x5634449e7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:45.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.847+0000 7fad75af5640 1 --2- 172.21.15.22:0/3884803114 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5634449e51e0 0x5634449e7600 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2efab0a45cdbf08a server_cookie=8ae8c3bec3756a98 in_seq=0 out_seq=0 2024-08-20T01:35:45.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.854+0000 7fad59ffb640 10 client.25691 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:45.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.854+0000 7fad59ffb640 1 -- 172.21.15.22:0/3884803114 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5634448ada60 con 0x5634449e51e0 2024-08-20T01:35:45.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.854+0000 7fad59ffb640 10 client.25691 handle_command_reply: tid=0 2024-08-20T01:35:45.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.856+0000 7fad7a953740 1 client.25691 shutdown 2024-08-20T01:35:45.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.862+0000 7fad7a953740 1 -- 172.21.15.22:0/3884803114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563444938fe0 msgr2=0x56344494b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:45.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.862+0000 7fad7a953740 1 --2- 172.21.15.22:0/3884803114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563444938fe0 0x56344494b900 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fad600093d0 tx=0x7fad60005510 comp rx=0 tx=0).stop 2024-08-20T01:35:45.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.865+0000 7fad7a953740 1 -- 172.21.15.22:0/3884803114 shutdown_connections 2024-08-20T01:35:45.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.865+0000 7fad7a953740 1 --2- 172.21.15.22:0/3884803114 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5634449e51e0 0x5634449e7600 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.865+0000 7fad7a953740 1 --2- 172.21.15.22:0/3884803114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634449e10d0 0x5634449e34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.865+0000 7fad7a953740 1 --2- 172.21.15.22:0/3884803114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5634449482e0 0x56344494be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.865+0000 7fad7a953740 1 --2- 172.21.15.22:0/3884803114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563444938fe0 0x56344494b900 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.865+0000 7fad7a953740 1 -- 172.21.15.22:0/3884803114 >> 172.21.15.22:0/3884803114 conn(0x563444939860 msgr2=0x563444946930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:45.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.866+0000 7fad59ffb640 0 client.25691 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:45.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.868+0000 7fad7a953740 1 -- 172.21.15.22:0/3884803114 shutdown_connections 2024-08-20T01:35:45.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.869+0000 7fad7a953740 1 -- 172.21.15.22:0/3884803114 wait complete. 2024-08-20T01:35:45.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.870+0000 7fad7a953740 20 client.25691 trim_cache size 0 max 16384 2024-08-20T01:35:45.875 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:35:45.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.878+0000 7fad772f8640 1 -- 172.21.15.22:0/3620189883 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fad5c0b3dd0 msgr2=0x7fad5c0b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:45.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.878+0000 7fad772f8640 1 --2- 172.21.15.22:0/3620189883 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fad5c0b3dd0 0x7fad5c0b6290 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fad60009460 tx=0x7fad60003dd0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.878+0000 7fad772f8640 1 -- 172.21.15.22:0/3620189883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad70113670 msgr2=0x7fad7006d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:45.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.878+0000 7fad772f8640 1 --2- 172.21.15.22:0/3620189883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad70113670 0x7fad7006d6a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fad68004af0 tx=0x7fad68003970 comp rx=0 tx=0).stop 2024-08-20T01:35:45.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.878+0000 7fad772f8640 1 -- 172.21.15.22:0/3620189883 shutdown_connections 2024-08-20T01:35:45.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.878+0000 7fad772f8640 1 --2- 172.21.15.22:0/3620189883 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fad5c0b3dd0 0x7fad5c0b6290 secure :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fad60009460 tx=0x7fad60003dd0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.878+0000 7fad772f8640 1 --2- 172.21.15.22:0/3620189883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad70113670 0x7fad7006d6a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.878+0000 7fad772f8640 1 --2- 172.21.15.22:0/3620189883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad70075b90 0x7fad70074930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.878+0000 7fad772f8640 1 --2- 172.21.15.22:0/3620189883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad70075270 0x7fad700743f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.879+0000 7fad772f8640 1 -- 172.21.15.22:0/3620189883 >> 172.21.15.22:0/3620189883 conn(0x7fad700fe3c0 msgr2=0x7fad700fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:45.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.879+0000 7fad772f8640 1 -- 172.21.15.22:0/3620189883 shutdown_connections 2024-08-20T01:35:45.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:45.879+0000 7fad772f8640 1 -- 172.21.15.22:0/3620189883 wait complete. 2024-08-20T01:35:47.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:46 smithi022 ceph-mon[18709]: pgmap v485: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 1.36k op/s 2024-08-20T01:35:47.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:46 smithi134 ceph-mon[22511]: pgmap v485: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 1.36k op/s 2024-08-20T01:35:47.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:46 smithi077 ceph-mon[22251]: pgmap v485: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 1.36k op/s 2024-08-20T01:35:48.879 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:48 smithi022 ceph-mon[18709]: pgmap v486: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 15 MiB/s wr, 1.41k op/s 2024-08-20T01:35:49.006 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:35:49.007 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:35:49.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:48 smithi134 ceph-mon[22511]: pgmap v486: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 15 MiB/s wr, 1.41k op/s 2024-08-20T01:35:49.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:48 smithi077 ceph-mon[22251]: pgmap v486: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 15 MiB/s wr, 1.41k op/s 2024-08-20T01:35:50.032 INFO:tasks.workunit.client.0.smithi022.stdout: 461 2052779 1556 1419291 1480 784888 3314 2024-08-20T01:35:51.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:50 smithi022 ceph-mon[18709]: pgmap v487: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.5 MiB/s wr, 925 op/s 2024-08-20T01:35:51.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:50 smithi134 ceph-mon[22511]: pgmap v487: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.5 MiB/s wr, 925 op/s 2024-08-20T01:35:51.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:50 smithi077 ceph-mon[22251]: pgmap v487: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.5 MiB/s wr, 925 op/s 2024-08-20T01:35:53.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:52 smithi022 ceph-mon[18709]: pgmap v488: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.9 MiB/s wr, 1.00k op/s 2024-08-20T01:35:53.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:52 smithi134 ceph-mon[22511]: pgmap v488: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.9 MiB/s wr, 1.00k op/s 2024-08-20T01:35:53.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:52 smithi077 ceph-mon[22251]: pgmap v488: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.9 MiB/s wr, 1.00k op/s 2024-08-20T01:35:55.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:54 smithi134 ceph-mon[22511]: pgmap v489: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.7 MiB/s wr, 477 op/s 2024-08-20T01:35:55.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:54 smithi077 ceph-mon[22251]: pgmap v489: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.7 MiB/s wr, 477 op/s 2024-08-20T01:35:55.320 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:55.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:54 smithi022 ceph-mon[18709]: pgmap v489: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.7 MiB/s wr, 477 op/s 2024-08-20T01:35:57.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.175+0000 7f3f98b27640 1 -- 172.21.15.22:0/2662256235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f9411bdd0 msgr2=0x7f3f9411e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:57.186 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:56 smithi022 ceph-mon[18709]: pgmap v490: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.6 MiB/s wr, 371 op/s 2024-08-20T01:35:57.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.175+0000 7f3f98b27640 1 --2- 172.21.15.22:0/2662256235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f9411bdd0 0x7f3f9411e1c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3f8801a910 tx=0x7f3f8803b500 comp rx=0 tx=0).stop 2024-08-20T01:35:57.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.175+0000 7f3f98b27640 1 -- 172.21.15.22:0/2662256235 shutdown_connections 2024-08-20T01:35:57.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.175+0000 7f3f98b27640 1 --2- 172.21.15.22:0/2662256235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f9411bdd0 0x7f3f9411e1c0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.175+0000 7f3f98b27640 1 --2- 172.21.15.22:0/2662256235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f9410a260 0x7f3f9410a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.175+0000 7f3f98b27640 1 --2- 172.21.15.22:0/2662256235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f94109e80 0x7f3f94110ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.175+0000 7f3f98b27640 1 -- 172.21.15.22:0/2662256235 >> 172.21.15.22:0/2662256235 conn(0x7f3f9406dcc0 msgr2=0x7f3f9406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:57.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.178+0000 7f3f98b27640 1 -- 172.21.15.22:0/2662256235 shutdown_connections 2024-08-20T01:35:57.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.178+0000 7f3f98b27640 1 -- 172.21.15.22:0/2662256235 wait complete. 2024-08-20T01:35:57.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.179+0000 7f3f98b27640 1 Processor -- start 2024-08-20T01:35:57.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.179+0000 7f3f98b27640 1 -- start start 2024-08-20T01:35:57.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.179+0000 7f3f98b27640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f9411bdd0 0x7f3f9411b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.180+0000 7f3f98b27640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f94117740 0x7f3f94117b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.180+0000 7f3f98b27640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f941180c0 0x7f3f941abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.180+0000 7f3f98b27640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3f94113ef0 con 0x7f3f9411bdd0 2024-08-20T01:35:57.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.180+0000 7f3f98b27640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f94113d70 con 0x7f3f941180c0 2024-08-20T01:35:57.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.180+0000 7f3f98b27640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3f94114070 con 0x7f3f94117740 2024-08-20T01:35:57.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.180+0000 7f3f92d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f941180c0 0x7f3f941abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.180+0000 7f3f92d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f941180c0 0x7f3f941abd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:60364/0 (socket says 172.21.15.22:60364) 2024-08-20T01:35:57.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.180+0000 7f3f92d9d640 1 -- 172.21.15.22:0/4179207472 learned_addr learned my addr 172.21.15.22:0/4179207472 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:57.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.180+0000 7f3f92d9d640 1 -- 172.21.15.22:0/4179207472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f94117740 msgr2=0x7f3f94117b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T01:35:57.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.180+0000 7f3f92d9d640 1 --2- 172.21.15.22:0/4179207472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f94117740 0x7f3f94117b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.180+0000 7f3f92d9d640 1 -- 172.21.15.22:0/4179207472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f9411bdd0 msgr2=0x7f3f9411b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:57.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.180+0000 7f3f92d9d640 1 --2- 172.21.15.22:0/4179207472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f9411bdd0 0x7f3f9411b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.180+0000 7f3f92d9d640 1 -- 172.21.15.22:0/4179207472 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f941ac2c0 con 0x7f3f941180c0 2024-08-20T01:35:57.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.184+0000 7f3f92d9d640 1 --2- 172.21.15.22:0/4179207472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f941180c0 0x7f3f941abd80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3f8803ba70 tx=0x7f3f88004960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:57.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.184+0000 7f3f837fe640 1 -- 172.21.15.22:0/4179207472 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8804f020 con 0x7f3f941180c0 2024-08-20T01:35:57.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.184+0000 7f3f98b27640 1 -- 172.21.15.22:0/4179207472 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f941ac4f0 con 0x7f3f941180c0 2024-08-20T01:35:57.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.184+0000 7f3f98b27640 1 -- 172.21.15.22:0/4179207472 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f941aca00 con 0x7f3f941180c0 2024-08-20T01:35:57.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.184+0000 7f3f837fe640 1 -- 172.21.15.22:0/4179207472 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f880035f0 con 0x7f3f941180c0 2024-08-20T01:35:57.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.184+0000 7f3f837fe640 1 -- 172.21.15.22:0/4179207472 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f88046070 con 0x7f3f941180c0 2024-08-20T01:35:57.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.191+0000 7f3f9af20740 1 Processor -- start 2024-08-20T01:35:57.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.193+0000 7f3f9af20740 1 -- start start 2024-08-20T01:35:57.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.193+0000 7f3f9af20740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa3a9bf3b0 0x55fa3a9bf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.193+0000 7f3f9af20740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bfcd0 0x55fa3a9cb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.193+0000 7f3f9af20740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa3a9cbc60 0x55fa3a9ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.193+0000 7f3f9af20740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fa3a935940 con 0x55fa3a9cbc60 2024-08-20T01:35:57.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.193+0000 7f3f9af20740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fa3a924e40 con 0x55fa3a9bf3b0 2024-08-20T01:35:57.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.193+0000 7f3f9af20740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fa3a928e80 con 0x55fa3a9bfcd0 2024-08-20T01:35:57.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.193+0000 7f3f837fe640 1 -- 172.21.15.22:0/4179207472 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3f88052020 con 0x7f3f941180c0 2024-08-20T01:35:57.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.195+0000 7f3f837fe640 1 --2- 172.21.15.22:0/4179207472 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3f7c0b3de0 0x7f3f7c0b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.195+0000 7f3f837fe640 1 -- 172.21.15.22:0/4179207472 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f3f88116050 con 0x7f3f941180c0 2024-08-20T01:35:57.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.196+0000 7f3f9259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bfcd0 0x55fa3a9cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.196+0000 7f3f9259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bfcd0 0x55fa3a9cb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:43452/0 (socket says 172.21.15.22:43452) 2024-08-20T01:35:57.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.196+0000 7f3f9259c640 1 -- 172.21.15.22:0/2889816190 learned_addr learned my addr 172.21.15.22:0/2889816190 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:57.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.197+0000 7f3f9259c640 1 -- 172.21.15.22:0/2889816190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa3a9bf3b0 msgr2=0x55fa3a9bf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:57.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.197+0000 7f3f9259c640 1 --2- 172.21.15.22:0/2889816190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa3a9bf3b0 0x55fa3a9bf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.197+0000 7f3f9259c640 1 -- 172.21.15.22:0/2889816190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa3a9cbc60 msgr2=0x55fa3a9ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:57.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.197+0000 7f3f9259c640 1 --2- 172.21.15.22:0/2889816190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa3a9cbc60 0x55fa3a9ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.197+0000 7f3f9259c640 1 -- 172.21.15.22:0/2889816190 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa3a8c1520 con 0x55fa3a9bfcd0 2024-08-20T01:35:57.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.197+0000 7f3f92d9d640 1 --2- 172.21.15.22:0/4179207472 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3f7c0b3de0 0x7f3f7c0b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.198+0000 7f3f9259c640 1 --2- 172.21.15.22:0/2889816190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bfcd0 0x55fa3a9cb720 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c009e20 tx=0x7f3f8c00e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53f10b1f9c5fb24e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:57.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.198+0000 7f3f80ff9640 1 -- 172.21.15.22:0/2889816190 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c004d20 con 0x55fa3a9bfcd0 2024-08-20T01:35:57.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.199+0000 7f3f80ff9640 1 -- 172.21.15.22:0/2889816190 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f8c00ee70 con 0x55fa3a9bfcd0 2024-08-20T01:35:57.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.200+0000 7f3f9af20740 1 -- 172.21.15.22:0/2889816190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bfcd0 msgr2=0x55fa3a9cb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:57.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.200+0000 7f3f9af20740 1 --2- 172.21.15.22:0/2889816190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bfcd0 0x55fa3a9cb720 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c009e20 tx=0x7f3f8c00e720 comp rx=0 tx=0).stop 2024-08-20T01:35:57.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.201+0000 7f3f9af20740 1 -- 172.21.15.22:0/2889816190 shutdown_connections 2024-08-20T01:35:57.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.201+0000 7f3f9af20740 1 --2- 172.21.15.22:0/2889816190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa3a9cbc60 0x55fa3a9ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.201+0000 7f3f9af20740 1 --2- 172.21.15.22:0/2889816190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bfcd0 0x55fa3a9cb720 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.201+0000 7f3f9af20740 1 --2- 172.21.15.22:0/2889816190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa3a9bf3b0 0x55fa3a9bf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.201+0000 7f3f9af20740 1 -- 172.21.15.22:0/2889816190 >> 172.21.15.22:0/2889816190 conn(0x55fa3a9bd1e0 msgr2=0x55fa3a9be380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:57.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.201+0000 7f3f92d9d640 1 --2- 172.21.15.22:0/4179207472 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3f7c0b3de0 0x7f3f7c0b62a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3f88005ab0 tx=0x7f3f8803b500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:57.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.203+0000 7f3f9af20740 1 -- 172.21.15.22:0/2889816190 shutdown_connections 2024-08-20T01:35:57.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.204+0000 7f3f9af20740 1 -- 172.21.15.22:0/2889816190 wait complete. 2024-08-20T01:35:57.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.205+0000 7f3f9af20740 1 -- start start 2024-08-20T01:35:57.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.205+0000 7f3f9af20740 1 Processor -- start 2024-08-20T01:35:57.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.206+0000 7f3f9af20740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bf3b0 0x55fa3a9cb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.206+0000 7f3f9af20740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa3a9bfcd0 0x55fa3a9c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.207+0000 7f3f91d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bf3b0 0x55fa3a9cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.207+0000 7f3f91d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bf3b0 0x55fa3a9cb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:43454/0 (socket says 172.21.15.22:43454) 2024-08-20T01:35:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.207+0000 7f3f91d9b640 1 -- 172.21.15.22:0/2542087539 learned_addr learned my addr 172.21.15.22:0/2542087539 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.207+0000 7f3f9af20740 1 --2- 172.21.15.22:0/2542087539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa3a9cbc60 0x55fa3a9c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.207+0000 7f3f9af20740 1 -- 172.21.15.22:0/2542087539 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fa3a787890 con 0x55fa3a9bfcd0 2024-08-20T01:35:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.207+0000 7f3f9af20740 1 -- 172.21.15.22:0/2542087539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fa3a8ab700 con 0x55fa3a9cbc60 2024-08-20T01:35:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.207+0000 7f3f9af20740 1 -- 172.21.15.22:0/2542087539 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fa3a9cea00 con 0x55fa3a9bf3b0 2024-08-20T01:35:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.207+0000 7f3f91d9b640 1 --2- 172.21.15.22:0/2542087539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa3a9cbc60 0x55fa3a9c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.208+0000 7f3f91d9b640 1 -- 172.21.15.22:0/2542087539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa3a9cbc60 msgr2=0x55fa3a9c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.208+0000 7f3f91d9b640 1 --2- 172.21.15.22:0/2542087539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa3a9cbc60 0x55fa3a9c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.208+0000 7f3f91d9b640 1 -- 172.21.15.22:0/2542087539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa3a9bfcd0 msgr2=0x55fa3a9c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.208+0000 7f3f91d9b640 1 --2- 172.21.15.22:0/2542087539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa3a9bfcd0 0x55fa3a9c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.208+0000 7f3f91d9b640 1 -- 172.21.15.22:0/2542087539 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3a684930 con 0x55fa3a9bf3b0 2024-08-20T01:35:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.208+0000 7f3f9af20740 10 client.0 _ll_register_callbacks cb 0x55fa3a9206f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:35:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.208+0000 7f3f91d9b640 1 --2- 172.21.15.22:0/2542087539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bf3b0 0x55fa3a9cb720 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400bfc0 tx=0x7f3f8400b520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50b2ca5ed13e75d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.208+0000 7f3f9af20740 1 -- 172.21.15.22:0/2542087539 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f8c00ee70 con 0x55fa3a9bf3b0 2024-08-20T01:35:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.209+0000 7f3f79ffb640 10 client.25720 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:35:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.209+0000 7f3f79ffb640 1 -- 172.21.15.22:0/2542087539 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84022050 con 0x55fa3a9bf3b0 2024-08-20T01:35:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.209+0000 7f3f79ffb640 1 -- 172.21.15.22:0/2542087539 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f3f84010650 con 0x55fa3a9bf3b0 2024-08-20T01:35:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.209+0000 7f3f79ffb640 1 -- 172.21.15.22:0/2542087539 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3f84010890 con 0x55fa3a9bf3b0 2024-08-20T01:35:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.209+0000 7f3f9af20740 10 client.25720 fetch_fsmap learned FSMap version 29 2024-08-20T01:35:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.209+0000 7f3f9af20740 1 -- 172.21.15.22:0/2542087539 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55fa3a9da540 con 0x55fa3a9bf3b0 2024-08-20T01:35:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.210+0000 7f3f79ffb640 1 -- 172.21.15.22:0/2542087539 <== mon.1 v2:172.21.15.134:3300/0 4 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3f84010a30 con 0x55fa3a9bf3b0 2024-08-20T01:35:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.210+0000 7f3f9af20740 10 client.25720 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:35:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.210+0000 7f3f9af20740 10 client.25720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:35:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.210+0000 7f3f9af20740 20 client.25720 populate_metadata read hostname 'smithi022' 2024-08-20T01:35:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.210+0000 7f3f9af20740 1 --2- 172.21.15.22:0/2542087539 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fa3a9dbe90 0x55fa3a9de350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.210+0000 7f3f9af20740 4 client.25720 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:35:57.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.210+0000 7f3f9af20740 1 -- 172.21.15.22:0/2542087539 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa3a937890 con 0x55fa3a9dbe90 2024-08-20T01:35:57.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.210+0000 7f3f9259c640 1 --2- 172.21.15.22:0/2542087539 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fa3a9dbe90 0x55fa3a9de350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.211+0000 7f3f9259c640 1 --2- 172.21.15.22:0/2542087539 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fa3a9dbe90 0x55fa3a9de350 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f2cadb45fcefbe6 server_cookie=7b782e9cb0999747 in_seq=0 out_seq=0 2024-08-20T01:35:57.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.211+0000 7f3f79ffb640 10 client.25720 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:57.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.211+0000 7f3f79ffb640 1 -- 172.21.15.22:0/2542087539 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fa3a937890 con 0x55fa3a9dbe90 2024-08-20T01:35:57.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.211+0000 7f3f79ffb640 10 client.25720 handle_command_reply: tid=0 2024-08-20T01:35:57.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.211+0000 7f3f9af20740 1 client.25720 shutdown 2024-08-20T01:35:57.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.213+0000 7f3f9af20740 1 -- 172.21.15.22:0/2542087539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bf3b0 msgr2=0x55fa3a9cb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:57.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.213+0000 7f3f9af20740 1 --2- 172.21.15.22:0/2542087539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bf3b0 0x55fa3a9cb720 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400bfc0 tx=0x7f3f8400b520 comp rx=0 tx=0).stop 2024-08-20T01:35:57.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.213+0000 7f3f9af20740 1 -- 172.21.15.22:0/2542087539 shutdown_connections 2024-08-20T01:35:57.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.213+0000 7f3f9af20740 1 --2- 172.21.15.22:0/2542087539 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fa3a9dbe90 0x55fa3a9de350 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.213+0000 7f3f9af20740 1 --2- 172.21.15.22:0/2542087539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa3a9cbc60 0x55fa3a9c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.213+0000 7f3f9af20740 1 --2- 172.21.15.22:0/2542087539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa3a9bfcd0 0x55fa3a9c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.213+0000 7f3f9af20740 1 --2- 172.21.15.22:0/2542087539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bf3b0 0x55fa3a9cb720 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.213+0000 7f3f9af20740 1 -- 172.21.15.22:0/2542087539 >> 172.21.15.22:0/2542087539 conn(0x55fa3a9bd1e0 msgr2=0x55fa3a9c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:57.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.213+0000 7f3f79ffb640 0 client.25720 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:57.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.213+0000 7f3f9af20740 1 -- 172.21.15.22:0/2542087539 shutdown_connections 2024-08-20T01:35:57.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.214+0000 7f3f9af20740 1 -- 172.21.15.22:0/2542087539 wait complete. 2024-08-20T01:35:57.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.214+0000 7f3f9af20740 20 client.25720 trim_cache size 0 max 16384 2024-08-20T01:35:57.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.255+0000 7f3f9af20740 1 Processor -- start 2024-08-20T01:35:57.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.255+0000 7f3f9af20740 1 -- start start 2024-08-20T01:35:57.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.256+0000 7f3f9af20740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bf3b0 0x55fa3a9e3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.256+0000 7f3f9af20740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa3a9bfcd0 0x55fa3a9e41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.256+0000 7f3f91d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bf3b0 0x55fa3a9e3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.256+0000 7f3f91d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bf3b0 0x55fa3a9e3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:43466/0 (socket says 172.21.15.22:43466) 2024-08-20T01:35:57.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.256+0000 7f3f91d9b640 1 -- 172.21.15.22:0/3098525668 learned_addr learned my addr 172.21.15.22:0/3098525668 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:57.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.256+0000 7f3f9259c640 1 --2- 172.21.15.22:0/3098525668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa3a9bfcd0 0x55fa3a9e41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.257+0000 7f3f9af20740 1 --2- 172.21.15.22:0/3098525668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa3a9cbc60 0x55fa3a9c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.257+0000 7f3f9af20740 1 -- 172.21.15.22:0/3098525668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3f74010fb0 con 0x55fa3a9cbc60 2024-08-20T01:35:57.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.257+0000 7f3f9af20740 1 -- 172.21.15.22:0/3098525668 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7400e820 con 0x55fa3a9bfcd0 2024-08-20T01:35:57.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.257+0000 7f3f9af20740 1 -- 172.21.15.22:0/3098525668 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7400c670 con 0x55fa3a9bf3b0 2024-08-20T01:35:57.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.257+0000 7f3f91d9b640 1 --2- 172.21.15.22:0/3098525668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa3a9cbc60 0x55fa3a9c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.257+0000 7f3f91d9b640 1 -- 172.21.15.22:0/3098525668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa3a9bfcd0 msgr2=0x55fa3a9e41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:57.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.257+0000 7f3f91d9b640 1 --2- 172.21.15.22:0/3098525668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa3a9bfcd0 0x55fa3a9e41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.257+0000 7f3f91d9b640 1 -- 172.21.15.22:0/3098525668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa3a9cbc60 msgr2=0x55fa3a9c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:57.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.257+0000 7f3f91d9b640 1 --2- 172.21.15.22:0/3098525668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa3a9cbc60 0x55fa3a9c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.257+0000 7f3f91d9b640 1 -- 172.21.15.22:0/3098525668 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa3a9c8f20 con 0x55fa3a9bf3b0 2024-08-20T01:35:57.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:56 smithi134 ceph-mon[22511]: pgmap v490: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.6 MiB/s wr, 371 op/s 2024-08-20T01:35:57.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.262+0000 7f3f91d9b640 1 --2- 172.21.15.22:0/3098525668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bf3b0 0x55fa3a9e3c60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3f84001eb0 tx=0x7f3f84014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=300fbb60f16f81a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:57.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.262+0000 7f3f7bfff640 1 -- 172.21.15.22:0/3098525668 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84022050 con 0x55fa3a9bf3b0 2024-08-20T01:35:57.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.262+0000 7f3f7bfff640 1 -- 172.21.15.22:0/3098525668 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f8c00ee70 con 0x55fa3a9bf3b0 2024-08-20T01:35:57.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.263+0000 7f3f9af20740 1 -- 172.21.15.22:0/3098525668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bf3b0 msgr2=0x55fa3a9e3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:57.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.263+0000 7f3f9af20740 1 --2- 172.21.15.22:0/3098525668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bf3b0 0x55fa3a9e3c60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3f84001eb0 tx=0x7f3f84014000 comp rx=0 tx=0).stop 2024-08-20T01:35:57.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.264+0000 7f3f9af20740 1 -- 172.21.15.22:0/3098525668 shutdown_connections 2024-08-20T01:35:57.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.264+0000 7f3f9af20740 1 --2- 172.21.15.22:0/3098525668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa3a9cbc60 0x55fa3a9c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.264+0000 7f3f9af20740 1 --2- 172.21.15.22:0/3098525668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa3a9bfcd0 0x55fa3a9e41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.264+0000 7f3f9af20740 1 --2- 172.21.15.22:0/3098525668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bf3b0 0x55fa3a9e3c60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.264+0000 7f3f9af20740 1 -- 172.21.15.22:0/3098525668 >> 172.21.15.22:0/3098525668 conn(0x55fa3a9bd1e0 msgr2=0x55fa3a9c3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:57.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.264+0000 7f3f9af20740 1 -- 172.21.15.22:0/3098525668 shutdown_connections 2024-08-20T01:35:57.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.264+0000 7f3f9af20740 1 -- 172.21.15.22:0/3098525668 wait complete. 2024-08-20T01:35:57.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.264+0000 7f3f9af20740 1 -- start start 2024-08-20T01:35:57.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.265+0000 7f3f9af20740 1 Processor -- start 2024-08-20T01:35:57.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.265+0000 7f3f9af20740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bfcd0 0x55fa3a9d44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.265+0000 7f3f9af20740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa3a9cbc60 0x55fa3a9cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.265+0000 7f3f9af20740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa3a9cfe20 0x55fa3a9d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.265+0000 7f3f9af20740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7400cce0 con 0x55fa3a9cfe20 2024-08-20T01:35:57.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.265+0000 7f3f9af20740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7400e150 con 0x55fa3a9cbc60 2024-08-20T01:35:57.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.265+0000 7f3f9af20740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7400d3b0 con 0x55fa3a9bfcd0 2024-08-20T01:35:57.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.265+0000 7f3f9af20740 10 client.0 _ll_register_callbacks cb 0x7f3f84005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:35:57.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.266+0000 7f3f91d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bfcd0 0x55fa3a9d44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.266+0000 7f3f91d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bfcd0 0x55fa3a9d44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:43472/0 (socket says 172.21.15.22:43472) 2024-08-20T01:35:57.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.266+0000 7f3f91d9b640 1 -- 172.21.15.22:0/1452341633 learned_addr learned my addr 172.21.15.22:0/1452341633 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:57.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.266+0000 7f3f91d9b640 1 --2- 172.21.15.22:0/1452341633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa3a9cfe20 0x55fa3a9d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.267+0000 7f3f91d9b640 1 -- 172.21.15.22:0/1452341633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa3a9cbc60 msgr2=0x55fa3a9cf8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:35:57.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.267+0000 7f3f91d9b640 1 --2- 172.21.15.22:0/1452341633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa3a9cbc60 0x55fa3a9cf8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.267+0000 7f3f91d9b640 1 -- 172.21.15.22:0/1452341633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa3a9cfe20 msgr2=0x55fa3a9d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:57.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.267+0000 7f3f91d9b640 1 --2- 172.21.15.22:0/1452341633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa3a9cfe20 0x55fa3a9d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.267+0000 7f3f91d9b640 1 -- 172.21.15.22:0/1452341633 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3a9c96b0 con 0x55fa3a9bfcd0 2024-08-20T01:35:57.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.268+0000 7f3f91d9b640 1 --2- 172.21.15.22:0/1452341633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bfcd0 0x55fa3a9d44b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400b2c0 tx=0x7f3f84029040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98addc6b9a0f21ba server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:57.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.268+0000 7f3f79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:35:57.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.268+0000 7f3f79ffb640 1 -- 172.21.15.22:0/1452341633 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8403a020 con 0x55fa3a9bfcd0 2024-08-20T01:35:57.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.269+0000 7f3f79ffb640 1 -- 172.21.15.22:0/1452341633 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f3f84003e00 con 0x55fa3a9bfcd0 2024-08-20T01:35:57.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.269+0000 7f3f9af20740 1 -- 172.21.15.22:0/1452341633 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fa3a933330 con 0x55fa3a9bfcd0 2024-08-20T01:35:57.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.269+0000 7f3f79ffb640 1 -- 172.21.15.22:0/1452341633 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3f84022070 con 0x55fa3a9bfcd0 2024-08-20T01:35:57.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.269+0000 7f3f9af20740 10 client.25726 fetch_fsmap learned FSMap version 29 2024-08-20T01:35:57.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.269+0000 7f3f9af20740 1 -- 172.21.15.22:0/1452341633 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fa3a9cba90 con 0x55fa3a9bfcd0 2024-08-20T01:35:57.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.270+0000 7f3f79ffb640 1 -- 172.21.15.22:0/1452341633 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55fa3a933330 con 0x55fa3a9bfcd0 2024-08-20T01:35:57.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.270+0000 7f3f79ffb640 1 -- 172.21.15.22:0/1452341633 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3f84041030 con 0x55fa3a9bfcd0 2024-08-20T01:35:57.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.270+0000 7f3f9af20740 10 client.25726 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:35:57.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.270+0000 7f3f9af20740 10 client.25726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:35:57.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.270+0000 7f3f9af20740 20 client.25726 populate_metadata read hostname 'smithi022' 2024-08-20T01:35:57.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.270+0000 7f3f9af20740 1 --2- 172.21.15.22:0/1452341633 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fa3aa475a0 0x55fa3aa499e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.270+0000 7f3f9af20740 4 client.25726 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:35:57.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.270+0000 7f3f9af20740 1 -- 172.21.15.22:0/1452341633 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fa3a930a70 con 0x55fa3aa475a0 2024-08-20T01:35:57.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.274+0000 7f3f9259c640 1 --2- 172.21.15.22:0/1452341633 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fa3aa475a0 0x55fa3aa499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.281+0000 7f3f9259c640 1 --2- 172.21.15.22:0/1452341633 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fa3aa475a0 0x55fa3aa499e0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96f5725cbc7b0c46 server_cookie=c3304e38a400de89 in_seq=0 out_seq=0 2024-08-20T01:35:57.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.281+0000 7f3f79ffb640 10 client.25726 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:57.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.284+0000 7f3f79ffb640 1 -- 172.21.15.22:0/1452341633 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fa3a930a70 con 0x55fa3aa475a0 2024-08-20T01:35:57.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.284+0000 7f3f79ffb640 10 client.25726 handle_command_reply: tid=0 2024-08-20T01:35:57.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.284+0000 7f3f9af20740 1 client.25726 shutdown 2024-08-20T01:35:57.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.292+0000 7f3f9af20740 1 -- 172.21.15.22:0/1452341633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bfcd0 msgr2=0x55fa3a9d44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:57.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.292+0000 7f3f9af20740 1 --2- 172.21.15.22:0/1452341633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bfcd0 0x55fa3a9d44b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400b2c0 tx=0x7f3f84029040 comp rx=0 tx=0).stop 2024-08-20T01:35:57.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.296+0000 7f3f9af20740 1 -- 172.21.15.22:0/1452341633 shutdown_connections 2024-08-20T01:35:57.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.296+0000 7f3f9af20740 1 --2- 172.21.15.22:0/1452341633 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fa3aa475a0 0x55fa3aa499e0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.296+0000 7f3f9af20740 1 --2- 172.21.15.22:0/1452341633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa3a9cfe20 0x55fa3a9d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.296+0000 7f3f9af20740 1 --2- 172.21.15.22:0/1452341633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa3a9cbc60 0x55fa3a9cf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.296+0000 7f3f9af20740 1 --2- 172.21.15.22:0/1452341633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa3a9bfcd0 0x55fa3a9d44b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.296+0000 7f3f9af20740 1 -- 172.21.15.22:0/1452341633 >> 172.21.15.22:0/1452341633 conn(0x55fa3a9bd1e0 msgr2=0x55fa3a9c2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:57.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.296+0000 7f3f79ffb640 0 client.25726 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:57.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.296+0000 7f3f9af20740 1 -- 172.21.15.22:0/1452341633 shutdown_connections 2024-08-20T01:35:57.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.297+0000 7f3f9af20740 1 -- 172.21.15.22:0/1452341633 wait complete. 2024-08-20T01:35:57.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.297+0000 7f3f9af20740 20 client.25726 trim_cache size 0 max 16384 2024-08-20T01:35:57.311 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:35:57.312 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-08-20T01:35:57.312 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "c41375a5-efda-4ff7-83eb-c35aa2233f94", 2024-08-20T01:35:57.312 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-08-20T01:35:57.312 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:35:57.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.303+0000 7f3f98b27640 1 -- 172.21.15.22:0/4179207472 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3f7c0b3de0 msgr2=0x7f3f7c0b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:57.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.303+0000 7f3f98b27640 1 --2- 172.21.15.22:0/4179207472 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3f7c0b3de0 0x7f3f7c0b62a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3f88005ab0 tx=0x7f3f8803b500 comp rx=0 tx=0).stop 2024-08-20T01:35:57.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.303+0000 7f3f98b27640 1 -- 172.21.15.22:0/4179207472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f941180c0 msgr2=0x7f3f941abd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:57.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.303+0000 7f3f98b27640 1 --2- 172.21.15.22:0/4179207472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f941180c0 0x7f3f941abd80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3f8803ba70 tx=0x7f3f88004960 comp rx=0 tx=0).stop 2024-08-20T01:35:57.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.306+0000 7f3f98b27640 1 -- 172.21.15.22:0/4179207472 shutdown_connections 2024-08-20T01:35:57.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.306+0000 7f3f98b27640 1 --2- 172.21.15.22:0/4179207472 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3f7c0b3de0 0x7f3f7c0b62a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.306+0000 7f3f98b27640 1 --2- 172.21.15.22:0/4179207472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f941180c0 0x7f3f941abd80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.306+0000 7f3f98b27640 1 --2- 172.21.15.22:0/4179207472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f94117740 0x7f3f94117b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.306+0000 7f3f98b27640 1 --2- 172.21.15.22:0/4179207472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f9411bdd0 0x7f3f9411b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.306+0000 7f3f98b27640 1 -- 172.21.15.22:0/4179207472 >> 172.21.15.22:0/4179207472 conn(0x7f3f9406dcc0 msgr2=0x7f3f940728f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:57.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.308+0000 7f3f98b27640 1 -- 172.21.15.22:0/4179207472 shutdown_connections 2024-08-20T01:35:57.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:35:57.308+0000 7f3f98b27640 1 -- 172.21.15.22:0/4179207472 wait complete. 2024-08-20T01:35:57.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:56 smithi077 ceph-mon[22251]: pgmap v490: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.6 MiB/s wr, 371 op/s 2024-08-20T01:35:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.397+0000 7f9219740640 1 -- 172.21.15.22:0/1879342240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9214073a00 msgr2=0x7f9214073e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.397+0000 7f9219740640 1 --2- 172.21.15.22:0/1879342240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9214073a00 0x7f9214073e80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f920c009ca0 tx=0x7f920c02a8f0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.397+0000 7f9219740640 1 -- 172.21.15.22:0/1879342240 shutdown_connections 2024-08-20T01:35:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.397+0000 7f9219740640 1 --2- 172.21.15.22:0/1879342240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92140743c0 0x7f921407af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.397+0000 7f9219740640 1 --2- 172.21.15.22:0/1879342240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9214073a00 0x7f9214073e80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.397+0000 7f9219740640 1 --2- 172.21.15.22:0/1879342240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f921410a130 0x7f921410a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.397+0000 7f9219740640 1 -- 172.21.15.22:0/1879342240 >> 172.21.15.22:0/1879342240 conn(0x7f921406f550 msgr2=0x7f9214071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.397+0000 7f9219740640 1 -- 172.21.15.22:0/1879342240 shutdown_connections 2024-08-20T01:35:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.397+0000 7f9219740640 1 -- 172.21.15.22:0/1879342240 wait complete. 2024-08-20T01:35:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.398+0000 7f9219740640 1 Processor -- start 2024-08-20T01:35:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.398+0000 7f9219740640 1 -- start start 2024-08-20T01:35:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.399+0000 7f9219740640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9214073a00 0x7f9214085940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.399+0000 7f9219740640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92140743c0 0x7f92140841a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.399+0000 7f9219740640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f921410a130 0x7f9214084800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.399+0000 7f9219740640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f921407e840 con 0x7f921410a130 2024-08-20T01:35:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.399+0000 7f9219740640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f921407e6c0 con 0x7f92140743c0 2024-08-20T01:35:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.399+0000 7f9219740640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f921407e9c0 con 0x7f9214073a00 2024-08-20T01:35:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.399+0000 7f92137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92140743c0 0x7f92140841a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.399+0000 7f92137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92140743c0 0x7f92140841a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:60420/0 (socket says 172.21.15.22:60420) 2024-08-20T01:35:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.399+0000 7f92137fe640 1 -- 172.21.15.22:0/1065921335 learned_addr learned my addr 172.21.15.22:0/1065921335 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.399+0000 7f9218f3f640 1 --2- 172.21.15.22:0/1065921335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f921410a130 0x7f9214084800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.399+0000 7f9213fff640 1 --2- 172.21.15.22:0/1065921335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9214073a00 0x7f9214085940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.403+0000 7f9213fff640 1 -- 172.21.15.22:0/1065921335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92140743c0 msgr2=0x7f92140841a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.403+0000 7f9213fff640 1 --2- 172.21.15.22:0/1065921335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92140743c0 0x7f92140841a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.403+0000 7f9213fff640 1 -- 172.21.15.22:0/1065921335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f921410a130 msgr2=0x7f9214084800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.403+0000 7f9213fff640 1 --2- 172.21.15.22:0/1065921335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f921410a130 0x7f9214084800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.403+0000 7f9213fff640 1 -- 172.21.15.22:0/1065921335 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92141330e0 con 0x7f9214073a00 2024-08-20T01:35:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.404+0000 7f9213fff640 1 --2- 172.21.15.22:0/1065921335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9214073a00 0x7f9214085940 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9204009fd0 tx=0x7f920400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:57.463 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.453+0000 7f92117fa640 1 -- 172.21.15.22:0/1065921335 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204015020 con 0x7f9214073a00 2024-08-20T01:35:57.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.453+0000 7f9219740640 1 -- 172.21.15.22:0/1065921335 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92141333d0 con 0x7f9214073a00 2024-08-20T01:35:57.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.453+0000 7f9219740640 1 -- 172.21.15.22:0/1065921335 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9214133920 con 0x7f9214073a00 2024-08-20T01:35:57.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.459+0000 7f921d868740 1 Processor -- start 2024-08-20T01:35:57.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.459+0000 7f921d868740 1 -- start start 2024-08-20T01:35:57.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.459+0000 7f921d868740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad4fa20 0x5579dad51e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.459+0000 7f921d868740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad52350 0x5579dad54740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.459+0000 7f921d868740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad54d90 0x5579dad57250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.459+0000 7f921d868740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5579dacc2360 con 0x5579dad4fa20 2024-08-20T01:35:57.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.459+0000 7f921d868740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5579dacb1860 con 0x5579dad54d90 2024-08-20T01:35:57.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.459+0000 7f921d868740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5579dacb58a0 con 0x5579dad52350 2024-08-20T01:35:57.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.460+0000 7f92137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad54d90 0x5579dad57250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.460+0000 7f92137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad54d90 0x5579dad57250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:60432/0 (socket says 172.21.15.22:60432) 2024-08-20T01:35:57.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.460+0000 7f92137fe640 1 -- 172.21.15.22:0/3943545475 learned_addr learned my addr 172.21.15.22:0/3943545475 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:57.465 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.460+0000 7f9213fff640 1 --2- 172.21.15.22:0/3943545475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad52350 0x5579dad54740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.465 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.460+0000 7f92137fe640 1 -- 172.21.15.22:0/3943545475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad52350 msgr2=0x5579dad54740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:57.465 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.460+0000 7f92137fe640 1 --2- 172.21.15.22:0/3943545475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad52350 0x5579dad54740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.465 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.460+0000 7f92137fe640 1 -- 172.21.15.22:0/3943545475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad4fa20 msgr2=0x5579dad51e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:57.465 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.460+0000 7f92137fe640 1 --2- 172.21.15.22:0/3943545475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad4fa20 0x5579dad51e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.465 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.460+0000 7f92137fe640 1 -- 172.21.15.22:0/3943545475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579dac58e40 con 0x5579dad54d90 2024-08-20T01:35:57.465 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.460+0000 7f92137fe640 1 --2- 172.21.15.22:0/3943545475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad54d90 0x5579dad57250 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f920c009950 tx=0x7f920c009980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16c8a20940ea0c45 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.463+0000 7f92117fa640 1 -- 172.21.15.22:0/1065921335 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9204011ce0 con 0x7f9214073a00 2024-08-20T01:35:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.463+0000 7f92117fa640 1 -- 172.21.15.22:0/1065921335 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204010e00 con 0x7f9214073a00 2024-08-20T01:35:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.463+0000 7f92117fa640 1 -- 172.21.15.22:0/1065921335 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9204018020 con 0x7f9214073a00 2024-08-20T01:35:57.482 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.480+0000 7f92117fa640 1 --2- 172.21.15.22:0/1065921335 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f91fc0b3e10 0x7f91fc0b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.483 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.481+0000 7f92117fa640 1 -- 172.21.15.22:0/1065921335 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f92040e44a0 con 0x7f9214073a00 2024-08-20T01:35:57.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.484+0000 7f9218f3f640 1 --2- 172.21.15.22:0/1065921335 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f91fc0b3e10 0x7f91fc0b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.496+0000 7f9218f3f640 1 --2- 172.21.15.22:0/1065921335 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f91fc0b3e10 0x7f91fc0b62d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f920800b830 tx=0x7f9208008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.507+0000 7f91fa7fc640 1 -- 172.21.15.22:0/3943545475 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c031800 con 0x5579dad54d90 2024-08-20T01:35:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.507+0000 7f91fa7fc640 1 -- 172.21.15.22:0/3943545475 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f920c036040 con 0x5579dad54d90 2024-08-20T01:35:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.508+0000 7f921d868740 1 -- 172.21.15.22:0/3943545475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad54d90 msgr2=0x5579dad57250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.508+0000 7f921d868740 1 --2- 172.21.15.22:0/3943545475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad54d90 0x5579dad57250 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f920c009950 tx=0x7f920c009980 comp rx=0 tx=0).stop 2024-08-20T01:35:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.508+0000 7f921d868740 1 -- 172.21.15.22:0/3943545475 shutdown_connections 2024-08-20T01:35:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.508+0000 7f921d868740 1 --2- 172.21.15.22:0/3943545475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad54d90 0x5579dad57250 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.508+0000 7f921d868740 1 --2- 172.21.15.22:0/3943545475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad52350 0x5579dad54740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.508+0000 7f921d868740 1 --2- 172.21.15.22:0/3943545475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad4fa20 0x5579dad51e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.508+0000 7f921d868740 1 -- 172.21.15.22:0/3943545475 >> 172.21.15.22:0/3943545475 conn(0x5579dad4ab70 msgr2=0x5579dad4b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:57.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.607+0000 7f921d868740 1 -- 172.21.15.22:0/3943545475 shutdown_connections 2024-08-20T01:35:57.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.607+0000 7f921d868740 1 -- 172.21.15.22:0/3943545475 wait complete. 2024-08-20T01:35:57.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.608+0000 7f921d868740 1 -- start start 2024-08-20T01:35:57.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.608+0000 7f921d868740 1 Processor -- start 2024-08-20T01:35:57.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.608+0000 7f921d868740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad4fa20 0x5579dad591c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.608+0000 7f921d868740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad52350 0x5579dad59860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.608+0000 7f921d868740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad54d90 0x5579dad5a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.608+0000 7f921d868740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5579dabeaab0 con 0x5579dad52350 2024-08-20T01:35:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.608+0000 7f921d868740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5579dac38780 con 0x5579dad54d90 2024-08-20T01:35:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.608+0000 7f921d868740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5579dad57d60 con 0x5579dad4fa20 2024-08-20T01:35:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.608+0000 7f921d868740 10 client.0 _ll_register_callbacks cb 0x5579da9c0a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:35:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.609+0000 7f92137fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad52350 0x5579dad59860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.609+0000 7f92137fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad52350 0x5579dad59860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55926/0 (socket says 172.21.15.22:55926) 2024-08-20T01:35:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.609+0000 7f92137fe640 1 -- 172.21.15.22:0/4163762694 learned_addr learned my addr 172.21.15.22:0/4163762694 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.609+0000 7f9218f3f640 1 --2- 172.21.15.22:0/4163762694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad54d90 0x5579dad5a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.609+0000 7f9213fff640 1 --2- 172.21.15.22:0/4163762694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad4fa20 0x5579dad591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.609+0000 7f92137fe640 1 -- 172.21.15.22:0/4163762694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad4fa20 msgr2=0x5579dad591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.609+0000 7f92137fe640 1 --2- 172.21.15.22:0/4163762694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad4fa20 0x5579dad591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.609+0000 7f92137fe640 1 -- 172.21.15.22:0/4163762694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad54d90 msgr2=0x5579dad5a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.609+0000 7f92137fe640 1 --2- 172.21.15.22:0/4163762694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad54d90 0x5579dad5a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.609+0000 7f92137fe640 1 -- 172.21.15.22:0/4163762694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579daa14790 con 0x5579dad52350 2024-08-20T01:35:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.610+0000 7f9213fff640 1 --2- 172.21.15.22:0/4163762694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad4fa20 0x5579dad591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:35:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.610+0000 7f92137fe640 1 --2- 172.21.15.22:0/4163762694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad52350 0x5579dad59860 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f920c009a60 tx=0x7f920c031760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72cb17d71c1e392 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.611+0000 7f91f7ff7640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:35:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.613+0000 7f91f7ff7640 1 -- 172.21.15.22:0/4163762694 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c02f8a0 con 0x5579dad52350 2024-08-20T01:35:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.614+0000 7f921d868740 1 -- 172.21.15.22:0/4163762694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5579dac60e00 con 0x5579dad52350 2024-08-20T01:35:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.614+0000 7f91f7ff7640 1 -- 172.21.15.22:0/4163762694 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f920c02fa40 con 0x5579dad52350 2024-08-20T01:35:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.615+0000 7f91f7ff7640 1 -- 172.21.15.22:0/4163762694 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f920c02fc40 con 0x5579dad52350 2024-08-20T01:35:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.615+0000 7f921d868740 10 client.16107 fetch_fsmap learned FSMap version 29 2024-08-20T01:35:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.615+0000 7f921d868740 1 -- 172.21.15.22:0/4163762694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5579daa8d620 con 0x5579dad52350 2024-08-20T01:35:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.616+0000 7f91f7ff7640 1 -- 172.21.15.22:0/4163762694 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5579dac60e00 con 0x5579dad52350 2024-08-20T01:35:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.618+0000 7f91f7ff7640 1 -- 172.21.15.22:0/4163762694 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f920c030760 con 0x5579dad52350 2024-08-20T01:35:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.618+0000 7f921d868740 10 client.16107 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:35:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.618+0000 7f921d868740 10 client.16107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:35:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.618+0000 7f921d868740 20 client.16107 populate_metadata read hostname 'smithi022' 2024-08-20T01:35:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.618+0000 7f921d868740 1 --2- 172.21.15.22:0/4163762694 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5579dad64c40 0x5579dad670c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.618+0000 7f921d868740 4 client.16107 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:35:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.618+0000 7f921d868740 1 -- 172.21.15.22:0/4163762694 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579dacc42b0 con 0x5579dad64c40 2024-08-20T01:35:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.618+0000 7f9213fff640 1 --2- 172.21.15.22:0/4163762694 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5579dad64c40 0x5579dad670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.619+0000 7f9213fff640 1 --2- 172.21.15.22:0/4163762694 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5579dad64c40 0x5579dad670c0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c465d84ae32761a server_cookie=39f67572df588aff in_seq=0 out_seq=0 2024-08-20T01:35:57.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.619+0000 7f91f7ff7640 10 client.16107 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:57.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.620+0000 7f91f7ff7640 1 -- 172.21.15.22:0/4163762694 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5579dacc42b0 con 0x5579dad64c40 2024-08-20T01:35:57.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.620+0000 7f91f7ff7640 10 client.16107 handle_command_reply: tid=0 2024-08-20T01:35:57.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.620+0000 7f921d868740 1 client.16107 shutdown 2024-08-20T01:35:57.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.620+0000 7f921d868740 1 -- 172.21.15.22:0/4163762694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad52350 msgr2=0x5579dad59860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:57.623 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.620+0000 7f921d868740 1 --2- 172.21.15.22:0/4163762694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad52350 0x5579dad59860 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f920c009a60 tx=0x7f920c031760 comp rx=0 tx=0).stop 2024-08-20T01:35:57.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.657+0000 7f921d868740 1 -- 172.21.15.22:0/4163762694 shutdown_connections 2024-08-20T01:35:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.657+0000 7f921d868740 1 --2- 172.21.15.22:0/4163762694 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5579dad64c40 0x5579dad670c0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.657+0000 7f921d868740 1 --2- 172.21.15.22:0/4163762694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad54d90 0x5579dad5a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.657+0000 7f921d868740 1 --2- 172.21.15.22:0/4163762694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad52350 0x5579dad59860 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.657+0000 7f921d868740 1 --2- 172.21.15.22:0/4163762694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad4fa20 0x5579dad591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.657+0000 7f921d868740 1 -- 172.21.15.22:0/4163762694 >> 172.21.15.22:0/4163762694 conn(0x5579dad4ab70 msgr2=0x5579dad49c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.657+0000 7f91f7ff7640 0 client.16107 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.657+0000 7f921d868740 1 -- 172.21.15.22:0/4163762694 shutdown_connections 2024-08-20T01:35:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.657+0000 7f921d868740 1 -- 172.21.15.22:0/4163762694 wait complete. 2024-08-20T01:35:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:57.657+0000 7f921d868740 20 client.16107 trim_cache size 0 max 16384 2024-08-20T01:35:58.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.086+0000 7f921d868740 1 Processor -- start 2024-08-20T01:35:58.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.096+0000 7f921d868740 1 -- start start 2024-08-20T01:35:58.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.097+0000 7f921d868740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad4ab70 0x5579dad4f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:58.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.097+0000 7f921d868740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad4fa20 0x5579dad4b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:58.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.097+0000 7f9213fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad4ab70 0x5579dad4f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:58.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.097+0000 7f9213fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad4ab70 0x5579dad4f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55938/0 (socket says 172.21.15.22:55938) 2024-08-20T01:35:58.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.098+0000 7f9213fff640 1 -- 172.21.15.22:0/1978064928 learned_addr learned my addr 172.21.15.22:0/1978064928 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:58.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.098+0000 7f92137fe640 1 --2- 172.21.15.22:0/1978064928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad4fa20 0x5579dad4b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.098+0000 7f921d868740 1 --2- 172.21.15.22:0/1978064928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad52350 0x5579dad591c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.098+0000 7f921d868740 1 -- 172.21.15.22:0/1978064928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9200010f20 con 0x5579dad4ab70 2024-08-20T01:35:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.098+0000 7f9218f3f640 1 --2- 172.21.15.22:0/1978064928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad52350 0x5579dad591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.098+0000 7f921d868740 1 -- 172.21.15.22:0/1978064928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f920000e790 con 0x5579dad4fa20 2024-08-20T01:35:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.099+0000 7f921d868740 1 -- 172.21.15.22:0/1978064928 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f920000c690 con 0x5579dad52350 2024-08-20T01:35:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.099+0000 7f9213fff640 1 -- 172.21.15.22:0/1978064928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad52350 msgr2=0x5579dad591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.099+0000 7f9213fff640 1 --2- 172.21.15.22:0/1978064928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad52350 0x5579dad591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.099+0000 7f9213fff640 1 -- 172.21.15.22:0/1978064928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad4fa20 msgr2=0x5579dad4b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.099+0000 7f9213fff640 1 --2- 172.21.15.22:0/1978064928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad4fa20 0x5579dad4b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.099+0000 7f9213fff640 1 -- 172.21.15.22:0/1978064928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579dad5a7a0 con 0x5579dad4ab70 2024-08-20T01:35:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.100+0000 7f9213fff640 1 --2- 172.21.15.22:0/1978064928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad4ab70 0x5579dad4f490 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f92040ab0d0 tx=0x7f92040ce040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53eea75ee2a35b27 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:58.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:57 smithi022 ceph-mon[18709]: scrub queued for path: / 2024-08-20T01:35:58.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:57 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:35:58.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:57 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:35:58.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:57 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:35:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.142+0000 7f91f9ffb640 1 -- 172.21.15.22:0/1978064928 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92040aaee0 con 0x5579dad4ab70 2024-08-20T01:35:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.142+0000 7f91f9ffb640 1 -- 172.21.15.22:0/1978064928 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92040abad0 con 0x5579dad4ab70 2024-08-20T01:35:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.142+0000 7f91f9ffb640 1 -- 172.21.15.22:0/1978064928 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92040e2090 con 0x5579dad4ab70 2024-08-20T01:35:58.149 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.148+0000 7f921d868740 1 -- 172.21.15.22:0/1978064928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad4ab70 msgr2=0x5579dad4f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:58.149 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.148+0000 7f921d868740 1 --2- 172.21.15.22:0/1978064928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad4ab70 0x5579dad4f490 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f92040ab0d0 tx=0x7f92040ce040 comp rx=0 tx=0).stop 2024-08-20T01:35:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.149+0000 7f921d868740 1 -- 172.21.15.22:0/1978064928 shutdown_connections 2024-08-20T01:35:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.149+0000 7f921d868740 1 --2- 172.21.15.22:0/1978064928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad52350 0x5579dad591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.149+0000 7f921d868740 1 --2- 172.21.15.22:0/1978064928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad4fa20 0x5579dad4b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:58.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.149+0000 7f921d868740 1 --2- 172.21.15.22:0/1978064928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad4ab70 0x5579dad4f490 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:58.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.149+0000 7f921d868740 1 -- 172.21.15.22:0/1978064928 >> 172.21.15.22:0/1978064928 conn(0x5579dad588c0 msgr2=0x5579dad4ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.163+0000 7f921d868740 1 -- 172.21.15.22:0/1978064928 shutdown_connections 2024-08-20T01:35:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.163+0000 7f921d868740 1 -- 172.21.15.22:0/1978064928 wait complete. 2024-08-20T01:35:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.164+0000 7f921d868740 1 -- start start 2024-08-20T01:35:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.164+0000 7f921d868740 1 Processor -- start 2024-08-20T01:35:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.165+0000 7f921d868740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad4ab70 0x5579dad5dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.165+0000 7f921d868740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad4fa20 0x5579dad5e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.165+0000 7f9213fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad4ab70 0x5579dad5dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.166+0000 7f9213fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad4ab70 0x5579dad5dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:43534/0 (socket says 172.21.15.22:43534) 2024-08-20T01:35:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.166+0000 7f9213fff640 1 -- 172.21.15.22:0/1429495453 learned_addr learned my addr 172.21.15.22:0/1429495453 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:35:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.166+0000 7f921d868740 1 --2- 172.21.15.22:0/1429495453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad52350 0x5579dad5ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.166+0000 7f92137fe640 1 --2- 172.21.15.22:0/1429495453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad4fa20 0x5579dad5e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.166+0000 7f9218f3f640 1 --2- 172.21.15.22:0/1429495453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad52350 0x5579dad5ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.167+0000 7f921d868740 1 -- 172.21.15.22:0/1429495453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f920000cc50 con 0x5579dad52350 2024-08-20T01:35:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.167+0000 7f921d868740 1 -- 172.21.15.22:0/1429495453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f920000e0c0 con 0x5579dad4fa20 2024-08-20T01:35:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.167+0000 7f921d868740 1 -- 172.21.15.22:0/1429495453 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f920000d320 con 0x5579dad4ab70 2024-08-20T01:35:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.167+0000 7f92137fe640 1 -- 172.21.15.22:0/1429495453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad4ab70 msgr2=0x5579dad5dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.167+0000 7f92137fe640 1 --2- 172.21.15.22:0/1429495453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad4ab70 0x5579dad5dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.167+0000 7f92137fe640 1 -- 172.21.15.22:0/1429495453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad52350 msgr2=0x5579dad5ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:35:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.167+0000 7f92137fe640 1 --2- 172.21.15.22:0/1429495453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad52350 0x5579dad5ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.167+0000 7f92137fe640 1 -- 172.21.15.22:0/1429495453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579dad52180 con 0x5579dad4fa20 2024-08-20T01:35:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.168+0000 7f92137fe640 1 --2- 172.21.15.22:0/1429495453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad4fa20 0x5579dad5e3b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f920c030cd0 tx=0x7f920c004970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72755a4ca322fd43 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.169+0000 7f921d868740 10 client.0 _ll_register_callbacks cb 0x7f92040e7da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:35:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.169+0000 7f921d868740 1 -- 172.21.15.22:0/1429495453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92040abad0 con 0x5579dad4fa20 2024-08-20T01:35:58.214 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.212+0000 7f91f7ff7640 10 client.25718 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:35:58.214 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.213+0000 7f91f7ff7640 1 -- 172.21.15.22:0/1429495453 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c02f7e0 con 0x5579dad4fa20 2024-08-20T01:35:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.213+0000 7f91f7ff7640 1 -- 172.21.15.22:0/1429495453 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f920c02f980 con 0x5579dad4fa20 2024-08-20T01:35:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.213+0000 7f91f7ff7640 1 -- 172.21.15.22:0/1429495453 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f920c0305f0 con 0x5579dad4fa20 2024-08-20T01:35:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.237+0000 7f921d868740 10 client.25718 fetch_fsmap learned FSMap version 29 2024-08-20T01:35:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.237+0000 7f921d868740 1 -- 172.21.15.22:0/1429495453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5579dad60720 con 0x5579dad4fa20 2024-08-20T01:35:58.242 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.241+0000 7f91f7ff7640 1 -- 172.21.15.22:0/1429495453 <== mon.2 v2:172.21.15.77:3300/0 4 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f920c030790 con 0x5579dad4fa20 2024-08-20T01:35:58.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.241+0000 7f921d868740 10 client.25718 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:35:58.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.241+0000 7f921d868740 10 client.25718 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:35:58.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.241+0000 7f921d868740 20 client.25718 populate_metadata read hostname 'smithi022' 2024-08-20T01:35:58.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.241+0000 7f921d868740 1 --2- 172.21.15.22:0/1429495453 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5579dad54d90 0x5579dadd1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:58.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.241+0000 7f921d868740 4 client.25718 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:35:58.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.241+0000 7f921d868740 1 -- 172.21.15.22:0/1429495453 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f92040abad0 con 0x5579dad54d90 2024-08-20T01:35:58.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.241+0000 7f9213fff640 1 --2- 172.21.15.22:0/1429495453 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5579dad54d90 0x5579dadd1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:58.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.242+0000 7f9213fff640 1 --2- 172.21.15.22:0/1429495453 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5579dad54d90 0x5579dadd1970 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7a211036391753f server_cookie=9a8b840810e6ac61 in_seq=0 out_seq=0 2024-08-20T01:35:58.245 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:35:58.244+0000 7f91f7ff7640 10 client.25718 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:35:58.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:57 smithi134 ceph-mon[22511]: scrub queued for path: / 2024-08-20T01:35:58.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:57 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:35:58.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:57 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:35:58.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:57 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:35:58.267 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:35:58 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i[52992]: 2024-08-20T01:35:58.017+0000 7f7703adc640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023d9 [...2,head] /volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/ auth{1=1,2=1} v143622 ap=2 f(v5 m2024-08-20T01:35:00.911502+0000 77=77+0) n(v8 rc2024-08-20T01:35:00.911502+0000 b1092227 78=77+1) (inest sync->mix g=1,2) caps={24937=pAsLsXsFs/pAsLsXsFsx@59} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x56492199eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000023d9:[<0x10000000399/blog-51 v85657>,<0x10000000208/blogtest_in v682>,<0x10000000201/src v2089>,<0x10000000006/blogbench-1.0 v1841>,<0x10000000005/tmp v120>,<0x100000001fb/client.0 v114>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v129>,<0x10000000001/sv_1 v145>,<0x10000000000/qa v134>,<0x1/volumes v126>]//[]","memoryvalue":"(2)0x100000023d9:[<0x10000000399/blog-51 v143622>,<0x10000000208/blogtest_in v3085>,<0x10000000201/src v2543>,<0x10000000006/blogbench-1.0 v2230>,<0x10000000005/tmp v497>,<0x100000001fb/client.0 v487>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v496>,<0x10000000001/sv_1 v500>,<0x10000000000/qa v484>,<0x1/volumes v482>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-20T01:33:36.108609+0000 73=73+0)","ondisk_value.rstat":"n(v0 rc2024-08-20T01:35:00.911502+0000 b1092227 78=77+1)","memory_value.dirstat":"f(v5 m2024-08-20T01:35:00.911502+0000 77=77+0)","memory_value.rstat":"n(v8 rc2024-08-20T01:35:00.911502+0000 b1092227 78=77+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-20T01:35:58.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:57 smithi077 ceph-mon[22251]: scrub queued for path: / 2024-08-20T01:35:58.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:57 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:35:58.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:57 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:35:58.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:57 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:35:59.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:58 smithi134 ceph-mon[22511]: pgmap v491: 97 pgs: 97 active+clean; 1.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 9.7 MiB/s wr, 695 op/s 2024-08-20T01:35:59.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:59 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:35:59.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:35:59 smithi134 ceph-mon[22511]: Scrub error on inode 0x100000023d9 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51) see mds.i log and `damage ls` output for details 2024-08-20T01:35:59.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:58 smithi077 ceph-mon[22251]: pgmap v491: 97 pgs: 97 active+clean; 1.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 9.7 MiB/s wr, 695 op/s 2024-08-20T01:35:59.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:58 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:35:59.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:35:58 smithi077 ceph-mon[22251]: Scrub error on inode 0x100000023d9 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51) see mds.i log and `damage ls` output for details 2024-08-20T01:35:59.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:58 smithi022 ceph-mon[18709]: pgmap v491: 97 pgs: 97 active+clean; 1.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 9.7 MiB/s wr, 695 op/s 2024-08-20T01:35:59.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:58 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:35:59.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:35:58 smithi022 ceph-mon[18709]: Scrub error on inode 0x100000023d9 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51) see mds.i log and `damage ls` output for details 2024-08-20T01:35:59.609 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:36:00.044 INFO:tasks.workunit.client.0.smithi022.stdout: 478 1781660 914 1237057 906 703056 1853 2024-08-20T01:36:01.236 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:00 smithi022 ceph-mon[18709]: pgmap v492: 97 pgs: 97 active+clean; 1.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 9.2 MiB/s wr, 617 op/s 2024-08-20T01:36:01.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:00 smithi134 ceph-mon[22511]: pgmap v492: 97 pgs: 97 active+clean; 1.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 9.2 MiB/s wr, 617 op/s 2024-08-20T01:36:01.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:00 smithi077 ceph-mon[22251]: pgmap v492: 97 pgs: 97 active+clean; 1.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 9.2 MiB/s wr, 617 op/s 2024-08-20T01:36:01.766 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:36:01 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i[52992]: 2024-08-20T01:36:01.413+0000 7f7703adc640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fde [...2,head] /volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/ auth{1=1,2=1} fragtree_t(*^3) v186615 ap=2 f(v13 m2024-08-20T01:35:47.415897+0000 214=214+0) n(v17 rc2024-08-20T01:35:47.415897+0000 b3687625 215=214+1) (inest sync->mix g=1,2) caps={24937=pAsLsXsFs/pAsLsXsFsx@2349} mcw={1=AsLsXsFs,2=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 importing=0 dirfrag=8 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x564922358c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000fde:[<0x10000000399/blog-14 v38184>,<0x10000000208/blogtest_in v363>,<0x10000000201/src v2025>,<0x10000000006/blogbench-1.0 v1777>,<0x10000000005/tmp v60>,<0x100000001fb/client.0 v56>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v71>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v82>,<0x1/volumes v76>]//[]","memoryvalue":"(2)0x10000000fde:[<0x10000000399/blog-14 v186615>,<0x10000000208/blogtest_in v3102>,<0x10000000201/src v2550>,<0x10000000006/blogbench-1.0 v2232>,<0x10000000005/tmp v500>,<0x100000001fb/client.0 v490>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v499>,<0x10000000001/sv_1 v503>,<0x10000000000/qa v486>,<0x1/volumes v484>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-20T01:35:47.415897+0000 213=213+0)","ondisk_value.rstat":"n(v0 rc2024-08-20T01:35:47.415897+0000 b3687625 215=214+1)","memory_value.dirstat":"f(v13 m2024-08-20T01:35:47.415897+0000 214=214+0)","memory_value.rstat":"n(v17 rc2024-08-20T01:35:47.415897+0000 b3687625 215=214+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-20T01:36:03.268 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:02 smithi134 ceph-mon[22511]: Scrub error on inode 0x10000000fde (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14) see mds.i log and `damage ls` output for details 2024-08-20T01:36:03.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:02 smithi134 ceph-mon[22511]: pgmap v493: 97 pgs: 97 active+clean; 1.7 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 13 MiB/s wr, 1.16k op/s 2024-08-20T01:36:03.335 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:02 smithi077 ceph-mon[22251]: Scrub error on inode 0x10000000fde (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14) see mds.i log and `damage ls` output for details 2024-08-20T01:36:03.335 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:02 smithi077 ceph-mon[22251]: pgmap v493: 97 pgs: 97 active+clean; 1.7 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 13 MiB/s wr, 1.16k op/s 2024-08-20T01:36:03.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:02 smithi022 ceph-mon[18709]: Scrub error on inode 0x10000000fde (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14) see mds.i log and `damage ls` output for details 2024-08-20T01:36:03.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:02 smithi022 ceph-mon[18709]: pgmap v493: 97 pgs: 97 active+clean; 1.7 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 13 MiB/s wr, 1.16k op/s 2024-08-20T01:36:05.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:04 smithi134 ceph-mon[22511]: pgmap v494: 97 pgs: 97 active+clean; 1.7 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 1.65k op/s 2024-08-20T01:36:05.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:04 smithi077 ceph-mon[22251]: pgmap v494: 97 pgs: 97 active+clean; 1.7 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 1.65k op/s 2024-08-20T01:36:05.394 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:04 smithi022 ceph-mon[18709]: pgmap v494: 97 pgs: 97 active+clean; 1.7 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 1.65k op/s 2024-08-20T01:36:05.590 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.055+0000 7f91f7ff7640 1 -- 172.21.15.22:0/1429495453 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f92040abad0 con 0x5579dad54d90 2024-08-20T01:36:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.055+0000 7f91f7ff7640 10 client.25718 handle_command_reply: tid=0 2024-08-20T01:36:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.056+0000 7f921d868740 1 client.25718 shutdown 2024-08-20T01:36:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.056+0000 7f921d868740 1 -- 172.21.15.22:0/1429495453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad4fa20 msgr2=0x5579dad5e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.056+0000 7f921d868740 1 --2- 172.21.15.22:0/1429495453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad4fa20 0x5579dad5e3b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f920c030cd0 tx=0x7f920c004970 comp rx=0 tx=0).stop 2024-08-20T01:36:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.056+0000 7f921d868740 1 -- 172.21.15.22:0/1429495453 shutdown_connections 2024-08-20T01:36:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.056+0000 7f921d868740 1 --2- 172.21.15.22:0/1429495453 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5579dad54d90 0x5579dadd1970 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.056+0000 7f921d868740 1 --2- 172.21.15.22:0/1429495453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579dad52350 0x5579dad5ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.056+0000 7f921d868740 1 --2- 172.21.15.22:0/1429495453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579dad4fa20 0x5579dad5e3b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.056+0000 7f921d868740 1 --2- 172.21.15.22:0/1429495453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579dad4ab70 0x5579dad5dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.056+0000 7f921d868740 1 -- 172.21.15.22:0/1429495453 >> 172.21.15.22:0/1429495453 conn(0x5579dad588c0 msgr2=0x5579dad59180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:06.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.056+0000 7f91f7ff7640 0 client.25718 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:06.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.056+0000 7f921d868740 1 -- 172.21.15.22:0/1429495453 shutdown_connections 2024-08-20T01:36:06.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.056+0000 7f921d868740 1 -- 172.21.15.22:0/1429495453 wait complete. 2024-08-20T01:36:06.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.057+0000 7f921d868740 20 client.25718 trim_cache size 0 max 16384 2024-08-20T01:36:06.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:36:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:36:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:36:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:36:06.064 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.058+0000 7f9219740640 1 -- 172.21.15.22:0/1065921335 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f91fc0b3e10 msgr2=0x7f91fc0b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:06.064 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.058+0000 7f9219740640 1 --2- 172.21.15.22:0/1065921335 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f91fc0b3e10 0x7f91fc0b62d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f920800b830 tx=0x7f9208008040 comp rx=0 tx=0).stop 2024-08-20T01:36:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.058+0000 7f9219740640 1 -- 172.21.15.22:0/1065921335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9214073a00 msgr2=0x7f9214085940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.058+0000 7f9219740640 1 --2- 172.21.15.22:0/1065921335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9214073a00 0x7f9214085940 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9204009fd0 tx=0x7f920400b870 comp rx=0 tx=0).stop 2024-08-20T01:36:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.058+0000 7f9219740640 1 -- 172.21.15.22:0/1065921335 shutdown_connections 2024-08-20T01:36:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.059+0000 7f9219740640 1 --2- 172.21.15.22:0/1065921335 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f91fc0b3e10 0x7f91fc0b62d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.059+0000 7f9219740640 1 --2- 172.21.15.22:0/1065921335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f921410a130 0x7f9214084800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.059+0000 7f9219740640 1 --2- 172.21.15.22:0/1065921335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92140743c0 0x7f92140841a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.059+0000 7f9219740640 1 --2- 172.21.15.22:0/1065921335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9214073a00 0x7f9214085940 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.059+0000 7f9219740640 1 -- 172.21.15.22:0/1065921335 >> 172.21.15.22:0/1065921335 conn(0x7f921406f550 msgr2=0x7f92140770f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.059+0000 7f9219740640 1 -- 172.21.15.22:0/1065921335 shutdown_connections 2024-08-20T01:36:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:06.059+0000 7f9219740640 1 -- 172.21.15.22:0/1065921335 wait complete. 2024-08-20T01:36:06.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.315+0000 7f2f06477640 1 -- 172.21.15.22:0/1430016628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f00106bd0 msgr2=0x7f2f00107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:06.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.315+0000 7f2f06477640 1 --2- 172.21.15.22:0/1430016628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f00106bd0 0x7f2f00107020 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009be0 tx=0x7f2ef802a6f0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.315+0000 7f2f06477640 1 -- 172.21.15.22:0/1430016628 shutdown_connections 2024-08-20T01:36:06.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.315+0000 7f2f06477640 1 --2- 172.21.15.22:0/1430016628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f00106bd0 0x7f2f00107020 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.315+0000 7f2f06477640 1 --2- 172.21.15.22:0/1430016628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f001020b0 0x7f2f00106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.315+0000 7f2f06477640 1 --2- 172.21.15.22:0/1430016628 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f00101790 0x7f2f00101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.315+0000 7f2f06477640 1 -- 172.21.15.22:0/1430016628 >> 172.21.15.22:0/1430016628 conn(0x7f2f000fd400 msgr2=0x7f2f000ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:06.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.315+0000 7f2f06477640 1 -- 172.21.15.22:0/1430016628 shutdown_connections 2024-08-20T01:36:06.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.315+0000 7f2f06477640 1 -- 172.21.15.22:0/1430016628 wait complete. 2024-08-20T01:36:06.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.316+0000 7f2f06477640 1 Processor -- start 2024-08-20T01:36:06.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.316+0000 7f2f06477640 1 -- start start 2024-08-20T01:36:06.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.317+0000 7f2f06477640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f00101790 0x7f2f00074570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.317+0000 7f2f06477640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f001020b0 0x7f2f00074ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.317+0000 7f2f06477640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f00106bd0 0x7f2f0006e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.317+0000 7f2f06477640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0006d1a0 con 0x7f2f00106bd0 2024-08-20T01:36:06.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.317+0000 7f2f06477640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0006d020 con 0x7f2f001020b0 2024-08-20T01:36:06.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.317+0000 7f2f06477640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0006d320 con 0x7f2f00101790 2024-08-20T01:36:06.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.317+0000 7f2efffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f00101790 0x7f2f00074570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.318+0000 7f2efffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f00101790 0x7f2f00074570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:36864/0 (socket says 172.21.15.22:36864) 2024-08-20T01:36:06.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.318+0000 7f2efffff640 1 -- 172.21.15.22:0/3029161079 learned_addr learned my addr 172.21.15.22:0/3029161079 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:06.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.318+0000 7f2f04a14640 1 --2- 172.21.15.22:0/3029161079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f00106bd0 0x7f2f0006e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.318+0000 7f2eff7fe640 1 --2- 172.21.15.22:0/3029161079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f001020b0 0x7f2f00074ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.318+0000 7f2efffff640 1 -- 172.21.15.22:0/3029161079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f001020b0 msgr2=0x7f2f00074ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:06.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.318+0000 7f2efffff640 1 --2- 172.21.15.22:0/3029161079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f001020b0 0x7f2f00074ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.318+0000 7f2efffff640 1 -- 172.21.15.22:0/3029161079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f00106bd0 msgr2=0x7f2f0006e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:06.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.318+0000 7f2efffff640 1 --2- 172.21.15.22:0/3029161079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f00106bd0 0x7f2f0006e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.318+0000 7f2efffff640 1 -- 172.21.15.22:0/3029161079 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f0006f210 con 0x7f2f00101790 2024-08-20T01:36:06.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.319+0000 7f2efffff640 1 --2- 172.21.15.22:0/3029161079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f00101790 0x7f2f00074570 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000e9c0 tx=0x7f2ef000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:06.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.319+0000 7f2efd7fa640 1 -- 172.21.15.22:0/3029161079 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef000ccc0 con 0x7f2f00101790 2024-08-20T01:36:06.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.319+0000 7f2f06477640 1 -- 172.21.15.22:0/3029161079 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f0006f500 con 0x7f2f00101790 2024-08-20T01:36:06.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.319+0000 7f2f06477640 1 -- 172.21.15.22:0/3029161079 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f001b4840 con 0x7f2f00101790 2024-08-20T01:36:06.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.319+0000 7f2efd7fa640 1 -- 172.21.15.22:0/3029161079 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ef00054d0 con 0x7f2f00101790 2024-08-20T01:36:06.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.319+0000 7f2efd7fa640 1 -- 172.21.15.22:0/3029161079 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0010430 con 0x7f2f00101790 2024-08-20T01:36:06.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.326+0000 7f2efd7fa640 1 -- 172.21.15.22:0/3029161079 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2ef00046c0 con 0x7f2f00101790 2024-08-20T01:36:06.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.328+0000 7f2efd7fa640 1 --2- 172.21.15.22:0/3029161079 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2ee80b3d10 0x7f2ee80b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.328+0000 7f2eff7fe640 1 --2- 172.21.15.22:0/3029161079 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2ee80b3d10 0x7f2ee80b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.328+0000 7f2efd7fa640 1 -- 172.21.15.22:0/3029161079 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f2ef00e3f20 con 0x7f2f00101790 2024-08-20T01:36:06.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.329+0000 7f2f08870740 1 Processor -- start 2024-08-20T01:36:06.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.329+0000 7f2f08870740 1 -- start start 2024-08-20T01:36:06.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.329+0000 7f2f08870740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a4d830 0x5649b9a4dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.330+0000 7f2f08870740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4e150 0x5649b9a59ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.330+0000 7f2eff7fe640 1 --2- 172.21.15.22:0/3029161079 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2ee80b3d10 0x7f2ee80b61d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2f000742c0 tx=0x7f2ef400b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:06.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.330+0000 7f2efffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a4d830 0x5649b9a4dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.330+0000 7f2efffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a4d830 0x5649b9a4dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:36878/0 (socket says 172.21.15.22:36878) 2024-08-20T01:36:06.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.330+0000 7f2efffff640 1 -- 172.21.15.22:0/2558656938 learned_addr learned my addr 172.21.15.22:0/2558656938 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:06.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.330+0000 7f2f08870740 1 --2- 172.21.15.22:0/2558656938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a5a0e0 0x5649b9a5c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.330+0000 7f2f08870740 1 -- 172.21.15.22:0/2558656938 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5649b99c48e0 con 0x5649b9a5a0e0 2024-08-20T01:36:06.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.330+0000 7f2f08870740 1 -- 172.21.15.22:0/2558656938 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5649b99b3de0 con 0x5649b9a4e150 2024-08-20T01:36:06.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.330+0000 7f2f08870740 1 -- 172.21.15.22:0/2558656938 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5649b99b7e20 con 0x5649b9a4d830 2024-08-20T01:36:06.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.331+0000 7f2eff7fe640 1 --2- 172.21.15.22:0/2558656938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4e150 0x5649b9a59ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.331+0000 7f2f04a14640 1 --2- 172.21.15.22:0/2558656938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a5a0e0 0x5649b9a5c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.331+0000 7f2eff7fe640 1 -- 172.21.15.22:0/2558656938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a4d830 msgr2=0x5649b9a4dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:06.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.331+0000 7f2eff7fe640 1 --2- 172.21.15.22:0/2558656938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a4d830 0x5649b9a4dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.331+0000 7f2eff7fe640 1 -- 172.21.15.22:0/2558656938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a5a0e0 msgr2=0x5649b9a5c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:06.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.331+0000 7f2eff7fe640 1 --2- 172.21.15.22:0/2558656938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a5a0e0 0x5649b9a5c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.331+0000 7f2eff7fe640 1 -- 172.21.15.22:0/2558656938 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649b9713650 con 0x5649b9a4e150 2024-08-20T01:36:06.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.332+0000 7f2eff7fe640 1 --2- 172.21.15.22:0/2558656938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4e150 0x5649b9a59ba0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2f0006b650 tx=0x7f2ef4013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4dff9c665918d9a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:06.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.332+0000 7f2ee67fc640 1 -- 172.21.15.22:0/2558656938 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4004220 con 0x5649b9a4e150 2024-08-20T01:36:06.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.332+0000 7f2ee67fc640 1 -- 172.21.15.22:0/2558656938 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ef4010e60 con 0x5649b9a4e150 2024-08-20T01:36:06.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.332+0000 7f2ee67fc640 1 -- 172.21.15.22:0/2558656938 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef401e680 con 0x5649b9a4e150 2024-08-20T01:36:06.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.334+0000 7f2f08870740 1 -- 172.21.15.22:0/2558656938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4e150 msgr2=0x5649b9a59ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:06.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.334+0000 7f2f08870740 1 --2- 172.21.15.22:0/2558656938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4e150 0x5649b9a59ba0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2f0006b650 tx=0x7f2ef4013000 comp rx=0 tx=0).stop 2024-08-20T01:36:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.334+0000 7f2f08870740 1 -- 172.21.15.22:0/2558656938 shutdown_connections 2024-08-20T01:36:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.334+0000 7f2f08870740 1 --2- 172.21.15.22:0/2558656938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a5a0e0 0x5649b9a5c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.334+0000 7f2f08870740 1 --2- 172.21.15.22:0/2558656938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4e150 0x5649b9a59ba0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.334+0000 7f2f08870740 1 --2- 172.21.15.22:0/2558656938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a4d830 0x5649b9a4dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.334+0000 7f2f08870740 1 -- 172.21.15.22:0/2558656938 >> 172.21.15.22:0/2558656938 conn(0x5649b9a4b660 msgr2=0x5649b9a4c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:06.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.335+0000 7f2f08870740 1 -- 172.21.15.22:0/2558656938 shutdown_connections 2024-08-20T01:36:06.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.335+0000 7f2f08870740 1 -- 172.21.15.22:0/2558656938 wait complete. 2024-08-20T01:36:06.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.335+0000 7f2f08870740 1 -- start start 2024-08-20T01:36:06.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.336+0000 7f2f08870740 1 Processor -- start 2024-08-20T01:36:06.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.337+0000 7f2f08870740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4d830 0x5649b9a59b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.337+0000 7f2f08870740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a4e150 0x5649b9a56f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.337+0000 7f2f08870740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a5a0e0 0x5649b9a576e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.337+0000 7f2f08870740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5649b9816700 con 0x5649b9a4e150 2024-08-20T01:36:06.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.337+0000 7f2f08870740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5649b993a7c0 con 0x5649b9a4d830 2024-08-20T01:36:06.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.337+0000 7f2f08870740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5649b9a5cde0 con 0x5649b9a5a0e0 2024-08-20T01:36:06.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.337+0000 7f2f04a14640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a5a0e0 0x5649b9a576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.337+0000 7f2f04a14640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a5a0e0 0x5649b9a576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:36880/0 (socket says 172.21.15.22:36880) 2024-08-20T01:36:06.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.337+0000 7f2f04a14640 1 -- 172.21.15.22:0/1577992260 learned_addr learned my addr 172.21.15.22:0/1577992260 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:06.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.337+0000 7f2f08870740 10 client.0 _ll_register_callbacks cb 0x5649b99ad6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:06.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.338+0000 7f2eff7fe640 1 --2- 172.21.15.22:0/1577992260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a4e150 0x5649b9a56f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.338+0000 7f2efffff640 1 --2- 172.21.15.22:0/1577992260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4d830 0x5649b9a59b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.339+0000 7f2efffff640 1 -- 172.21.15.22:0/1577992260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a5a0e0 msgr2=0x5649b9a576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:06.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.339+0000 7f2efffff640 1 --2- 172.21.15.22:0/1577992260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a5a0e0 0x5649b9a576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.339+0000 7f2efffff640 1 -- 172.21.15.22:0/1577992260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a4e150 msgr2=0x5649b9a56f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:06.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.339+0000 7f2efffff640 1 --2- 172.21.15.22:0/1577992260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a4e150 0x5649b9a56f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.339+0000 7f2efffff640 1 -- 172.21.15.22:0/1577992260 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649b9a661f0 con 0x5649b9a4d830 2024-08-20T01:36:06.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.339+0000 7f2efffff640 1 --2- 172.21.15.22:0/1577992260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4d830 0x5649b9a59b00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00aaad0 tx=0x7f2ef0004b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d1177e697689fb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:06.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.339+0000 7f2edf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:36:06.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.339+0000 7f2edf7fe640 1 -- 172.21.15.22:0/1577992260 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef00c5060 con 0x5649b9a4d830 2024-08-20T01:36:06.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.340+0000 7f2edf7fe640 1 -- 172.21.15.22:0/1577992260 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f2ef00a6950 con 0x5649b9a4d830 2024-08-20T01:36:06.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.340+0000 7f2f08870740 1 -- 172.21.15.22:0/1577992260 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5649b9963100 con 0x5649b9a4d830 2024-08-20T01:36:06.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.340+0000 7f2edf7fe640 1 -- 172.21.15.22:0/1577992260 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2ef00cc050 con 0x5649b9a4d830 2024-08-20T01:36:06.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.340+0000 7f2f08870740 10 client.25730 fetch_fsmap learned FSMap version 29 2024-08-20T01:36:06.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.340+0000 7f2f08870740 1 -- 172.21.15.22:0/1577992260 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5649b9a68b30 con 0x5649b9a4d830 2024-08-20T01:36:06.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.341+0000 7f2edf7fe640 1 -- 172.21.15.22:0/1577992260 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ef00aa8e0 con 0x5649b9a4d830 2024-08-20T01:36:06.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.341+0000 7f2edf7fe640 1 -- 172.21.15.22:0/1577992260 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2ef0004f80 con 0x5649b9a4d830 2024-08-20T01:36:06.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.341+0000 7f2f08870740 10 client.25730 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:36:06.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.341+0000 7f2f08870740 10 client.25730 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:36:06.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.341+0000 7f2f08870740 20 client.25730 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:06.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.341+0000 7f2f08870740 1 --2- 172.21.15.22:0/1577992260 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5649b9a69ff0 0x5649b9a6c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.341+0000 7f2f08870740 4 client.25730 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:06.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.341+0000 7f2f08870740 1 -- 172.21.15.22:0/1577992260 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649b9963100 con 0x5649b9a69ff0 2024-08-20T01:36:06.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.343+0000 7f2eff7fe640 1 --2- 172.21.15.22:0/1577992260 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5649b9a69ff0 0x5649b9a6c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.347+0000 7f2eff7fe640 1 --2- 172.21.15.22:0/1577992260 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5649b9a69ff0 0x5649b9a6c400 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f20b4578bbd2ca64 server_cookie=25f98ef02e48cba0 in_seq=0 out_seq=0 2024-08-20T01:36:06.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.347+0000 7f2edf7fe640 10 client.25730 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:06.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.364+0000 7f2edf7fe640 1 -- 172.21.15.22:0/1577992260 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5649b9963100 con 0x5649b9a69ff0 2024-08-20T01:36:06.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.364+0000 7f2edf7fe640 10 client.25730 handle_command_reply: tid=0 2024-08-20T01:36:06.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.364+0000 7f2f08870740 1 client.25730 shutdown 2024-08-20T01:36:06.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.365+0000 7f2f08870740 1 -- 172.21.15.22:0/1577992260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4d830 msgr2=0x5649b9a59b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:06.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.365+0000 7f2f08870740 1 --2- 172.21.15.22:0/1577992260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4d830 0x5649b9a59b00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00aaad0 tx=0x7f2ef0004b60 comp rx=0 tx=0).stop 2024-08-20T01:36:06.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.365+0000 7f2f08870740 1 -- 172.21.15.22:0/1577992260 shutdown_connections 2024-08-20T01:36:06.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.365+0000 7f2f08870740 1 --2- 172.21.15.22:0/1577992260 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5649b9a69ff0 0x5649b9a6c400 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.365+0000 7f2f08870740 1 --2- 172.21.15.22:0/1577992260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a5a0e0 0x5649b9a576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.365+0000 7f2edf7fe640 0 client.25730 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:06.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.365+0000 7f2f08870740 1 --2- 172.21.15.22:0/1577992260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a4e150 0x5649b9a56f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.365+0000 7f2f08870740 1 --2- 172.21.15.22:0/1577992260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4d830 0x5649b9a59b00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.365+0000 7f2f08870740 1 -- 172.21.15.22:0/1577992260 >> 172.21.15.22:0/1577992260 conn(0x5649b9a4b660 msgr2=0x5649b9a51200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:06.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.366+0000 7f2f08870740 1 -- 172.21.15.22:0/1577992260 shutdown_connections 2024-08-20T01:36:06.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.366+0000 7f2f08870740 1 -- 172.21.15.22:0/1577992260 wait complete. 2024-08-20T01:36:06.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.366+0000 7f2f08870740 20 client.25730 trim_cache size 0 max 16384 2024-08-20T01:36:06.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.404+0000 7f2f08870740 1 Processor -- start 2024-08-20T01:36:06.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.406+0000 7f2f08870740 1 -- start start 2024-08-20T01:36:06.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.407+0000 7f2f08870740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a4d830 0x5649b9a4cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.407+0000 7f2f08870740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4e150 0x5649b9a58c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.407+0000 7f2efffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a4d830 0x5649b9a4cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.407+0000 7f2efffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a4d830 0x5649b9a4cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45698/0 (socket says 172.21.15.22:45698) 2024-08-20T01:36:06.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.407+0000 7f2efffff640 1 -- 172.21.15.22:0/2204342357 learned_addr learned my addr 172.21.15.22:0/2204342357 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:06.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.407+0000 7f2f08870740 1 --2- 172.21.15.22:0/2204342357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a5a0e0 0x5649b9a71d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.407+0000 7f2eff7fe640 1 --2- 172.21.15.22:0/2204342357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4e150 0x5649b9a58c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.408+0000 7f2f08870740 1 -- 172.21.15.22:0/2204342357 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec010f50 con 0x5649b9a4d830 2024-08-20T01:36:06.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.408+0000 7f2f08870740 1 -- 172.21.15.22:0/2204342357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec00e7c0 con 0x5649b9a4e150 2024-08-20T01:36:06.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.408+0000 7f2f04a14640 1 --2- 172.21.15.22:0/2204342357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a5a0e0 0x5649b9a71d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.408+0000 7f2f08870740 1 -- 172.21.15.22:0/2204342357 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec00c610 con 0x5649b9a5a0e0 2024-08-20T01:36:06.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.409+0000 7f2eff7fe640 1 -- 172.21.15.22:0/2204342357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a5a0e0 msgr2=0x5649b9a71d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:06.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.409+0000 7f2eff7fe640 1 --2- 172.21.15.22:0/2204342357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a5a0e0 0x5649b9a71d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.409+0000 7f2eff7fe640 1 -- 172.21.15.22:0/2204342357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a4d830 msgr2=0x5649b9a4cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:06.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.409+0000 7f2eff7fe640 1 --2- 172.21.15.22:0/2204342357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a4d830 0x5649b9a4cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.409+0000 7f2eff7fe640 1 -- 172.21.15.22:0/2204342357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649b9a57a50 con 0x5649b9a4e150 2024-08-20T01:36:06.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.410+0000 7f2eff7fe640 1 --2- 172.21.15.22:0/2204342357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4e150 0x5649b9a58c90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4011ca0 tx=0x7f2ef4003e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9df2713fb80aea0f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:06.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.412+0000 7f2ee5ffb640 1 -- 172.21.15.22:0/2204342357 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef400b7a0 con 0x5649b9a4e150 2024-08-20T01:36:06.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.412+0000 7f2ee5ffb640 1 -- 172.21.15.22:0/2204342357 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ef4003aa0 con 0x5649b9a4e150 2024-08-20T01:36:06.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.412+0000 7f2ee5ffb640 1 -- 172.21.15.22:0/2204342357 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4004370 con 0x5649b9a4e150 2024-08-20T01:36:06.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.413+0000 7f2f08870740 1 -- 172.21.15.22:0/2204342357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4e150 msgr2=0x5649b9a58c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:06.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.413+0000 7f2f08870740 1 --2- 172.21.15.22:0/2204342357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4e150 0x5649b9a58c90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4011ca0 tx=0x7f2ef4003e40 comp rx=0 tx=0).stop 2024-08-20T01:36:06.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.413+0000 7f2f08870740 1 -- 172.21.15.22:0/2204342357 shutdown_connections 2024-08-20T01:36:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.413+0000 7f2f08870740 1 --2- 172.21.15.22:0/2204342357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a5a0e0 0x5649b9a71d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.413+0000 7f2f08870740 1 --2- 172.21.15.22:0/2204342357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4e150 0x5649b9a58c90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.413+0000 7f2f08870740 1 --2- 172.21.15.22:0/2204342357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a4d830 0x5649b9a4cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.413+0000 7f2f08870740 1 -- 172.21.15.22:0/2204342357 >> 172.21.15.22:0/2204342357 conn(0x5649b9a4b660 msgr2=0x5649b9a58580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.415+0000 7f2f08870740 1 -- 172.21.15.22:0/2204342357 shutdown_connections 2024-08-20T01:36:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.415+0000 7f2f08870740 1 -- 172.21.15.22:0/2204342357 wait complete. 2024-08-20T01:36:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.415+0000 7f2f08870740 1 -- start start 2024-08-20T01:36:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.416+0000 7f2f08870740 1 Processor -- start 2024-08-20T01:36:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.416+0000 7f2f08870740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4d830 0x5649b9a62160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.417+0000 7f2f08870740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a4e150 0x5649b9a626a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.417+0000 7f2efffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4d830 0x5649b9a62160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.417+0000 7f2efffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4d830 0x5649b9a62160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:40964/0 (socket says 172.21.15.22:40964) 2024-08-20T01:36:06.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.417+0000 7f2efffff640 1 -- 172.21.15.22:0/3483922847 learned_addr learned my addr 172.21.15.22:0/3483922847 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.417+0000 7f2f08870740 1 --2- 172.21.15.22:0/3483922847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a5a0e0 0x5649b9a5d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.417+0000 7f2f08870740 1 -- 172.21.15.22:0/3483922847 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec00cc80 con 0x5649b9a4e150 2024-08-20T01:36:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.417+0000 7f2f08870740 1 -- 172.21.15.22:0/3483922847 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec00e0f0 con 0x5649b9a4d830 2024-08-20T01:36:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.417+0000 7f2f08870740 1 -- 172.21.15.22:0/3483922847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec00d350 con 0x5649b9a5a0e0 2024-08-20T01:36:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.418+0000 7f2f04a14640 1 --2- 172.21.15.22:0/3483922847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a5a0e0 0x5649b9a5d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.418+0000 7f2efffff640 1 -- 172.21.15.22:0/3483922847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a5a0e0 msgr2=0x5649b9a5d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.418+0000 7f2efffff640 1 --2- 172.21.15.22:0/3483922847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a5a0e0 0x5649b9a5d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.418+0000 7f2efffff640 1 -- 172.21.15.22:0/3483922847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a4e150 msgr2=0x5649b9a626a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.418+0000 7f2efffff640 1 --2- 172.21.15.22:0/3483922847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a4e150 0x5649b9a626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.418+0000 7f2efffff640 1 -- 172.21.15.22:0/3483922847 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649b9a4df80 con 0x5649b9a4d830 2024-08-20T01:36:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.419+0000 7f2f08870740 10 client.0 _ll_register_callbacks cb 0x7f2ef000ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.419+0000 7f2efffff640 1 --2- 172.21.15.22:0/3483922847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4d830 0x5649b9a62160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00a8040 tx=0x7f2ef0005460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2eec69738a4d4951 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.419+0000 7f2f08870740 1 -- 172.21.15.22:0/3483922847 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5649b99c6830 con 0x5649b9a4d830 2024-08-20T01:36:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.419+0000 7f2edf7fe640 10 client.25736 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:36:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.421+0000 7f2edf7fe640 1 -- 172.21.15.22:0/3483922847 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef00aa720 con 0x5649b9a4d830 2024-08-20T01:36:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.422+0000 7f2edf7fe640 1 -- 172.21.15.22:0/3483922847 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f2ef00b0560 con 0x5649b9a4d830 2024-08-20T01:36:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.422+0000 7f2edf7fe640 1 -- 172.21.15.22:0/3483922847 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2ef00af420 con 0x5649b9a4d830 2024-08-20T01:36:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.422+0000 7f2f08870740 10 client.25736 fetch_fsmap learned FSMap version 29 2024-08-20T01:36:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.422+0000 7f2f08870740 1 -- 172.21.15.22:0/3483922847 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5649b9ad5250 con 0x5649b9a4d830 2024-08-20T01:36:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.423+0000 7f2edf7fe640 1 -- 172.21.15.22:0/3483922847 <== mon.2 v2:172.21.15.77:3300/0 4 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2ef00920b0 con 0x5649b9a4d830 2024-08-20T01:36:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.423+0000 7f2f08870740 10 client.25736 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:36:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.423+0000 7f2f08870740 10 client.25736 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:36:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.423+0000 7f2f08870740 20 client.25736 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.423+0000 7f2f08870740 1 --2- 172.21.15.22:0/3483922847 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5649b9a69ff0 0x5649b9ad7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.423+0000 7f2f08870740 4 client.25736 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:36:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.423+0000 7f2f08870740 1 -- 172.21.15.22:0/3483922847 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5649b99c6830 con 0x5649b9a69ff0 2024-08-20T01:36:06.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.424+0000 7f2eff7fe640 1 --2- 172.21.15.22:0/3483922847 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5649b9a69ff0 0x5649b9ad7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.425+0000 7f2eff7fe640 1 --2- 172.21.15.22:0/3483922847 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5649b9a69ff0 0x5649b9ad7820 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8534570e49afa839 server_cookie=878cbf8bb4b61768 in_seq=0 out_seq=0 2024-08-20T01:36:06.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.425+0000 7f2edf7fe640 10 client.25736 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:06.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.431+0000 7f2edf7fe640 1 -- 172.21.15.22:0/3483922847 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x5649b99c6830 con 0x5649b9a69ff0 2024-08-20T01:36:06.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.431+0000 7f2edf7fe640 10 client.25736 handle_command_reply: tid=0 2024-08-20T01:36:06.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.431+0000 7f2f08870740 1 client.25736 shutdown 2024-08-20T01:36:06.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.431+0000 7f2f08870740 1 -- 172.21.15.22:0/3483922847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4d830 msgr2=0x5649b9a62160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:06.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.431+0000 7f2f08870740 1 --2- 172.21.15.22:0/3483922847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4d830 0x5649b9a62160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00a8040 tx=0x7f2ef0005460 comp rx=0 tx=0).stop 2024-08-20T01:36:06.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.432+0000 7f2f08870740 1 -- 172.21.15.22:0/3483922847 shutdown_connections 2024-08-20T01:36:06.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.432+0000 7f2f08870740 1 --2- 172.21.15.22:0/3483922847 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5649b9a69ff0 0x5649b9ad7820 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.432+0000 7f2f08870740 1 --2- 172.21.15.22:0/3483922847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649b9a5a0e0 0x5649b9a5d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.432+0000 7f2f08870740 1 --2- 172.21.15.22:0/3483922847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5649b9a4e150 0x5649b9a626a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.432+0000 7f2f08870740 1 --2- 172.21.15.22:0/3483922847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5649b9a4d830 0x5649b9a62160 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.432+0000 7f2f08870740 1 -- 172.21.15.22:0/3483922847 >> 172.21.15.22:0/3483922847 conn(0x5649b9a4b660 msgr2=0x5649b9a58da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:06.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.432+0000 7f2edf7fe640 0 client.25736 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:06.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.432+0000 7f2f08870740 1 -- 172.21.15.22:0/3483922847 shutdown_connections 2024-08-20T01:36:06.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.432+0000 7f2f08870740 1 -- 172.21.15.22:0/3483922847 wait complete. 2024-08-20T01:36:06.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.436+0000 7f2f08870740 20 client.25736 trim_cache size 0 max 16384 2024-08-20T01:36:06.438 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:36:06.438 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "scrub active (20927 inodes in the stack)", 2024-08-20T01:36:06.438 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-08-20T01:36:06.438 INFO:teuthology.orchestra.run.smithi022.stdout: "c41375a5-efda-4ff7-83eb-c35aa2233f94": { 2024-08-20T01:36:06.438 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-08-20T01:36:06.438 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "c41375a5-efda-4ff7-83eb-c35aa2233f94", 2024-08-20T01:36:06.438 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-08-20T01:36:06.438 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:36:06.438 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:36:06.438 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:36:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.437+0000 7f2f06477640 1 -- 172.21.15.22:0/3029161079 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2ee80b3d10 msgr2=0x7f2ee80b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.437+0000 7f2f06477640 1 --2- 172.21.15.22:0/3029161079 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2ee80b3d10 0x7f2ee80b61d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2f000742c0 tx=0x7f2ef400b2e0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.437+0000 7f2f06477640 1 -- 172.21.15.22:0/3029161079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f00101790 msgr2=0x7f2f00074570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.437+0000 7f2f06477640 1 --2- 172.21.15.22:0/3029161079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f00101790 0x7f2f00074570 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000e9c0 tx=0x7f2ef000ee80 comp rx=0 tx=0).stop 2024-08-20T01:36:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.437+0000 7f2f06477640 1 -- 172.21.15.22:0/3029161079 shutdown_connections 2024-08-20T01:36:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.437+0000 7f2f06477640 1 --2- 172.21.15.22:0/3029161079 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2ee80b3d10 0x7f2ee80b61d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.437+0000 7f2f06477640 1 --2- 172.21.15.22:0/3029161079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f00106bd0 0x7f2f0006e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.437+0000 7f2f06477640 1 --2- 172.21.15.22:0/3029161079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f001020b0 0x7f2f00074ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.437+0000 7f2f06477640 1 --2- 172.21.15.22:0/3029161079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f00101790 0x7f2f00074570 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.437+0000 7f2f06477640 1 -- 172.21.15.22:0/3029161079 >> 172.21.15.22:0/3029161079 conn(0x7f2f000fd400 msgr2=0x7f2f00104500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:06.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.439+0000 7f2f06477640 1 -- 172.21.15.22:0/3029161079 shutdown_connections 2024-08-20T01:36:06.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:06.439+0000 7f2f06477640 1 -- 172.21.15.22:0/3029161079 wait complete. 2024-08-20T01:36:07.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:06 smithi134 ceph-mon[22511]: pgmap v495: 97 pgs: 97 active+clean; 1.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 16 MiB/s wr, 1.67k op/s 2024-08-20T01:36:07.274 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:06 smithi022 ceph-mon[18709]: pgmap v495: 97 pgs: 97 active+clean; 1.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 16 MiB/s wr, 1.67k op/s 2024-08-20T01:36:07.308 INFO:tasks.cephfs.filesystem:scrub status for tag:c41375a5-efda-4ff7-83eb-c35aa2233f94 - {'path': '/', 'tag': 'c41375a5-efda-4ff7-83eb-c35aa2233f94', 'options': 'recursive,force'} 2024-08-20T01:36:07.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:06 smithi077 ceph-mon[22251]: pgmap v495: 97 pgs: 97 active+clean; 1.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 16 MiB/s wr, 1.67k op/s 2024-08-20T01:36:09.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:09 smithi134 ceph-mon[22511]: pgmap v496: 97 pgs: 97 active+clean; 1.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 22 MiB/s wr, 2.12k op/s 2024-08-20T01:36:09.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:09 smithi077 ceph-mon[22251]: pgmap v496: 97 pgs: 97 active+clean; 1.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 22 MiB/s wr, 2.12k op/s 2024-08-20T01:36:09.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:09 smithi022 ceph-mon[18709]: pgmap v496: 97 pgs: 97 active+clean; 1.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 22 MiB/s wr, 2.12k op/s 2024-08-20T01:36:10.044 INFO:tasks.workunit.client.0.smithi022.stdout: 495 809724 821 567596 558 324930 896 2024-08-20T01:36:11.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:11 smithi134 ceph-mon[22511]: pgmap v497: 97 pgs: 97 active+clean; 1.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 16 MiB/s wr, 1.80k op/s 2024-08-20T01:36:11.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:11 smithi077 ceph-mon[22251]: pgmap v497: 97 pgs: 97 active+clean; 1.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 16 MiB/s wr, 1.80k op/s 2024-08-20T01:36:11.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:11 smithi022 ceph-mon[18709]: pgmap v497: 97 pgs: 97 active+clean; 1.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 16 MiB/s wr, 1.80k op/s 2024-08-20T01:36:12.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:12 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:12.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:12 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:36:12.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:12 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:12.317 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:12 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:12.318 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:12 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:36:12.318 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:12 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:12.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:12 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:12.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:12 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:36:12.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:12 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:13.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:13 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:36:13.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:13 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:13.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:13 smithi134 ceph-mon[22511]: pgmap v498: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 16 MiB/s wr, 2.11k op/s 2024-08-20T01:36:13.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:13 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:36:13.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:13 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:13.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:13 smithi077 ceph-mon[22251]: pgmap v498: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 16 MiB/s wr, 2.11k op/s 2024-08-20T01:36:13.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:13 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:36:13.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:13 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:13.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:13 smithi022 ceph-mon[18709]: pgmap v498: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 16 MiB/s wr, 2.11k op/s 2024-08-20T01:36:14.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:14 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:36:14.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:14 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:14.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:14 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:36:14.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:14 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:14.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:14 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:36:14.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:14 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:14.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:14 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:36:14.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:14 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:14.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:14 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:36:14.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:14 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:14.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:14 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:36:14.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:14 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:14.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:14 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:36:14.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:14 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:14.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:14 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:36:14.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:14 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:14.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:14 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:36:14.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:14 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:15.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:15 smithi134 ceph-mon[22511]: pgmap v499: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 13 MiB/s wr, 2.05k op/s 2024-08-20T01:36:15.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:15 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:36:15.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:15 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:15.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:15 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:36:15.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:15 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:15.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:15 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:36:15.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:15 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:15.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:15 smithi077 ceph-mon[22251]: pgmap v499: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 13 MiB/s wr, 2.05k op/s 2024-08-20T01:36:15.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:15 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:36:15.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:15 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:15.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:15 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:36:15.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:15 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:15.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:15 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:36:15.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:15 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:15.389 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:15 smithi022 ceph-mon[18709]: pgmap v499: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 13 MiB/s wr, 2.05k op/s 2024-08-20T01:36:15.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:15 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:36:15.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:15 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:15.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:15 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:36:15.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:15 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:15.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:15 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:36:15.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:15 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:16.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:16 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:36:16.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:16 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:16.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:16 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:36:16.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:16 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:16.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:16 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:36:16.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:16 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:16.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:16 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:36:16.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:16 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:16.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:16 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:36:16.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:16 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:16.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:16 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:36:16.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:16 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:17.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:17 smithi077 ceph-mon[22251]: pgmap v500: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 9.5 MiB/s wr, 1.58k op/s 2024-08-20T01:36:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:17 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:36:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:17 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:17 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:36:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:17 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:17 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:36:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:17 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:17 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:36:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:17 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:17 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:17.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:17 smithi022 ceph-mon[18709]: pgmap v500: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 9.5 MiB/s wr, 1.58k op/s 2024-08-20T01:36:17.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:17 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:36:17.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:17 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:17.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:17 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:36:17.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:17 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:17.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:17 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:36:17.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:17 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:17.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:17 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:36:17.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:17 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:17.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:17 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:17.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:17 smithi134 ceph-mon[22511]: pgmap v500: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 9.5 MiB/s wr, 1.58k op/s 2024-08-20T01:36:17.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:17 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:36:17.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:17 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:17.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:17 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:36:17.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:17 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:17.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:17 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:36:17.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:17 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:17.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:17 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:36:17.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:17 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:17.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:17 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.164+0000 7f6c5175d640 1 -- 172.21.15.22:0/44321397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c4c101560 msgr2=0x7f6c4c101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.164+0000 7f6c5175d640 1 --2- 172.21.15.22:0/44321397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c4c101560 0x7f6c4c101960 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009930 tx=0x7f6c3c02a420 comp rx=0 tx=0).stop 2024-08-20T01:36:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.164+0000 7f6c5175d640 1 -- 172.21.15.22:0/44321397 shutdown_connections 2024-08-20T01:36:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.164+0000 7f6c5175d640 1 --2- 172.21.15.22:0/44321397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c103070 0x7f6c4c1099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.164+0000 7f6c5175d640 1 --2- 172.21.15.22:0/44321397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c4c1026b0 0x7f6c4c102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.164+0000 7f6c5175d640 1 --2- 172.21.15.22:0/44321397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c4c101560 0x7f6c4c101960 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.164+0000 7f6c5175d640 1 -- 172.21.15.22:0/44321397 >> 172.21.15.22:0/44321397 conn(0x7f6c4c0fce40 msgr2=0x7f6c4c0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.164+0000 7f6c5175d640 1 -- 172.21.15.22:0/44321397 shutdown_connections 2024-08-20T01:36:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.164+0000 7f6c5175d640 1 -- 172.21.15.22:0/44321397 wait complete. 2024-08-20T01:36:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.165+0000 7f6c5175d640 1 Processor -- start 2024-08-20T01:36:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.165+0000 7f6c5175d640 1 -- start start 2024-08-20T01:36:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.165+0000 7f6c5175d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c101560 0x7f6c4c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.165+0000 7f6c5175d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c4c1026b0 0x7f6c4c199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.165+0000 7f6c5175d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c4c103070 0x7f6c4c199d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.165+0000 7f6c5175d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c10d1e0 con 0x7f6c4c103070 2024-08-20T01:36:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.165+0000 7f6c5175d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c10d060 con 0x7f6c4c101560 2024-08-20T01:36:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.165+0000 7f6c5175d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c10d360 con 0x7f6c4c1026b0 2024-08-20T01:36:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.165+0000 7f6c4b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c4c103070 0x7f6c4c199d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.165+0000 7f6c43fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c4c1026b0 0x7f6c4c199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.165+0000 7f6c4b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c4c103070 0x7f6c4c199d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53440/0 (socket says 172.21.15.22:53440) 2024-08-20T01:36:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.165+0000 7f6c4b7fe640 1 -- 172.21.15.22:0/88765348 learned_addr learned my addr 172.21.15.22:0/88765348 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.165+0000 7f6c4affd640 1 --2- 172.21.15.22:0/88765348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c101560 0x7f6c4c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.166+0000 7f6c4b7fe640 1 -- 172.21.15.22:0/88765348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c4c1026b0 msgr2=0x7f6c4c199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.166+0000 7f6c4b7fe640 1 --2- 172.21.15.22:0/88765348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c4c1026b0 0x7f6c4c199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.166+0000 7f6c4b7fe640 1 -- 172.21.15.22:0/88765348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c101560 msgr2=0x7f6c4c198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.166+0000 7f6c4b7fe640 1 --2- 172.21.15.22:0/88765348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c101560 0x7f6c4c198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.166+0000 7f6c4b7fe640 1 -- 172.21.15.22:0/88765348 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4c19a640 con 0x7f6c4c103070 2024-08-20T01:36:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.166+0000 7f6c4affd640 1 --2- 172.21.15.22:0/88765348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c101560 0x7f6c4c198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:36:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.166+0000 7f6c4b7fe640 1 --2- 172.21.15.22:0/88765348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c4c103070 0x7f6c4c199d80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400efd0 tx=0x7f6c4400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.166+0000 7f6c48ff9640 1 -- 172.21.15.22:0/88765348 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c44003b70 con 0x7f6c4c103070 2024-08-20T01:36:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.166+0000 7f6c48ff9640 1 -- 172.21.15.22:0/88765348 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c44003d10 con 0x7f6c4c103070 2024-08-20T01:36:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.166+0000 7f6c5175d640 1 -- 172.21.15.22:0/88765348 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c4c19a930 con 0x7f6c4c103070 2024-08-20T01:36:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.166+0000 7f6c48ff9640 1 -- 172.21.15.22:0/88765348 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c440108a0 con 0x7f6c4c103070 2024-08-20T01:36:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.166+0000 7f6c5175d640 1 -- 172.21.15.22:0/88765348 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c4c1a1000 con 0x7f6c4c103070 2024-08-20T01:36:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.169+0000 7f6c54623740 1 Processor -- start 2024-08-20T01:36:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.169+0000 7f6c48ff9640 1 -- 172.21.15.22:0/88765348 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6c44004020 con 0x7f6c4c103070 2024-08-20T01:36:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.169+0000 7f6c54623740 1 -- start start 2024-08-20T01:36:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.170+0000 7f6c54623740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e66322cce0 0x55e66322f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.170+0000 7f6c54623740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322f610 0x55e663231a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.170+0000 7f6c54623740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e663232050 0x55e663234510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.170+0000 7f6c54623740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e66319b360 con 0x55e66322f610 2024-08-20T01:36:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.170+0000 7f6c54623740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e66318a860 con 0x55e663232050 2024-08-20T01:36:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.170+0000 7f6c54623740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e66318e8a0 con 0x55e66322cce0 2024-08-20T01:36:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.170+0000 7f6c4affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322f610 0x55e663231a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.170+0000 7f6c43fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e66322cce0 0x55e66322f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.170+0000 7f6c4affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322f610 0x55e663231a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53446/0 (socket says 172.21.15.22:53446) 2024-08-20T01:36:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.170+0000 7f6c4affd640 1 -- 172.21.15.22:0/2647988903 learned_addr learned my addr 172.21.15.22:0/2647988903 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.170+0000 7f6c43fff640 1 --2- 172.21.15.22:0/2647988903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e663232050 0x55e663234510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.170+0000 7f6c4affd640 1 -- 172.21.15.22:0/2647988903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e66322cce0 msgr2=0x55e66322f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.170+0000 7f6c4affd640 1 --2- 172.21.15.22:0/2647988903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e66322cce0 0x55e66322f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.170+0000 7f6c4affd640 1 -- 172.21.15.22:0/2647988903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e663232050 msgr2=0x55e663234510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.170+0000 7f6c4affd640 1 --2- 172.21.15.22:0/2647988903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e663232050 0x55e663234510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.170+0000 7f6c4affd640 1 -- 172.21.15.22:0/2647988903 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e663131e40 con 0x55e66322f610 2024-08-20T01:36:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.170+0000 7f6c48ff9640 1 --2- 172.21.15.22:0/88765348 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6c380b3bd0 0x7f6c380b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.171+0000 7f6c4affd640 1 --2- 172.21.15.22:0/2647988903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322f610 0x55e663231a00 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009930 tx=0x7f6c3c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42547892665952b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.171+0000 7f6c43fff640 1 --2- 172.21.15.22:0/88765348 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6c380b3bd0 0x7f6c380b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.171+0000 7f6c48ff9640 1 -- 172.21.15.22:0/88765348 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f6c440e4030 con 0x7f6c4c103070 2024-08-20T01:36:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.171+0000 7f6c417fa640 1 -- 172.21.15.22:0/2647988903 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c035070 con 0x55e66322f610 2024-08-20T01:36:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.171+0000 7f6c417fa640 1 -- 172.21.15.22:0/2647988903 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c3c0317a0 con 0x55e66322f610 2024-08-20T01:36:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.171+0000 7f6c417fa640 1 -- 172.21.15.22:0/2647988903 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c003d10 con 0x55e66322f610 2024-08-20T01:36:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.172+0000 7f6c54623740 1 -- 172.21.15.22:0/2647988903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322f610 msgr2=0x55e663231a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.172+0000 7f6c43fff640 1 --2- 172.21.15.22:0/88765348 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6c380b3bd0 0x7f6c380b6090 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009fd0 tx=0x7f6c340046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.172+0000 7f6c54623740 1 --2- 172.21.15.22:0/2647988903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322f610 0x55e663231a00 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009930 tx=0x7f6c3c005d50 comp rx=0 tx=0).stop 2024-08-20T01:36:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.172+0000 7f6c54623740 1 -- 172.21.15.22:0/2647988903 shutdown_connections 2024-08-20T01:36:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.172+0000 7f6c54623740 1 --2- 172.21.15.22:0/2647988903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e663232050 0x55e663234510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.172+0000 7f6c54623740 1 --2- 172.21.15.22:0/2647988903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322f610 0x55e663231a00 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.172+0000 7f6c54623740 1 --2- 172.21.15.22:0/2647988903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e66322cce0 0x55e66322f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.172+0000 7f6c54623740 1 -- 172.21.15.22:0/2647988903 >> 172.21.15.22:0/2647988903 conn(0x55e663223a20 msgr2=0x55e6632247b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.172+0000 7f6c54623740 1 -- 172.21.15.22:0/2647988903 shutdown_connections 2024-08-20T01:36:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.172+0000 7f6c54623740 1 -- 172.21.15.22:0/2647988903 wait complete. 2024-08-20T01:36:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.172+0000 7f6c54623740 1 -- start start 2024-08-20T01:36:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.172+0000 7f6c54623740 1 Processor -- start 2024-08-20T01:36:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.172+0000 7f6c54623740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322cce0 0x55e663236440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.172+0000 7f6c54623740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e66322f610 0x55e663236ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c54623740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e663232050 0x55e6632376b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c54623740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e6630c3ab0 con 0x55e66322cce0 2024-08-20T01:36:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c54623740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e663111780 con 0x55e66322f610 2024-08-20T01:36:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c54623740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e663234fd0 con 0x55e663232050 2024-08-20T01:36:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c4affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322cce0 0x55e663236440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c4affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322cce0 0x55e663236440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53452/0 (socket says 172.21.15.22:53452) 2024-08-20T01:36:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c4affd640 1 -- 172.21.15.22:0/1902901919 learned_addr learned my addr 172.21.15.22:0/1902901919 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c54623740 10 client.0 _ll_register_callbacks cb 0x55e662e99a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c4b7fe640 1 --2- 172.21.15.22:0/1902901919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e663232050 0x55e6632376b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c43fff640 1 --2- 172.21.15.22:0/1902901919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e66322f610 0x55e663236ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c4affd640 1 -- 172.21.15.22:0/1902901919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e663232050 msgr2=0x55e6632376b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c4affd640 1 --2- 172.21.15.22:0/1902901919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e663232050 0x55e6632376b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c4affd640 1 -- 172.21.15.22:0/1902901919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e66322f610 msgr2=0x55e663236ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c4affd640 1 --2- 172.21.15.22:0/1902901919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e66322f610 0x55e663236ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c4affd640 1 -- 172.21.15.22:0/1902901919 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e662eed790 con 0x55e66322cce0 2024-08-20T01:36:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c43fff640 1 --2- 172.21.15.22:0/1902901919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e66322f610 0x55e663236ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c4affd640 1 --2- 172.21.15.22:0/1902901919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322cce0 0x55e663236440 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c02a460 tx=0x7f6c3c009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4db7b0097669cf1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c327fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:36:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c327fc640 1 -- 172.21.15.22:0/1902901919 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c035030 con 0x55e66322cce0 2024-08-20T01:36:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c327fc640 1 -- 172.21.15.22:0/1902901919 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f6c3c0317a0 con 0x55e66322cce0 2024-08-20T01:36:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.173+0000 7f6c54623740 1 -- 172.21.15.22:0/1902901919 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e663139e00 con 0x55e66322cce0 2024-08-20T01:36:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.174+0000 7f6c327fc640 1 -- 172.21.15.22:0/1902901919 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6c3c04a040 con 0x55e66322cce0 2024-08-20T01:36:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.174+0000 7f6c54623740 10 client.16140 fetch_fsmap learned FSMap version 29 2024-08-20T01:36:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.174+0000 7f6c54623740 1 -- 172.21.15.22:0/1902901919 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e662f66620 con 0x55e66322cce0 2024-08-20T01:36:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.174+0000 7f6c327fc640 1 -- 172.21.15.22:0/1902901919 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e663139e00 con 0x55e66322cce0 2024-08-20T01:36:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.174+0000 7f6c327fc640 1 -- 172.21.15.22:0/1902901919 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6c3c04d070 con 0x55e66322cce0 2024-08-20T01:36:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.174+0000 7f6c54623740 10 client.16140 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:36:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.174+0000 7f6c54623740 10 client.16140 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:36:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.174+0000 7f6c54623740 20 client.16140 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.174+0000 7f6c54623740 1 --2- 172.21.15.22:0/1902901919 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e6632418c0 0x55e663243cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.174+0000 7f6c54623740 4 client.16140 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.174+0000 7f6c54623740 1 -- 172.21.15.22:0/1902901919 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e66319d2b0 con 0x55e6632418c0 2024-08-20T01:36:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.174+0000 7f6c43fff640 1 --2- 172.21.15.22:0/1902901919 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e6632418c0 0x55e663243cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.175+0000 7f6c327fc640 10 client.16140 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.175+0000 7f6c43fff640 1 --2- 172.21.15.22:0/1902901919 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e6632418c0 0x55e663243cb0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=342faa3879e2d6a9 server_cookie=aca78622a2132bc3 in_seq=0 out_seq=0 2024-08-20T01:36:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.177+0000 7f6c327fc640 1 -- 172.21.15.22:0/1902901919 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e66319d2b0 con 0x55e6632418c0 2024-08-20T01:36:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.177+0000 7f6c327fc640 10 client.16140 handle_command_reply: tid=0 2024-08-20T01:36:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.177+0000 7f6c54623740 1 client.16140 shutdown 2024-08-20T01:36:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.177+0000 7f6c54623740 1 -- 172.21.15.22:0/1902901919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322cce0 msgr2=0x55e663236440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.177+0000 7f6c54623740 1 --2- 172.21.15.22:0/1902901919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322cce0 0x55e663236440 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c02a460 tx=0x7f6c3c009630 comp rx=0 tx=0).stop 2024-08-20T01:36:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.177+0000 7f6c54623740 1 -- 172.21.15.22:0/1902901919 shutdown_connections 2024-08-20T01:36:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.177+0000 7f6c54623740 1 --2- 172.21.15.22:0/1902901919 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e6632418c0 0x55e663243cb0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.177+0000 7f6c54623740 1 --2- 172.21.15.22:0/1902901919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e663232050 0x55e6632376b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.177+0000 7f6c54623740 1 --2- 172.21.15.22:0/1902901919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e66322f610 0x55e663236ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.177+0000 7f6c327fc640 0 client.16140 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.177+0000 7f6c54623740 1 --2- 172.21.15.22:0/1902901919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322cce0 0x55e663236440 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.177+0000 7f6c54623740 1 -- 172.21.15.22:0/1902901919 >> 172.21.15.22:0/1902901919 conn(0x55e663223a20 msgr2=0x55e663222ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.177+0000 7f6c54623740 1 -- 172.21.15.22:0/1902901919 shutdown_connections 2024-08-20T01:36:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.177+0000 7f6c54623740 1 -- 172.21.15.22:0/1902901919 wait complete. 2024-08-20T01:36:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.177+0000 7f6c54623740 20 client.16140 trim_cache size 0 max 16384 2024-08-20T01:36:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.193+0000 7f6c54623740 1 Processor -- start 2024-08-20T01:36:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.193+0000 7f6c54623740 1 -- start start 2024-08-20T01:36:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.193+0000 7f6c54623740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e66322cce0 0x55e6632229d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.193+0000 7f6c54623740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322f610 0x55e663222f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.193+0000 7f6c54623740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e663232050 0x55e663248540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.193+0000 7f6c54623740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c1aa3f0 con 0x55e66322f610 2024-08-20T01:36:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.193+0000 7f6c54623740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c1a7c60 con 0x55e66322cce0 2024-08-20T01:36:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.193+0000 7f6c54623740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c1a5ab0 con 0x55e663232050 2024-08-20T01:36:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.193+0000 7f6c43fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322f610 0x55e663222f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.193+0000 7f6c4affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e66322cce0 0x55e6632229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.193+0000 7f6c43fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322f610 0x55e663222f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53456/0 (socket says 172.21.15.22:53456) 2024-08-20T01:36:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.194+0000 7f6c4b7fe640 1 --2- 172.21.15.22:0/2839627863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e663232050 0x55e663248540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.194+0000 7f6c43fff640 1 -- 172.21.15.22:0/2839627863 learned_addr learned my addr 172.21.15.22:0/2839627863 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.194+0000 7f6c4affd640 1 -- 172.21.15.22:0/2839627863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e663232050 msgr2=0x55e663248540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.194+0000 7f6c4affd640 1 --2- 172.21.15.22:0/2839627863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e663232050 0x55e663248540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.194+0000 7f6c4affd640 1 -- 172.21.15.22:0/2839627863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322f610 msgr2=0x55e663222f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.194+0000 7f6c4affd640 1 --2- 172.21.15.22:0/2839627863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322f610 0x55e663222f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.194+0000 7f6c4affd640 1 -- 172.21.15.22:0/2839627863 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e663244020 con 0x55e66322cce0 2024-08-20T01:36:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.194+0000 7f6c43fff640 1 --2- 172.21.15.22:0/2839627863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322f610 0x55e663222f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:36:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.194+0000 7f6c4affd640 1 --2- 172.21.15.22:0/2839627863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e66322cce0 0x55e6632229d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c003db0 tx=0x7f6c3c0314a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1fc5862942eb7bb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.194+0000 7f6c40ff9640 1 -- 172.21.15.22:0/2839627863 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c035040 con 0x55e66322cce0 2024-08-20T01:36:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.194+0000 7f6c40ff9640 1 -- 172.21.15.22:0/2839627863 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c3c053070 con 0x55e66322cce0 2024-08-20T01:36:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.194+0000 7f6c40ff9640 1 -- 172.21.15.22:0/2839627863 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c031b60 con 0x55e66322cce0 2024-08-20T01:36:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.195+0000 7f6c54623740 1 -- 172.21.15.22:0/2839627863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e66322cce0 msgr2=0x55e6632229d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.195+0000 7f6c54623740 1 --2- 172.21.15.22:0/2839627863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e66322cce0 0x55e6632229d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c003db0 tx=0x7f6c3c0314a0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.195+0000 7f6c54623740 1 -- 172.21.15.22:0/2839627863 shutdown_connections 2024-08-20T01:36:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.195+0000 7f6c54623740 1 --2- 172.21.15.22:0/2839627863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e663232050 0x55e663248540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.195+0000 7f6c54623740 1 --2- 172.21.15.22:0/2839627863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322f610 0x55e663222f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.195+0000 7f6c54623740 1 --2- 172.21.15.22:0/2839627863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e66322cce0 0x55e6632229d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.195+0000 7f6c54623740 1 -- 172.21.15.22:0/2839627863 >> 172.21.15.22:0/2839627863 conn(0x55e663223a20 msgr2=0x55e6632222c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.195+0000 7f6c54623740 1 -- 172.21.15.22:0/2839627863 shutdown_connections 2024-08-20T01:36:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.195+0000 7f6c54623740 1 -- 172.21.15.22:0/2839627863 wait complete. 2024-08-20T01:36:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.195+0000 7f6c54623740 1 -- start start 2024-08-20T01:36:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.196+0000 7f6c54623740 1 Processor -- start 2024-08-20T01:36:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.196+0000 7f6c54623740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322cce0 0x55e66323cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.196+0000 7f6c54623740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e66322f610 0x55e66323d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.196+0000 7f6c54623740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e663232050 0x55e66323da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.196+0000 7f6c54623740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c1a6120 con 0x55e66322cce0 2024-08-20T01:36:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.196+0000 7f6c54623740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c1a7590 con 0x55e663232050 2024-08-20T01:36:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.196+0000 7f6c54623740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c1a67f0 con 0x55e66322f610 2024-08-20T01:36:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.196+0000 7f6c54623740 10 client.0 _ll_register_callbacks cb 0x7f6c34009de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.196+0000 7f6c4affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322cce0 0x55e66323cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.196+0000 7f6c4affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322cce0 0x55e66323cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53462/0 (socket says 172.21.15.22:53462) 2024-08-20T01:36:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.196+0000 7f6c4affd640 1 -- 172.21.15.22:0/673638531 learned_addr learned my addr 172.21.15.22:0/673638531 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.196+0000 7f6c43fff640 1 --2- 172.21.15.22:0/673638531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e66322f610 0x55e66323d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.196+0000 7f6c4b7fe640 1 --2- 172.21.15.22:0/673638531 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e663232050 0x55e66323da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.196+0000 7f6c4affd640 1 -- 172.21.15.22:0/673638531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e66322f610 msgr2=0x55e66323d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.196+0000 7f6c4affd640 1 --2- 172.21.15.22:0/673638531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e66322f610 0x55e66323d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.196+0000 7f6c4affd640 1 -- 172.21.15.22:0/673638531 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e663232050 msgr2=0x55e66323da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.196+0000 7f6c4affd640 1 --2- 172.21.15.22:0/673638531 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e663232050 0x55e66323da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.196+0000 7f6c4affd640 1 -- 172.21.15.22:0/673638531 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e66322f440 con 0x55e66322cce0 2024-08-20T01:36:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.197+0000 7f6c4affd640 1 --2- 172.21.15.22:0/673638531 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322cce0 0x55e66323cfe0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c005ec0 tx=0x7f6c3c02ab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fcc14759f76ae61 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.197+0000 7f6c327fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:36:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.197+0000 7f6c327fc640 1 -- 172.21.15.22:0/673638531 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c035040 con 0x55e66322cce0 2024-08-20T01:36:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.197+0000 7f6c327fc640 1 -- 172.21.15.22:0/673638531 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f6c3c003ff0 con 0x55e66322cce0 2024-08-20T01:36:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.197+0000 7f6c54623740 1 -- 172.21.15.22:0/673638531 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c3c053070 con 0x55e66322cce0 2024-08-20T01:36:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.197+0000 7f6c327fc640 1 -- 172.21.15.22:0/673638531 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6c3c070050 con 0x55e66322cce0 2024-08-20T01:36:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.197+0000 7f6c54623740 10 client.16146 fetch_fsmap learned FSMap version 29 2024-08-20T01:36:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.197+0000 7f6c54623740 1 -- 172.21.15.22:0/673638531 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e6632ac790 con 0x55e66322cce0 2024-08-20T01:36:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.197+0000 7f6c327fc640 1 -- 172.21.15.22:0/673638531 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c3c053070 con 0x55e66322cce0 2024-08-20T01:36:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.197+0000 7f6c327fc640 1 -- 172.21.15.22:0/673638531 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6c3c04d070 con 0x55e66322cce0 2024-08-20T01:36:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.197+0000 7f6c54623740 10 client.16146 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:36:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.197+0000 7f6c54623740 10 client.16146 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:36:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.198+0000 7f6c54623740 20 client.16146 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.198+0000 7f6c54623740 1 --2- 172.21.15.22:0/673638531 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e6632ad170 0x55e6632af590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.198+0000 7f6c54623740 4 client.16146 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:36:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.198+0000 7f6c54623740 1 -- 172.21.15.22:0/673638531 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e663198d50 con 0x55e6632ad170 2024-08-20T01:36:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.198+0000 7f6c43fff640 1 --2- 172.21.15.22:0/673638531 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e6632ad170 0x55e6632af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.198+0000 7f6c327fc640 10 client.16146 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:19.198+0000 7f6c43fff640 1 --2- 172.21.15.22:0/673638531 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e6632ad170 0x55e6632af590 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1c1c7a60b31721a server_cookie=801d79e39de6f538 in_seq=0 out_seq=0 2024-08-20T01:36:19.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:19 smithi077 ceph-mon[22251]: pgmap v501: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 8.9 MiB/s wr, 2.85k op/s 2024-08-20T01:36:19.386 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:19 smithi022 ceph-mon[18709]: pgmap v501: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 8.9 MiB/s wr, 2.85k op/s 2024-08-20T01:36:19.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:19 smithi134 ceph-mon[22511]: pgmap v501: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 8.9 MiB/s wr, 2.85k op/s 2024-08-20T01:36:20.044 INFO:tasks.workunit.client.0.smithi022.stdout: 498 172003 287 119366 229 68130 362 2024-08-20T01:36:21.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:21 smithi077 ceph-mon[22251]: pgmap v502: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.8 MiB/s wr, 2.48k op/s 2024-08-20T01:36:21.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:21 smithi022 ceph-mon[18709]: pgmap v502: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.8 MiB/s wr, 2.48k op/s 2024-08-20T01:36:21.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.432+0000 7f6c327fc640 1 -- 172.21.15.22:0/673638531 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e663198d50 con 0x55e6632ad170 2024-08-20T01:36:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.432+0000 7f6c327fc640 10 client.16146 handle_command_reply: tid=0 2024-08-20T01:36:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.433+0000 7f6c54623740 1 client.16146 shutdown 2024-08-20T01:36:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.433+0000 7f6c54623740 1 -- 172.21.15.22:0/673638531 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322cce0 msgr2=0x55e66323cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.433+0000 7f6c54623740 1 --2- 172.21.15.22:0/673638531 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322cce0 0x55e66323cfe0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c005ec0 tx=0x7f6c3c02ab40 comp rx=0 tx=0).stop 2024-08-20T01:36:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.434+0000 7f6c54623740 1 -- 172.21.15.22:0/673638531 shutdown_connections 2024-08-20T01:36:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.434+0000 7f6c54623740 1 --2- 172.21.15.22:0/673638531 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e6632ad170 0x55e6632af590 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.434+0000 7f6c54623740 1 --2- 172.21.15.22:0/673638531 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e663232050 0x55e66323da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.434+0000 7f6c54623740 1 --2- 172.21.15.22:0/673638531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e66322f610 0x55e66323d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.434+0000 7f6c54623740 1 --2- 172.21.15.22:0/673638531 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e66322cce0 0x55e66323cfe0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.434+0000 7f6c54623740 1 -- 172.21.15.22:0/673638531 >> 172.21.15.22:0/673638531 conn(0x55e663223a20 msgr2=0x55e663222ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.434+0000 7f6c327fc640 0 client.16146 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:21.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.435+0000 7f6c54623740 1 -- 172.21.15.22:0/673638531 shutdown_connections 2024-08-20T01:36:21.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.435+0000 7f6c54623740 1 -- 172.21.15.22:0/673638531 wait complete. 2024-08-20T01:36:21.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.440+0000 7f6c54623740 20 client.16146 trim_cache size 0 max 16384 2024-08-20T01:36:21.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:36:21.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:36:21.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:36:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:36:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.441+0000 7f6c5175d640 1 -- 172.21.15.22:0/88765348 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6c380b3bd0 msgr2=0x7f6c380b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.441+0000 7f6c5175d640 1 --2- 172.21.15.22:0/88765348 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6c380b3bd0 0x7f6c380b6090 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009fd0 tx=0x7f6c340046c0 comp rx=0 tx=0).stop 2024-08-20T01:36:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.441+0000 7f6c5175d640 1 -- 172.21.15.22:0/88765348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c4c103070 msgr2=0x7f6c4c199d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.441+0000 7f6c5175d640 1 --2- 172.21.15.22:0/88765348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c4c103070 0x7f6c4c199d80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400efd0 tx=0x7f6c4400c6a0 comp rx=0 tx=0).stop 2024-08-20T01:36:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.441+0000 7f6c5175d640 1 -- 172.21.15.22:0/88765348 shutdown_connections 2024-08-20T01:36:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.441+0000 7f6c5175d640 1 --2- 172.21.15.22:0/88765348 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6c380b3bd0 0x7f6c380b6090 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:21.444 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.441+0000 7f6c5175d640 1 --2- 172.21.15.22:0/88765348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c4c103070 0x7f6c4c199d80 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:21.444 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.441+0000 7f6c5175d640 1 --2- 172.21.15.22:0/88765348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c4c1026b0 0x7f6c4c199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:21.444 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.441+0000 7f6c5175d640 1 --2- 172.21.15.22:0/88765348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c101560 0x7f6c4c198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:21.444 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.441+0000 7f6c5175d640 1 -- 172.21.15.22:0/88765348 >> 172.21.15.22:0/88765348 conn(0x7f6c4c0fce40 msgr2=0x7f6c4c103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:21.444 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.442+0000 7f6c5175d640 1 -- 172.21.15.22:0/88765348 shutdown_connections 2024-08-20T01:36:21.444 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:21.442+0000 7f6c5175d640 1 -- 172.21.15.22:0/88765348 wait complete. 2024-08-20T01:36:21.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:21 smithi134 ceph-mon[22511]: pgmap v502: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.8 MiB/s wr, 2.48k op/s 2024-08-20T01:36:23.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:23 smithi022 ceph-mon[18709]: pgmap v503: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 1.9 MiB/s wr, 2.67k op/s 2024-08-20T01:36:23.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:23 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:23.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:23 smithi077 ceph-mon[22251]: pgmap v503: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 1.9 MiB/s wr, 2.67k op/s 2024-08-20T01:36:23.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:23 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:23.404 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:23 smithi134 ceph-mon[22511]: pgmap v503: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 1.9 MiB/s wr, 2.67k op/s 2024-08-20T01:36:23.404 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:23 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:25.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:25 smithi134 ceph-mon[22511]: pgmap v504: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 1.2 MiB/s wr, 2.52k op/s 2024-08-20T01:36:25.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:25 smithi077 ceph-mon[22251]: pgmap v504: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 1.2 MiB/s wr, 2.52k op/s 2024-08-20T01:36:25.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:25 smithi022 ceph-mon[18709]: pgmap v504: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 1.2 MiB/s wr, 2.52k op/s 2024-08-20T01:36:27.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:27 smithi077 ceph-mon[22251]: pgmap v505: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.2 MiB/s wr, 2.09k op/s 2024-08-20T01:36:27.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:27 smithi022 ceph-mon[18709]: pgmap v505: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.2 MiB/s wr, 2.09k op/s 2024-08-20T01:36:27.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:27 smithi134 ceph-mon[22511]: pgmap v505: 97 pgs: 97 active+clean; 1.8 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.2 MiB/s wr, 2.09k op/s 2024-08-20T01:36:29.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:29 smithi077 ceph-mon[22251]: pgmap v506: 97 pgs: 97 active+clean; 1.8 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 6.9 MiB/s wr, 2.28k op/s 2024-08-20T01:36:29.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:29 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:36:29.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:29 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:36:29.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:29 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:36:29.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:29 smithi022 ceph-mon[18709]: pgmap v506: 97 pgs: 97 active+clean; 1.8 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 6.9 MiB/s wr, 2.28k op/s 2024-08-20T01:36:29.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:29 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:36:29.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:29 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:36:29.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:29 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:36:29.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:29 smithi134 ceph-mon[22511]: pgmap v506: 97 pgs: 97 active+clean; 1.8 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 6.9 MiB/s wr, 2.28k op/s 2024-08-20T01:36:29.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:29 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:36:29.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:29 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:36:29.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:29 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:36:30.044 INFO:tasks.workunit.client.0.smithi022.stdout: 505 1612447 593 1117335 667 623675 1896 2024-08-20T01:36:31.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:31 smithi077 ceph-mon[22251]: pgmap v507: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.5 MiB/s wr, 992 op/s 2024-08-20T01:36:31.395 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:31 smithi022 ceph-mon[18709]: pgmap v507: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.5 MiB/s wr, 992 op/s 2024-08-20T01:36:31.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:31 smithi134 ceph-mon[22511]: pgmap v507: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.5 MiB/s wr, 992 op/s 2024-08-20T01:36:33.314 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:33 smithi077 ceph-mon[22251]: pgmap v508: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.3 MiB/s wr, 967 op/s 2024-08-20T01:36:33.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:33 smithi022 ceph-mon[18709]: pgmap v508: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.3 MiB/s wr, 967 op/s 2024-08-20T01:36:33.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:33 smithi134 ceph-mon[22511]: pgmap v508: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.3 MiB/s wr, 967 op/s 2024-08-20T01:36:34.083 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:34 smithi022 ceph-mon[18709]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:36:34.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:34 smithi134 ceph-mon[22511]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:36:34.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:34 smithi077 ceph-mon[22251]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:36:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.050+0000 7f6a0ae0b640 1 -- 172.21.15.22:0/3580060910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a04074230 msgr2=0x7f6a04119dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.050+0000 7f6a0ae0b640 1 --2- 172.21.15.22:0/3580060910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a04074230 0x7f6a04119dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009900 tx=0x7f69f402a3f0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.051+0000 7f6a0ae0b640 1 -- 172.21.15.22:0/3580060910 shutdown_connections 2024-08-20T01:36:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.051+0000 7f6a0ae0b640 1 --2- 172.21.15.22:0/3580060910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a04074230 0x7f6a04119dc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.051+0000 7f6a0ae0b640 1 --2- 172.21.15.22:0/3580060910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a0410aa30 0x7f6a04073b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.051+0000 7f6a0ae0b640 1 --2- 172.21.15.22:0/3580060910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a0410a0f0 0x7f6a0410a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.051+0000 7f6a0ae0b640 1 -- 172.21.15.22:0/3580060910 >> 172.21.15.22:0/3580060910 conn(0x7f6a0406f580 msgr2=0x7f6a040719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.051+0000 7f6a0ae0b640 1 -- 172.21.15.22:0/3580060910 shutdown_connections 2024-08-20T01:36:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.052+0000 7f6a0ae0b640 1 -- 172.21.15.22:0/3580060910 wait complete. 2024-08-20T01:36:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.053+0000 7f6a0ae0b640 1 Processor -- start 2024-08-20T01:36:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.053+0000 7f6a0ae0b640 1 -- start start 2024-08-20T01:36:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.054+0000 7f6a0ae0b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a04074230 0x7f6a041192d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.054+0000 7f6a0ae0b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a0410a0f0 0x7f6a04119810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.054+0000 7f6a0ae0b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a0410aa30 0x7f6a04117bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.054+0000 7f6a0ae0b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6a04111e70 con 0x7f6a04074230 2024-08-20T01:36:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.054+0000 7f6a0ae0b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a04111cf0 con 0x7f6a0410a0f0 2024-08-20T01:36:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.054+0000 7f6a0ae0b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6a04111ff0 con 0x7f6a0410aa30 2024-08-20T01:36:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.054+0000 7f6a03fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a0410a0f0 0x7f6a04119810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.054+0000 7f6a03fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a0410a0f0 0x7f6a04119810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:38294/0 (socket says 172.21.15.22:38294) 2024-08-20T01:36:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.054+0000 7f6a03fff640 1 -- 172.21.15.22:0/2242647294 learned_addr learned my addr 172.21.15.22:0/2242647294 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.055+0000 7f6a08ba7640 1 --2- 172.21.15.22:0/2242647294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a04074230 0x7f6a041192d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.056+0000 7f6a03fff640 1 -- 172.21.15.22:0/2242647294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a0410aa30 msgr2=0x7f6a04117bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T01:36:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.056+0000 7f6a03fff640 1 --2- 172.21.15.22:0/2242647294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a0410aa30 0x7f6a04117bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.056+0000 7f6a03fff640 1 -- 172.21.15.22:0/2242647294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a04074230 msgr2=0x7f6a041192d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.056+0000 7f6a03fff640 1 --2- 172.21.15.22:0/2242647294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a04074230 0x7f6a041192d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.056+0000 7f6a03fff640 1 -- 172.21.15.22:0/2242647294 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a04118300 con 0x7f6a0410a0f0 2024-08-20T01:36:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.056+0000 7f6a08ba7640 1 --2- 172.21.15.22:0/2242647294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a04074230 0x7f6a041192d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:36:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.057+0000 7f6a03fff640 1 --2- 172.21.15.22:0/2242647294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a0410a0f0 0x7f6a04119810 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00cce0 tx=0x7f69fc00a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.069+0000 7f6a01ffb640 1 -- 172.21.15.22:0/2242647294 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc004b20 con 0x7f6a0410a0f0 2024-08-20T01:36:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.071+0000 7f6a0ae0b640 1 -- 172.21.15.22:0/2242647294 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a04118590 con 0x7f6a0410a0f0 2024-08-20T01:36:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.071+0000 7f6a0ae0b640 1 -- 172.21.15.22:0/2242647294 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a041b8380 con 0x7f6a0410a0f0 2024-08-20T01:36:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.071+0000 7f6a01ffb640 1 -- 172.21.15.22:0/2242647294 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69fc004cc0 con 0x7f6a0410a0f0 2024-08-20T01:36:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.072+0000 7f6a01ffb640 1 -- 172.21.15.22:0/2242647294 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc00f6b0 con 0x7f6a0410a0f0 2024-08-20T01:36:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.077+0000 7f6a01ffb640 1 -- 172.21.15.22:0/2242647294 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f69fc00f850 con 0x7f6a0410a0f0 2024-08-20T01:36:35.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.078+0000 7f6a0dbfc740 1 Processor -- start 2024-08-20T01:36:35.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.078+0000 7f6a0dbfc740 1 -- start start 2024-08-20T01:36:35.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.079+0000 7f6a0dbfc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e7ea20 0x55e950e80e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:35.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.079+0000 7f6a0dbfc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e81350 0x55e950e83740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:35.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.079+0000 7f6a0dbfc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e83d90 0x55e950e86250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:35.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.079+0000 7f6a0dbfc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e950df1360 con 0x55e950e7ea20 2024-08-20T01:36:35.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.079+0000 7f6a0dbfc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e950de0860 con 0x55e950e83d90 2024-08-20T01:36:35.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.079+0000 7f6a0dbfc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e950de48a0 con 0x55e950e81350 2024-08-20T01:36:35.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.079+0000 7f6a03fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e83d90 0x55e950e86250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:35.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.079+0000 7f6a03fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e83d90 0x55e950e86250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:38306/0 (socket says 172.21.15.22:38306) 2024-08-20T01:36:35.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.079+0000 7f6a08ba7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e81350 0x55e950e83740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:35.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.079+0000 7f6a03fff640 1 -- 172.21.15.22:0/2222422152 learned_addr learned my addr 172.21.15.22:0/2222422152 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:35.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.080+0000 7f6a093a8640 1 --2- 172.21.15.22:0/2222422152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e7ea20 0x55e950e80e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:35.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.080+0000 7f6a03fff640 1 -- 172.21.15.22:0/2222422152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e81350 msgr2=0x55e950e83740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:35.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.080+0000 7f6a03fff640 1 --2- 172.21.15.22:0/2222422152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e81350 0x55e950e83740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.080+0000 7f6a03fff640 1 -- 172.21.15.22:0/2222422152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e7ea20 msgr2=0x55e950e80e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:35.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.080+0000 7f6a03fff640 1 --2- 172.21.15.22:0/2222422152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e7ea20 0x55e950e80e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.080+0000 7f6a03fff640 1 -- 172.21.15.22:0/2222422152 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e950d87e40 con 0x55e950e83d90 2024-08-20T01:36:35.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.081+0000 7f6a01ffb640 1 --2- 172.21.15.22:0/2242647294 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f69ec0b3da0 0x7f69ec0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:35.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.081+0000 7f6a01ffb640 1 -- 172.21.15.22:0/2242647294 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f69fc0e4b20 con 0x7f6a0410a0f0 2024-08-20T01:36:35.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.082+0000 7f6a08ba7640 1 --2- 172.21.15.22:0/2222422152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e81350 0x55e950e83740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:35.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.084+0000 7f6a093a8640 1 --2- 172.21.15.22:0/2222422152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e7ea20 0x55e950e80e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:35.086 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.084+0000 7f6a093a8640 1 --2- 172.21.15.22:0/2242647294 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f69ec0b3da0 0x7f69ec0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.085+0000 7f6a093a8640 1 --2- 172.21.15.22:0/2242647294 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f69ec0b3da0 0x7f69ec0b6260 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f69f40096c0 tx=0x7f69f4005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.082+0000 7f6a03fff640 1 --2- 172.21.15.22:0/2222422152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e83d90 0x55e950e86250 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00ab20 tx=0x7f69fc011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b0785a1a990f165 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:35.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.094+0000 7f69eaffd640 1 -- 172.21.15.22:0/2222422152 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc01d070 con 0x55e950e83d90 2024-08-20T01:36:35.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.095+0000 7f69eaffd640 1 -- 172.21.15.22:0/2222422152 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69fc0ab4e0 con 0x55e950e83d90 2024-08-20T01:36:35.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.096+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/2222422152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e83d90 msgr2=0x55e950e86250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.096+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/2222422152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e83d90 0x55e950e86250 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00ab20 tx=0x7f69fc011000 comp rx=0 tx=0).stop 2024-08-20T01:36:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.113+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/2222422152 shutdown_connections 2024-08-20T01:36:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.113+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/2222422152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e83d90 0x55e950e86250 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.113+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/2222422152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e81350 0x55e950e83740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.113+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/2222422152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e7ea20 0x55e950e80e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.113+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/2222422152 >> 172.21.15.22:0/2222422152 conn(0x55e950e79b70 msgr2=0x55e950e7a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.113+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/2222422152 shutdown_connections 2024-08-20T01:36:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.113+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/2222422152 wait complete. 2024-08-20T01:36:35.117 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.114+0000 7f6a0dbfc740 1 -- start start 2024-08-20T01:36:35.117 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.114+0000 7f6a0dbfc740 1 Processor -- start 2024-08-20T01:36:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.115+0000 7f6a0dbfc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e7ea20 0x55e950e88240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.115+0000 7f6a0dbfc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e81350 0x55e950e888e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.115+0000 7f6a0dbfc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e83d90 0x55e950e894b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.115+0000 7f6a0dbfc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e950d19ab0 con 0x55e950e81350 2024-08-20T01:36:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.115+0000 7f6a0dbfc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e950d67780 con 0x55e950e83d90 2024-08-20T01:36:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.115+0000 7f6a0dbfc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e950e86db0 con 0x55e950e7ea20 2024-08-20T01:36:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.115+0000 7f6a0dbfc740 10 client.0 _ll_register_callbacks cb 0x55e950aefa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.116+0000 7f6a093a8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e83d90 0x55e950e894b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.116+0000 7f6a093a8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e83d90 0x55e950e894b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:38310/0 (socket says 172.21.15.22:38310) 2024-08-20T01:36:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.116+0000 7f6a093a8640 1 -- 172.21.15.22:0/2336558012 learned_addr learned my addr 172.21.15.22:0/2336558012 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.116+0000 7f6a08ba7640 1 --2- 172.21.15.22:0/2336558012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e7ea20 0x55e950e88240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.116+0000 7f6a03fff640 1 --2- 172.21.15.22:0/2336558012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e81350 0x55e950e888e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.117+0000 7f6a08ba7640 1 -- 172.21.15.22:0/2336558012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e83d90 msgr2=0x55e950e894b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.117+0000 7f6a08ba7640 1 --2- 172.21.15.22:0/2336558012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e83d90 0x55e950e894b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.117+0000 7f6a08ba7640 1 -- 172.21.15.22:0/2336558012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e81350 msgr2=0x55e950e888e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.117+0000 7f6a08ba7640 1 --2- 172.21.15.22:0/2336558012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e81350 0x55e950e888e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.117+0000 7f6a08ba7640 1 -- 172.21.15.22:0/2336558012 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e950b43790 con 0x55e950e7ea20 2024-08-20T01:36:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.117+0000 7f6a03fff640 1 --2- 172.21.15.22:0/2336558012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e81350 0x55e950e888e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:36:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.118+0000 7f6a08ba7640 1 --2- 172.21.15.22:0/2336558012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e7ea20 0x55e950e88240 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f69f8005fd0 tx=0x7f69f8012be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6eb0db52ff5c98c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:35.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:35 smithi022 ceph-mon[18709]: pgmap v509: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 11 MiB/s wr, 943 op/s 2024-08-20T01:36:35.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:35 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:36:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.182+0000 7f69e87f8640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:36:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.182+0000 7f69e87f8640 1 -- 172.21.15.22:0/2336558012 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f8010dc0 con 0x55e950e7ea20 2024-08-20T01:36:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.182+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/2336558012 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e950d8fe00 con 0x55e950e7ea20 2024-08-20T01:36:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.182+0000 7f69e87f8640 1 -- 172.21.15.22:0/2336558012 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f69f8004020 con 0x55e950e7ea20 2024-08-20T01:36:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.182+0000 7f69e87f8640 1 -- 172.21.15.22:0/2336558012 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f69f8004220 con 0x55e950e7ea20 2024-08-20T01:36:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.186+0000 7f6a0dbfc740 10 client.25786 fetch_fsmap learned FSMap version 30 2024-08-20T01:36:35.188 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.186+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/2336558012 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e950bbc620 con 0x55e950e7ea20 2024-08-20T01:36:35.188 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.187+0000 7f69e87f8640 1 -- 172.21.15.22:0/2336558012 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e950d8fe00 con 0x55e950e7ea20 2024-08-20T01:36:35.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.188+0000 7f69e87f8640 1 -- 172.21.15.22:0/2336558012 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f69f8019030 con 0x55e950e7ea20 2024-08-20T01:36:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.189+0000 7f6a0dbfc740 10 client.25786 fetch_fsmap finished waiting for FSMap version 30 2024-08-20T01:36:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.189+0000 7f6a0dbfc740 10 client.25786 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:36:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.189+0000 7f6a0dbfc740 20 client.25786 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.189+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/2336558012 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e950e93f90 0x55e950e963f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:35.191 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.189+0000 7f6a0dbfc740 4 client.25786 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:35.191 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.189+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/2336558012 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e950df32b0 con 0x55e950e93f90 2024-08-20T01:36:35.191 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.189+0000 7f6a03fff640 1 --2- 172.21.15.22:0/2336558012 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e950e93f90 0x55e950e963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:35.192 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.191+0000 7f6a03fff640 1 --2- 172.21.15.22:0/2336558012 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e950e93f90 0x55e950e963f0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cc76dde5ee00395 server_cookie=cbd27b5b9ffadc82 in_seq=0 out_seq=0 2024-08-20T01:36:35.192 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.191+0000 7f69e87f8640 10 client.25786 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:35.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.255+0000 7f69e87f8640 1 -- 172.21.15.22:0/2336558012 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e950df32b0 con 0x55e950e93f90 2024-08-20T01:36:35.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.255+0000 7f69e87f8640 10 client.25786 handle_command_reply: tid=0 2024-08-20T01:36:35.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.255+0000 7f6a0dbfc740 1 client.25786 shutdown 2024-08-20T01:36:35.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.256+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/2336558012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e7ea20 msgr2=0x55e950e88240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:35.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.256+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/2336558012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e7ea20 0x55e950e88240 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f69f8005fd0 tx=0x7f69f8012be0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.265+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/2336558012 shutdown_connections 2024-08-20T01:36:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.265+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/2336558012 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e950e93f90 0x55e950e963f0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.265+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/2336558012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e83d90 0x55e950e894b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.265+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/2336558012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e81350 0x55e950e888e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.265+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/2336558012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e7ea20 0x55e950e88240 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.265+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/2336558012 >> 172.21.15.22:0/2336558012 conn(0x55e950e79b70 msgr2=0x55e950e78c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:35.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.265+0000 7f69e87f8640 0 client.25786 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:35.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.266+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/2336558012 shutdown_connections 2024-08-20T01:36:35.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.266+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/2336558012 wait complete. 2024-08-20T01:36:35.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.266+0000 7f6a0dbfc740 20 client.25786 trim_cache size 0 max 16384 2024-08-20T01:36:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.331+0000 7f6a0dbfc740 1 Processor -- start 2024-08-20T01:36:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.332+0000 7f6a0dbfc740 1 -- start start 2024-08-20T01:36:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.332+0000 7f6a0dbfc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e7ea20 0x55e950e85600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.332+0000 7f6a0dbfc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e81350 0x55e950e85b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.333+0000 7f6a08ba7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e7ea20 0x55e950e85600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.333+0000 7f6a08ba7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e7ea20 0x55e950e85600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:38322/0 (socket says 172.21.15.22:38322) 2024-08-20T01:36:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.333+0000 7f6a08ba7640 1 -- 172.21.15.22:0/3538556599 learned_addr learned my addr 172.21.15.22:0/3538556599 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.333+0000 7f6a03fff640 1 --2- 172.21.15.22:0/3538556599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e81350 0x55e950e85b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.333+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/3538556599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e83d90 0x55e950e87230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.333+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/3538556599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f69f0010e80 con 0x55e950e83d90 2024-08-20T01:36:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.333+0000 7f6a093a8640 1 --2- 172.21.15.22:0/3538556599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e83d90 0x55e950e87230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.334+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/3538556599 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f69f000e6c0 con 0x55e950e7ea20 2024-08-20T01:36:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.334+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/3538556599 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f69f000c5c0 con 0x55e950e81350 2024-08-20T01:36:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.334+0000 7f6a08ba7640 1 -- 172.21.15.22:0/3538556599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e81350 msgr2=0x55e950e85b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.335+0000 7f6a08ba7640 1 --2- 172.21.15.22:0/3538556599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e81350 0x55e950e85b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.335+0000 7f6a08ba7640 1 -- 172.21.15.22:0/3538556599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e83d90 msgr2=0x55e950e87230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.335+0000 7f6a08ba7640 1 --2- 172.21.15.22:0/3538556599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e83d90 0x55e950e87230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.335+0000 7f6a08ba7640 1 -- 172.21.15.22:0/3538556599 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e950e751a0 con 0x55e950e7ea20 2024-08-20T01:36:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.335+0000 7f6a03fff640 1 --2- 172.21.15.22:0/3538556599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e81350 0x55e950e85b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:36:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.335+0000 7f6a093a8640 1 --2- 172.21.15.22:0/3538556599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e83d90 0x55e950e87230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:36:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.335+0000 7f6a08ba7640 1 --2- 172.21.15.22:0/3538556599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e7ea20 0x55e950e85600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f69f8000be0 tx=0x7f69f80108d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b2fc73feec70eb1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.355+0000 7f69ea7fc640 1 -- 172.21.15.22:0/3538556599 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f802a070 con 0x55e950e7ea20 2024-08-20T01:36:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.355+0000 7f69ea7fc640 1 -- 172.21.15.22:0/3538556599 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69f8010bc0 con 0x55e950e7ea20 2024-08-20T01:36:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.356+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/3538556599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e7ea20 msgr2=0x55e950e85600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.356+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/3538556599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e7ea20 0x55e950e85600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f69f8000be0 tx=0x7f69f80108d0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.357+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/3538556599 shutdown_connections 2024-08-20T01:36:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.357+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/3538556599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e83d90 0x55e950e87230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.357+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/3538556599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e81350 0x55e950e85b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.357+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/3538556599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e7ea20 0x55e950e85600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.357+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/3538556599 >> 172.21.15.22:0/3538556599 conn(0x55e950e79b70 msgr2=0x55e950e7a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:35.385 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.384+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/3538556599 shutdown_connections 2024-08-20T01:36:35.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.384+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/3538556599 wait complete. 2024-08-20T01:36:35.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.384+0000 7f6a0dbfc740 1 -- start start 2024-08-20T01:36:35.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.384+0000 7f6a0dbfc740 1 Processor -- start 2024-08-20T01:36:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.385+0000 7f6a0dbfc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e81350 0x55e950e8c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.385+0000 7f6a0dbfc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e83d90 0x55e950e8cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.385+0000 7f6a08ba7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e81350 0x55e950e8c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.385+0000 7f6a03fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e83d90 0x55e950e8cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.386+0000 7f6a03fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e83d90 0x55e950e8cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57076/0 (socket says 172.21.15.22:57076) 2024-08-20T01:36:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.386+0000 7f6a08ba7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e81350 0x55e950e8c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:38338/0 (socket says 172.21.15.22:38338) 2024-08-20T01:36:35.389 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.385+0000 7f6a0dbfc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e8dae0 0x55e950e8df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.386+0000 7f6a0dbfc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f69f000cb80 con 0x55e950e83d90 2024-08-20T01:36:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.386+0000 7f6a0dbfc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f69f000dff0 con 0x55e950e81350 2024-08-20T01:36:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.386+0000 7f6a0dbfc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f69f000d250 con 0x55e950e8dae0 2024-08-20T01:36:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.386+0000 7f6a0dbfc740 10 client.0 _ll_register_callbacks cb 0x7f69f800bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:35.391 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.386+0000 7f6a03fff640 1 -- 172.21.15.22:0/3617055077 learned_addr learned my addr 172.21.15.22:0/3617055077 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:35.391 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.386+0000 7f6a093a8640 1 --2- 172.21.15.22:0/3617055077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e8dae0 0x55e950e8df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:35.391 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.387+0000 7f6a03fff640 1 -- 172.21.15.22:0/3617055077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e8dae0 msgr2=0x55e950e8df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.387+0000 7f6a03fff640 1 --2- 172.21.15.22:0/3617055077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e8dae0 0x55e950e8df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.387+0000 7f6a03fff640 1 -- 172.21.15.22:0/3617055077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e81350 msgr2=0x55e950e8c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.387+0000 7f6a03fff640 1 --2- 172.21.15.22:0/3617055077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e81350 0x55e950e8c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.387+0000 7f6a03fff640 1 -- 172.21.15.22:0/3617055077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e950e8e790 con 0x55e950e83d90 2024-08-20T01:36:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.388+0000 7f6a03fff640 1 --2- 172.21.15.22:0/3617055077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e83d90 0x55e950e8cf40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f69fc005530 tx=0x7f69fc0ab140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d06423977b4ed52 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:35.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.405+0000 7f69e87f8640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:36:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.405+0000 7f69e87f8640 1 -- 172.21.15.22:0/3617055077 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc0cb060 con 0x55e950e83d90 2024-08-20T01:36:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.405+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/3617055077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e950e88690 con 0x55e950e83d90 2024-08-20T01:36:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.405+0000 7f69e87f8640 1 -- 172.21.15.22:0/3617055077 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f69fc0a7340 con 0x55e950e83d90 2024-08-20T01:36:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.406+0000 7f69e87f8640 1 -- 172.21.15.22:0/3617055077 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f69fc01d040 con 0x55e950e83d90 2024-08-20T01:36:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.406+0000 7f6a0dbfc740 10 client.16161 fetch_fsmap learned FSMap version 30 2024-08-20T01:36:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.406+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/3617055077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e950e8fbd0 con 0x55e950e83d90 2024-08-20T01:36:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.406+0000 7f69e87f8640 1 -- 172.21.15.22:0/3617055077 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e950e88690 con 0x55e950e83d90 2024-08-20T01:36:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.406+0000 7f69e87f8640 1 -- 172.21.15.22:0/3617055077 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f69fc0a7540 con 0x55e950e83d90 2024-08-20T01:36:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.407+0000 7f6a0dbfc740 10 client.16161 fetch_fsmap finished waiting for FSMap version 30 2024-08-20T01:36:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.407+0000 7f6a0dbfc740 10 client.16161 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:36:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.407+0000 7f6a0dbfc740 20 client.16161 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.407+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/3617055077 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e950efed20 0x55e950f01140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.407+0000 7f6a0dbfc740 4 client.16161 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:36:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.407+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/3617055077 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e950deed50 con 0x55e950efed20 2024-08-20T01:36:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.407+0000 7f6a08ba7640 1 --2- 172.21.15.22:0/3617055077 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e950efed20 0x55e950f01140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.407+0000 7f69e87f8640 10 client.16161 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:35.408+0000 7f6a08ba7640 1 --2- 172.21.15.22:0/3617055077 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e950efed20 0x55e950f01140 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6097df77a36d7f5 server_cookie=6c4d417b56d8d789 in_seq=0 out_seq=0 2024-08-20T01:36:35.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:35 smithi134 ceph-mon[22511]: pgmap v509: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 11 MiB/s wr, 943 op/s 2024-08-20T01:36:35.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:35 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:36:35.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:35 smithi077 ceph-mon[22251]: pgmap v509: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 11 MiB/s wr, 943 op/s 2024-08-20T01:36:35.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:35 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:36:37.310 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:36:37.394 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:37 smithi022 ceph-mon[18709]: pgmap v510: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 12 MiB/s wr, 758 op/s 2024-08-20T01:36:37.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:37 smithi134 ceph-mon[22511]: pgmap v510: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 12 MiB/s wr, 758 op/s 2024-08-20T01:36:37.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:37 smithi077 ceph-mon[22251]: pgmap v510: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 12 MiB/s wr, 758 op/s 2024-08-20T01:36:38.151 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:38.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.879+0000 7fb5fdf7f640 1 -- 172.21.15.22:0/3289134949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5f8109e80 msgr2=0x7fb5f8110ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:38.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.879+0000 7fb5fdf7f640 1 --2- 172.21.15.22:0/3289134949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5f8109e80 0x7fb5f8110ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009900 tx=0x7fb5e002a4d0 comp rx=0 tx=0).stop 2024-08-20T01:36:38.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.890+0000 7fb5fdf7f640 1 -- 172.21.15.22:0/3289134949 shutdown_connections 2024-08-20T01:36:38.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.890+0000 7fb5fdf7f640 1 --2- 172.21.15.22:0/3289134949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5f811bdd0 0x7fb5f811e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:38.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.890+0000 7fb5fdf7f640 1 --2- 172.21.15.22:0/3289134949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5f810a260 0x7fb5f810a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:38.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.890+0000 7fb5fdf7f640 1 --2- 172.21.15.22:0/3289134949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5f8109e80 0x7fb5f8110ee0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:38.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.890+0000 7fb5fdf7f640 1 -- 172.21.15.22:0/3289134949 >> 172.21.15.22:0/3289134949 conn(0x7fb5f806dcc0 msgr2=0x7fb5f806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:38.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.891+0000 7fb5fdf7f640 1 -- 172.21.15.22:0/3289134949 shutdown_connections 2024-08-20T01:36:38.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.891+0000 7fb5fdf7f640 1 -- 172.21.15.22:0/3289134949 wait complete. 2024-08-20T01:36:38.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.891+0000 7fb5fdf7f640 1 Processor -- start 2024-08-20T01:36:38.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.891+0000 7fb5fdf7f640 1 -- start start 2024-08-20T01:36:38.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.892+0000 7fb5fdf7f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5f8109e80 0x7fb5f81a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:38.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.892+0000 7fb5fdf7f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5f810a260 0x7fb5f81a8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:38.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.892+0000 7fb5fdf7f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5f811bdd0 0x7fb5f81ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:38.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.892+0000 7fb5fdf7f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f81218a0 con 0x7fb5f811bdd0 2024-08-20T01:36:38.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.892+0000 7fb5fdf7f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f8121720 con 0x7fb5f810a260 2024-08-20T01:36:38.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.892+0000 7fb5fdf7f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f8121a20 con 0x7fb5f8109e80 2024-08-20T01:36:38.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.894+0000 7fb5f77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5f8109e80 0x7fb5f81a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:38.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.898+0000 7fb5f77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5f8109e80 0x7fb5f81a7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:53784/0 (socket says 172.21.15.22:53784) 2024-08-20T01:36:38.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.898+0000 7fb5f77fe640 1 -- 172.21.15.22:0/3275289318 learned_addr learned my addr 172.21.15.22:0/3275289318 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:38.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.902+0000 7fb5f7fff640 1 --2- 172.21.15.22:0/3275289318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5f811bdd0 0x7fb5f81ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:38.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.902+0000 7fb5f77fe640 1 -- 172.21.15.22:0/3275289318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5f810a260 msgr2=0x7fb5f81a8310 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T01:36:38.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.902+0000 7fb5f77fe640 1 --2- 172.21.15.22:0/3275289318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5f810a260 0x7fb5f81a8310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:38.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.902+0000 7fb5f77fe640 1 -- 172.21.15.22:0/3275289318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5f811bdd0 msgr2=0x7fb5f81ad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:38.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.902+0000 7fb5f77fe640 1 --2- 172.21.15.22:0/3275289318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5f811bdd0 0x7fb5f81ad6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:38.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.902+0000 7fb5f77fe640 1 -- 172.21.15.22:0/3275289318 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f81ade80 con 0x7fb5f8109e80 2024-08-20T01:36:38.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.902+0000 7fb5f7fff640 1 --2- 172.21.15.22:0/3275289318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5f811bdd0 0x7fb5f81ad6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:38.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.902+0000 7fb5f77fe640 1 --2- 172.21.15.22:0/3275289318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5f8109e80 0x7fb5f81a7dd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0006010 tx=0x7fb5e0003fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:38.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.905+0000 7fb5f57fa640 1 -- 172.21.15.22:0/3275289318 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0040030 con 0x7fb5f8109e80 2024-08-20T01:36:38.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.905+0000 7fb5f57fa640 1 -- 172.21.15.22:0/3275289318 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5e003c8f0 con 0x7fb5f8109e80 2024-08-20T01:36:38.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.905+0000 7fb5f57fa640 1 -- 172.21.15.22:0/3275289318 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0031a10 con 0x7fb5f8109e80 2024-08-20T01:36:38.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.905+0000 7fb5fdf7f640 1 -- 172.21.15.22:0/3275289318 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f81ae110 con 0x7fb5f8109e80 2024-08-20T01:36:38.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.905+0000 7fb5fdf7f640 1 -- 172.21.15.22:0/3275289318 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f81115b0 con 0x7fb5f8109e80 2024-08-20T01:36:38.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.908+0000 7fb600378740 1 Processor -- start 2024-08-20T01:36:38.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.912+0000 7fb5f57fa640 1 -- 172.21.15.22:0/3275289318 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb5e0043030 con 0x7fb5f8109e80 2024-08-20T01:36:38.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.916+0000 7fb600378740 1 -- start start 2024-08-20T01:36:38.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.918+0000 7fb5f57fa640 1 --2- 172.21.15.22:0/3275289318 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb5e40b3da0 0x7fb5e40b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:38.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.918+0000 7fb5f57fa640 1 -- 172.21.15.22:0/3275289318 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb5e0104590 con 0x7fb5f8109e80 2024-08-20T01:36:38.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.921+0000 7fb600378740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 0x562696212be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:38.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.921+0000 7fb600378740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562696213120 0x56269621eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:38.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.921+0000 7fb600378740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56269621f0b0 0x5626962214a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:38.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.921+0000 7fb600378740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5626961898e0 con 0x562696212800 2024-08-20T01:36:38.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.921+0000 7fb600378740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562696178de0 con 0x562696213120 2024-08-20T01:36:38.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.921+0000 7fb600378740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56269617ce20 con 0x56269621f0b0 2024-08-20T01:36:38.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.922+0000 7fb5effff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562696213120 0x56269621eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:38.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.922+0000 7fb5effff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562696213120 0x56269621eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:38380/0 (socket says 172.21.15.22:38380) 2024-08-20T01:36:38.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.922+0000 7fb5effff640 1 -- 172.21.15.22:0/3219418818 learned_addr learned my addr 172.21.15.22:0/3219418818 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:38.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.922+0000 7fb5f7fff640 1 --2- 172.21.15.22:0/3275289318 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb5e40b3da0 0x7fb5e40b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:38.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.923+0000 7fb5f77fe640 1 --2- 172.21.15.22:0/3219418818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 0x562696212be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:38.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.923+0000 7fb5f7fff640 1 --2- 172.21.15.22:0/3219418818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56269621f0b0 0x5626962214a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:38.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.923+0000 7fb5f77fe640 1 -- 172.21.15.22:0/3219418818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56269621f0b0 msgr2=0x5626962214a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:38.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.923+0000 7fb5f77fe640 1 --2- 172.21.15.22:0/3219418818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56269621f0b0 0x5626962214a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:38.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.923+0000 7fb5f77fe640 1 -- 172.21.15.22:0/3219418818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562696213120 msgr2=0x56269621eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:38.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.923+0000 7fb5f77fe640 1 --2- 172.21.15.22:0/3219418818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562696213120 0x56269621eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:38.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.923+0000 7fb5f77fe640 1 -- 172.21.15.22:0/3219418818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562695ed8650 con 0x562696212800 2024-08-20T01:36:38.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.923+0000 7fb5f7fff640 1 --2- 172.21.15.22:0/3275289318 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb5e40b3da0 0x7fb5e40b6260 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0007ea0 tx=0x7fb5f000c690 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:38.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.924+0000 7fb5f77fe640 1 --2- 172.21.15.22:0/3219418818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 0x562696212be0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0101fc0 tx=0x7fb5e00cb010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a40a497caeee9f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:38.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.928+0000 7fb5edffb640 1 -- 172.21.15.22:0/3219418818 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e004a040 con 0x562696212800 2024-08-20T01:36:38.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.928+0000 7fb5edffb640 1 -- 172.21.15.22:0/3219418818 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5e00cfa40 con 0x562696212800 2024-08-20T01:36:38.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.928+0000 7fb5edffb640 1 -- 172.21.15.22:0/3219418818 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e00cb8c0 con 0x562696212800 2024-08-20T01:36:38.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.931+0000 7fb600378740 1 -- 172.21.15.22:0/3219418818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 msgr2=0x562696212be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:38.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.931+0000 7fb600378740 1 --2- 172.21.15.22:0/3219418818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 0x562696212be0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0101fc0 tx=0x7fb5e00cb010 comp rx=0 tx=0).stop 2024-08-20T01:36:38.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.933+0000 7fb600378740 1 -- 172.21.15.22:0/3219418818 shutdown_connections 2024-08-20T01:36:38.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.933+0000 7fb600378740 1 --2- 172.21.15.22:0/3219418818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56269621f0b0 0x5626962214a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:38.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.933+0000 7fb600378740 1 --2- 172.21.15.22:0/3219418818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562696213120 0x56269621eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:38.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.933+0000 7fb600378740 1 --2- 172.21.15.22:0/3219418818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 0x562696212be0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:38.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.933+0000 7fb600378740 1 -- 172.21.15.22:0/3219418818 >> 172.21.15.22:0/3219418818 conn(0x562696210630 msgr2=0x5626962117d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:38.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.934+0000 7fb600378740 1 -- 172.21.15.22:0/3219418818 shutdown_connections 2024-08-20T01:36:38.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.934+0000 7fb600378740 1 -- 172.21.15.22:0/3219418818 wait complete. 2024-08-20T01:36:38.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.934+0000 7fb600378740 1 -- start start 2024-08-20T01:36:38.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.935+0000 7fb600378740 1 Processor -- start 2024-08-20T01:36:38.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.935+0000 7fb600378740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 0x56269621c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:38.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.935+0000 7fb600378740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562696213120 0x56269621c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:38.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.935+0000 7fb600378740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56269621f0b0 0x56269621cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:38.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.935+0000 7fb600378740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562695fdb700 con 0x562696212800 2024-08-20T01:36:38.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.935+0000 7fb600378740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5626960ff7c0 con 0x56269621f0b0 2024-08-20T01:36:38.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.935+0000 7fb600378740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562696221b20 con 0x562696213120 2024-08-20T01:36:38.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.935+0000 7fb600378740 10 client.0 _ll_register_callbacks cb 0x5626961726b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:38.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.937+0000 7fb5f7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56269621f0b0 0x56269621cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:38.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.937+0000 7fb5f77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 0x56269621c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:38.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.937+0000 7fb5f77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 0x56269621c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57116/0 (socket says 172.21.15.22:57116) 2024-08-20T01:36:38.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.937+0000 7fb5f77fe640 1 -- 172.21.15.22:0/4126525575 learned_addr learned my addr 172.21.15.22:0/4126525575 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:38.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.937+0000 7fb5effff640 1 --2- 172.21.15.22:0/4126525575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562696213120 0x56269621c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:38.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.940+0000 7fb5effff640 1 -- 172.21.15.22:0/4126525575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56269621f0b0 msgr2=0x56269621cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:38.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.940+0000 7fb5effff640 1 --2- 172.21.15.22:0/4126525575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56269621f0b0 0x56269621cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:38.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.940+0000 7fb5effff640 1 -- 172.21.15.22:0/4126525575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 msgr2=0x56269621c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:38.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.940+0000 7fb5effff640 1 --2- 172.21.15.22:0/4126525575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 0x56269621c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:38.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.940+0000 7fb5effff640 1 -- 172.21.15.22:0/4126525575 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56269622aea0 con 0x562696213120 2024-08-20T01:36:38.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.941+0000 7fb5effff640 1 --2- 172.21.15.22:0/4126525575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562696213120 0x56269621c660 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80058c0 tx=0x7fb5e800fad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d78b1c2bfda4164d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:38.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.941+0000 7fb5d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:36:38.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.945+0000 7fb5d6ffd640 1 -- 172.21.15.22:0/4126525575 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8004220 con 0x562696213120 2024-08-20T01:36:38.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.945+0000 7fb600378740 1 -- 172.21.15.22:0/4126525575 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562696128100 con 0x562696213120 2024-08-20T01:36:38.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.945+0000 7fb5d6ffd640 1 -- 172.21.15.22:0/4126525575 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb5e80043c0 con 0x562696213120 2024-08-20T01:36:38.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.950+0000 7fb5d6ffd640 1 -- 172.21.15.22:0/4126525575 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb5e8005020 con 0x562696213120 2024-08-20T01:36:38.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.951+0000 7fb600378740 10 client.25804 fetch_fsmap learned FSMap version 31 2024-08-20T01:36:38.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.951+0000 7fb600378740 1 -- 172.21.15.22:0/4126525575 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56269624f910 con 0x562696213120 2024-08-20T01:36:38.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.954+0000 7fb5d6ffd640 1 -- 172.21.15.22:0/4126525575 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562696128100 con 0x562696213120 2024-08-20T01:36:38.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.954+0000 7fb5d6ffd640 1 -- 172.21.15.22:0/4126525575 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fb5e8010760 con 0x562696213120 2024-08-20T01:36:38.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.957+0000 7fb600378740 10 client.25804 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:36:38.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.957+0000 7fb600378740 10 client.25804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:36:38.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.957+0000 7fb600378740 20 client.25804 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:38.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.957+0000 7fb600378740 1 --2- 172.21.15.22:0/4126525575 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562696250e70 0x562696253290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:38.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.957+0000 7fb600378740 4 client.25804 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:38.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.957+0000 7fb600378740 1 -- 172.21.15.22:0/4126525575 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56269618b830 con 0x562696250e70 2024-08-20T01:36:38.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.962+0000 7fb5f77fe640 1 --2- 172.21.15.22:0/4126525575 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562696250e70 0x562696253290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:38.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.976+0000 7fb5f77fe640 1 --2- 172.21.15.22:0/4126525575 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562696250e70 0x562696253290 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d27b516f7255011f server_cookie=9864859b7d6f994f in_seq=0 out_seq=0 2024-08-20T01:36:38.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.977+0000 7fb5d6ffd640 10 client.25804 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.996+0000 7fb5d6ffd640 1 -- 172.21.15.22:0/4126525575 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56269618b830 con 0x562696250e70 2024-08-20T01:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.996+0000 7fb5d6ffd640 10 client.25804 handle_command_reply: tid=0 2024-08-20T01:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.996+0000 7fb600378740 1 client.25804 shutdown 2024-08-20T01:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.996+0000 7fb600378740 1 -- 172.21.15.22:0/4126525575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562696213120 msgr2=0x56269621c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.996+0000 7fb600378740 1 --2- 172.21.15.22:0/4126525575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562696213120 0x56269621c660 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80058c0 tx=0x7fb5e800fad0 comp rx=0 tx=0).stop 2024-08-20T01:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.996+0000 7fb600378740 1 -- 172.21.15.22:0/4126525575 shutdown_connections 2024-08-20T01:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.996+0000 7fb600378740 1 --2- 172.21.15.22:0/4126525575 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562696250e70 0x562696253290 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.996+0000 7fb600378740 1 --2- 172.21.15.22:0/4126525575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56269621f0b0 0x56269621cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.996+0000 7fb600378740 1 --2- 172.21.15.22:0/4126525575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562696213120 0x56269621c660 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80058c0 tx=0x7fb5e800fad0 comp rx=0 tx=0).stop 2024-08-20T01:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.996+0000 7fb5d6ffd640 0 client.25804 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.996+0000 7fb600378740 1 --2- 172.21.15.22:0/4126525575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 0x56269621c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.996+0000 7fb600378740 1 -- 172.21.15.22:0/4126525575 >> 172.21.15.22:0/4126525575 conn(0x562696210630 msgr2=0x5626962161d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:39.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.996+0000 7fb600378740 1 -- 172.21.15.22:0/4126525575 shutdown_connections 2024-08-20T01:36:39.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.996+0000 7fb600378740 1 -- 172.21.15.22:0/4126525575 wait complete. 2024-08-20T01:36:39.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:38.997+0000 7fb600378740 20 client.25804 trim_cache size 0 max 16384 2024-08-20T01:36:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.034+0000 7fb600378740 1 Processor -- start 2024-08-20T01:36:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.035+0000 7fb600378740 1 -- start start 2024-08-20T01:36:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.035+0000 7fb600378740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 0x562696216870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.035+0000 7fb600378740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56269621f0b0 0x562696258b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.035+0000 7fb600378740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5626962590a0 0x56269621c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.035+0000 7fb600378740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f81b7230 con 0x562696212800 2024-08-20T01:36:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.035+0000 7fb600378740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f81b4a40 con 0x5626962590a0 2024-08-20T01:36:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.035+0000 7fb600378740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f8117e10 con 0x56269621f0b0 2024-08-20T01:36:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.035+0000 7fb5effff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56269621f0b0 0x562696258b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.036+0000 7fb5effff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56269621f0b0 0x562696258b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:53802/0 (socket says 172.21.15.22:53802) 2024-08-20T01:36:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.036+0000 7fb5effff640 1 -- 172.21.15.22:0/1190209742 learned_addr learned my addr 172.21.15.22:0/1190209742 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.036+0000 7fb5effff640 1 -- 172.21.15.22:0/1190209742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5626962590a0 msgr2=0x56269621c120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:36:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.036+0000 7fb5effff640 1 --2- 172.21.15.22:0/1190209742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5626962590a0 0x56269621c120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.036+0000 7fb5effff640 1 -- 172.21.15.22:0/1190209742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 msgr2=0x562696216870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.036+0000 7fb5effff640 1 --2- 172.21.15.22:0/1190209742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 0x562696216870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.036+0000 7fb5effff640 1 -- 172.21.15.22:0/1190209742 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626962110b0 con 0x56269621f0b0 2024-08-20T01:36:39.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.041+0000 7fb5effff640 1 --2- 172.21.15.22:0/1190209742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56269621f0b0 0x562696258b60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800a2a0 tx=0x7fb5e8005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f07b9614c18cbc1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:39.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.043+0000 7fb5ed7fa640 1 -- 172.21.15.22:0/1190209742 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8026070 con 0x56269621f0b0 2024-08-20T01:36:39.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.044+0000 7fb5ed7fa640 1 -- 172.21.15.22:0/1190209742 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5e8027040 con 0x56269621f0b0 2024-08-20T01:36:39.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.044+0000 7fb5ed7fa640 1 -- 172.21.15.22:0/1190209742 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8004a60 con 0x56269621f0b0 2024-08-20T01:36:39.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.047+0000 7fb600378740 1 -- 172.21.15.22:0/1190209742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56269621f0b0 msgr2=0x562696258b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:39.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.047+0000 7fb600378740 1 --2- 172.21.15.22:0/1190209742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56269621f0b0 0x562696258b60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800a2a0 tx=0x7fb5e8005dd0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.048+0000 7fb600378740 1 -- 172.21.15.22:0/1190209742 shutdown_connections 2024-08-20T01:36:39.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.048+0000 7fb600378740 1 --2- 172.21.15.22:0/1190209742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5626962590a0 0x56269621c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.048+0000 7fb600378740 1 --2- 172.21.15.22:0/1190209742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56269621f0b0 0x562696258b60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.048+0000 7fb600378740 1 --2- 172.21.15.22:0/1190209742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 0x562696216870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.048+0000 7fb600378740 1 -- 172.21.15.22:0/1190209742 >> 172.21.15.22:0/1190209742 conn(0x562696210630 msgr2=0x56269621b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:39.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.061+0000 7fb600378740 1 -- 172.21.15.22:0/1190209742 shutdown_connections 2024-08-20T01:36:39.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.065+0000 7fb600378740 1 -- 172.21.15.22:0/1190209742 wait complete. 2024-08-20T01:36:39.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.066+0000 7fb600378740 1 -- start start 2024-08-20T01:36:39.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.066+0000 7fb600378740 1 Processor -- start 2024-08-20T01:36:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.066+0000 7fb600378740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 0x562696227380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.067+0000 7fb600378740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56269621f0b0 0x562696222850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.067+0000 7fb600378740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626962590a0 0x562696222d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.067+0000 7fb600378740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f8118480 con 0x562696212800 2024-08-20T01:36:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.067+0000 7fb600378740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f81198f0 con 0x56269621f0b0 2024-08-20T01:36:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.067+0000 7fb600378740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f8118b50 con 0x5626962590a0 2024-08-20T01:36:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.067+0000 7fb600378740 10 client.0 _ll_register_callbacks cb 0x7fb5e800a4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.067+0000 7fb5f7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626962590a0 0x562696222d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.067+0000 7fb5f7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626962590a0 0x562696222d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:53806/0 (socket says 172.21.15.22:53806) 2024-08-20T01:36:39.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.067+0000 7fb5f7fff640 1 -- 172.21.15.22:0/1633608384 learned_addr learned my addr 172.21.15.22:0/1633608384 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:39.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.069+0000 7fb5f7fff640 1 -- 172.21.15.22:0/1633608384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56269621f0b0 msgr2=0x562696222850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:39.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.069+0000 7fb5f7fff640 1 --2- 172.21.15.22:0/1633608384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56269621f0b0 0x562696222850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.069+0000 7fb5f7fff640 1 -- 172.21.15.22:0/1633608384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 msgr2=0x562696227380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:36:39.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.069+0000 7fb5f7fff640 1 --2- 172.21.15.22:0/1633608384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 0x562696227380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.069+0000 7fb5f7fff640 1 -- 172.21.15.22:0/1633608384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56269622ab70 con 0x5626962590a0 2024-08-20T01:36:39.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.070+0000 7fb5f7fff640 1 --2- 172.21.15.22:0/1633608384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626962590a0 0x562696222d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0011e00 tx=0x7fb5f0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50134ce985f110bb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:39.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.070+0000 7fb5d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:36:39.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.071+0000 7fb5d6ffd640 1 -- 172.21.15.22:0/1633608384 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f000fd20 con 0x5626962590a0 2024-08-20T01:36:39.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.071+0000 7fb600378740 1 -- 172.21.15.22:0/1633608384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5e8027040 con 0x5626962590a0 2024-08-20T01:36:39.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.072+0000 7fb5d6ffd640 1 -- 172.21.15.22:0/1633608384 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb5f0026400 con 0x5626962590a0 2024-08-20T01:36:39.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.072+0000 7fb5d6ffd640 1 -- 172.21.15.22:0/1633608384 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb5f0026600 con 0x5626962590a0 2024-08-20T01:36:39.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.072+0000 7fb600378740 10 client.25810 fetch_fsmap learned FSMap version 31 2024-08-20T01:36:39.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.072+0000 7fb600378740 1 -- 172.21.15.22:0/1633608384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5626962bba60 con 0x5626962590a0 2024-08-20T01:36:39.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.076+0000 7fb5d6ffd640 1 -- 172.21.15.22:0/1633608384 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5e8027040 con 0x5626962590a0 2024-08-20T01:36:39.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.076+0000 7fb5d6ffd640 1 -- 172.21.15.22:0/1633608384 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fb5f001e800 con 0x5626962590a0 2024-08-20T01:36:39.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.077+0000 7fb600378740 10 client.25810 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:36:39.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.077+0000 7fb600378740 10 client.25810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:36:39.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.077+0000 7fb600378740 20 client.25810 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:39.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.077+0000 7fb600378740 1 --2- 172.21.15.22:0/1633608384 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5626962bc150 0x5626962be570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.077+0000 7fb600378740 4 client.25810 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:36:39.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.077+0000 7fb600378740 1 -- 172.21.15.22:0/1633608384 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5626961872d0 con 0x5626962bc150 2024-08-20T01:36:39.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.081+0000 7fb5f77fe640 1 --2- 172.21.15.22:0/1633608384 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5626962bc150 0x5626962be570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:39.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.092+0000 7fb5f77fe640 1 --2- 172.21.15.22:0/1633608384 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5626962bc150 0x5626962be570 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e94575f9f98774e server_cookie=74354465d967b6ee in_seq=0 out_seq=0 2024-08-20T01:36:39.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.092+0000 7fb5d6ffd640 10 client.25810 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:39.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.104+0000 7fb5d6ffd640 1 -- 172.21.15.22:0/1633608384 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5626961872d0 con 0x5626962bc150 2024-08-20T01:36:39.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.104+0000 7fb5d6ffd640 10 client.25810 handle_command_reply: tid=0 2024-08-20T01:36:39.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.104+0000 7fb600378740 1 client.25810 shutdown 2024-08-20T01:36:39.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.104+0000 7fb600378740 1 -- 172.21.15.22:0/1633608384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626962590a0 msgr2=0x562696222d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:39.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.104+0000 7fb600378740 1 --2- 172.21.15.22:0/1633608384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626962590a0 0x562696222d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0011e00 tx=0x7fb5f0004a40 comp rx=0 tx=0).stop 2024-08-20T01:36:39.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.104+0000 7fb600378740 1 -- 172.21.15.22:0/1633608384 shutdown_connections 2024-08-20T01:36:39.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.104+0000 7fb600378740 1 --2- 172.21.15.22:0/1633608384 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5626962bc150 0x5626962be570 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.104+0000 7fb600378740 1 --2- 172.21.15.22:0/1633608384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5626962590a0 0x562696222d90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.104+0000 7fb600378740 1 --2- 172.21.15.22:0/1633608384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56269621f0b0 0x562696222850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.104+0000 7fb600378740 1 --2- 172.21.15.22:0/1633608384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562696212800 0x562696227380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.104+0000 7fb600378740 1 -- 172.21.15.22:0/1633608384 >> 172.21.15.22:0/1633608384 conn(0x562696210630 msgr2=0x56269620edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:39.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.105+0000 7fb5d6ffd640 0 client.25810 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:39.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.105+0000 7fb600378740 1 -- 172.21.15.22:0/1633608384 shutdown_connections 2024-08-20T01:36:39.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.105+0000 7fb600378740 1 -- 172.21.15.22:0/1633608384 wait complete. 2024-08-20T01:36:39.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.105+0000 7fb600378740 20 client.25810 trim_cache size 0 max 16384 2024-08-20T01:36:39.108 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:36:39.108 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-08-20T01:36:39.108 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-08-20T01:36:39.108 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:36:39.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.106+0000 7fb5fdf7f640 1 -- 172.21.15.22:0/3275289318 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb5e40b3da0 msgr2=0x7fb5e40b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:39.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.106+0000 7fb5fdf7f640 1 --2- 172.21.15.22:0/3275289318 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb5e40b3da0 0x7fb5e40b6260 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0007ea0 tx=0x7fb5f000c690 comp rx=0 tx=0).stop 2024-08-20T01:36:39.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.106+0000 7fb5fdf7f640 1 -- 172.21.15.22:0/3275289318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5f8109e80 msgr2=0x7fb5f81a7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:39.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.106+0000 7fb5fdf7f640 1 --2- 172.21.15.22:0/3275289318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5f8109e80 0x7fb5f81a7dd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0006010 tx=0x7fb5e0003fc0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.108+0000 7fb5fdf7f640 1 -- 172.21.15.22:0/3275289318 shutdown_connections 2024-08-20T01:36:39.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.108+0000 7fb5fdf7f640 1 --2- 172.21.15.22:0/3275289318 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb5e40b3da0 0x7fb5e40b6260 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.108+0000 7fb5fdf7f640 1 --2- 172.21.15.22:0/3275289318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5f811bdd0 0x7fb5f81ad6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.108+0000 7fb5fdf7f640 1 --2- 172.21.15.22:0/3275289318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5f810a260 0x7fb5f81a8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.108+0000 7fb5fdf7f640 1 --2- 172.21.15.22:0/3275289318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5f8109e80 0x7fb5f81a7dd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.108+0000 7fb5fdf7f640 1 -- 172.21.15.22:0/3275289318 >> 172.21.15.22:0/3275289318 conn(0x7fb5f806dcc0 msgr2=0x7fb5f811c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:39.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.110+0000 7fb5fdf7f640 1 -- 172.21.15.22:0/3275289318 shutdown_connections 2024-08-20T01:36:39.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:39.110+0000 7fb5fdf7f640 1 -- 172.21.15.22:0/3275289318 wait complete. 2024-08-20T01:36:39.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:39 smithi022 ceph-mon[18709]: pgmap v511: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 12 MiB/s wr, 798 op/s 2024-08-20T01:36:39.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:39 smithi022 ceph-mon[18709]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:36:39.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:39 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:36:39.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:39 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:36:39.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:39 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:36:39.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:39 smithi134 ceph-mon[22511]: pgmap v511: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 12 MiB/s wr, 798 op/s 2024-08-20T01:36:39.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:39 smithi134 ceph-mon[22511]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:36:39.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:39 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:36:39.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:39 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:36:39.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:39 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:36:39.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:39 smithi077 ceph-mon[22251]: pgmap v511: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 12 MiB/s wr, 798 op/s 2024-08-20T01:36:39.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:39 smithi077 ceph-mon[22251]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:36:39.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:39 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:36:39.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:39 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:36:39.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:39 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:36:40.026 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:36:40.026 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:36:40.044 INFO:tasks.workunit.client.0.smithi022.stdout: 515 1637138 839 1141643 640 668464 1424 2024-08-20T01:36:40.636 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:41.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.290+0000 7f39e6c96640 1 -- 172.21.15.22:0/738605077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39e0107210 msgr2=0x7f39e0107650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:41.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.290+0000 7f39e6c96640 1 --2- 172.21.15.22:0/738605077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39e0107210 0x7f39e0107650 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009900 tx=0x7f39d002a3f0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.291+0000 7f39e6c96640 1 -- 172.21.15.22:0/738605077 shutdown_connections 2024-08-20T01:36:41.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.291+0000 7f39e6c96640 1 --2- 172.21.15.22:0/738605077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39e0107b90 0x7f39e010e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.291+0000 7f39e6c96640 1 --2- 172.21.15.22:0/738605077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39e0107210 0x7f39e0107650 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.291+0000 7f39e6c96640 1 --2- 172.21.15.22:0/738605077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39e0101800 0x7f39e0101be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.291+0000 7f39e6c96640 1 -- 172.21.15.22:0/738605077 >> 172.21.15.22:0/738605077 conn(0x7f39e00fd250 msgr2=0x7f39e00ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:41.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.292+0000 7f39e6c96640 1 -- 172.21.15.22:0/738605077 shutdown_connections 2024-08-20T01:36:41.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.292+0000 7f39e6c96640 1 -- 172.21.15.22:0/738605077 wait complete. 2024-08-20T01:36:41.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.296+0000 7f39e6c96640 1 Processor -- start 2024-08-20T01:36:41.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.296+0000 7f39e6c96640 1 -- start start 2024-08-20T01:36:41.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.297+0000 7f39e6c96640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39e0101800 0x7f39e019af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:41.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.297+0000 7f39e6c96640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39e0107210 0x7f39e019b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:41.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.297+0000 7f39e6c96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39e0107b90 0x7f39e01a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:41.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.298+0000 7f39e5493640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39e0107210 0x7f39e019b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:41.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.298+0000 7f39e5c94640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39e0101800 0x7f39e019af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:41.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.298+0000 7f39e5c94640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39e0101800 0x7f39e019af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:45458/0 (socket says 172.21.15.22:45458) 2024-08-20T01:36:41.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.298+0000 7f39e5493640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39e0107210 0x7f39e019b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:50862/0 (socket says 172.21.15.22:50862) 2024-08-20T01:36:41.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.298+0000 7f39e6c96640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f39e0110790 con 0x7f39e0107b90 2024-08-20T01:36:41.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.298+0000 7f39e5c94640 1 -- 172.21.15.22:0/2891281905 learned_addr learned my addr 172.21.15.22:0/2891281905 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:41.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.298+0000 7f39e6c96640 1 -- 172.21.15.22:0/2891281905 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f39e0110610 con 0x7f39e0101800 2024-08-20T01:36:41.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.298+0000 7f39e6c96640 1 -- 172.21.15.22:0/2891281905 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f39e0110910 con 0x7f39e0107210 2024-08-20T01:36:41.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.299+0000 7f39e5c94640 1 -- 172.21.15.22:0/2891281905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39e0107210 msgr2=0x7f39e019b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:41.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.299+0000 7f39e5c94640 1 --2- 172.21.15.22:0/2891281905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39e0107210 0x7f39e019b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.300+0000 7f39e5c94640 1 -- 172.21.15.22:0/2891281905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39e0107b90 msgr2=0x7f39e01a0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:41.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.300+0000 7f39e5c94640 1 --2- 172.21.15.22:0/2891281905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39e0107b90 0x7f39e01a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.300+0000 7f39e5c94640 1 -- 172.21.15.22:0/2891281905 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e01a1040 con 0x7f39e0101800 2024-08-20T01:36:41.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.301+0000 7f39e5c94640 1 --2- 172.21.15.22:0/2891281905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39e0101800 0x7f39e019af90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00e9f0 tx=0x7f39dc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:41.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.303+0000 7f39d6ffd640 1 -- 172.21.15.22:0/2891281905 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc00cd80 con 0x7f39e0101800 2024-08-20T01:36:41.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.303+0000 7f39d6ffd640 1 -- 172.21.15.22:0/2891281905 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39dc0108e0 con 0x7f39e0101800 2024-08-20T01:36:41.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.304+0000 7f39d6ffd640 1 -- 172.21.15.22:0/2891281905 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc018980 con 0x7f39e0101800 2024-08-20T01:36:41.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.304+0000 7f39e6c96640 1 -- 172.21.15.22:0/2891281905 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e01a1330 con 0x7f39e0101800 2024-08-20T01:36:41.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.304+0000 7f39e6c96640 1 -- 172.21.15.22:0/2891281905 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e01a79f0 con 0x7f39e0101800 2024-08-20T01:36:41.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.306+0000 7f39e6c96640 1 -- 172.21.15.22:0/2891281905 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39e0102ab0 con 0x7f39e0101800 2024-08-20T01:36:41.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.309+0000 7f39d6ffd640 1 -- 172.21.15.22:0/2891281905 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f39dc010430 con 0x7f39e0101800 2024-08-20T01:36:41.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.310+0000 7f39d6ffd640 1 --2- 172.21.15.22:0/2891281905 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f39cc0b3cf0 0x7f39cc0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:41.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.310+0000 7f39d6ffd640 1 -- 172.21.15.22:0/2891281905 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f39dc0e4070 con 0x7f39e0101800 2024-08-20T01:36:41.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.315+0000 7f39e5493640 1 --2- 172.21.15.22:0/2891281905 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f39cc0b3cf0 0x7f39cc0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:41.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.315+0000 7f39d6ffd640 1 -- 172.21.15.22:0/2891281905 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f39dc0ab700 con 0x7f39e0101800 2024-08-20T01:36:41.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.324+0000 7f39e5493640 1 --2- 172.21.15.22:0/2891281905 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f39cc0b3cf0 0x7f39cc0b61b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f39d0000c00 tx=0x7f39d0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:41.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:41 smithi022 ceph-mon[18709]: pgmap v512: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.7 MiB/s wr, 658 op/s 2024-08-20T01:36:41.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:41 smithi134 ceph-mon[22511]: pgmap v512: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.7 MiB/s wr, 658 op/s 2024-08-20T01:36:41.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:41 smithi077 ceph-mon[22251]: pgmap v512: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.7 MiB/s wr, 658 op/s 2024-08-20T01:36:41.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.675+0000 7f39e6c96640 1 -- 172.21.15.22:0/2891281905 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39e0111840 con 0x7f39e0101800 2024-08-20T01:36:41.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.678+0000 7f39d6ffd640 1 -- 172.21.15.22:0/2891281905 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11915 (secure 0 0 0) 0x7f39dc0ab000 con 0x7f39e0101800 2024-08-20T01:36:41.680 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:36:41.680 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":31,"btime":"2024-08-20T01:36:38:097249+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:36:37.446760+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24586,24575,24565]},"id":1}]} 2024-08-20T01:36:41.681 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 31 2024-08-20T01:36:41.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.681+0000 7f39e6c96640 1 -- 172.21.15.22:0/2891281905 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f39cc0b3cf0 msgr2=0x7f39cc0b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:41.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.681+0000 7f39e6c96640 1 --2- 172.21.15.22:0/2891281905 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f39cc0b3cf0 0x7f39cc0b61b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f39d0000c00 tx=0x7f39d0031400 comp rx=0 tx=0).stop 2024-08-20T01:36:41.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.681+0000 7f39e6c96640 1 -- 172.21.15.22:0/2891281905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39e0101800 msgr2=0x7f39e019af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:41.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.681+0000 7f39e6c96640 1 --2- 172.21.15.22:0/2891281905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39e0101800 0x7f39e019af90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00e9f0 tx=0x7f39dc00eeb0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.681+0000 7f39e6c96640 1 -- 172.21.15.22:0/2891281905 shutdown_connections 2024-08-20T01:36:41.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.681+0000 7f39e6c96640 1 --2- 172.21.15.22:0/2891281905 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f39cc0b3cf0 0x7f39cc0b61b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.681+0000 7f39e6c96640 1 --2- 172.21.15.22:0/2891281905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39e0107b90 0x7f39e01a0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.681+0000 7f39e6c96640 1 --2- 172.21.15.22:0/2891281905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39e0107210 0x7f39e019b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.681+0000 7f39e6c96640 1 --2- 172.21.15.22:0/2891281905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39e0101800 0x7f39e019af90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.681+0000 7f39e6c96640 1 -- 172.21.15.22:0/2891281905 >> 172.21.15.22:0/2891281905 conn(0x7f39e00fd250 msgr2=0x7f39e00ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:41.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.681+0000 7f39e6c96640 1 -- 172.21.15.22:0/2891281905 shutdown_connections 2024-08-20T01:36:41.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:41.682+0000 7f39e6c96640 1 -- 172.21.15.22:0/2891281905 wait complete. 2024-08-20T01:36:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.689+0000 7f69e87f8640 1 -- 172.21.15.22:0/3617055077 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e950deed50 con 0x55e950efed20 2024-08-20T01:36:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.689+0000 7f69e87f8640 10 client.16161 handle_command_reply: tid=0 2024-08-20T01:36:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.689+0000 7f6a0dbfc740 1 client.16161 shutdown 2024-08-20T01:36:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.689+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/3617055077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e83d90 msgr2=0x55e950e8cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.690+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/3617055077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e83d90 0x55e950e8cf40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f69fc005530 tx=0x7f69fc0ab140 comp rx=0 tx=0).stop 2024-08-20T01:36:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.690+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/3617055077 shutdown_connections 2024-08-20T01:36:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.690+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/3617055077 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e950efed20 0x55e950f01140 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.690+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/3617055077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e950e8dae0 0x55e950e8df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.690+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/3617055077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e950e83d90 0x55e950e8cf40 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.690+0000 7f69e87f8640 0 client.16161 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.690+0000 7f6a0dbfc740 1 --2- 172.21.15.22:0/3617055077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e950e81350 0x55e950e8c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.690+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/3617055077 >> 172.21.15.22:0/3617055077 conn(0x55e950e79b70 msgr2=0x55e950e87230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.690+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/3617055077 shutdown_connections 2024-08-20T01:36:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.690+0000 7f6a0dbfc740 1 -- 172.21.15.22:0/3617055077 wait complete. 2024-08-20T01:36:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.690+0000 7f6a0dbfc740 20 client.16161 trim_cache size 0 max 16384 2024-08-20T01:36:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:36:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:36:41.694 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:36:41.694 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:36:41.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.691+0000 7f6a0ae0b640 1 -- 172.21.15.22:0/2242647294 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f69ec0b3da0 msgr2=0x7f69ec0b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:41.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.691+0000 7f6a0ae0b640 1 --2- 172.21.15.22:0/2242647294 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f69ec0b3da0 0x7f69ec0b6260 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f69f40096c0 tx=0x7f69f4005fd0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.691+0000 7f6a0ae0b640 1 -- 172.21.15.22:0/2242647294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a0410a0f0 msgr2=0x7f6a04119810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:41.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.691+0000 7f6a0ae0b640 1 --2- 172.21.15.22:0/2242647294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a0410a0f0 0x7f6a04119810 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00cce0 tx=0x7f69fc00a620 comp rx=0 tx=0).stop 2024-08-20T01:36:41.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.691+0000 7f6a0ae0b640 1 -- 172.21.15.22:0/2242647294 shutdown_connections 2024-08-20T01:36:41.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.691+0000 7f6a0ae0b640 1 --2- 172.21.15.22:0/2242647294 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f69ec0b3da0 0x7f69ec0b6260 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.691+0000 7f6a0ae0b640 1 --2- 172.21.15.22:0/2242647294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a0410aa30 0x7f6a04117bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.691+0000 7f6a0ae0b640 1 --2- 172.21.15.22:0/2242647294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a0410a0f0 0x7f6a04119810 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.691+0000 7f6a0ae0b640 1 --2- 172.21.15.22:0/2242647294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a04074230 0x7f6a041192d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.691+0000 7f6a0ae0b640 1 -- 172.21.15.22:0/2242647294 >> 172.21.15.22:0/2242647294 conn(0x7f6a0406f580 msgr2=0x7f6a04070220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.691+0000 7f6a0ae0b640 1 -- 172.21.15.22:0/2242647294 shutdown_connections 2024-08-20T01:36:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:41.691+0000 7f6a0ae0b640 1 -- 172.21.15.22:0/2242647294 wait complete. 2024-08-20T01:36:42.127 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:42 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2891281905' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:42.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:42 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2891281905' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:42.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:42 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2891281905' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:42.848 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:36:43.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:43 smithi022 ceph-mon[18709]: pgmap v513: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.6 MiB/s wr, 1.54k op/s 2024-08-20T01:36:43.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:43 smithi134 ceph-mon[22511]: pgmap v513: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.6 MiB/s wr, 1.54k op/s 2024-08-20T01:36:43.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:43 smithi077 ceph-mon[22251]: pgmap v513: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.6 MiB/s wr, 1.54k op/s 2024-08-20T01:36:43.602 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:45.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.277+0000 7fbeaa389640 1 -- 172.21.15.22:0/3394083434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbea4075b90 msgr2=0x7fbea4113310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:45.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.277+0000 7fbeaa389640 1 --2- 172.21.15.22:0/3394083434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbea4075b90 0x7fbea4113310 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009900 tx=0x7fbe9402a420 comp rx=0 tx=0).stop 2024-08-20T01:36:45.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.277+0000 7fbeaa389640 1 -- 172.21.15.22:0/3394083434 shutdown_connections 2024-08-20T01:36:45.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.277+0000 7fbeaa389640 1 --2- 172.21.15.22:0/3394083434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4113850 0x7fbea4115c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.277+0000 7fbeaa389640 1 --2- 172.21.15.22:0/3394083434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbea4075b90 0x7fbea4113310 secure :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009900 tx=0x7fbe9402a420 comp rx=0 tx=0).stop 2024-08-20T01:36:45.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.277+0000 7fbeaa389640 1 --2- 172.21.15.22:0/3394083434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbea4075270 0x7fbea4075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.277+0000 7fbeaa389640 1 -- 172.21.15.22:0/3394083434 >> 172.21.15.22:0/3394083434 conn(0x7fbea40fe540 msgr2=0x7fbea4100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:45.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.281+0000 7fbeaa389640 1 -- 172.21.15.22:0/3394083434 shutdown_connections 2024-08-20T01:36:45.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.281+0000 7fbeaa389640 1 -- 172.21.15.22:0/3394083434 wait complete. 2024-08-20T01:36:45.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.282+0000 7fbeaa389640 1 Processor -- start 2024-08-20T01:36:45.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.282+0000 7fbeaa389640 1 -- start start 2024-08-20T01:36:45.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.283+0000 7fbeaa389640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbea4075270 0x7fbea4112b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:45.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.283+0000 7fbeaa389640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4113850 0x7fbea41130b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:45.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.283+0000 7fbeaa389640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbea410cd90 0x7fbea410d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:45.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.283+0000 7fbeaa389640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbea4106fb0 con 0x7fbea410cd90 2024-08-20T01:36:45.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.283+0000 7fbeaa389640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbea4106e30 con 0x7fbea4075270 2024-08-20T01:36:45.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.283+0000 7fbeaa389640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbea4107130 con 0x7fbea4113850 2024-08-20T01:36:45.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.283+0000 7fbea3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbea4075270 0x7fbea4112b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:45.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.283+0000 7fbea3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbea4075270 0x7fbea4112b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:45482/0 (socket says 172.21.15.22:45482) 2024-08-20T01:36:45.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.283+0000 7fbea3fff640 1 -- 172.21.15.22:0/366710464 learned_addr learned my addr 172.21.15.22:0/366710464 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:45.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.284+0000 7fbea8926640 1 --2- 172.21.15.22:0/366710464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbea410cd90 0x7fbea410d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:45.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.284+0000 7fbea37fe640 1 --2- 172.21.15.22:0/366710464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4113850 0x7fbea41130b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:45.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.285+0000 7fbea3fff640 1 -- 172.21.15.22:0/366710464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4113850 msgr2=0x7fbea41130b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:45.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.285+0000 7fbea3fff640 1 --2- 172.21.15.22:0/366710464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4113850 0x7fbea41130b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.285+0000 7fbea3fff640 1 -- 172.21.15.22:0/366710464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbea410cd90 msgr2=0x7fbea410d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:45.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.285+0000 7fbea3fff640 1 --2- 172.21.15.22:0/366710464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbea410cd90 0x7fbea410d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.285+0000 7fbea3fff640 1 -- 172.21.15.22:0/366710464 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea410da60 con 0x7fbea4075270 2024-08-20T01:36:45.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.289+0000 7fbea3fff640 1 --2- 172.21.15.22:0/366710464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbea4075270 0x7fbea4112b70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c00ba50 tx=0x7fbe9c00bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:45.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.289+0000 7fbea17fa640 1 -- 172.21.15.22:0/366710464 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c019070 con 0x7fbea4075270 2024-08-20T01:36:45.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.289+0000 7fbeaa389640 1 -- 172.21.15.22:0/366710464 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea406c8a0 con 0x7fbea4075270 2024-08-20T01:36:45.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.289+0000 7fbeaa389640 1 -- 172.21.15.22:0/366710464 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea406cde0 con 0x7fbea4075270 2024-08-20T01:36:45.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.294+0000 7fbeac782740 1 Processor -- start 2024-08-20T01:36:45.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.302+0000 7fbeac782740 1 -- start start 2024-08-20T01:36:45.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.307+0000 7fbeac782740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 0x5627c0aabc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:45.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.307+0000 7fbeac782740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0aac1a0 0x5627c0ab7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:45.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.307+0000 7fbeac782740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0ab8130 0x5627c0aba520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:45.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.307+0000 7fbeac782740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5627c0a22930 con 0x5627c0aac1a0 2024-08-20T01:36:45.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.307+0000 7fbeac782740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5627c0a11e30 con 0x5627c0aab880 2024-08-20T01:36:45.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.307+0000 7fbeac782740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5627c0a15e70 con 0x5627c0ab8130 2024-08-20T01:36:45.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.307+0000 7fbea17fa640 1 -- 172.21.15.22:0/366710464 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe9c00cbe0 con 0x7fbea4075270 2024-08-20T01:36:45.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.307+0000 7fbea17fa640 1 -- 172.21.15.22:0/366710464 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c0075d0 con 0x7fbea4075270 2024-08-20T01:36:45.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.307+0000 7fbea17fa640 1 -- 172.21.15.22:0/366710464 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbe9c01c070 con 0x7fbea4075270 2024-08-20T01:36:45.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.309+0000 7fbea17fa640 1 --2- 172.21.15.22:0/366710464 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbe8c0b3d00 0x7fbe8c0b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:45.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.309+0000 7fbea17fa640 1 -- 172.21.15.22:0/366710464 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fbe9c0e41d0 con 0x7fbea4075270 2024-08-20T01:36:45.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.310+0000 7fbea8926640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 0x5627c0aabc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:45.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.310+0000 7fbea8926640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 0x5627c0aabc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:45496/0 (socket says 172.21.15.22:45496) 2024-08-20T01:36:45.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.310+0000 7fbea8926640 1 -- 172.21.15.22:0/2118399826 learned_addr learned my addr 172.21.15.22:0/2118399826 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:45.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.310+0000 7fbea37fe640 1 --2- 172.21.15.22:0/2118399826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0ab8130 0x5627c0aba520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:45.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.310+0000 7fbea8926640 1 --2- 172.21.15.22:0/366710464 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbe8c0b3d00 0x7fbe8c0b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:45.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.310+0000 7fbea8926640 1 -- 172.21.15.22:0/2118399826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0ab8130 msgr2=0x5627c0aba520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:45.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.310+0000 7fbea8926640 1 --2- 172.21.15.22:0/2118399826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0ab8130 0x5627c0aba520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.310+0000 7fbea8926640 1 -- 172.21.15.22:0/2118399826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0aac1a0 msgr2=0x5627c0ab7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:45.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.310+0000 7fbea8926640 1 --2- 172.21.15.22:0/2118399826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0aac1a0 0x5627c0ab7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.310+0000 7fbea8926640 1 -- 172.21.15.22:0/2118399826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627c0771650 con 0x5627c0aab880 2024-08-20T01:36:45.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.312+0000 7fbea8926640 1 --2- 172.21.15.22:0/2118399826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 0x5627c0aabc60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbe98015400 tx=0x7fbe980158c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d325efc572c62be server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:45.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.314+0000 7fbe8a7fc640 1 -- 172.21.15.22:0/2118399826 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe980176a0 con 0x5627c0aab880 2024-08-20T01:36:45.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.314+0000 7fbe8a7fc640 1 -- 172.21.15.22:0/2118399826 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe98017cf0 con 0x5627c0aab880 2024-08-20T01:36:45.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.314+0000 7fbe8a7fc640 1 -- 172.21.15.22:0/2118399826 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe98020400 con 0x5627c0aab880 2024-08-20T01:36:45.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.316+0000 7fbeac782740 1 -- 172.21.15.22:0/2118399826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 msgr2=0x5627c0aabc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:45.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.316+0000 7fbeac782740 1 --2- 172.21.15.22:0/2118399826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 0x5627c0aabc60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbe98015400 tx=0x7fbe980158c0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.317+0000 7fbeac782740 1 -- 172.21.15.22:0/2118399826 shutdown_connections 2024-08-20T01:36:45.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.317+0000 7fbeac782740 1 --2- 172.21.15.22:0/2118399826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0ab8130 0x5627c0aba520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.317+0000 7fbeac782740 1 --2- 172.21.15.22:0/2118399826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0aac1a0 0x5627c0ab7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.317+0000 7fbeac782740 1 --2- 172.21.15.22:0/2118399826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 0x5627c0aabc60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.317+0000 7fbeac782740 1 -- 172.21.15.22:0/2118399826 >> 172.21.15.22:0/2118399826 conn(0x5627c0aa96b0 msgr2=0x5627c0aaa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:45.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.323+0000 7fbeac782740 1 -- 172.21.15.22:0/2118399826 shutdown_connections 2024-08-20T01:36:45.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.325+0000 7fbea8926640 1 --2- 172.21.15.22:0/366710464 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbe8c0b3d00 0x7fbe8c0b61c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbe9801f000 tx=0x7fbe98018ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:45.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.325+0000 7fbeac782740 1 -- 172.21.15.22:0/2118399826 wait complete. 2024-08-20T01:36:45.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.326+0000 7fbeac782740 1 -- start start 2024-08-20T01:36:45.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.326+0000 7fbeac782740 1 Processor -- start 2024-08-20T01:36:45.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.326+0000 7fbeac782740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0aab880 0x5627c0ab7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:45.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.326+0000 7fbeac782740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0aac1a0 0x5627c0ab5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:45.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.326+0000 7fbeac782740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0ab8130 0x5627c0ab5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:45.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.327+0000 7fbeac782740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5627c0874700 con 0x5627c0aac1a0 2024-08-20T01:36:45.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.327+0000 7fbeac782740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5627c0998810 con 0x5627c0ab8130 2024-08-20T01:36:45.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.327+0000 7fbeac782740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5627c0adcdf0 con 0x5627c0aab880 2024-08-20T01:36:45.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.327+0000 7fbeac782740 10 client.0 _ll_register_callbacks cb 0x5627c0a0b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:45.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.327+0000 7fbea8926640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0ab8130 0x5627c0ab5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:45.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.327+0000 7fbea8926640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0ab8130 0x5627c0ab5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:45498/0 (socket says 172.21.15.22:45498) 2024-08-20T01:36:45.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.327+0000 7fbea8926640 1 -- 172.21.15.22:0/3856486277 learned_addr learned my addr 172.21.15.22:0/3856486277 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:45.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.328+0000 7fbea37fe640 1 --2- 172.21.15.22:0/3856486277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0aac1a0 0x5627c0ab5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:45.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.328+0000 7fbea3fff640 1 --2- 172.21.15.22:0/3856486277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0aab880 0x5627c0ab7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:45.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.329+0000 7fbea37fe640 1 -- 172.21.15.22:0/3856486277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0aab880 msgr2=0x5627c0ab7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:45.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.329+0000 7fbea37fe640 1 --2- 172.21.15.22:0/3856486277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0aab880 0x5627c0ab7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.329+0000 7fbea37fe640 1 -- 172.21.15.22:0/3856486277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0ab8130 msgr2=0x5627c0ab5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.329+0000 7fbea37fe640 1 --2- 172.21.15.22:0/3856486277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0ab8130 0x5627c0ab5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.329+0000 7fbea37fe640 1 -- 172.21.15.22:0/3856486277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627c0ae6180 con 0x5627c0aac1a0 2024-08-20T01:36:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.329+0000 7fbea8926640 1 --2- 172.21.15.22:0/3856486277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0ab8130 0x5627c0ab5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.329+0000 7fbea37fe640 1 --2- 172.21.15.22:0/3856486277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0aac1a0 0x5627c0ab5070 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fbe94008000 tx=0x7fbe94005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98fbff392c9d201 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.329+0000 7fbe837fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:36:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.330+0000 7fbe837fe640 1 -- 172.21.15.22:0/3856486277 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe94040020 con 0x5627c0aac1a0 2024-08-20T01:36:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.330+0000 7fbeac782740 1 -- 172.21.15.22:0/3856486277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5627c09c1150 con 0x5627c0aac1a0 2024-08-20T01:36:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.330+0000 7fbe837fe640 1 -- 172.21.15.22:0/3856486277 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fbe940048c0 con 0x5627c0aac1a0 2024-08-20T01:36:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.331+0000 7fbe837fe640 1 -- 172.21.15.22:0/3856486277 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbe94035070 con 0x5627c0aac1a0 2024-08-20T01:36:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.331+0000 7fbeac782740 10 client.16173 fetch_fsmap learned FSMap version 31 2024-08-20T01:36:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.331+0000 7fbeac782740 1 -- 172.21.15.22:0/3856486277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5627c0ae8b60 con 0x5627c0aac1a0 2024-08-20T01:36:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.332+0000 7fbe837fe640 1 -- 172.21.15.22:0/3856486277 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5627c09c1150 con 0x5627c0aac1a0 2024-08-20T01:36:45.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.333+0000 7fbe837fe640 1 -- 172.21.15.22:0/3856486277 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fbe9403a040 con 0x5627c0aac1a0 2024-08-20T01:36:45.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.333+0000 7fbeac782740 10 client.16173 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:36:45.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.333+0000 7fbeac782740 10 client.16173 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:36:45.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.333+0000 7fbeac782740 20 client.16173 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:45.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.333+0000 7fbeac782740 1 --2- 172.21.15.22:0/3856486277 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5627c0aea510 0x5627c0aec930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:45.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.333+0000 7fbeac782740 4 client.16173 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:45.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.333+0000 7fbeac782740 1 -- 172.21.15.22:0/3856486277 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627c0a24880 con 0x5627c0aea510 2024-08-20T01:36:45.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.336+0000 7fbea3fff640 1 --2- 172.21.15.22:0/3856486277 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5627c0aea510 0x5627c0aec930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:45.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.341+0000 7fbea3fff640 1 --2- 172.21.15.22:0/3856486277 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5627c0aea510 0x5627c0aec930 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=994609b125370a93 server_cookie=aea4d3db54115048 in_seq=0 out_seq=0 2024-08-20T01:36:45.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.341+0000 7fbe837fe640 10 client.16173 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:36:45.356 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:45 smithi022 ceph-mon[18709]: pgmap v514: 97 pgs: 97 active+clean; 1.9 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.1 MiB/s wr, 2.45k op/s 2024-08-20T01:36:45.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.354+0000 7fbe837fe640 1 -- 172.21.15.22:0/3856486277 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5627c0a24880 con 0x5627c0aea510 2024-08-20T01:36:45.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.354+0000 7fbe837fe640 10 client.16173 handle_command_reply: tid=0 2024-08-20T01:36:45.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.354+0000 7fbeac782740 1 client.16173 shutdown 2024-08-20T01:36:45.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.363+0000 7fbeac782740 1 -- 172.21.15.22:0/3856486277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0aac1a0 msgr2=0x5627c0ab5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:45.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.363+0000 7fbeac782740 1 --2- 172.21.15.22:0/3856486277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0aac1a0 0x5627c0ab5070 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fbe94008000 tx=0x7fbe94005270 comp rx=0 tx=0).stop 2024-08-20T01:36:45.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.367+0000 7fbeac782740 1 -- 172.21.15.22:0/3856486277 shutdown_connections 2024-08-20T01:36:45.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.367+0000 7fbeac782740 1 --2- 172.21.15.22:0/3856486277 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5627c0aea510 0x5627c0aec930 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.367+0000 7fbeac782740 1 --2- 172.21.15.22:0/3856486277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0ab8130 0x5627c0ab5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.367+0000 7fbeac782740 1 --2- 172.21.15.22:0/3856486277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0aac1a0 0x5627c0ab5070 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.367+0000 7fbeac782740 1 --2- 172.21.15.22:0/3856486277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0aab880 0x5627c0ab7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.367+0000 7fbeac782740 1 -- 172.21.15.22:0/3856486277 >> 172.21.15.22:0/3856486277 conn(0x5627c0aa96b0 msgr2=0x5627c0aaf250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:45.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.367+0000 7fbe837fe640 0 client.16173 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:36:45.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.369+0000 7fbeac782740 1 -- 172.21.15.22:0/3856486277 shutdown_connections 2024-08-20T01:36:45.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.369+0000 7fbeac782740 1 -- 172.21.15.22:0/3856486277 wait complete. 2024-08-20T01:36:45.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.371+0000 7fbeac782740 20 client.16173 trim_cache size 0 max 16384 2024-08-20T01:36:45.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.422+0000 7fbeac782740 1 Processor -- start 2024-08-20T01:36:45.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.422+0000 7fbeac782740 1 -- start start 2024-08-20T01:36:45.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.423+0000 7fbeac782740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 0x5627c0ab57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:45.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.423+0000 7fbeac782740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0aac1a0 0x5627c0af21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:45.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.423+0000 7fbeac782740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0ab8130 0x5627c0af2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:45.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.423+0000 7fbea3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 0x5627c0ab57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:45.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.423+0000 7fbea3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 0x5627c0ab57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:45510/0 (socket says 172.21.15.22:45510) 2024-08-20T01:36:45.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.423+0000 7fbea37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0aac1a0 0x5627c0af21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:45.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.423+0000 7fbea37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0aac1a0 0x5627c0af21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:50918/0 (socket says 172.21.15.22:50918) 2024-08-20T01:36:45.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.423+0000 7fbea3fff640 1 -- 172.21.15.22:0/1206135519 learned_addr learned my addr 172.21.15.22:0/1206135519 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:45.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.424+0000 7fbeac782740 1 -- 172.21.15.22:0/1206135519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbe90010e70 con 0x5627c0ab8130 2024-08-20T01:36:45.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.424+0000 7fbeac782740 1 -- 172.21.15.22:0/1206135519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9000e680 con 0x5627c0aab880 2024-08-20T01:36:45.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.424+0000 7fbeac782740 1 -- 172.21.15.22:0/1206135519 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9000c580 con 0x5627c0aac1a0 2024-08-20T01:36:45.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.426+0000 7fbea8926640 1 --2- 172.21.15.22:0/1206135519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0ab8130 0x5627c0af2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:45.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.426+0000 7fbea3fff640 1 -- 172.21.15.22:0/1206135519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0aac1a0 msgr2=0x5627c0af21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:45.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.426+0000 7fbea3fff640 1 --2- 172.21.15.22:0/1206135519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0aac1a0 0x5627c0af21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.426+0000 7fbea3fff640 1 -- 172.21.15.22:0/1206135519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0ab8130 msgr2=0x5627c0af2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:45.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.427+0000 7fbea3fff640 1 --2- 172.21.15.22:0/1206135519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0ab8130 0x5627c0af2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.427+0000 7fbea3fff640 1 -- 172.21.15.22:0/1206135519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627c0aabfd0 con 0x5627c0aab880 2024-08-20T01:36:45.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.427+0000 7fbea8926640 1 --2- 172.21.15.22:0/1206135519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0ab8130 0x5627c0af2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:45.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.428+0000 7fbea3fff640 1 --2- 172.21.15.22:0/1206135519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 0x5627c0ab57e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0ab140 tx=0x7fbe9c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cac93ec4994e12cc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:45.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.429+0000 7fbe89ffb640 1 -- 172.21.15.22:0/1206135519 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00cd90 con 0x5627c0aab880 2024-08-20T01:36:45.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.429+0000 7fbe89ffb640 1 -- 172.21.15.22:0/1206135519 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe9c0e1dc0 con 0x5627c0aab880 2024-08-20T01:36:45.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.429+0000 7fbe89ffb640 1 -- 172.21.15.22:0/1206135519 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c0a6d80 con 0x5627c0aab880 2024-08-20T01:36:45.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.431+0000 7fbeac782740 1 -- 172.21.15.22:0/1206135519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 msgr2=0x5627c0ab57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:45.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.431+0000 7fbeac782740 1 --2- 172.21.15.22:0/1206135519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 0x5627c0ab57e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0ab140 tx=0x7fbe9c004a40 comp rx=0 tx=0).stop 2024-08-20T01:36:45.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.431+0000 7fbeac782740 1 -- 172.21.15.22:0/1206135519 shutdown_connections 2024-08-20T01:36:45.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.431+0000 7fbeac782740 1 --2- 172.21.15.22:0/1206135519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0ab8130 0x5627c0af2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.431+0000 7fbeac782740 1 --2- 172.21.15.22:0/1206135519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0aac1a0 0x5627c0af21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.431+0000 7fbeac782740 1 --2- 172.21.15.22:0/1206135519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 0x5627c0ab57e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.431+0000 7fbeac782740 1 -- 172.21.15.22:0/1206135519 >> 172.21.15.22:0/1206135519 conn(0x5627c0aa96b0 msgr2=0x5627c0ab38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.434+0000 7fbeac782740 1 -- 172.21.15.22:0/1206135519 shutdown_connections 2024-08-20T01:36:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.434+0000 7fbeac782740 1 -- 172.21.15.22:0/1206135519 wait complete. 2024-08-20T01:36:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.434+0000 7fbeac782740 1 -- start start 2024-08-20T01:36:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.435+0000 7fbeac782740 1 Processor -- start 2024-08-20T01:36:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.435+0000 7fbeac782740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 0x5627c0add890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.436+0000 7fbeac782740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0aac1a0 0x5627c0adddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.436+0000 7fbea3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 0x5627c0add890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.436+0000 7fbea3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 0x5627c0add890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:45518/0 (socket says 172.21.15.22:45518) 2024-08-20T01:36:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.436+0000 7fbea3fff640 1 -- 172.21.15.22:0/4056200196 learned_addr learned my addr 172.21.15.22:0/4056200196 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.436+0000 7fbeac782740 1 --2- 172.21.15.22:0/4056200196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0ab8130 0x5627c0b53180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.436+0000 7fbeac782740 1 -- 172.21.15.22:0/4056200196 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9000cb40 con 0x5627c0aac1a0 2024-08-20T01:36:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.436+0000 7fbeac782740 1 -- 172.21.15.22:0/4056200196 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9000dfb0 con 0x5627c0aab880 2024-08-20T01:36:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.436+0000 7fbea8926640 1 --2- 172.21.15.22:0/4056200196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0ab8130 0x5627c0b53180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.437+0000 7fbeac782740 1 -- 172.21.15.22:0/4056200196 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9000d210 con 0x5627c0ab8130 2024-08-20T01:36:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.437+0000 7fbea3fff640 1 -- 172.21.15.22:0/4056200196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0ab8130 msgr2=0x5627c0b53180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.437+0000 7fbea3fff640 1 --2- 172.21.15.22:0/4056200196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0ab8130 0x5627c0b53180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.437+0000 7fbea3fff640 1 -- 172.21.15.22:0/4056200196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0aac1a0 msgr2=0x5627c0adddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.437+0000 7fbea3fff640 1 --2- 172.21.15.22:0/4056200196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0aac1a0 0x5627c0adddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.437+0000 7fbea3fff640 1 -- 172.21.15.22:0/4056200196 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627c0b53820 con 0x5627c0aab880 2024-08-20T01:36:45.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.437+0000 7fbeac782740 10 client.0 _ll_register_callbacks cb 0x7fbe94009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:45.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.437+0000 7fbea3fff640 1 --2- 172.21.15.22:0/4056200196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 0x5627c0add890 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c000f80 tx=0x7fbe9c0a7820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bd086317ef2df76 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:45.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.438+0000 7fbeac782740 1 -- 172.21.15.22:0/4056200196 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe9c0e1dc0 con 0x5627c0aab880 2024-08-20T01:36:45.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.438+0000 7fbe837fe640 10 client.25802 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:36:45.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.438+0000 7fbe837fe640 1 -- 172.21.15.22:0/4056200196 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c0c9070 con 0x5627c0aab880 2024-08-20T01:36:45.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.438+0000 7fbe837fe640 1 -- 172.21.15.22:0/4056200196 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fbe9c0b3d20 con 0x5627c0aab880 2024-08-20T01:36:45.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.438+0000 7fbe837fe640 1 -- 172.21.15.22:0/4056200196 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbe9c0b3f20 con 0x5627c0aab880 2024-08-20T01:36:45.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.441+0000 7fbeac782740 10 client.25802 fetch_fsmap learned FSMap version 31 2024-08-20T01:36:45.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.441+0000 7fbeac782740 1 -- 172.21.15.22:0/4056200196 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({fsmap=31}) -- 0x5627c0b54950 con 0x5627c0aab880 2024-08-20T01:36:45.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.442+0000 7fbe837fe640 1 -- 172.21.15.22:0/4056200196 <== mon.2 v2:172.21.15.77:3300/0 4 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fbe9c0aa410 con 0x5627c0aab880 2024-08-20T01:36:45.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.442+0000 7fbeac782740 10 client.25802 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:36:45.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.442+0000 7fbeac782740 10 client.25802 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:36:45.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.442+0000 7fbeac782740 20 client.25802 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:45.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.442+0000 7fbeac782740 1 --2- 172.21.15.22:0/4056200196 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5627c0b54fa0 0x5627c0b573c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:45.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.442+0000 7fbeac782740 4 client.25802 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:36:45.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.442+0000 7fbeac782740 1 -- 172.21.15.22:0/4056200196 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fbe9c0e1dc0 con 0x5627c0b54fa0 2024-08-20T01:36:45.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.442+0000 7fbea37fe640 1 --2- 172.21.15.22:0/4056200196 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5627c0b54fa0 0x5627c0b573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:45.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.457+0000 7fbea37fe640 1 --2- 172.21.15.22:0/4056200196 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5627c0b54fa0 0x5627c0b573c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f3ef2242e1abfcb8 server_cookie=d0cc7cd1fefef15e in_seq=0 out_seq=0 2024-08-20T01:36:45.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.457+0000 7fbe837fe640 10 client.25802 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:36:45.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.462+0000 7fbe837fe640 1 -- 172.21.15.22:0/4056200196 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fbe9c0e1dc0 con 0x5627c0b54fa0 2024-08-20T01:36:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.462+0000 7fbe837fe640 10 client.25802 handle_command_reply: tid=0 2024-08-20T01:36:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.462+0000 7fbeac782740 1 client.25802 shutdown 2024-08-20T01:36:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.467+0000 7fbeac782740 1 -- 172.21.15.22:0/4056200196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 msgr2=0x5627c0add890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.467+0000 7fbeac782740 1 --2- 172.21.15.22:0/4056200196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 0x5627c0add890 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c000f80 tx=0x7fbe9c0a7820 comp rx=0 tx=0).stop 2024-08-20T01:36:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.467+0000 7fbeac782740 1 -- 172.21.15.22:0/4056200196 shutdown_connections 2024-08-20T01:36:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.467+0000 7fbeac782740 1 --2- 172.21.15.22:0/4056200196 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5627c0b54fa0 0x5627c0b573c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.467+0000 7fbeac782740 1 --2- 172.21.15.22:0/4056200196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627c0ab8130 0x5627c0b53180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.467+0000 7fbeac782740 1 --2- 172.21.15.22:0/4056200196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627c0aac1a0 0x5627c0adddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.467+0000 7fbeac782740 1 --2- 172.21.15.22:0/4056200196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627c0aab880 0x5627c0add890 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.467+0000 7fbeac782740 1 -- 172.21.15.22:0/4056200196 >> 172.21.15.22:0/4056200196 conn(0x5627c0aa96b0 msgr2=0x5627c0ab6660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:45.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.467+0000 7fbe837fe640 0 client.25802 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:36:45.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.467+0000 7fbeac782740 1 -- 172.21.15.22:0/4056200196 shutdown_connections 2024-08-20T01:36:45.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.468+0000 7fbeac782740 1 -- 172.21.15.22:0/4056200196 wait complete. 2024-08-20T01:36:45.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.470+0000 7fbeac782740 20 client.25802 trim_cache size 0 max 16384 2024-08-20T01:36:45.473 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:36:45.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.472+0000 7fbeaa389640 1 -- 172.21.15.22:0/366710464 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbe8c0b3d00 msgr2=0x7fbe8c0b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:45.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.472+0000 7fbeaa389640 1 --2- 172.21.15.22:0/366710464 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbe8c0b3d00 0x7fbe8c0b61c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbe9801f000 tx=0x7fbe98018ed0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.472+0000 7fbeaa389640 1 -- 172.21.15.22:0/366710464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbea4075270 msgr2=0x7fbea4112b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:45.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.472+0000 7fbeaa389640 1 --2- 172.21.15.22:0/366710464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbea4075270 0x7fbea4112b70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c00ba50 tx=0x7fbe9c00bf10 comp rx=0 tx=0).stop 2024-08-20T01:36:45.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.472+0000 7fbeaa389640 1 -- 172.21.15.22:0/366710464 shutdown_connections 2024-08-20T01:36:45.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.472+0000 7fbeaa389640 1 --2- 172.21.15.22:0/366710464 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbe8c0b3d00 0x7fbe8c0b61c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.472+0000 7fbeaa389640 1 --2- 172.21.15.22:0/366710464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbea410cd90 0x7fbea410d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.472+0000 7fbeaa389640 1 --2- 172.21.15.22:0/366710464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea4113850 0x7fbea41130b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.472+0000 7fbeaa389640 1 --2- 172.21.15.22:0/366710464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbea4075270 0x7fbea4112b70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:45.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.472+0000 7fbeaa389640 1 -- 172.21.15.22:0/366710464 >> 172.21.15.22:0/366710464 conn(0x7fbea40fe540 msgr2=0x7fbea41152d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:45.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.473+0000 7fbeaa389640 1 -- 172.21.15.22:0/366710464 shutdown_connections 2024-08-20T01:36:45.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:45.473+0000 7fbeaa389640 1 -- 172.21.15.22:0/366710464 wait complete. 2024-08-20T01:36:45.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:45 smithi134 ceph-mon[22511]: pgmap v514: 97 pgs: 97 active+clean; 1.9 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.1 MiB/s wr, 2.45k op/s 2024-08-20T01:36:45.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:45 smithi077 ceph-mon[22251]: pgmap v514: 97 pgs: 97 active+clean; 1.9 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.1 MiB/s wr, 2.45k op/s 2024-08-20T01:36:47.251 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:36:47.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:47 smithi134 ceph-mon[22511]: pgmap v515: 97 pgs: 97 active+clean; 1.9 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.3 MiB/s wr, 2.33k op/s 2024-08-20T01:36:47.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:47 smithi077 ceph-mon[22251]: pgmap v515: 97 pgs: 97 active+clean; 1.9 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.3 MiB/s wr, 2.33k op/s 2024-08-20T01:36:47.640 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:47 smithi022 ceph-mon[18709]: pgmap v515: 97 pgs: 97 active+clean; 1.9 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.3 MiB/s wr, 2.33k op/s 2024-08-20T01:36:49.186 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:49.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:49 smithi134 ceph-mon[22511]: pgmap v516: 97 pgs: 97 active+clean; 1.9 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.3 MiB/s wr, 2.53k op/s 2024-08-20T01:36:49.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:49 smithi077 ceph-mon[22251]: pgmap v516: 97 pgs: 97 active+clean; 1.9 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.3 MiB/s wr, 2.53k op/s 2024-08-20T01:36:49.608 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:49 smithi022 ceph-mon[18709]: pgmap v516: 97 pgs: 97 active+clean; 1.9 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.3 MiB/s wr, 2.53k op/s 2024-08-20T01:36:49.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.922+0000 7f4e53214640 1 -- 172.21.15.22:0/359569788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e4c1042c0 msgr2=0x7f4e4c10c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.922+0000 7f4e53214640 1 --2- 172.21.15.22:0/359569788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e4c1042c0 0x7f4e4c10c7b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4e38009900 tx=0x7f4e3802a410 comp rx=0 tx=0).stop 2024-08-20T01:36:49.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.922+0000 7f4e53214640 1 -- 172.21.15.22:0/359569788 shutdown_connections 2024-08-20T01:36:49.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.922+0000 7f4e53214640 1 --2- 172.21.15.22:0/359569788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e4c10ce00 0x7f4e4c10f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.922+0000 7f4e53214640 1 --2- 172.21.15.22:0/359569788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e4c1042c0 0x7f4e4c10c7b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.922+0000 7f4e53214640 1 --2- 172.21.15.22:0/359569788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e4c1039a0 0x7f4e4c103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.922+0000 7f4e53214640 1 -- 172.21.15.22:0/359569788 >> 172.21.15.22:0/359569788 conn(0x7f4e4c0fd400 msgr2=0x7f4e4c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:49.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.922+0000 7f4e53214640 1 -- 172.21.15.22:0/359569788 shutdown_connections 2024-08-20T01:36:49.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.922+0000 7f4e53214640 1 -- 172.21.15.22:0/359569788 wait complete. 2024-08-20T01:36:49.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.923+0000 7f4e53214640 1 Processor -- start 2024-08-20T01:36:49.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.923+0000 7f4e53214640 1 -- start start 2024-08-20T01:36:49.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.923+0000 7f4e53214640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e4c1039a0 0x7f4e4c103100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.923+0000 7f4e53214640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e4c1042c0 0x7f4e4c101650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.923+0000 7f4e53214640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e4c10ce00 0x7f4e4c101c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.923+0000 7f4e53214640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c112a70 con 0x7f4e4c1039a0 2024-08-20T01:36:49.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.923+0000 7f4e53214640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c1128f0 con 0x7f4e4c10ce00 2024-08-20T01:36:49.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.923+0000 7f4e53214640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c112bf0 con 0x7f4e4c1042c0 2024-08-20T01:36:49.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.924+0000 7f4e50fb0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e4c1039a0 0x7f4e4c103100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.924+0000 7f4e50fb0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e4c1039a0 0x7f4e4c103100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36190/0 (socket says 172.21.15.22:36190) 2024-08-20T01:36:49.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.924+0000 7f4e50fb0640 1 -- 172.21.15.22:0/2055757265 learned_addr learned my addr 172.21.15.22:0/2055757265 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:49.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.924+0000 7f4e4bfff640 1 --2- 172.21.15.22:0/2055757265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e4c1042c0 0x7f4e4c101650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.924+0000 7f4e517b1640 1 --2- 172.21.15.22:0/2055757265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e4c10ce00 0x7f4e4c101c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.924+0000 7f4e50fb0640 1 -- 172.21.15.22:0/2055757265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e4c1042c0 msgr2=0x7f4e4c101650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.924+0000 7f4e50fb0640 1 --2- 172.21.15.22:0/2055757265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e4c1042c0 0x7f4e4c101650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.924+0000 7f4e50fb0640 1 -- 172.21.15.22:0/2055757265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e4c10ce00 msgr2=0x7f4e4c101c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.924+0000 7f4e50fb0640 1 --2- 172.21.15.22:0/2055757265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e4c10ce00 0x7f4e4c101c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.924+0000 7f4e50fb0640 1 -- 172.21.15.22:0/2055757265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4c1ab900 con 0x7f4e4c1039a0 2024-08-20T01:36:49.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.924+0000 7f4e517b1640 1 --2- 172.21.15.22:0/2055757265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e4c10ce00 0x7f4e4c101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.924+0000 7f4e4bfff640 1 --2- 172.21.15.22:0/2055757265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e4c1042c0 0x7f4e4c101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.924+0000 7f4e50fb0640 1 --2- 172.21.15.22:0/2055757265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e4c1039a0 0x7f4e4c103100 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4e4000e9f0 tx=0x7f4e4000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.925+0000 7f4e49ffb640 1 -- 172.21.15.22:0/2055757265 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4000cd80 con 0x7f4e4c1039a0 2024-08-20T01:36:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.925+0000 7f4e53214640 1 -- 172.21.15.22:0/2055757265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e4c1abad0 con 0x7f4e4c1039a0 2024-08-20T01:36:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.925+0000 7f4e53214640 1 -- 172.21.15.22:0/2055757265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e4c1ac030 con 0x7f4e4c1039a0 2024-08-20T01:36:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.925+0000 7f4e49ffb640 1 -- 172.21.15.22:0/2055757265 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e400108e0 con 0x7f4e4c1039a0 2024-08-20T01:36:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.925+0000 7f4e49ffb640 1 -- 172.21.15.22:0/2055757265 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e400188e0 con 0x7f4e4c1039a0 2024-08-20T01:36:49.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.929+0000 7f4e5560d740 1 Processor -- start 2024-08-20T01:36:49.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.929+0000 7f4e5560d740 1 -- start start 2024-08-20T01:36:49.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.929+0000 7f4e5560d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff35880 0x556caff35c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.929+0000 7f4e5560d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff361a0 0x556caff41bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.929+0000 7f4e5560d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff42130 0x556caff44520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.929+0000 7f4e5560d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556cafeac930 con 0x556caff361a0 2024-08-20T01:36:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.929+0000 7f4e5560d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556cafe9be30 con 0x556caff42130 2024-08-20T01:36:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.929+0000 7f4e5560d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556cafe9fe70 con 0x556caff35880 2024-08-20T01:36:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.929+0000 7f4e49ffb640 1 -- 172.21.15.22:0/2055757265 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4e40010430 con 0x7f4e4c1039a0 2024-08-20T01:36:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.929+0000 7f4e4bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff42130 0x556caff44520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.929+0000 7f4e4bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff42130 0x556caff44520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:36912/0 (socket says 172.21.15.22:36912) 2024-08-20T01:36:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.929+0000 7f4e4bfff640 1 -- 172.21.15.22:0/2492050921 learned_addr learned my addr 172.21.15.22:0/2492050921 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.929+0000 7f4e50fb0640 1 --2- 172.21.15.22:0/2492050921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff361a0 0x556caff41bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.930+0000 7f4e4bfff640 1 -- 172.21.15.22:0/2492050921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff35880 msgr2=0x556caff35c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.930+0000 7f4e4bfff640 1 --2- 172.21.15.22:0/2492050921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff35880 0x556caff35c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.930+0000 7f4e4bfff640 1 -- 172.21.15.22:0/2492050921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff361a0 msgr2=0x556caff41bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.930+0000 7f4e4bfff640 1 --2- 172.21.15.22:0/2492050921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff361a0 0x556caff41bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.930+0000 7f4e4bfff640 1 -- 172.21.15.22:0/2492050921 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cafbfb650 con 0x556caff42130 2024-08-20T01:36:49.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.930+0000 7f4e49ffb640 1 --2- 172.21.15.22:0/2055757265 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4e3c0b3bd0 0x7f4e3c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.930+0000 7f4e49ffb640 1 -- 172.21.15.22:0/2055757265 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f4e400e40b0 con 0x7f4e4c1039a0 2024-08-20T01:36:49.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.930+0000 7f4e517b1640 1 --2- 172.21.15.22:0/2055757265 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4e3c0b3bd0 0x7f4e3c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.930+0000 7f4e4bfff640 1 --2- 172.21.15.22:0/2492050921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff42130 0x556caff44520 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4e38031440 tx=0x7f4e38032dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10779bb1f7423c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:49.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.931+0000 7f4e36ffd640 1 -- 172.21.15.22:0/2492050921 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3803f070 con 0x556caff42130 2024-08-20T01:36:49.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.931+0000 7f4e36ffd640 1 -- 172.21.15.22:0/2492050921 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e380316a0 con 0x556caff42130 2024-08-20T01:36:49.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.931+0000 7f4e36ffd640 1 -- 172.21.15.22:0/2492050921 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38035070 con 0x556caff42130 2024-08-20T01:36:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.932+0000 7f4e517b1640 1 --2- 172.21.15.22:0/2055757265 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4e3c0b3bd0 0x7f4e3c0b6090 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4e44005fd0 tx=0x7f4e44009b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.931+0000 7f4e5560d740 1 -- 172.21.15.22:0/2492050921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff42130 msgr2=0x556caff44520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.932+0000 7f4e5560d740 1 --2- 172.21.15.22:0/2492050921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff42130 0x556caff44520 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4e38031440 tx=0x7f4e38032dc0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.932+0000 7f4e5560d740 1 -- 172.21.15.22:0/2492050921 shutdown_connections 2024-08-20T01:36:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.932+0000 7f4e5560d740 1 --2- 172.21.15.22:0/2492050921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff42130 0x556caff44520 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.932+0000 7f4e5560d740 1 --2- 172.21.15.22:0/2492050921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff361a0 0x556caff41bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.932+0000 7f4e5560d740 1 --2- 172.21.15.22:0/2492050921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff35880 0x556caff35c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.932+0000 7f4e5560d740 1 -- 172.21.15.22:0/2492050921 >> 172.21.15.22:0/2492050921 conn(0x556caff336b0 msgr2=0x556caff34850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.932+0000 7f4e5560d740 1 -- 172.21.15.22:0/2492050921 shutdown_connections 2024-08-20T01:36:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.932+0000 7f4e5560d740 1 -- 172.21.15.22:0/2492050921 wait complete. 2024-08-20T01:36:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.932+0000 7f4e5560d740 1 -- start start 2024-08-20T01:36:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.932+0000 7f4e5560d740 1 Processor -- start 2024-08-20T01:36:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.933+0000 7f4e5560d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff35880 0x556caff3f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.933+0000 7f4e5560d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff361a0 0x556caff3f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.933+0000 7f4e5560d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff42130 0x556caff3fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.933+0000 7f4e5560d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556cafcfe700 con 0x556caff361a0 2024-08-20T01:36:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.933+0000 7f4e5560d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556cafe22810 con 0x556caff35880 2024-08-20T01:36:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.933+0000 7f4e5560d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556caff44d80 con 0x556caff42130 2024-08-20T01:36:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.933+0000 7f4e5560d740 10 client.0 _ll_register_callbacks cb 0x556cafe95700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.933+0000 7f4e50fb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff35880 0x556caff3f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.933+0000 7f4e4bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff361a0 0x556caff3f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.933+0000 7f4e4bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff361a0 0x556caff3f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36212/0 (socket says 172.21.15.22:36212) 2024-08-20T01:36:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.933+0000 7f4e517b1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff42130 0x556caff3fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.933+0000 7f4e4bfff640 1 -- 172.21.15.22:0/1460532419 learned_addr learned my addr 172.21.15.22:0/1460532419 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.933+0000 7f4e4bfff640 1 -- 172.21.15.22:0/1460532419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff42130 msgr2=0x556caff3fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.934+0000 7f4e4bfff640 1 --2- 172.21.15.22:0/1460532419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff42130 0x556caff3fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.934+0000 7f4e4bfff640 1 -- 172.21.15.22:0/1460532419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff35880 msgr2=0x556caff3f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.934+0000 7f4e4bfff640 1 --2- 172.21.15.22:0/1460532419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff35880 0x556caff3f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.934+0000 7f4e4bfff640 1 -- 172.21.15.22:0/1460532419 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556caff4e180 con 0x556caff361a0 2024-08-20T01:36:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.934+0000 7f4e517b1640 1 --2- 172.21.15.22:0/1460532419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff42130 0x556caff3fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:36:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.934+0000 7f4e4bfff640 1 --2- 172.21.15.22:0/1460532419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff361a0 0x556caff3f660 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4e3802a450 tx=0x7f4e38005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1ebcc6317c92c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.934+0000 7f4e2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:36:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.934+0000 7f4e2bfff640 1 -- 172.21.15.22:0/1460532419 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3803f070 con 0x556caff361a0 2024-08-20T01:36:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.934+0000 7f4e5560d740 1 -- 172.21.15.22:0/1460532419 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556cafe4b150 con 0x556caff361a0 2024-08-20T01:36:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.934+0000 7f4e2bfff640 1 -- 172.21.15.22:0/1460532419 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f4e38031d10 con 0x556caff361a0 2024-08-20T01:36:49.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.935+0000 7f4e2bfff640 1 -- 172.21.15.22:0/1460532419 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4e38035040 con 0x556caff361a0 2024-08-20T01:36:49.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.935+0000 7f4e5560d740 10 client.16185 fetch_fsmap learned FSMap version 31 2024-08-20T01:36:49.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.935+0000 7f4e5560d740 1 -- 172.21.15.22:0/1460532419 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556caff50b30 con 0x556caff361a0 2024-08-20T01:36:49.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.935+0000 7f4e2bfff640 1 -- 172.21.15.22:0/1460532419 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556cafe4b150 con 0x556caff361a0 2024-08-20T01:36:49.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.935+0000 7f4e2bfff640 1 -- 172.21.15.22:0/1460532419 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f4e3803b550 con 0x556caff361a0 2024-08-20T01:36:49.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.935+0000 7f4e5560d740 10 client.16185 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:36:49.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.935+0000 7f4e5560d740 10 client.16185 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:36:49.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.935+0000 7f4e5560d740 20 client.16185 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:49.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.935+0000 7f4e5560d740 1 --2- 172.21.15.22:0/1460532419 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x556caff51e80 0x556caff54270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.935+0000 7f4e5560d740 4 client.16185 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:49.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.935+0000 7f4e5560d740 1 -- 172.21.15.22:0/1460532419 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556cafeae880 con 0x556caff51e80 2024-08-20T01:36:49.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.936+0000 7f4e50fb0640 1 --2- 172.21.15.22:0/1460532419 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x556caff51e80 0x556caff54270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.936+0000 7f4e2bfff640 10 client.16185 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:36:49.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.936+0000 7f4e50fb0640 1 --2- 172.21.15.22:0/1460532419 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x556caff51e80 0x556caff54270 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=161c4816dd10f3fb server_cookie=908ff20772782c7f in_seq=0 out_seq=0 2024-08-20T01:36:49.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.938+0000 7f4e2bfff640 1 -- 172.21.15.22:0/1460532419 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556cafeae880 con 0x556caff51e80 2024-08-20T01:36:49.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.938+0000 7f4e2bfff640 10 client.16185 handle_command_reply: tid=0 2024-08-20T01:36:49.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.938+0000 7f4e5560d740 1 client.16185 shutdown 2024-08-20T01:36:49.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.939+0000 7f4e5560d740 1 -- 172.21.15.22:0/1460532419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff361a0 msgr2=0x556caff3f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.939+0000 7f4e5560d740 1 --2- 172.21.15.22:0/1460532419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff361a0 0x556caff3f660 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4e3802a450 tx=0x7f4e38005e80 comp rx=0 tx=0).stop 2024-08-20T01:36:49.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.939+0000 7f4e5560d740 1 -- 172.21.15.22:0/1460532419 shutdown_connections 2024-08-20T01:36:49.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.939+0000 7f4e5560d740 1 --2- 172.21.15.22:0/1460532419 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x556caff51e80 0x556caff54270 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.939+0000 7f4e5560d740 1 --2- 172.21.15.22:0/1460532419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff42130 0x556caff3fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.939+0000 7f4e5560d740 1 --2- 172.21.15.22:0/1460532419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff361a0 0x556caff3f660 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.939+0000 7f4e5560d740 1 --2- 172.21.15.22:0/1460532419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff35880 0x556caff3f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.939+0000 7f4e5560d740 1 -- 172.21.15.22:0/1460532419 >> 172.21.15.22:0/1460532419 conn(0x556caff336b0 msgr2=0x556caff39250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:49.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.939+0000 7f4e2bfff640 0 client.16185 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:36:49.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.939+0000 7f4e5560d740 1 -- 172.21.15.22:0/1460532419 shutdown_connections 2024-08-20T01:36:49.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.939+0000 7f4e5560d740 1 -- 172.21.15.22:0/1460532419 wait complete. 2024-08-20T01:36:49.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.939+0000 7f4e5560d740 20 client.16185 trim_cache size 0 max 16384 2024-08-20T01:36:49.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.955+0000 7f4e5560d740 1 Processor -- start 2024-08-20T01:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.955+0000 7f4e5560d740 1 -- start start 2024-08-20T01:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.955+0000 7f4e5560d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff35880 0x556caff39a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.955+0000 7f4e5560d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff361a0 0x556caff34e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.955+0000 7f4e5560d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff42130 0x556caff59870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.955+0000 7f4e5560d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c1b7100 con 0x556caff35880 2024-08-20T01:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.955+0000 7f4e5560d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c1b4910 con 0x556caff361a0 2024-08-20T01:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.955+0000 7f4e5560d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c1b2760 con 0x556caff42130 2024-08-20T01:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.955+0000 7f4e50fb0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff35880 0x556caff39a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.955+0000 7f4e50fb0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff35880 0x556caff39a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36218/0 (socket says 172.21.15.22:36218) 2024-08-20T01:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.955+0000 7f4e50fb0640 1 -- 172.21.15.22:0/345966498 learned_addr learned my addr 172.21.15.22:0/345966498 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.955+0000 7f4e4bfff640 1 --2- 172.21.15.22:0/345966498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff361a0 0x556caff34e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.955+0000 7f4e517b1640 1 --2- 172.21.15.22:0/345966498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff42130 0x556caff59870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.956+0000 7f4e50fb0640 1 -- 172.21.15.22:0/345966498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff42130 msgr2=0x556caff59870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:49.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.956+0000 7f4e50fb0640 1 --2- 172.21.15.22:0/345966498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff42130 0x556caff59870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.956+0000 7f4e50fb0640 1 -- 172.21.15.22:0/345966498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff361a0 msgr2=0x556caff34e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:49.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.956+0000 7f4e50fb0640 1 --2- 172.21.15.22:0/345966498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff361a0 0x556caff34e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.956+0000 7f4e50fb0640 1 -- 172.21.15.22:0/345966498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556caff4dea0 con 0x556caff35880 2024-08-20T01:36:49.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.956+0000 7f4e4bfff640 1 --2- 172.21.15.22:0/345966498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff361a0 0x556caff34e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:36:49.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.956+0000 7f4e50fb0640 1 --2- 172.21.15.22:0/345966498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff35880 0x556caff39a40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4e40000c00 tx=0x7f4e400e7b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa06b90bb6bb39a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:49.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.956+0000 7f4e367fc640 1 -- 172.21.15.22:0/345966498 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e400bc070 con 0x556caff35880 2024-08-20T01:36:49.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.956+0000 7f4e367fc640 1 -- 172.21.15.22:0/345966498 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e40010720 con 0x556caff35880 2024-08-20T01:36:49.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.956+0000 7f4e367fc640 1 -- 172.21.15.22:0/345966498 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e400b4070 con 0x556caff35880 2024-08-20T01:36:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.957+0000 7f4e5560d740 1 -- 172.21.15.22:0/345966498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff35880 msgr2=0x556caff39a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.957+0000 7f4e5560d740 1 --2- 172.21.15.22:0/345966498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff35880 0x556caff39a40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4e40000c00 tx=0x7f4e400e7b80 comp rx=0 tx=0).stop 2024-08-20T01:36:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.957+0000 7f4e5560d740 1 -- 172.21.15.22:0/345966498 shutdown_connections 2024-08-20T01:36:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.957+0000 7f4e5560d740 1 --2- 172.21.15.22:0/345966498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff42130 0x556caff59870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.957+0000 7f4e5560d740 1 --2- 172.21.15.22:0/345966498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff361a0 0x556caff34e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.957+0000 7f4e5560d740 1 --2- 172.21.15.22:0/345966498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff35880 0x556caff39a40 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.957+0000 7f4e5560d740 1 -- 172.21.15.22:0/345966498 >> 172.21.15.22:0/345966498 conn(0x556caff336b0 msgr2=0x556caff34700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.957+0000 7f4e5560d740 1 -- 172.21.15.22:0/345966498 shutdown_connections 2024-08-20T01:36:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.957+0000 7f4e5560d740 1 -- 172.21.15.22:0/345966498 wait complete. 2024-08-20T01:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.957+0000 7f4e5560d740 1 -- start start 2024-08-20T01:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.958+0000 7f4e5560d740 1 Processor -- start 2024-08-20T01:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.958+0000 7f4e5560d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff35880 0x556caff451c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.958+0000 7f4e5560d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff361a0 0x556caff45700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.958+0000 7f4e5560d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff42130 0x556caffba830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.958+0000 7f4e5560d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c1b2dd0 con 0x556caff42130 2024-08-20T01:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.958+0000 7f4e50fb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff35880 0x556caff451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.958+0000 7f4e5560d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c1b4240 con 0x556caff35880 2024-08-20T01:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.958+0000 7f4e50fb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff35880 0x556caff451c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:36926/0 (socket says 172.21.15.22:36926) 2024-08-20T01:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.958+0000 7f4e50fb0640 1 -- 172.21.15.22:0/1361341636 learned_addr learned my addr 172.21.15.22:0/1361341636 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.958+0000 7f4e5560d740 1 -- 172.21.15.22:0/1361341636 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c1b34a0 con 0x556caff361a0 2024-08-20T01:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.958+0000 7f4e4bfff640 1 --2- 172.21.15.22:0/1361341636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff361a0 0x556caff45700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.959+0000 7f4e517b1640 1 --2- 172.21.15.22:0/1361341636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff42130 0x556caffba830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.959+0000 7f4e5560d740 10 client.0 _ll_register_callbacks cb 0x7f4e400e7a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.959+0000 7f4e50fb0640 1 -- 172.21.15.22:0/1361341636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff361a0 msgr2=0x556caff45700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.959+0000 7f4e50fb0640 1 --2- 172.21.15.22:0/1361341636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff361a0 0x556caff45700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.959+0000 7f4e50fb0640 1 -- 172.21.15.22:0/1361341636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff42130 msgr2=0x556caffba830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.959+0000 7f4e50fb0640 1 --2- 172.21.15.22:0/1361341636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff42130 0x556caffba830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.959+0000 7f4e50fb0640 1 -- 172.21.15.22:0/1361341636 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556caffbad70 con 0x556caff35880 2024-08-20T01:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.959+0000 7f4e5560d740 1 -- 172.21.15.22:0/1361341636 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556caff449f0 con 0x556caff35880 2024-08-20T01:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.959+0000 7f4e4bfff640 1 --2- 172.21.15.22:0/1361341636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff361a0 0x556caff45700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.959+0000 7f4e50fb0640 1 --2- 172.21.15.22:0/1361341636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff35880 0x556caff451c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4e400aaf50 tx=0x7f4e40010cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f516f54798436c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.959+0000 7f4e2bfff640 10 client.25820 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.959+0000 7f4e2bfff640 1 -- 172.21.15.22:0/1361341636 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e400bc030 con 0x556caff35880 2024-08-20T01:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.959+0000 7f4e2bfff640 1 -- 172.21.15.22:0/1361341636 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f4e40010d90 con 0x556caff35880 2024-08-20T01:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.960+0000 7f4e2bfff640 1 -- 172.21.15.22:0/1361341636 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4e400aaad0 con 0x556caff35880 2024-08-20T01:36:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.960+0000 7f4e5560d740 10 client.25820 fetch_fsmap learned FSMap version 31 2024-08-20T01:36:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.960+0000 7f4e5560d740 1 -- 172.21.15.22:0/1361341636 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({fsmap=31}) -- 0x556caffbbdd0 con 0x556caff35880 2024-08-20T01:36:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.960+0000 7f4e2bfff640 1 -- 172.21.15.22:0/1361341636 <== mon.2 v2:172.21.15.77:3300/0 4 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f4e400ad030 con 0x556caff35880 2024-08-20T01:36:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.960+0000 7f4e5560d740 10 client.25820 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:36:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.960+0000 7f4e5560d740 10 client.25820 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:36:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.960+0000 7f4e5560d740 20 client.25820 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.960+0000 7f4e5560d740 1 --2- 172.21.15.22:0/1361341636 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x556caffbc3c0 0x556caffbe7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.960+0000 7f4e5560d740 4 client.25820 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:36:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.960+0000 7f4e5560d740 1 -- 172.21.15.22:0/1361341636 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556cafeaa320 con 0x556caffbc3c0 2024-08-20T01:36:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.960+0000 7f4e4bfff640 1 --2- 172.21.15.22:0/1361341636 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x556caffbc3c0 0x556caffbe7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.961+0000 7f4e4bfff640 1 --2- 172.21.15.22:0/1361341636 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x556caffbc3c0 0x556caffbe7e0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3af99f1ac8938e99 server_cookie=13bbf5dde3260211 in_seq=0 out_seq=0 2024-08-20T01:36:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.961+0000 7f4e2bfff640 10 client.25820 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:36:49.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.964+0000 7f4e2bfff640 1 -- 172.21.15.22:0/1361341636 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556cafeaa320 con 0x556caffbc3c0 2024-08-20T01:36:49.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.964+0000 7f4e2bfff640 10 client.25820 handle_command_reply: tid=0 2024-08-20T01:36:49.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.964+0000 7f4e5560d740 1 client.25820 shutdown 2024-08-20T01:36:49.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.964+0000 7f4e5560d740 1 -- 172.21.15.22:0/1361341636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff35880 msgr2=0x556caff451c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.964+0000 7f4e5560d740 1 --2- 172.21.15.22:0/1361341636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff35880 0x556caff451c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4e400aaf50 tx=0x7f4e40010cc0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.964+0000 7f4e5560d740 1 -- 172.21.15.22:0/1361341636 shutdown_connections 2024-08-20T01:36:49.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.964+0000 7f4e5560d740 1 --2- 172.21.15.22:0/1361341636 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x556caffbc3c0 0x556caffbe7e0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.964+0000 7f4e5560d740 1 --2- 172.21.15.22:0/1361341636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556caff42130 0x556caffba830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.964+0000 7f4e5560d740 1 --2- 172.21.15.22:0/1361341636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556caff361a0 0x556caff45700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.964+0000 7f4e5560d740 1 --2- 172.21.15.22:0/1361341636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556caff35880 0x556caff451c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.964+0000 7f4e5560d740 1 -- 172.21.15.22:0/1361341636 >> 172.21.15.22:0/1361341636 conn(0x556caff336b0 msgr2=0x556caff40750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:49.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.965+0000 7f4e2bfff640 0 client.25820 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:36:49.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.965+0000 7f4e5560d740 1 -- 172.21.15.22:0/1361341636 shutdown_connections 2024-08-20T01:36:49.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.965+0000 7f4e5560d740 1 -- 172.21.15.22:0/1361341636 wait complete. 2024-08-20T01:36:49.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.965+0000 7f4e5560d740 20 client.25820 trim_cache size 0 max 16384 2024-08-20T01:36:49.969 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:36:49.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.966+0000 7f4e53214640 1 -- 172.21.15.22:0/2055757265 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4e3c0b3bd0 msgr2=0x7f4e3c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.966+0000 7f4e53214640 1 --2- 172.21.15.22:0/2055757265 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4e3c0b3bd0 0x7f4e3c0b6090 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4e44005fd0 tx=0x7f4e44009b40 comp rx=0 tx=0).stop 2024-08-20T01:36:49.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.966+0000 7f4e53214640 1 -- 172.21.15.22:0/2055757265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e4c1039a0 msgr2=0x7f4e4c103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.966+0000 7f4e53214640 1 --2- 172.21.15.22:0/2055757265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e4c1039a0 0x7f4e4c103100 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4e4000e9f0 tx=0x7f4e4000eeb0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.966+0000 7f4e53214640 1 -- 172.21.15.22:0/2055757265 shutdown_connections 2024-08-20T01:36:49.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.966+0000 7f4e53214640 1 --2- 172.21.15.22:0/2055757265 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f4e3c0b3bd0 0x7f4e3c0b6090 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.966+0000 7f4e53214640 1 --2- 172.21.15.22:0/2055757265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e4c10ce00 0x7f4e4c101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.966+0000 7f4e53214640 1 --2- 172.21.15.22:0/2055757265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e4c1042c0 0x7f4e4c101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.966+0000 7f4e53214640 1 --2- 172.21.15.22:0/2055757265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e4c1039a0 0x7f4e4c103100 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.966+0000 7f4e53214640 1 -- 172.21.15.22:0/2055757265 >> 172.21.15.22:0/2055757265 conn(0x7f4e4c0fd400 msgr2=0x7f4e4c0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:49.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.966+0000 7f4e53214640 1 -- 172.21.15.22:0/2055757265 shutdown_connections 2024-08-20T01:36:49.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:49.966+0000 7f4e53214640 1 -- 172.21.15.22:0/2055757265 wait complete. 2024-08-20T01:36:50.045 INFO:tasks.workunit.client.0.smithi022.stdout: 529 1184351 688 813783 666 478004 803 2024-08-20T01:36:50.736 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:36:51.059 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:51.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:51 smithi022 ceph-mon[18709]: pgmap v517: 97 pgs: 97 active+clean; 2.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 6.9 MiB/s wr, 2.55k op/s 2024-08-20T01:36:51.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:51 smithi134 ceph-mon[22511]: pgmap v517: 97 pgs: 97 active+clean; 2.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 6.9 MiB/s wr, 2.55k op/s 2024-08-20T01:36:51.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:51 smithi077 ceph-mon[22251]: pgmap v517: 97 pgs: 97 active+clean; 2.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 6.9 MiB/s wr, 2.55k op/s 2024-08-20T01:36:52.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.641+0000 7ff03621a640 1 -- 172.21.15.22:0/3306244454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff030102af0 msgr2=0x7ff030102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.641+0000 7ff03621a640 1 --2- 172.21.15.22:0/3306244454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff030102af0 0x7ff030102ed0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff020009900 tx=0x7ff02002a410 comp rx=0 tx=0).stop 2024-08-20T01:36:52.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.641+0000 7ff03621a640 1 -- 172.21.15.22:0/3306244454 shutdown_connections 2024-08-20T01:36:52.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.641+0000 7ff03621a640 1 --2- 172.21.15.22:0/3306244454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff030108e80 0x7ff03010f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.641+0000 7ff03621a640 1 --2- 172.21.15.22:0/3306244454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff030108500 0x7ff030108940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.641+0000 7ff03621a640 1 --2- 172.21.15.22:0/3306244454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff030102af0 0x7ff030102ed0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.641+0000 7ff03621a640 1 -- 172.21.15.22:0/3306244454 >> 172.21.15.22:0/3306244454 conn(0x7ff0300fe540 msgr2=0x7ff030100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:52.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.641+0000 7ff03621a640 1 -- 172.21.15.22:0/3306244454 shutdown_connections 2024-08-20T01:36:52.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.641+0000 7ff03621a640 1 -- 172.21.15.22:0/3306244454 wait complete. 2024-08-20T01:36:52.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.641+0000 7ff03621a640 1 Processor -- start 2024-08-20T01:36:52.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.642+0000 7ff03621a640 1 -- start start 2024-08-20T01:36:52.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.642+0000 7ff03621a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff030102af0 0x7ff0300751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.642+0000 7ff03621a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff030108500 0x7ff030075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.642+0000 7ff03621a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff030108e80 0x7ff030075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.642+0000 7ff03621a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff030112b40 con 0x7ff030108e80 2024-08-20T01:36:52.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.642+0000 7ff03621a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff0301129c0 con 0x7ff030102af0 2024-08-20T01:36:52.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.642+0000 7ff03621a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff030112cc0 con 0x7ff030108500 2024-08-20T01:36:52.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.642+0000 7ff02f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff030102af0 0x7ff0300751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.642+0000 7ff02f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff030102af0 0x7ff0300751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:36938/0 (socket says 172.21.15.22:36938) 2024-08-20T01:36:52.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.642+0000 7ff02ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff030108e80 0x7ff030075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.642+0000 7ff02f7fe640 1 -- 172.21.15.22:0/2881358709 learned_addr learned my addr 172.21.15.22:0/2881358709 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:52.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.642+0000 7ff02effd640 1 --2- 172.21.15.22:0/2881358709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff030108500 0x7ff030075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.643+0000 7ff02f7fe640 1 -- 172.21.15.22:0/2881358709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff030108500 msgr2=0x7ff030075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.643+0000 7ff02f7fe640 1 --2- 172.21.15.22:0/2881358709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff030108500 0x7ff030075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.643+0000 7ff02f7fe640 1 -- 172.21.15.22:0/2881358709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff030108e80 msgr2=0x7ff030075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.643+0000 7ff02f7fe640 1 --2- 172.21.15.22:0/2881358709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff030108e80 0x7ff030075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.643+0000 7ff02f7fe640 1 -- 172.21.15.22:0/2881358709 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0301a7390 con 0x7ff030102af0 2024-08-20T01:36:52.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.643+0000 7ff02f7fe640 1 --2- 172.21.15.22:0/2881358709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff030102af0 0x7ff0300751d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff020005940 tx=0x7ff0200040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:52.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.643+0000 7ff02cff9640 1 -- 172.21.15.22:0/2881358709 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02003f030 con 0x7ff030102af0 2024-08-20T01:36:52.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.643+0000 7ff02cff9640 1 -- 172.21.15.22:0/2881358709 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0200044c0 con 0x7ff030102af0 2024-08-20T01:36:52.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.643+0000 7ff02cff9640 1 -- 172.21.15.22:0/2881358709 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020035070 con 0x7ff030102af0 2024-08-20T01:36:52.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.643+0000 7ff03621a640 1 -- 172.21.15.22:0/2881358709 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0301a7620 con 0x7ff030102af0 2024-08-20T01:36:52.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.643+0000 7ff03621a640 1 -- 172.21.15.22:0/2881358709 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0301a7ab0 con 0x7ff030102af0 2024-08-20T01:36:52.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.646+0000 7ff038613740 1 Processor -- start 2024-08-20T01:36:52.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.646+0000 7ff038613740 1 -- start start 2024-08-20T01:36:52.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.646+0000 7ff02cff9640 1 -- 172.21.15.22:0/2881358709 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff020042030 con 0x7ff030102af0 2024-08-20T01:36:52.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.646+0000 7ff038613740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d5f880 0x5559c1d5fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.646+0000 7ff038613740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d601a0 0x5559c1d6bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.646+0000 7ff038613740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d6c130 0x5559c1d6e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.646+0000 7ff038613740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5559c1cd6930 con 0x5559c1d6c130 2024-08-20T01:36:52.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.646+0000 7ff038613740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5559c1cc5e30 con 0x5559c1d5f880 2024-08-20T01:36:52.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.646+0000 7ff038613740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5559c1cc9e70 con 0x5559c1d601a0 2024-08-20T01:36:52.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.646+0000 7ff02ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d5f880 0x5559c1d5fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.646+0000 7ff02ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d5f880 0x5559c1d5fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:36948/0 (socket says 172.21.15.22:36948) 2024-08-20T01:36:52.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.646+0000 7ff02ffff640 1 -- 172.21.15.22:0/984990298 learned_addr learned my addr 172.21.15.22:0/984990298 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:52.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.646+0000 7ff02f7fe640 1 --2- 172.21.15.22:0/984990298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d601a0 0x5559c1d6bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.646+0000 7ff02effd640 1 --2- 172.21.15.22:0/984990298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d6c130 0x5559c1d6e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.647+0000 7ff02ffff640 1 -- 172.21.15.22:0/984990298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d601a0 msgr2=0x5559c1d6bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:52.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.647+0000 7ff02ffff640 1 --2- 172.21.15.22:0/984990298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d601a0 0x5559c1d6bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.647+0000 7ff02ffff640 1 -- 172.21.15.22:0/984990298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d6c130 msgr2=0x5559c1d6e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:52.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.647+0000 7ff02ffff640 1 --2- 172.21.15.22:0/984990298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d6c130 0x5559c1d6e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.647+0000 7ff02ffff640 1 -- 172.21.15.22:0/984990298 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c1a25650 con 0x5559c1d5f880 2024-08-20T01:36:52.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.647+0000 7ff02effd640 1 --2- 172.21.15.22:0/984990298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d6c130 0x5559c1d6e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:52.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.647+0000 7ff02ffff640 1 --2- 172.21.15.22:0/984990298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d5f880 0x5559c1d5fc60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff028009f90 tx=0x7ff0280118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0e669832a9bdf39 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:52.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.647+0000 7ff025ffb640 1 -- 172.21.15.22:0/984990298 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028004d20 con 0x5559c1d5f880 2024-08-20T01:36:52.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.647+0000 7ff025ffb640 1 -- 172.21.15.22:0/984990298 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff028004050 con 0x5559c1d5f880 2024-08-20T01:36:52.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.647+0000 7ff025ffb640 1 -- 172.21.15.22:0/984990298 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028005280 con 0x5559c1d5f880 2024-08-20T01:36:52.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.648+0000 7ff02cff9640 1 --2- 172.21.15.22:0/2881358709 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff01c0b3c50 0x7ff01c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.648+0000 7ff02f7fe640 1 --2- 172.21.15.22:0/2881358709 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff01c0b3c50 0x7ff01c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.648+0000 7ff02cff9640 1 -- 172.21.15.22:0/2881358709 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ff020103ed0 con 0x7ff030102af0 2024-08-20T01:36:52.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.648+0000 7ff038613740 1 -- 172.21.15.22:0/984990298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d5f880 msgr2=0x5559c1d5fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.648+0000 7ff02f7fe640 1 --2- 172.21.15.22:0/2881358709 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff01c0b3c50 0x7ff01c0b6110 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff020101d00 tx=0x7ff0201079b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:52.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.648+0000 7ff038613740 1 --2- 172.21.15.22:0/984990298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d5f880 0x5559c1d5fc60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff028009f90 tx=0x7ff0280118d0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.648+0000 7ff038613740 1 -- 172.21.15.22:0/984990298 shutdown_connections 2024-08-20T01:36:52.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.648+0000 7ff038613740 1 --2- 172.21.15.22:0/984990298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d6c130 0x5559c1d6e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.648+0000 7ff038613740 1 --2- 172.21.15.22:0/984990298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d601a0 0x5559c1d6bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.648+0000 7ff038613740 1 --2- 172.21.15.22:0/984990298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d5f880 0x5559c1d5fc60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.648+0000 7ff038613740 1 -- 172.21.15.22:0/984990298 >> 172.21.15.22:0/984990298 conn(0x5559c1d5d6b0 msgr2=0x5559c1d5e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:52.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.648+0000 7ff038613740 1 -- 172.21.15.22:0/984990298 shutdown_connections 2024-08-20T01:36:52.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.648+0000 7ff038613740 1 -- 172.21.15.22:0/984990298 wait complete. 2024-08-20T01:36:52.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.649+0000 7ff038613740 1 -- start start 2024-08-20T01:36:52.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.649+0000 7ff038613740 1 Processor -- start 2024-08-20T01:36:52.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.649+0000 7ff038613740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d5f880 0x5559c1d690a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.649+0000 7ff038613740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d601a0 0x5559c1d695e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.649+0000 7ff038613740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d6c130 0x5559c1d69b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.649+0000 7ff038613740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5559c1b28700 con 0x5559c1d6c130 2024-08-20T01:36:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.649+0000 7ff038613740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5559c1c4c810 con 0x5559c1d5f880 2024-08-20T01:36:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.649+0000 7ff038613740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5559c1d6ede0 con 0x5559c1d601a0 2024-08-20T01:36:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.649+0000 7ff038613740 10 client.0 _ll_register_callbacks cb 0x5559c1cbf700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.649+0000 7ff02ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d5f880 0x5559c1d690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.649+0000 7ff02ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d6c130 0x5559c1d69b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.649+0000 7ff02effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d601a0 0x5559c1d695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.649+0000 7ff02ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d6c130 0x5559c1d69b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36256/0 (socket says 172.21.15.22:36256) 2024-08-20T01:36:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.649+0000 7ff02ffff640 1 -- 172.21.15.22:0/3187956638 learned_addr learned my addr 172.21.15.22:0/3187956638 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.650+0000 7ff02effd640 1 -- 172.21.15.22:0/3187956638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d5f880 msgr2=0x5559c1d690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.650+0000 7ff02effd640 1 --2- 172.21.15.22:0/3187956638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d5f880 0x5559c1d690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.650+0000 7ff02effd640 1 -- 172.21.15.22:0/3187956638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d6c130 msgr2=0x5559c1d69b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.650+0000 7ff02effd640 1 --2- 172.21.15.22:0/3187956638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d6c130 0x5559c1d69b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.650+0000 7ff02effd640 1 -- 172.21.15.22:0/3187956638 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559c1d781c0 con 0x5559c1d601a0 2024-08-20T01:36:52.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.650+0000 7ff02ffff640 1 --2- 172.21.15.22:0/3187956638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d6c130 0x5559c1d69b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:36:52.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.650+0000 7ff02effd640 1 --2- 172.21.15.22:0/3187956638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d601a0 0x5559c1d695e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff030076cc0 tx=0x7ff018012b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1275e40ba9ff93b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:52.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.650+0000 7ff00effd640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:36:52.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.650+0000 7ff00effd640 1 -- 172.21.15.22:0/3187956638 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff018004050 con 0x5559c1d601a0 2024-08-20T01:36:52.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.650+0000 7ff00effd640 1 -- 172.21.15.22:0/3187956638 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ff0180041f0 con 0x5559c1d601a0 2024-08-20T01:36:52.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.650+0000 7ff038613740 1 -- 172.21.15.22:0/3187956638 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5559c1c75150 con 0x5559c1d601a0 2024-08-20T01:36:52.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.650+0000 7ff00effd640 1 -- 172.21.15.22:0/3187956638 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff0180043f0 con 0x5559c1d601a0 2024-08-20T01:36:52.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.650+0000 7ff038613740 10 client.25852 fetch_fsmap learned FSMap version 31 2024-08-20T01:36:52.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.650+0000 7ff038613740 1 -- 172.21.15.22:0/3187956638 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5559c1d7abd0 con 0x5559c1d601a0 2024-08-20T01:36:52.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.651+0000 7ff00effd640 1 -- 172.21.15.22:0/3187956638 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5559c1c75150 con 0x5559c1d601a0 2024-08-20T01:36:52.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.651+0000 7ff00effd640 1 -- 172.21.15.22:0/3187956638 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7ff018003b90 con 0x5559c1d601a0 2024-08-20T01:36:52.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.651+0000 7ff038613740 10 client.25852 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:36:52.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.651+0000 7ff038613740 10 client.25852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:36:52.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.651+0000 7ff038613740 20 client.25852 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:52.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.651+0000 7ff038613740 1 --2- 172.21.15.22:0/3187956638 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5559c1d7c1d0 0x5559c1d7e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.651+0000 7ff038613740 4 client.25852 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:52.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.651+0000 7ff038613740 1 -- 172.21.15.22:0/3187956638 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559c1cd8880 con 0x5559c1d7c1d0 2024-08-20T01:36:52.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.651+0000 7ff02ffff640 1 --2- 172.21.15.22:0/3187956638 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5559c1d7c1d0 0x5559c1d7e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.652+0000 7ff00effd640 10 client.25852 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:52.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.652+0000 7ff02ffff640 1 --2- 172.21.15.22:0/3187956638 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5559c1d7c1d0 0x5559c1d7e5f0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68cee2232986fade server_cookie=6edd5fe3d4111ddf in_seq=0 out_seq=0 2024-08-20T01:36:52.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.655+0000 7ff00effd640 1 -- 172.21.15.22:0/3187956638 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559c1cd8880 con 0x5559c1d7c1d0 2024-08-20T01:36:52.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.655+0000 7ff00effd640 10 client.25852 handle_command_reply: tid=0 2024-08-20T01:36:52.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.655+0000 7ff038613740 1 client.25852 shutdown 2024-08-20T01:36:52.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.655+0000 7ff038613740 1 -- 172.21.15.22:0/3187956638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d601a0 msgr2=0x5559c1d695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.655+0000 7ff038613740 1 --2- 172.21.15.22:0/3187956638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d601a0 0x5559c1d695e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff030076cc0 tx=0x7ff018012b60 comp rx=0 tx=0).stop 2024-08-20T01:36:52.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.655+0000 7ff038613740 1 -- 172.21.15.22:0/3187956638 shutdown_connections 2024-08-20T01:36:52.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.655+0000 7ff038613740 1 --2- 172.21.15.22:0/3187956638 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5559c1d7c1d0 0x5559c1d7e5f0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.655+0000 7ff038613740 1 --2- 172.21.15.22:0/3187956638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d6c130 0x5559c1d69b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.655+0000 7ff038613740 1 --2- 172.21.15.22:0/3187956638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d601a0 0x5559c1d695e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.655+0000 7ff00effd640 0 client.25852 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:52.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.655+0000 7ff038613740 1 --2- 172.21.15.22:0/3187956638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d5f880 0x5559c1d690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.655+0000 7ff038613740 1 -- 172.21.15.22:0/3187956638 >> 172.21.15.22:0/3187956638 conn(0x5559c1d5d6b0 msgr2=0x5559c1d63250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:52.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.655+0000 7ff038613740 1 -- 172.21.15.22:0/3187956638 shutdown_connections 2024-08-20T01:36:52.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.655+0000 7ff038613740 1 -- 172.21.15.22:0/3187956638 wait complete. 2024-08-20T01:36:52.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.656+0000 7ff038613740 20 client.25852 trim_cache size 0 max 16384 2024-08-20T01:36:52.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.670+0000 7ff038613740 1 Processor -- start 2024-08-20T01:36:52.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.670+0000 7ff038613740 1 -- start start 2024-08-20T01:36:52.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.670+0000 7ff038613740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d5f880 0x5559c1d5e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.670+0000 7ff038613740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d601a0 0x5559c1d83ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.671+0000 7ff038613740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d6c130 0x5559c1d843e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.671+0000 7ff038613740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff0301b2d40 con 0x5559c1d601a0 2024-08-20T01:36:52.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.671+0000 7ff038613740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff0301b0550 con 0x5559c1d6c130 2024-08-20T01:36:52.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.671+0000 7ff038613740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff0301ae3a0 con 0x5559c1d5f880 2024-08-20T01:36:52.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.671+0000 7ff02effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d601a0 0x5559c1d83ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.671+0000 7ff02effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d601a0 0x5559c1d83ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36266/0 (socket says 172.21.15.22:36266) 2024-08-20T01:36:52.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.671+0000 7ff02effd640 1 -- 172.21.15.22:0/2718080951 learned_addr learned my addr 172.21.15.22:0/2718080951 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:52.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.671+0000 7ff02ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d5f880 0x5559c1d5e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.671+0000 7ff02ffff640 1 --2- 172.21.15.22:0/2718080951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d6c130 0x5559c1d843e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.671+0000 7ff02effd640 1 -- 172.21.15.22:0/2718080951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d5f880 msgr2=0x5559c1d5e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:52.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.671+0000 7ff02effd640 1 --2- 172.21.15.22:0/2718080951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d5f880 0x5559c1d5e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.671+0000 7ff02effd640 1 -- 172.21.15.22:0/2718080951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d6c130 msgr2=0x5559c1d843e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:52.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.671+0000 7ff02effd640 1 --2- 172.21.15.22:0/2718080951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d6c130 0x5559c1d843e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.671+0000 7ff02effd640 1 -- 172.21.15.22:0/2718080951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c1d675a0 con 0x5559c1d601a0 2024-08-20T01:36:52.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.671+0000 7ff02ffff640 1 --2- 172.21.15.22:0/2718080951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d5f880 0x5559c1d5e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:36:52.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.671+0000 7ff02effd640 1 --2- 172.21.15.22:0/2718080951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d601a0 0x5559c1d83ea0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff018003f50 tx=0x7ff018010780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf9edfb3b08449d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:52.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.672+0000 7ff0257fa640 1 -- 172.21.15.22:0/2718080951 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff018003fd0 con 0x5559c1d601a0 2024-08-20T01:36:52.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.672+0000 7ff0257fa640 1 -- 172.21.15.22:0/2718080951 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff018010df0 con 0x5559c1d601a0 2024-08-20T01:36:52.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.672+0000 7ff0257fa640 1 -- 172.21.15.22:0/2718080951 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01800f790 con 0x5559c1d601a0 2024-08-20T01:36:52.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.673+0000 7ff038613740 1 -- 172.21.15.22:0/2718080951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d601a0 msgr2=0x5559c1d83ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.673+0000 7ff038613740 1 --2- 172.21.15.22:0/2718080951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d601a0 0x5559c1d83ea0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff018003f50 tx=0x7ff018010780 comp rx=0 tx=0).stop 2024-08-20T01:36:52.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.673+0000 7ff038613740 1 -- 172.21.15.22:0/2718080951 shutdown_connections 2024-08-20T01:36:52.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.673+0000 7ff038613740 1 --2- 172.21.15.22:0/2718080951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d6c130 0x5559c1d843e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.673+0000 7ff038613740 1 --2- 172.21.15.22:0/2718080951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d601a0 0x5559c1d83ea0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.673+0000 7ff038613740 1 --2- 172.21.15.22:0/2718080951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d5f880 0x5559c1d5e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.673+0000 7ff038613740 1 -- 172.21.15.22:0/2718080951 >> 172.21.15.22:0/2718080951 conn(0x5559c1d5d6b0 msgr2=0x5559c1d63250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:52.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.673+0000 7ff038613740 1 -- 172.21.15.22:0/2718080951 shutdown_connections 2024-08-20T01:36:52.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.673+0000 7ff038613740 1 -- 172.21.15.22:0/2718080951 wait complete. 2024-08-20T01:36:52.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.673+0000 7ff038613740 1 -- start start 2024-08-20T01:36:52.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.674+0000 7ff038613740 1 Processor -- start 2024-08-20T01:36:52.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.674+0000 7ff038613740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d5f880 0x5559c1d71390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.674+0000 7ff038613740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d601a0 0x5559c1d718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.674+0000 7ff038613740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d6c130 0x5559c1de4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.674+0000 7ff038613740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff0301aea10 con 0x5559c1d601a0 2024-08-20T01:36:52.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.674+0000 7ff038613740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff0301afe80 con 0x5559c1d5f880 2024-08-20T01:36:52.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.674+0000 7ff038613740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff0301af0e0 con 0x5559c1d6c130 2024-08-20T01:36:52.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.674+0000 7ff038613740 10 client.0 _ll_register_callbacks cb 0x7ff0180097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:52.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.674+0000 7ff02effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d601a0 0x5559c1d718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.674+0000 7ff02ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d5f880 0x5559c1d71390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.674+0000 7ff02ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d6c130 0x5559c1de4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.674+0000 7ff02ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d6c130 0x5559c1de4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:34378/0 (socket says 172.21.15.22:34378) 2024-08-20T01:36:52.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.674+0000 7ff02ffff640 1 -- 172.21.15.22:0/2622779070 learned_addr learned my addr 172.21.15.22:0/2622779070 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:52.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.675+0000 7ff02effd640 1 -- 172.21.15.22:0/2622779070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d6c130 msgr2=0x5559c1de4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:52.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.675+0000 7ff02effd640 1 --2- 172.21.15.22:0/2622779070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d6c130 0x5559c1de4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.675+0000 7ff02effd640 1 -- 172.21.15.22:0/2622779070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d5f880 msgr2=0x5559c1d71390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:52.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.675+0000 7ff02effd640 1 --2- 172.21.15.22:0/2622779070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d5f880 0x5559c1d71390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.675+0000 7ff02effd640 1 -- 172.21.15.22:0/2622779070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559c1de53b0 con 0x5559c1d601a0 2024-08-20T01:36:52.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.675+0000 7ff02ffff640 1 --2- 172.21.15.22:0/2622779070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d6c130 0x5559c1de4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:36:52.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.675+0000 7ff02effd640 1 --2- 172.21.15.22:0/2622779070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d601a0 0x5559c1d718d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff018010450 tx=0x7ff0180055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b7d2b7ebf9785b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:52.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.675+0000 7ff00effd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:36:52.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.675+0000 7ff00effd640 1 -- 172.21.15.22:0/2622779070 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff018010b00 con 0x5559c1d601a0 2024-08-20T01:36:52.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.675+0000 7ff00effd640 1 -- 172.21.15.22:0/2622779070 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ff01800f790 con 0x5559c1d601a0 2024-08-20T01:36:52.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.675+0000 7ff038613740 1 -- 172.21.15.22:0/2622779070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff018010df0 con 0x5559c1d601a0 2024-08-20T01:36:52.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.675+0000 7ff00effd640 1 -- 172.21.15.22:0/2622779070 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff01800f990 con 0x5559c1d601a0 2024-08-20T01:36:52.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.675+0000 7ff038613740 10 client.16209 fetch_fsmap learned FSMap version 31 2024-08-20T01:36:52.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.676+0000 7ff038613740 1 -- 172.21.15.22:0/2622779070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5559c1de6610 con 0x5559c1d601a0 2024-08-20T01:36:52.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.676+0000 7ff00effd640 1 -- 172.21.15.22:0/2622779070 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff018003aa0 con 0x5559c1d601a0 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.676+0000 7ff00effd640 1 -- 172.21.15.22:0/2622779070 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7ff01803a460 con 0x5559c1d601a0 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.676+0000 7ff038613740 10 client.16209 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.676+0000 7ff038613740 10 client.16209 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.676+0000 7ff038613740 20 client.16209 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.676+0000 7ff038613740 1 --2- 172.21.15.22:0/2622779070 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5559c1de6ca0 0x5559c1de90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.676+0000 7ff038613740 4 client.16209 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.676+0000 7ff038613740 1 -- 172.21.15.22:0/2622779070 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff018010df0 con 0x5559c1de6ca0 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.676+0000 7ff02ffff640 1 --2- 172.21.15.22:0/2622779070 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5559c1de6ca0 0x5559c1de90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.677+0000 7ff00effd640 10 client.16209 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.677+0000 7ff02ffff640 1 --2- 172.21.15.22:0/2622779070 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5559c1de6ca0 0x5559c1de90c0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a47c65cb340f86f server_cookie=c79fc67df6c537ad in_seq=0 out_seq=0 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.680+0000 7ff00effd640 1 -- 172.21.15.22:0/2622779070 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff018010df0 con 0x5559c1de6ca0 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.680+0000 7ff00effd640 10 client.16209 handle_command_reply: tid=0 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.680+0000 7ff038613740 1 client.16209 shutdown 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.680+0000 7ff038613740 1 -- 172.21.15.22:0/2622779070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d601a0 msgr2=0x5559c1d718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.680+0000 7ff038613740 1 --2- 172.21.15.22:0/2622779070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d601a0 0x5559c1d718d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff018010450 tx=0x7ff0180055d0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.681+0000 7ff038613740 1 -- 172.21.15.22:0/2622779070 shutdown_connections 2024-08-20T01:36:52.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.681+0000 7ff038613740 1 --2- 172.21.15.22:0/2622779070 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5559c1de6ca0 0x5559c1de90c0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.157 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:36:52.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.681+0000 7ff038613740 1 --2- 172.21.15.22:0/2622779070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5559c1d6c130 0x5559c1de4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.681+0000 7ff00effd640 0 client.16209 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:52.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.681+0000 7ff038613740 1 --2- 172.21.15.22:0/2622779070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559c1d601a0 0x5559c1d718d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.681+0000 7ff038613740 1 --2- 172.21.15.22:0/2622779070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5559c1d5f880 0x5559c1d71390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.681+0000 7ff038613740 1 -- 172.21.15.22:0/2622779070 >> 172.21.15.22:0/2622779070 conn(0x5559c1d5d6b0 msgr2=0x5559c1d62a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.681+0000 7ff038613740 1 -- 172.21.15.22:0/2622779070 shutdown_connections 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.681+0000 7ff038613740 1 -- 172.21.15.22:0/2622779070 wait complete. 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.681+0000 7ff038613740 20 client.16209 trim_cache size 0 max 16384 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.682+0000 7ff03621a640 1 -- 172.21.15.22:0/2881358709 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff01c0b3c50 msgr2=0x7ff01c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.682+0000 7ff03621a640 1 --2- 172.21.15.22:0/2881358709 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff01c0b3c50 0x7ff01c0b6110 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff020101d00 tx=0x7ff0201079b0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.682+0000 7ff03621a640 1 -- 172.21.15.22:0/2881358709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff030102af0 msgr2=0x7ff0300751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.682+0000 7ff03621a640 1 --2- 172.21.15.22:0/2881358709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff030102af0 0x7ff0300751d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff020005940 tx=0x7ff0200040c0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.682+0000 7ff03621a640 1 -- 172.21.15.22:0/2881358709 shutdown_connections 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.682+0000 7ff03621a640 1 --2- 172.21.15.22:0/2881358709 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff01c0b3c50 0x7ff01c0b6110 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.682+0000 7ff03621a640 1 --2- 172.21.15.22:0/2881358709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff030108e80 0x7ff030075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.682+0000 7ff03621a640 1 --2- 172.21.15.22:0/2881358709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff030108500 0x7ff030075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.682+0000 7ff03621a640 1 --2- 172.21.15.22:0/2881358709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff030102af0 0x7ff0300751d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.682+0000 7ff03621a640 1 -- 172.21.15.22:0/2881358709 >> 172.21.15.22:0/2881358709 conn(0x7ff0300fe540 msgr2=0x7ff0300ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:52.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.682+0000 7ff03621a640 1 -- 172.21.15.22:0/2881358709 shutdown_connections 2024-08-20T01:36:52.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:51.682+0000 7ff03621a640 1 -- 172.21.15.22:0/2881358709 wait complete. 2024-08-20T01:36:53.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:53 smithi134 ceph-mon[22511]: pgmap v518: 97 pgs: 97 active+clean; 2.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 9.3 MiB/s wr, 2.67k op/s 2024-08-20T01:36:53.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:53 smithi077 ceph-mon[22251]: pgmap v518: 97 pgs: 97 active+clean; 2.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 9.3 MiB/s wr, 2.67k op/s 2024-08-20T01:36:53.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:53 smithi022 ceph-mon[18709]: pgmap v518: 97 pgs: 97 active+clean; 2.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 9.3 MiB/s wr, 2.67k op/s 2024-08-20T01:36:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.794+0000 7fef0fc94640 1 -- 172.21.15.22:0/3578640956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef08102680 msgr2=0x7fef08102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.794+0000 7fef0fc94640 1 --2- 172.21.15.22:0/3578640956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef08102680 0x7fef08102a80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fef04009890 tx=0x7fef0402a380 comp rx=0 tx=0).stop 2024-08-20T01:36:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.794+0000 7fef0fc94640 1 -- 172.21.15.22:0/3578640956 shutdown_connections 2024-08-20T01:36:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.794+0000 7fef0fc94640 1 --2- 172.21.15.22:0/3578640956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef08104190 0x7fef0810ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.794+0000 7fef0fc94640 1 --2- 172.21.15.22:0/3578640956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef081037d0 0x7fef08103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.794+0000 7fef0fc94640 1 --2- 172.21.15.22:0/3578640956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef08102680 0x7fef08102a80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.794+0000 7fef0fc94640 1 -- 172.21.15.22:0/3578640956 >> 172.21.15.22:0/3578640956 conn(0x7fef080fdf40 msgr2=0x7fef08100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.794+0000 7fef0fc94640 1 -- 172.21.15.22:0/3578640956 shutdown_connections 2024-08-20T01:36:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.794+0000 7fef0fc94640 1 -- 172.21.15.22:0/3578640956 wait complete. 2024-08-20T01:36:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.795+0000 7fef0fc94640 1 Processor -- start 2024-08-20T01:36:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.795+0000 7fef0fc94640 1 -- start start 2024-08-20T01:36:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.795+0000 7fef0fc94640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef08102680 0x7fef08198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.795+0000 7fef0fc94640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef081037d0 0x7fef08199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.795+0000 7fef0fc94640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef08104190 0x7fef08199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.795+0000 7fef0fc94640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fef0810e2d0 con 0x7fef081037d0 2024-08-20T01:36:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.795+0000 7fef0fc94640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fef0810e150 con 0x7fef08104190 2024-08-20T01:36:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.795+0000 7fef0fc94640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fef0810e450 con 0x7fef08102680 2024-08-20T01:36:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.795+0000 7fef0d22f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef081037d0 0x7fef08199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.795+0000 7fef0da30640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef08102680 0x7fef08198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.795+0000 7fef0d22f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef081037d0 0x7fef08199100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36294/0 (socket says 172.21.15.22:36294) 2024-08-20T01:36:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.795+0000 7fef0d22f640 1 -- 172.21.15.22:0/3342129743 learned_addr learned my addr 172.21.15.22:0/3342129743 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.795+0000 7fef0e231640 1 --2- 172.21.15.22:0/3342129743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef08104190 0x7fef08199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.795+0000 7fef0da30640 1 -- 172.21.15.22:0/3342129743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef08104190 msgr2=0x7fef08199d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.795+0000 7fef0da30640 1 --2- 172.21.15.22:0/3342129743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef08104190 0x7fef08199d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.795+0000 7fef0da30640 1 -- 172.21.15.22:0/3342129743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef081037d0 msgr2=0x7fef08199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.795+0000 7fef0da30640 1 --2- 172.21.15.22:0/3342129743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef081037d0 0x7fef08199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.795+0000 7fef0da30640 1 -- 172.21.15.22:0/3342129743 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0819a5f0 con 0x7fef08102680 2024-08-20T01:36:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.795+0000 7fef0d22f640 1 --2- 172.21.15.22:0/3342129743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef081037d0 0x7fef08199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:36:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.796+0000 7fef0da30640 1 --2- 172.21.15.22:0/3342129743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef08102680 0x7fef08198ab0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fef0402a8a0 tx=0x7fef04032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.796+0000 7feefeffd640 1 -- 172.21.15.22:0/3342129743 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef04040020 con 0x7fef08102680 2024-08-20T01:36:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.796+0000 7feefeffd640 1 -- 172.21.15.22:0/3342129743 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef04030d50 con 0x7fef08102680 2024-08-20T01:36:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.796+0000 7fef0fc94640 1 -- 172.21.15.22:0/3342129743 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef0819a880 con 0x7fef08102680 2024-08-20T01:36:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.796+0000 7feefeffd640 1 -- 172.21.15.22:0/3342129743 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef04037040 con 0x7fef08102680 2024-08-20T01:36:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.796+0000 7fef0fc94640 1 -- 172.21.15.22:0/3342129743 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef081a0fb0 con 0x7fef08102680 2024-08-20T01:36:54.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.798+0000 7fef12a88740 1 Processor -- start 2024-08-20T01:36:54.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.799+0000 7fef12a88740 1 -- start start 2024-08-20T01:36:54.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.799+0000 7feefeffd640 1 -- 172.21.15.22:0/3342129743 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fef04043020 con 0x7fef08102680 2024-08-20T01:36:54.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.799+0000 7fef12a88740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c84630 0x557bc7c86a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.799+0000 7fef12a88740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c89350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.799+0000 7fef12a88740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 0x557bc7c8be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.799+0000 7fef12a88740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557bc7bf7360 con 0x557bc7c899a0 2024-08-20T01:36:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.799+0000 7fef12a88740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557bc7be6860 con 0x557bc7c86f60 2024-08-20T01:36:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.799+0000 7fef12a88740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557bc7bea8a0 con 0x557bc7c84630 2024-08-20T01:36:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.799+0000 7fef0d22f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 0x557bc7c8be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.799+0000 7fef0da30640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c89350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.799+0000 7fef0d22f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 0x557bc7c8be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36298/0 (socket says 172.21.15.22:36298) 2024-08-20T01:36:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.799+0000 7fef0d22f640 1 -- 172.21.15.22:0/4016092973 learned_addr learned my addr 172.21.15.22:0/4016092973 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.799+0000 7fef0e231640 1 --2- 172.21.15.22:0/4016092973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c84630 0x557bc7c86a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.800+0000 7fef0d22f640 1 -- 172.21.15.22:0/4016092973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c84630 msgr2=0x557bc7c86a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.800+0000 7fef0d22f640 1 --2- 172.21.15.22:0/4016092973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c84630 0x557bc7c86a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.800+0000 7fef0d22f640 1 -- 172.21.15.22:0/4016092973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 msgr2=0x557bc7c89350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.800+0000 7fef0d22f640 1 --2- 172.21.15.22:0/4016092973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c89350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.800+0000 7fef0d22f640 1 -- 172.21.15.22:0/4016092973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bc7b8de40 con 0x557bc7c899a0 2024-08-20T01:36:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.800+0000 7fef0da30640 1 --2- 172.21.15.22:0/4016092973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c89350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:36:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.800+0000 7fef0d22f640 1 --2- 172.21.15.22:0/4016092973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 0x557bc7c8be60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7feef80115c0 tx=0x7feef8011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b909454d3b277be5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.800+0000 7feefeffd640 1 --2- 172.21.15.22:0/3342129743 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7feef40b3bd0 0x7feef40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.800+0000 7feef3fff640 1 -- 172.21.15.22:0/4016092973 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef800f6c0 con 0x557bc7c899a0 2024-08-20T01:36:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.800+0000 7feefeffd640 1 -- 172.21.15.22:0/3342129743 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fef04103c60 con 0x7fef08102680 2024-08-20T01:36:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.800+0000 7fef0e231640 1 --2- 172.21.15.22:0/3342129743 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7feef40b3bd0 0x7feef40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.800+0000 7feef3fff640 1 -- 172.21.15.22:0/4016092973 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feef800fd10 con 0x557bc7c899a0 2024-08-20T01:36:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.800+0000 7feef3fff640 1 -- 172.21.15.22:0/4016092973 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef8019df0 con 0x557bc7c899a0 2024-08-20T01:36:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.801+0000 7fef12a88740 1 -- 172.21.15.22:0/4016092973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 msgr2=0x557bc7c8be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.801+0000 7fef0e231640 1 --2- 172.21.15.22:0/3342129743 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7feef40b3bd0 0x7feef40b6090 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fef08199830 tx=0x7fef00009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.801+0000 7fef12a88740 1 --2- 172.21.15.22:0/4016092973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 0x557bc7c8be60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7feef80115c0 tx=0x7feef8011a80 comp rx=0 tx=0).stop 2024-08-20T01:36:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.801+0000 7fef12a88740 1 -- 172.21.15.22:0/4016092973 shutdown_connections 2024-08-20T01:36:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.801+0000 7fef12a88740 1 --2- 172.21.15.22:0/4016092973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 0x557bc7c8be60 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.801+0000 7fef12a88740 1 --2- 172.21.15.22:0/4016092973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c89350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.801+0000 7fef12a88740 1 --2- 172.21.15.22:0/4016092973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c84630 0x557bc7c86a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.801+0000 7fef12a88740 1 -- 172.21.15.22:0/4016092973 >> 172.21.15.22:0/4016092973 conn(0x557bc7c7f730 msgr2=0x557bc7c80510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.801+0000 7fef12a88740 1 -- 172.21.15.22:0/4016092973 shutdown_connections 2024-08-20T01:36:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.801+0000 7fef12a88740 1 -- 172.21.15.22:0/4016092973 wait complete. 2024-08-20T01:36:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.802+0000 7fef12a88740 1 -- start start 2024-08-20T01:36:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.802+0000 7fef12a88740 1 Processor -- start 2024-08-20T01:36:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.802+0000 7fef12a88740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c84630 0x557bc7c8dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.802+0000 7fef12a88740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c8e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.802+0000 7fef12a88740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 0x557bc7c8efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.802+0000 7fef12a88740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557bc7b1fab0 con 0x557bc7c899a0 2024-08-20T01:36:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.802+0000 7fef12a88740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557bc7b6d780 con 0x557bc7c86f60 2024-08-20T01:36:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.802+0000 7fef12a88740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557bc7c8c980 con 0x557bc7c84630 2024-08-20T01:36:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.802+0000 7fef12a88740 10 client.0 _ll_register_callbacks cb 0x557bc78f5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.803+0000 7fef0da30640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c84630 0x557bc7c8dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.803+0000 7fef0e231640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 0x557bc7c8efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.803+0000 7fef0d22f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c8e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.803+0000 7fef0d22f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c8e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:37010/0 (socket says 172.21.15.22:37010) 2024-08-20T01:36:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.803+0000 7fef0e231640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 0x557bc7c8efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36310/0 (socket says 172.21.15.22:36310) 2024-08-20T01:36:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.803+0000 7fef0d22f640 1 -- 172.21.15.22:0/1587395700 learned_addr learned my addr 172.21.15.22:0/1587395700 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.803+0000 7fef0d22f640 1 -- 172.21.15.22:0/1587395700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c84630 msgr2=0x557bc7c8dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.803+0000 7fef0d22f640 1 --2- 172.21.15.22:0/1587395700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c84630 0x557bc7c8dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.803+0000 7fef0d22f640 1 -- 172.21.15.22:0/1587395700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 msgr2=0x557bc7c8efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.803+0000 7fef0d22f640 1 --2- 172.21.15.22:0/1587395700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 0x557bc7c8efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.803+0000 7fef0d22f640 1 -- 172.21.15.22:0/1587395700 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bc7949790 con 0x557bc7c86f60 2024-08-20T01:36:54.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.803+0000 7fef0e231640 1 --2- 172.21.15.22:0/1587395700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 0x557bc7c8efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:36:54.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.803+0000 7fef0d22f640 1 --2- 172.21.15.22:0/1587395700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c8e400 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feef801b040 tx=0x7feef8019dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6b27e85065959a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:54.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.803+0000 7feef17fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:36:54.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.803+0000 7feef17fa640 1 -- 172.21.15.22:0/1587395700 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef8004240 con 0x557bc7c86f60 2024-08-20T01:36:54.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.803+0000 7fef12a88740 1 -- 172.21.15.22:0/1587395700 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557bc7b95e00 con 0x557bc7c86f60 2024-08-20T01:36:54.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.803+0000 7feef17fa640 1 -- 172.21.15.22:0/1587395700 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7feef80043e0 con 0x557bc7c86f60 2024-08-20T01:36:54.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.804+0000 7feef17fa640 1 -- 172.21.15.22:0/1587395700 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7feef8005070 con 0x557bc7c86f60 2024-08-20T01:36:54.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.804+0000 7fef12a88740 10 client.25850 fetch_fsmap learned FSMap version 31 2024-08-20T01:36:54.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.804+0000 7fef12a88740 1 -- 172.21.15.22:0/1587395700 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557bc79c2620 con 0x557bc7c86f60 2024-08-20T01:36:54.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.804+0000 7feef17fa640 1 -- 172.21.15.22:0/1587395700 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557bc7b95e00 con 0x557bc7c86f60 2024-08-20T01:36:54.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.804+0000 7feef17fa640 1 -- 172.21.15.22:0/1587395700 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7feef800f6c0 con 0x557bc7c86f60 2024-08-20T01:36:54.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.804+0000 7fef12a88740 10 client.25850 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:36:54.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.804+0000 7fef12a88740 10 client.25850 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:36:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.804+0000 7fef12a88740 20 client.25850 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.804+0000 7fef12a88740 1 --2- 172.21.15.22:0/1587395700 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557bc7c99910 0x557bc7c9bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.804+0000 7fef12a88740 4 client.25850 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.804+0000 7fef12a88740 1 -- 172.21.15.22:0/1587395700 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557bc7bf92b0 con 0x557bc7c99910 2024-08-20T01:36:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.804+0000 7fef0da30640 1 --2- 172.21.15.22:0/1587395700 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557bc7c99910 0x557bc7c9bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.805+0000 7fef0da30640 1 --2- 172.21.15.22:0/1587395700 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557bc7c99910 0x557bc7c9bd00 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33a33d2df57ef190 server_cookie=ae4a91e80a3aa508 in_seq=0 out_seq=0 2024-08-20T01:36:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.805+0000 7feef17fa640 10 client.25850 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.805+0000 7feef17fa640 1 -- 172.21.15.22:0/1587395700 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557bc7bf92b0 con 0x557bc7c99910 2024-08-20T01:36:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.805+0000 7feef17fa640 10 client.25850 handle_command_reply: tid=0 2024-08-20T01:36:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.806+0000 7fef12a88740 1 client.25850 shutdown 2024-08-20T01:36:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.806+0000 7fef12a88740 1 -- 172.21.15.22:0/1587395700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 msgr2=0x557bc7c8e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.806+0000 7fef12a88740 1 --2- 172.21.15.22:0/1587395700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c8e400 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feef801b040 tx=0x7feef8019dd0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.806+0000 7fef12a88740 1 -- 172.21.15.22:0/1587395700 shutdown_connections 2024-08-20T01:36:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.806+0000 7fef12a88740 1 --2- 172.21.15.22:0/1587395700 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557bc7c99910 0x557bc7c9bd00 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.806+0000 7fef12a88740 1 --2- 172.21.15.22:0/1587395700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 0x557bc7c8efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.806+0000 7fef12a88740 1 --2- 172.21.15.22:0/1587395700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c8e400 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.806+0000 7feef17fa640 0 client.25850 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:54.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.806+0000 7fef12a88740 1 --2- 172.21.15.22:0/1587395700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c84630 0x557bc7c8dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.806+0000 7fef12a88740 1 -- 172.21.15.22:0/1587395700 >> 172.21.15.22:0/1587395700 conn(0x557bc7c7f730 msgr2=0x557bc7c7e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:54.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.806+0000 7fef12a88740 1 -- 172.21.15.22:0/1587395700 shutdown_connections 2024-08-20T01:36:54.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.806+0000 7fef12a88740 1 -- 172.21.15.22:0/1587395700 wait complete. 2024-08-20T01:36:54.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.806+0000 7fef12a88740 20 client.25850 trim_cache size 0 max 16384 2024-08-20T01:36:54.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.822+0000 7fef12a88740 1 Processor -- start 2024-08-20T01:36:54.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.822+0000 7fef12a88740 1 -- start start 2024-08-20T01:36:54.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.822+0000 7fef12a88740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c84630 0x557bc7c8e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:54.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.822+0000 7fef12a88740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c89d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:54.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.822+0000 7fef12a88740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c899a0 0x557bc7c8a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:54.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.822+0000 7fef12a88740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fef081ac6e0 con 0x557bc7c84630 2024-08-20T01:36:54.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.822+0000 7fef12a88740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fef081a9ef0 con 0x557bc7c86f60 2024-08-20T01:36:54.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.822+0000 7fef12a88740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fef081a7d40 con 0x557bc7c899a0 2024-08-20T01:36:54.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.822+0000 7fef0da30640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c84630 0x557bc7c8e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:54.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.822+0000 7fef0da30640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c84630 0x557bc7c8e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36318/0 (socket says 172.21.15.22:36318) 2024-08-20T01:36:54.835 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.822+0000 7fef0da30640 1 -- 172.21.15.22:0/2325068401 learned_addr learned my addr 172.21.15.22:0/2325068401 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:54.835 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.822+0000 7fef0d22f640 1 --2- 172.21.15.22:0/2325068401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c89d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:54.835 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.822+0000 7fef0e231640 1 --2- 172.21.15.22:0/2325068401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c899a0 0x557bc7c8a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:54.835 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.822+0000 7fef0da30640 1 -- 172.21.15.22:0/2325068401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c899a0 msgr2=0x557bc7c8a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:54.835 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.822+0000 7fef0da30640 1 --2- 172.21.15.22:0/2325068401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c899a0 0x557bc7c8a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.836 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.822+0000 7fef0da30640 1 -- 172.21.15.22:0/2325068401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 msgr2=0x557bc7c89d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:54.836 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.822+0000 7fef0da30640 1 --2- 172.21.15.22:0/2325068401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c89d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.836 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.823+0000 7fef0da30640 1 -- 172.21.15.22:0/2325068401 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bc7c896c0 con 0x557bc7c84630 2024-08-20T01:36:54.836 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.823+0000 7fef0da30640 1 --2- 172.21.15.22:0/2325068401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c84630 0x557bc7c8e470 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fef04005e00 tx=0x7fef04005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1366eca74711d89 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:54.836 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.823+0000 7feef37fe640 1 -- 172.21.15.22:0/2325068401 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef040c6a30 con 0x557bc7c84630 2024-08-20T01:36:54.836 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.823+0000 7feef37fe640 1 -- 172.21.15.22:0/2325068401 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef040ca680 con 0x557bc7c84630 2024-08-20T01:36:54.837 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.823+0000 7feef37fe640 1 -- 172.21.15.22:0/2325068401 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef040c6300 con 0x557bc7c84630 2024-08-20T01:36:54.837 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.824+0000 7fef12a88740 1 -- 172.21.15.22:0/2325068401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c84630 msgr2=0x557bc7c8e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:54.837 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.824+0000 7fef12a88740 1 --2- 172.21.15.22:0/2325068401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c84630 0x557bc7c8e470 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fef04005e00 tx=0x7fef04005f90 comp rx=0 tx=0).stop 2024-08-20T01:36:54.837 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.824+0000 7fef12a88740 1 -- 172.21.15.22:0/2325068401 shutdown_connections 2024-08-20T01:36:54.837 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.824+0000 7fef12a88740 1 --2- 172.21.15.22:0/2325068401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c899a0 0x557bc7c8a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.837 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.824+0000 7fef12a88740 1 --2- 172.21.15.22:0/2325068401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c89d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.824+0000 7fef12a88740 1 --2- 172.21.15.22:0/2325068401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c84630 0x557bc7c8e470 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.824+0000 7fef12a88740 1 -- 172.21.15.22:0/2325068401 >> 172.21.15.22:0/2325068401 conn(0x557bc7c7f730 msgr2=0x557bc7c8dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.824+0000 7fef12a88740 1 -- 172.21.15.22:0/2325068401 shutdown_connections 2024-08-20T01:36:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.824+0000 7fef12a88740 1 -- 172.21.15.22:0/2325068401 wait complete. 2024-08-20T01:36:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.824+0000 7fef12a88740 1 -- start start 2024-08-20T01:36:54.839 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.824+0000 7fef12a88740 1 Processor -- start 2024-08-20T01:36:54.839 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7fef12a88740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c84630 0x557bc7c94bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:54.839 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7fef12a88740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c95130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:54.839 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7fef12a88740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 0x557bc7d02230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:54.840 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7fef12a88740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fef081a83b0 con 0x557bc7c899a0 2024-08-20T01:36:54.840 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7fef12a88740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fef081a9820 con 0x557bc7c86f60 2024-08-20T01:36:54.840 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7fef12a88740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fef081a8a80 con 0x557bc7c84630 2024-08-20T01:36:54.840 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7fef12a88740 10 client.0 _ll_register_callbacks cb 0x7feef8011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:54.840 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7fef0e231640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 0x557bc7d02230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7fef0d22f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c95130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7fef0e231640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 0x557bc7d02230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36332/0 (socket says 172.21.15.22:36332) 2024-08-20T01:36:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7fef0e231640 1 -- 172.21.15.22:0/2568029343 learned_addr learned my addr 172.21.15.22:0/2568029343 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7fef0da30640 1 --2- 172.21.15.22:0/2568029343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c84630 0x557bc7c94bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7fef0e231640 1 -- 172.21.15.22:0/2568029343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c84630 msgr2=0x557bc7c94bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7fef0e231640 1 --2- 172.21.15.22:0/2568029343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c84630 0x557bc7c94bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.842 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7fef0e231640 1 -- 172.21.15.22:0/2568029343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 msgr2=0x557bc7c95130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:54.842 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7fef0e231640 1 --2- 172.21.15.22:0/2568029343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c95130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.842 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7fef0e231640 1 -- 172.21.15.22:0/2568029343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bc7c8f340 con 0x557bc7c899a0 2024-08-20T01:36:54.842 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7fef0d22f640 1 --2- 172.21.15.22:0/2568029343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c95130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:36:54.842 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7fef0e231640 1 --2- 172.21.15.22:0/2568029343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 0x557bc7d02230 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fef00004610 tx=0x7fef00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d028dbe61459a87e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:54.843 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7feef17fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:36:54.843 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.825+0000 7feef17fa640 1 -- 172.21.15.22:0/2568029343 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef00004850 con 0x557bc7c899a0 2024-08-20T01:36:54.843 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.826+0000 7feef17fa640 1 -- 172.21.15.22:0/2568029343 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fef00003e00 con 0x557bc7c899a0 2024-08-20T01:36:54.843 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.826+0000 7fef12a88740 1 -- 172.21.15.22:0/2568029343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef040ca680 con 0x557bc7c899a0 2024-08-20T01:36:54.843 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.826+0000 7feef17fa640 1 -- 172.21.15.22:0/2568029343 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fef00004b20 con 0x557bc7c899a0 2024-08-20T01:36:54.843 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.826+0000 7fef12a88740 10 client.16227 fetch_fsmap learned FSMap version 31 2024-08-20T01:36:54.844 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.826+0000 7fef12a88740 1 -- 172.21.15.22:0/2568029343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557bc7d03ac0 con 0x557bc7c899a0 2024-08-20T01:36:54.844 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.826+0000 7feef17fa640 1 -- 172.21.15.22:0/2568029343 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef040ca680 con 0x557bc7c899a0 2024-08-20T01:36:54.844 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.826+0000 7feef17fa640 1 -- 172.21.15.22:0/2568029343 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fef00028420 con 0x557bc7c899a0 2024-08-20T01:36:54.844 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.826+0000 7fef12a88740 10 client.16227 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:36:54.844 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.826+0000 7fef12a88740 10 client.16227 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:36:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.826+0000 7fef12a88740 20 client.16227 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.826+0000 7fef12a88740 1 --2- 172.21.15.22:0/2568029343 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557bc7d04580 0x557bc7d069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.826+0000 7fef12a88740 4 client.16227 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:36:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.826+0000 7fef12a88740 1 -- 172.21.15.22:0/2568029343 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557bc7bf4d50 con 0x557bc7d04580 2024-08-20T01:36:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.827+0000 7fef0da30640 1 --2- 172.21.15.22:0/2568029343 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557bc7d04580 0x557bc7d069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.827+0000 7feef17fa640 10 client.16227 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:54.846 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:54.827+0000 7fef0da30640 1 --2- 172.21.15.22:0/2568029343 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557bc7d04580 0x557bc7d069a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49103cd4edd3e61d server_cookie=2aa64874eb257fde in_seq=0 out_seq=0 2024-08-20T01:36:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.324+0000 7feef17fa640 1 -- 172.21.15.22:0/2568029343 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557bc7bf4d50 con 0x557bc7d04580 2024-08-20T01:36:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.324+0000 7feef17fa640 10 client.16227 handle_command_reply: tid=0 2024-08-20T01:36:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.324+0000 7fef12a88740 1 client.16227 shutdown 2024-08-20T01:36:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.324+0000 7fef12a88740 1 -- 172.21.15.22:0/2568029343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 msgr2=0x557bc7d02230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.324+0000 7fef12a88740 1 --2- 172.21.15.22:0/2568029343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 0x557bc7d02230 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fef00004610 tx=0x7fef00004a40 comp rx=0 tx=0).stop 2024-08-20T01:36:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.324+0000 7fef12a88740 1 -- 172.21.15.22:0/2568029343 shutdown_connections 2024-08-20T01:36:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.324+0000 7fef12a88740 1 --2- 172.21.15.22:0/2568029343 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x557bc7d04580 0x557bc7d069a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.324+0000 7feef17fa640 0 client.16227 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.324+0000 7fef12a88740 1 --2- 172.21.15.22:0/2568029343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557bc7c899a0 0x557bc7d02230 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.325+0000 7fef12a88740 1 --2- 172.21.15.22:0/2568029343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557bc7c86f60 0x557bc7c95130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.325+0000 7fef12a88740 1 --2- 172.21.15.22:0/2568029343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557bc7c84630 0x557bc7c94bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.325+0000 7fef12a88740 1 -- 172.21.15.22:0/2568029343 >> 172.21.15.22:0/2568029343 conn(0x557bc7c7f730 msgr2=0x557bc7c7e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.325+0000 7fef12a88740 1 -- 172.21.15.22:0/2568029343 shutdown_connections 2024-08-20T01:36:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.325+0000 7fef12a88740 1 -- 172.21.15.22:0/2568029343 wait complete. 2024-08-20T01:36:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.325+0000 7fef12a88740 20 client.16227 trim_cache size 0 max 16384 2024-08-20T01:36:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:36:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:36:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:36:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:36:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.326+0000 7fef0fc94640 1 -- 172.21.15.22:0/3342129743 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7feef40b3bd0 msgr2=0x7feef40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.326+0000 7fef0fc94640 1 --2- 172.21.15.22:0/3342129743 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7feef40b3bd0 0x7feef40b6090 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fef08199830 tx=0x7fef00009500 comp rx=0 tx=0).stop 2024-08-20T01:36:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.326+0000 7fef0fc94640 1 -- 172.21.15.22:0/3342129743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef08102680 msgr2=0x7fef08198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.326+0000 7fef0fc94640 1 --2- 172.21.15.22:0/3342129743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef08102680 0x7fef08198ab0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fef0402a8a0 tx=0x7fef04032d50 comp rx=0 tx=0).stop 2024-08-20T01:36:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.326+0000 7fef0fc94640 1 -- 172.21.15.22:0/3342129743 shutdown_connections 2024-08-20T01:36:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.326+0000 7fef0fc94640 1 --2- 172.21.15.22:0/3342129743 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7feef40b3bd0 0x7feef40b6090 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.326+0000 7fef0fc94640 1 --2- 172.21.15.22:0/3342129743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef08104190 0x7fef08199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.326+0000 7fef0fc94640 1 --2- 172.21.15.22:0/3342129743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef081037d0 0x7fef08199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.326+0000 7fef0fc94640 1 --2- 172.21.15.22:0/3342129743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef08102680 0x7fef08198ab0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.326+0000 7fef0fc94640 1 -- 172.21.15.22:0/3342129743 >> 172.21.15.22:0/3342129743 conn(0x7fef080fdf40 msgr2=0x7fef08106bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.326+0000 7fef0fc94640 1 -- 172.21.15.22:0/3342129743 shutdown_connections 2024-08-20T01:36:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:36:55.326+0000 7fef0fc94640 1 -- 172.21.15.22:0/3342129743 wait complete. 2024-08-20T01:36:55.402 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:36:55.484 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:36:55.509 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:55 smithi022 ceph-mon[18709]: pgmap v519: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 12 MiB/s wr, 2.14k op/s 2024-08-20T01:36:55.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:55 smithi134 ceph-mon[22511]: pgmap v519: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 12 MiB/s wr, 2.14k op/s 2024-08-20T01:36:55.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:55 smithi077 ceph-mon[22251]: pgmap v519: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 12 MiB/s wr, 2.14k op/s 2024-08-20T01:36:55.784 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:56.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.289+0000 7ffb66d86640 1 -- 172.21.15.22:0/3123106112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb60101790 msgr2=0x7ffb60101b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:56.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.289+0000 7ffb66d86640 1 --2- 172.21.15.22:0/3123106112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb60101790 0x7ffb60101b70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009900 tx=0x7ffb5402a440 comp rx=0 tx=0).stop 2024-08-20T01:36:56.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.292+0000 7ffb66d86640 1 -- 172.21.15.22:0/3123106112 shutdown_connections 2024-08-20T01:36:56.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.292+0000 7ffb66d86640 1 --2- 172.21.15.22:0/3123106112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb60106bd0 0x7ffb60107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.292+0000 7ffb66d86640 1 --2- 172.21.15.22:0/3123106112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb601020b0 0x7ffb60106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.292+0000 7ffb66d86640 1 --2- 172.21.15.22:0/3123106112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb60101790 0x7ffb60101b70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.292+0000 7ffb66d86640 1 -- 172.21.15.22:0/3123106112 >> 172.21.15.22:0/3123106112 conn(0x7ffb600fd400 msgr2=0x7ffb600ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:56.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.293+0000 7ffb66d86640 1 -- 172.21.15.22:0/3123106112 shutdown_connections 2024-08-20T01:36:56.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.293+0000 7ffb66d86640 1 -- 172.21.15.22:0/3123106112 wait complete. 2024-08-20T01:36:56.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.294+0000 7ffb66d86640 1 Processor -- start 2024-08-20T01:36:56.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.294+0000 7ffb66d86640 1 -- start start 2024-08-20T01:36:56.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.294+0000 7ffb66d86640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb60101790 0x7ffb601156f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:56.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.294+0000 7ffb66d86640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb601020b0 0x7ffb60115c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:56.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.294+0000 7ffb66d86640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb60106bd0 0x7ffb6010e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:56.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.294+0000 7ffb66d86640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffb60119090 con 0x7ffb60101790 2024-08-20T01:36:56.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.294+0000 7ffb66d86640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffb60118f10 con 0x7ffb601020b0 2024-08-20T01:36:56.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.294+0000 7ffb66d86640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffb60119210 con 0x7ffb60106bd0 2024-08-20T01:36:56.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.295+0000 7ffb65323640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb60106bd0 0x7ffb6010e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:56.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.295+0000 7ffb65323640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb60106bd0 0x7ffb6010e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:34440/0 (socket says 172.21.15.22:34440) 2024-08-20T01:36:56.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.295+0000 7ffb65323640 1 -- 172.21.15.22:0/2066297935 learned_addr learned my addr 172.21.15.22:0/2066297935 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:56.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.295+0000 7ffb5ffff640 1 --2- 172.21.15.22:0/2066297935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb601020b0 0x7ffb60115c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:56.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.296+0000 7ffb65323640 1 -- 172.21.15.22:0/2066297935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb601020b0 msgr2=0x7ffb60115c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:56.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.296+0000 7ffb65323640 1 --2- 172.21.15.22:0/2066297935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb601020b0 0x7ffb60115c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.296+0000 7ffb65323640 1 -- 172.21.15.22:0/2066297935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb60101790 msgr2=0x7ffb601156f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:56.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.297+0000 7ffb64b22640 1 --2- 172.21.15.22:0/2066297935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb60101790 0x7ffb601156f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:56.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.298+0000 7ffb65323640 1 --2- 172.21.15.22:0/2066297935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb60101790 0x7ffb601156f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.298+0000 7ffb65323640 1 -- 172.21.15.22:0/2066297935 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6010f240 con 0x7ffb60106bd0 2024-08-20T01:36:56.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.299+0000 7ffb64b22640 1 --2- 172.21.15.22:0/2066297935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb60101790 0x7ffb601156f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:56.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.300+0000 7ffb65323640 1 --2- 172.21.15.22:0/2066297935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb60106bd0 0x7ffb6010e980 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800efd0 tx=0x7ffb5800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:56.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.304+0000 7ffb5dffb640 1 -- 172.21.15.22:0/2066297935 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58003b70 con 0x7ffb60106bd0 2024-08-20T01:36:56.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.304+0000 7ffb5dffb640 1 -- 172.21.15.22:0/2066297935 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb58003d10 con 0x7ffb60106bd0 2024-08-20T01:36:56.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.304+0000 7ffb5dffb640 1 -- 172.21.15.22:0/2066297935 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb580108a0 con 0x7ffb60106bd0 2024-08-20T01:36:56.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.306+0000 7ffb66d86640 1 -- 172.21.15.22:0/2066297935 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6010f530 con 0x7ffb60106bd0 2024-08-20T01:36:56.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.306+0000 7ffb66d86640 1 -- 172.21.15.22:0/2066297935 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb60114530 con 0x7ffb60106bd0 2024-08-20T01:36:56.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.316+0000 7ffb6917f740 1 Processor -- start 2024-08-20T01:36:56.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.317+0000 7ffb6917f740 1 -- start start 2024-08-20T01:36:56.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.317+0000 7ffb6917f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1f0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:56.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.317+0000 7ffb6917f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1f0cd0 0x55e3cb1fc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:56.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.317+0000 7ffb6917f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1fcc60 0x55e3cb1ff050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:56.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.317+0000 7ffb6917f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e3cb166940 con 0x55e3cb1f0cd0 2024-08-20T01:36:56.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.317+0000 7ffb6917f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e3cb155e40 con 0x55e3cb1fcc60 2024-08-20T01:36:56.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.317+0000 7ffb6917f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e3cb159e80 con 0x55e3cb1f03b0 2024-08-20T01:36:56.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.317+0000 7ffb5ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1f0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:56.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.317+0000 7ffb5ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1fcc60 0x55e3cb1ff050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:56.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.317+0000 7ffb5ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1f0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:34456/0 (socket says 172.21.15.22:34456) 2024-08-20T01:36:56.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.317+0000 7ffb5ffff640 1 -- 172.21.15.22:0/2123450333 learned_addr learned my addr 172.21.15.22:0/2123450333 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:56.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.318+0000 7ffb5ffff640 1 -- 172.21.15.22:0/2123450333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1fcc60 msgr2=0x55e3cb1ff050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:56.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.318+0000 7ffb5ffff640 1 --2- 172.21.15.22:0/2123450333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1fcc60 0x55e3cb1ff050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.318+0000 7ffb5ffff640 1 -- 172.21.15.22:0/2123450333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1f0cd0 msgr2=0x55e3cb1fc720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:36:56.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.318+0000 7ffb5ffff640 1 --2- 172.21.15.22:0/2123450333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1f0cd0 0x55e3cb1fc720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.318+0000 7ffb5ffff640 1 -- 172.21.15.22:0/2123450333 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3cb0f2520 con 0x55e3cb1f03b0 2024-08-20T01:36:56.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.319+0000 7ffb5ffff640 1 --2- 172.21.15.22:0/2123450333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1f0790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c014900 tx=0x7ffb4c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a652ebe302b0106a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:56.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.320+0000 7ffb4affd640 1 -- 172.21.15.22:0/2123450333 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c0142d0 con 0x55e3cb1f03b0 2024-08-20T01:36:56.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.320+0000 7ffb4affd640 1 -- 172.21.15.22:0/2123450333 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb4c005020 con 0x55e3cb1f03b0 2024-08-20T01:36:56.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.321+0000 7ffb6917f740 1 -- 172.21.15.22:0/2123450333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1f03b0 msgr2=0x55e3cb1f0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:56.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.321+0000 7ffb6917f740 1 --2- 172.21.15.22:0/2123450333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1f0790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c014900 tx=0x7ffb4c005f90 comp rx=0 tx=0).stop 2024-08-20T01:36:56.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.324+0000 7ffb6917f740 1 -- 172.21.15.22:0/2123450333 shutdown_connections 2024-08-20T01:36:56.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.324+0000 7ffb6917f740 1 --2- 172.21.15.22:0/2123450333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1fcc60 0x55e3cb1ff050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.324+0000 7ffb6917f740 1 --2- 172.21.15.22:0/2123450333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1f0cd0 0x55e3cb1fc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.324+0000 7ffb6917f740 1 --2- 172.21.15.22:0/2123450333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1f0790 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.324+0000 7ffb6917f740 1 -- 172.21.15.22:0/2123450333 >> 172.21.15.22:0/2123450333 conn(0x55e3cb1ee1e0 msgr2=0x55e3cb1ef380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:56.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.324+0000 7ffb5dffb640 1 -- 172.21.15.22:0/2066297935 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ffb58004000 con 0x7ffb60106bd0 2024-08-20T01:36:56.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.325+0000 7ffb5dffb640 1 --2- 172.21.15.22:0/2066297935 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ffb500b3c90 0x7ffb500b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:56.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.326+0000 7ffb5dffb640 1 -- 172.21.15.22:0/2066297935 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ffb580e4080 con 0x7ffb60106bd0 2024-08-20T01:36:56.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.326+0000 7ffb6917f740 1 -- 172.21.15.22:0/2123450333 shutdown_connections 2024-08-20T01:36:56.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.326+0000 7ffb64b22640 1 --2- 172.21.15.22:0/2066297935 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ffb500b3c90 0x7ffb500b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:56.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.326+0000 7ffb6917f740 1 -- 172.21.15.22:0/2123450333 wait complete. 2024-08-20T01:36:56.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.327+0000 7ffb6917f740 1 -- start start 2024-08-20T01:36:56.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.329+0000 7ffb6917f740 1 Processor -- start 2024-08-20T01:36:56.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.329+0000 7ffb6917f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1f9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:56.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.329+0000 7ffb6917f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1f0cd0 0x55e3cb1fa190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:56.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.329+0000 7ffb6917f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1fcc60 0x55e3cb1fa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:56.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.329+0000 7ffb6917f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e3cafb8890 con 0x55e3cb1fcc60 2024-08-20T01:36:56.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.329+0000 7ffb6917f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e3cb0dc700 con 0x55e3cb1f03b0 2024-08-20T01:36:56.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.329+0000 7ffb6917f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e3cb1ffa50 con 0x55e3cb1f0cd0 2024-08-20T01:36:56.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.330+0000 7ffb6917f740 10 client.0 _ll_register_callbacks cb 0x55e3cb1516f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:56.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.330+0000 7ffb5ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1f0cd0 0x55e3cb1fa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:56.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.331+0000 7ffb65323640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1fcc60 0x55e3cb1fa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:56.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.331+0000 7ffb65323640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1fcc60 0x55e3cb1fa6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36362/0 (socket says 172.21.15.22:36362) 2024-08-20T01:36:56.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.331+0000 7ffb65323640 1 -- 172.21.15.22:0/3693579656 learned_addr learned my addr 172.21.15.22:0/3693579656 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:56.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.331+0000 7ffb64b22640 1 --2- 172.21.15.22:0/3693579656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1f9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:56.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.332+0000 7ffb65323640 1 -- 172.21.15.22:0/3693579656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1f0cd0 msgr2=0x55e3cb1fa190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:56.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.332+0000 7ffb65323640 1 --2- 172.21.15.22:0/3693579656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1f0cd0 0x55e3cb1fa190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.332+0000 7ffb65323640 1 -- 172.21.15.22:0/3693579656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1f03b0 msgr2=0x55e3cb1f9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:56.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.332+0000 7ffb65323640 1 --2- 172.21.15.22:0/3693579656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1f9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.332+0000 7ffb65323640 1 -- 172.21.15.22:0/3693579656 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3caeb5930 con 0x55e3cb1fcc60 2024-08-20T01:36:56.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.332+0000 7ffb64b22640 1 --2- 172.21.15.22:0/2066297935 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ffb500b3c90 0x7ffb500b6150 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009230 tx=0x7ffb540036d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:56.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.332+0000 7ffb65323640 1 --2- 172.21.15.22:0/3693579656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1fcc60 0x55e3cb1fa6d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ffb580a6fb0 tx=0x7ffb580aaa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55697fea2cf5577f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:56.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.332+0000 7ffb3ffff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:36:56.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.334+0000 7ffb3ffff640 1 -- 172.21.15.22:0/3693579656 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb580c4020 con 0x55e3cb1fcc60 2024-08-20T01:36:56.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.334+0000 7ffb6917f740 1 -- 172.21.15.22:0/3693579656 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e3cb168890 con 0x55e3cb1fcc60 2024-08-20T01:36:56.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.335+0000 7ffb3ffff640 1 -- 172.21.15.22:0/3693579656 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ffb58004560 con 0x55e3cb1fcc60 2024-08-20T01:36:56.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.336+0000 7ffb3ffff640 1 -- 172.21.15.22:0/3693579656 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffb580aaf30 con 0x55e3cb1fcc60 2024-08-20T01:36:56.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.339+0000 7ffb6917f740 10 client.16233 fetch_fsmap learned FSMap version 31 2024-08-20T01:36:56.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.339+0000 7ffb6917f740 1 -- 172.21.15.22:0/3693579656 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e3cb22d800 con 0x55e3cb1fcc60 2024-08-20T01:36:56.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.343+0000 7ffb3ffff640 1 -- 172.21.15.22:0/3693579656 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e3cb168890 con 0x55e3cb1fcc60 2024-08-20T01:36:56.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.343+0000 7ffb3ffff640 1 -- 172.21.15.22:0/3693579656 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7ffb580a68a0 con 0x55e3cb1fcc60 2024-08-20T01:36:56.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.344+0000 7ffb6917f740 10 client.16233 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:36:56.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.344+0000 7ffb6917f740 10 client.16233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:36:56.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.344+0000 7ffb6917f740 20 client.16233 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:56.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.344+0000 7ffb6917f740 1 --2- 172.21.15.22:0/3693579656 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e3cb22f1b0 0x55e3cb231630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:56.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.344+0000 7ffb6917f740 4 client.16233 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:56.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.344+0000 7ffb6917f740 1 -- 172.21.15.22:0/3693579656 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3cb164330 con 0x55e3cb22f1b0 2024-08-20T01:36:56.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.347+0000 7ffb64b22640 1 --2- 172.21.15.22:0/3693579656 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e3cb22f1b0 0x55e3cb231630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:56.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.357+0000 7ffb64b22640 1 --2- 172.21.15.22:0/3693579656 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e3cb22f1b0 0x55e3cb231630 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4de860b26ee2d7d server_cookie=c369db17a7bb7fd in_seq=0 out_seq=0 2024-08-20T01:36:56.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.357+0000 7ffb3ffff640 10 client.16233 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:56.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.358+0000 7ffb3ffff640 1 -- 172.21.15.22:0/3693579656 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e3cb164330 con 0x55e3cb22f1b0 2024-08-20T01:36:56.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.358+0000 7ffb3ffff640 10 client.16233 handle_command_reply: tid=0 2024-08-20T01:36:56.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.358+0000 7ffb6917f740 1 client.16233 shutdown 2024-08-20T01:36:56.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.362+0000 7ffb6917f740 1 -- 172.21.15.22:0/3693579656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1fcc60 msgr2=0x55e3cb1fa6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:56.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.362+0000 7ffb6917f740 1 --2- 172.21.15.22:0/3693579656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1fcc60 0x55e3cb1fa6d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ffb580a6fb0 tx=0x7ffb580aaa40 comp rx=0 tx=0).stop 2024-08-20T01:36:56.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.365+0000 7ffb6917f740 1 -- 172.21.15.22:0/3693579656 shutdown_connections 2024-08-20T01:36:56.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.365+0000 7ffb6917f740 1 --2- 172.21.15.22:0/3693579656 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e3cb22f1b0 0x55e3cb231630 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.365+0000 7ffb6917f740 1 --2- 172.21.15.22:0/3693579656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1fcc60 0x55e3cb1fa6d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.365+0000 7ffb6917f740 1 --2- 172.21.15.22:0/3693579656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1f0cd0 0x55e3cb1fa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.365+0000 7ffb6917f740 1 --2- 172.21.15.22:0/3693579656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1f9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.365+0000 7ffb6917f740 1 -- 172.21.15.22:0/3693579656 >> 172.21.15.22:0/3693579656 conn(0x55e3cb1ee1e0 msgr2=0x55e3cb1f3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:56.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.369+0000 7ffb3ffff640 0 client.16233 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:56.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.369+0000 7ffb6917f740 1 -- 172.21.15.22:0/3693579656 shutdown_connections 2024-08-20T01:36:56.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.369+0000 7ffb6917f740 1 -- 172.21.15.22:0/3693579656 wait complete. 2024-08-20T01:36:56.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.370+0000 7ffb6917f740 20 client.16233 trim_cache size 0 max 16384 2024-08-20T01:36:56.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.407+0000 7ffb6917f740 1 Processor -- start 2024-08-20T01:36:56.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.408+0000 7ffb6917f740 1 -- start start 2024-08-20T01:36:56.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.408+0000 7ffb6917f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1f4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:56.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.408+0000 7ffb6917f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1f0cd0 0x55e3cb236f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:56.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.408+0000 7ffb6917f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1fcc60 0x55e3cb237440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:56.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.408+0000 7ffb6917f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffb601b7100 con 0x55e3cb1fcc60 2024-08-20T01:36:56.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.408+0000 7ffb6917f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffb60074420 con 0x55e3cb1f03b0 2024-08-20T01:36:56.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.408+0000 7ffb6917f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffb60072270 con 0x55e3cb1f0cd0 2024-08-20T01:36:56.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.408+0000 7ffb5ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1f0cd0 0x55e3cb236f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:56.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.408+0000 7ffb64b22640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:56.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.408+0000 7ffb65323640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1fcc60 0x55e3cb237440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:56.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.408+0000 7ffb5ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1f0cd0 0x55e3cb236f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:34472/0 (socket says 172.21.15.22:34472) 2024-08-20T01:36:56.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.408+0000 7ffb64b22640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1f4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:37088/0 (socket says 172.21.15.22:37088) 2024-08-20T01:36:56.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.408+0000 7ffb5ffff640 1 -- 172.21.15.22:0/3679157995 learned_addr learned my addr 172.21.15.22:0/3679157995 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:56.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.408+0000 7ffb5ffff640 1 -- 172.21.15.22:0/3679157995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1f03b0 msgr2=0x55e3cb1f4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:56.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.408+0000 7ffb5ffff640 1 --2- 172.21.15.22:0/3679157995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1f4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.408+0000 7ffb5ffff640 1 -- 172.21.15.22:0/3679157995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1fcc60 msgr2=0x55e3cb237440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:56.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.408+0000 7ffb5ffff640 1 --2- 172.21.15.22:0/3679157995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1fcc60 0x55e3cb237440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.408+0000 7ffb5ffff640 1 -- 172.21.15.22:0/3679157995 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3cb1f8bb0 con 0x55e3cb1f0cd0 2024-08-20T01:36:56.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.409+0000 7ffb5ffff640 1 --2- 172.21.15.22:0/3679157995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1f0cd0 0x55e3cb236f00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0148a0 tx=0x7ffb4c014660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d800e3b4e4e58ad server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:56.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.409+0000 7ffb4a7fc640 1 -- 172.21.15.22:0/3679157995 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c0140d0 con 0x55e3cb1f0cd0 2024-08-20T01:36:56.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.409+0000 7ffb4a7fc640 1 -- 172.21.15.22:0/3679157995 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb4c014270 con 0x55e3cb1f0cd0 2024-08-20T01:36:56.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.409+0000 7ffb4a7fc640 1 -- 172.21.15.22:0/3679157995 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c003610 con 0x55e3cb1f0cd0 2024-08-20T01:36:56.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.410+0000 7ffb6917f740 1 -- 172.21.15.22:0/3679157995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1f0cd0 msgr2=0x55e3cb236f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:56.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.410+0000 7ffb6917f740 1 --2- 172.21.15.22:0/3679157995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1f0cd0 0x55e3cb236f00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0148a0 tx=0x7ffb4c014660 comp rx=0 tx=0).stop 2024-08-20T01:36:56.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.410+0000 7ffb6917f740 1 -- 172.21.15.22:0/3679157995 shutdown_connections 2024-08-20T01:36:56.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.410+0000 7ffb6917f740 1 --2- 172.21.15.22:0/3679157995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1fcc60 0x55e3cb237440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.410+0000 7ffb6917f740 1 --2- 172.21.15.22:0/3679157995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1f0cd0 0x55e3cb236f00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.410+0000 7ffb6917f740 1 --2- 172.21.15.22:0/3679157995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.410+0000 7ffb6917f740 1 -- 172.21.15.22:0/3679157995 >> 172.21.15.22:0/3679157995 conn(0x55e3cb1ee1e0 msgr2=0x55e3cb1fbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:56.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.410+0000 7ffb6917f740 1 -- 172.21.15.22:0/3679157995 shutdown_connections 2024-08-20T01:36:56.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.410+0000 7ffb6917f740 1 -- 172.21.15.22:0/3679157995 wait complete. 2024-08-20T01:36:56.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.410+0000 7ffb6917f740 1 -- start start 2024-08-20T01:36:56.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.410+0000 7ffb6917f740 1 Processor -- start 2024-08-20T01:36:56.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.411+0000 7ffb6917f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1ffe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:56.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.411+0000 7ffb6917f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1f0cd0 0x55e3cb200390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:56.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.411+0000 7ffb6917f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1fcc60 0x55e3cb297ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:56.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.411+0000 7ffb6917f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffb600728e0 con 0x55e3cb1f03b0 2024-08-20T01:36:56.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.411+0000 7ffb6917f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffb60073d50 con 0x55e3cb1f0cd0 2024-08-20T01:36:56.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.411+0000 7ffb6917f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffb60072fb0 con 0x55e3cb1fcc60 2024-08-20T01:36:56.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.411+0000 7ffb6917f740 10 client.0 _ll_register_callbacks cb 0x7ffb58009b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:56.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.411+0000 7ffb64b22640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1ffe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:56.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.411+0000 7ffb64b22640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1ffe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36378/0 (socket says 172.21.15.22:36378) 2024-08-20T01:36:56.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.411+0000 7ffb64b22640 1 -- 172.21.15.22:0/4152183314 learned_addr learned my addr 172.21.15.22:0/4152183314 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:56.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.411+0000 7ffb65323640 1 --2- 172.21.15.22:0/4152183314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1fcc60 0x55e3cb297ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:56.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.411+0000 7ffb5ffff640 1 --2- 172.21.15.22:0/4152183314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1f0cd0 0x55e3cb200390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:56.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.412+0000 7ffb64b22640 1 -- 172.21.15.22:0/4152183314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1fcc60 msgr2=0x55e3cb297ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:56.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.412+0000 7ffb64b22640 1 --2- 172.21.15.22:0/4152183314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1fcc60 0x55e3cb297ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.412+0000 7ffb64b22640 1 -- 172.21.15.22:0/4152183314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1f0cd0 msgr2=0x55e3cb200390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:56.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.412+0000 7ffb64b22640 1 --2- 172.21.15.22:0/4152183314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1f0cd0 0x55e3cb200390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.412+0000 7ffb64b22640 1 -- 172.21.15.22:0/4152183314 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3cb200c20 con 0x55e3cb1f03b0 2024-08-20T01:36:56.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.412+0000 7ffb5ffff640 1 --2- 172.21.15.22:0/4152183314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1f0cd0 0x55e3cb200390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:36:56.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.412+0000 7ffb64b22640 1 --2- 172.21.15.22:0/4152183314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1ffe50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x55e3cb1f3530 tx=0x7ffb5402a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8ccf468cc65613 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:56.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.412+0000 7ffb3ffff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:36:56.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.412+0000 7ffb3ffff640 1 -- 172.21.15.22:0/4152183314 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb54031d90 con 0x55e3cb1f03b0 2024-08-20T01:36:56.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.412+0000 7ffb3ffff640 1 -- 172.21.15.22:0/4152183314 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ffb5404b440 con 0x55e3cb1f03b0 2024-08-20T01:36:56.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.412+0000 7ffb6917f740 1 -- 172.21.15.22:0/4152183314 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb4c014270 con 0x55e3cb1f03b0 2024-08-20T01:36:56.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.412+0000 7ffb3ffff640 1 -- 172.21.15.22:0/4152183314 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffb5404b640 con 0x55e3cb1f03b0 2024-08-20T01:36:56.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.412+0000 7ffb6917f740 10 client.16239 fetch_fsmap learned FSMap version 31 2024-08-20T01:36:56.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.412+0000 7ffb6917f740 1 -- 172.21.15.22:0/4152183314 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e3cb299570 con 0x55e3cb1f03b0 2024-08-20T01:36:56.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.413+0000 7ffb3ffff640 1 -- 172.21.15.22:0/4152183314 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb4c014270 con 0x55e3cb1f03b0 2024-08-20T01:36:56.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.413+0000 7ffb3ffff640 1 -- 172.21.15.22:0/4152183314 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7ffb5405c7e0 con 0x55e3cb1f03b0 2024-08-20T01:36:56.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.413+0000 7ffb6917f740 10 client.16239 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:36:56.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.413+0000 7ffb6917f740 10 client.16239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:36:56.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.413+0000 7ffb6917f740 20 client.16239 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:56.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.413+0000 7ffb6917f740 1 --2- 172.21.15.22:0/4152183314 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e3cb299d50 0x55e3cb29c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:56.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.413+0000 7ffb6917f740 4 client.16239 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:36:56.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.413+0000 7ffb6917f740 1 -- 172.21.15.22:0/4152183314 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e3cb161a70 con 0x55e3cb299d50 2024-08-20T01:36:56.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.413+0000 7ffb5ffff640 1 --2- 172.21.15.22:0/4152183314 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e3cb299d50 0x55e3cb29c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:56.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.414+0000 7ffb5ffff640 1 --2- 172.21.15.22:0/4152183314 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e3cb299d50 0x55e3cb29c170 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec36e9f4619b829c server_cookie=4fb7c0b892bd7733 in_seq=0 out_seq=0 2024-08-20T01:36:56.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.414+0000 7ffb3ffff640 10 client.16239 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:56.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.415+0000 7ffb3ffff640 1 -- 172.21.15.22:0/4152183314 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e3cb161a70 con 0x55e3cb299d50 2024-08-20T01:36:56.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.415+0000 7ffb3ffff640 10 client.16239 handle_command_reply: tid=0 2024-08-20T01:36:56.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.415+0000 7ffb6917f740 1 client.16239 shutdown 2024-08-20T01:36:56.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.415+0000 7ffb6917f740 1 -- 172.21.15.22:0/4152183314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1f03b0 msgr2=0x55e3cb1ffe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:56.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.415+0000 7ffb6917f740 1 --2- 172.21.15.22:0/4152183314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1ffe50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x55e3cb1f3530 tx=0x7ffb5402a440 comp rx=0 tx=0).stop 2024-08-20T01:36:56.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.415+0000 7ffb6917f740 1 -- 172.21.15.22:0/4152183314 shutdown_connections 2024-08-20T01:36:56.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.415+0000 7ffb6917f740 1 --2- 172.21.15.22:0/4152183314 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e3cb299d50 0x55e3cb29c170 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.415+0000 7ffb6917f740 1 --2- 172.21.15.22:0/4152183314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3cb1fcc60 0x55e3cb297ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.415+0000 7ffb6917f740 1 --2- 172.21.15.22:0/4152183314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3cb1f0cd0 0x55e3cb200390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.415+0000 7ffb6917f740 1 --2- 172.21.15.22:0/4152183314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3cb1f03b0 0x55e3cb1ffe50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.415+0000 7ffb6917f740 1 -- 172.21.15.22:0/4152183314 >> 172.21.15.22:0/4152183314 conn(0x55e3cb1ee1e0 msgr2=0x55e3cb1f9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:56.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.415+0000 7ffb3ffff640 0 client.16239 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:56.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.415+0000 7ffb6917f740 1 -- 172.21.15.22:0/4152183314 shutdown_connections 2024-08-20T01:36:56.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.415+0000 7ffb6917f740 1 -- 172.21.15.22:0/4152183314 wait complete. 2024-08-20T01:36:56.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.415+0000 7ffb6917f740 20 client.16239 trim_cache size 0 max 16384 2024-08-20T01:36:56.424 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:36:56.425 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-08-20T01:36:56.425 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "8ba209a7-349a-4db6-a36b-6592361cbf6f", 2024-08-20T01:36:56.425 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-08-20T01:36:56.425 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:36:56.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.416+0000 7ffb66d86640 1 -- 172.21.15.22:0/2066297935 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ffb500b3c90 msgr2=0x7ffb500b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:56.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.416+0000 7ffb66d86640 1 --2- 172.21.15.22:0/2066297935 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ffb500b3c90 0x7ffb500b6150 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009230 tx=0x7ffb540036d0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.416+0000 7ffb66d86640 1 -- 172.21.15.22:0/2066297935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb60106bd0 msgr2=0x7ffb6010e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:56.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.416+0000 7ffb66d86640 1 --2- 172.21.15.22:0/2066297935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb60106bd0 0x7ffb6010e980 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800efd0 tx=0x7ffb5800c6a0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.416+0000 7ffb66d86640 1 -- 172.21.15.22:0/2066297935 shutdown_connections 2024-08-20T01:36:56.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.416+0000 7ffb66d86640 1 --2- 172.21.15.22:0/2066297935 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ffb500b3c90 0x7ffb500b6150 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.416+0000 7ffb66d86640 1 --2- 172.21.15.22:0/2066297935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb60106bd0 0x7ffb6010e980 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.416+0000 7ffb66d86640 1 --2- 172.21.15.22:0/2066297935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb601020b0 0x7ffb60115c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.416+0000 7ffb66d86640 1 --2- 172.21.15.22:0/2066297935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb60101790 0x7ffb601156f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:56.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.416+0000 7ffb66d86640 1 -- 172.21.15.22:0/2066297935 >> 172.21.15.22:0/2066297935 conn(0x7ffb600fd400 msgr2=0x7ffb60104550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:56.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.416+0000 7ffb66d86640 1 -- 172.21.15.22:0/2066297935 shutdown_connections 2024-08-20T01:36:56.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:56.416+0000 7ffb66d86640 1 -- 172.21.15.22:0/2066297935 wait complete. 2024-08-20T01:36:57.136 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:36:57.182 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:36:56 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i[52992]: 2024-08-20T01:36:56.777+0000 7f7703adc640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002477 [...2,head] /volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/ auth{1=1,2=1} fragtree_t(*^3) v203660 ap=2 f(v8 m2024-08-20T01:36:43.568170+0000 154=154+0) n(v13 rc2024-08-20T01:36:43.568170+0000 b2065972 155=154+1) (inest sync->mix g=1,2) caps={24937=pAsLsXsFs/pAsLsXsFsx@178} | dirtyscattered=0 request=0 lock=0 importing=0 dirfrag=8 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x564924e59600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000002477:[<0x10000000399/blog-53 v85363>,<0x10000000208/blogtest_in v682>,<0x10000000201/src v2089>,<0x10000000006/blogbench-1.0 v1841>,<0x10000000005/tmp v120>,<0x100000001fb/client.0 v114>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v129>,<0x10000000001/sv_1 v145>,<0x10000000000/qa v134>,<0x1/volumes v126>]//[]","memoryvalue":"(2)0x10000002477:[<0x10000000399/blog-53 v203660>,<0x10000000208/blogtest_in v3383>,<0x10000000201/src v2670>,<0x10000000006/blogbench-1.0 v2331>,<0x10000000005/tmp v596>,<0x100000001fb/client.0 v586>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v595>,<0x10000000001/sv_1 v599>,<0x10000000000/qa v574>,<0x1/volumes v580>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-20T01:36:28.685362+0000 153=153+0)","ondisk_value.rstat":"n(v0 rc2024-08-20T01:36:43.568170+0000 b2065972 155=154+1)","memory_value.dirstat":"f(v8 m2024-08-20T01:36:43.568170+0000 154=154+0)","memory_value.rstat":"n(v13 rc2024-08-20T01:36:43.568170+0000 b2065972 155=154+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-20T01:36:57.182 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:36:56 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i[52992]: 2024-08-20T01:36:56.823+0000 7f7703adc640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b8d [...2,head] /volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/ auth{1=1,2=1} fragtree_t(*^3) v203668 ap=2 f(v14 m2024-08-20T01:36:45.002151+0000 216=216+0) n(v16 rc2024-08-20T01:36:45.002151+0000 b4088487 217=216+1) (inest sync->mix g=1,2) caps={24937=pAsLsXsFs/pAsLsXsFsx@333} mcw={1=AsLsXsFs,2=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 importing=0 dirfrag=8 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x564922c20580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000001b8d:[<0x10000000399/blog-31 v55487>,<0x10000000208/blogtest_in v498>,<0x10000000201/src v2059>,<0x10000000006/blogbench-1.0 v1811>,<0x10000000005/tmp v94>,<0x100000001fb/client.0 v90>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v105>,<0x10000000001/sv_1 v122>,<0x10000000000/qa v112>,<0x1/volumes v104>]//[]","memoryvalue":"(2)0x10000001b8d:[<0x10000000399/blog-31 v203668>,<0x10000000208/blogtest_in v3383>,<0x10000000201/src v2670>,<0x10000000006/blogbench-1.0 v2331>,<0x10000000005/tmp v596>,<0x100000001fb/client.0 v586>,<0x100000001fa/3be0a5f5-9967-4951-8ad4-27cd511ce0fd v595>,<0x10000000001/sv_1 v599>,<0x10000000000/qa v574>,<0x1/volumes v580>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-20T01:36:45.002151+0000 215=215+0)","ondisk_value.rstat":"n(v0 rc2024-08-20T01:36:45.002151+0000 b4088487 217=216+1)","memory_value.dirstat":"f(v14 m2024-08-20T01:36:45.002151+0000 216=216+0)","memory_value.rstat":"n(v16 rc2024-08-20T01:36:45.002151+0000 b4088487 217=216+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-20T01:36:57.513 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:57.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:57 smithi134 ceph-mon[22511]: pgmap v520: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 1.17k op/s 2024-08-20T01:36:57.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:57 smithi134 ceph-mon[22511]: scrub queued for path: / 2024-08-20T01:36:57.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:57 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:57.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:57 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:36:57.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:57 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:36:57.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:57 smithi077 ceph-mon[22251]: pgmap v520: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 1.17k op/s 2024-08-20T01:36:57.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:57 smithi077 ceph-mon[22251]: scrub queued for path: / 2024-08-20T01:36:57.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:57 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:57.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:57 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:36:57.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:57 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:36:57.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:57 smithi022 ceph-mon[18709]: pgmap v520: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 1.17k op/s 2024-08-20T01:36:57.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:57 smithi022 ceph-mon[18709]: scrub queued for path: / 2024-08-20T01:36:57.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:57 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:57.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:57 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:36:57.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:57 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:36:58.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.012+0000 7f5d9c414640 1 -- 172.21.15.22:0/604459781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d941073a0 msgr2=0x7f5d941077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:58.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.012+0000 7f5d9c414640 1 --2- 172.21.15.22:0/604459781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d941073a0 0x7f5d941077e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009900 tx=0x7f5d8402a3f0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.012+0000 7f5d9c414640 1 -- 172.21.15.22:0/604459781 shutdown_connections 2024-08-20T01:36:58.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.012+0000 7f5d9c414640 1 --2- 172.21.15.22:0/604459781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d94107d20 0x7f5d9410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.012+0000 7f5d9c414640 1 --2- 172.21.15.22:0/604459781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d941073a0 0x7f5d941077e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.012+0000 7f5d9c414640 1 --2- 172.21.15.22:0/604459781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d94101990 0x7f5d94101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.013+0000 7f5d9c414640 1 -- 172.21.15.22:0/604459781 >> 172.21.15.22:0/604459781 conn(0x7f5d940fd400 msgr2=0x7f5d940ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:58.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.013+0000 7f5d9c414640 1 -- 172.21.15.22:0/604459781 shutdown_connections 2024-08-20T01:36:58.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.013+0000 7f5d9c414640 1 -- 172.21.15.22:0/604459781 wait complete. 2024-08-20T01:36:58.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.014+0000 7f5d9c414640 1 Processor -- start 2024-08-20T01:36:58.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.014+0000 7f5d9c414640 1 -- start start 2024-08-20T01:36:58.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.014+0000 7f5d9c414640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d94101990 0x7f5d9410ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.014+0000 7f5d9c414640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d941073a0 0x7f5d9410f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.015+0000 7f5d9c414640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d94107d20 0x7f5d9410f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.015+0000 7f5d9a1b0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d94101990 0x7f5d9410ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.015+0000 7f5d9a1b0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d94101990 0x7f5d9410ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36384/0 (socket says 172.21.15.22:36384) 2024-08-20T01:36:58.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.015+0000 7f5d9a1b0640 1 -- 172.21.15.22:0/2764255918 learned_addr learned my addr 172.21.15.22:0/2764255918 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:58.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.015+0000 7f5d9c414640 1 -- 172.21.15.22:0/2764255918 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5d94112ad0 con 0x7f5d94101990 2024-08-20T01:36:58.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.015+0000 7f5d9c414640 1 -- 172.21.15.22:0/2764255918 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d94112950 con 0x7f5d941073a0 2024-08-20T01:36:58.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.015+0000 7f5d9c414640 1 -- 172.21.15.22:0/2764255918 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5d94112c50 con 0x7f5d94107d20 2024-08-20T01:36:58.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.015+0000 7f5d9a9b1640 1 --2- 172.21.15.22:0/2764255918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d94107d20 0x7f5d9410f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.015+0000 7f5d999af640 1 --2- 172.21.15.22:0/2764255918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d941073a0 0x7f5d9410f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.015+0000 7f5d9a1b0640 1 -- 172.21.15.22:0/2764255918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d94107d20 msgr2=0x7f5d9410f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:58.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.015+0000 7f5d9a1b0640 1 --2- 172.21.15.22:0/2764255918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d94107d20 0x7f5d9410f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.015+0000 7f5d9a1b0640 1 -- 172.21.15.22:0/2764255918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d941073a0 msgr2=0x7f5d9410f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:58.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.015+0000 7f5d9a1b0640 1 --2- 172.21.15.22:0/2764255918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d941073a0 0x7f5d9410f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.015+0000 7f5d9a1b0640 1 -- 172.21.15.22:0/2764255918 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d941a7380 con 0x7f5d94101990 2024-08-20T01:36:58.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.016+0000 7f5d9a9b1640 1 --2- 172.21.15.22:0/2764255918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d94107d20 0x7f5d9410f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:36:58.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.016+0000 7f5d9a1b0640 1 --2- 172.21.15.22:0/2764255918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d94101990 0x7f5d9410ed00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000d950 tx=0x7f5d9000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:58.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.016+0000 7f5d8b7fe640 1 -- 172.21.15.22:0/2764255918 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d90017070 con 0x7f5d94101990 2024-08-20T01:36:58.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.016+0000 7f5d8b7fe640 1 -- 172.21.15.22:0/2764255918 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d90009c30 con 0x7f5d94101990 2024-08-20T01:36:58.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.016+0000 7f5d9c414640 1 -- 172.21.15.22:0/2764255918 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d941a7670 con 0x7f5d94101990 2024-08-20T01:36:58.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.016+0000 7f5d8b7fe640 1 -- 172.21.15.22:0/2764255918 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9000f620 con 0x7f5d94101990 2024-08-20T01:36:58.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.016+0000 7f5d9c414640 1 -- 172.21.15.22:0/2764255918 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d941a7b10 con 0x7f5d94101990 2024-08-20T01:36:58.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.020+0000 7f5d9e80d740 1 Processor -- start 2024-08-20T01:36:58.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.020+0000 7f5d9e80d740 1 -- start start 2024-08-20T01:36:58.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.020+0000 7f5d9e80d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46c830 0x55d34c46cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.020+0000 7f5d9e80d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c46d150 0x55d34c478ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.020+0000 7f5d9e80d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c4790e0 0x55d34c47b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.020+0000 7f5d9e80d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d34c3e38e0 con 0x55d34c4790e0 2024-08-20T01:36:58.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.020+0000 7f5d9e80d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d34c3d2de0 con 0x55d34c46d150 2024-08-20T01:36:58.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.020+0000 7f5d9e80d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d34c3d6e20 con 0x55d34c46c830 2024-08-20T01:36:58.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.021+0000 7f5d9a9b1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46c830 0x55d34c46cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.021+0000 7f5d8b7fe640 1 -- 172.21.15.22:0/2764255918 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5d90010460 con 0x7f5d94101990 2024-08-20T01:36:58.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.021+0000 7f5d9a9b1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46c830 0x55d34c46cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:34518/0 (socket says 172.21.15.22:34518) 2024-08-20T01:36:58.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.021+0000 7f5d9a9b1640 1 -- 172.21.15.22:0/3266912169 learned_addr learned my addr 172.21.15.22:0/3266912169 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:58.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.021+0000 7f5d9a1b0640 1 --2- 172.21.15.22:0/3266912169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c46d150 0x55d34c478ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.021+0000 7f5d999af640 1 --2- 172.21.15.22:0/3266912169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c4790e0 0x55d34c47b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.021+0000 7f5d9a9b1640 1 -- 172.21.15.22:0/3266912169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c46d150 msgr2=0x55d34c478ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:58.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.021+0000 7f5d9a9b1640 1 --2- 172.21.15.22:0/3266912169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c46d150 0x55d34c478ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.021+0000 7f5d9a9b1640 1 -- 172.21.15.22:0/3266912169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c4790e0 msgr2=0x55d34c47b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:58.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.021+0000 7f5d9a9b1640 1 --2- 172.21.15.22:0/3266912169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c4790e0 0x55d34c47b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.022+0000 7f5d9a9b1640 1 -- 172.21.15.22:0/3266912169 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d34c132650 con 0x55d34c46c830 2024-08-20T01:36:58.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.022+0000 7f5d999af640 1 --2- 172.21.15.22:0/3266912169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c4790e0 0x55d34c47b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:58.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.022+0000 7f5d9a9b1640 1 --2- 172.21.15.22:0/3266912169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46c830 0x55d34c46cc10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c011760 tx=0x7f5d8c011c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac3e6b783b0c368e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:58.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.022+0000 7f5d8b7fe640 1 --2- 172.21.15.22:0/2764255918 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5d800b3cd0 0x7f5d800b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.022+0000 7f5d88de6640 1 -- 172.21.15.22:0/3266912169 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c00fb40 con 0x55d34c46c830 2024-08-20T01:36:58.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.022+0000 7f5d88de6640 1 -- 172.21.15.22:0/3266912169 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d8c011e70 con 0x55d34c46c830 2024-08-20T01:36:58.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.022+0000 7f5d9a1b0640 1 --2- 172.21.15.22:0/2764255918 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5d800b3cd0 0x7f5d800b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.023+0000 7f5d8b7fe640 1 -- 172.21.15.22:0/2764255918 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f5d900e3420 con 0x7f5d94101990 2024-08-20T01:36:58.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.023+0000 7f5d88de6640 1 -- 172.21.15.22:0/3266912169 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c012e60 con 0x55d34c46c830 2024-08-20T01:36:58.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.023+0000 7f5d9e80d740 1 -- 172.21.15.22:0/3266912169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46c830 msgr2=0x55d34c46cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:58.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.023+0000 7f5d9a1b0640 1 --2- 172.21.15.22:0/2764255918 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5d800b3cd0 0x7f5d800b6190 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5d900a75f0 tx=0x7f5d90010cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:58.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.023+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/3266912169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46c830 0x55d34c46cc10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c011760 tx=0x7f5d8c011c20 comp rx=0 tx=0).stop 2024-08-20T01:36:58.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.023+0000 7f5d9e80d740 1 -- 172.21.15.22:0/3266912169 shutdown_connections 2024-08-20T01:36:58.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.023+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/3266912169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c4790e0 0x55d34c47b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.023+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/3266912169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c46d150 0x55d34c478ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.023+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/3266912169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46c830 0x55d34c46cc10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.024+0000 7f5d9e80d740 1 -- 172.21.15.22:0/3266912169 >> 172.21.15.22:0/3266912169 conn(0x55d34c46a660 msgr2=0x55d34c46b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:58.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.024+0000 7f5d9e80d740 1 -- 172.21.15.22:0/3266912169 shutdown_connections 2024-08-20T01:36:58.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.024+0000 7f5d9e80d740 1 -- 172.21.15.22:0/3266912169 wait complete. 2024-08-20T01:36:58.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.024+0000 7f5d9e80d740 1 -- start start 2024-08-20T01:36:58.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.024+0000 7f5d9e80d740 1 Processor -- start 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.025+0000 7f5d9e80d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c46c830 0x55d34c478b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.025+0000 7f5d9e80d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46d150 0x55d34c475f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.025+0000 7f5d9e80d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c4790e0 0x55d34c4766a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.025+0000 7f5d9e80d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d34c235700 con 0x55d34c4790e0 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.025+0000 7f5d9e80d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d34c3597c0 con 0x55d34c46c830 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.025+0000 7f5d9e80d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d34c47bde0 con 0x55d34c46d150 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.025+0000 7f5d9e80d740 10 client.0 _ll_register_callbacks cb 0x55d34c3cc6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.025+0000 7f5d999af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46d150 0x55d34c475f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.025+0000 7f5d999af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46d150 0x55d34c475f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:34530/0 (socket says 172.21.15.22:34530) 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.025+0000 7f5d999af640 1 -- 172.21.15.22:0/1516209386 learned_addr learned my addr 172.21.15.22:0/1516209386 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.025+0000 7f5d9a9b1640 1 --2- 172.21.15.22:0/1516209386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c46c830 0x55d34c478b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.025+0000 7f5d9a9b1640 1 --2- 172.21.15.22:0/1516209386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c4790e0 0x55d34c4766a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.026+0000 7f5d999af640 1 -- 172.21.15.22:0/1516209386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c46c830 msgr2=0x55d34c478b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.026+0000 7f5d999af640 1 --2- 172.21.15.22:0/1516209386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c46c830 0x55d34c478b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.026+0000 7f5d999af640 1 -- 172.21.15.22:0/1516209386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c4790e0 msgr2=0x55d34c4766a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.026+0000 7f5d999af640 1 --2- 172.21.15.22:0/1516209386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c4790e0 0x55d34c4766a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.026+0000 7f5d999af640 1 -- 172.21.15.22:0/1516209386 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d34c485160 con 0x55d34c46d150 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.026+0000 7f5d9a9b1640 1 --2- 172.21.15.22:0/1516209386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c46c830 0x55d34c478b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.026+0000 7f5d999af640 1 --2- 172.21.15.22:0/1516209386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46d150 0x55d34c475f60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5d84005940 tx=0x7f5d84009660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2e14cdc7f78d882 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.026+0000 7f5d7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.027+0000 7f5d7dffb640 1 -- 172.21.15.22:0/1516209386 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d84040070 con 0x55d34c46d150 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.027+0000 7f5d9e80d740 1 -- 172.21.15.22:0/1516209386 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d34c382100 con 0x55d34c46d150 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.027+0000 7f5d7dffb640 1 -- 172.21.15.22:0/1516209386 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f5d84004040 con 0x55d34c46d150 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.027+0000 7f5d7dffb640 1 -- 172.21.15.22:0/1516209386 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5d84035040 con 0x55d34c46d150 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.027+0000 7f5d9e80d740 10 client.25903 fetch_fsmap learned FSMap version 31 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.027+0000 7f5d9e80d740 1 -- 172.21.15.22:0/1516209386 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d34c487a30 con 0x55d34c46d150 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.028+0000 7f5d7dffb640 1 -- 172.21.15.22:0/1516209386 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d34c382100 con 0x55d34c46d150 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.028+0000 7f5d7dffb640 1 -- 172.21.15.22:0/1516209386 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f5d84004750 con 0x55d34c46d150 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.028+0000 7f5d9e80d740 10 client.25903 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.028+0000 7f5d9e80d740 10 client.25903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.028+0000 7f5d9e80d740 20 client.25903 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.028+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/1516209386 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d34c488eb0 0x55d34c48b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.028+0000 7f5d9e80d740 4 client.25903 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.028+0000 7f5d9e80d740 1 -- 172.21.15.22:0/1516209386 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d34c3e5830 con 0x55d34c488eb0 2024-08-20T01:36:58.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.028+0000 7f5d9a9b1640 1 --2- 172.21.15.22:0/1516209386 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d34c488eb0 0x55d34c48b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.030+0000 7f5d7dffb640 10 client.25903 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:58.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.030+0000 7f5d9a9b1640 1 --2- 172.21.15.22:0/1516209386 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d34c488eb0 0x55d34c48b2f0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=170133cdc3dbbccc server_cookie=ae404534c2009e9a in_seq=0 out_seq=0 2024-08-20T01:36:58.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.031+0000 7f5d7dffb640 1 -- 172.21.15.22:0/1516209386 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d34c3e5830 con 0x55d34c488eb0 2024-08-20T01:36:58.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.031+0000 7f5d7dffb640 10 client.25903 handle_command_reply: tid=0 2024-08-20T01:36:58.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.031+0000 7f5d9e80d740 1 client.25903 shutdown 2024-08-20T01:36:58.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.031+0000 7f5d9e80d740 1 -- 172.21.15.22:0/1516209386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46d150 msgr2=0x55d34c475f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:58.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.031+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/1516209386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46d150 0x55d34c475f60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5d84005940 tx=0x7f5d84009660 comp rx=0 tx=0).stop 2024-08-20T01:36:58.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.031+0000 7f5d9e80d740 1 -- 172.21.15.22:0/1516209386 shutdown_connections 2024-08-20T01:36:58.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.031+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/1516209386 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d34c488eb0 0x55d34c48b2f0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.031+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/1516209386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c4790e0 0x55d34c4766a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.031+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/1516209386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46d150 0x55d34c475f60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.031+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/1516209386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c46c830 0x55d34c478b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.031+0000 7f5d9e80d740 1 -- 172.21.15.22:0/1516209386 >> 172.21.15.22:0/1516209386 conn(0x55d34c46a660 msgr2=0x55d34c470200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:58.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.031+0000 7f5d7dffb640 0 client.25903 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:58.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.031+0000 7f5d9e80d740 1 -- 172.21.15.22:0/1516209386 shutdown_connections 2024-08-20T01:36:58.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.032+0000 7f5d9e80d740 1 -- 172.21.15.22:0/1516209386 wait complete. 2024-08-20T01:36:58.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.032+0000 7f5d9e80d740 20 client.25903 trim_cache size 0 max 16384 2024-08-20T01:36:58.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.058+0000 7f5d9e80d740 1 Processor -- start 2024-08-20T01:36:58.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.058+0000 7f5d9e80d740 1 -- start start 2024-08-20T01:36:58.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.058+0000 7f5d9e80d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46c830 0x55d34c4756c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.058+0000 7f5d9e80d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c46d150 0x55d34c475c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.058+0000 7f5d9e80d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c4790e0 0x55d34c490c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.058+0000 7f5d9e80d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5d941b2d40 con 0x55d34c4790e0 2024-08-20T01:36:58.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.058+0000 7f5d9e80d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d941b0550 con 0x55d34c46d150 2024-08-20T01:36:58.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.058+0000 7f5d9e80d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5d941ae3a0 con 0x55d34c46c830 2024-08-20T01:36:58.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.058+0000 7f5d999af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c46d150 0x55d34c475c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.058+0000 7f5d999af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c46d150 0x55d34c475c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:37144/0 (socket says 172.21.15.22:37144) 2024-08-20T01:36:58.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.058+0000 7f5d9a9b1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46c830 0x55d34c4756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.058+0000 7f5d999af640 1 -- 172.21.15.22:0/2244526273 learned_addr learned my addr 172.21.15.22:0/2244526273 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:58.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.058+0000 7f5d9a9b1640 1 --2- 172.21.15.22:0/2244526273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c4790e0 0x55d34c490c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.059+0000 7f5d999af640 1 -- 172.21.15.22:0/2244526273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46c830 msgr2=0x55d34c4756c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:58.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.059+0000 7f5d999af640 1 --2- 172.21.15.22:0/2244526273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46c830 0x55d34c4756c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.059+0000 7f5d999af640 1 -- 172.21.15.22:0/2244526273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c4790e0 msgr2=0x55d34c490c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:58.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.059+0000 7f5d999af640 1 --2- 172.21.15.22:0/2244526273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c4790e0 0x55d34c490c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.059+0000 7f5d999af640 1 -- 172.21.15.22:0/2244526273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d34c476a10 con 0x55d34c46d150 2024-08-20T01:36:58.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.059+0000 7f5d9a9b1640 1 --2- 172.21.15.22:0/2244526273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c4790e0 0x55d34c490c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:58.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.059+0000 7f5d999af640 1 --2- 172.21.15.22:0/2244526273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c46d150 0x55d34c475c00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5d840048e0 tx=0x7f5d840095f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ba234a23dd42589 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:58.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.059+0000 7f5d7ffff640 1 -- 172.21.15.22:0/2244526273 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d84040070 con 0x55d34c46d150 2024-08-20T01:36:58.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.059+0000 7f5d7ffff640 1 -- 172.21.15.22:0/2244526273 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d8404a030 con 0x55d34c46d150 2024-08-20T01:36:58.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.059+0000 7f5d7ffff640 1 -- 172.21.15.22:0/2244526273 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d84005430 con 0x55d34c46d150 2024-08-20T01:36:58.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.060+0000 7f5d9e80d740 1 -- 172.21.15.22:0/2244526273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c46d150 msgr2=0x55d34c475c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:58.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.060+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/2244526273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c46d150 0x55d34c475c00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5d840048e0 tx=0x7f5d840095f0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.060+0000 7f5d9e80d740 1 -- 172.21.15.22:0/2244526273 shutdown_connections 2024-08-20T01:36:58.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.060+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/2244526273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c4790e0 0x55d34c490c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.060+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/2244526273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c46d150 0x55d34c475c00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.060+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/2244526273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46c830 0x55d34c4756c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.060+0000 7f5d9e80d740 1 -- 172.21.15.22:0/2244526273 >> 172.21.15.22:0/2244526273 conn(0x55d34c46a660 msgr2=0x55d34c4711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:58.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.061+0000 7f5d9e80d740 1 -- 172.21.15.22:0/2244526273 shutdown_connections 2024-08-20T01:36:58.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.061+0000 7f5d9e80d740 1 -- 172.21.15.22:0/2244526273 wait complete. 2024-08-20T01:36:58.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.061+0000 7f5d9e80d740 1 -- start start 2024-08-20T01:36:58.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.061+0000 7f5d9e80d740 1 Processor -- start 2024-08-20T01:36:58.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.061+0000 7f5d9e80d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46c830 0x55d34c4810c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.061+0000 7f5d9e80d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c46d150 0x55d34c481600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.061+0000 7f5d9e80d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c4790e0 0x55d34c473190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.061+0000 7f5d9e80d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5d941aea10 con 0x55d34c46d150 2024-08-20T01:36:58.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.061+0000 7f5d9e80d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d941afe80 con 0x55d34c4790e0 2024-08-20T01:36:58.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.061+0000 7f5d9e80d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5d941af0e0 con 0x55d34c46c830 2024-08-20T01:36:58.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.061+0000 7f5d9e80d740 10 client.0 _ll_register_callbacks cb 0x7f5d84005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:58.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.062+0000 7f5d9a9b1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46c830 0x55d34c4810c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.062+0000 7f5d9a9b1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46c830 0x55d34c4810c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:34538/0 (socket says 172.21.15.22:34538) 2024-08-20T01:36:58.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.062+0000 7f5d9a9b1640 1 -- 172.21.15.22:0/850714596 learned_addr learned my addr 172.21.15.22:0/850714596 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:36:58.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.062+0000 7f5d9a9b1640 1 --2- 172.21.15.22:0/850714596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c4790e0 0x55d34c473190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.062+0000 7f5d999af640 1 --2- 172.21.15.22:0/850714596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c46d150 0x55d34c481600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.062+0000 7f5d9a9b1640 1 -- 172.21.15.22:0/850714596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c4790e0 msgr2=0x55d34c473190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:58.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.062+0000 7f5d9a9b1640 1 --2- 172.21.15.22:0/850714596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c4790e0 0x55d34c473190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.062+0000 7f5d9a9b1640 1 -- 172.21.15.22:0/850714596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c46d150 msgr2=0x55d34c481600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:58.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.062+0000 7f5d9a9b1640 1 --2- 172.21.15.22:0/850714596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c46d150 0x55d34c481600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.062+0000 7f5d9a9b1640 1 -- 172.21.15.22:0/850714596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d34c481cf0 con 0x55d34c46c830 2024-08-20T01:36:58.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.062+0000 7f5d999af640 1 --2- 172.21.15.22:0/850714596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c46d150 0x55d34c481600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:58.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.062+0000 7f5d9a9b1640 1 --2- 172.21.15.22:0/850714596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46c830 0x55d34c4810c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c005cc0 tx=0x7f5d8c014040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c838c446ecff4fa server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:58.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.063+0000 7f5d7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:36:58.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.063+0000 7f5d7dffb640 1 -- 172.21.15.22:0/850714596 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c012e60 con 0x55d34c46c830 2024-08-20T01:36:58.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.063+0000 7f5d7dffb640 1 -- 172.21.15.22:0/850714596 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f5d8c020040 con 0x55d34c46c830 2024-08-20T01:36:58.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.063+0000 7f5d9e80d740 1 -- 172.21.15.22:0/850714596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d8404a030 con 0x55d34c46c830 2024-08-20T01:36:58.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.064+0000 7f5d7dffb640 1 -- 172.21.15.22:0/850714596 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5d8c0049a0 con 0x55d34c46c830 2024-08-20T01:36:58.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.064+0000 7f5d9e80d740 10 client.25909 fetch_fsmap learned FSMap version 31 2024-08-20T01:36:58.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.064+0000 7f5d9e80d740 1 -- 172.21.15.22:0/850714596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d34c479af0 con 0x55d34c46c830 2024-08-20T01:36:58.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.064+0000 7f5d7dffb640 1 -- 172.21.15.22:0/850714596 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d8404a030 con 0x55d34c46c830 2024-08-20T01:36:58.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.064+0000 7f5d7dffb640 1 -- 172.21.15.22:0/850714596 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f5d8c00f040 con 0x55d34c46c830 2024-08-20T01:36:58.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.065+0000 7f5d9e80d740 10 client.25909 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:36:58.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.065+0000 7f5d9e80d740 10 client.25909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:36:58.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.065+0000 7f5d9e80d740 20 client.25909 populate_metadata read hostname 'smithi022' 2024-08-20T01:36:58.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.065+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/850714596 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d34c47a090 0x55d34c4f5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.065+0000 7f5d9e80d740 4 client.25909 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:36:58.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.065+0000 7f5d9e80d740 1 -- 172.21.15.22:0/850714596 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d34c3e12d0 con 0x55d34c47a090 2024-08-20T01:36:58.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.066+0000 7f5d999af640 1 --2- 172.21.15.22:0/850714596 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d34c47a090 0x55d34c4f5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.066+0000 7f5d7dffb640 10 client.25909 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:58.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.066+0000 7f5d999af640 1 --2- 172.21.15.22:0/850714596 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d34c47a090 0x55d34c4f5bf0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=273b8c334ff54b48 server_cookie=520a61fe0726a82c in_seq=0 out_seq=0 2024-08-20T01:36:58.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.067+0000 7f5d7dffb640 1 -- 172.21.15.22:0/850714596 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x55d34c3e12d0 con 0x55d34c47a090 2024-08-20T01:36:58.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.067+0000 7f5d7dffb640 10 client.25909 handle_command_reply: tid=0 2024-08-20T01:36:58.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.067+0000 7f5d9e80d740 1 client.25909 shutdown 2024-08-20T01:36:58.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.067+0000 7f5d9e80d740 1 -- 172.21.15.22:0/850714596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46c830 msgr2=0x55d34c4810c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:58.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.067+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/850714596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46c830 0x55d34c4810c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c005cc0 tx=0x7f5d8c014040 comp rx=0 tx=0).stop 2024-08-20T01:36:58.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.067+0000 7f5d9e80d740 1 -- 172.21.15.22:0/850714596 shutdown_connections 2024-08-20T01:36:58.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.067+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/850714596 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d34c47a090 0x55d34c4f5bf0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.067+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/850714596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d34c4790e0 0x55d34c473190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.067+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/850714596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d34c46d150 0x55d34c481600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.068+0000 7f5d9e80d740 1 --2- 172.21.15.22:0/850714596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d34c46c830 0x55d34c4810c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.068+0000 7f5d9e80d740 1 -- 172.21.15.22:0/850714596 >> 172.21.15.22:0/850714596 conn(0x55d34c46a660 msgr2=0x55d34c477590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:58.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.068+0000 7f5d7dffb640 0 client.25909 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:36:58.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.068+0000 7f5d9e80d740 1 -- 172.21.15.22:0/850714596 shutdown_connections 2024-08-20T01:36:58.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.068+0000 7f5d9e80d740 1 -- 172.21.15.22:0/850714596 wait complete. 2024-08-20T01:36:58.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.068+0000 7f5d9e80d740 20 client.25909 trim_cache size 0 max 16384 2024-08-20T01:36:58.073 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:36:58.073 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "scrub active (13025 inodes in the stack)", 2024-08-20T01:36:58.073 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-08-20T01:36:58.073 INFO:teuthology.orchestra.run.smithi022.stdout: "8ba209a7-349a-4db6-a36b-6592361cbf6f": { 2024-08-20T01:36:58.074 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-08-20T01:36:58.074 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "8ba209a7-349a-4db6-a36b-6592361cbf6f", 2024-08-20T01:36:58.074 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-08-20T01:36:58.074 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:36:58.074 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:36:58.074 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:36:58.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.069+0000 7f5d9c414640 1 -- 172.21.15.22:0/2764255918 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5d800b3cd0 msgr2=0x7f5d800b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:58.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.069+0000 7f5d9c414640 1 --2- 172.21.15.22:0/2764255918 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5d800b3cd0 0x7f5d800b6190 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5d900a75f0 tx=0x7f5d90010cb0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.069+0000 7f5d9c414640 1 -- 172.21.15.22:0/2764255918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d94101990 msgr2=0x7f5d9410ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:58.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.069+0000 7f5d9c414640 1 --2- 172.21.15.22:0/2764255918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d94101990 0x7f5d9410ed00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000d950 tx=0x7f5d9000de10 comp rx=0 tx=0).stop 2024-08-20T01:36:58.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.069+0000 7f5d9c414640 1 -- 172.21.15.22:0/2764255918 shutdown_connections 2024-08-20T01:36:58.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.069+0000 7f5d9c414640 1 --2- 172.21.15.22:0/2764255918 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5d800b3cd0 0x7f5d800b6190 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.069+0000 7f5d9c414640 1 --2- 172.21.15.22:0/2764255918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d94107d20 0x7f5d9410f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.069+0000 7f5d9c414640 1 --2- 172.21.15.22:0/2764255918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d941073a0 0x7f5d9410f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.069+0000 7f5d9c414640 1 --2- 172.21.15.22:0/2764255918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d94101990 0x7f5d9410ed00 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.069+0000 7f5d9c414640 1 -- 172.21.15.22:0/2764255918 >> 172.21.15.22:0/2764255918 conn(0x7f5d940fd400 msgr2=0x7f5d940ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:58.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.069+0000 7f5d9c414640 1 -- 172.21.15.22:0/2764255918 shutdown_connections 2024-08-20T01:36:58.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:36:58.070+0000 7f5d9c414640 1 -- 172.21.15.22:0/2764255918 wait complete. 2024-08-20T01:36:58.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:58 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:36:58.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:58 smithi134 ceph-mon[22511]: Scrub error on inode 0x10000002477 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53) see mds.i log and `damage ls` output for details 2024-08-20T01:36:58.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:58 smithi134 ceph-mon[22511]: Scrub error on inode 0x10000001b8d (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31) see mds.i log and `damage ls` output for details 2024-08-20T01:36:58.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:58 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:36:58.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:58 smithi077 ceph-mon[22251]: Scrub error on inode 0x10000002477 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53) see mds.i log and `damage ls` output for details 2024-08-20T01:36:58.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:58 smithi077 ceph-mon[22251]: Scrub error on inode 0x10000001b8d (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31) see mds.i log and `damage ls` output for details 2024-08-20T01:36:58.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:58 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:36:58.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:58 smithi022 ceph-mon[18709]: Scrub error on inode 0x10000002477 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53) see mds.i log and `damage ls` output for details 2024-08-20T01:36:58.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:58 smithi022 ceph-mon[18709]: Scrub error on inode 0x10000001b8d (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31) see mds.i log and `damage ls` output for details 2024-08-20T01:36:59.211 INFO:tasks.cephfs.filesystem:scrub status for tag:8ba209a7-349a-4db6-a36b-6592361cbf6f - {'path': '/', 'tag': '8ba209a7-349a-4db6-a36b-6592361cbf6f', 'options': 'recursive,force'} 2024-08-20T01:36:59.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:36:59 smithi022 ceph-mon[18709]: pgmap v521: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 11 MiB/s wr, 1.39k op/s 2024-08-20T01:36:59.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:36:59 smithi134 ceph-mon[22511]: pgmap v521: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 11 MiB/s wr, 1.39k op/s 2024-08-20T01:36:59.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:36:59 smithi077 ceph-mon[22251]: pgmap v521: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 11 MiB/s wr, 1.39k op/s 2024-08-20T01:37:00.046 INFO:tasks.workunit.client.0.smithi022.stdout: 532 401712 146 280764 225 161863 682 2024-08-20T01:37:01.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:01 smithi134 ceph-mon[22511]: pgmap v522: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.8 MiB/s wr, 1.69k op/s 2024-08-20T01:37:01.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:01 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:01.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:01 smithi077 ceph-mon[22251]: pgmap v522: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.8 MiB/s wr, 1.69k op/s 2024-08-20T01:37:01.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:01 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:01.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:01 smithi022 ceph-mon[18709]: pgmap v522: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.8 MiB/s wr, 1.69k op/s 2024-08-20T01:37:01.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:01 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:02.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:02 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:02.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:02 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:02.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:02 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:02.678 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-08-20T01:37:02.678 INFO:tasks.workunit.client.0.smithi022.stdout:Final score for writes: 532 2024-08-20T01:37:02.679 INFO:tasks.workunit.client.0.smithi022.stdout:Final score for reads : 790013 2024-08-20T01:37:02.679 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-08-20T01:37:02.679 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-20T01:37:02.679 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-20T01:37:03.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:03 smithi134 ceph-mon[22511]: pgmap v523: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.0 MiB/s wr, 2.85k op/s 2024-08-20T01:37:03.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:03 smithi077 ceph-mon[22251]: pgmap v523: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.0 MiB/s wr, 2.85k op/s 2024-08-20T01:37:03.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:03 smithi022 ceph-mon[18709]: pgmap v523: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.0 MiB/s wr, 2.85k op/s 2024-08-20T01:37:05.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:05 smithi134 ceph-mon[22511]: pgmap v524: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 3.6 MiB/s wr, 3.82k op/s 2024-08-20T01:37:05.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:05 smithi077 ceph-mon[22251]: pgmap v524: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 3.6 MiB/s wr, 3.82k op/s 2024-08-20T01:37:05.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:05 smithi022 ceph-mon[18709]: pgmap v524: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 3.6 MiB/s wr, 3.82k op/s 2024-08-20T01:37:06.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:06 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:06.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:06 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:06.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:06 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:07.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:07 smithi134 ceph-mon[22511]: pgmap v525: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 724 KiB/s wr, 3.52k op/s 2024-08-20T01:37:07.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:07 smithi077 ceph-mon[22251]: pgmap v525: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 724 KiB/s wr, 3.52k op/s 2024-08-20T01:37:07.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:07 smithi022 ceph-mon[18709]: pgmap v525: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 724 KiB/s wr, 3.52k op/s 2024-08-20T01:37:08.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.416+0000 7efe4cb93640 1 -- 172.21.15.22:0/54478851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe48103070 msgr2=0x7efe481099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:08.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.416+0000 7efe4cb93640 1 --2- 172.21.15.22:0/54478851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe48103070 0x7efe481099f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7efe40009cd0 tx=0x7efe4002a8e0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.417+0000 7efe4cb93640 1 -- 172.21.15.22:0/54478851 shutdown_connections 2024-08-20T01:37:08.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.417+0000 7efe4cb93640 1 --2- 172.21.15.22:0/54478851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe48103070 0x7efe481099f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.417+0000 7efe4cb93640 1 --2- 172.21.15.22:0/54478851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe481026b0 0x7efe48102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.417+0000 7efe4cb93640 1 --2- 172.21.15.22:0/54478851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe48101560 0x7efe48101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.417+0000 7efe4cb93640 1 -- 172.21.15.22:0/54478851 >> 172.21.15.22:0/54478851 conn(0x7efe480fce40 msgr2=0x7efe480ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:08.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.417+0000 7efe4cb93640 1 -- 172.21.15.22:0/54478851 shutdown_connections 2024-08-20T01:37:08.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.417+0000 7efe4cb93640 1 -- 172.21.15.22:0/54478851 wait complete. 2024-08-20T01:37:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.417+0000 7efe4cb93640 1 Processor -- start 2024-08-20T01:37:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.417+0000 7efe4cb93640 1 -- start start 2024-08-20T01:37:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe4cb93640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe48101560 0x7efe48198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe4cb93640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe481026b0 0x7efe48199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe4cb93640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe48103070 0x7efe48199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe4cb93640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efe4810d1b0 con 0x7efe48101560 2024-08-20T01:37:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe4cb93640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efe4810d030 con 0x7efe481026b0 2024-08-20T01:37:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe4cb93640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efe4810d330 con 0x7efe48103070 2024-08-20T01:37:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe4659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe48101560 0x7efe48198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe4659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe48101560 0x7efe48198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58864/0 (socket says 172.21.15.22:58864) 2024-08-20T01:37:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe4659c640 1 -- 172.21.15.22:0/540005306 learned_addr learned my addr 172.21.15.22:0/540005306 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe46d9d640 1 --2- 172.21.15.22:0/540005306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe48103070 0x7efe48199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe3ffff640 1 --2- 172.21.15.22:0/540005306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe481026b0 0x7efe48199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe4659c640 1 -- 172.21.15.22:0/540005306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe48103070 msgr2=0x7efe48199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe4659c640 1 --2- 172.21.15.22:0/540005306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe48103070 0x7efe48199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe4659c640 1 -- 172.21.15.22:0/540005306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe481026b0 msgr2=0x7efe48199080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe4659c640 1 --2- 172.21.15.22:0/540005306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe481026b0 0x7efe48199080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe4659c640 1 -- 172.21.15.22:0/540005306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4819a570 con 0x7efe48101560 2024-08-20T01:37:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe3ffff640 1 --2- 172.21.15.22:0/540005306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe481026b0 0x7efe48199080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe4659c640 1 --2- 172.21.15.22:0/540005306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe48101560 0x7efe48198a30 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7efe3800d950 tx=0x7efe3800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe3f7fe640 1 -- 172.21.15.22:0/540005306 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe38017070 con 0x7efe48101560 2024-08-20T01:37:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe3f7fe640 1 -- 172.21.15.22:0/540005306 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe38009c30 con 0x7efe48101560 2024-08-20T01:37:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe4cb93640 1 -- 172.21.15.22:0/540005306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe4819a860 con 0x7efe48101560 2024-08-20T01:37:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.418+0000 7efe3f7fe640 1 -- 172.21.15.22:0/540005306 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3800f620 con 0x7efe48101560 2024-08-20T01:37:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.419+0000 7efe4cb93640 1 -- 172.21.15.22:0/540005306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe481a0f30 con 0x7efe48101560 2024-08-20T01:37:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.421+0000 7efe4fa5f740 1 Processor -- start 2024-08-20T01:37:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.421+0000 7efe3f7fe640 1 -- 172.21.15.22:0/540005306 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7efe38010460 con 0x7efe48101560 2024-08-20T01:37:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.421+0000 7efe4fa5f740 1 -- start start 2024-08-20T01:37:08.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.421+0000 7efe4fa5f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f421176ce0 0x55f4211790d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:08.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.421+0000 7efe4fa5f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f421179610 0x55f42117ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:08.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.421+0000 7efe4fa5f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42117c050 0x55f42117e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:08.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.421+0000 7efe4fa5f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f4210e5360 con 0x55f421176ce0 2024-08-20T01:37:08.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.421+0000 7efe4fa5f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f4210d4860 con 0x55f421179610 2024-08-20T01:37:08.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.421+0000 7efe4fa5f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f4210d88a0 con 0x55f42117c050 2024-08-20T01:37:08.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.421+0000 7efe46d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f421176ce0 0x55f4211790d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:08.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.421+0000 7efe3ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42117c050 0x55f42117e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:08.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.421+0000 7efe46d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f421176ce0 0x55f4211790d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58868/0 (socket says 172.21.15.22:58868) 2024-08-20T01:37:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.421+0000 7efe3ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42117c050 0x55f42117e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:55536/0 (socket says 172.21.15.22:55536) 2024-08-20T01:37:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.422+0000 7efe46d9d640 1 -- 172.21.15.22:0/2045685156 learned_addr learned my addr 172.21.15.22:0/2045685156 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.422+0000 7efe4659c640 1 --2- 172.21.15.22:0/2045685156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f421179610 0x55f42117ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.422+0000 7efe46d9d640 1 -- 172.21.15.22:0/2045685156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42117c050 msgr2=0x55f42117e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.422+0000 7efe46d9d640 1 --2- 172.21.15.22:0/2045685156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42117c050 0x55f42117e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.422+0000 7efe46d9d640 1 -- 172.21.15.22:0/2045685156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f421179610 msgr2=0x55f42117ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.422+0000 7efe46d9d640 1 --2- 172.21.15.22:0/2045685156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f421179610 0x55f42117ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.422+0000 7efe46d9d640 1 -- 172.21.15.22:0/2045685156 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f42107be40 con 0x55f421176ce0 2024-08-20T01:37:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.422+0000 7efe4659c640 1 --2- 172.21.15.22:0/2045685156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f421179610 0x55f42117ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.422+0000 7efe3f7fe640 1 --2- 172.21.15.22:0/540005306 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efe340b3c50 0x7efe340b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.422+0000 7efe4659c640 1 --2- 172.21.15.22:0/540005306 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efe340b3c50 0x7efe340b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.422+0000 7efe46d9d640 1 --2- 172.21.15.22:0/2045685156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f421176ce0 0x55f4211790d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7efe4002ae00 tx=0x7efe40009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0e5b20a8cab89f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.422+0000 7efe3f7fe640 1 -- 172.21.15.22:0/540005306 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7efe380e3860 con 0x7efe48101560 2024-08-20T01:37:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.422+0000 7efe3cff9640 1 -- 172.21.15.22:0/2045685156 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe400314f0 con 0x55f421176ce0 2024-08-20T01:37:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.422+0000 7efe3cff9640 1 -- 172.21.15.22:0/2045685156 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe40036040 con 0x55f421176ce0 2024-08-20T01:37:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.422+0000 7efe3cff9640 1 -- 172.21.15.22:0/2045685156 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe40004280 con 0x55f421176ce0 2024-08-20T01:37:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.423+0000 7efe4fa5f740 1 -- 172.21.15.22:0/2045685156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f421176ce0 msgr2=0x55f4211790d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.423+0000 7efe4659c640 1 --2- 172.21.15.22:0/540005306 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efe340b3c50 0x7efe340b6110 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efe38000c00 tx=0x7efe38010cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.423+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/2045685156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f421176ce0 0x55f4211790d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7efe4002ae00 tx=0x7efe40009a20 comp rx=0 tx=0).stop 2024-08-20T01:37:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.423+0000 7efe4fa5f740 1 -- 172.21.15.22:0/2045685156 shutdown_connections 2024-08-20T01:37:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.423+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/2045685156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42117c050 0x55f42117e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.423+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/2045685156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f421179610 0x55f42117ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.423+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/2045685156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f421176ce0 0x55f4211790d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.423+0000 7efe4fa5f740 1 -- 172.21.15.22:0/2045685156 >> 172.21.15.22:0/2045685156 conn(0x55f42116da20 msgr2=0x55f42116e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.423+0000 7efe4fa5f740 1 -- 172.21.15.22:0/2045685156 shutdown_connections 2024-08-20T01:37:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.423+0000 7efe4fa5f740 1 -- 172.21.15.22:0/2045685156 wait complete. 2024-08-20T01:37:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.423+0000 7efe4fa5f740 1 -- start start 2024-08-20T01:37:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.424+0000 7efe4fa5f740 1 Processor -- start 2024-08-20T01:37:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.424+0000 7efe4fa5f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f421176ce0 0x55f4211803e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.424+0000 7efe4fa5f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f421179610 0x55f421180a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.424+0000 7efe4fa5f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f42117c050 0x55f421181650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.424+0000 7efe4fa5f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f42100dab0 con 0x55f421176ce0 2024-08-20T01:37:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.424+0000 7efe4fa5f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f42105b780 con 0x55f42117c050 2024-08-20T01:37:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.424+0000 7efe4fa5f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f42117ef70 con 0x55f421179610 2024-08-20T01:37:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.424+0000 7efe4fa5f740 10 client.0 _ll_register_callbacks cb 0x55f420de3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.424+0000 7efe46d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f421176ce0 0x55f4211803e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.424+0000 7efe46d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f421176ce0 0x55f4211803e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58870/0 (socket says 172.21.15.22:58870) 2024-08-20T01:37:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.424+0000 7efe46d9d640 1 -- 172.21.15.22:0/2452771736 learned_addr learned my addr 172.21.15.22:0/2452771736 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.424+0000 7efe3ffff640 1 --2- 172.21.15.22:0/2452771736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f421179610 0x55f421180a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.424+0000 7efe46d9d640 1 --2- 172.21.15.22:0/2452771736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f42117c050 0x55f421181650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:08.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.424+0000 7efe46d9d640 1 -- 172.21.15.22:0/2452771736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f421179610 msgr2=0x55f421180a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:08.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.424+0000 7efe46d9d640 1 --2- 172.21.15.22:0/2452771736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f421179610 0x55f421180a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.424+0000 7efe46d9d640 1 -- 172.21.15.22:0/2452771736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f42117c050 msgr2=0x55f421181650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:08.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.424+0000 7efe46d9d640 1 --2- 172.21.15.22:0/2452771736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f42117c050 0x55f421181650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.424+0000 7efe46d9d640 1 -- 172.21.15.22:0/2452771736 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f420e37790 con 0x55f421176ce0 2024-08-20T01:37:08.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.424+0000 7efe3ffff640 1 --2- 172.21.15.22:0/2452771736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f421179610 0x55f421180a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:08.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.425+0000 7efe2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:37:08.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.425+0000 7efe46d9d640 1 --2- 172.21.15.22:0/2452771736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f421176ce0 0x55f4211803e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7efe40009bf0 tx=0x7efe40009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbcbbf998bf4c349 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:08.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.425+0000 7efe2dffb640 1 -- 172.21.15.22:0/2452771736 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe40055060 con 0x55f421176ce0 2024-08-20T01:37:08.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.425+0000 7efe2dffb640 1 -- 172.21.15.22:0/2452771736 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7efe40041040 con 0x55f421176ce0 2024-08-20T01:37:08.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.425+0000 7efe4fa5f740 1 -- 172.21.15.22:0/2452771736 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f421083e00 con 0x55f421176ce0 2024-08-20T01:37:08.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.425+0000 7efe2dffb640 1 -- 172.21.15.22:0/2452771736 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7efe40004210 con 0x55f421176ce0 2024-08-20T01:37:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.427+0000 7efe4fa5f740 10 client.16260 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.427+0000 7efe4fa5f740 1 -- 172.21.15.22:0/2452771736 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f420eb0620 con 0x55f421176ce0 2024-08-20T01:37:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.427+0000 7efe2dffb640 1 -- 172.21.15.22:0/2452771736 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f421083e00 con 0x55f421176ce0 2024-08-20T01:37:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.427+0000 7efe2dffb640 1 -- 172.21.15.22:0/2452771736 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7efe40030070 con 0x55f421176ce0 2024-08-20T01:37:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.427+0000 7efe4fa5f740 10 client.16260 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.427+0000 7efe4fa5f740 10 client.16260 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:37:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.427+0000 7efe4fa5f740 20 client.16260 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.427+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/2452771736 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55f42118b880 0x55f42118dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.427+0000 7efe4fa5f740 4 client.16260 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.427+0000 7efe4fa5f740 1 -- 172.21.15.22:0/2452771736 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4210e72b0 con 0x55f42118b880 2024-08-20T01:37:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.428+0000 7efe3ffff640 1 --2- 172.21.15.22:0/2452771736 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55f42118b880 0x55f42118dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:08.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.429+0000 7efe2dffb640 10 client.16260 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:08.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.429+0000 7efe3ffff640 1 --2- 172.21.15.22:0/2452771736 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55f42118b880 0x55f42118dc70 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a8f01505b03f642 server_cookie=10a29521014f5141 in_seq=0 out_seq=0 2024-08-20T01:37:08.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.430+0000 7efe2dffb640 1 -- 172.21.15.22:0/2452771736 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f4210e72b0 con 0x55f42118b880 2024-08-20T01:37:08.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.430+0000 7efe2dffb640 10 client.16260 handle_command_reply: tid=0 2024-08-20T01:37:08.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.430+0000 7efe4fa5f740 1 client.16260 shutdown 2024-08-20T01:37:08.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.430+0000 7efe4fa5f740 1 -- 172.21.15.22:0/2452771736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f421176ce0 msgr2=0x55f4211803e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:08.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.430+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/2452771736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f421176ce0 0x55f4211803e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7efe40009bf0 tx=0x7efe40009860 comp rx=0 tx=0).stop 2024-08-20T01:37:08.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.430+0000 7efe4fa5f740 1 -- 172.21.15.22:0/2452771736 shutdown_connections 2024-08-20T01:37:08.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.430+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/2452771736 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55f42118b880 0x55f42118dc70 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.430+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/2452771736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f42117c050 0x55f421181650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.430+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/2452771736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f421179610 0x55f421180a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.430+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/2452771736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f421176ce0 0x55f4211803e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.430+0000 7efe4fa5f740 1 -- 172.21.15.22:0/2452771736 >> 172.21.15.22:0/2452771736 conn(0x55f42116da20 msgr2=0x55f42116cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:08.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.430+0000 7efe2dffb640 0 client.16260 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:08.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.431+0000 7efe4fa5f740 1 -- 172.21.15.22:0/2452771736 shutdown_connections 2024-08-20T01:37:08.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.431+0000 7efe4fa5f740 1 -- 172.21.15.22:0/2452771736 wait complete. 2024-08-20T01:37:08.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.431+0000 7efe4fa5f740 20 client.16260 trim_cache size 0 max 16384 2024-08-20T01:37:08.459 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.457+0000 7efe4fa5f740 1 Processor -- start 2024-08-20T01:37:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.457+0000 7efe4fa5f740 1 -- start start 2024-08-20T01:37:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.457+0000 7efe4fa5f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f421176ce0 0x55f42117c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.457+0000 7efe4fa5f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f421179610 0x55f42117c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.457+0000 7efe4fa5f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42117c050 0x55f42117ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.457+0000 7efe4fa5f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efe481aa390 con 0x55f421179610 2024-08-20T01:37:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.457+0000 7efe4fa5f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efe481a7ba0 con 0x55f421176ce0 2024-08-20T01:37:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.457+0000 7efe4fa5f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efe481a59f0 con 0x55f42117c050 2024-08-20T01:37:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.457+0000 7efe3ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f421179610 0x55f42117c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.457+0000 7efe46d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42117c050 0x55f42117ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.457+0000 7efe46d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42117c050 0x55f42117ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:55546/0 (socket says 172.21.15.22:55546) 2024-08-20T01:37:08.461 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.457+0000 7efe46d9d640 1 -- 172.21.15.22:0/3402333547 learned_addr learned my addr 172.21.15.22:0/3402333547 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.457+0000 7efe46d9d640 1 --2- 172.21.15.22:0/3402333547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f421176ce0 0x55f42117c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.458+0000 7efe46d9d640 1 -- 172.21.15.22:0/3402333547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f421176ce0 msgr2=0x55f42117c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.458+0000 7efe46d9d640 1 --2- 172.21.15.22:0/3402333547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f421176ce0 0x55f42117c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.458+0000 7efe46d9d640 1 -- 172.21.15.22:0/3402333547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f421179610 msgr2=0x55f42117c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.458+0000 7efe46d9d640 1 --2- 172.21.15.22:0/3402333547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f421179610 0x55f42117c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.458+0000 7efe46d9d640 1 -- 172.21.15.22:0/3402333547 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f42117bd70 con 0x55f42117c050 2024-08-20T01:37:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.458+0000 7efe46d9d640 1 --2- 172.21.15.22:0/3402333547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42117c050 0x55f42117ceb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efe40030360 tx=0x7efe400305a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cae4ca2439963b03 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.458+0000 7efe2ffff640 1 -- 172.21.15.22:0/3402333547 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe40055070 con 0x55f42117c050 2024-08-20T01:37:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.459+0000 7efe2ffff640 1 -- 172.21.15.22:0/3402333547 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe40036070 con 0x55f42117c050 2024-08-20T01:37:08.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.459+0000 7efe2ffff640 1 -- 172.21.15.22:0/3402333547 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe400444e0 con 0x55f42117c050 2024-08-20T01:37:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.460+0000 7efe4fa5f740 1 -- 172.21.15.22:0/3402333547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42117c050 msgr2=0x55f42117ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.460+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/3402333547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42117c050 0x55f42117ceb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efe40030360 tx=0x7efe400305a0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.461+0000 7efe4fa5f740 1 -- 172.21.15.22:0/3402333547 shutdown_connections 2024-08-20T01:37:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.461+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/3402333547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42117c050 0x55f42117ceb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.461+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/3402333547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f421179610 0x55f42117c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.461+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/3402333547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f421176ce0 0x55f42117c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.461+0000 7efe4fa5f740 1 -- 172.21.15.22:0/3402333547 >> 172.21.15.22:0/3402333547 conn(0x55f42116da20 msgr2=0x55f42117da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.461+0000 7efe4fa5f740 1 -- 172.21.15.22:0/3402333547 shutdown_connections 2024-08-20T01:37:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.462+0000 7efe4fa5f740 1 -- 172.21.15.22:0/3402333547 wait complete. 2024-08-20T01:37:08.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.462+0000 7efe4fa5f740 1 -- start start 2024-08-20T01:37:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.462+0000 7efe4fa5f740 1 Processor -- start 2024-08-20T01:37:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.462+0000 7efe4fa5f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f421176ce0 0x55f421184f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.462+0000 7efe4fa5f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f421179610 0x55f421185620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.462+0000 7efe4fa5f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f42117c050 0x55f421185fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.462+0000 7efe4fa5f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efe481a6060 con 0x55f42117c050 2024-08-20T01:37:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.462+0000 7efe4fa5f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efe481a74d0 con 0x55f421179610 2024-08-20T01:37:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.462+0000 7efe4fa5f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efe481a6730 con 0x55f421176ce0 2024-08-20T01:37:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.463+0000 7efe4fa5f740 10 client.0 _ll_register_callbacks cb 0x7efe300095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.463+0000 7efe46d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f421176ce0 0x55f421184f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.463+0000 7efe46d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f421176ce0 0x55f421184f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:55550/0 (socket says 172.21.15.22:55550) 2024-08-20T01:37:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.463+0000 7efe46d9d640 1 -- 172.21.15.22:0/1946092791 learned_addr learned my addr 172.21.15.22:0/1946092791 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.463+0000 7efe46d9d640 1 --2- 172.21.15.22:0/1946092791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f42117c050 0x55f421185fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.463+0000 7efe3ffff640 1 --2- 172.21.15.22:0/1946092791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f421179610 0x55f421185620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.463+0000 7efe46d9d640 1 -- 172.21.15.22:0/1946092791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f421176ce0 msgr2=0x55f421184f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.463+0000 7efe46d9d640 1 --2- 172.21.15.22:0/1946092791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f421176ce0 0x55f421184f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.463+0000 7efe46d9d640 1 -- 172.21.15.22:0/1946092791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f421179610 msgr2=0x55f421185620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.463+0000 7efe46d9d640 1 --2- 172.21.15.22:0/1946092791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f421179610 0x55f421185620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.463+0000 7efe46d9d640 1 -- 172.21.15.22:0/1946092791 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4211867d0 con 0x55f42117c050 2024-08-20T01:37:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.463+0000 7efe46d9d640 1 --2- 172.21.15.22:0/1946092791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f42117c050 0x55f421185fa0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7efe40002230 tx=0x7efe40031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbca0d112d1c135 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.463+0000 7efe2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:37:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.464+0000 7efe2dffb640 1 -- 172.21.15.22:0/1946092791 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4005f070 con 0x55f42117c050 2024-08-20T01:37:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.464+0000 7efe2dffb640 1 -- 172.21.15.22:0/1946092791 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7efe400047c0 con 0x55f42117c050 2024-08-20T01:37:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.464+0000 7efe4fa5f740 1 -- 172.21.15.22:0/1946092791 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe40036070 con 0x55f42117c050 2024-08-20T01:37:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.464+0000 7efe2dffb640 1 -- 172.21.15.22:0/1946092791 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7efe40055040 con 0x55f42117c050 2024-08-20T01:37:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.464+0000 7efe4fa5f740 10 client.16266 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.464+0000 7efe4fa5f740 1 -- 172.21.15.22:0/1946092791 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f421187b40 con 0x55f42117c050 2024-08-20T01:37:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.464+0000 7efe2dffb640 1 -- 172.21.15.22:0/1946092791 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe40036070 con 0x55f42117c050 2024-08-20T01:37:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.465+0000 7efe2dffb640 1 -- 172.21.15.22:0/1946092791 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7efe4006f080 con 0x55f42117c050 2024-08-20T01:37:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.465+0000 7efe4fa5f740 10 client.16266 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.465+0000 7efe4fa5f740 10 client.16266 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:37:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.465+0000 7efe4fa5f740 20 client.16266 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.465+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/1946092791 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55f4211f6530 0x55f4211f8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.465+0000 7efe4fa5f740 4 client.16266 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:37:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.465+0000 7efe4fa5f740 1 -- 172.21.15.22:0/1946092791 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f4210e2d50 con 0x55f4211f6530 2024-08-20T01:37:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.465+0000 7efe3ffff640 1 --2- 172.21.15.22:0/1946092791 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55f4211f6530 0x55f4211f8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.468+0000 7efe3ffff640 1 --2- 172.21.15.22:0/1946092791 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55f4211f6530 0x55f4211f8920 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3854c36ba8b444c server_cookie=d873a261bd89083 in_seq=0 out_seq=0 2024-08-20T01:37:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.468+0000 7efe2dffb640 10 client.16266 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.996+0000 7efe2dffb640 1 -- 172.21.15.22:0/1946092791 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f4210e2d50 con 0x55f4211f6530 2024-08-20T01:37:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.996+0000 7efe2dffb640 10 client.16266 handle_command_reply: tid=0 2024-08-20T01:37:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.996+0000 7efe4fa5f740 1 client.16266 shutdown 2024-08-20T01:37:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.996+0000 7efe4fa5f740 1 -- 172.21.15.22:0/1946092791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f42117c050 msgr2=0x55f421185fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.996+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/1946092791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f42117c050 0x55f421185fa0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7efe40002230 tx=0x7efe40031660 comp rx=0 tx=0).stop 2024-08-20T01:37:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.996+0000 7efe4fa5f740 1 -- 172.21.15.22:0/1946092791 shutdown_connections 2024-08-20T01:37:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.996+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/1946092791 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55f4211f6530 0x55f4211f8920 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.996+0000 7efe2dffb640 0 client.16266 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.996+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/1946092791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f42117c050 0x55f421185fa0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.996+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/1946092791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f421179610 0x55f421185620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.996+0000 7efe4fa5f740 1 --2- 172.21.15.22:0/1946092791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f421176ce0 0x55f421184f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.996+0000 7efe4fa5f740 1 -- 172.21.15.22:0/1946092791 >> 172.21.15.22:0/1946092791 conn(0x55f42116da20 msgr2=0x55f42116c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.996+0000 7efe4fa5f740 1 -- 172.21.15.22:0/1946092791 shutdown_connections 2024-08-20T01:37:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.996+0000 7efe4fa5f740 1 -- 172.21.15.22:0/1946092791 wait complete. 2024-08-20T01:37:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.997+0000 7efe4fa5f740 20 client.16266 trim_cache size 0 max 16384 2024-08-20T01:37:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:37:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:37:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:37:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:37:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.997+0000 7efe4cb93640 1 -- 172.21.15.22:0/540005306 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efe340b3c50 msgr2=0x7efe340b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.997+0000 7efe4cb93640 1 --2- 172.21.15.22:0/540005306 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efe340b3c50 0x7efe340b6110 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efe38000c00 tx=0x7efe38010cb0 comp rx=0 tx=0).stop 2024-08-20T01:37:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.997+0000 7efe4cb93640 1 -- 172.21.15.22:0/540005306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe48101560 msgr2=0x7efe48198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.997+0000 7efe4cb93640 1 --2- 172.21.15.22:0/540005306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe48101560 0x7efe48198a30 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7efe3800d950 tx=0x7efe3800de10 comp rx=0 tx=0).stop 2024-08-20T01:37:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.997+0000 7efe4cb93640 1 -- 172.21.15.22:0/540005306 shutdown_connections 2024-08-20T01:37:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.997+0000 7efe4cb93640 1 --2- 172.21.15.22:0/540005306 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efe340b3c50 0x7efe340b6110 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.997+0000 7efe4cb93640 1 --2- 172.21.15.22:0/540005306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe48103070 0x7efe48199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.997+0000 7efe4cb93640 1 --2- 172.21.15.22:0/540005306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe481026b0 0x7efe48199080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.997+0000 7efe4cb93640 1 --2- 172.21.15.22:0/540005306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe48101560 0x7efe48198a30 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.997+0000 7efe4cb93640 1 -- 172.21.15.22:0/540005306 >> 172.21.15.22:0/540005306 conn(0x7efe480fce40 msgr2=0x7efe480fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.997+0000 7efe4cb93640 1 -- 172.21.15.22:0/540005306 shutdown_connections 2024-08-20T01:37:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:08.997+0000 7efe4cb93640 1 -- 172.21.15.22:0/540005306 wait complete. 2024-08-20T01:37:09.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:09 smithi134 ceph-mon[22511]: pgmap v526: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 928 KiB/s wr, 4.00k op/s 2024-08-20T01:37:09.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:09 smithi077 ceph-mon[22251]: pgmap v526: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 928 KiB/s wr, 4.00k op/s 2024-08-20T01:37:09.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:09 smithi022 ceph-mon[18709]: pgmap v526: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 928 KiB/s wr, 4.00k op/s 2024-08-20T01:37:11.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:11 smithi134 ceph-mon[22511]: pgmap v527: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 676 KiB/s wr, 4.00k op/s 2024-08-20T01:37:11.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:11 smithi077 ceph-mon[22251]: pgmap v527: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 676 KiB/s wr, 4.00k op/s 2024-08-20T01:37:11.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:11 smithi022 ceph-mon[18709]: pgmap v527: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 676 KiB/s wr, 4.00k op/s 2024-08-20T01:37:13.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:13 smithi134 ceph-mon[22511]: pgmap v528: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.5 MiB/s wr, 3.66k op/s 2024-08-20T01:37:13.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:13 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:37:13.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:13 smithi077 ceph-mon[22251]: pgmap v528: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.5 MiB/s wr, 3.66k op/s 2024-08-20T01:37:13.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:13 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:37:13.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:13 smithi022 ceph-mon[18709]: pgmap v528: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.5 MiB/s wr, 3.66k op/s 2024-08-20T01:37:13.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:13 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:37:14.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:14 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:37:14.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:14 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:37:14.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:14 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:37:14.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:14 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:37:14.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:14 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:37:14.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:14 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:37:15.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:15 smithi134 ceph-mon[22511]: pgmap v529: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 2.63k op/s 2024-08-20T01:37:15.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:15 smithi077 ceph-mon[22251]: pgmap v529: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 2.63k op/s 2024-08-20T01:37:15.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:15 smithi022 ceph-mon[18709]: pgmap v529: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 2.63k op/s 2024-08-20T01:37:17.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:17 smithi134 ceph-mon[22511]: pgmap v530: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 1.40k op/s 2024-08-20T01:37:17.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:17 smithi077 ceph-mon[22251]: pgmap v530: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 1.40k op/s 2024-08-20T01:37:17.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:17 smithi022 ceph-mon[18709]: pgmap v530: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 1.40k op/s 2024-08-20T01:37:19.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:19 smithi134 ceph-mon[22511]: pgmap v531: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 1.42k op/s 2024-08-20T01:37:19.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:19 smithi077 ceph-mon[22251]: pgmap v531: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 1.42k op/s 2024-08-20T01:37:19.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:19 smithi022 ceph-mon[18709]: pgmap v531: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 1.42k op/s 2024-08-20T01:37:21.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:21 smithi134 ceph-mon[22511]: pgmap v532: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 930 op/s 2024-08-20T01:37:21.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:21 smithi077 ceph-mon[22251]: pgmap v532: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 930 op/s 2024-08-20T01:37:21.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:21 smithi022 ceph-mon[18709]: pgmap v532: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 930 op/s 2024-08-20T01:37:22.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.092+0000 7f6e4906e640 1 -- 172.21.15.22:0/2985777813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e44101560 msgr2=0x7f6e44101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:22.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.092+0000 7f6e4906e640 1 --2- 172.21.15.22:0/2985777813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e44101560 0x7f6e44101960 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009930 tx=0x7f6e3402a420 comp rx=0 tx=0).stop 2024-08-20T01:37:22.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.092+0000 7f6e4906e640 1 -- 172.21.15.22:0/2985777813 shutdown_connections 2024-08-20T01:37:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.092+0000 7f6e4906e640 1 --2- 172.21.15.22:0/2985777813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e44103070 0x7f6e441099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.092+0000 7f6e4906e640 1 --2- 172.21.15.22:0/2985777813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e441026b0 0x7f6e44102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.092+0000 7f6e4906e640 1 --2- 172.21.15.22:0/2985777813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e44101560 0x7f6e44101960 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.092+0000 7f6e4906e640 1 -- 172.21.15.22:0/2985777813 >> 172.21.15.22:0/2985777813 conn(0x7f6e440fce40 msgr2=0x7f6e440ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.092+0000 7f6e4906e640 1 -- 172.21.15.22:0/2985777813 shutdown_connections 2024-08-20T01:37:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.092+0000 7f6e4906e640 1 -- 172.21.15.22:0/2985777813 wait complete. 2024-08-20T01:37:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.093+0000 7f6e4906e640 1 Processor -- start 2024-08-20T01:37:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.093+0000 7f6e4906e640 1 -- start start 2024-08-20T01:37:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.093+0000 7f6e4906e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e44101560 0x7f6e4406ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.093+0000 7f6e4906e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e441026b0 0x7f6e4419d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.093+0000 7f6e4906e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e44103070 0x7f6e4419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.093+0000 7f6e4906e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4410d1e0 con 0x7f6e44101560 2024-08-20T01:37:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.093+0000 7f6e4906e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4410d060 con 0x7f6e44103070 2024-08-20T01:37:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.093+0000 7f6e4906e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4410d360 con 0x7f6e441026b0 2024-08-20T01:37:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.094+0000 7f6e42d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e44101560 0x7f6e4406ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.094+0000 7f6e42d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e44101560 0x7f6e4406ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33324/0 (socket says 172.21.15.22:33324) 2024-08-20T01:37:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.094+0000 7f6e42d9d640 1 -- 172.21.15.22:0/1849015070 learned_addr learned my addr 172.21.15.22:0/1849015070 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.094+0000 7f6e3bfff640 1 --2- 172.21.15.22:0/1849015070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e441026b0 0x7f6e4419d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.094+0000 7f6e4359e640 1 --2- 172.21.15.22:0/1849015070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e44103070 0x7f6e4419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.094+0000 7f6e42d9d640 1 -- 172.21.15.22:0/1849015070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e441026b0 msgr2=0x7f6e4419d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.094+0000 7f6e42d9d640 1 --2- 172.21.15.22:0/1849015070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e441026b0 0x7f6e4419d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.094+0000 7f6e42d9d640 1 -- 172.21.15.22:0/1849015070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e44103070 msgr2=0x7f6e4419fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.094+0000 7f6e42d9d640 1 --2- 172.21.15.22:0/1849015070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e44103070 0x7f6e4419fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.094+0000 7f6e42d9d640 1 -- 172.21.15.22:0/1849015070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e441a0630 con 0x7f6e44101560 2024-08-20T01:37:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.094+0000 7f6e42d9d640 1 --2- 172.21.15.22:0/1849015070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e44101560 0x7f6e4406ae80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009a50 tx=0x7f6e340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.094+0000 7f6e40d99640 1 -- 172.21.15.22:0/1849015070 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3403f030 con 0x7f6e44101560 2024-08-20T01:37:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.094+0000 7f6e40d99640 1 -- 172.21.15.22:0/1849015070 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e34003cb0 con 0x7f6e44101560 2024-08-20T01:37:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.094+0000 7f6e4906e640 1 -- 172.21.15.22:0/1849015070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e441a08c0 con 0x7f6e44101560 2024-08-20T01:37:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.094+0000 7f6e40d99640 1 -- 172.21.15.22:0/1849015070 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34035070 con 0x7f6e44101560 2024-08-20T01:37:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.094+0000 7f6e4906e640 1 -- 172.21.15.22:0/1849015070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e441a0e00 con 0x7f6e44101560 2024-08-20T01:37:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.097+0000 7f6e4be65740 1 Processor -- start 2024-08-20T01:37:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.097+0000 7f6e4be65740 1 -- start start 2024-08-20T01:37:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.097+0000 7f6e4be65740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b81d8d0 0x55fa8b81fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.097+0000 7f6e4be65740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b820200 0x55fa8b8225f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.097+0000 7f6e4be65740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b822c40 0x55fa8b825100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.097+0000 7f6e4be65740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fa8b790360 con 0x55fa8b81d8d0 2024-08-20T01:37:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.097+0000 7f6e4be65740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fa8b77f860 con 0x55fa8b822c40 2024-08-20T01:37:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.097+0000 7f6e4be65740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fa8b7838a0 con 0x55fa8b820200 2024-08-20T01:37:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.097+0000 7f6e4359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b81d8d0 0x55fa8b81fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.097+0000 7f6e4359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b81d8d0 0x55fa8b81fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33334/0 (socket says 172.21.15.22:33334) 2024-08-20T01:37:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.097+0000 7f6e4359e640 1 -- 172.21.15.22:0/4064155629 learned_addr learned my addr 172.21.15.22:0/4064155629 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.097+0000 7f6e40d99640 1 -- 172.21.15.22:0/1849015070 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6e34042030 con 0x7f6e44101560 2024-08-20T01:37:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.097+0000 7f6e3bfff640 1 --2- 172.21.15.22:0/4064155629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b822c40 0x55fa8b825100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.098+0000 7f6e4359e640 1 -- 172.21.15.22:0/4064155629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b820200 msgr2=0x55fa8b8225f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.098+0000 7f6e4359e640 1 --2- 172.21.15.22:0/4064155629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b820200 0x55fa8b8225f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.098+0000 7f6e4359e640 1 -- 172.21.15.22:0/4064155629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b822c40 msgr2=0x55fa8b825100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.098+0000 7f6e4359e640 1 --2- 172.21.15.22:0/4064155629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b822c40 0x55fa8b825100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.098+0000 7f6e4359e640 1 -- 172.21.15.22:0/4064155629 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa8b726e40 con 0x55fa8b81d8d0 2024-08-20T01:37:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.098+0000 7f6e4359e640 1 --2- 172.21.15.22:0/4064155629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b81d8d0 0x55fa8b81fcc0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c007e50 tx=0x7f6e3c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e9d513b3a43eab server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.098+0000 7f6e397fa640 1 -- 172.21.15.22:0/4064155629 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c014070 con 0x55fa8b81d8d0 2024-08-20T01:37:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.098+0000 7f6e397fa640 1 -- 172.21.15.22:0/4064155629 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e3c00ee90 con 0x55fa8b81d8d0 2024-08-20T01:37:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.098+0000 7f6e397fa640 1 -- 172.21.15.22:0/4064155629 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c005340 con 0x55fa8b81d8d0 2024-08-20T01:37:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.099+0000 7f6e40d99640 1 --2- 172.21.15.22:0/1849015070 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6e300b3c50 0x7f6e300b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.099+0000 7f6e4be65740 1 -- 172.21.15.22:0/4064155629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b81d8d0 msgr2=0x55fa8b81fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.099+0000 7f6e4be65740 1 --2- 172.21.15.22:0/4064155629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b81d8d0 0x55fa8b81fcc0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c007e50 tx=0x7f6e3c00e720 comp rx=0 tx=0).stop 2024-08-20T01:37:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.099+0000 7f6e42d9d640 1 --2- 172.21.15.22:0/1849015070 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6e300b3c50 0x7f6e300b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.099+0000 7f6e4be65740 1 -- 172.21.15.22:0/4064155629 shutdown_connections 2024-08-20T01:37:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.099+0000 7f6e4be65740 1 --2- 172.21.15.22:0/4064155629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b822c40 0x55fa8b825100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.099+0000 7f6e4be65740 1 --2- 172.21.15.22:0/4064155629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b820200 0x55fa8b8225f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.099+0000 7f6e4be65740 1 --2- 172.21.15.22:0/4064155629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b81d8d0 0x55fa8b81fcc0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.099+0000 7f6e4be65740 1 -- 172.21.15.22:0/4064155629 >> 172.21.15.22:0/4064155629 conn(0x55fa8b818a20 msgr2=0x55fa8b8197b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.099+0000 7f6e40d99640 1 -- 172.21.15.22:0/1849015070 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f6e34104590 con 0x7f6e44101560 2024-08-20T01:37:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.099+0000 7f6e4be65740 1 -- 172.21.15.22:0/4064155629 shutdown_connections 2024-08-20T01:37:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.099+0000 7f6e4be65740 1 -- 172.21.15.22:0/4064155629 wait complete. 2024-08-20T01:37:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.099+0000 7f6e42d9d640 1 --2- 172.21.15.22:0/1849015070 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6e300b3c50 0x7f6e300b6110 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6e340cb1a0 tx=0x7f6e34098c40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.099+0000 7f6e4be65740 1 -- start start 2024-08-20T01:37:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.099+0000 7f6e4be65740 1 Processor -- start 2024-08-20T01:37:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.100+0000 7f6e4be65740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b81d8d0 0x55fa8b827180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.100+0000 7f6e4be65740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b820200 0x55fa8b827820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.100+0000 7f6e4be65740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b822c40 0x55fa8b8283f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.100+0000 7f6e4be65740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fa8b6b8ab0 con 0x55fa8b81d8d0 2024-08-20T01:37:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.100+0000 7f6e4be65740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fa8b706780 con 0x55fa8b822c40 2024-08-20T01:37:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.100+0000 7f6e4be65740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fa8b825c20 con 0x55fa8b820200 2024-08-20T01:37:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.100+0000 7f6e4be65740 10 client.0 _ll_register_callbacks cb 0x55fa8b48ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.100+0000 7f6e4359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b81d8d0 0x55fa8b827180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.100+0000 7f6e4359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b81d8d0 0x55fa8b827180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33346/0 (socket says 172.21.15.22:33346) 2024-08-20T01:37:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.100+0000 7f6e4359e640 1 -- 172.21.15.22:0/2554741867 learned_addr learned my addr 172.21.15.22:0/2554741867 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.100+0000 7f6e3bfff640 1 --2- 172.21.15.22:0/2554741867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b820200 0x55fa8b827820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.100+0000 7f6e4359e640 1 --2- 172.21.15.22:0/2554741867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b822c40 0x55fa8b8283f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.100+0000 7f6e4359e640 1 -- 172.21.15.22:0/2554741867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b820200 msgr2=0x55fa8b827820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.100+0000 7f6e4359e640 1 --2- 172.21.15.22:0/2554741867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b820200 0x55fa8b827820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.100+0000 7f6e4359e640 1 -- 172.21.15.22:0/2554741867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b822c40 msgr2=0x55fa8b8283f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.100+0000 7f6e4359e640 1 --2- 172.21.15.22:0/2554741867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b822c40 0x55fa8b8283f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.100+0000 7f6e4359e640 1 -- 172.21.15.22:0/2554741867 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa8b4e2790 con 0x55fa8b81d8d0 2024-08-20T01:37:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.100+0000 7f6e4359e640 1 --2- 172.21.15.22:0/2554741867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b81d8d0 0x55fa8b827180 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c007310 tx=0x7f6e3c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6665ed8fc45cc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.100+0000 7f6e2a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:37:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.101+0000 7f6e2a7fc640 1 -- 172.21.15.22:0/2554741867 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c014070 con 0x55fa8b81d8d0 2024-08-20T01:37:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.101+0000 7f6e2a7fc640 1 -- 172.21.15.22:0/2554741867 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f6e3c010a50 con 0x55fa8b81d8d0 2024-08-20T01:37:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.101+0000 7f6e4be65740 1 -- 172.21.15.22:0/2554741867 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fa8b72ee00 con 0x55fa8b81d8d0 2024-08-20T01:37:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.101+0000 7f6e2a7fc640 1 -- 172.21.15.22:0/2554741867 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6e3c003e60 con 0x55fa8b81d8d0 2024-08-20T01:37:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.101+0000 7f6e4be65740 10 client.16278 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.101+0000 7f6e4be65740 1 -- 172.21.15.22:0/2554741867 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55fa8b55b620 con 0x55fa8b81d8d0 2024-08-20T01:37:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.101+0000 7f6e2a7fc640 1 -- 172.21.15.22:0/2554741867 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55fa8b72ee00 con 0x55fa8b81d8d0 2024-08-20T01:37:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.101+0000 7f6e2a7fc640 1 -- 172.21.15.22:0/2554741867 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f6e3c0052e0 con 0x55fa8b81d8d0 2024-08-20T01:37:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.101+0000 7f6e4be65740 10 client.16278 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.101+0000 7f6e4be65740 10 client.16278 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:37:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.101+0000 7f6e4be65740 20 client.16278 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.101+0000 7f6e4be65740 1 --2- 172.21.15.22:0/2554741867 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fa8b8327f0 0x55fa8b834c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.101+0000 7f6e4be65740 4 client.16278 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.101+0000 7f6e4be65740 1 -- 172.21.15.22:0/2554741867 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa8b7922b0 con 0x55fa8b8327f0 2024-08-20T01:37:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.102+0000 7f6e3bfff640 1 --2- 172.21.15.22:0/2554741867 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fa8b8327f0 0x55fa8b834c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.102+0000 7f6e2a7fc640 10 client.16278 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.102+0000 7f6e3bfff640 1 --2- 172.21.15.22:0/2554741867 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fa8b8327f0 0x55fa8b834c20 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=313340b2f2ed0282 server_cookie=9e707dd45cea8afd in_seq=0 out_seq=0 2024-08-20T01:37:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.103+0000 7f6e2a7fc640 1 -- 172.21.15.22:0/2554741867 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fa8b7922b0 con 0x55fa8b8327f0 2024-08-20T01:37:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.103+0000 7f6e2a7fc640 10 client.16278 handle_command_reply: tid=0 2024-08-20T01:37:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.103+0000 7f6e4be65740 1 client.16278 shutdown 2024-08-20T01:37:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.103+0000 7f6e4be65740 1 -- 172.21.15.22:0/2554741867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b81d8d0 msgr2=0x55fa8b827180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.103+0000 7f6e4be65740 1 --2- 172.21.15.22:0/2554741867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b81d8d0 0x55fa8b827180 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c007310 tx=0x7f6e3c00eeb0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.103+0000 7f6e4be65740 1 -- 172.21.15.22:0/2554741867 shutdown_connections 2024-08-20T01:37:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.103+0000 7f6e4be65740 1 --2- 172.21.15.22:0/2554741867 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fa8b8327f0 0x55fa8b834c20 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.103+0000 7f6e4be65740 1 --2- 172.21.15.22:0/2554741867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b822c40 0x55fa8b8283f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.103+0000 7f6e4be65740 1 --2- 172.21.15.22:0/2554741867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b820200 0x55fa8b827820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.103+0000 7f6e2a7fc640 0 client.16278 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.103+0000 7f6e4be65740 1 --2- 172.21.15.22:0/2554741867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b81d8d0 0x55fa8b827180 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.103+0000 7f6e4be65740 1 -- 172.21.15.22:0/2554741867 >> 172.21.15.22:0/2554741867 conn(0x55fa8b818a20 msgr2=0x55fa8b817ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.103+0000 7f6e4be65740 1 -- 172.21.15.22:0/2554741867 shutdown_connections 2024-08-20T01:37:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.103+0000 7f6e4be65740 1 -- 172.21.15.22:0/2554741867 wait complete. 2024-08-20T01:37:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.103+0000 7f6e4be65740 20 client.16278 trim_cache size 0 max 16384 2024-08-20T01:37:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.118+0000 7f6e4be65740 1 Processor -- start 2024-08-20T01:37:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.118+0000 7f6e4be65740 1 -- start start 2024-08-20T01:37:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.119+0000 7f6e4be65740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b81d8d0 0x55fa8b8182d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.119+0000 7f6e4be65740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b820200 0x55fa8b826320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.119+0000 7f6e4be65740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b822c40 0x55fa8b823730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.119+0000 7f6e4be65740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6e441ac670 con 0x55fa8b820200 2024-08-20T01:37:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.119+0000 7f6e4be65740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6e441a9e80 con 0x55fa8b81d8d0 2024-08-20T01:37:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.119+0000 7f6e4be65740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6e441a7cd0 con 0x55fa8b822c40 2024-08-20T01:37:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.119+0000 7f6e3bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b820200 0x55fa8b826320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.119+0000 7f6e3bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b820200 0x55fa8b826320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33348/0 (socket says 172.21.15.22:33348) 2024-08-20T01:37:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.119+0000 7f6e3bfff640 1 -- 172.21.15.22:0/2637146828 learned_addr learned my addr 172.21.15.22:0/2637146828 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.119+0000 7f6e4359e640 1 --2- 172.21.15.22:0/2637146828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b822c40 0x55fa8b823730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.119+0000 7f6e4359e640 1 --2- 172.21.15.22:0/2637146828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b81d8d0 0x55fa8b8182d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.119+0000 7f6e3bfff640 1 -- 172.21.15.22:0/2637146828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b822c40 msgr2=0x55fa8b823730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.119+0000 7f6e3bfff640 1 --2- 172.21.15.22:0/2637146828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b822c40 0x55fa8b823730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.119+0000 7f6e3bfff640 1 -- 172.21.15.22:0/2637146828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b81d8d0 msgr2=0x55fa8b8182d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.119+0000 7f6e3bfff640 1 --2- 172.21.15.22:0/2637146828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b81d8d0 0x55fa8b8182d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.119+0000 7f6e3bfff640 1 -- 172.21.15.22:0/2637146828 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa8b820030 con 0x55fa8b820200 2024-08-20T01:37:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.119+0000 7f6e4359e640 1 --2- 172.21.15.22:0/2637146828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b81d8d0 0x55fa8b8182d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.120+0000 7f6e3bfff640 1 --2- 172.21.15.22:0/2637146828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b820200 0x55fa8b826320 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x55fa8b8354a0 tx=0x7f6e2c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d421ad400d673e95 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.120+0000 7f6e38ff9640 1 -- 172.21.15.22:0/2637146828 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c003e40 con 0x55fa8b820200 2024-08-20T01:37:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.120+0000 7f6e38ff9640 1 -- 172.21.15.22:0/2637146828 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e2c0108e0 con 0x55fa8b820200 2024-08-20T01:37:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.120+0000 7f6e38ff9640 1 -- 172.21.15.22:0/2637146828 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c01e930 con 0x55fa8b820200 2024-08-20T01:37:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4be65740 1 -- 172.21.15.22:0/2637146828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b820200 msgr2=0x55fa8b826320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4be65740 1 --2- 172.21.15.22:0/2637146828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b820200 0x55fa8b826320 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x55fa8b8354a0 tx=0x7f6e2c005f90 comp rx=0 tx=0).stop 2024-08-20T01:37:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4be65740 1 -- 172.21.15.22:0/2637146828 shutdown_connections 2024-08-20T01:37:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4be65740 1 --2- 172.21.15.22:0/2637146828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b822c40 0x55fa8b823730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4be65740 1 --2- 172.21.15.22:0/2637146828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b820200 0x55fa8b826320 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4be65740 1 --2- 172.21.15.22:0/2637146828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b81d8d0 0x55fa8b8182d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4be65740 1 -- 172.21.15.22:0/2637146828 >> 172.21.15.22:0/2637146828 conn(0x55fa8b818a20 msgr2=0x55fa8b823020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4be65740 1 -- 172.21.15.22:0/2637146828 shutdown_connections 2024-08-20T01:37:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4be65740 1 -- 172.21.15.22:0/2637146828 wait complete. 2024-08-20T01:37:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4be65740 1 -- start start 2024-08-20T01:37:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4be65740 1 Processor -- start 2024-08-20T01:37:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4be65740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b81d8d0 0x55fa8b829f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4be65740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b820200 0x55fa8b82a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4be65740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b822c40 0x55fa8b82b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4be65740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6e441a8340 con 0x55fa8b820200 2024-08-20T01:37:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4be65740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6e441a97b0 con 0x55fa8b822c40 2024-08-20T01:37:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4be65740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6e441a8a10 con 0x55fa8b81d8d0 2024-08-20T01:37:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4be65740 10 client.0 _ll_register_callbacks cb 0x7f6e2c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e3bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b820200 0x55fa8b82a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4359e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b81d8d0 0x55fa8b829f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.121+0000 7f6e4359e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b81d8d0 0x55fa8b829f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:57184/0 (socket says 172.21.15.22:57184) 2024-08-20T01:37:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.122+0000 7f6e4359e640 1 -- 172.21.15.22:0/2293674387 learned_addr learned my addr 172.21.15.22:0/2293674387 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.122+0000 7f6e4359e640 1 --2- 172.21.15.22:0/2293674387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b822c40 0x55fa8b82b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.122+0000 7f6e4359e640 1 -- 172.21.15.22:0/2293674387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b822c40 msgr2=0x55fa8b82b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.122+0000 7f6e4359e640 1 --2- 172.21.15.22:0/2293674387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b822c40 0x55fa8b82b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.122+0000 7f6e4359e640 1 -- 172.21.15.22:0/2293674387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b820200 msgr2=0x55fa8b82a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.122+0000 7f6e4359e640 1 --2- 172.21.15.22:0/2293674387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b820200 0x55fa8b82a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.122+0000 7f6e4359e640 1 -- 172.21.15.22:0/2293674387 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa8b82b9f0 con 0x55fa8b81d8d0 2024-08-20T01:37:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.122+0000 7f6e3bfff640 1 --2- 172.21.15.22:0/2293674387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b820200 0x55fa8b82a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.122+0000 7f6e4359e640 1 --2- 172.21.15.22:0/2293674387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b81d8d0 0x55fa8b829f50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c007be0 tx=0x7f6e3c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec024483e1bb1e61 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.122+0000 7f6e2a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:37:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.122+0000 7f6e2a7fc640 1 -- 172.21.15.22:0/2293674387 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c014070 con 0x55fa8b81d8d0 2024-08-20T01:37:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.122+0000 7f6e2a7fc640 1 -- 172.21.15.22:0/2293674387 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f6e3c02a330 con 0x55fa8b81d8d0 2024-08-20T01:37:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.122+0000 7f6e4be65740 1 -- 172.21.15.22:0/2293674387 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e2c0108e0 con 0x55fa8b81d8d0 2024-08-20T01:37:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.122+0000 7f6e2a7fc640 1 -- 172.21.15.22:0/2293674387 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6e3c037040 con 0x55fa8b81d8d0 2024-08-20T01:37:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.122+0000 7f6e4be65740 10 client.25942 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.122+0000 7f6e4be65740 1 -- 172.21.15.22:0/2293674387 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55fa8b82ed70 con 0x55fa8b81d8d0 2024-08-20T01:37:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.123+0000 7f6e2a7fc640 1 -- 172.21.15.22:0/2293674387 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e2c0108e0 con 0x55fa8b81d8d0 2024-08-20T01:37:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.123+0000 7f6e2a7fc640 1 -- 172.21.15.22:0/2293674387 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f6e3c0052b0 con 0x55fa8b81d8d0 2024-08-20T01:37:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.123+0000 7f6e4be65740 10 client.25942 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:22.130 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.123+0000 7f6e4be65740 10 client.25942 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:37:22.130 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.123+0000 7f6e4be65740 20 client.25942 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:22.130 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.123+0000 7f6e4be65740 1 --2- 172.21.15.22:0/2293674387 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fa8b8a1b20 0x55fa8b8a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:22.130 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.123+0000 7f6e4be65740 4 client.25942 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:37:22.130 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.123+0000 7f6e4be65740 1 -- 172.21.15.22:0/2293674387 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fa8b78dd50 con 0x55fa8b8a1b20 2024-08-20T01:37:22.130 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.123+0000 7f6e3bfff640 1 --2- 172.21.15.22:0/2293674387 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fa8b8a1b20 0x55fa8b8a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:22.130 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.123+0000 7f6e2a7fc640 10 client.25942 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:22.130 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.123+0000 7f6e3bfff640 1 --2- 172.21.15.22:0/2293674387 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fa8b8a1b20 0x55fa8b8a3f40 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee515318010b1387 server_cookie=cf07853c315d9c31 in_seq=0 out_seq=0 2024-08-20T01:37:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.303+0000 7f6e2a7fc640 1 -- 172.21.15.22:0/2293674387 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fa8b78dd50 con 0x55fa8b8a1b20 2024-08-20T01:37:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.303+0000 7f6e2a7fc640 10 client.25942 handle_command_reply: tid=0 2024-08-20T01:37:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.303+0000 7f6e4be65740 1 client.25942 shutdown 2024-08-20T01:37:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.303+0000 7f6e4be65740 1 -- 172.21.15.22:0/2293674387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b81d8d0 msgr2=0x55fa8b829f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.303+0000 7f6e4be65740 1 --2- 172.21.15.22:0/2293674387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b81d8d0 0x55fa8b829f50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c007be0 tx=0x7f6e3c00eeb0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.303+0000 7f6e4be65740 1 -- 172.21.15.22:0/2293674387 shutdown_connections 2024-08-20T01:37:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.303+0000 7f6e4be65740 1 --2- 172.21.15.22:0/2293674387 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fa8b8a1b20 0x55fa8b8a3f40 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.303+0000 7f6e4be65740 1 --2- 172.21.15.22:0/2293674387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa8b822c40 0x55fa8b82b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.307 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.303+0000 7f6e2a7fc640 0 client.25942 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:22.307 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.303+0000 7f6e4be65740 1 --2- 172.21.15.22:0/2293674387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fa8b820200 0x55fa8b82a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.307 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.303+0000 7f6e4be65740 1 --2- 172.21.15.22:0/2293674387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fa8b81d8d0 0x55fa8b829f50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.307 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.303+0000 7f6e4be65740 1 -- 172.21.15.22:0/2293674387 >> 172.21.15.22:0/2293674387 conn(0x55fa8b818a20 msgr2=0x55fa8b823840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:22.307 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.303+0000 7f6e4be65740 1 -- 172.21.15.22:0/2293674387 shutdown_connections 2024-08-20T01:37:22.307 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.303+0000 7f6e4be65740 1 -- 172.21.15.22:0/2293674387 wait complete. 2024-08-20T01:37:22.307 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.303+0000 7f6e4be65740 20 client.25942 trim_cache size 0 max 16384 2024-08-20T01:37:22.307 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:37:22.307 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:37:22.308 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:37:22.308 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:37:22.308 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.304+0000 7f6e4906e640 1 -- 172.21.15.22:0/1849015070 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6e300b3c50 msgr2=0x7f6e300b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:22.308 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.304+0000 7f6e4906e640 1 --2- 172.21.15.22:0/1849015070 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6e300b3c50 0x7f6e300b6110 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6e340cb1a0 tx=0x7f6e34098c40 comp rx=0 tx=0).stop 2024-08-20T01:37:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.304+0000 7f6e4906e640 1 -- 172.21.15.22:0/1849015070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e44101560 msgr2=0x7f6e4406ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.304+0000 7f6e4906e640 1 --2- 172.21.15.22:0/1849015070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e44101560 0x7f6e4406ae80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009a50 tx=0x7f6e340042f0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.304+0000 7f6e4906e640 1 -- 172.21.15.22:0/1849015070 shutdown_connections 2024-08-20T01:37:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.304+0000 7f6e4906e640 1 --2- 172.21.15.22:0/1849015070 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f6e300b3c50 0x7f6e300b6110 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.304+0000 7f6e4906e640 1 --2- 172.21.15.22:0/1849015070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e44103070 0x7f6e4419fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.304+0000 7f6e4906e640 1 --2- 172.21.15.22:0/1849015070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e441026b0 0x7f6e4419d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.304+0000 7f6e4906e640 1 --2- 172.21.15.22:0/1849015070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e44101560 0x7f6e4406ae80 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.304+0000 7f6e4906e640 1 -- 172.21.15.22:0/1849015070 >> 172.21.15.22:0/1849015070 conn(0x7f6e440fce40 msgr2=0x7f6e44105a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.304+0000 7f6e4906e640 1 -- 172.21.15.22:0/1849015070 shutdown_connections 2024-08-20T01:37:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:22.304+0000 7f6e4906e640 1 -- 172.21.15.22:0/1849015070 wait complete. 2024-08-20T01:37:23.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:23 smithi134 ceph-mon[22511]: pgmap v533: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.1 MiB/s wr, 676 op/s 2024-08-20T01:37:23.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:23 smithi077 ceph-mon[22251]: pgmap v533: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.1 MiB/s wr, 676 op/s 2024-08-20T01:37:23.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:23 smithi022 ceph-mon[18709]: pgmap v533: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.1 MiB/s wr, 676 op/s 2024-08-20T01:37:25.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:25 smithi134 ceph-mon[22511]: pgmap v534: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.3 MiB/s wr, 556 op/s 2024-08-20T01:37:25.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:25 smithi077 ceph-mon[22251]: pgmap v534: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.3 MiB/s wr, 556 op/s 2024-08-20T01:37:25.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:25 smithi022 ceph-mon[18709]: pgmap v534: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.3 MiB/s wr, 556 op/s 2024-08-20T01:37:27.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:27 smithi134 ceph-mon[22511]: pgmap v535: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 346 op/s 2024-08-20T01:37:27.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:27 smithi077 ceph-mon[22251]: pgmap v535: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 346 op/s 2024-08-20T01:37:27.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:27 smithi022 ceph-mon[18709]: pgmap v535: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 346 op/s 2024-08-20T01:37:29.212 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:37:29.478 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:29.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:29 smithi134 ceph-mon[22511]: pgmap v536: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 438 op/s 2024-08-20T01:37:29.564 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:29 smithi077 ceph-mon[22251]: pgmap v536: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 438 op/s 2024-08-20T01:37:29.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:29 smithi022 ceph-mon[18709]: pgmap v536: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 438 op/s 2024-08-20T01:37:30.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.989+0000 7fa70da09640 1 -- 172.21.15.22:0/4277371607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa70810ce40 msgr2=0x7fa70810f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:30.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.989+0000 7fa70da09640 1 --2- 172.21.15.22:0/4277371607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa70810ce40 0x7fa70810f2a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa700009ca0 tx=0x7fa70002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.990+0000 7fa70da09640 1 -- 172.21.15.22:0/4277371607 shutdown_connections 2024-08-20T01:37:30.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.990+0000 7fa70da09640 1 --2- 172.21.15.22:0/4277371607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa70810ce40 0x7fa70810f2a0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.990+0000 7fa70da09640 1 --2- 172.21.15.22:0/4277371607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa708104300 0x7fa70810c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.990+0000 7fa70da09640 1 --2- 172.21.15.22:0/4277371607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7081039e0 0x7fa708103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.990+0000 7fa70da09640 1 -- 172.21.15.22:0/4277371607 >> 172.21.15.22:0/4277371607 conn(0x7fa7080fd440 msgr2=0x7fa7080ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:30.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.990+0000 7fa70da09640 1 -- 172.21.15.22:0/4277371607 shutdown_connections 2024-08-20T01:37:30.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.990+0000 7fa70da09640 1 -- 172.21.15.22:0/4277371607 wait complete. 2024-08-20T01:37:30.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.990+0000 7fa70da09640 1 Processor -- start 2024-08-20T01:37:30.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.990+0000 7fa70da09640 1 -- start start 2024-08-20T01:37:30.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.991+0000 7fa70da09640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7081039e0 0x7fa708198f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:30.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.991+0000 7fa70da09640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa708104300 0x7fa7081994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:30.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.991+0000 7fa70da09640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa70810ce40 0x7fa70819e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:30.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.991+0000 7fa70da09640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa708112ab0 con 0x7fa70810ce40 2024-08-20T01:37:30.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.991+0000 7fa70da09640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa708112930 con 0x7fa708104300 2024-08-20T01:37:30.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.991+0000 7fa70da09640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa708112c30 con 0x7fa7081039e0 2024-08-20T01:37:30.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.991+0000 7fa7077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa70810ce40 0x7fa70819e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:30.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.991+0000 7fa7077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa70810ce40 0x7fa70819e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47590/0 (socket says 172.21.15.22:47590) 2024-08-20T01:37:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.991+0000 7fa706ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7081039e0 0x7fa708198f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.991+0000 7fa7077fe640 1 -- 172.21.15.22:0/451571721 learned_addr learned my addr 172.21.15.22:0/451571721 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.991+0000 7fa7067fc640 1 --2- 172.21.15.22:0/451571721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa708104300 0x7fa7081994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.991+0000 7fa706ffd640 1 -- 172.21.15.22:0/451571721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa708104300 msgr2=0x7fa7081994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.991+0000 7fa706ffd640 1 --2- 172.21.15.22:0/451571721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa708104300 0x7fa7081994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.991+0000 7fa706ffd640 1 -- 172.21.15.22:0/451571721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa70810ce40 msgr2=0x7fa70819e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.991+0000 7fa706ffd640 1 --2- 172.21.15.22:0/451571721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa70810ce40 0x7fa70819e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.991+0000 7fa706ffd640 1 -- 172.21.15.22:0/451571721 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa70819f010 con 0x7fa7081039e0 2024-08-20T01:37:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.991+0000 7fa7077fe640 1 --2- 172.21.15.22:0/451571721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa70810ce40 0x7fa70819e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.991+0000 7fa706ffd640 1 --2- 172.21.15.22:0/451571721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7081039e0 0x7fa708198f60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800e9f0 tx=0x7fa6f800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.992+0000 7fa70ca07640 1 -- 172.21.15.22:0/451571721 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f800ccc0 con 0x7fa7081039e0 2024-08-20T01:37:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.992+0000 7fa70da09640 1 -- 172.21.15.22:0/451571721 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa70819f300 con 0x7fa7081039e0 2024-08-20T01:37:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.992+0000 7fa70ca07640 1 -- 172.21.15.22:0/451571721 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6f8005020 con 0x7fa7081039e0 2024-08-20T01:37:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.992+0000 7fa70ca07640 1 -- 172.21.15.22:0/451571721 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8004a00 con 0x7fa7081039e0 2024-08-20T01:37:30.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.992+0000 7fa70da09640 1 -- 172.21.15.22:0/451571721 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7081a59c0 con 0x7fa7081039e0 2024-08-20T01:37:30.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.994+0000 7fa70fe02740 1 Processor -- start 2024-08-20T01:37:30.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.994+0000 7fa70fe02740 1 -- start start 2024-08-20T01:37:30.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.994+0000 7fa70ca07640 1 -- 172.21.15.22:0/451571721 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa6f8004ba0 con 0x7fa7081039e0 2024-08-20T01:37:30.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.994+0000 7fa70fe02740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 0x5621a9966c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:30.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.994+0000 7fa70fe02740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a9967150 0x5621a9976fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:30.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.994+0000 7fa70fe02740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a99774f0 0x5621a99798e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:30.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.994+0000 7fa70fe02740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5621a98dd8e0 con 0x5621a9966830 2024-08-20T01:37:30.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.994+0000 7fa70fe02740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5621a98ccde0 con 0x5621a9967150 2024-08-20T01:37:30.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.994+0000 7fa70fe02740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5621a98d0e20 con 0x5621a99774f0 2024-08-20T01:37:30.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.994+0000 7fa7077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 0x5621a9966c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:30.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.994+0000 7fa7077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 0x5621a9966c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47604/0 (socket says 172.21.15.22:47604) 2024-08-20T01:37:30.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.994+0000 7fa7077fe640 1 -- 172.21.15.22:0/4185964088 learned_addr learned my addr 172.21.15.22:0/4185964088 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:30.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.994+0000 7fa7067fc640 1 --2- 172.21.15.22:0/4185964088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a99774f0 0x5621a99798e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:30.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.994+0000 7fa706ffd640 1 --2- 172.21.15.22:0/4185964088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a9967150 0x5621a9976fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:30.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.995+0000 7fa7077fe640 1 -- 172.21.15.22:0/4185964088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a99774f0 msgr2=0x5621a99798e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:30.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.995+0000 7fa7077fe640 1 --2- 172.21.15.22:0/4185964088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a99774f0 0x5621a99798e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.995+0000 7fa7077fe640 1 -- 172.21.15.22:0/4185964088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a9967150 msgr2=0x5621a9976fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:30.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.995+0000 7fa7077fe640 1 --2- 172.21.15.22:0/4185964088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a9967150 0x5621a9976fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.995+0000 7fa7077fe640 1 -- 172.21.15.22:0/4185964088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621a962c650 con 0x5621a9966830 2024-08-20T01:37:30.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.995+0000 7fa7077fe640 1 --2- 172.21.15.22:0/4185964088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 0x5621a9966c10 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa70002f3f0 tx=0x7fa70002f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433e26183d769682 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:30.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.995+0000 7fa70ca07640 1 --2- 172.21.15.22:0/451571721 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa6f00b3bd0 0x7fa6f00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:30.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.995+0000 7fa6edffb640 1 -- 172.21.15.22:0/4185964088 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa700031650 con 0x5621a9966830 2024-08-20T01:37:30.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.995+0000 7fa6edffb640 1 -- 172.21.15.22:0/4185964088 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa700036040 con 0x5621a9966830 2024-08-20T01:37:30.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.995+0000 7fa6edffb640 1 -- 172.21.15.22:0/4185964088 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7000045e0 con 0x5621a9966830 2024-08-20T01:37:30.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.995+0000 7fa706ffd640 1 --2- 172.21.15.22:0/451571721 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa6f00b3bd0 0x7fa6f00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:30.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.995+0000 7fa70ca07640 1 -- 172.21.15.22:0/451571721 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fa6f80e3c80 con 0x7fa7081039e0 2024-08-20T01:37:30.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.996+0000 7fa70fe02740 1 -- 172.21.15.22:0/4185964088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 msgr2=0x5621a9966c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:30.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.996+0000 7fa706ffd640 1 --2- 172.21.15.22:0/451571721 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa6f00b3bd0 0x7fa6f00b6090 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80a6bb0 tx=0x7fa6f8005460 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:30.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.996+0000 7fa70fe02740 1 --2- 172.21.15.22:0/4185964088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 0x5621a9966c10 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa70002f3f0 tx=0x7fa70002f420 comp rx=0 tx=0).stop 2024-08-20T01:37:30.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.996+0000 7fa70fe02740 1 -- 172.21.15.22:0/4185964088 shutdown_connections 2024-08-20T01:37:30.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.996+0000 7fa70fe02740 1 --2- 172.21.15.22:0/4185964088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a99774f0 0x5621a99798e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.996+0000 7fa70fe02740 1 --2- 172.21.15.22:0/4185964088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a9967150 0x5621a9976fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.996+0000 7fa70fe02740 1 --2- 172.21.15.22:0/4185964088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 0x5621a9966c10 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.996+0000 7fa70fe02740 1 -- 172.21.15.22:0/4185964088 >> 172.21.15.22:0/4185964088 conn(0x5621a9964660 msgr2=0x5621a9965800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:30.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.996+0000 7fa70fe02740 1 -- 172.21.15.22:0/4185964088 shutdown_connections 2024-08-20T01:37:30.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.996+0000 7fa70fe02740 1 -- 172.21.15.22:0/4185964088 wait complete. 2024-08-20T01:37:30.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.996+0000 7fa70fe02740 1 -- start start 2024-08-20T01:37:30.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.997+0000 7fa70fe02740 1 Processor -- start 2024-08-20T01:37:30.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.997+0000 7fa70fe02740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 0x5621a9974510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:30.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.997+0000 7fa70fe02740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a9967150 0x5621a9974a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:30.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.997+0000 7fa70fe02740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a99774f0 0x5621a9974f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:30.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.997+0000 7fa70fe02740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5621a972f700 con 0x5621a9966830 2024-08-20T01:37:30.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.997+0000 7fa70fe02740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5621a98537c0 con 0x5621a99774f0 2024-08-20T01:37:30.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.997+0000 7fa70fe02740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5621a9979fc0 con 0x5621a9967150 2024-08-20T01:37:30.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.997+0000 7fa70fe02740 10 client.0 _ll_register_callbacks cb 0x5621a98c66b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:30.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.997+0000 7fa7077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 0x5621a9974510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:30.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.997+0000 7fa7067fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a9967150 0x5621a9974a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:30.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.997+0000 7fa7077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 0x5621a9974510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47618/0 (socket says 172.21.15.22:47618) 2024-08-20T01:37:30.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.997+0000 7fa7077fe640 1 -- 172.21.15.22:0/2883672309 learned_addr learned my addr 172.21.15.22:0/2883672309 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:30.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.997+0000 7fa7077fe640 1 --2- 172.21.15.22:0/2883672309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a99774f0 0x5621a9974f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:30.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.997+0000 7fa7077fe640 1 -- 172.21.15.22:0/2883672309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a9967150 msgr2=0x5621a9974a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:30.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.997+0000 7fa7077fe640 1 --2- 172.21.15.22:0/2883672309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a9967150 0x5621a9974a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.997+0000 7fa7077fe640 1 -- 172.21.15.22:0/2883672309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a99774f0 msgr2=0x5621a9974f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:30.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.997+0000 7fa7077fe640 1 --2- 172.21.15.22:0/2883672309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a99774f0 0x5621a9974f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.997+0000 7fa7077fe640 1 -- 172.21.15.22:0/2883672309 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621a99833a0 con 0x5621a9966830 2024-08-20T01:37:30.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.997+0000 7fa7067fc640 1 --2- 172.21.15.22:0/2883672309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a9967150 0x5621a9974a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:30.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.998+0000 7fa7077fe640 1 --2- 172.21.15.22:0/2883672309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 0x5621a9974510 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa700009c70 tx=0x7fa700004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0551a7825286476 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:30.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.998+0000 7fa6e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:37:30.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.998+0000 7fa6e6ffd640 1 -- 172.21.15.22:0/2883672309 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa700057060 con 0x5621a9966830 2024-08-20T01:37:30.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.998+0000 7fa70fe02740 1 -- 172.21.15.22:0/2883672309 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5621a987c100 con 0x5621a9966830 2024-08-20T01:37:30.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.998+0000 7fa6e6ffd640 1 -- 172.21.15.22:0/2883672309 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fa7000045f0 con 0x5621a9966830 2024-08-20T01:37:30.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.998+0000 7fa6e6ffd640 1 -- 172.21.15.22:0/2883672309 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa7000047f0 con 0x5621a9966830 2024-08-20T01:37:30.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.998+0000 7fa70fe02740 10 client.16296 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:30.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.998+0000 7fa70fe02740 1 -- 172.21.15.22:0/2883672309 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5621a9985d50 con 0x5621a9966830 2024-08-20T01:37:30.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.998+0000 7fa6e6ffd640 1 -- 172.21.15.22:0/2883672309 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5621a987c100 con 0x5621a9966830 2024-08-20T01:37:30.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.998+0000 7fa6e6ffd640 1 -- 172.21.15.22:0/2883672309 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fa700044070 con 0x5621a9966830 2024-08-20T01:37:30.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.999+0000 7fa70fe02740 10 client.16296 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:30.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.999+0000 7fa70fe02740 10 client.16296 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:37:30.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.999+0000 7fa70fe02740 20 client.16296 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:30.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.999+0000 7fa70fe02740 1 --2- 172.21.15.22:0/2883672309 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5621a99870a0 0x5621a9989490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:30.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.999+0000 7fa70fe02740 4 client.16296 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:30.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.999+0000 7fa70fe02740 1 -- 172.21.15.22:0/2883672309 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621a98df830 con 0x5621a99870a0 2024-08-20T01:37:30.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.999+0000 7fa7067fc640 1 --2- 172.21.15.22:0/2883672309 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5621a99870a0 0x5621a9989490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:30.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.999+0000 7fa6e6ffd640 10 client.16296 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:30.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:29.999+0000 7fa7067fc640 1 --2- 172.21.15.22:0/2883672309 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5621a99870a0 0x5621a9989490 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5280e17acca479c8 server_cookie=c8cd58561f92e952 in_seq=0 out_seq=0 2024-08-20T01:37:30.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.001+0000 7fa6e6ffd640 1 -- 172.21.15.22:0/2883672309 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5621a98df830 con 0x5621a99870a0 2024-08-20T01:37:30.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.001+0000 7fa6e6ffd640 10 client.16296 handle_command_reply: tid=0 2024-08-20T01:37:30.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.001+0000 7fa70fe02740 1 client.16296 shutdown 2024-08-20T01:37:30.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.001+0000 7fa70fe02740 1 -- 172.21.15.22:0/2883672309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 msgr2=0x5621a9974510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:30.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.001+0000 7fa70fe02740 1 --2- 172.21.15.22:0/2883672309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 0x5621a9974510 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa700009c70 tx=0x7fa700004180 comp rx=0 tx=0).stop 2024-08-20T01:37:30.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.001+0000 7fa70fe02740 1 -- 172.21.15.22:0/2883672309 shutdown_connections 2024-08-20T01:37:30.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.001+0000 7fa70fe02740 1 --2- 172.21.15.22:0/2883672309 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5621a99870a0 0x5621a9989490 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.001+0000 7fa70fe02740 1 --2- 172.21.15.22:0/2883672309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a99774f0 0x5621a9974f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.001+0000 7fa70fe02740 1 --2- 172.21.15.22:0/2883672309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a9967150 0x5621a9974a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.001+0000 7fa70fe02740 1 --2- 172.21.15.22:0/2883672309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 0x5621a9974510 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.001+0000 7fa6e6ffd640 0 client.16296 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:30.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.001+0000 7fa70fe02740 1 -- 172.21.15.22:0/2883672309 >> 172.21.15.22:0/2883672309 conn(0x5621a9964660 msgr2=0x5621a996a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:30.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.001+0000 7fa70fe02740 1 -- 172.21.15.22:0/2883672309 shutdown_connections 2024-08-20T01:37:30.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.001+0000 7fa70fe02740 1 -- 172.21.15.22:0/2883672309 wait complete. 2024-08-20T01:37:30.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.001+0000 7fa70fe02740 20 client.16296 trim_cache size 0 max 16384 2024-08-20T01:37:30.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.019+0000 7fa70fe02740 1 Processor -- start 2024-08-20T01:37:30.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.019+0000 7fa70fe02740 1 -- start start 2024-08-20T01:37:30.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa70fe02740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a9966830 0x5621a9973da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:30.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa70fe02740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9967150 0x5621a9971f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:30.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa70fe02740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a99774f0 0x5621a9963f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:30.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa70fe02740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa7081ae8e0 con 0x5621a9967150 2024-08-20T01:37:30.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa70fe02740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa7081ac0f0 con 0x5621a9966830 2024-08-20T01:37:30.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa70fe02740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa7081a9f40 con 0x5621a99774f0 2024-08-20T01:37:30.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa7067fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9967150 0x5621a9971f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:30.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa7067fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9967150 0x5621a9971f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47628/0 (socket says 172.21.15.22:47628) 2024-08-20T01:37:30.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa7067fc640 1 -- 172.21.15.22:0/170889341 learned_addr learned my addr 172.21.15.22:0/170889341 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:30.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa7077fe640 1 --2- 172.21.15.22:0/170889341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a9966830 0x5621a9973da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:30.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa7077fe640 1 --2- 172.21.15.22:0/170889341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a99774f0 0x5621a9963f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:30.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa7067fc640 1 -- 172.21.15.22:0/170889341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a99774f0 msgr2=0x5621a9963f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:30.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa7067fc640 1 --2- 172.21.15.22:0/170889341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a99774f0 0x5621a9963f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa7067fc640 1 -- 172.21.15.22:0/170889341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a9966830 msgr2=0x5621a9973da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:30.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa7067fc640 1 --2- 172.21.15.22:0/170889341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a9966830 0x5621a9973da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa7067fc640 1 -- 172.21.15.22:0/170889341 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621a9976ca0 con 0x5621a9967150 2024-08-20T01:37:30.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa7067fc640 1 --2- 172.21.15.22:0/170889341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9967150 0x5621a9971f80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00b8d0 tx=0x7fa6fc00b360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70ab27be270db62 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:30.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa6ed7fa640 1 -- 172.21.15.22:0/170889341 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc011440 con 0x5621a9967150 2024-08-20T01:37:30.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa6ed7fa640 1 -- 172.21.15.22:0/170889341 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6fc011a90 con 0x5621a9967150 2024-08-20T01:37:30.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.020+0000 7fa6ed7fa640 1 -- 172.21.15.22:0/170889341 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc026a00 con 0x5621a9967150 2024-08-20T01:37:30.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.021+0000 7fa70fe02740 1 -- 172.21.15.22:0/170889341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9967150 msgr2=0x5621a9971f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:30.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.021+0000 7fa70fe02740 1 --2- 172.21.15.22:0/170889341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9967150 0x5621a9971f80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00b8d0 tx=0x7fa6fc00b360 comp rx=0 tx=0).stop 2024-08-20T01:37:30.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.021+0000 7fa70fe02740 1 -- 172.21.15.22:0/170889341 shutdown_connections 2024-08-20T01:37:30.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.021+0000 7fa70fe02740 1 --2- 172.21.15.22:0/170889341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a99774f0 0x5621a9963f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.021+0000 7fa70fe02740 1 --2- 172.21.15.22:0/170889341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9967150 0x5621a9971f80 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.021+0000 7fa70fe02740 1 --2- 172.21.15.22:0/170889341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a9966830 0x5621a9973da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.021+0000 7fa70fe02740 1 -- 172.21.15.22:0/170889341 >> 172.21.15.22:0/170889341 conn(0x5621a9964660 msgr2=0x5621a9974480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:30.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.021+0000 7fa70fe02740 1 -- 172.21.15.22:0/170889341 shutdown_connections 2024-08-20T01:37:30.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.021+0000 7fa70fe02740 1 -- 172.21.15.22:0/170889341 wait complete. 2024-08-20T01:37:30.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.021+0000 7fa70fe02740 1 -- start start 2024-08-20T01:37:30.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.022+0000 7fa70fe02740 1 Processor -- start 2024-08-20T01:37:30.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.022+0000 7fa70fe02740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 0x5621a9968870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:30.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.022+0000 7fa70fe02740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a9967150 0x5621a9968db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:30.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.022+0000 7fa70fe02740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a99774f0 0x5621a997f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:30.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.022+0000 7fa70fe02740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa7081aa5b0 con 0x5621a9966830 2024-08-20T01:37:30.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.022+0000 7fa70fe02740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa7081aba20 con 0x5621a99774f0 2024-08-20T01:37:30.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.022+0000 7fa70fe02740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa7081aac80 con 0x5621a9967150 2024-08-20T01:37:30.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.022+0000 7fa70fe02740 10 client.0 _ll_register_callbacks cb 0x7fa6fc004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:30.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.022+0000 7fa7077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 0x5621a9968870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:30.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.022+0000 7fa7077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 0x5621a9968870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47636/0 (socket says 172.21.15.22:47636) 2024-08-20T01:37:30.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.022+0000 7fa7077fe640 1 -- 172.21.15.22:0/3839647714 learned_addr learned my addr 172.21.15.22:0/3839647714 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:30.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.022+0000 7fa7067fc640 1 --2- 172.21.15.22:0/3839647714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a9967150 0x5621a9968db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:30.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.022+0000 7fa7077fe640 1 --2- 172.21.15.22:0/3839647714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a99774f0 0x5621a997f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:30.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.022+0000 7fa7077fe640 1 -- 172.21.15.22:0/3839647714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a9967150 msgr2=0x5621a9968db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:30.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.022+0000 7fa7077fe640 1 --2- 172.21.15.22:0/3839647714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a9967150 0x5621a9968db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.022+0000 7fa7077fe640 1 -- 172.21.15.22:0/3839647714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a99774f0 msgr2=0x5621a997f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:30.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.022+0000 7fa7077fe640 1 --2- 172.21.15.22:0/3839647714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a99774f0 0x5621a997f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.023+0000 7fa7077fe640 1 -- 172.21.15.22:0/3839647714 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621a997f790 con 0x5621a9966830 2024-08-20T01:37:30.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.023+0000 7fa7067fc640 1 --2- 172.21.15.22:0/3839647714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a9967150 0x5621a9968db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:30.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.023+0000 7fa7077fe640 1 --2- 172.21.15.22:0/3839647714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 0x5621a9968870 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa700002230 tx=0x7fa700004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225e1fc69978696e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:30.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.023+0000 7fa6e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:37:30.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.023+0000 7fa6e6ffd640 1 -- 172.21.15.22:0/3839647714 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa700057040 con 0x5621a9966830 2024-08-20T01:37:30.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.023+0000 7fa6e6ffd640 1 -- 172.21.15.22:0/3839647714 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fa70004b040 con 0x5621a9966830 2024-08-20T01:37:30.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.023+0000 7fa70fe02740 1 -- 172.21.15.22:0/3839647714 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6fc011a90 con 0x5621a9966830 2024-08-20T01:37:30.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.023+0000 7fa6e6ffd640 1 -- 172.21.15.22:0/3839647714 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa70002f380 con 0x5621a9966830 2024-08-20T01:37:30.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.023+0000 7fa70fe02740 10 client.16302 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:30.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.023+0000 7fa70fe02740 1 -- 172.21.15.22:0/3839647714 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5621a998e6c0 con 0x5621a9966830 2024-08-20T01:37:30.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.023+0000 7fa6e6ffd640 1 -- 172.21.15.22:0/3839647714 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6fc011a90 con 0x5621a9966830 2024-08-20T01:37:30.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.023+0000 7fa6e6ffd640 1 -- 172.21.15.22:0/3839647714 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fa700044070 con 0x5621a9966830 2024-08-20T01:37:30.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.024+0000 7fa70fe02740 10 client.16302 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:30.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.024+0000 7fa70fe02740 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:37:30.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.024+0000 7fa70fe02740 20 client.16302 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:30.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.024+0000 7fa70fe02740 1 --2- 172.21.15.22:0/3839647714 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5621a99f1d10 0x5621a99f4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:30.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.024+0000 7fa70fe02740 4 client.16302 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:37:30.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.024+0000 7fa70fe02740 1 -- 172.21.15.22:0/3839647714 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5621a98db2d0 con 0x5621a99f1d10 2024-08-20T01:37:30.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.024+0000 7fa7067fc640 1 --2- 172.21.15.22:0/3839647714 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5621a99f1d10 0x5621a99f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:30.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.024+0000 7fa7067fc640 1 --2- 172.21.15.22:0/3839647714 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5621a99f1d10 0x5621a99f4130 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb7e4df2346921a5 server_cookie=2d600a454305ff7 in_seq=0 out_seq=0 2024-08-20T01:37:30.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.024+0000 7fa6e6ffd640 10 client.16302 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:30.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.026+0000 7fa6e6ffd640 1 -- 172.21.15.22:0/3839647714 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5621a98db2d0 con 0x5621a99f1d10 2024-08-20T01:37:30.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.026+0000 7fa6e6ffd640 10 client.16302 handle_command_reply: tid=0 2024-08-20T01:37:30.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.026+0000 7fa70fe02740 1 client.16302 shutdown 2024-08-20T01:37:30.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.026+0000 7fa70fe02740 1 -- 172.21.15.22:0/3839647714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 msgr2=0x5621a9968870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:30.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.026+0000 7fa70fe02740 1 --2- 172.21.15.22:0/3839647714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 0x5621a9968870 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa700002230 tx=0x7fa700004180 comp rx=0 tx=0).stop 2024-08-20T01:37:30.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.026+0000 7fa70fe02740 1 -- 172.21.15.22:0/3839647714 shutdown_connections 2024-08-20T01:37:30.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.026+0000 7fa70fe02740 1 --2- 172.21.15.22:0/3839647714 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5621a99f1d10 0x5621a99f4130 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.026+0000 7fa70fe02740 1 --2- 172.21.15.22:0/3839647714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621a99774f0 0x5621a997f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.026+0000 7fa70fe02740 1 --2- 172.21.15.22:0/3839647714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621a9967150 0x5621a9968db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.026+0000 7fa70fe02740 1 --2- 172.21.15.22:0/3839647714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5621a9966830 0x5621a9968870 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.026+0000 7fa70fe02740 1 -- 172.21.15.22:0/3839647714 >> 172.21.15.22:0/3839647714 conn(0x5621a9964660 msgr2=0x5621a996a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:30.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.026+0000 7fa6e6ffd640 0 client.16302 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:30.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.026+0000 7fa70fe02740 1 -- 172.21.15.22:0/3839647714 shutdown_connections 2024-08-20T01:37:30.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.026+0000 7fa70fe02740 1 -- 172.21.15.22:0/3839647714 wait complete. 2024-08-20T01:37:30.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.026+0000 7fa70fe02740 20 client.16302 trim_cache size 0 max 16384 2024-08-20T01:37:30.032 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:37:30.032 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-08-20T01:37:30.032 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-08-20T01:37:30.032 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:37:30.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.027+0000 7fa70da09640 1 -- 172.21.15.22:0/451571721 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa6f00b3bd0 msgr2=0x7fa6f00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:30.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.027+0000 7fa70da09640 1 --2- 172.21.15.22:0/451571721 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa6f00b3bd0 0x7fa6f00b6090 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80a6bb0 tx=0x7fa6f8005460 comp rx=0 tx=0).stop 2024-08-20T01:37:30.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.027+0000 7fa70da09640 1 -- 172.21.15.22:0/451571721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7081039e0 msgr2=0x7fa708198f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:30.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.027+0000 7fa70da09640 1 --2- 172.21.15.22:0/451571721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7081039e0 0x7fa708198f60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800e9f0 tx=0x7fa6f800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.027+0000 7fa70da09640 1 -- 172.21.15.22:0/451571721 shutdown_connections 2024-08-20T01:37:30.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.027+0000 7fa70da09640 1 --2- 172.21.15.22:0/451571721 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa6f00b3bd0 0x7fa6f00b6090 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.027+0000 7fa70da09640 1 --2- 172.21.15.22:0/451571721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa70810ce40 0x7fa70819e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.027+0000 7fa70da09640 1 --2- 172.21.15.22:0/451571721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa708104300 0x7fa7081994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.027+0000 7fa70da09640 1 --2- 172.21.15.22:0/451571721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7081039e0 0x7fa708198f60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:30.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.027+0000 7fa70da09640 1 -- 172.21.15.22:0/451571721 >> 172.21.15.22:0/451571721 conn(0x7fa7080fd440 msgr2=0x7fa7080fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:30.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.027+0000 7fa70da09640 1 -- 172.21.15.22:0/451571721 shutdown_connections 2024-08-20T01:37:30.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:30.027+0000 7fa70da09640 1 -- 172.21.15.22:0/451571721 wait complete. 2024-08-20T01:37:30.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:30 smithi134 ceph-mon[22511]: pgmap v537: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 377 op/s 2024-08-20T01:37:30.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:30 smithi077 ceph-mon[22251]: pgmap v537: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 377 op/s 2024-08-20T01:37:30.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:30 smithi022 ceph-mon[18709]: pgmap v537: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 377 op/s 2024-08-20T01:37:31.056 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:37:31.056 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:37:31.319 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:31.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.827+0000 7f2ddc1d2640 1 -- 172.21.15.22:0/952911765 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2dd41073a0 msgr2=0x7f2dd41077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:31.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.827+0000 7f2ddc1d2640 1 --2- 172.21.15.22:0/952911765 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2dd41073a0 0x7f2dd41077e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4009900 tx=0x7f2dc402a3f0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.827+0000 7f2ddc1d2640 1 -- 172.21.15.22:0/952911765 shutdown_connections 2024-08-20T01:37:31.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.827+0000 7f2ddc1d2640 1 --2- 172.21.15.22:0/952911765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dd4107d20 0x7f2dd410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.827+0000 7f2ddc1d2640 1 --2- 172.21.15.22:0/952911765 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2dd41073a0 0x7f2dd41077e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.827+0000 7f2ddc1d2640 1 --2- 172.21.15.22:0/952911765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dd4101990 0x7f2dd4101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.827+0000 7f2ddc1d2640 1 -- 172.21.15.22:0/952911765 >> 172.21.15.22:0/952911765 conn(0x7f2dd40fd400 msgr2=0x7f2dd40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:31.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.827+0000 7f2ddc1d2640 1 -- 172.21.15.22:0/952911765 shutdown_connections 2024-08-20T01:37:31.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.827+0000 7f2ddc1d2640 1 -- 172.21.15.22:0/952911765 wait complete. 2024-08-20T01:37:31.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.828+0000 7f2ddc1d2640 1 Processor -- start 2024-08-20T01:37:31.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.828+0000 7f2ddc1d2640 1 -- start start 2024-08-20T01:37:31.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.828+0000 7f2ddc1d2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dd4101990 0x7f2dd40ff3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.829+0000 7f2ddc1d2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dd41073a0 0x7f2dd40fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.829+0000 7f2ddc1d2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2dd4107d20 0x7f2dd40fdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.829+0000 7f2ddc1d2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd41119e0 con 0x7f2dd4107d20 2024-08-20T01:37:31.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.829+0000 7f2dd9f6e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dd4101990 0x7f2dd40ff3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.829+0000 7f2dd9f6e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dd4101990 0x7f2dd40ff3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:33316/0 (socket says 172.21.15.22:33316) 2024-08-20T01:37:31.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.829+0000 7f2dd9f6e640 1 -- 172.21.15.22:0/1417789247 learned_addr learned my addr 172.21.15.22:0/1417789247 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:31.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.829+0000 7f2ddc1d2640 1 -- 172.21.15.22:0/1417789247 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd4111860 con 0x7f2dd4101990 2024-08-20T01:37:31.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.829+0000 7f2dd976d640 1 --2- 172.21.15.22:0/1417789247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dd41073a0 0x7f2dd40fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.829+0000 7f2dda76f640 1 --2- 172.21.15.22:0/1417789247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2dd4107d20 0x7f2dd40fdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.829+0000 7f2ddc1d2640 1 -- 172.21.15.22:0/1417789247 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd4111b60 con 0x7f2dd41073a0 2024-08-20T01:37:31.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.830+0000 7f2dd9f6e640 1 -- 172.21.15.22:0/1417789247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dd41073a0 msgr2=0x7f2dd40fd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:31.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.830+0000 7f2dd9f6e640 1 --2- 172.21.15.22:0/1417789247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dd41073a0 0x7f2dd40fd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.830+0000 7f2dd9f6e640 1 -- 172.21.15.22:0/1417789247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2dd4107d20 msgr2=0x7f2dd40fdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:31.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.830+0000 7f2dd9f6e640 1 --2- 172.21.15.22:0/1417789247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2dd4107d20 0x7f2dd40fdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.830+0000 7f2dd9f6e640 1 -- 172.21.15.22:0/1417789247 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd41ab980 con 0x7f2dd4101990 2024-08-20T01:37:31.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.830+0000 7f2dd9f6e640 1 --2- 172.21.15.22:0/1417789247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dd4101990 0x7f2dd40ff3b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2dd000d950 tx=0x7f2dd000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:31.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.830+0000 7f2dd976d640 1 --2- 172.21.15.22:0/1417789247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dd41073a0 0x7f2dd40fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:31.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.830+0000 7f2dcaffd640 1 -- 172.21.15.22:0/1417789247 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0017070 con 0x7f2dd4101990 2024-08-20T01:37:31.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.831+0000 7f2dcaffd640 1 -- 172.21.15.22:0/1417789247 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dd0009c30 con 0x7f2dd4101990 2024-08-20T01:37:31.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.831+0000 7f2dcaffd640 1 -- 172.21.15.22:0/1417789247 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd000f620 con 0x7f2dd4101990 2024-08-20T01:37:31.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.831+0000 7f2ddc1d2640 1 -- 172.21.15.22:0/1417789247 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd41abb50 con 0x7f2dd4101990 2024-08-20T01:37:31.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.831+0000 7f2ddc1d2640 1 -- 172.21.15.22:0/1417789247 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd41ac070 con 0x7f2dd4101990 2024-08-20T01:37:31.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.833+0000 7f2ddc1d2640 1 -- 172.21.15.22:0/1417789247 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd4101d70 con 0x7f2dd4101990 2024-08-20T01:37:31.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.835+0000 7f2dcaffd640 1 -- 172.21.15.22:0/1417789247 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2dd0004020 con 0x7f2dd4101990 2024-08-20T01:37:31.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.836+0000 7f2dcaffd640 1 --2- 172.21.15.22:0/1417789247 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2dc00b3cd0 0x7f2dc00b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.836+0000 7f2dcaffd640 1 -- 172.21.15.22:0/1417789247 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f2dd00e3520 con 0x7f2dd4101990 2024-08-20T01:37:31.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.836+0000 7f2dd976d640 1 --2- 172.21.15.22:0/1417789247 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2dc00b3cd0 0x7f2dc00b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.837+0000 7f2dd976d640 1 --2- 172.21.15.22:0/1417789247 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2dc00b3cd0 0x7f2dc00b6190 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4000c00 tx=0x7f2dc4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:31.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:31.842+0000 7f2dcaffd640 1 -- 172.21.15.22:0/1417789247 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f2dd00aab50 con 0x7f2dd4101990 2024-08-20T01:37:32.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:32.138+0000 7f2ddc1d2640 1 -- 172.21.15.22:0/1417789247 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2dd40fec00 con 0x7f2dd4101990 2024-08-20T01:37:32.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:32.139+0000 7f2dcaffd640 1 -- 172.21.15.22:0/1417789247 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11915 (secure 0 0 0) 0x7f2dd0009de0 con 0x7f2dd4101990 2024-08-20T01:37:32.141 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:37:32.141 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":31,"btime":"2024-08-20T01:36:38:097249+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:36:37.446760+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24586,24575,24565]},"id":1}]} 2024-08-20T01:37:32.142 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 31 2024-08-20T01:37:32.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:32.141+0000 7f2ddc1d2640 1 -- 172.21.15.22:0/1417789247 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2dc00b3cd0 msgr2=0x7f2dc00b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:32.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:32.141+0000 7f2ddc1d2640 1 --2- 172.21.15.22:0/1417789247 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2dc00b3cd0 0x7f2dc00b6190 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4000c00 tx=0x7f2dc4005a20 comp rx=0 tx=0).stop 2024-08-20T01:37:32.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:32.141+0000 7f2ddc1d2640 1 -- 172.21.15.22:0/1417789247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dd4101990 msgr2=0x7f2dd40ff3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:32.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:32.141+0000 7f2ddc1d2640 1 --2- 172.21.15.22:0/1417789247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dd4101990 0x7f2dd40ff3b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2dd000d950 tx=0x7f2dd000de10 comp rx=0 tx=0).stop 2024-08-20T01:37:32.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:32.141+0000 7f2ddc1d2640 1 -- 172.21.15.22:0/1417789247 shutdown_connections 2024-08-20T01:37:32.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:32.141+0000 7f2ddc1d2640 1 --2- 172.21.15.22:0/1417789247 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2dc00b3cd0 0x7f2dc00b6190 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:32.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:32.141+0000 7f2ddc1d2640 1 --2- 172.21.15.22:0/1417789247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2dd4107d20 0x7f2dd40fdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:32.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:32.141+0000 7f2ddc1d2640 1 --2- 172.21.15.22:0/1417789247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dd41073a0 0x7f2dd40fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:32.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:32.141+0000 7f2ddc1d2640 1 --2- 172.21.15.22:0/1417789247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dd4101990 0x7f2dd40ff3b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:32.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:32.141+0000 7f2ddc1d2640 1 -- 172.21.15.22:0/1417789247 >> 172.21.15.22:0/1417789247 conn(0x7f2dd40fd400 msgr2=0x7f2dd406aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:32.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:32.142+0000 7f2ddc1d2640 1 -- 172.21.15.22:0/1417789247 shutdown_connections 2024-08-20T01:37:32.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:32.142+0000 7f2ddc1d2640 1 -- 172.21.15.22:0/1417789247 wait complete. 2024-08-20T01:37:32.765 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:32 smithi022 ceph-mon[18709]: pgmap v538: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 403 op/s 2024-08-20T01:37:32.765 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:32 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1417789247' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:37:32.811 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:37:32.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:32 smithi077 ceph-mon[22251]: pgmap v538: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 403 op/s 2024-08-20T01:37:32.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:32 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1417789247' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:37:33.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:32 smithi134 ceph-mon[22511]: pgmap v538: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 403 op/s 2024-08-20T01:37:33.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:32 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1417789247' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:37:33.074 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:33.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.550+0000 7f55138d6640 1 -- 172.21.15.22:0/994472649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f550c102ad0 msgr2=0x7f550c102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:33.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.550+0000 7f55138d6640 1 --2- 172.21.15.22:0/994472649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f550c102ad0 0x7f550c102eb0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f5508009900 tx=0x7f550802a410 comp rx=0 tx=0).stop 2024-08-20T01:37:33.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.550+0000 7f55138d6640 1 -- 172.21.15.22:0/994472649 shutdown_connections 2024-08-20T01:37:33.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.550+0000 7f55138d6640 1 --2- 172.21.15.22:0/994472649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f550c108e60 0x7f550c10f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.550+0000 7f55138d6640 1 --2- 172.21.15.22:0/994472649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f550c1084e0 0x7f550c108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.550+0000 7f55138d6640 1 --2- 172.21.15.22:0/994472649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f550c102ad0 0x7f550c102eb0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.550+0000 7f55138d6640 1 -- 172.21.15.22:0/994472649 >> 172.21.15.22:0/994472649 conn(0x7f550c0fe540 msgr2=0x7f550c100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:33.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.550+0000 7f55138d6640 1 -- 172.21.15.22:0/994472649 shutdown_connections 2024-08-20T01:37:33.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.550+0000 7f55138d6640 1 -- 172.21.15.22:0/994472649 wait complete. 2024-08-20T01:37:33.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.551+0000 7f55138d6640 1 Processor -- start 2024-08-20T01:37:33.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.551+0000 7f55138d6640 1 -- start start 2024-08-20T01:37:33.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.551+0000 7f55138d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f550c102ad0 0x7f550c19b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.551+0000 7f55138d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f550c1084e0 0x7f550c19b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.551+0000 7f55138d6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f550c108e60 0x7f550c1a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.551+0000 7f55138d6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f550c112b20 con 0x7f550c108e60 2024-08-20T01:37:33.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.551+0000 7f55138d6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f550c1129a0 con 0x7f550c1084e0 2024-08-20T01:37:33.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.551+0000 7f55138d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f550c112ca0 con 0x7f550c102ad0 2024-08-20T01:37:33.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.551+0000 7f5511e73640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f550c108e60 0x7f550c1a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.551+0000 7f5511672640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f550c102ad0 0x7f550c19b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.551+0000 7f5511e73640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f550c108e60 0x7f550c1a0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47684/0 (socket says 172.21.15.22:47684) 2024-08-20T01:37:33.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.551+0000 7f5511e73640 1 -- 172.21.15.22:0/3925946402 learned_addr learned my addr 172.21.15.22:0/3925946402 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:33.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.551+0000 7f5510e71640 1 --2- 172.21.15.22:0/3925946402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f550c1084e0 0x7f550c19b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.551+0000 7f5511e73640 1 -- 172.21.15.22:0/3925946402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f550c102ad0 msgr2=0x7f550c19b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:33.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.551+0000 7f5511e73640 1 --2- 172.21.15.22:0/3925946402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f550c102ad0 0x7f550c19b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.551+0000 7f5511e73640 1 -- 172.21.15.22:0/3925946402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f550c1084e0 msgr2=0x7f550c19b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:33.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.551+0000 7f5511e73640 1 --2- 172.21.15.22:0/3925946402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f550c1084e0 0x7f550c19b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.551+0000 7f5511e73640 1 -- 172.21.15.22:0/3925946402 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550c1a1270 con 0x7f550c108e60 2024-08-20T01:37:33.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.552+0000 7f5511e73640 1 --2- 172.21.15.22:0/3925946402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f550c108e60 0x7f550c1a0aa0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f550400eb10 tx=0x7f550400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:33.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.552+0000 7f55027fc640 1 -- 172.21.15.22:0/3925946402 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5504004b20 con 0x7f550c108e60 2024-08-20T01:37:33.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.552+0000 7f55138d6640 1 -- 172.21.15.22:0/3925946402 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f550c1a1560 con 0x7f550c108e60 2024-08-20T01:37:33.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.552+0000 7f55027fc640 1 -- 172.21.15.22:0/3925946402 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5504004cc0 con 0x7f550c108e60 2024-08-20T01:37:33.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.552+0000 7f55027fc640 1 -- 172.21.15.22:0/3925946402 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5504010670 con 0x7f550c108e60 2024-08-20T01:37:33.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.552+0000 7f55138d6640 1 -- 172.21.15.22:0/3925946402 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f550c1a7c20 con 0x7f550c108e60 2024-08-20T01:37:33.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.554+0000 7f55027fc640 1 -- 172.21.15.22:0/3925946402 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5504005020 con 0x7f550c108e60 2024-08-20T01:37:33.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f5515ccf740 1 Processor -- start 2024-08-20T01:37:33.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f5515ccf740 1 -- start start 2024-08-20T01:37:33.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f5515ccf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 0x55708e48ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f5515ccf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e48f1a0 0x55708e49abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f5515ccf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e49b130 0x55708e49d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f5515ccf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55708e405930 con 0x55708e48e880 2024-08-20T01:37:33.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f5515ccf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55708e3f4e30 con 0x55708e48f1a0 2024-08-20T01:37:33.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f5515ccf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55708e3f8e70 con 0x55708e49b130 2024-08-20T01:37:33.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f5510e71640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 0x55708e48ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f5510e71640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 0x55708e48ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47700/0 (socket says 172.21.15.22:47700) 2024-08-20T01:37:33.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f5511672640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e48f1a0 0x55708e49abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f5510e71640 1 -- 172.21.15.22:0/102850230 learned_addr learned my addr 172.21.15.22:0/102850230 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:33.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f5510e71640 1 --2- 172.21.15.22:0/102850230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e49b130 0x55708e49d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f55027fc640 1 --2- 172.21.15.22:0/3925946402 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f54f80b3bd0 0x7f54f80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f5510e71640 1 -- 172.21.15.22:0/102850230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e49b130 msgr2=0x55708e49d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:33.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f5510e71640 1 --2- 172.21.15.22:0/102850230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e49b130 0x55708e49d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f5510e71640 1 -- 172.21.15.22:0/102850230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e48f1a0 msgr2=0x55708e49abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:33.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f5510e71640 1 --2- 172.21.15.22:0/102850230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e48f1a0 0x55708e49abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f5510e71640 1 -- 172.21.15.22:0/102850230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55708e154650 con 0x55708e48e880 2024-08-20T01:37:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.555+0000 7f5511e73640 1 --2- 172.21.15.22:0/3925946402 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f54f80b3bd0 0x7f54f80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.556+0000 7f5510e71640 1 --2- 172.21.15.22:0/102850230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 0x55708e48ec60 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f54fc0135d0 tx=0x7f54fc009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ebee1fb90f9eae server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.556+0000 7f55027fc640 1 -- 172.21.15.22:0/3925946402 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f55040e4260 con 0x7f550c108e60 2024-08-20T01:37:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.556+0000 7f54f77fe640 1 -- 172.21.15.22:0/102850230 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc004050 con 0x55708e48e880 2024-08-20T01:37:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.556+0000 7f54f77fe640 1 -- 172.21.15.22:0/102850230 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54fc0054d0 con 0x55708e48e880 2024-08-20T01:37:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.556+0000 7f54f77fe640 1 -- 172.21.15.22:0/102850230 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc004b10 con 0x55708e48e880 2024-08-20T01:37:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.557+0000 7f5515ccf740 1 -- 172.21.15.22:0/102850230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 msgr2=0x55708e48ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.557+0000 7f5511e73640 1 --2- 172.21.15.22:0/3925946402 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f54f80b3bd0 0x7f54f80b6090 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f55040ab0a0 tx=0x7f550401bd20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.557+0000 7f5515ccf740 1 --2- 172.21.15.22:0/102850230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 0x55708e48ec60 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f54fc0135d0 tx=0x7f54fc009830 comp rx=0 tx=0).stop 2024-08-20T01:37:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.557+0000 7f5515ccf740 1 -- 172.21.15.22:0/102850230 shutdown_connections 2024-08-20T01:37:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.557+0000 7f5515ccf740 1 --2- 172.21.15.22:0/102850230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e49b130 0x55708e49d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.557+0000 7f5515ccf740 1 --2- 172.21.15.22:0/102850230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e48f1a0 0x55708e49abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.557+0000 7f5515ccf740 1 --2- 172.21.15.22:0/102850230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 0x55708e48ec60 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.557+0000 7f5515ccf740 1 -- 172.21.15.22:0/102850230 >> 172.21.15.22:0/102850230 conn(0x55708e48c6b0 msgr2=0x55708e48d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:33.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.557+0000 7f5515ccf740 1 -- 172.21.15.22:0/102850230 shutdown_connections 2024-08-20T01:37:33.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.557+0000 7f5515ccf740 1 -- 172.21.15.22:0/102850230 wait complete. 2024-08-20T01:37:33.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.557+0000 7f5515ccf740 1 -- start start 2024-08-20T01:37:33.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.557+0000 7f5515ccf740 1 Processor -- start 2024-08-20T01:37:33.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.558+0000 7f5515ccf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e48e880 0x55708e4980f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.558+0000 7f5515ccf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e48f1a0 0x55708e498630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.558+0000 7f5515ccf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e49b130 0x55708e498b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.558+0000 7f5515ccf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55708e257700 con 0x55708e49b130 2024-08-20T01:37:33.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.558+0000 7f5515ccf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55708e37b810 con 0x55708e48f1a0 2024-08-20T01:37:33.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.558+0000 7f5515ccf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55708e49dde0 con 0x55708e48e880 2024-08-20T01:37:33.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.558+0000 7f5515ccf740 10 client.0 _ll_register_callbacks cb 0x55708e3ee700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:33.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.558+0000 7f5510e71640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e49b130 0x55708e498b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.558+0000 7f5511672640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e48f1a0 0x55708e498630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.558+0000 7f5510e71640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e48e880 0x55708e4980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.558+0000 7f5511672640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e48f1a0 0x55708e498630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:33364/0 (socket says 172.21.15.22:33364) 2024-08-20T01:37:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.558+0000 7f5511672640 1 -- 172.21.15.22:0/760454205 learned_addr learned my addr 172.21.15.22:0/760454205 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.558+0000 7f5511672640 1 -- 172.21.15.22:0/760454205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e48e880 msgr2=0x55708e4980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.558+0000 7f5511672640 1 --2- 172.21.15.22:0/760454205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e48e880 0x55708e4980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.558+0000 7f5511672640 1 -- 172.21.15.22:0/760454205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e49b130 msgr2=0x55708e498b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.558+0000 7f5511672640 1 --2- 172.21.15.22:0/760454205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e49b130 0x55708e498b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.558+0000 7f5511672640 1 -- 172.21.15.22:0/760454205 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55708e4a71c0 con 0x55708e48f1a0 2024-08-20T01:37:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.558+0000 7f5511672640 1 --2- 172.21.15.22:0/760454205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e48f1a0 0x55708e498630 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f550802a930 tx=0x7f5508032f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=935e6b10ea17089f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.558+0000 7f54f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:37:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.559+0000 7f54f4ff9640 1 -- 172.21.15.22:0/760454205 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5508035040 con 0x55708e48f1a0 2024-08-20T01:37:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.559+0000 7f54f4ff9640 1 -- 172.21.15.22:0/760454205 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f5508031720 con 0x55708e48f1a0 2024-08-20T01:37:33.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.559+0000 7f5515ccf740 1 -- 172.21.15.22:0/760454205 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55708e3a4150 con 0x55708e48f1a0 2024-08-20T01:37:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.559+0000 7f54f4ff9640 1 -- 172.21.15.22:0/760454205 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5508031920 con 0x55708e48f1a0 2024-08-20T01:37:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.559+0000 7f5515ccf740 10 client.25958 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.559+0000 7f5515ccf740 1 -- 172.21.15.22:0/760454205 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55708e4a9b70 con 0x55708e48f1a0 2024-08-20T01:37:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.559+0000 7f54f4ff9640 1 -- 172.21.15.22:0/760454205 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55708e3a4150 con 0x55708e48f1a0 2024-08-20T01:37:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.559+0000 7f54f4ff9640 1 -- 172.21.15.22:0/760454205 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f55080047e0 con 0x55708e48f1a0 2024-08-20T01:37:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.559+0000 7f5515ccf740 10 client.25958 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.559+0000 7f5515ccf740 10 client.25958 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:37:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.559+0000 7f5515ccf740 20 client.25958 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.559+0000 7f5515ccf740 1 --2- 172.21.15.22:0/760454205 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55708e4aafe0 0x55708e4ad400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.559+0000 7f5515ccf740 4 client.25958 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.559+0000 7f5515ccf740 1 -- 172.21.15.22:0/760454205 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55708e407880 con 0x55708e4aafe0 2024-08-20T01:37:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.560+0000 7f5510e71640 1 --2- 172.21.15.22:0/760454205 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55708e4aafe0 0x55708e4ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.560+0000 7f54f4ff9640 10 client.25958 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:37:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.560+0000 7f5510e71640 1 --2- 172.21.15.22:0/760454205 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55708e4aafe0 0x55708e4ad400 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b70ef644925b0643 server_cookie=1cac422fefaa10f0 in_seq=0 out_seq=0 2024-08-20T01:37:33.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.590+0000 7f54f4ff9640 1 -- 172.21.15.22:0/760454205 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55708e407880 con 0x55708e4aafe0 2024-08-20T01:37:33.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.590+0000 7f54f4ff9640 10 client.25958 handle_command_reply: tid=0 2024-08-20T01:37:33.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.590+0000 7f5515ccf740 1 client.25958 shutdown 2024-08-20T01:37:33.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.590+0000 7f5515ccf740 1 -- 172.21.15.22:0/760454205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e48f1a0 msgr2=0x55708e498630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:33.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.590+0000 7f5515ccf740 1 --2- 172.21.15.22:0/760454205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e48f1a0 0x55708e498630 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f550802a930 tx=0x7f5508032f00 comp rx=0 tx=0).stop 2024-08-20T01:37:33.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.590+0000 7f5515ccf740 1 -- 172.21.15.22:0/760454205 shutdown_connections 2024-08-20T01:37:33.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.590+0000 7f5515ccf740 1 --2- 172.21.15.22:0/760454205 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55708e4aafe0 0x55708e4ad400 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.590+0000 7f5515ccf740 1 --2- 172.21.15.22:0/760454205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e49b130 0x55708e498b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.590+0000 7f5515ccf740 1 --2- 172.21.15.22:0/760454205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e48f1a0 0x55708e498630 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.590+0000 7f54f4ff9640 0 client.25958 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:37:33.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.590+0000 7f5515ccf740 1 --2- 172.21.15.22:0/760454205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e48e880 0x55708e4980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.590+0000 7f5515ccf740 1 -- 172.21.15.22:0/760454205 >> 172.21.15.22:0/760454205 conn(0x55708e48c6b0 msgr2=0x55708e492220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:33.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.590+0000 7f5515ccf740 1 -- 172.21.15.22:0/760454205 shutdown_connections 2024-08-20T01:37:33.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.590+0000 7f5515ccf740 1 -- 172.21.15.22:0/760454205 wait complete. 2024-08-20T01:37:33.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.590+0000 7f5515ccf740 20 client.25958 trim_cache size 0 max 16384 2024-08-20T01:37:33.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.605+0000 7f5515ccf740 1 Processor -- start 2024-08-20T01:37:33.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.605+0000 7f5515ccf740 1 -- start start 2024-08-20T01:37:33.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.605+0000 7f5515ccf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 0x55708e4a6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.605+0000 7f5515ccf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e48f1a0 0x55708e4a6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.605+0000 7f5515ccf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e49b130 0x55708e4b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.605+0000 7f5515ccf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f550c1b2d30 con 0x55708e48e880 2024-08-20T01:37:33.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.605+0000 7f5515ccf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f550c1b0540 con 0x55708e49b130 2024-08-20T01:37:33.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.605+0000 7f5515ccf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f550c1ae390 con 0x55708e48f1a0 2024-08-20T01:37:33.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.605+0000 7f5510e71640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 0x55708e4a6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.605+0000 7f5510e71640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 0x55708e4a6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47704/0 (socket says 172.21.15.22:47704) 2024-08-20T01:37:33.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.605+0000 7f5510e71640 1 -- 172.21.15.22:0/1778089673 learned_addr learned my addr 172.21.15.22:0/1778089673 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:33.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.605+0000 7f5511672640 1 --2- 172.21.15.22:0/1778089673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e48f1a0 0x55708e4a6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.605+0000 7f5510e71640 1 --2- 172.21.15.22:0/1778089673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e49b130 0x55708e4b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.606+0000 7f5510e71640 1 -- 172.21.15.22:0/1778089673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e48f1a0 msgr2=0x55708e4a6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:33.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.606+0000 7f5510e71640 1 --2- 172.21.15.22:0/1778089673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e48f1a0 0x55708e4a6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.606+0000 7f5510e71640 1 -- 172.21.15.22:0/1778089673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e49b130 msgr2=0x55708e4b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:33.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.606+0000 7f5510e71640 1 --2- 172.21.15.22:0/1778089673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e49b130 0x55708e4b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.606+0000 7f5510e71640 1 -- 172.21.15.22:0/1778089673 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55708e48c4e0 con 0x55708e48e880 2024-08-20T01:37:33.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.606+0000 7f5510e71640 1 --2- 172.21.15.22:0/1778089673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 0x55708e4a6600 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f54fc009ed0 tx=0x7f54fc005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da104f6d6162408 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:33.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.606+0000 7f54f6ffd640 1 -- 172.21.15.22:0/1778089673 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc028040 con 0x55708e48e880 2024-08-20T01:37:33.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.606+0000 7f54f6ffd640 1 -- 172.21.15.22:0/1778089673 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54fc0047a0 con 0x55708e48e880 2024-08-20T01:37:33.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.606+0000 7f54f6ffd640 1 -- 172.21.15.22:0/1778089673 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc00f7e0 con 0x55708e48e880 2024-08-20T01:37:33.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.607+0000 7f5515ccf740 1 -- 172.21.15.22:0/1778089673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 msgr2=0x55708e4a6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:33.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.607+0000 7f5515ccf740 1 --2- 172.21.15.22:0/1778089673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 0x55708e4a6600 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f54fc009ed0 tx=0x7f54fc005f90 comp rx=0 tx=0).stop 2024-08-20T01:37:33.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.607+0000 7f5515ccf740 1 -- 172.21.15.22:0/1778089673 shutdown_connections 2024-08-20T01:37:33.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.607+0000 7f5515ccf740 1 --2- 172.21.15.22:0/1778089673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e49b130 0x55708e4b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.607+0000 7f5515ccf740 1 --2- 172.21.15.22:0/1778089673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e48f1a0 0x55708e4a6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.607+0000 7f5515ccf740 1 --2- 172.21.15.22:0/1778089673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 0x55708e4a6600 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.607+0000 7f5515ccf740 1 -- 172.21.15.22:0/1778089673 >> 172.21.15.22:0/1778089673 conn(0x55708e48c6b0 msgr2=0x55708e4a5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:33.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.607+0000 7f5515ccf740 1 -- 172.21.15.22:0/1778089673 shutdown_connections 2024-08-20T01:37:33.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.607+0000 7f5515ccf740 1 -- 172.21.15.22:0/1778089673 wait complete. 2024-08-20T01:37:33.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.607+0000 7f5515ccf740 1 -- start start 2024-08-20T01:37:33.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.607+0000 7f5515ccf740 1 Processor -- start 2024-08-20T01:37:33.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.608+0000 7f5515ccf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 0x55708e4a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.608+0000 7f5515ccf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e48f1a0 0x55708e4a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.608+0000 7f5515ccf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e49b130 0x55708e4a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.608+0000 7f5515ccf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f550c1aea00 con 0x55708e48e880 2024-08-20T01:37:33.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.608+0000 7f5515ccf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f550c1afe70 con 0x55708e48f1a0 2024-08-20T01:37:33.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.608+0000 7f5515ccf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f550c1af0d0 con 0x55708e49b130 2024-08-20T01:37:33.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.608+0000 7f5515ccf740 10 client.0 _ll_register_callbacks cb 0x7f5508009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:33.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.608+0000 7f5510e71640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 0x55708e4a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.608+0000 7f5510e71640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 0x55708e4a35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47710/0 (socket says 172.21.15.22:47710) 2024-08-20T01:37:33.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.608+0000 7f5510e71640 1 -- 172.21.15.22:0/4058277801 learned_addr learned my addr 172.21.15.22:0/4058277801 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:33.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.608+0000 7f5511672640 1 --2- 172.21.15.22:0/4058277801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e48f1a0 0x55708e4a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.608+0000 7f5510e71640 1 --2- 172.21.15.22:0/4058277801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e49b130 0x55708e4a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.608+0000 7f5511672640 1 -- 172.21.15.22:0/4058277801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e49b130 msgr2=0x55708e4a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:33.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.608+0000 7f5511672640 1 --2- 172.21.15.22:0/4058277801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e49b130 0x55708e4a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.608+0000 7f5511672640 1 -- 172.21.15.22:0/4058277801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 msgr2=0x55708e4a35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:33.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.608+0000 7f5511672640 1 --2- 172.21.15.22:0/4058277801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 0x55708e4a35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.608+0000 7f5511672640 1 -- 172.21.15.22:0/4058277801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55708e48d130 con 0x55708e48f1a0 2024-08-20T01:37:33.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.608+0000 7f5511672640 1 --2- 172.21.15.22:0/4058277801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e48f1a0 0x55708e4a0ab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5508009900 tx=0x7f5508005b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1911d8d7611f5029 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:33.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.608+0000 7f54f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:37:33.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.609+0000 7f54f4ff9640 1 -- 172.21.15.22:0/4058277801 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5508035040 con 0x55708e48f1a0 2024-08-20T01:37:33.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.609+0000 7f54f4ff9640 1 -- 172.21.15.22:0/4058277801 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f5508031ac0 con 0x55708e48f1a0 2024-08-20T01:37:33.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.609+0000 7f5515ccf740 1 -- 172.21.15.22:0/4058277801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54fc0047a0 con 0x55708e48f1a0 2024-08-20T01:37:33.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.609+0000 7f54f4ff9640 1 -- 172.21.15.22:0/4058277801 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5508031ce0 con 0x55708e48f1a0 2024-08-20T01:37:33.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.609+0000 7f5515ccf740 10 client.25964 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:33.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.609+0000 7f5515ccf740 1 -- 172.21.15.22:0/4058277801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55708e515a00 con 0x55708e48f1a0 2024-08-20T01:37:33.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.609+0000 7f54f4ff9640 1 -- 172.21.15.22:0/4058277801 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54fc0047a0 con 0x55708e48f1a0 2024-08-20T01:37:33.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.609+0000 7f54f4ff9640 1 -- 172.21.15.22:0/4058277801 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f5508005160 con 0x55708e48f1a0 2024-08-20T01:37:33.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.609+0000 7f5515ccf740 10 client.25964 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:33.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.609+0000 7f5515ccf740 10 client.25964 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:37:33.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.609+0000 7f5515ccf740 20 client.25964 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:33.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.609+0000 7f5515ccf740 1 --2- 172.21.15.22:0/4058277801 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55708e516230 0x55708e518650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.609+0000 7f5515ccf740 4 client.25964 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:37:33.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.609+0000 7f5515ccf740 1 -- 172.21.15.22:0/4058277801 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55708e403320 con 0x55708e516230 2024-08-20T01:37:33.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.609+0000 7f5510e71640 1 --2- 172.21.15.22:0/4058277801 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55708e516230 0x55708e518650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.610+0000 7f5510e71640 1 --2- 172.21.15.22:0/4058277801 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55708e516230 0x55708e518650 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1aa4df6d91fdfb22 server_cookie=a0d287bab8525d90 in_seq=0 out_seq=0 2024-08-20T01:37:33.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.610+0000 7f54f4ff9640 10 client.25964 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:37:33.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.682+0000 7f54f4ff9640 1 -- 172.21.15.22:0/4058277801 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55708e403320 con 0x55708e516230 2024-08-20T01:37:33.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.682+0000 7f54f4ff9640 10 client.25964 handle_command_reply: tid=0 2024-08-20T01:37:33.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.682+0000 7f5515ccf740 1 client.25964 shutdown 2024-08-20T01:37:33.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.682+0000 7f5515ccf740 1 -- 172.21.15.22:0/4058277801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e48f1a0 msgr2=0x55708e4a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:33.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.682+0000 7f5515ccf740 1 --2- 172.21.15.22:0/4058277801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e48f1a0 0x55708e4a0ab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5508009900 tx=0x7f5508005b50 comp rx=0 tx=0).stop 2024-08-20T01:37:33.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.682+0000 7f5515ccf740 1 -- 172.21.15.22:0/4058277801 shutdown_connections 2024-08-20T01:37:33.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.682+0000 7f5515ccf740 1 --2- 172.21.15.22:0/4058277801 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55708e516230 0x55708e518650 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.682+0000 7f5515ccf740 1 --2- 172.21.15.22:0/4058277801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55708e49b130 0x55708e4a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.682+0000 7f54f4ff9640 0 client.25964 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:37:33.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.682+0000 7f5515ccf740 1 --2- 172.21.15.22:0/4058277801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55708e48f1a0 0x55708e4a0ab0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.682+0000 7f5515ccf740 1 --2- 172.21.15.22:0/4058277801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55708e48e880 0x55708e4a35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.682+0000 7f5515ccf740 1 -- 172.21.15.22:0/4058277801 >> 172.21.15.22:0/4058277801 conn(0x55708e48c6b0 msgr2=0x55708e4a6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:33.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.683+0000 7f5515ccf740 1 -- 172.21.15.22:0/4058277801 shutdown_connections 2024-08-20T01:37:33.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.683+0000 7f5515ccf740 1 -- 172.21.15.22:0/4058277801 wait complete. 2024-08-20T01:37:33.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.683+0000 7f5515ccf740 20 client.25964 trim_cache size 0 max 16384 2024-08-20T01:37:33.686 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:37:33.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.684+0000 7f55138d6640 1 -- 172.21.15.22:0/3925946402 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f54f80b3bd0 msgr2=0x7f54f80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:33.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.684+0000 7f55138d6640 1 --2- 172.21.15.22:0/3925946402 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f54f80b3bd0 0x7f54f80b6090 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f55040ab0a0 tx=0x7f550401bd20 comp rx=0 tx=0).stop 2024-08-20T01:37:33.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.684+0000 7f55138d6640 1 -- 172.21.15.22:0/3925946402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f550c108e60 msgr2=0x7f550c1a0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:33.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.684+0000 7f55138d6640 1 --2- 172.21.15.22:0/3925946402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f550c108e60 0x7f550c1a0aa0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f550400eb10 tx=0x7f550400c2d0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.684+0000 7f55138d6640 1 -- 172.21.15.22:0/3925946402 shutdown_connections 2024-08-20T01:37:33.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.684+0000 7f55138d6640 1 --2- 172.21.15.22:0/3925946402 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f54f80b3bd0 0x7f54f80b6090 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.684+0000 7f55138d6640 1 --2- 172.21.15.22:0/3925946402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f550c108e60 0x7f550c1a0aa0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.684+0000 7f55138d6640 1 --2- 172.21.15.22:0/3925946402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f550c1084e0 0x7f550c19b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.684+0000 7f55138d6640 1 --2- 172.21.15.22:0/3925946402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f550c102ad0 0x7f550c19b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.684+0000 7f55138d6640 1 -- 172.21.15.22:0/3925946402 >> 172.21.15.22:0/3925946402 conn(0x7f550c0fe540 msgr2=0x7f550c104a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:33.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.684+0000 7f55138d6640 1 -- 172.21.15.22:0/3925946402 shutdown_connections 2024-08-20T01:37:33.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:33.684+0000 7f55138d6640 1 -- 172.21.15.22:0/3925946402 wait complete. 2024-08-20T01:37:34.461 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:37:34.734 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:34.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:34 smithi077 ceph-mon[22251]: pgmap v539: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 447 op/s 2024-08-20T01:37:34.855 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:34 smithi022 ceph-mon[18709]: pgmap v539: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 447 op/s 2024-08-20T01:37:35.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:34 smithi134 ceph-mon[22511]: pgmap v539: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 447 op/s 2024-08-20T01:37:35.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.246+0000 7f2ae88da640 1 -- 172.21.15.22:0/4077002112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae4108e60 msgr2=0x7f2ae410f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:35.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.246+0000 7f2ae88da640 1 --2- 172.21.15.22:0/4077002112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae4108e60 0x7f2ae410f660 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009900 tx=0x7f2ad402a410 comp rx=0 tx=0).stop 2024-08-20T01:37:35.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.246+0000 7f2ae88da640 1 -- 172.21.15.22:0/4077002112 shutdown_connections 2024-08-20T01:37:35.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.246+0000 7f2ae88da640 1 --2- 172.21.15.22:0/4077002112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae4108e60 0x7f2ae410f660 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.246+0000 7f2ae88da640 1 --2- 172.21.15.22:0/4077002112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ae41084e0 0x7f2ae4108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.246+0000 7f2ae88da640 1 --2- 172.21.15.22:0/4077002112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ae4102ad0 0x7f2ae4102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.246+0000 7f2ae88da640 1 -- 172.21.15.22:0/4077002112 >> 172.21.15.22:0/4077002112 conn(0x7f2ae40fe540 msgr2=0x7f2ae4100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:35.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.247+0000 7f2ae88da640 1 -- 172.21.15.22:0/4077002112 shutdown_connections 2024-08-20T01:37:35.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.247+0000 7f2ae88da640 1 -- 172.21.15.22:0/4077002112 wait complete. 2024-08-20T01:37:35.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.247+0000 7f2ae88da640 1 Processor -- start 2024-08-20T01:37:35.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.247+0000 7f2ae88da640 1 -- start start 2024-08-20T01:37:35.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.247+0000 7f2ae88da640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ae4102ad0 0x7f2ae40751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.247+0000 7f2ae88da640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae41084e0 0x7f2ae4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2ae88da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ae4108e60 0x7f2ae4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2ae88da640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae4112b70 con 0x7f2ae41084e0 2024-08-20T01:37:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2ae88da640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae41129f0 con 0x7f2ae4108e60 2024-08-20T01:37:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2ae88da640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae4112cf0 con 0x7f2ae4102ad0 2024-08-20T01:37:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2ae1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae41084e0 0x7f2ae4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2ae1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae41084e0 0x7f2ae4075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47732/0 (socket says 172.21.15.22:47732) 2024-08-20T01:37:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/725647167 learned_addr learned my addr 172.21.15.22:0/725647167 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2ae259c640 1 --2- 172.21.15.22:0/725647167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ae4102ad0 0x7f2ae40751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2ae2d9d640 1 --2- 172.21.15.22:0/725647167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ae4108e60 0x7f2ae4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/725647167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ae4102ad0 msgr2=0x7f2ae40751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2ae1d9b640 1 --2- 172.21.15.22:0/725647167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ae4102ad0 0x7f2ae40751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/725647167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ae4108e60 msgr2=0x7f2ae4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2ae1d9b640 1 --2- 172.21.15.22:0/725647167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ae4108e60 0x7f2ae4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/725647167 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae41a7380 con 0x7f2ae41084e0 2024-08-20T01:37:35.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2ae1d9b640 1 --2- 172.21.15.22:0/725647167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae41084e0 0x7f2ae4075710 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00e9f0 tx=0x7f2acc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:35.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2adb7fe640 1 -- 172.21.15.22:0/725647167 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc00cd80 con 0x7f2ae41084e0 2024-08-20T01:37:35.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2ae88da640 1 -- 172.21.15.22:0/725647167 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae41a7670 con 0x7f2ae41084e0 2024-08-20T01:37:35.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2adb7fe640 1 -- 172.21.15.22:0/725647167 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2acc0108e0 con 0x7f2ae41084e0 2024-08-20T01:37:35.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2adb7fe640 1 -- 172.21.15.22:0/725647167 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc018980 con 0x7f2ae41084e0 2024-08-20T01:37:35.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.248+0000 7f2ae88da640 1 -- 172.21.15.22:0/725647167 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae41a7bb0 con 0x7f2ae41084e0 2024-08-20T01:37:35.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.251+0000 7f2aeacd3740 1 Processor -- start 2024-08-20T01:37:35.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.251+0000 7f2aeacd3740 1 -- start start 2024-08-20T01:37:35.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.251+0000 7f2adb7fe640 1 -- 172.21.15.22:0/725647167 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2acc010430 con 0x7f2ae41084e0 2024-08-20T01:37:35.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.251+0000 7f2aeacd3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d28880 0x558614d28c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.251+0000 7f2aeacd3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d291a0 0x558614d34bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.251+0000 7f2aeacd3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d35130 0x558614d37520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.251+0000 7f2aeacd3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558614c9f930 con 0x558614d35130 2024-08-20T01:37:35.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.251+0000 7f2aeacd3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558614c8ee30 con 0x558614d291a0 2024-08-20T01:37:35.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.251+0000 7f2aeacd3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558614c92e70 con 0x558614d28880 2024-08-20T01:37:35.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.251+0000 7f2ae1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d35130 0x558614d37520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.251+0000 7f2ae2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d28880 0x558614d28c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.251+0000 7f2ae1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d35130 0x558614d37520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47748/0 (socket says 172.21.15.22:47748) 2024-08-20T01:37:35.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.251+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/3593299919 learned_addr learned my addr 172.21.15.22:0/3593299919 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:35.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.251+0000 7f2ae2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d28880 0x558614d28c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:60184/0 (socket says 172.21.15.22:60184) 2024-08-20T01:37:35.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.252+0000 7f2ae259c640 1 --2- 172.21.15.22:0/3593299919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d291a0 0x558614d34bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.252+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/3593299919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d28880 msgr2=0x558614d28c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:35.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.252+0000 7f2ae1d9b640 1 --2- 172.21.15.22:0/3593299919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d28880 0x558614d28c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.252+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/3593299919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d291a0 msgr2=0x558614d34bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:35.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.252+0000 7f2ae1d9b640 1 --2- 172.21.15.22:0/3593299919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d291a0 0x558614d34bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.252+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/3593299919 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586149ee650 con 0x558614d35130 2024-08-20T01:37:35.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.252+0000 7f2adb7fe640 1 --2- 172.21.15.22:0/725647167 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2ad00b3bd0 0x7f2ad00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.252+0000 7f2ae1d9b640 1 --2- 172.21.15.22:0/3593299919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d35130 0x558614d37520 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0ec160 tx=0x7f2acc0ec620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1069dfb66c1560be server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.252+0000 7f2ae2d9d640 1 --2- 172.21.15.22:0/725647167 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2ad00b3bd0 0x7f2ad00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.252+0000 7f2ad8ff9640 1 -- 172.21.15.22:0/3593299919 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0f7070 con 0x558614d35130 2024-08-20T01:37:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.252+0000 7f2adb7fe640 1 -- 172.21.15.22:0/725647167 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f2acc0e3f40 con 0x7f2ae41084e0 2024-08-20T01:37:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.253+0000 7f2ad8ff9640 1 -- 172.21.15.22:0/3593299919 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2acc0ece50 con 0x558614d35130 2024-08-20T01:37:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.253+0000 7f2ad8ff9640 1 -- 172.21.15.22:0/3593299919 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0aa850 con 0x558614d35130 2024-08-20T01:37:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.253+0000 7f2aeacd3740 1 -- 172.21.15.22:0/3593299919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d35130 msgr2=0x558614d37520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.253+0000 7f2ae2d9d640 1 --2- 172.21.15.22:0/725647167 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2ad00b3bd0 0x7f2ad00b6090 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4077290 tx=0x7f2ad4005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.253+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/3593299919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d35130 0x558614d37520 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0ec160 tx=0x7f2acc0ec620 comp rx=0 tx=0).stop 2024-08-20T01:37:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.253+0000 7f2aeacd3740 1 -- 172.21.15.22:0/3593299919 shutdown_connections 2024-08-20T01:37:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.253+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/3593299919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d35130 0x558614d37520 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.253+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/3593299919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d291a0 0x558614d34bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.253+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/3593299919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d28880 0x558614d28c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.253+0000 7f2aeacd3740 1 -- 172.21.15.22:0/3593299919 >> 172.21.15.22:0/3593299919 conn(0x558614d266b0 msgr2=0x558614d27850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:35.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.253+0000 7f2aeacd3740 1 -- 172.21.15.22:0/3593299919 shutdown_connections 2024-08-20T01:37:35.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.254+0000 7f2aeacd3740 1 -- 172.21.15.22:0/3593299919 wait complete. 2024-08-20T01:37:35.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.254+0000 7f2aeacd3740 1 -- start start 2024-08-20T01:37:35.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.254+0000 7f2aeacd3740 1 Processor -- start 2024-08-20T01:37:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.254+0000 7f2aeacd3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d28880 0x558614d320b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.254+0000 7f2aeacd3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 0x558614d325f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.254+0000 7f2aeacd3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d35130 0x558614d32b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.254+0000 7f2aeacd3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558614af1700 con 0x558614d291a0 2024-08-20T01:37:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.254+0000 7f2aeacd3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558614c15810 con 0x558614d28880 2024-08-20T01:37:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.254+0000 7f2aeacd3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558614d37de0 con 0x558614d35130 2024-08-20T01:37:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.254+0000 7f2aeacd3740 10 client.0 _ll_register_callbacks cb 0x558614c88700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.254+0000 7f2ae1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 0x558614d325f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.254+0000 7f2ae259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d28880 0x558614d320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.254+0000 7f2ae1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 0x558614d325f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47764/0 (socket says 172.21.15.22:47764) 2024-08-20T01:37:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.254+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/3758406788 learned_addr learned my addr 172.21.15.22:0/3758406788 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.254+0000 7f2ae2d9d640 1 --2- 172.21.15.22:0/3758406788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d35130 0x558614d32b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.255+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/3758406788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d35130 msgr2=0x558614d32b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.255+0000 7f2ae1d9b640 1 --2- 172.21.15.22:0/3758406788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d35130 0x558614d32b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.255+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/3758406788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d28880 msgr2=0x558614d320b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.255+0000 7f2ae1d9b640 1 --2- 172.21.15.22:0/3758406788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d28880 0x558614d320b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.255+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/3758406788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558614d41190 con 0x558614d291a0 2024-08-20T01:37:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.255+0000 7f2ae259c640 1 --2- 172.21.15.22:0/3758406788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d28880 0x558614d320b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.255+0000 7f2ae1d9b640 1 --2- 172.21.15.22:0/3758406788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 0x558614d325f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0a8170 tx=0x7f2acc00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ea9c36a1c3633d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.255+0000 7f2ac9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:37:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.255+0000 7f2ac9ffb640 1 -- 172.21.15.22:0/3758406788 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0aa670 con 0x558614d291a0 2024-08-20T01:37:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.255+0000 7f2ac9ffb640 1 -- 172.21.15.22:0/3758406788 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f2acc0e7b50 con 0x558614d291a0 2024-08-20T01:37:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.255+0000 7f2aeacd3740 1 -- 172.21.15.22:0/3758406788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558614c3e150 con 0x558614d291a0 2024-08-20T01:37:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.255+0000 7f2ac9ffb640 1 -- 172.21.15.22:0/3758406788 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2acc0aa850 con 0x558614d291a0 2024-08-20T01:37:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.255+0000 7f2aeacd3740 10 client.16338 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:35.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.255+0000 7f2aeacd3740 1 -- 172.21.15.22:0/3758406788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558614d43b20 con 0x558614d291a0 2024-08-20T01:37:35.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.256+0000 7f2ac9ffb640 1 -- 172.21.15.22:0/3758406788 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558614c3e150 con 0x558614d291a0 2024-08-20T01:37:35.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.256+0000 7f2ac9ffb640 1 -- 172.21.15.22:0/3758406788 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f2acc01abf0 con 0x558614d291a0 2024-08-20T01:37:35.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.256+0000 7f2aeacd3740 10 client.16338 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:35.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.256+0000 7f2aeacd3740 10 client.16338 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:37:35.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.256+0000 7f2aeacd3740 20 client.16338 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:35.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.256+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/3758406788 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x558614d44e70 0x558614d47260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.256+0000 7f2aeacd3740 4 client.16338 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:35.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.256+0000 7f2aeacd3740 1 -- 172.21.15.22:0/3758406788 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558614ca1880 con 0x558614d44e70 2024-08-20T01:37:35.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.256+0000 7f2ae259c640 1 --2- 172.21.15.22:0/3758406788 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x558614d44e70 0x558614d47260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.256+0000 7f2ac9ffb640 10 client.16338 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:37:35.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.256+0000 7f2ae259c640 1 --2- 172.21.15.22:0/3758406788 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x558614d44e70 0x558614d47260 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fdb1b19f4345ccf8 server_cookie=847bb15c9785edad in_seq=0 out_seq=0 2024-08-20T01:37:35.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.257+0000 7f2ac9ffb640 1 -- 172.21.15.22:0/3758406788 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558614ca1880 con 0x558614d44e70 2024-08-20T01:37:35.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.257+0000 7f2ac9ffb640 10 client.16338 handle_command_reply: tid=0 2024-08-20T01:37:35.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.257+0000 7f2aeacd3740 1 client.16338 shutdown 2024-08-20T01:37:35.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.258+0000 7f2aeacd3740 1 -- 172.21.15.22:0/3758406788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 msgr2=0x558614d325f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:35.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.258+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/3758406788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 0x558614d325f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0a8170 tx=0x7f2acc00cf20 comp rx=0 tx=0).stop 2024-08-20T01:37:35.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.258+0000 7f2aeacd3740 1 -- 172.21.15.22:0/3758406788 shutdown_connections 2024-08-20T01:37:35.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.258+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/3758406788 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x558614d44e70 0x558614d47260 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.258+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/3758406788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d35130 0x558614d32b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.258+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/3758406788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 0x558614d325f0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.258+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/3758406788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d28880 0x558614d320b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.258+0000 7f2aeacd3740 1 -- 172.21.15.22:0/3758406788 >> 172.21.15.22:0/3758406788 conn(0x558614d266b0 msgr2=0x558614d2c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:35.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.258+0000 7f2ac9ffb640 0 client.16338 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:37:35.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.258+0000 7f2aeacd3740 1 -- 172.21.15.22:0/3758406788 shutdown_connections 2024-08-20T01:37:35.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.258+0000 7f2aeacd3740 1 -- 172.21.15.22:0/3758406788 wait complete. 2024-08-20T01:37:35.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.258+0000 7f2aeacd3740 20 client.16338 trim_cache size 0 max 16384 2024-08-20T01:37:35.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.271+0000 7f2aeacd3740 1 Processor -- start 2024-08-20T01:37:35.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.271+0000 7f2aeacd3740 1 -- start start 2024-08-20T01:37:35.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.271+0000 7f2aeacd3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d28880 0x558614d2ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.271+0000 7f2aeacd3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 0x558614d4c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.271+0000 7f2aeacd3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d35130 0x558614d4ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.271+0000 7f2aeacd3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae41b2e20 con 0x558614d291a0 2024-08-20T01:37:35.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.271+0000 7f2aeacd3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae41b0630 con 0x558614d35130 2024-08-20T01:37:35.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.271+0000 7f2aeacd3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae41ae480 con 0x558614d28880 2024-08-20T01:37:35.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.271+0000 7f2ae1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 0x558614d4c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.271+0000 7f2ae1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 0x558614d4c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47768/0 (socket says 172.21.15.22:47768) 2024-08-20T01:37:35.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.271+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/4218342186 learned_addr learned my addr 172.21.15.22:0/4218342186 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:35.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.271+0000 7f2ae259c640 1 --2- 172.21.15.22:0/4218342186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d28880 0x558614d2ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.271+0000 7f2ae2d9d640 1 --2- 172.21.15.22:0/4218342186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d35130 0x558614d4ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.271+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/4218342186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d28880 msgr2=0x558614d2ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:35.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.271+0000 7f2ae1d9b640 1 --2- 172.21.15.22:0/4218342186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d28880 0x558614d2ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.271+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/4218342186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d35130 msgr2=0x558614d4ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:35.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.271+0000 7f2ae1d9b640 1 --2- 172.21.15.22:0/4218342186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d35130 0x558614d4ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.272+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/4218342186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558614d27130 con 0x558614d291a0 2024-08-20T01:37:35.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.272+0000 7f2ae2d9d640 1 --2- 172.21.15.22:0/4218342186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d35130 0x558614d4ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:35.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.272+0000 7f2ae1d9b640 1 --2- 172.21.15.22:0/4218342186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 0x558614d4c8c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0a6f80 tx=0x7f2acc018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5faa187eb1b57a70 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:35.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.272+0000 7f2acbfff640 1 -- 172.21.15.22:0/4218342186 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0a6dc0 con 0x558614d291a0 2024-08-20T01:37:35.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.272+0000 7f2acbfff640 1 -- 172.21.15.22:0/4218342186 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2acc0ad050 con 0x558614d291a0 2024-08-20T01:37:35.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.272+0000 7f2acbfff640 1 -- 172.21.15.22:0/4218342186 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0aaa10 con 0x558614d291a0 2024-08-20T01:37:35.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.272+0000 7f2aeacd3740 1 -- 172.21.15.22:0/4218342186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 msgr2=0x558614d4c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:35.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.272+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/4218342186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 0x558614d4c8c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0a6f80 tx=0x7f2acc018420 comp rx=0 tx=0).stop 2024-08-20T01:37:35.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.273+0000 7f2aeacd3740 1 -- 172.21.15.22:0/4218342186 shutdown_connections 2024-08-20T01:37:35.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.273+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/4218342186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d35130 0x558614d4ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.273+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/4218342186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 0x558614d4c8c0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.273+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/4218342186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d28880 0x558614d2ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.273+0000 7f2aeacd3740 1 -- 172.21.15.22:0/4218342186 >> 172.21.15.22:0/4218342186 conn(0x558614d266b0 msgr2=0x558614d30930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:35.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.273+0000 7f2aeacd3740 1 -- 172.21.15.22:0/4218342186 shutdown_connections 2024-08-20T01:37:35.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.273+0000 7f2aeacd3740 1 -- 172.21.15.22:0/4218342186 wait complete. 2024-08-20T01:37:35.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.273+0000 7f2aeacd3740 1 -- start start 2024-08-20T01:37:35.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.273+0000 7f2aeacd3740 1 Processor -- start 2024-08-20T01:37:35.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.273+0000 7f2aeacd3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d28880 0x558614d3d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.273+0000 7f2aeacd3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 0x558614d38030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.273+0000 7f2aeacd3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d35130 0x558614d38610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.273+0000 7f2aeacd3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae41aeaf0 con 0x558614d291a0 2024-08-20T01:37:35.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.273+0000 7f2aeacd3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae41aff60 con 0x558614d35130 2024-08-20T01:37:35.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.273+0000 7f2aeacd3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae41af1c0 con 0x558614d28880 2024-08-20T01:37:35.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2aeacd3740 10 client.0 _ll_register_callbacks cb 0x7f2acc0f5070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:35.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2ae1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 0x558614d38030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2ae1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 0x558614d38030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47776/0 (socket says 172.21.15.22:47776) 2024-08-20T01:37:35.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/675630181 learned_addr learned my addr 172.21.15.22:0/675630181 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:35.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2ae259c640 1 --2- 172.21.15.22:0/675630181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d28880 0x558614d3d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2ae2d9d640 1 --2- 172.21.15.22:0/675630181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d35130 0x558614d38610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/675630181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d28880 msgr2=0x558614d3d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:35.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2ae1d9b640 1 --2- 172.21.15.22:0/675630181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d28880 0x558614d3d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/675630181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d35130 msgr2=0x558614d38610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:35.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2ae1d9b640 1 --2- 172.21.15.22:0/675630181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d35130 0x558614d38610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2ae1d9b640 1 -- 172.21.15.22:0/675630181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558614dad880 con 0x558614d291a0 2024-08-20T01:37:35.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2ae259c640 1 --2- 172.21.15.22:0/675630181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d28880 0x558614d3d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:35.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2ae1d9b640 1 --2- 172.21.15.22:0/675630181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 0x558614d38030 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2acc01afd0 tx=0x7f2acc0ec620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b9539dc55d684e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:35.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2ac9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:37:35.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2ac9ffb640 1 -- 172.21.15.22:0/675630181 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0c4020 con 0x558614d291a0 2024-08-20T01:37:35.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2ac9ffb640 1 -- 172.21.15.22:0/675630181 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f2acc0a74f0 con 0x558614d291a0 2024-08-20T01:37:35.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2aeacd3740 1 -- 172.21.15.22:0/675630181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2acc0ad050 con 0x558614d291a0 2024-08-20T01:37:35.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2ac9ffb640 1 -- 172.21.15.22:0/675630181 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2acc0a6dc0 con 0x558614d291a0 2024-08-20T01:37:35.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2aeacd3740 10 client.16344 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:35.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.274+0000 7f2aeacd3740 1 -- 172.21.15.22:0/675630181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558614dad880 con 0x558614d291a0 2024-08-20T01:37:35.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.275+0000 7f2ac9ffb640 1 -- 172.21.15.22:0/675630181 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2acc0ad050 con 0x558614d291a0 2024-08-20T01:37:35.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.275+0000 7f2ac9ffb640 1 -- 172.21.15.22:0/675630181 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f2acc0b3b00 con 0x558614d291a0 2024-08-20T01:37:35.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.275+0000 7f2aeacd3740 10 client.16344 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:35.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.275+0000 7f2aeacd3740 10 client.16344 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:37:35.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.275+0000 7f2aeacd3740 20 client.16344 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:35.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.275+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/675630181 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x558614daec10 0x558614db1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.275+0000 7f2aeacd3740 4 client.16344 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:37:35.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.275+0000 7f2aeacd3740 1 -- 172.21.15.22:0/675630181 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558614c9d320 con 0x558614daec10 2024-08-20T01:37:35.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.275+0000 7f2ae259c640 1 --2- 172.21.15.22:0/675630181 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x558614daec10 0x558614db1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.275+0000 7f2ac9ffb640 10 client.16344 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:37:35.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.275+0000 7f2ae259c640 1 --2- 172.21.15.22:0/675630181 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x558614daec10 0x558614db1000 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1d7440f400d80265 server_cookie=57c0bb247d7b26a9 in_seq=0 out_seq=0 2024-08-20T01:37:35.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.276+0000 7f2ac9ffb640 1 -- 172.21.15.22:0/675630181 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558614c9d320 con 0x558614daec10 2024-08-20T01:37:35.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.276+0000 7f2ac9ffb640 10 client.16344 handle_command_reply: tid=0 2024-08-20T01:37:35.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.276+0000 7f2aeacd3740 1 client.16344 shutdown 2024-08-20T01:37:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.276+0000 7f2aeacd3740 1 -- 172.21.15.22:0/675630181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 msgr2=0x558614d38030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.276+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/675630181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 0x558614d38030 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2acc01afd0 tx=0x7f2acc0ec620 comp rx=0 tx=0).stop 2024-08-20T01:37:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.276+0000 7f2aeacd3740 1 -- 172.21.15.22:0/675630181 shutdown_connections 2024-08-20T01:37:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.276+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/675630181 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x558614daec10 0x558614db1000 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.276+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/675630181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558614d35130 0x558614d38610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.276+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/675630181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558614d291a0 0x558614d38030 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.276+0000 7f2aeacd3740 1 --2- 172.21.15.22:0/675630181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558614d28880 0x558614d3d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.276+0000 7f2aeacd3740 1 -- 172.21.15.22:0/675630181 >> 172.21.15.22:0/675630181 conn(0x558614d266b0 msgr2=0x558614d336e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.276+0000 7f2ac9ffb640 0 client.16344 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:37:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.276+0000 7f2aeacd3740 1 -- 172.21.15.22:0/675630181 shutdown_connections 2024-08-20T01:37:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.276+0000 7f2aeacd3740 1 -- 172.21.15.22:0/675630181 wait complete. 2024-08-20T01:37:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.276+0000 7f2aeacd3740 20 client.16344 trim_cache size 0 max 16384 2024-08-20T01:37:35.284 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:37:35.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.277+0000 7f2ae88da640 1 -- 172.21.15.22:0/725647167 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2ad00b3bd0 msgr2=0x7f2ad00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:35.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.277+0000 7f2ae88da640 1 --2- 172.21.15.22:0/725647167 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2ad00b3bd0 0x7f2ad00b6090 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4077290 tx=0x7f2ad4005a40 comp rx=0 tx=0).stop 2024-08-20T01:37:35.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.277+0000 7f2ae88da640 1 -- 172.21.15.22:0/725647167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae41084e0 msgr2=0x7f2ae4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:35.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.277+0000 7f2ae88da640 1 --2- 172.21.15.22:0/725647167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae41084e0 0x7f2ae4075710 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00e9f0 tx=0x7f2acc00eeb0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.277+0000 7f2ae88da640 1 -- 172.21.15.22:0/725647167 shutdown_connections 2024-08-20T01:37:35.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.277+0000 7f2ae88da640 1 --2- 172.21.15.22:0/725647167 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2ad00b3bd0 0x7f2ad00b6090 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.277+0000 7f2ae88da640 1 --2- 172.21.15.22:0/725647167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ae4108e60 0x7f2ae4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.277+0000 7f2ae88da640 1 --2- 172.21.15.22:0/725647167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae41084e0 0x7f2ae4075710 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.277+0000 7f2ae88da640 1 --2- 172.21.15.22:0/725647167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ae4102ad0 0x7f2ae40751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.277+0000 7f2ae88da640 1 -- 172.21.15.22:0/725647167 >> 172.21.15.22:0/725647167 conn(0x7f2ae40fe540 msgr2=0x7f2ae4100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:35.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.277+0000 7f2ae88da640 1 -- 172.21.15.22:0/725647167 shutdown_connections 2024-08-20T01:37:35.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:35.277+0000 7f2ae88da640 1 -- 172.21.15.22:0/725647167 wait complete. 2024-08-20T01:37:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.394+0000 7ff3776a1640 1 -- 172.21.15.22:0/1525058316 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff370108490 msgr2=0x7ff37010a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.394+0000 7ff3776a1640 1 --2- 172.21.15.22:0/1525058316 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff370108490 0x7ff37010a880 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff368009900 tx=0x7ff36802a410 comp rx=0 tx=0).stop 2024-08-20T01:37:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.394+0000 7ff3776a1640 1 -- 172.21.15.22:0/1525058316 shutdown_connections 2024-08-20T01:37:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.394+0000 7ff3776a1640 1 --2- 172.21.15.22:0/1525058316 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff370108490 0x7ff37010a880 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.394+0000 7ff3776a1640 1 --2- 172.21.15.22:0/1525058316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff370105b60 0x7ff370107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.394+0000 7ff3776a1640 1 --2- 172.21.15.22:0/1525058316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff370100aa0 0x7ff370100ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.394+0000 7ff3776a1640 1 -- 172.21.15.22:0/1525058316 >> 172.21.15.22:0/1525058316 conn(0x7ff3700fc5e0 msgr2=0x7ff3700fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.394+0000 7ff3776a1640 1 -- 172.21.15.22:0/1525058316 shutdown_connections 2024-08-20T01:37:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.394+0000 7ff3776a1640 1 -- 172.21.15.22:0/1525058316 wait complete. 2024-08-20T01:37:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.395+0000 7ff3776a1640 1 Processor -- start 2024-08-20T01:37:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.395+0000 7ff3776a1640 1 -- start start 2024-08-20T01:37:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.395+0000 7ff3776a1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff370100aa0 0x7ff37019ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.395+0000 7ff3776a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff370105b60 0x7ff37019b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.395+0000 7ff3776a1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff370108490 0x7ff37019bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.395+0000 7ff3776a1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff37010e340 con 0x7ff370105b60 2024-08-20T01:37:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.395+0000 7ff3776a1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff37010e1c0 con 0x7ff370108490 2024-08-20T01:37:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.395+0000 7ff3776a1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff37010e4c0 con 0x7ff370100aa0 2024-08-20T01:37:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.396+0000 7ff374c3c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff370105b60 0x7ff37019b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.396+0000 7ff37543d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff370100aa0 0x7ff37019ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.396+0000 7ff374c3c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff370105b60 0x7ff37019b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47808/0 (socket says 172.21.15.22:47808) 2024-08-20T01:37:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.396+0000 7ff374c3c640 1 -- 172.21.15.22:0/664588817 learned_addr learned my addr 172.21.15.22:0/664588817 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.396+0000 7ff375c3e640 1 --2- 172.21.15.22:0/664588817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff370108490 0x7ff37019bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.396+0000 7ff374c3c640 1 -- 172.21.15.22:0/664588817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff370100aa0 msgr2=0x7ff37019ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.396+0000 7ff374c3c640 1 --2- 172.21.15.22:0/664588817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff370100aa0 0x7ff37019ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.396+0000 7ff374c3c640 1 -- 172.21.15.22:0/664588817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff370108490 msgr2=0x7ff37019bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.396+0000 7ff374c3c640 1 --2- 172.21.15.22:0/664588817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff370108490 0x7ff37019bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.396+0000 7ff374c3c640 1 -- 172.21.15.22:0/664588817 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff37019c7a0 con 0x7ff370105b60 2024-08-20T01:37:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.396+0000 7ff37543d640 1 --2- 172.21.15.22:0/664588817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff370100aa0 0x7ff37019ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.396+0000 7ff374c3c640 1 --2- 172.21.15.22:0/664588817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff370105b60 0x7ff37019b2b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff36400e9f0 tx=0x7ff36400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.396+0000 7ff36e7fc640 1 -- 172.21.15.22:0/664588817 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36400cd80 con 0x7ff370105b60 2024-08-20T01:37:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.396+0000 7ff36e7fc640 1 -- 172.21.15.22:0/664588817 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3640054d0 con 0x7ff370105b60 2024-08-20T01:37:35.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.396+0000 7ff3776a1640 1 -- 172.21.15.22:0/664588817 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff37019ca90 con 0x7ff370105b60 2024-08-20T01:37:35.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.396+0000 7ff36e7fc640 1 -- 172.21.15.22:0/664588817 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff364010690 con 0x7ff370105b60 2024-08-20T01:37:35.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.396+0000 7ff3776a1640 1 -- 172.21.15.22:0/664588817 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3701a3160 con 0x7ff370105b60 2024-08-20T01:37:35.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.399+0000 7ff37a493740 1 Processor -- start 2024-08-20T01:37:35.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff37a493740 1 -- start start 2024-08-20T01:37:35.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff37a493740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d28d0 0x5568229d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff37a493740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d5200 0x5568229d75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff37a493740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d7c40 0x5568229da100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff37a493740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556822945360 con 0x5568229d5200 2024-08-20T01:37:35.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff37a493740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556822934860 con 0x5568229d7c40 2024-08-20T01:37:35.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff37a493740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5568229388a0 con 0x5568229d28d0 2024-08-20T01:37:35.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff36e7fc640 1 -- 172.21.15.22:0/664588817 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff364004e90 con 0x7ff370105b60 2024-08-20T01:37:35.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff37543d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d5200 0x5568229d75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff375c3e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d28d0 0x5568229d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff37543d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d5200 0x5568229d75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47820/0 (socket says 172.21.15.22:47820) 2024-08-20T01:37:35.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff375c3e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d28d0 0x5568229d4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:60244/0 (socket says 172.21.15.22:60244) 2024-08-20T01:37:35.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff37543d640 1 -- 172.21.15.22:0/3120186 learned_addr learned my addr 172.21.15.22:0/3120186 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:35.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff374c3c640 1 --2- 172.21.15.22:0/3120186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d7c40 0x5568229da100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff37543d640 1 -- 172.21.15.22:0/3120186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d28d0 msgr2=0x5568229d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:35.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff37543d640 1 --2- 172.21.15.22:0/3120186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d28d0 0x5568229d4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff37543d640 1 -- 172.21.15.22:0/3120186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d7c40 msgr2=0x5568229da100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff37543d640 1 --2- 172.21.15.22:0/3120186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d7c40 0x5568229da100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff37543d640 1 -- 172.21.15.22:0/3120186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568228dbe40 con 0x5568229d5200 2024-08-20T01:37:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.400+0000 7ff37543d640 1 --2- 172.21.15.22:0/3120186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d5200 0x5568229d75f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff360005f40 tx=0x7ff360011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af17291976c93f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.401+0000 7ff3577fe640 1 -- 172.21.15.22:0/3120186 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff360011330 con 0x5568229d5200 2024-08-20T01:37:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.401+0000 7ff3577fe640 1 -- 172.21.15.22:0/3120186 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff36000fe50 con 0x5568229d5200 2024-08-20T01:37:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.401+0000 7ff3577fe640 1 -- 172.21.15.22:0/3120186 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3600193e0 con 0x5568229d5200 2024-08-20T01:37:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.401+0000 7ff36e7fc640 1 --2- 172.21.15.22:0/664588817 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff3580b3bd0 0x7ff3580b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.401+0000 7ff375c3e640 1 --2- 172.21.15.22:0/664588817 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff3580b3bd0 0x7ff3580b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.401+0000 7ff36e7fc640 1 -- 172.21.15.22:0/664588817 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ff3640e4010 con 0x7ff370105b60 2024-08-20T01:37:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.401+0000 7ff37a493740 1 -- 172.21.15.22:0/3120186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d5200 msgr2=0x5568229d75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.401+0000 7ff375c3e640 1 --2- 172.21.15.22:0/664588817 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff3580b3bd0 0x7ff3580b6090 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff368005ab0 tx=0x7ff368005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.401+0000 7ff37a493740 1 --2- 172.21.15.22:0/3120186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d5200 0x5568229d75f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff360005f40 tx=0x7ff360011d30 comp rx=0 tx=0).stop 2024-08-20T01:37:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.402+0000 7ff37a493740 1 -- 172.21.15.22:0/3120186 shutdown_connections 2024-08-20T01:37:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.402+0000 7ff37a493740 1 --2- 172.21.15.22:0/3120186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d7c40 0x5568229da100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.402+0000 7ff37a493740 1 --2- 172.21.15.22:0/3120186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d5200 0x5568229d75f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.402+0000 7ff37a493740 1 --2- 172.21.15.22:0/3120186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d28d0 0x5568229d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.402+0000 7ff37a493740 1 -- 172.21.15.22:0/3120186 >> 172.21.15.22:0/3120186 conn(0x5568229cda20 msgr2=0x5568229ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.402+0000 7ff37a493740 1 -- 172.21.15.22:0/3120186 shutdown_connections 2024-08-20T01:37:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.402+0000 7ff37a493740 1 -- 172.21.15.22:0/3120186 wait complete. 2024-08-20T01:37:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.402+0000 7ff37a493740 1 -- start start 2024-08-20T01:37:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.402+0000 7ff37a493740 1 Processor -- start 2024-08-20T01:37:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.402+0000 7ff37a493740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d28d0 0x5568229dc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.402+0000 7ff37a493740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d5200 0x5568229dc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.402+0000 7ff37a493740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d7c40 0x5568229dd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.402+0000 7ff37a493740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55682286dab0 con 0x5568229d5200 2024-08-20T01:37:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.402+0000 7ff37a493740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5568228bb780 con 0x5568229d7c40 2024-08-20T01:37:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.402+0000 7ff37a493740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5568229dac20 con 0x5568229d28d0 2024-08-20T01:37:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.402+0000 7ff37a493740 10 client.0 _ll_register_callbacks cb 0x556822643a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.403+0000 7ff37543d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d28d0 0x5568229dc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.403+0000 7ff374c3c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d5200 0x5568229dc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.403+0000 7ff37543d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d28d0 0x5568229dc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:60260/0 (socket says 172.21.15.22:60260) 2024-08-20T01:37:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.403+0000 7ff374c3c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d5200 0x5568229dc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47828/0 (socket says 172.21.15.22:47828) 2024-08-20T01:37:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.403+0000 7ff37543d640 1 -- 172.21.15.22:0/794164843 learned_addr learned my addr 172.21.15.22:0/794164843 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.403+0000 7ff375c3e640 1 --2- 172.21.15.22:0/794164843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d7c40 0x5568229dd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.403+0000 7ff37543d640 1 -- 172.21.15.22:0/794164843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d7c40 msgr2=0x5568229dd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.403+0000 7ff37543d640 1 --2- 172.21.15.22:0/794164843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d7c40 0x5568229dd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.403+0000 7ff37543d640 1 -- 172.21.15.22:0/794164843 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d5200 msgr2=0x5568229dc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.403+0000 7ff37543d640 1 --2- 172.21.15.22:0/794164843 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d5200 0x5568229dc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.403+0000 7ff37543d640 1 -- 172.21.15.22:0/794164843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556822697790 con 0x5568229d28d0 2024-08-20T01:37:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.403+0000 7ff374c3c640 1 --2- 172.21.15.22:0/794164843 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d5200 0x5568229dc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:35.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.403+0000 7ff37543d640 1 --2- 172.21.15.22:0/794164843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d28d0 0x5568229dc0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff3600099d0 tx=0x7ff360010f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b88ca9f353a38561 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:35.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.403+0000 7ff354ff9640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:37:35.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.403+0000 7ff354ff9640 1 -- 172.21.15.22:0/794164843 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36001f040 con 0x5568229d28d0 2024-08-20T01:37:35.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.403+0000 7ff37a493740 1 -- 172.21.15.22:0/794164843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5568228e3e00 con 0x5568229d28d0 2024-08-20T01:37:35.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.403+0000 7ff354ff9640 1 -- 172.21.15.22:0/794164843 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ff360004d00 con 0x5568229d28d0 2024-08-20T01:37:35.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.404+0000 7ff354ff9640 1 -- 172.21.15.22:0/794164843 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff360010430 con 0x5568229d28d0 2024-08-20T01:37:35.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.404+0000 7ff37a493740 10 client.26011 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:35.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.404+0000 7ff37a493740 1 -- 172.21.15.22:0/794164843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556822710620 con 0x5568229d28d0 2024-08-20T01:37:35.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.404+0000 7ff354ff9640 1 -- 172.21.15.22:0/794164843 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5568228e3e00 con 0x5568229d28d0 2024-08-20T01:37:35.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.404+0000 7ff354ff9640 1 -- 172.21.15.22:0/794164843 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7ff360018070 con 0x5568229d28d0 2024-08-20T01:37:35.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.404+0000 7ff37a493740 10 client.26011 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:35.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.404+0000 7ff37a493740 10 client.26011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:37:35.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.404+0000 7ff37a493740 20 client.26011 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:35.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.404+0000 7ff37a493740 1 --2- 172.21.15.22:0/794164843 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5568229e7780 0x5568229e9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.404+0000 7ff37a493740 4 client.26011 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:35.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.404+0000 7ff37a493740 1 -- 172.21.15.22:0/794164843 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568229472b0 con 0x5568229e7780 2024-08-20T01:37:35.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.404+0000 7ff374c3c640 1 --2- 172.21.15.22:0/794164843 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5568229e7780 0x5568229e9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.405+0000 7ff374c3c640 1 --2- 172.21.15.22:0/794164843 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5568229e7780 0x5568229e9bb0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c42f4706e7098a9 server_cookie=e9330a4607068b93 in_seq=0 out_seq=0 2024-08-20T01:37:35.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.405+0000 7ff354ff9640 10 client.26011 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.405+0000 7ff354ff9640 1 -- 172.21.15.22:0/794164843 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5568229472b0 con 0x5568229e7780 2024-08-20T01:37:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.405+0000 7ff354ff9640 10 client.26011 handle_command_reply: tid=0 2024-08-20T01:37:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.405+0000 7ff37a493740 1 client.26011 shutdown 2024-08-20T01:37:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.405+0000 7ff37a493740 1 -- 172.21.15.22:0/794164843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d28d0 msgr2=0x5568229dc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.405+0000 7ff37a493740 1 --2- 172.21.15.22:0/794164843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d28d0 0x5568229dc0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff3600099d0 tx=0x7ff360010f30 comp rx=0 tx=0).stop 2024-08-20T01:37:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.405+0000 7ff37a493740 1 -- 172.21.15.22:0/794164843 shutdown_connections 2024-08-20T01:37:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.405+0000 7ff37a493740 1 --2- 172.21.15.22:0/794164843 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5568229e7780 0x5568229e9bb0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.405+0000 7ff37a493740 1 --2- 172.21.15.22:0/794164843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d7c40 0x5568229dd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.405+0000 7ff37a493740 1 --2- 172.21.15.22:0/794164843 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d5200 0x5568229dc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.405+0000 7ff37a493740 1 --2- 172.21.15.22:0/794164843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d28d0 0x5568229dc0a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.405+0000 7ff354ff9640 0 client.26011 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.405+0000 7ff37a493740 1 -- 172.21.15.22:0/794164843 >> 172.21.15.22:0/794164843 conn(0x5568229cda20 msgr2=0x5568229ccae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.406+0000 7ff37a493740 1 -- 172.21.15.22:0/794164843 shutdown_connections 2024-08-20T01:37:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.406+0000 7ff37a493740 1 -- 172.21.15.22:0/794164843 wait complete. 2024-08-20T01:37:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.406+0000 7ff37a493740 20 client.26011 trim_cache size 0 max 16384 2024-08-20T01:37:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.420+0000 7ff37a493740 1 Processor -- start 2024-08-20T01:37:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.420+0000 7ff37a493740 1 -- start start 2024-08-20T01:37:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.420+0000 7ff37a493740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d28d0 0x5568229dbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.420+0000 7ff37a493740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d5200 0x5568229d9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.420+0000 7ff37a493740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d7c40 0x5568229d9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.420+0000 7ff37a493740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff3701ae920 con 0x5568229d28d0 2024-08-20T01:37:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.420+0000 7ff37a493740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff3701ac130 con 0x5568229d7c40 2024-08-20T01:37:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.420+0000 7ff37a493740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff3701a9f80 con 0x5568229d5200 2024-08-20T01:37:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.420+0000 7ff37543d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d28d0 0x5568229dbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.420+0000 7ff37543d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d28d0 0x5568229dbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47836/0 (socket says 172.21.15.22:47836) 2024-08-20T01:37:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.420+0000 7ff37543d640 1 -- 172.21.15.22:0/629119010 learned_addr learned my addr 172.21.15.22:0/629119010 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.420+0000 7ff374c3c640 1 --2- 172.21.15.22:0/629119010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d5200 0x5568229d9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.420+0000 7ff375c3e640 1 --2- 172.21.15.22:0/629119010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d7c40 0x5568229d9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.421+0000 7ff37543d640 1 -- 172.21.15.22:0/629119010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d5200 msgr2=0x5568229d9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.421+0000 7ff37543d640 1 --2- 172.21.15.22:0/629119010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d5200 0x5568229d9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.421+0000 7ff37543d640 1 -- 172.21.15.22:0/629119010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d7c40 msgr2=0x5568229d9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.421+0000 7ff37543d640 1 --2- 172.21.15.22:0/629119010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d7c40 0x5568229d9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.421+0000 7ff37543d640 1 -- 172.21.15.22:0/629119010 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568229dcba0 con 0x5568229d28d0 2024-08-20T01:37:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.421+0000 7ff375c3e640 1 --2- 172.21.15.22:0/629119010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d7c40 0x5568229d9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.421+0000 7ff37543d640 1 --2- 172.21.15.22:0/629119010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d28d0 0x5568229dbe10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff36000f790 tx=0x7ff360012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd7338b1598cc41 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.421+0000 7ff356ffd640 1 -- 172.21.15.22:0/629119010 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36000fe50 con 0x5568229d28d0 2024-08-20T01:37:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.421+0000 7ff356ffd640 1 -- 172.21.15.22:0/629119010 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff360029070 con 0x5568229d28d0 2024-08-20T01:37:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.421+0000 7ff356ffd640 1 -- 172.21.15.22:0/629119010 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff360004540 con 0x5568229d28d0 2024-08-20T01:37:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.421+0000 7ff37a493740 1 -- 172.21.15.22:0/629119010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d28d0 msgr2=0x5568229dbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.421+0000 7ff37a493740 1 --2- 172.21.15.22:0/629119010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d28d0 0x5568229dbe10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff36000f790 tx=0x7ff360012f90 comp rx=0 tx=0).stop 2024-08-20T01:37:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.422+0000 7ff37a493740 1 -- 172.21.15.22:0/629119010 shutdown_connections 2024-08-20T01:37:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.422+0000 7ff37a493740 1 --2- 172.21.15.22:0/629119010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d7c40 0x5568229d9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.422+0000 7ff37a493740 1 --2- 172.21.15.22:0/629119010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d5200 0x5568229d9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.422+0000 7ff37a493740 1 --2- 172.21.15.22:0/629119010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d28d0 0x5568229dbe10 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.422+0000 7ff37a493740 1 -- 172.21.15.22:0/629119010 >> 172.21.15.22:0/629119010 conn(0x5568229cda20 msgr2=0x5568229db260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.422+0000 7ff37a493740 1 -- 172.21.15.22:0/629119010 shutdown_connections 2024-08-20T01:37:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.422+0000 7ff37a493740 1 -- 172.21.15.22:0/629119010 wait complete. 2024-08-20T01:37:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.422+0000 7ff37a493740 1 -- start start 2024-08-20T01:37:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.422+0000 7ff37a493740 1 Processor -- start 2024-08-20T01:37:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.422+0000 7ff37a493740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d28d0 0x5568229e0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.422+0000 7ff37a493740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d5200 0x5568229e12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.422+0000 7ff37a493740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d7c40 0x5568229e1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.422+0000 7ff37a493740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff3701aa5f0 con 0x5568229d7c40 2024-08-20T01:37:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.422+0000 7ff37a493740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff3701aba60 con 0x5568229d28d0 2024-08-20T01:37:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.422+0000 7ff37a493740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff3701aacc0 con 0x5568229d5200 2024-08-20T01:37:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.422+0000 7ff37a493740 10 client.0 _ll_register_callbacks cb 0x7ff3640e79b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.422+0000 7ff375c3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d7c40 0x5568229e1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.423+0000 7ff375c3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d7c40 0x5568229e1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47844/0 (socket says 172.21.15.22:47844) 2024-08-20T01:37:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.423+0000 7ff375c3e640 1 -- 172.21.15.22:0/1586689095 learned_addr learned my addr 172.21.15.22:0/1586689095 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.423+0000 7ff374c3c640 1 --2- 172.21.15.22:0/1586689095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d5200 0x5568229e12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.423+0000 7ff37543d640 1 --2- 172.21.15.22:0/1586689095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d28d0 0x5568229e0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.423+0000 7ff375c3e640 1 -- 172.21.15.22:0/1586689095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d5200 msgr2=0x5568229e12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.423+0000 7ff375c3e640 1 --2- 172.21.15.22:0/1586689095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d5200 0x5568229e12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.423+0000 7ff375c3e640 1 -- 172.21.15.22:0/1586689095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d28d0 msgr2=0x5568229e0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:35.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.423+0000 7ff375c3e640 1 --2- 172.21.15.22:0/1586689095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d28d0 0x5568229e0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:35.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.423+0000 7ff375c3e640 1 -- 172.21.15.22:0/1586689095 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568229e2670 con 0x5568229d7c40 2024-08-20T01:37:35.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.423+0000 7ff375c3e640 1 --2- 172.21.15.22:0/1586689095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d7c40 0x5568229e1e40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff368009900 tx=0x7ff368009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3735e9b98c30380d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:35.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.423+0000 7ff354ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:37:35.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.423+0000 7ff354ff9640 1 -- 172.21.15.22:0/1586689095 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368057060 con 0x5568229d7c40 2024-08-20T01:37:35.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.423+0000 7ff37a493740 1 -- 172.21.15.22:0/1586689095 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff360029070 con 0x5568229d7c40 2024-08-20T01:37:35.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.423+0000 7ff354ff9640 1 -- 172.21.15.22:0/1586689095 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ff3680035f0 con 0x5568229d7c40 2024-08-20T01:37:35.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.423+0000 7ff354ff9640 1 -- 172.21.15.22:0/1586689095 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff368035040 con 0x5568229d7c40 2024-08-20T01:37:35.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.423+0000 7ff37a493740 10 client.16362 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:35.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.423+0000 7ff37a493740 1 -- 172.21.15.22:0/1586689095 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5568229e3ad0 con 0x5568229d7c40 2024-08-20T01:37:35.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.423+0000 7ff354ff9640 1 -- 172.21.15.22:0/1586689095 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff360029070 con 0x5568229d7c40 2024-08-20T01:37:35.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.424+0000 7ff354ff9640 1 -- 172.21.15.22:0/1586689095 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7ff368051070 con 0x5568229d7c40 2024-08-20T01:37:35.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.424+0000 7ff37a493740 10 client.16362 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:35.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.424+0000 7ff37a493740 10 client.16362 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:37:35.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.424+0000 7ff37a493740 20 client.16362 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:35.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.424+0000 7ff37a493740 1 --2- 172.21.15.22:0/1586689095 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556822a52570 0x556822a54990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:35.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.424+0000 7ff37a493740 4 client.16362 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:37:35.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.424+0000 7ff37a493740 1 -- 172.21.15.22:0/1586689095 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556822942d50 con 0x556822a52570 2024-08-20T01:37:35.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.424+0000 7ff37543d640 1 --2- 172.21.15.22:0/1586689095 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556822a52570 0x556822a54990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:35.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.424+0000 7ff37543d640 1 --2- 172.21.15.22:0/1586689095 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556822a52570 0x556822a54990 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a601fffd02ba9e5 server_cookie=135bdd999af3f061 in_seq=0 out_seq=0 2024-08-20T01:37:35.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:35.424+0000 7ff354ff9640 10 client.16362 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:36.025 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:37:36.283 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:36.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:36 smithi022 ceph-mon[18709]: pgmap v540: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 390 op/s 2024-08-20T01:37:36.735 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.733+0000 7ff354ff9640 1 -- 172.21.15.22:0/1586689095 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556822942d50 con 0x556822a52570 2024-08-20T01:37:36.735 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.733+0000 7ff354ff9640 10 client.16362 handle_command_reply: tid=0 2024-08-20T01:37:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.733+0000 7ff37a493740 1 client.16362 shutdown 2024-08-20T01:37:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.733+0000 7ff37a493740 1 -- 172.21.15.22:0/1586689095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d7c40 msgr2=0x5568229e1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.733+0000 7ff37a493740 1 --2- 172.21.15.22:0/1586689095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d7c40 0x5568229e1e40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff368009900 tx=0x7ff368009260 comp rx=0 tx=0).stop 2024-08-20T01:37:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.734+0000 7ff37a493740 1 -- 172.21.15.22:0/1586689095 shutdown_connections 2024-08-20T01:37:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.734+0000 7ff37a493740 1 --2- 172.21.15.22:0/1586689095 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x556822a52570 0x556822a54990 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.734+0000 7ff37a493740 1 --2- 172.21.15.22:0/1586689095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568229d7c40 0x5568229e1e40 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.734+0000 7ff37a493740 1 --2- 172.21.15.22:0/1586689095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5568229d5200 0x5568229e12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.734+0000 7ff37a493740 1 --2- 172.21.15.22:0/1586689095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568229d28d0 0x5568229e0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.734+0000 7ff354ff9640 0 client.16362 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.734+0000 7ff37a493740 1 -- 172.21.15.22:0/1586689095 >> 172.21.15.22:0/1586689095 conn(0x5568229cda20 msgr2=0x5568229d1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.734+0000 7ff37a493740 1 -- 172.21.15.22:0/1586689095 shutdown_connections 2024-08-20T01:37:36.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.735+0000 7ff37a493740 1 -- 172.21.15.22:0/1586689095 wait complete. 2024-08-20T01:37:36.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.735+0000 7ff37a493740 20 client.16362 trim_cache size 0 max 16384 2024-08-20T01:37:36.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:37:36.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:37:36.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:37:36.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:37:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.735+0000 7ff3776a1640 1 -- 172.21.15.22:0/664588817 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff3580b3bd0 msgr2=0x7ff3580b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.735+0000 7ff3776a1640 1 --2- 172.21.15.22:0/664588817 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff3580b3bd0 0x7ff3580b6090 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff368005ab0 tx=0x7ff368005a20 comp rx=0 tx=0).stop 2024-08-20T01:37:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.735+0000 7ff3776a1640 1 -- 172.21.15.22:0/664588817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff370105b60 msgr2=0x7ff37019b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.735+0000 7ff3776a1640 1 --2- 172.21.15.22:0/664588817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff370105b60 0x7ff37019b2b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff36400e9f0 tx=0x7ff36400edf0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.736+0000 7ff3776a1640 1 -- 172.21.15.22:0/664588817 shutdown_connections 2024-08-20T01:37:36.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.736+0000 7ff3776a1640 1 --2- 172.21.15.22:0/664588817 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff3580b3bd0 0x7ff3580b6090 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.736+0000 7ff3776a1640 1 --2- 172.21.15.22:0/664588817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff370108490 0x7ff37019bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.736+0000 7ff3776a1640 1 --2- 172.21.15.22:0/664588817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff370105b60 0x7ff37019b2b0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.736+0000 7ff3776a1640 1 --2- 172.21.15.22:0/664588817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff370100aa0 0x7ff37019ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.736+0000 7ff3776a1640 1 -- 172.21.15.22:0/664588817 >> 172.21.15.22:0/664588817 conn(0x7ff3700fc5e0 msgr2=0x7ff370106760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.736+0000 7ff3776a1640 1 -- 172.21.15.22:0/664588817 shutdown_connections 2024-08-20T01:37:36.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:36.736+0000 7ff3776a1640 1 -- 172.21.15.22:0/664588817 wait complete. 2024-08-20T01:37:36.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.805+0000 7fa2365f6640 1 -- 172.21.15.22:0/1710118978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa230101990 msgr2=0x7fa230101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.805+0000 7fa2365f6640 1 --2- 172.21.15.22:0/1710118978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa230101990 0x7fa230101d70 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa220009900 tx=0x7fa22002a410 comp rx=0 tx=0).stop 2024-08-20T01:37:36.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.805+0000 7fa2365f6640 1 -- 172.21.15.22:0/1710118978 shutdown_connections 2024-08-20T01:37:36.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.805+0000 7fa2365f6640 1 --2- 172.21.15.22:0/1710118978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa230107d20 0x7fa23010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.805+0000 7fa2365f6640 1 --2- 172.21.15.22:0/1710118978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2301073a0 0x7fa2301077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.805+0000 7fa2365f6640 1 --2- 172.21.15.22:0/1710118978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa230101990 0x7fa230101d70 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.805+0000 7fa2365f6640 1 -- 172.21.15.22:0/1710118978 >> 172.21.15.22:0/1710118978 conn(0x7fa2300fd400 msgr2=0x7fa2300ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.805+0000 7fa2365f6640 1 -- 172.21.15.22:0/1710118978 shutdown_connections 2024-08-20T01:37:36.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.805+0000 7fa2365f6640 1 -- 172.21.15.22:0/1710118978 wait complete. 2024-08-20T01:37:36.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.805+0000 7fa2365f6640 1 Processor -- start 2024-08-20T01:37:36.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.805+0000 7fa2365f6640 1 -- start start 2024-08-20T01:37:36.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.806+0000 7fa2365f6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa230101990 0x7fa23019b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.806+0000 7fa2365f6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2301073a0 0x7fa23019b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.806+0000 7fa2365f6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa230107d20 0x7fa2301a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.806+0000 7fa2365f6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa230112b00 con 0x7fa230101990 2024-08-20T01:37:36.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.806+0000 7fa2365f6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa230112980 con 0x7fa230107d20 2024-08-20T01:37:36.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.806+0000 7fa2365f6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa230112c80 con 0x7fa2301073a0 2024-08-20T01:37:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.806+0000 7fa22ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa230101990 0x7fa23019b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.806+0000 7fa22ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa230101990 0x7fa23019b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47858/0 (socket says 172.21.15.22:47858) 2024-08-20T01:37:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.806+0000 7fa22ffff640 1 -- 172.21.15.22:0/1685895851 learned_addr learned my addr 172.21.15.22:0/1685895851 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.806+0000 7fa22f7fe640 1 --2- 172.21.15.22:0/1685895851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2301073a0 0x7fa23019b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.806+0000 7fa234b93640 1 --2- 172.21.15.22:0/1685895851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa230107d20 0x7fa2301a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.806+0000 7fa22ffff640 1 -- 172.21.15.22:0/1685895851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2301073a0 msgr2=0x7fa23019b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.806+0000 7fa22ffff640 1 --2- 172.21.15.22:0/1685895851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2301073a0 0x7fa23019b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.806+0000 7fa22ffff640 1 -- 172.21.15.22:0/1685895851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa230107d20 msgr2=0x7fa2301a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.806+0000 7fa22ffff640 1 --2- 172.21.15.22:0/1685895851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa230107d20 0x7fa2301a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.806+0000 7fa22ffff640 1 -- 172.21.15.22:0/1685895851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2301a1290 con 0x7fa230101990 2024-08-20T01:37:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.806+0000 7fa22f7fe640 1 --2- 172.21.15.22:0/1685895851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2301073a0 0x7fa23019b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.807+0000 7fa22ffff640 1 --2- 172.21.15.22:0/1685895851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa230101990 0x7fa23019b1e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa220005940 tx=0x7fa220004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.807+0000 7fa22d7fa640 1 -- 172.21.15.22:0/1685895851 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22003f030 con 0x7fa230101990 2024-08-20T01:37:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.807+0000 7fa2365f6640 1 -- 172.21.15.22:0/1685895851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2301a1520 con 0x7fa230101990 2024-08-20T01:37:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.807+0000 7fa22d7fa640 1 -- 172.21.15.22:0/1685895851 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa220003aa0 con 0x7fa230101990 2024-08-20T01:37:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.807+0000 7fa22d7fa640 1 -- 172.21.15.22:0/1685895851 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa220035070 con 0x7fa230101990 2024-08-20T01:37:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.807+0000 7fa2365f6640 1 -- 172.21.15.22:0/1685895851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2301a7c40 con 0x7fa230101990 2024-08-20T01:37:36.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.809+0000 7fa22d7fa640 1 -- 172.21.15.22:0/1685895851 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa220042030 con 0x7fa230101990 2024-08-20T01:37:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.809+0000 7fa2389ef740 1 Processor -- start 2024-08-20T01:37:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.809+0000 7fa2389ef740 1 -- start start 2024-08-20T01:37:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.810+0000 7fa2389ef740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc18880 0x56473cc18c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.810+0000 7fa2389ef740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc191a0 0x56473cc24bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.810+0000 7fa2389ef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc25130 0x56473cc27520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.810+0000 7fa2389ef740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56473cb8f930 con 0x56473cc191a0 2024-08-20T01:37:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.810+0000 7fa2389ef740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56473cb7ee30 con 0x56473cc18880 2024-08-20T01:37:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.810+0000 7fa2389ef740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56473cb82e70 con 0x56473cc25130 2024-08-20T01:37:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.810+0000 7fa22ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc191a0 0x56473cc24bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.810+0000 7fa22ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc191a0 0x56473cc24bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47862/0 (socket says 172.21.15.22:47862) 2024-08-20T01:37:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.810+0000 7fa22ffff640 1 -- 172.21.15.22:0/2802427109 learned_addr learned my addr 172.21.15.22:0/2802427109 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.810+0000 7fa22f7fe640 1 --2- 172.21.15.22:0/2802427109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc25130 0x56473cc27520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.810+0000 7fa234b93640 1 --2- 172.21.15.22:0/2802427109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc18880 0x56473cc18c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.810+0000 7fa22f7fe640 1 -- 172.21.15.22:0/2802427109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc18880 msgr2=0x56473cc18c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.810+0000 7fa22f7fe640 1 --2- 172.21.15.22:0/2802427109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc18880 0x56473cc18c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.810+0000 7fa22f7fe640 1 -- 172.21.15.22:0/2802427109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc191a0 msgr2=0x56473cc24bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.810+0000 7fa22f7fe640 1 --2- 172.21.15.22:0/2802427109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc191a0 0x56473cc24bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.810+0000 7fa22f7fe640 1 -- 172.21.15.22:0/2802427109 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56473c8de650 con 0x56473cc25130 2024-08-20T01:37:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.810+0000 7fa234b93640 1 --2- 172.21.15.22:0/2802427109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc18880 0x56473cc18c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.810+0000 7fa22d7fa640 1 --2- 172.21.15.22:0/1685895851 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa2180b3c50 0x7fa2180b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.810+0000 7fa22f7fe640 1 --2- 172.21.15.22:0/2802427109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc25130 0x56473cc27520 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa224009fd0 tx=0x7fa2240118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f355c65b3b4f717 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.811+0000 7fa234b93640 1 --2- 172.21.15.22:0/1685895851 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa2180b3c50 0x7fa2180b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.811+0000 7fa2167fc640 1 -- 172.21.15.22:0/2802427109 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa224004030 con 0x56473cc25130 2024-08-20T01:37:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.811+0000 7fa2167fc640 1 -- 172.21.15.22:0/2802427109 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2240054d0 con 0x56473cc25130 2024-08-20T01:37:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.811+0000 7fa2167fc640 1 -- 172.21.15.22:0/2802427109 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa224004ce0 con 0x56473cc25130 2024-08-20T01:37:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.811+0000 7fa22d7fa640 1 -- 172.21.15.22:0/1685895851 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fa220104160 con 0x7fa230101990 2024-08-20T01:37:36.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:36 smithi077 ceph-mon[22251]: pgmap v540: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 390 op/s 2024-08-20T01:37:36.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.811+0000 7fa2389ef740 1 -- 172.21.15.22:0/2802427109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc25130 msgr2=0x56473cc27520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.811+0000 7fa2389ef740 1 --2- 172.21.15.22:0/2802427109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc25130 0x56473cc27520 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa224009fd0 tx=0x7fa2240118d0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.811+0000 7fa234b93640 1 --2- 172.21.15.22:0/1685895851 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa2180b3c50 0x7fa2180b6110 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa22800af80 tx=0x7fa22800a4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:36.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.811+0000 7fa2389ef740 1 -- 172.21.15.22:0/2802427109 shutdown_connections 2024-08-20T01:37:36.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.811+0000 7fa2389ef740 1 --2- 172.21.15.22:0/2802427109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc25130 0x56473cc27520 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.811+0000 7fa2389ef740 1 --2- 172.21.15.22:0/2802427109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc191a0 0x56473cc24bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.811+0000 7fa2389ef740 1 --2- 172.21.15.22:0/2802427109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc18880 0x56473cc18c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.811+0000 7fa2389ef740 1 -- 172.21.15.22:0/2802427109 >> 172.21.15.22:0/2802427109 conn(0x56473cc166b0 msgr2=0x56473cc17850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.812+0000 7fa2389ef740 1 -- 172.21.15.22:0/2802427109 shutdown_connections 2024-08-20T01:37:36.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.812+0000 7fa2389ef740 1 -- 172.21.15.22:0/2802427109 wait complete. 2024-08-20T01:37:36.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.812+0000 7fa2389ef740 1 -- start start 2024-08-20T01:37:36.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.812+0000 7fa2389ef740 1 Processor -- start 2024-08-20T01:37:36.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa2389ef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc18880 0x56473cc220d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa2389ef740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc191a0 0x56473cc22610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa2389ef740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc25130 0x56473cc22b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa2389ef740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56473c9e1700 con 0x56473cc25130 2024-08-20T01:37:36.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa2389ef740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56473cb05810 con 0x56473cc191a0 2024-08-20T01:37:36.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa2389ef740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56473cc27de0 con 0x56473cc18880 2024-08-20T01:37:36.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa22ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc18880 0x56473cc220d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa22ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc18880 0x56473cc220d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:60328/0 (socket says 172.21.15.22:60328) 2024-08-20T01:37:36.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa22ffff640 1 -- 172.21.15.22:0/767133857 learned_addr learned my addr 172.21.15.22:0/767133857 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:36.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa2389ef740 10 client.0 _ll_register_callbacks cb 0x56473cb78700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:36.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa234b93640 1 --2- 172.21.15.22:0/767133857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc25130 0x56473cc22b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa22ffff640 1 -- 172.21.15.22:0/767133857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc191a0 msgr2=0x56473cc22610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa22f7fe640 1 --2- 172.21.15.22:0/767133857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc191a0 0x56473cc22610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa22ffff640 1 --2- 172.21.15.22:0/767133857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc191a0 0x56473cc22610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa22ffff640 1 -- 172.21.15.22:0/767133857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc25130 msgr2=0x56473cc22b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa22ffff640 1 --2- 172.21.15.22:0/767133857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc25130 0x56473cc22b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa22ffff640 1 -- 172.21.15.22:0/767133857 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56473cc311c0 con 0x56473cc18880 2024-08-20T01:37:36.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa22f7fe640 1 --2- 172.21.15.22:0/767133857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc191a0 0x56473cc22610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:37:36.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa22ffff640 1 --2- 172.21.15.22:0/767133857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc18880 0x56473cc220d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa220101c70 tx=0x7fa2200092b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb33bfc4981a0b29 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:36.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa20f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:37:36.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa20f7fe640 1 -- 172.21.15.22:0/767133857 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa220049040 con 0x56473cc18880 2024-08-20T01:37:36.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa20f7fe640 1 -- 172.21.15.22:0/767133857 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fa2200c73b0 con 0x56473cc18880 2024-08-20T01:37:36.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.813+0000 7fa2389ef740 1 -- 172.21.15.22:0/767133857 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56473cb2e150 con 0x56473cc18880 2024-08-20T01:37:36.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.814+0000 7fa20f7fe640 1 -- 172.21.15.22:0/767133857 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa2200caef0 con 0x56473cc18880 2024-08-20T01:37:36.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.814+0000 7fa2389ef740 10 client.26029 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:36.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.814+0000 7fa2389ef740 1 -- 172.21.15.22:0/767133857 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56473cc33b70 con 0x56473cc18880 2024-08-20T01:37:36.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.814+0000 7fa20f7fe640 1 -- 172.21.15.22:0/767133857 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56473cb2e150 con 0x56473cc18880 2024-08-20T01:37:36.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.814+0000 7fa20f7fe640 1 -- 172.21.15.22:0/767133857 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fa220003c50 con 0x56473cc18880 2024-08-20T01:37:36.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.814+0000 7fa2389ef740 10 client.26029 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:36.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.814+0000 7fa2389ef740 10 client.26029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:37:36.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.814+0000 7fa2389ef740 20 client.26029 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:36.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.814+0000 7fa2389ef740 1 --2- 172.21.15.22:0/767133857 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56473cc35020 0x56473cc374b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.814+0000 7fa2389ef740 4 client.26029 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:36.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.814+0000 7fa2389ef740 1 -- 172.21.15.22:0/767133857 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56473cb91880 con 0x56473cc35020 2024-08-20T01:37:36.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.814+0000 7fa22f7fe640 1 --2- 172.21.15.22:0/767133857 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56473cc35020 0x56473cc374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.815+0000 7fa22f7fe640 1 --2- 172.21.15.22:0/767133857 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56473cc35020 0x56473cc374b0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16b7b295917c78ab server_cookie=d978fd31c68d3604 in_seq=0 out_seq=0 2024-08-20T01:37:36.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.815+0000 7fa20f7fe640 10 client.26029 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:36.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.817+0000 7fa20f7fe640 1 -- 172.21.15.22:0/767133857 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56473cb91880 con 0x56473cc35020 2024-08-20T01:37:36.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.817+0000 7fa20f7fe640 10 client.26029 handle_command_reply: tid=0 2024-08-20T01:37:36.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.817+0000 7fa2389ef740 1 client.26029 shutdown 2024-08-20T01:37:36.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.817+0000 7fa2389ef740 1 -- 172.21.15.22:0/767133857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc18880 msgr2=0x56473cc220d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.817+0000 7fa2389ef740 1 --2- 172.21.15.22:0/767133857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc18880 0x56473cc220d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa220101c70 tx=0x7fa2200092b0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.817+0000 7fa2389ef740 1 -- 172.21.15.22:0/767133857 shutdown_connections 2024-08-20T01:37:36.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.817+0000 7fa2389ef740 1 --2- 172.21.15.22:0/767133857 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56473cc35020 0x56473cc374b0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.817+0000 7fa2389ef740 1 --2- 172.21.15.22:0/767133857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc25130 0x56473cc22b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.818+0000 7fa2389ef740 1 --2- 172.21.15.22:0/767133857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc191a0 0x56473cc22610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.818+0000 7fa20f7fe640 0 client.26029 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:36.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.818+0000 7fa2389ef740 1 --2- 172.21.15.22:0/767133857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc18880 0x56473cc220d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.818+0000 7fa2389ef740 1 -- 172.21.15.22:0/767133857 >> 172.21.15.22:0/767133857 conn(0x56473cc166b0 msgr2=0x56473cc1c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.818+0000 7fa2389ef740 1 -- 172.21.15.22:0/767133857 shutdown_connections 2024-08-20T01:37:36.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.818+0000 7fa2389ef740 1 -- 172.21.15.22:0/767133857 wait complete. 2024-08-20T01:37:36.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.818+0000 7fa2389ef740 20 client.26029 trim_cache size 0 max 16384 2024-08-20T01:37:36.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.831+0000 7fa2389ef740 1 Processor -- start 2024-08-20T01:37:36.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.831+0000 7fa2389ef740 1 -- start start 2024-08-20T01:37:36.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.831+0000 7fa2389ef740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc18880 0x56473cc17cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.831+0000 7fa2389ef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc191a0 0x56473cc1c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.831+0000 7fa2389ef740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc25130 0x56473cc23e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.831+0000 7fa2389ef740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa2301b2d10 con 0x56473cc18880 2024-08-20T01:37:36.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.831+0000 7fa2389ef740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa2301b0520 con 0x56473cc25130 2024-08-20T01:37:36.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.831+0000 7fa2389ef740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa2301ae370 con 0x56473cc191a0 2024-08-20T01:37:36.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.831+0000 7fa22ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc18880 0x56473cc17cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.831+0000 7fa22ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc18880 0x56473cc17cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47882/0 (socket says 172.21.15.22:47882) 2024-08-20T01:37:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.831+0000 7fa22ffff640 1 -- 172.21.15.22:0/4023407256 learned_addr learned my addr 172.21.15.22:0/4023407256 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.831+0000 7fa22f7fe640 1 --2- 172.21.15.22:0/4023407256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc191a0 0x56473cc1c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.831+0000 7fa234b93640 1 --2- 172.21.15.22:0/4023407256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc25130 0x56473cc23e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.831+0000 7fa22ffff640 1 -- 172.21.15.22:0/4023407256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc191a0 msgr2=0x56473cc1c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.831+0000 7fa22ffff640 1 --2- 172.21.15.22:0/4023407256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc191a0 0x56473cc1c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.831+0000 7fa22ffff640 1 -- 172.21.15.22:0/4023407256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc25130 msgr2=0x56473cc23e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.831+0000 7fa22ffff640 1 --2- 172.21.15.22:0/4023407256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc25130 0x56473cc23e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.831+0000 7fa22ffff640 1 -- 172.21.15.22:0/4023407256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56473cc14d20 con 0x56473cc18880 2024-08-20T01:37:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.832+0000 7fa22ffff640 1 --2- 172.21.15.22:0/4023407256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc18880 0x56473cc17cb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa2201078a0 tx=0x7fa22002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3572576075c45d84 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.832+0000 7fa215ffb640 1 -- 172.21.15.22:0/4023407256 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa220049070 con 0x56473cc18880 2024-08-20T01:37:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.832+0000 7fa215ffb640 1 -- 172.21.15.22:0/4023407256 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2200cb120 con 0x56473cc18880 2024-08-20T01:37:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.832+0000 7fa215ffb640 1 -- 172.21.15.22:0/4023407256 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2200ca890 con 0x56473cc18880 2024-08-20T01:37:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.832+0000 7fa2389ef740 1 -- 172.21.15.22:0/4023407256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc18880 msgr2=0x56473cc17cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.832+0000 7fa2389ef740 1 --2- 172.21.15.22:0/4023407256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc18880 0x56473cc17cb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa2201078a0 tx=0x7fa22002a410 comp rx=0 tx=0).stop 2024-08-20T01:37:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.832+0000 7fa2389ef740 1 -- 172.21.15.22:0/4023407256 shutdown_connections 2024-08-20T01:37:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.832+0000 7fa2389ef740 1 --2- 172.21.15.22:0/4023407256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc25130 0x56473cc23e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.832+0000 7fa2389ef740 1 --2- 172.21.15.22:0/4023407256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc191a0 0x56473cc1c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.832+0000 7fa2389ef740 1 --2- 172.21.15.22:0/4023407256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc18880 0x56473cc17cb0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.832+0000 7fa2389ef740 1 -- 172.21.15.22:0/4023407256 >> 172.21.15.22:0/4023407256 conn(0x56473cc166b0 msgr2=0x56473cc23700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.833+0000 7fa2389ef740 1 -- 172.21.15.22:0/4023407256 shutdown_connections 2024-08-20T01:37:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.833+0000 7fa2389ef740 1 -- 172.21.15.22:0/4023407256 wait complete. 2024-08-20T01:37:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.833+0000 7fa2389ef740 1 -- start start 2024-08-20T01:37:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.833+0000 7fa2389ef740 1 Processor -- start 2024-08-20T01:37:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.833+0000 7fa2389ef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc18880 0x56473cc28850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.833+0000 7fa2389ef740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc191a0 0x56473cc28df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.833+0000 7fa2389ef740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc25130 0x56473cc9dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.833+0000 7fa2389ef740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa2301ae9e0 con 0x56473cc25130 2024-08-20T01:37:36.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.833+0000 7fa2389ef740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa2301afe50 con 0x56473cc191a0 2024-08-20T01:37:36.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.833+0000 7fa2389ef740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa2301af0b0 con 0x56473cc18880 2024-08-20T01:37:36.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.833+0000 7fa2389ef740 10 client.0 _ll_register_callbacks cb 0x7fa22003ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:36.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.833+0000 7fa234b93640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc25130 0x56473cc9dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.833+0000 7fa22ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc18880 0x56473cc28850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.834+0000 7fa234b93640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc25130 0x56473cc9dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47884/0 (socket says 172.21.15.22:47884) 2024-08-20T01:37:36.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.834+0000 7fa234b93640 1 -- 172.21.15.22:0/1556707824 learned_addr learned my addr 172.21.15.22:0/1556707824 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:36.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.834+0000 7fa22ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc18880 0x56473cc28850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:60356/0 (socket says 172.21.15.22:60356) 2024-08-20T01:37:36.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.834+0000 7fa22f7fe640 1 --2- 172.21.15.22:0/1556707824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc191a0 0x56473cc28df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.834+0000 7fa22ffff640 1 -- 172.21.15.22:0/1556707824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc191a0 msgr2=0x56473cc28df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.834+0000 7fa22ffff640 1 --2- 172.21.15.22:0/1556707824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc191a0 0x56473cc28df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.834+0000 7fa22ffff640 1 -- 172.21.15.22:0/1556707824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc25130 msgr2=0x56473cc9dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.834+0000 7fa22ffff640 1 --2- 172.21.15.22:0/1556707824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc25130 0x56473cc9dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.834+0000 7fa22ffff640 1 -- 172.21.15.22:0/1556707824 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56473cc9e4c0 con 0x56473cc18880 2024-08-20T01:37:36.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.834+0000 7fa234b93640 1 --2- 172.21.15.22:0/1556707824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc25130 0x56473cc9dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:36.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.834+0000 7fa22ffff640 1 --2- 172.21.15.22:0/1556707824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc18880 0x56473cc28850 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa2200cb0b0 tx=0x7fa220009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1ba2afa83d14efe server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:36.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.834+0000 7fa20f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:37:36.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.834+0000 7fa20f7fe640 1 -- 172.21.15.22:0/1556707824 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa220049070 con 0x56473cc18880 2024-08-20T01:37:36.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.834+0000 7fa20f7fe640 1 -- 172.21.15.22:0/1556707824 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fa220003c50 con 0x56473cc18880 2024-08-20T01:37:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.834+0000 7fa2389ef740 1 -- 172.21.15.22:0/1556707824 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2200cb120 con 0x56473cc18880 2024-08-20T01:37:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.834+0000 7fa20f7fe640 1 -- 172.21.15.22:0/1556707824 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa2200caa70 con 0x56473cc18880 2024-08-20T01:37:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.834+0000 7fa2389ef740 10 client.26035 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.834+0000 7fa2389ef740 1 -- 172.21.15.22:0/1556707824 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56473cc9e4c0 con 0x56473cc18880 2024-08-20T01:37:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.835+0000 7fa20f7fe640 1 -- 172.21.15.22:0/1556707824 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2200cb120 con 0x56473cc18880 2024-08-20T01:37:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.835+0000 7fa20f7fe640 1 -- 172.21.15.22:0/1556707824 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fa2200ca380 con 0x56473cc18880 2024-08-20T01:37:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.835+0000 7fa2389ef740 10 client.26035 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.835+0000 7fa2389ef740 10 client.26035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:37:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.835+0000 7fa2389ef740 20 client.26035 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.835+0000 7fa2389ef740 1 --2- 172.21.15.22:0/1556707824 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56473cc9fad0 0x56473cca1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.835+0000 7fa2389ef740 4 client.26035 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:37:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.835+0000 7fa2389ef740 1 -- 172.21.15.22:0/1556707824 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56473cc1dca0 con 0x56473cc9fad0 2024-08-20T01:37:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.835+0000 7fa22f7fe640 1 --2- 172.21.15.22:0/1556707824 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56473cc9fad0 0x56473cca1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.836+0000 7fa22f7fe640 1 --2- 172.21.15.22:0/1556707824 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56473cc9fad0 0x56473cca1ef0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca14a7aafbc85834 server_cookie=a8536629d5657e58 in_seq=0 out_seq=0 2024-08-20T01:37:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.836+0000 7fa20f7fe640 10 client.26035 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:36.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.836+0000 7fa20f7fe640 1 -- 172.21.15.22:0/1556707824 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56473cc1dca0 con 0x56473cc9fad0 2024-08-20T01:37:36.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.836+0000 7fa20f7fe640 10 client.26035 handle_command_reply: tid=0 2024-08-20T01:37:36.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.836+0000 7fa2389ef740 1 client.26035 shutdown 2024-08-20T01:37:36.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.837+0000 7fa2389ef740 1 -- 172.21.15.22:0/1556707824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc18880 msgr2=0x56473cc28850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.837+0000 7fa2389ef740 1 --2- 172.21.15.22:0/1556707824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc18880 0x56473cc28850 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa2200cb0b0 tx=0x7fa220009290 comp rx=0 tx=0).stop 2024-08-20T01:37:36.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.837+0000 7fa2389ef740 1 -- 172.21.15.22:0/1556707824 shutdown_connections 2024-08-20T01:37:36.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.837+0000 7fa2389ef740 1 --2- 172.21.15.22:0/1556707824 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56473cc9fad0 0x56473cca1ef0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.837+0000 7fa2389ef740 1 --2- 172.21.15.22:0/1556707824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56473cc25130 0x56473cc9dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.837+0000 7fa2389ef740 1 --2- 172.21.15.22:0/1556707824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56473cc191a0 0x56473cc28df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.837+0000 7fa2389ef740 1 --2- 172.21.15.22:0/1556707824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56473cc18880 0x56473cc28850 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.837+0000 7fa20f7fe640 0 client.26035 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:36.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.837+0000 7fa2389ef740 1 -- 172.21.15.22:0/1556707824 >> 172.21.15.22:0/1556707824 conn(0x56473cc166b0 msgr2=0x56473cc22040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.837+0000 7fa2389ef740 1 -- 172.21.15.22:0/1556707824 shutdown_connections 2024-08-20T01:37:36.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.837+0000 7fa2389ef740 1 -- 172.21.15.22:0/1556707824 wait complete. 2024-08-20T01:37:36.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.837+0000 7fa2389ef740 20 client.26035 trim_cache size 0 max 16384 2024-08-20T01:37:36.845 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:37:36.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.837+0000 7fa2365f6640 1 -- 172.21.15.22:0/1685895851 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa2180b3c50 msgr2=0x7fa2180b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.837+0000 7fa2365f6640 1 --2- 172.21.15.22:0/1685895851 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa2180b3c50 0x7fa2180b6110 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa22800af80 tx=0x7fa22800a4d0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.837+0000 7fa2365f6640 1 -- 172.21.15.22:0/1685895851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa230101990 msgr2=0x7fa23019b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.837+0000 7fa2365f6640 1 --2- 172.21.15.22:0/1685895851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa230101990 0x7fa23019b1e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa220005940 tx=0x7fa220004270 comp rx=0 tx=0).stop 2024-08-20T01:37:36.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.838+0000 7fa2365f6640 1 -- 172.21.15.22:0/1685895851 shutdown_connections 2024-08-20T01:37:36.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.838+0000 7fa2365f6640 1 --2- 172.21.15.22:0/1685895851 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa2180b3c50 0x7fa2180b6110 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.838+0000 7fa2365f6640 1 --2- 172.21.15.22:0/1685895851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa230107d20 0x7fa2301a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.838+0000 7fa2365f6640 1 --2- 172.21.15.22:0/1685895851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2301073a0 0x7fa23019b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.838+0000 7fa2365f6640 1 --2- 172.21.15.22:0/1685895851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa230101990 0x7fa23019b1e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.838+0000 7fa2365f6640 1 -- 172.21.15.22:0/1685895851 >> 172.21.15.22:0/1685895851 conn(0x7fa2300fd400 msgr2=0x7fa230103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.838+0000 7fa2365f6640 1 -- 172.21.15.22:0/1685895851 shutdown_connections 2024-08-20T01:37:36.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:36.838+0000 7fa2365f6640 1 -- 172.21.15.22:0/1685895851 wait complete. 2024-08-20T01:37:37.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:36 smithi134 ceph-mon[22511]: pgmap v540: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 390 op/s 2024-08-20T01:37:38.515 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:37:38.515 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:37:38.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:38 smithi077 ceph-mon[22251]: pgmap v541: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 457 op/s 2024-08-20T01:37:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:38.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:38 smithi022 ceph-mon[18709]: pgmap v541: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 457 op/s 2024-08-20T01:37:39.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:38 smithi134 ceph-mon[22511]: pgmap v541: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 457 op/s 2024-08-20T01:37:39.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.378+0000 7f8950d48640 1 -- 172.21.15.22:0/2548301422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c103830 msgr2=0x7f894c103c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:39.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.378+0000 7f8950d48640 1 --2- 172.21.15.22:0/2548301422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c103830 0x7f894c103c10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f893c009900 tx=0x7f893c02a410 comp rx=0 tx=0).stop 2024-08-20T01:37:39.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.378+0000 7f8950d48640 1 -- 172.21.15.22:0/2548301422 shutdown_connections 2024-08-20T01:37:39.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.378+0000 7f8950d48640 1 --2- 172.21.15.22:0/2548301422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f894c10cde0 0x7f894c10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.378+0000 7f8950d48640 1 --2- 172.21.15.22:0/2548301422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f894c104230 0x7f894c10c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.378+0000 7f8950d48640 1 --2- 172.21.15.22:0/2548301422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c103830 0x7f894c103c10 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.378+0000 7f8950d48640 1 -- 172.21.15.22:0/2548301422 >> 172.21.15.22:0/2548301422 conn(0x7f894c0fd400 msgr2=0x7f894c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:39.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.378+0000 7f8950d48640 1 -- 172.21.15.22:0/2548301422 shutdown_connections 2024-08-20T01:37:39.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.378+0000 7f8950d48640 1 -- 172.21.15.22:0/2548301422 wait complete. 2024-08-20T01:37:39.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.379+0000 7f8950d48640 1 Processor -- start 2024-08-20T01:37:39.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.379+0000 7f8950d48640 1 -- start start 2024-08-20T01:37:39.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.380+0000 7f8950d48640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f894c103830 0x7f894c198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.380+0000 7f8950d48640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f894c104230 0x7f894c199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.380+0000 7f8950d48640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c10cde0 0x7f894c19e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.380+0000 7f8950d48640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f894c112ab0 con 0x7f894c10cde0 2024-08-20T01:37:39.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.380+0000 7f8950d48640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f894c112930 con 0x7f894c104230 2024-08-20T01:37:39.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.380+0000 7f8950d48640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f894c112c30 con 0x7f894c103830 2024-08-20T01:37:39.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.380+0000 7f894ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c10cde0 0x7f894c19e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.380+0000 7f894ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c10cde0 0x7f894c19e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47906/0 (socket says 172.21.15.22:47906) 2024-08-20T01:37:39.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.380+0000 7f894a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f894c103830 0x7f894c198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.380+0000 7f894ad9d640 1 -- 172.21.15.22:0/1521949129 learned_addr learned my addr 172.21.15.22:0/1521949129 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:39.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.380+0000 7f8949d9b640 1 --2- 172.21.15.22:0/1521949129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f894c104230 0x7f894c199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.380+0000 7f8949d9b640 1 -- 172.21.15.22:0/1521949129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f894c103830 msgr2=0x7f894c198fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:39.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.380+0000 7f8949d9b640 1 --2- 172.21.15.22:0/1521949129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f894c103830 0x7f894c198fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.380+0000 7f8949d9b640 1 -- 172.21.15.22:0/1521949129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c10cde0 msgr2=0x7f894c19e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:39.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.380+0000 7f8949d9b640 1 --2- 172.21.15.22:0/1521949129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c10cde0 0x7f894c19e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.380+0000 7f8949d9b640 1 -- 172.21.15.22:0/1521949129 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f894c19f070 con 0x7f894c104230 2024-08-20T01:37:39.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.380+0000 7f894ad9d640 1 --2- 172.21.15.22:0/1521949129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c10cde0 0x7f894c19e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:39.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.380+0000 7f8949d9b640 1 --2- 172.21.15.22:0/1521949129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f894c104230 0x7f894c199500 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f894000e9f0 tx=0x7f894000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:39.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.381+0000 7f893b7fe640 1 -- 172.21.15.22:0/1521949129 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894000cd80 con 0x7f894c104230 2024-08-20T01:37:39.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.381+0000 7f893b7fe640 1 -- 172.21.15.22:0/1521949129 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89400035f0 con 0x7f894c104230 2024-08-20T01:37:39.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.381+0000 7f8950d48640 1 -- 172.21.15.22:0/1521949129 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f894c19f360 con 0x7f894c104230 2024-08-20T01:37:39.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.381+0000 7f893b7fe640 1 -- 172.21.15.22:0/1521949129 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8940010670 con 0x7f894c104230 2024-08-20T01:37:39.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.381+0000 7f8950d48640 1 -- 172.21.15.22:0/1521949129 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f894c1a5a20 con 0x7f894c104230 2024-08-20T01:37:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.383+0000 7f893b7fe640 1 -- 172.21.15.22:0/1521949129 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f89400037a0 con 0x7f894c104230 2024-08-20T01:37:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.383+0000 7f8953141740 1 Processor -- start 2024-08-20T01:37:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.384+0000 7f8953141740 1 -- start start 2024-08-20T01:37:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.384+0000 7f8953141740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b73b0 0x5650941b7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.384+0000 7f8953141740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941b7cd0 0x5650941c3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.384+0000 7f8953141740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941c3c60 0x5650941c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.384+0000 7f8953141740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56509412d940 con 0x5650941b73b0 2024-08-20T01:37:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.384+0000 7f8953141740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56509411ce40 con 0x5650941c3c60 2024-08-20T01:37:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.384+0000 7f8953141740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x565094120e80 con 0x5650941b7cd0 2024-08-20T01:37:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.384+0000 7f894a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941b7cd0 0x5650941c3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.384+0000 7f894a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941b7cd0 0x5650941c3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:60384/0 (socket says 172.21.15.22:60384) 2024-08-20T01:37:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.384+0000 7f894a59c640 1 -- 172.21.15.22:0/4135077956 learned_addr learned my addr 172.21.15.22:0/4135077956 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.384+0000 7f894ad9d640 1 --2- 172.21.15.22:0/4135077956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b73b0 0x5650941b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.384+0000 7f8949d9b640 1 --2- 172.21.15.22:0/4135077956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941c3c60 0x5650941c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.384+0000 7f893b7fe640 1 --2- 172.21.15.22:0/1521949129 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f89340b3bd0 0x7f89340b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.385+0000 7f894a59c640 1 -- 172.21.15.22:0/4135077956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941c3c60 msgr2=0x5650941c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.385+0000 7f894a59c640 1 --2- 172.21.15.22:0/4135077956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941c3c60 0x5650941c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.385+0000 7f894a59c640 1 -- 172.21.15.22:0/4135077956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b73b0 msgr2=0x5650941b7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.385+0000 7f894a59c640 1 --2- 172.21.15.22:0/4135077956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b73b0 0x5650941b7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.385+0000 7f894a59c640 1 -- 172.21.15.22:0/4135077956 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650940b9520 con 0x5650941b7cd0 2024-08-20T01:37:39.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.385+0000 7f894ad9d640 1 --2- 172.21.15.22:0/4135077956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b73b0 0x5650941b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:39.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.385+0000 7f894ad9d640 1 --2- 172.21.15.22:0/1521949129 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f89340b3bd0 0x7f89340b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.385+0000 7f893b7fe640 1 -- 172.21.15.22:0/1521949129 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f89400e3e90 con 0x7f894c104230 2024-08-20T01:37:39.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.385+0000 7f894a59c640 1 --2- 172.21.15.22:0/4135077956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941b7cd0 0x5650941c3720 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f893c009230 tx=0x7f893c004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c84a245dd628234 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:39.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.385+0000 7f894ad9d640 1 --2- 172.21.15.22:0/1521949129 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f89340b3bd0 0x7f89340b6090 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f89440049d0 tx=0x7f8944004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:39.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.385+0000 7f8938ff9640 1 -- 172.21.15.22:0/4135077956 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f893c040070 con 0x5650941b7cd0 2024-08-20T01:37:39.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.385+0000 7f8938ff9640 1 -- 172.21.15.22:0/4135077956 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f893c004430 con 0x5650941b7cd0 2024-08-20T01:37:39.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.385+0000 7f8938ff9640 1 -- 172.21.15.22:0/4135077956 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f893c035040 con 0x5650941b7cd0 2024-08-20T01:37:39.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.386+0000 7f8953141740 1 -- 172.21.15.22:0/4135077956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941b7cd0 msgr2=0x5650941c3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:39.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.386+0000 7f8953141740 1 --2- 172.21.15.22:0/4135077956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941b7cd0 0x5650941c3720 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f893c009230 tx=0x7f893c004040 comp rx=0 tx=0).stop 2024-08-20T01:37:39.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.386+0000 7f8953141740 1 -- 172.21.15.22:0/4135077956 shutdown_connections 2024-08-20T01:37:39.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.386+0000 7f8953141740 1 --2- 172.21.15.22:0/4135077956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941c3c60 0x5650941c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.386+0000 7f8953141740 1 --2- 172.21.15.22:0/4135077956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941b7cd0 0x5650941c3720 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.386+0000 7f8953141740 1 --2- 172.21.15.22:0/4135077956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b73b0 0x5650941b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.386+0000 7f8953141740 1 -- 172.21.15.22:0/4135077956 >> 172.21.15.22:0/4135077956 conn(0x5650941b51e0 msgr2=0x5650941b6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:39.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.386+0000 7f8953141740 1 -- 172.21.15.22:0/4135077956 shutdown_connections 2024-08-20T01:37:39.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.386+0000 7f8953141740 1 -- 172.21.15.22:0/4135077956 wait complete. 2024-08-20T01:37:39.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.387+0000 7f8953141740 1 -- start start 2024-08-20T01:37:39.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.387+0000 7f8953141740 1 Processor -- start 2024-08-20T01:37:39.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.387+0000 7f8953141740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941b73b0 0x5650941c0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.387+0000 7f8953141740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b7cd0 0x5650941c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.387+0000 7f8953141740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941c3c60 0x5650941c1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.387+0000 7f8953141740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x565093f7f890 con 0x5650941b7cd0 2024-08-20T01:37:39.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.387+0000 7f8953141740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5650940a3700 con 0x5650941b73b0 2024-08-20T01:37:39.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.387+0000 7f8953141740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5650941c6950 con 0x5650941c3c60 2024-08-20T01:37:39.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.387+0000 7f8949d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b7cd0 0x5650941c11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.387+0000 7f8953141740 10 client.0 _ll_register_callbacks cb 0x5650941186f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.387+0000 7f8949d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b7cd0 0x5650941c11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47920/0 (socket says 172.21.15.22:47920) 2024-08-20T01:37:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.387+0000 7f8949d9b640 1 -- 172.21.15.22:0/1956099043 learned_addr learned my addr 172.21.15.22:0/1956099043 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.387+0000 7f894a59c640 1 --2- 172.21.15.22:0/1956099043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941b73b0 0x5650941c0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.387+0000 7f894ad9d640 1 --2- 172.21.15.22:0/1956099043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941c3c60 0x5650941c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.388+0000 7f8949d9b640 1 -- 172.21.15.22:0/1956099043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941c3c60 msgr2=0x5650941c1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.388+0000 7f8949d9b640 1 --2- 172.21.15.22:0/1956099043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941c3c60 0x5650941c1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.388+0000 7f8949d9b640 1 -- 172.21.15.22:0/1956099043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941b73b0 msgr2=0x5650941c0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.388+0000 7f8949d9b640 1 --2- 172.21.15.22:0/1956099043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941b73b0 0x5650941c0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.388+0000 7f8949d9b640 1 -- 172.21.15.22:0/1956099043 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565093e7c930 con 0x5650941b7cd0 2024-08-20T01:37:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.388+0000 7f8949d9b640 1 --2- 172.21.15.22:0/1956099043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b7cd0 0x5650941c11d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f894000e9c0 tx=0x7f89400aab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97b79ae6cf8d71a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.388+0000 7f8931ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:37:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.388+0000 7f8931ffb640 1 -- 172.21.15.22:0/1956099043 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89400aa8b0 con 0x5650941b7cd0 2024-08-20T01:37:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.388+0000 7f8931ffb640 1 -- 172.21.15.22:0/1956099043 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f8940009310 con 0x5650941b7cd0 2024-08-20T01:37:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.388+0000 7f8953141740 1 -- 172.21.15.22:0/1956099043 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f893c004430 con 0x5650941b7cd0 2024-08-20T01:37:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.388+0000 7f8931ffb640 1 -- 172.21.15.22:0/1956099043 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f89400ab4a0 con 0x5650941b7cd0 2024-08-20T01:37:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.388+0000 7f8953141740 10 client.16392 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.388+0000 7f8953141740 1 -- 172.21.15.22:0/1956099043 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5650941d2570 con 0x5650941b7cd0 2024-08-20T01:37:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.389+0000 7f8931ffb640 1 -- 172.21.15.22:0/1956099043 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f893c004430 con 0x5650941b7cd0 2024-08-20T01:37:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.389+0000 7f8931ffb640 1 -- 172.21.15.22:0/1956099043 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f89400e0a20 con 0x5650941b7cd0 2024-08-20T01:37:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.389+0000 7f8953141740 10 client.16392 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.389+0000 7f8953141740 10 client.16392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:37:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.389+0000 7f8953141740 20 client.16392 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.389+0000 7f8953141740 1 --2- 172.21.15.22:0/1956099043 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5650941d3a30 0x5650941d5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.389+0000 7f8953141740 4 client.16392 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.389+0000 7f8953141740 1 -- 172.21.15.22:0/1956099043 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56509412f890 con 0x5650941d3a30 2024-08-20T01:37:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.389+0000 7f894a59c640 1 --2- 172.21.15.22:0/1956099043 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5650941d3a30 0x5650941d5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.390+0000 7f8931ffb640 10 client.16392 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:39.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.390+0000 7f894a59c640 1 --2- 172.21.15.22:0/1956099043 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5650941d3a30 0x5650941d5e80 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90c7342b4949b720 server_cookie=96c7991e390f4486 in_seq=0 out_seq=0 2024-08-20T01:37:39.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.390+0000 7f8931ffb640 1 -- 172.21.15.22:0/1956099043 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56509412f890 con 0x5650941d3a30 2024-08-20T01:37:39.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.390+0000 7f8931ffb640 10 client.16392 handle_command_reply: tid=0 2024-08-20T01:37:39.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.390+0000 7f8953141740 1 client.16392 shutdown 2024-08-20T01:37:39.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.390+0000 7f8953141740 1 -- 172.21.15.22:0/1956099043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b7cd0 msgr2=0x5650941c11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:39.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.390+0000 7f8953141740 1 --2- 172.21.15.22:0/1956099043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b7cd0 0x5650941c11d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f894000e9c0 tx=0x7f89400aab70 comp rx=0 tx=0).stop 2024-08-20T01:37:39.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.391+0000 7f8953141740 1 -- 172.21.15.22:0/1956099043 shutdown_connections 2024-08-20T01:37:39.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.391+0000 7f8953141740 1 --2- 172.21.15.22:0/1956099043 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5650941d3a30 0x5650941d5e80 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.391+0000 7f8953141740 1 --2- 172.21.15.22:0/1956099043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941c3c60 0x5650941c1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.391+0000 7f8953141740 1 --2- 172.21.15.22:0/1956099043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b7cd0 0x5650941c11d0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.391+0000 7f8931ffb640 0 client.16392 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:39.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.391+0000 7f8953141740 1 --2- 172.21.15.22:0/1956099043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941b73b0 0x5650941c0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.391+0000 7f8953141740 1 -- 172.21.15.22:0/1956099043 >> 172.21.15.22:0/1956099043 conn(0x5650941b51e0 msgr2=0x5650941bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:39.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.391+0000 7f8953141740 1 -- 172.21.15.22:0/1956099043 shutdown_connections 2024-08-20T01:37:39.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.391+0000 7f8953141740 1 -- 172.21.15.22:0/1956099043 wait complete. 2024-08-20T01:37:39.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.391+0000 7f8953141740 20 client.16392 trim_cache size 0 max 16384 2024-08-20T01:37:39.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.409+0000 7f8953141740 1 Processor -- start 2024-08-20T01:37:39.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.409+0000 7f8953141740 1 -- start start 2024-08-20T01:37:39.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.409+0000 7f8953141740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941b73b0 0x5650941c2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.409+0000 7f8953141740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941b7cd0 0x5650941c1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.409+0000 7f8953141740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941c3c60 0x5650941db750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.409+0000 7f8953141740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f894c1b0ba0 con 0x5650941c3c60 2024-08-20T01:37:39.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.409+0000 7f8953141740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f894c1ae3b0 con 0x5650941b73b0 2024-08-20T01:37:39.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.409+0000 7f8953141740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f894c1ac200 con 0x5650941b7cd0 2024-08-20T01:37:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.409+0000 7f894ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941c3c60 0x5650941db750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.409+0000 7f8949d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941b7cd0 0x5650941c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.409+0000 7f894ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941c3c60 0x5650941db750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47928/0 (socket says 172.21.15.22:47928) 2024-08-20T01:37:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.409+0000 7f894ad9d640 1 -- 172.21.15.22:0/2930445855 learned_addr learned my addr 172.21.15.22:0/2930445855 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.409+0000 7f894a59c640 1 --2- 172.21.15.22:0/2930445855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941b73b0 0x5650941c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.410+0000 7f894ad9d640 1 -- 172.21.15.22:0/2930445855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941b7cd0 msgr2=0x5650941c1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.410+0000 7f894ad9d640 1 --2- 172.21.15.22:0/2930445855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941b7cd0 0x5650941c1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.410+0000 7f894ad9d640 1 -- 172.21.15.22:0/2930445855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941b73b0 msgr2=0x5650941c2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.410+0000 7f894ad9d640 1 --2- 172.21.15.22:0/2930445855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941b73b0 0x5650941c2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.410+0000 7f894ad9d640 1 -- 172.21.15.22:0/2930445855 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650941b5c60 con 0x5650941c3c60 2024-08-20T01:37:39.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.410+0000 7f894a59c640 1 --2- 172.21.15.22:0/2930445855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941b73b0 0x5650941c2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:39.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.410+0000 7f894ad9d640 1 --2- 172.21.15.22:0/2930445855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941c3c60 0x5650941db750 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f894400fe80 tx=0x7f894401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0887ba09eba4449 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:39.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.410+0000 7f8933fff640 1 -- 172.21.15.22:0/2930445855 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894401ce30 con 0x5650941c3c60 2024-08-20T01:37:39.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.410+0000 7f8933fff640 1 -- 172.21.15.22:0/2930445855 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f894402d070 con 0x5650941c3c60 2024-08-20T01:37:39.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.410+0000 7f8933fff640 1 -- 172.21.15.22:0/2930445855 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894400e770 con 0x5650941c3c60 2024-08-20T01:37:39.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.411+0000 7f8953141740 1 -- 172.21.15.22:0/2930445855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941c3c60 msgr2=0x5650941db750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:39.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.411+0000 7f8953141740 1 --2- 172.21.15.22:0/2930445855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941c3c60 0x5650941db750 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f894400fe80 tx=0x7f894401a000 comp rx=0 tx=0).stop 2024-08-20T01:37:39.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.411+0000 7f8953141740 1 -- 172.21.15.22:0/2930445855 shutdown_connections 2024-08-20T01:37:39.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.411+0000 7f8953141740 1 --2- 172.21.15.22:0/2930445855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941c3c60 0x5650941db750 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.411+0000 7f8953141740 1 --2- 172.21.15.22:0/2930445855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941b7cd0 0x5650941c1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.411+0000 7f8953141740 1 --2- 172.21.15.22:0/2930445855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941b73b0 0x5650941c2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.411+0000 7f8953141740 1 -- 172.21.15.22:0/2930445855 >> 172.21.15.22:0/2930445855 conn(0x5650941b51e0 msgr2=0x5650941c0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:39.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.411+0000 7f8953141740 1 -- 172.21.15.22:0/2930445855 shutdown_connections 2024-08-20T01:37:39.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.411+0000 7f8953141740 1 -- 172.21.15.22:0/2930445855 wait complete. 2024-08-20T01:37:39.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.411+0000 7f8953141740 1 -- start start 2024-08-20T01:37:39.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.411+0000 7f8953141740 1 Processor -- start 2024-08-20T01:37:39.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f8953141740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941b73b0 0x5650941c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f8953141740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b7cd0 0x5650941c8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f8953141740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941c3c60 0x5650942376f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f8953141740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f894c1ac870 con 0x5650941b7cd0 2024-08-20T01:37:39.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f8953141740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f894c1adce0 con 0x5650941b73b0 2024-08-20T01:37:39.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f8953141740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f894c1acf40 con 0x5650941c3c60 2024-08-20T01:37:39.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f8953141740 10 client.0 _ll_register_callbacks cb 0x7f89400e7660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:39.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f8949d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b7cd0 0x5650941c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f894a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941b73b0 0x5650941c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f8949d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b7cd0 0x5650941c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47932/0 (socket says 172.21.15.22:47932) 2024-08-20T01:37:39.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f8949d9b640 1 -- 172.21.15.22:0/2524492995 learned_addr learned my addr 172.21.15.22:0/2524492995 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:39.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f894ad9d640 1 --2- 172.21.15.22:0/2524492995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941c3c60 0x5650942376f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f8949d9b640 1 -- 172.21.15.22:0/2524492995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941c3c60 msgr2=0x5650942376f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:39.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f8949d9b640 1 --2- 172.21.15.22:0/2524492995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941c3c60 0x5650942376f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f8949d9b640 1 -- 172.21.15.22:0/2524492995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941b73b0 msgr2=0x5650941c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:39.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f8949d9b640 1 --2- 172.21.15.22:0/2524492995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941b73b0 0x5650941c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f8949d9b640 1 -- 172.21.15.22:0/2524492995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565094237e00 con 0x5650941b7cd0 2024-08-20T01:37:39.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f894a59c640 1 --2- 172.21.15.22:0/2524492995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941b73b0 0x5650941c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:39.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f8949d9b640 1 --2- 172.21.15.22:0/2524492995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b7cd0 0x5650941c8910 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f89400e7710 tx=0x7f8940003d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc4ac8fb32ab596 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:39.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f8931ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:37:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.412+0000 7f8931ffb640 1 -- 172.21.15.22:0/2524492995 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89400c9060 con 0x5650941b7cd0 2024-08-20T01:37:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.413+0000 7f8931ffb640 1 -- 172.21.15.22:0/2524492995 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f89400aa200 con 0x5650941b7cd0 2024-08-20T01:37:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.413+0000 7f8953141740 1 -- 172.21.15.22:0/2524492995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f894402d070 con 0x5650941b7cd0 2024-08-20T01:37:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.413+0000 7f8931ffb640 1 -- 172.21.15.22:0/2524492995 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f89400aa6f0 con 0x5650941b7cd0 2024-08-20T01:37:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.413+0000 7f8953141740 10 client.16398 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.413+0000 7f8953141740 1 -- 172.21.15.22:0/2524492995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56509423f1e0 con 0x5650941b7cd0 2024-08-20T01:37:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.413+0000 7f8931ffb640 1 -- 172.21.15.22:0/2524492995 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f894402d070 con 0x5650941b7cd0 2024-08-20T01:37:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.413+0000 7f8931ffb640 1 -- 172.21.15.22:0/2524492995 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f894008c080 con 0x5650941b7cd0 2024-08-20T01:37:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.413+0000 7f8953141740 10 client.16398 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.413+0000 7f8953141740 10 client.16398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:37:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.413+0000 7f8953141740 20 client.16398 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.413+0000 7f8953141740 1 --2- 172.21.15.22:0/2524492995 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56509423f850 0x565094241c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.413+0000 7f8953141740 4 client.16398 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:37:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.413+0000 7f8953141740 1 -- 172.21.15.22:0/2524492995 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56509412b330 con 0x56509423f850 2024-08-20T01:37:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.413+0000 7f894a59c640 1 --2- 172.21.15.22:0/2524492995 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56509423f850 0x565094241c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.414+0000 7f894a59c640 1 --2- 172.21.15.22:0/2524492995 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56509423f850 0x565094241c70 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bad2ffe3f9f8985 server_cookie=934fb5a05efe048b in_seq=0 out_seq=0 2024-08-20T01:37:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.414+0000 7f8931ffb640 10 client.16398 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.415+0000 7f8931ffb640 1 -- 172.21.15.22:0/2524492995 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56509412b330 con 0x56509423f850 2024-08-20T01:37:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.415+0000 7f8931ffb640 10 client.16398 handle_command_reply: tid=0 2024-08-20T01:37:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.415+0000 7f8953141740 1 client.16398 shutdown 2024-08-20T01:37:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.415+0000 7f8953141740 1 -- 172.21.15.22:0/2524492995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b7cd0 msgr2=0x5650941c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.415+0000 7f8953141740 1 --2- 172.21.15.22:0/2524492995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b7cd0 0x5650941c8910 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f89400e7710 tx=0x7f8940003d90 comp rx=0 tx=0).stop 2024-08-20T01:37:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.415+0000 7f8953141740 1 -- 172.21.15.22:0/2524492995 shutdown_connections 2024-08-20T01:37:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.415+0000 7f8953141740 1 --2- 172.21.15.22:0/2524492995 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56509423f850 0x565094241c70 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.415+0000 7f8931ffb640 0 client.16398 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.415+0000 7f8953141740 1 --2- 172.21.15.22:0/2524492995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650941c3c60 0x5650942376f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.415+0000 7f8953141740 1 --2- 172.21.15.22:0/2524492995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5650941b7cd0 0x5650941c8910 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.415+0000 7f8953141740 1 --2- 172.21.15.22:0/2524492995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650941b73b0 0x5650941c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.415+0000 7f8953141740 1 -- 172.21.15.22:0/2524492995 >> 172.21.15.22:0/2524492995 conn(0x5650941b51e0 msgr2=0x5650941ba560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:39.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.416+0000 7f8953141740 1 -- 172.21.15.22:0/2524492995 shutdown_connections 2024-08-20T01:37:39.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.416+0000 7f8953141740 1 -- 172.21.15.22:0/2524492995 wait complete. 2024-08-20T01:37:39.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.416+0000 7f8953141740 20 client.16398 trim_cache size 0 max 16384 2024-08-20T01:37:39.425 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:37:39.425 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-08-20T01:37:39.425 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "25b1477d-d873-43a6-960c-894cd20c0d05", 2024-08-20T01:37:39.425 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-08-20T01:37:39.426 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:37:39.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.416+0000 7f8950d48640 1 -- 172.21.15.22:0/1521949129 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f89340b3bd0 msgr2=0x7f89340b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:39.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.416+0000 7f8950d48640 1 --2- 172.21.15.22:0/1521949129 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f89340b3bd0 0x7f89340b6090 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f89440049d0 tx=0x7f8944004a40 comp rx=0 tx=0).stop 2024-08-20T01:37:39.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.416+0000 7f8950d48640 1 -- 172.21.15.22:0/1521949129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f894c104230 msgr2=0x7f894c199500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:39.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.416+0000 7f8950d48640 1 --2- 172.21.15.22:0/1521949129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f894c104230 0x7f894c199500 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f894000e9f0 tx=0x7f894000eeb0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.416+0000 7f8950d48640 1 -- 172.21.15.22:0/1521949129 shutdown_connections 2024-08-20T01:37:39.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.416+0000 7f8950d48640 1 --2- 172.21.15.22:0/1521949129 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f89340b3bd0 0x7f89340b6090 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.416+0000 7f8950d48640 1 --2- 172.21.15.22:0/1521949129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c10cde0 0x7f894c19e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.416+0000 7f8950d48640 1 --2- 172.21.15.22:0/1521949129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f894c104230 0x7f894c199500 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.416+0000 7f8950d48640 1 --2- 172.21.15.22:0/1521949129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f894c103830 0x7f894c198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.416+0000 7f8950d48640 1 -- 172.21.15.22:0/1521949129 >> 172.21.15.22:0/1521949129 conn(0x7f894c0fd400 msgr2=0x7f894c0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:39.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.416+0000 7f8950d48640 1 -- 172.21.15.22:0/1521949129 shutdown_connections 2024-08-20T01:37:39.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:39.417+0000 7f8950d48640 1 -- 172.21.15.22:0/1521949129 wait complete. 2024-08-20T01:37:39.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:39 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:37:39.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:39 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:37:39.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:39 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:37:39.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:39 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:37:39.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:39 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T01:37:39.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:39 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:37:39.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:39 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:37:39.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:39 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:37:39.888 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:39 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:37:39.888 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:39 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:37:39.888 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:39 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:37:39.888 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:39 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:37:39.888 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:39 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T01:37:39.888 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:39 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:37:39.888 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:39 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:37:39.889 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:39 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:37:40.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:39 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:37:40.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:39 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:37:40.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:39 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:37:40.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:39 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:37:40.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:39 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T01:37:40.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:39 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:37:40.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:39 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:37:40.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:39 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:37:40.240 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:37:40.562 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:40.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:40 smithi077 ceph-mon[22251]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-08-20T01:37:40.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:40 smithi077 ceph-mon[22251]: Unable to set osd_memory_target on smithi022 to 185701376: error parsing value: Value '185701376' is below minimum 939524096 2024-08-20T01:37:40.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:40 smithi077 ceph-mon[22251]: scrub queued for path: / 2024-08-20T01:37:40.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:40 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:40.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:40 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:37:40.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:40 smithi077 ceph-mon[22251]: pgmap v542: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 354 op/s 2024-08-20T01:37:40.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:40 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:37:40.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:40 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:37:40.838 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:40 smithi022 ceph-mon[18709]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-08-20T01:37:40.838 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:40 smithi022 ceph-mon[18709]: Unable to set osd_memory_target on smithi022 to 185701376: error parsing value: Value '185701376' is below minimum 939524096 2024-08-20T01:37:40.838 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:40 smithi022 ceph-mon[18709]: scrub queued for path: / 2024-08-20T01:37:40.838 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:40 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:40.838 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:40 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:37:40.839 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:40 smithi022 ceph-mon[18709]: pgmap v542: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 354 op/s 2024-08-20T01:37:40.839 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:40 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:37:40.839 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:40 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:37:41.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:40 smithi134 ceph-mon[22511]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-08-20T01:37:41.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:40 smithi134 ceph-mon[22511]: Unable to set osd_memory_target on smithi022 to 185701376: error parsing value: Value '185701376' is below minimum 939524096 2024-08-20T01:37:41.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:40 smithi134 ceph-mon[22511]: scrub queued for path: / 2024-08-20T01:37:41.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:40 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:41.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:40 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:37:41.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:40 smithi134 ceph-mon[22511]: pgmap v542: 97 pgs: 97 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 354 op/s 2024-08-20T01:37:41.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:40 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:37:41.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:40 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:37:41.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.097+0000 7f53a017c640 1 -- 172.21.15.22:0/3562757025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5398102ab0 msgr2=0x7f5398102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:41.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.097+0000 7f53a017c640 1 --2- 172.21.15.22:0/3562757025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5398102ab0 0x7f5398102e90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5394009900 tx=0x7f539402a3f0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.097+0000 7f53a017c640 1 -- 172.21.15.22:0/3562757025 shutdown_connections 2024-08-20T01:37:41.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.097+0000 7f53a017c640 1 --2- 172.21.15.22:0/3562757025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5398108e40 0x7f539810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.097+0000 7f53a017c640 1 --2- 172.21.15.22:0/3562757025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53981084c0 0x7f5398108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.097+0000 7f53a017c640 1 --2- 172.21.15.22:0/3562757025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5398102ab0 0x7f5398102e90 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.097+0000 7f53a017c640 1 -- 172.21.15.22:0/3562757025 >> 172.21.15.22:0/3562757025 conn(0x7f53980fe520 msgr2=0x7f5398100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:41.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.097+0000 7f53a017c640 1 -- 172.21.15.22:0/3562757025 shutdown_connections 2024-08-20T01:37:41.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.098+0000 7f53a017c640 1 -- 172.21.15.22:0/3562757025 wait complete. 2024-08-20T01:37:41.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.099+0000 7f53a017c640 1 Processor -- start 2024-08-20T01:37:41.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.099+0000 7f53a017c640 1 -- start start 2024-08-20T01:37:41.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.099+0000 7f53a017c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5398102ab0 0x7f5398198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.099+0000 7f53a017c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53981084c0 0x7f5398199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.099+0000 7f53a017c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5398108e40 0x7f539819e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.099+0000 7f53a017c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5398112b50 con 0x7f5398102ab0 2024-08-20T01:37:41.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.099+0000 7f53a017c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f53981129d0 con 0x7f5398108e40 2024-08-20T01:37:41.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.099+0000 7f53a017c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5398112cd0 con 0x7f53981084c0 2024-08-20T01:37:41.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.099+0000 7f539d717640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53981084c0 0x7f5398199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.099+0000 7f539d717640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53981084c0 0x7f5398199500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:53364/0 (socket says 172.21.15.22:53364) 2024-08-20T01:37:41.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.099+0000 7f539d717640 1 -- 172.21.15.22:0/3148392509 learned_addr learned my addr 172.21.15.22:0/3148392509 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:41.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.099+0000 7f539df18640 1 --2- 172.21.15.22:0/3148392509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5398102ab0 0x7f5398198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.100+0000 7f539d717640 1 -- 172.21.15.22:0/3148392509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5398108e40 msgr2=0x7f539819e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:41.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.100+0000 7f539d717640 1 --2- 172.21.15.22:0/3148392509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5398108e40 0x7f539819e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.100+0000 7f539d717640 1 -- 172.21.15.22:0/3148392509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5398102ab0 msgr2=0x7f5398198fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:41.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.100+0000 7f539d717640 1 --2- 172.21.15.22:0/3148392509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5398102ab0 0x7f5398198fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.100+0000 7f539d717640 1 -- 172.21.15.22:0/3148392509 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f539819f070 con 0x7f53981084c0 2024-08-20T01:37:41.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.100+0000 7f539d717640 1 --2- 172.21.15.22:0/3148392509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53981084c0 0x7f5398199500 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f538800e9f0 tx=0x7f538800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:41.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.101+0000 7f538effd640 1 -- 172.21.15.22:0/3148392509 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538800cd80 con 0x7f53981084c0 2024-08-20T01:37:41.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.101+0000 7f538effd640 1 -- 172.21.15.22:0/3148392509 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53880108e0 con 0x7f53981084c0 2024-08-20T01:37:41.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.101+0000 7f538effd640 1 -- 172.21.15.22:0/3148392509 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5388018860 con 0x7f53981084c0 2024-08-20T01:37:41.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.101+0000 7f53a017c640 1 -- 172.21.15.22:0/3148392509 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f539819f360 con 0x7f53981084c0 2024-08-20T01:37:41.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.101+0000 7f53a017c640 1 -- 172.21.15.22:0/3148392509 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53981a5a20 con 0x7f53981084c0 2024-08-20T01:37:41.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.105+0000 7f53a2575740 1 Processor -- start 2024-08-20T01:37:41.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.105+0000 7f53a2575740 1 -- start start 2024-08-20T01:37:41.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.105+0000 7f53a2575740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d10830 0x55e355d10c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.105+0000 7f53a2575740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e355d11150 0x55e355d1cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.105+0000 7f53a2575740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d1d0e0 0x55e355d1f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.105+0000 7f53a2575740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e355c878e0 con 0x55e355d10830 2024-08-20T01:37:41.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.105+0000 7f53a2575740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e355c76de0 con 0x55e355d1d0e0 2024-08-20T01:37:41.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.105+0000 7f53a2575740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e355c7ae20 con 0x55e355d11150 2024-08-20T01:37:41.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.105+0000 7f539e719640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d10830 0x55e355d10c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.105+0000 7f539e719640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d10830 0x55e355d10c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55666/0 (socket says 172.21.15.22:55666) 2024-08-20T01:37:41.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.105+0000 7f539e719640 1 -- 172.21.15.22:0/2894739061 learned_addr learned my addr 172.21.15.22:0/2894739061 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:41.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.106+0000 7f538effd640 1 -- 172.21.15.22:0/3148392509 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5388010430 con 0x7f53981084c0 2024-08-20T01:37:41.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.106+0000 7f539df18640 1 --2- 172.21.15.22:0/2894739061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e355d11150 0x55e355d1cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.106+0000 7f539e719640 1 -- 172.21.15.22:0/2894739061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e355d11150 msgr2=0x55e355d1cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:41.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.106+0000 7f539e719640 1 --2- 172.21.15.22:0/2894739061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e355d11150 0x55e355d1cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.106+0000 7f539e719640 1 -- 172.21.15.22:0/2894739061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d1d0e0 msgr2=0x55e355d1f4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:37:41.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.106+0000 7f539e719640 1 --2- 172.21.15.22:0/2894739061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d1d0e0 0x55e355d1f4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.106+0000 7f539e719640 1 -- 172.21.15.22:0/2894739061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3559d6650 con 0x55e355d10830 2024-08-20T01:37:41.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.107+0000 7f538effd640 1 --2- 172.21.15.22:0/3148392509 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53840b3de0 0x7f53840b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.107+0000 7f539e719640 1 --2- 172.21.15.22:0/2894739061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d10830 0x55e355d10c10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5390009ed0 tx=0x7f539000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59950ad0299f3442 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:41.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.107+0000 7f538effd640 1 -- 172.21.15.22:0/3148392509 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f53880e3f30 con 0x7f53981084c0 2024-08-20T01:37:41.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.108+0000 7f5383fff640 1 -- 172.21.15.22:0/2894739061 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5390004d20 con 0x55e355d10830 2024-08-20T01:37:41.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.108+0000 7f5383fff640 1 -- 172.21.15.22:0/2894739061 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53900054d0 con 0x55e355d10830 2024-08-20T01:37:41.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.108+0000 7f5383fff640 1 -- 172.21.15.22:0/2894739061 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5390004d20 con 0x55e355d10830 2024-08-20T01:37:41.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.108+0000 7f539df18640 1 --2- 172.21.15.22:0/3148392509 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53840b3de0 0x7f53840b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.109+0000 7f53a2575740 1 -- 172.21.15.22:0/2894739061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d10830 msgr2=0x55e355d10c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:41.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.109+0000 7f539df18640 1 --2- 172.21.15.22:0/3148392509 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53840b3de0 0x7f53840b62a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5394005ab0 tx=0x7f5394000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:41.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.109+0000 7f53a2575740 1 --2- 172.21.15.22:0/2894739061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d10830 0x55e355d10c10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5390009ed0 tx=0x7f539000e720 comp rx=0 tx=0).stop 2024-08-20T01:37:41.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.109+0000 7f53a2575740 1 -- 172.21.15.22:0/2894739061 shutdown_connections 2024-08-20T01:37:41.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.109+0000 7f53a2575740 1 --2- 172.21.15.22:0/2894739061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d1d0e0 0x55e355d1f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.109+0000 7f53a2575740 1 --2- 172.21.15.22:0/2894739061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e355d11150 0x55e355d1cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.109+0000 7f53a2575740 1 --2- 172.21.15.22:0/2894739061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d10830 0x55e355d10c10 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.109+0000 7f53a2575740 1 -- 172.21.15.22:0/2894739061 >> 172.21.15.22:0/2894739061 conn(0x55e355d0e660 msgr2=0x55e355d0f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:41.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.109+0000 7f53a2575740 1 -- 172.21.15.22:0/2894739061 shutdown_connections 2024-08-20T01:37:41.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.109+0000 7f53a2575740 1 -- 172.21.15.22:0/2894739061 wait complete. 2024-08-20T01:37:41.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.109+0000 7f53a2575740 1 -- start start 2024-08-20T01:37:41.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.109+0000 7f53a2575740 1 Processor -- start 2024-08-20T01:37:41.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.110+0000 7f53a2575740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d10830 0x55e355d1a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.110+0000 7f53a2575740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 0x55e355d1a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.110+0000 7f53a2575740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e355d1d0e0 0x55e355d1ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.110+0000 7f53a2575740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e355ad9700 con 0x55e355d10830 2024-08-20T01:37:41.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.110+0000 7f53a2575740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e355bfd7c0 con 0x55e355d11150 2024-08-20T01:37:41.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.110+0000 7f53a2575740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e355d1fd90 con 0x55e355d1d0e0 2024-08-20T01:37:41.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.110+0000 7f539d717640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 0x55e355d1a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.110+0000 7f539d717640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 0x55e355d1a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:33270/0 (socket says 172.21.15.22:33270) 2024-08-20T01:37:41.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.110+0000 7f539d717640 1 -- 172.21.15.22:0/743549676 learned_addr learned my addr 172.21.15.22:0/743549676 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:41.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.110+0000 7f53a2575740 10 client.0 _ll_register_callbacks cb 0x55e355c706b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:41.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.111+0000 7f539d717640 1 -- 172.21.15.22:0/743549676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e355d1d0e0 msgr2=0x55e355d1ab10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:37:41.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.111+0000 7f539d717640 1 --2- 172.21.15.22:0/743549676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e355d1d0e0 0x55e355d1ab10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.111+0000 7f539d717640 1 -- 172.21.15.22:0/743549676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d10830 msgr2=0x55e355d1a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:41.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.111+0000 7f539d717640 1 --2- 172.21.15.22:0/743549676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d10830 0x55e355d1a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.111+0000 7f539d717640 1 -- 172.21.15.22:0/743549676 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e355d29170 con 0x55e355d11150 2024-08-20T01:37:41.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.111+0000 7f539d717640 1 --2- 172.21.15.22:0/743549676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 0x55e355d1a5d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f53880aad70 tx=0x7f53880107e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c035a5e58369ba7d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:41.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.111+0000 7f53817fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:37:41.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.111+0000 7f53817fa640 1 -- 172.21.15.22:0/743549676 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53880aade0 con 0x55e355d11150 2024-08-20T01:37:41.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.112+0000 7f53817fa640 1 -- 172.21.15.22:0/743549676 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f53880aa040 con 0x55e355d11150 2024-08-20T01:37:41.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.112+0000 7f53a2575740 1 -- 172.21.15.22:0/743549676 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e355c26100 con 0x55e355d11150 2024-08-20T01:37:41.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.112+0000 7f53817fa640 1 -- 172.21.15.22:0/743549676 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f53880af3e0 con 0x55e355d11150 2024-08-20T01:37:41.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.112+0000 7f53a2575740 10 client.26033 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:41.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.112+0000 7f53a2575740 1 -- 172.21.15.22:0/743549676 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e355d2bae0 con 0x55e355d11150 2024-08-20T01:37:41.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.112+0000 7f53817fa640 1 -- 172.21.15.22:0/743549676 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e355c26100 con 0x55e355d11150 2024-08-20T01:37:41.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.112+0000 7f53817fa640 1 -- 172.21.15.22:0/743549676 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f53880b9020 con 0x55e355d11150 2024-08-20T01:37:41.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.113+0000 7f53a2575740 10 client.26033 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:41.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.113+0000 7f53a2575740 10 client.26033 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:37:41.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.113+0000 7f53a2575740 20 client.26033 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:41.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.113+0000 7f53a2575740 1 --2- 172.21.15.22:0/743549676 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e355d2d4b0 0x55e355d2f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.113+0000 7f53a2575740 4 client.26033 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:41.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.113+0000 7f53a2575740 1 -- 172.21.15.22:0/743549676 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e355c89830 con 0x55e355d2d4b0 2024-08-20T01:37:41.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.114+0000 7f539df18640 1 --2- 172.21.15.22:0/743549676 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e355d2d4b0 0x55e355d2f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.114+0000 7f539df18640 1 --2- 172.21.15.22:0/743549676 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e355d2d4b0 0x55e355d2f930 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fecc272c1f3af2 server_cookie=f426531aaf9ea361 in_seq=0 out_seq=0 2024-08-20T01:37:41.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.114+0000 7f53817fa640 10 client.26033 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:41.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.116+0000 7f53817fa640 1 -- 172.21.15.22:0/743549676 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e355c89830 con 0x55e355d2d4b0 2024-08-20T01:37:41.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.116+0000 7f53817fa640 10 client.26033 handle_command_reply: tid=0 2024-08-20T01:37:41.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.116+0000 7f53a2575740 1 client.26033 shutdown 2024-08-20T01:37:41.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.116+0000 7f53a2575740 1 -- 172.21.15.22:0/743549676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 msgr2=0x55e355d1a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:41.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.116+0000 7f53a2575740 1 --2- 172.21.15.22:0/743549676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 0x55e355d1a5d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f53880aad70 tx=0x7f53880107e0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.117+0000 7f53a2575740 1 -- 172.21.15.22:0/743549676 shutdown_connections 2024-08-20T01:37:41.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.117+0000 7f53a2575740 1 --2- 172.21.15.22:0/743549676 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e355d2d4b0 0x55e355d2f930 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.117+0000 7f53a2575740 1 --2- 172.21.15.22:0/743549676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e355d1d0e0 0x55e355d1ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.117+0000 7f53a2575740 1 --2- 172.21.15.22:0/743549676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 0x55e355d1a5d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.117+0000 7f53a2575740 1 --2- 172.21.15.22:0/743549676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d10830 0x55e355d1a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.117+0000 7f53a2575740 1 -- 172.21.15.22:0/743549676 >> 172.21.15.22:0/743549676 conn(0x55e355d0e660 msgr2=0x55e355d141d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:41.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.117+0000 7f53817fa640 0 client.26033 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:41.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.117+0000 7f53a2575740 1 -- 172.21.15.22:0/743549676 shutdown_connections 2024-08-20T01:37:41.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.117+0000 7f53a2575740 1 -- 172.21.15.22:0/743549676 wait complete. 2024-08-20T01:37:41.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.117+0000 7f53a2575740 20 client.26033 trim_cache size 0 max 16384 2024-08-20T01:37:41.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.142+0000 7f53a2575740 1 Processor -- start 2024-08-20T01:37:41.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.142+0000 7f53a2575740 1 -- start start 2024-08-20T01:37:41.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.142+0000 7f53a2575740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e355d10830 0x55e355d1a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.142+0000 7f53a2575740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 0x55e355d1aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.142+0000 7f53a2575740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d1d0e0 0x55e355d35200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.142+0000 7f53a2575740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f53981ae9c0 con 0x55e355d1d0e0 2024-08-20T01:37:41.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.142+0000 7f53a2575740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f53981ac1d0 con 0x55e355d11150 2024-08-20T01:37:41.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.142+0000 7f53a2575740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f53981aa020 con 0x55e355d10830 2024-08-20T01:37:41.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.142+0000 7f539e719640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d1d0e0 0x55e355d35200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.142+0000 7f539e719640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d1d0e0 0x55e355d35200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55680/0 (socket says 172.21.15.22:55680) 2024-08-20T01:37:41.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.142+0000 7f539e719640 1 -- 172.21.15.22:0/4275171635 learned_addr learned my addr 172.21.15.22:0/4275171635 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:41.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.142+0000 7f539d717640 1 --2- 172.21.15.22:0/4275171635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 0x55e355d1aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.142+0000 7f539df18640 1 --2- 172.21.15.22:0/4275171635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e355d10830 0x55e355d1a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.143+0000 7f539e719640 1 -- 172.21.15.22:0/4275171635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e355d10830 msgr2=0x55e355d1a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:41.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.143+0000 7f539e719640 1 --2- 172.21.15.22:0/4275171635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e355d10830 0x55e355d1a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.143+0000 7f539e719640 1 -- 172.21.15.22:0/4275171635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 msgr2=0x55e355d1aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:41.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.143+0000 7f539e719640 1 --2- 172.21.15.22:0/4275171635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 0x55e355d1aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.143+0000 7f539e719640 1 -- 172.21.15.22:0/4275171635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e355d10f80 con 0x55e355d1d0e0 2024-08-20T01:37:41.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.143+0000 7f539d717640 1 --2- 172.21.15.22:0/4275171635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 0x55e355d1aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:41.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.143+0000 7f539e719640 1 --2- 172.21.15.22:0/4275171635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d1d0e0 0x55e355d35200 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5390004a30 tx=0x7f539000eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15f123e0bd456c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:41.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.144+0000 7f53837fe640 1 -- 172.21.15.22:0/4275171635 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5390025020 con 0x55e355d1d0e0 2024-08-20T01:37:41.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.144+0000 7f53837fe640 1 -- 172.21.15.22:0/4275171635 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5390009ae0 con 0x55e355d1d0e0 2024-08-20T01:37:41.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.144+0000 7f53837fe640 1 -- 172.21.15.22:0/4275171635 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5390010780 con 0x55e355d1d0e0 2024-08-20T01:37:41.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.145+0000 7f53a2575740 1 -- 172.21.15.22:0/4275171635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d1d0e0 msgr2=0x55e355d35200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:41.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.145+0000 7f53a2575740 1 --2- 172.21.15.22:0/4275171635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d1d0e0 0x55e355d35200 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5390004a30 tx=0x7f539000eed0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.145+0000 7f53a2575740 1 -- 172.21.15.22:0/4275171635 shutdown_connections 2024-08-20T01:37:41.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.145+0000 7f53a2575740 1 --2- 172.21.15.22:0/4275171635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d1d0e0 0x55e355d35200 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.145+0000 7f53a2575740 1 --2- 172.21.15.22:0/4275171635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 0x55e355d1aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.145+0000 7f53a2575740 1 --2- 172.21.15.22:0/4275171635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e355d10830 0x55e355d1a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.145+0000 7f53a2575740 1 -- 172.21.15.22:0/4275171635 >> 172.21.15.22:0/4275171635 conn(0x55e355d0e660 msgr2=0x55e355d1bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:41.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.145+0000 7f53a2575740 1 -- 172.21.15.22:0/4275171635 shutdown_connections 2024-08-20T01:37:41.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.145+0000 7f53a2575740 1 -- 172.21.15.22:0/4275171635 wait complete. 2024-08-20T01:37:41.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.145+0000 7f53a2575740 1 -- start start 2024-08-20T01:37:41.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.146+0000 7f53a2575740 1 Processor -- start 2024-08-20T01:37:41.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.146+0000 7f53a2575740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d10830 0x55e355d1ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.146+0000 7f53a2575740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 0x55e355d20520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.146+0000 7f53a2575740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e355d1d0e0 0x55e355d20a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.146+0000 7f53a2575740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f53981aa690 con 0x55e355d10830 2024-08-20T01:37:41.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.146+0000 7f53a2575740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f53981abb00 con 0x55e355d11150 2024-08-20T01:37:41.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.146+0000 7f53a2575740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f53981aad60 con 0x55e355d1d0e0 2024-08-20T01:37:41.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.146+0000 7f539d717640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 0x55e355d20520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.146+0000 7f53a2575740 10 client.0 _ll_register_callbacks cb 0x7f53880aa550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:41.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.146+0000 7f539d717640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 0x55e355d20520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:33290/0 (socket says 172.21.15.22:33290) 2024-08-20T01:37:41.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.146+0000 7f539d717640 1 -- 172.21.15.22:0/1317603274 learned_addr learned my addr 172.21.15.22:0/1317603274 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:41.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.146+0000 7f539e719640 1 --2- 172.21.15.22:0/1317603274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e355d1d0e0 0x55e355d20a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.146+0000 7f539df18640 1 --2- 172.21.15.22:0/1317603274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d10830 0x55e355d1ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.147+0000 7f539d717640 1 -- 172.21.15.22:0/1317603274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e355d1d0e0 msgr2=0x55e355d20a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:41.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.147+0000 7f539d717640 1 --2- 172.21.15.22:0/1317603274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e355d1d0e0 0x55e355d20a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.147+0000 7f539d717640 1 -- 172.21.15.22:0/1317603274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d10830 msgr2=0x55e355d1ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:41.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.147+0000 7f539d717640 1 --2- 172.21.15.22:0/1317603274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d10830 0x55e355d1ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.147+0000 7f539d717640 1 -- 172.21.15.22:0/1317603274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e355d962c0 con 0x55e355d11150 2024-08-20T01:37:41.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.147+0000 7f539d717640 1 --2- 172.21.15.22:0/1317603274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 0x55e355d20520 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f53880a6e60 tx=0x7f53880aa600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ea9322a1194b14d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:41.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.147+0000 7f53817fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:37:41.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.147+0000 7f53817fa640 1 -- 172.21.15.22:0/1317603274 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53880bf060 con 0x55e355d11150 2024-08-20T01:37:41.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.147+0000 7f53a2575740 1 -- 172.21.15.22:0/1317603274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5390009ae0 con 0x55e355d11150 2024-08-20T01:37:41.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.147+0000 7f53817fa640 1 -- 172.21.15.22:0/1317603274 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f53880cb030 con 0x55e355d11150 2024-08-20T01:37:41.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.147+0000 7f53817fa640 1 -- 172.21.15.22:0/1317603274 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5388088030 con 0x55e355d11150 2024-08-20T01:37:41.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.147+0000 7f53a2575740 10 client.26039 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:41.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.147+0000 7f53a2575740 1 -- 172.21.15.22:0/1317603274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e355d975e0 con 0x55e355d11150 2024-08-20T01:37:41.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.148+0000 7f53817fa640 1 -- 172.21.15.22:0/1317603274 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5390009ae0 con 0x55e355d11150 2024-08-20T01:37:41.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.148+0000 7f53817fa640 1 -- 172.21.15.22:0/1317603274 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f53880b9070 con 0x55e355d11150 2024-08-20T01:37:41.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.148+0000 7f53a2575740 10 client.26039 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:41.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.148+0000 7f53a2575740 10 client.26039 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:37:41.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.148+0000 7f53a2575740 20 client.26039 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:41.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.148+0000 7f53a2575740 1 --2- 172.21.15.22:0/1317603274 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e355d97c80 0x55e355d9a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.148+0000 7f53a2575740 4 client.26039 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:37:41.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.148+0000 7f53a2575740 1 -- 172.21.15.22:0/1317603274 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e355c852d0 con 0x55e355d97c80 2024-08-20T01:37:41.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.148+0000 7f539df18640 1 --2- 172.21.15.22:0/1317603274 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e355d97c80 0x55e355d9a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.149+0000 7f53817fa640 10 client.26039 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:41.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.149+0000 7f539df18640 1 --2- 172.21.15.22:0/1317603274 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e355d97c80 0x55e355d9a0a0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbc7628e4f153d17 server_cookie=c90ce35c36152b4f in_seq=0 out_seq=0 2024-08-20T01:37:41.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.151+0000 7f53817fa640 1 -- 172.21.15.22:0/1317603274 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x55e355c852d0 con 0x55e355d97c80 2024-08-20T01:37:41.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.151+0000 7f53817fa640 10 client.26039 handle_command_reply: tid=0 2024-08-20T01:37:41.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.151+0000 7f53a2575740 1 client.26039 shutdown 2024-08-20T01:37:41.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.152+0000 7f53a2575740 1 -- 172.21.15.22:0/1317603274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 msgr2=0x55e355d20520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:41.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.152+0000 7f53a2575740 1 --2- 172.21.15.22:0/1317603274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 0x55e355d20520 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f53880a6e60 tx=0x7f53880aa600 comp rx=0 tx=0).stop 2024-08-20T01:37:41.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.152+0000 7f53a2575740 1 -- 172.21.15.22:0/1317603274 shutdown_connections 2024-08-20T01:37:41.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.152+0000 7f53a2575740 1 --2- 172.21.15.22:0/1317603274 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55e355d97c80 0x55e355d9a0a0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.152+0000 7f53a2575740 1 --2- 172.21.15.22:0/1317603274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e355d1d0e0 0x55e355d20a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.152+0000 7f53a2575740 1 --2- 172.21.15.22:0/1317603274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e355d11150 0x55e355d20520 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.152+0000 7f53a2575740 1 --2- 172.21.15.22:0/1317603274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e355d10830 0x55e355d1ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.152+0000 7f53a2575740 1 -- 172.21.15.22:0/1317603274 >> 172.21.15.22:0/1317603274 conn(0x55e355d0e660 msgr2=0x55e355d13890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:41.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.152+0000 7f53817fa640 0 client.26039 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:41.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.152+0000 7f53a2575740 1 -- 172.21.15.22:0/1317603274 shutdown_connections 2024-08-20T01:37:41.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.152+0000 7f53a2575740 1 -- 172.21.15.22:0/1317603274 wait complete. 2024-08-20T01:37:41.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.153+0000 7f53a2575740 20 client.26039 trim_cache size 0 max 16384 2024-08-20T01:37:41.156 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:37:41.157 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "scrub active (7010 inodes in the stack)", 2024-08-20T01:37:41.157 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-08-20T01:37:41.157 INFO:teuthology.orchestra.run.smithi022.stdout: "25b1477d-d873-43a6-960c-894cd20c0d05": { 2024-08-20T01:37:41.157 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-08-20T01:37:41.157 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "25b1477d-d873-43a6-960c-894cd20c0d05", 2024-08-20T01:37:41.157 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-08-20T01:37:41.157 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:37:41.157 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:37:41.157 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:37:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.153+0000 7f53a017c640 1 -- 172.21.15.22:0/3148392509 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53840b3de0 msgr2=0x7f53840b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.153+0000 7f53a017c640 1 --2- 172.21.15.22:0/3148392509 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53840b3de0 0x7f53840b62a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5394005ab0 tx=0x7f5394000bc0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.153+0000 7f53a017c640 1 -- 172.21.15.22:0/3148392509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53981084c0 msgr2=0x7f5398199500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.153+0000 7f53a017c640 1 --2- 172.21.15.22:0/3148392509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53981084c0 0x7f5398199500 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f538800e9f0 tx=0x7f538800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.153+0000 7f53a017c640 1 -- 172.21.15.22:0/3148392509 shutdown_connections 2024-08-20T01:37:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.153+0000 7f53a017c640 1 --2- 172.21.15.22:0/3148392509 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53840b3de0 0x7f53840b62a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.153+0000 7f53a017c640 1 --2- 172.21.15.22:0/3148392509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5398108e40 0x7f539819e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.153+0000 7f53a017c640 1 --2- 172.21.15.22:0/3148392509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53981084c0 0x7f5398199500 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.153+0000 7f53a017c640 1 --2- 172.21.15.22:0/3148392509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5398102ab0 0x7f5398198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.153+0000 7f53a017c640 1 -- 172.21.15.22:0/3148392509 >> 172.21.15.22:0/3148392509 conn(0x7f53980fe520 msgr2=0x7f53980ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:41.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.154+0000 7f53a017c640 1 -- 172.21.15.22:0/3148392509 shutdown_connections 2024-08-20T01:37:41.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:37:41.154+0000 7f53a017c640 1 -- 172.21.15.22:0/3148392509 wait complete. 2024-08-20T01:37:42.449 INFO:tasks.cephfs.filesystem:scrub status for tag:25b1477d-d873-43a6-960c-894cd20c0d05 - {'path': '/', 'tag': '25b1477d-d873-43a6-960c-894cd20c0d05', 'options': 'recursive,force'} 2024-08-20T01:37:42.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:42 smithi077 ceph-mon[22251]: pgmap v543: 97 pgs: 97 active+clean; 1.9 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.3 MiB/s wr, 652 op/s 2024-08-20T01:37:42.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:42 smithi022 ceph-mon[18709]: pgmap v543: 97 pgs: 97 active+clean; 1.9 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.3 MiB/s wr, 652 op/s 2024-08-20T01:37:43.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:42 smithi134 ceph-mon[22511]: pgmap v543: 97 pgs: 97 active+clean; 1.9 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.3 MiB/s wr, 652 op/s 2024-08-20T01:37:43.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:43 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:43.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:43 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:44.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:43 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:44.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:44 smithi077 ceph-mon[22251]: pgmap v544: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.4 MiB/s wr, 1.42k op/s 2024-08-20T01:37:44.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:44 smithi022 ceph-mon[18709]: pgmap v544: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.4 MiB/s wr, 1.42k op/s 2024-08-20T01:37:45.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:44 smithi134 ceph-mon[22511]: pgmap v544: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.4 MiB/s wr, 1.42k op/s 2024-08-20T01:37:46.814 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:46 smithi077 ceph-mon[22251]: pgmap v545: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.2 MiB/s wr, 1.57k op/s 2024-08-20T01:37:46.818 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:46 smithi134 ceph-mon[22511]: pgmap v545: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.2 MiB/s wr, 1.57k op/s 2024-08-20T01:37:46.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:46 smithi022 ceph-mon[18709]: pgmap v545: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.2 MiB/s wr, 1.57k op/s 2024-08-20T01:37:47.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:47 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:48.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:47 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:48.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:47 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:48.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:48 smithi022 ceph-mon[18709]: pgmap v546: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 2.8 MiB/s wr, 2.57k op/s 2024-08-20T01:37:49.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:48 smithi134 ceph-mon[22511]: pgmap v546: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 2.8 MiB/s wr, 2.57k op/s 2024-08-20T01:37:49.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:48 smithi077 ceph-mon[22251]: pgmap v546: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 2.8 MiB/s wr, 2.57k op/s 2024-08-20T01:37:49.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.849+0000 7fdf25188640 1 -- 172.21.15.22:0/397435701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf201026d0 msgr2=0x7fdf20102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.849+0000 7fdf25188640 1 --2- 172.21.15.22:0/397435701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf201026d0 0x7fdf20102b50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fdf14009930 tx=0x7fdf1402a420 comp rx=0 tx=0).stop 2024-08-20T01:37:49.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.849+0000 7fdf25188640 1 -- 172.21.15.22:0/397435701 shutdown_connections 2024-08-20T01:37:49.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.849+0000 7fdf25188640 1 --2- 172.21.15.22:0/397435701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf20103090 0x7fdf20109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.849+0000 7fdf25188640 1 --2- 172.21.15.22:0/397435701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf201026d0 0x7fdf20102b50 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.853 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.849+0000 7fdf25188640 1 --2- 172.21.15.22:0/397435701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf20101580 0x7fdf20101980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.853 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.849+0000 7fdf25188640 1 -- 172.21.15.22:0/397435701 >> 172.21.15.22:0/397435701 conn(0x7fdf200fce60 msgr2=0x7fdf200ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:49.853 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.849+0000 7fdf25188640 1 -- 172.21.15.22:0/397435701 shutdown_connections 2024-08-20T01:37:49.853 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.849+0000 7fdf25188640 1 -- 172.21.15.22:0/397435701 wait complete. 2024-08-20T01:37:49.853 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.850+0000 7fdf25188640 1 Processor -- start 2024-08-20T01:37:49.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.850+0000 7fdf25188640 1 -- start start 2024-08-20T01:37:49.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.850+0000 7fdf25188640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf20101580 0x7fdf2006b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.850+0000 7fdf25188640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf201026d0 0x7fdf2019d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.850+0000 7fdf25188640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf20103090 0x7fdf2019fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.850+0000 7fdf25188640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2010d220 con 0x7fdf201026d0 2024-08-20T01:37:49.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.850+0000 7fdf25188640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2010d0a0 con 0x7fdf20103090 2024-08-20T01:37:49.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.850+0000 7fdf25188640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2010d3a0 con 0x7fdf20101580 2024-08-20T01:37:49.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.850+0000 7fdf1e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf201026d0 0x7fdf2019d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.850+0000 7fdf1ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf20101580 0x7fdf2006b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.850+0000 7fdf1ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf20101580 0x7fdf2006b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:42126/0 (socket says 172.21.15.22:42126) 2024-08-20T01:37:49.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.850+0000 7fdf1ed9d640 1 -- 172.21.15.22:0/2454716674 learned_addr learned my addr 172.21.15.22:0/2454716674 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:49.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.851+0000 7fdf1f59e640 1 --2- 172.21.15.22:0/2454716674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf20103090 0x7fdf2019fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.851+0000 7fdf1ed9d640 1 -- 172.21.15.22:0/2454716674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf20103090 msgr2=0x7fdf2019fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.851+0000 7fdf1ed9d640 1 --2- 172.21.15.22:0/2454716674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf20103090 0x7fdf2019fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.851+0000 7fdf1ed9d640 1 -- 172.21.15.22:0/2454716674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf201026d0 msgr2=0x7fdf2019d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.851+0000 7fdf1ed9d640 1 --2- 172.21.15.22:0/2454716674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf201026d0 0x7fdf2019d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.851+0000 7fdf1ed9d640 1 -- 172.21.15.22:0/2454716674 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf201a06c0 con 0x7fdf20101580 2024-08-20T01:37:49.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.851+0000 7fdf1ed9d640 1 --2- 172.21.15.22:0/2454716674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf20101580 0x7fdf2006b9c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000e9f0 tx=0x7fdf1000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.851+0000 7fdf07fff640 1 -- 172.21.15.22:0/2454716674 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1000cd80 con 0x7fdf20101580 2024-08-20T01:37:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.851+0000 7fdf25188640 1 -- 172.21.15.22:0/2454716674 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf201a09b0 con 0x7fdf20101580 2024-08-20T01:37:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.851+0000 7fdf07fff640 1 -- 172.21.15.22:0/2454716674 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf100108e0 con 0x7fdf20101580 2024-08-20T01:37:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.851+0000 7fdf07fff640 1 -- 172.21.15.22:0/2454716674 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10018980 con 0x7fdf20101580 2024-08-20T01:37:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.851+0000 7fdf25188640 1 -- 172.21.15.22:0/2454716674 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf201a0f00 con 0x7fdf20101580 2024-08-20T01:37:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf2804e740 1 Processor -- start 2024-08-20T01:37:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf2804e740 1 -- start start 2024-08-20T01:37:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf2804e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed8ed11ce0 0x55ed8ed140d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf2804e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed14610 0x55ed8ed16a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf2804e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed17050 0x55ed8ed19510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf2804e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ed8ec80360 con 0x55ed8ed14610 2024-08-20T01:37:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf2804e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ed8ec6f860 con 0x55ed8ed17050 2024-08-20T01:37:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf2804e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ed8ec738a0 con 0x55ed8ed11ce0 2024-08-20T01:37:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf1f59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed8ed11ce0 0x55ed8ed140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf1f59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed8ed11ce0 0x55ed8ed140d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:42138/0 (socket says 172.21.15.22:42138) 2024-08-20T01:37:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf1f59e640 1 -- 172.21.15.22:0/811120060 learned_addr learned my addr 172.21.15.22:0/811120060 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf07fff640 1 -- 172.21.15.22:0/2454716674 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdf10010430 con 0x7fdf20101580 2024-08-20T01:37:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf1e59c640 1 --2- 172.21.15.22:0/811120060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed17050 0x55ed8ed19510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf1ed9d640 1 --2- 172.21.15.22:0/811120060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed14610 0x55ed8ed16a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf1f59e640 1 -- 172.21.15.22:0/811120060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed17050 msgr2=0x55ed8ed19510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf1f59e640 1 --2- 172.21.15.22:0/811120060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed17050 0x55ed8ed19510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf1f59e640 1 -- 172.21.15.22:0/811120060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed14610 msgr2=0x55ed8ed16a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf1f59e640 1 --2- 172.21.15.22:0/811120060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed14610 0x55ed8ed16a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf1f59e640 1 -- 172.21.15.22:0/811120060 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed8ec16e40 con 0x55ed8ed11ce0 2024-08-20T01:37:49.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf1ed9d640 1 --2- 172.21.15.22:0/811120060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed14610 0x55ed8ed16a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:37:49.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.854+0000 7fdf1e59c640 1 --2- 172.21.15.22:0/811120060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed17050 0x55ed8ed19510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:49.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.855+0000 7fdf1f59e640 1 --2- 172.21.15.22:0/811120060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed8ed11ce0 0x55ed8ed140d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009fd0 tx=0x7fdf180118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7d886f291a87714 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:49.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.855+0000 7fdf057fa640 1 -- 172.21.15.22:0/811120060 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18004d20 con 0x55ed8ed11ce0 2024-08-20T01:37:49.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.855+0000 7fdf057fa640 1 -- 172.21.15.22:0/811120060 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf18004050 con 0x55ed8ed11ce0 2024-08-20T01:37:49.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.855+0000 7fdf057fa640 1 -- 172.21.15.22:0/811120060 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18005280 con 0x55ed8ed11ce0 2024-08-20T01:37:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.855+0000 7fdf07fff640 1 --2- 172.21.15.22:0/2454716674 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fdf080b3bd0 0x7fdf080b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.855+0000 7fdf1ed9d640 1 --2- 172.21.15.22:0/2454716674 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fdf080b3bd0 0x7fdf080b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.855+0000 7fdf07fff640 1 -- 172.21.15.22:0/2454716674 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fdf100e3f40 con 0x7fdf20101580 2024-08-20T01:37:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.855+0000 7fdf2804e740 1 -- 172.21.15.22:0/811120060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed8ed11ce0 msgr2=0x55ed8ed140d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.855+0000 7fdf2804e740 1 --2- 172.21.15.22:0/811120060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed8ed11ce0 0x55ed8ed140d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009fd0 tx=0x7fdf180118d0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.856+0000 7fdf2804e740 1 -- 172.21.15.22:0/811120060 shutdown_connections 2024-08-20T01:37:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.856+0000 7fdf2804e740 1 --2- 172.21.15.22:0/811120060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed17050 0x55ed8ed19510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.856+0000 7fdf2804e740 1 --2- 172.21.15.22:0/811120060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed14610 0x55ed8ed16a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.856+0000 7fdf2804e740 1 --2- 172.21.15.22:0/811120060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed8ed11ce0 0x55ed8ed140d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.856+0000 7fdf2804e740 1 -- 172.21.15.22:0/811120060 >> 172.21.15.22:0/811120060 conn(0x55ed8ed08a20 msgr2=0x55ed8ed097b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.856+0000 7fdf2804e740 1 -- 172.21.15.22:0/811120060 shutdown_connections 2024-08-20T01:37:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.856+0000 7fdf2804e740 1 -- 172.21.15.22:0/811120060 wait complete. 2024-08-20T01:37:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.856+0000 7fdf1ed9d640 1 --2- 172.21.15.22:0/2454716674 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fdf080b3bd0 0x7fdf080b6090 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000c6a0 tx=0x7fdf10000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.856+0000 7fdf2804e740 1 -- start start 2024-08-20T01:37:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.856+0000 7fdf2804e740 1 Processor -- start 2024-08-20T01:37:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.856+0000 7fdf2804e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed11ce0 0x55ed8ed1b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.856+0000 7fdf2804e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed8ed14610 0x55ed8ed1bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.856+0000 7fdf2804e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed17050 0x55ed8ed1c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.856+0000 7fdf2804e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ed8eba8ab0 con 0x55ed8ed17050 2024-08-20T01:37:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.856+0000 7fdf2804e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ed8ebf6780 con 0x55ed8ed11ce0 2024-08-20T01:37:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.856+0000 7fdf2804e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ed8ed1a030 con 0x55ed8ed14610 2024-08-20T01:37:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.856+0000 7fdf2804e740 10 client.0 _ll_register_callbacks cb 0x55ed8e97ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.857+0000 7fdf1f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed17050 0x55ed8ed1c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.857+0000 7fdf1f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed17050 0x55ed8ed1c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60574/0 (socket says 172.21.15.22:60574) 2024-08-20T01:37:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.857+0000 7fdf1f59e640 1 -- 172.21.15.22:0/2398850087 learned_addr learned my addr 172.21.15.22:0/2398850087 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.857+0000 7fdf1f59e640 1 --2- 172.21.15.22:0/2398850087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed11ce0 0x55ed8ed1b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.857+0000 7fdf1f59e640 1 -- 172.21.15.22:0/2398850087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed8ed14610 msgr2=0x55ed8ed1bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.857+0000 7fdf1f59e640 1 --2- 172.21.15.22:0/2398850087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed8ed14610 0x55ed8ed1bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.857+0000 7fdf1f59e640 1 -- 172.21.15.22:0/2398850087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed11ce0 msgr2=0x55ed8ed1b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.857+0000 7fdf1f59e640 1 --2- 172.21.15.22:0/2398850087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed11ce0 0x55ed8ed1b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.857+0000 7fdf1f59e640 1 -- 172.21.15.22:0/2398850087 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed8e9d2790 con 0x55ed8ed17050 2024-08-20T01:37:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.857+0000 7fdf1f59e640 1 --2- 172.21.15.22:0/2398850087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed17050 0x55ed8ed1c6f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009de0 tx=0x7fdf18005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58226ccd97a1fce7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.857+0000 7fdf02ff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:37:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.857+0000 7fdf02ff5640 1 -- 172.21.15.22:0/2398850087 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1802d060 con 0x55ed8ed17050 2024-08-20T01:37:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.857+0000 7fdf02ff5640 1 -- 172.21.15.22:0/2398850087 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fdf18004a40 con 0x55ed8ed17050 2024-08-20T01:37:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.858+0000 7fdf2804e740 1 -- 172.21.15.22:0/2398850087 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ed8ec1ee00 con 0x55ed8ed17050 2024-08-20T01:37:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.858+0000 7fdf02ff5640 1 -- 172.21.15.22:0/2398850087 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fdf18004c40 con 0x55ed8ed17050 2024-08-20T01:37:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.858+0000 7fdf2804e740 10 client.16422 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.858+0000 7fdf2804e740 1 -- 172.21.15.22:0/2398850087 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ed8ea4b620 con 0x55ed8ed17050 2024-08-20T01:37:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.858+0000 7fdf02ff5640 1 -- 172.21.15.22:0/2398850087 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ed8ec1ee00 con 0x55ed8ed17050 2024-08-20T01:37:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.858+0000 7fdf02ff5640 1 -- 172.21.15.22:0/2398850087 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fdf1800f4e0 con 0x55ed8ed17050 2024-08-20T01:37:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.859+0000 7fdf2804e740 10 client.16422 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.859+0000 7fdf2804e740 10 client.16422 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:37:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.859+0000 7fdf2804e740 20 client.16422 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.859+0000 7fdf2804e740 1 --2- 172.21.15.22:0/2398850087 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ed8ed26aa0 0x55ed8ed28f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.859+0000 7fdf2804e740 4 client.16422 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.859+0000 7fdf2804e740 1 -- 172.21.15.22:0/2398850087 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed8ec822b0 con 0x55ed8ed26aa0 2024-08-20T01:37:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.859+0000 7fdf1e59c640 1 --2- 172.21.15.22:0/2398850087 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ed8ed26aa0 0x55ed8ed28f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.860+0000 7fdf1e59c640 1 --2- 172.21.15.22:0/2398850087 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ed8ed26aa0 0x55ed8ed28f00 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=968d1a25b92d66f5 server_cookie=d6f313a78555d1e4 in_seq=0 out_seq=0 2024-08-20T01:37:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.860+0000 7fdf02ff5640 10 client.16422 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.861+0000 7fdf02ff5640 1 -- 172.21.15.22:0/2398850087 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed8ec822b0 con 0x55ed8ed26aa0 2024-08-20T01:37:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.861+0000 7fdf02ff5640 10 client.16422 handle_command_reply: tid=0 2024-08-20T01:37:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.861+0000 7fdf2804e740 1 client.16422 shutdown 2024-08-20T01:37:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.863+0000 7fdf2804e740 1 -- 172.21.15.22:0/2398850087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed17050 msgr2=0x55ed8ed1c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.863+0000 7fdf2804e740 1 --2- 172.21.15.22:0/2398850087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed17050 0x55ed8ed1c6f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009de0 tx=0x7fdf18005ab0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.864+0000 7fdf2804e740 1 -- 172.21.15.22:0/2398850087 shutdown_connections 2024-08-20T01:37:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.864+0000 7fdf2804e740 1 --2- 172.21.15.22:0/2398850087 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ed8ed26aa0 0x55ed8ed28f00 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.864+0000 7fdf2804e740 1 --2- 172.21.15.22:0/2398850087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed17050 0x55ed8ed1c6f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.864+0000 7fdf2804e740 1 --2- 172.21.15.22:0/2398850087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed8ed14610 0x55ed8ed1bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.864+0000 7fdf2804e740 1 --2- 172.21.15.22:0/2398850087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed11ce0 0x55ed8ed1b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.864+0000 7fdf2804e740 1 -- 172.21.15.22:0/2398850087 >> 172.21.15.22:0/2398850087 conn(0x55ed8ed08a20 msgr2=0x55ed8ed07ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.865+0000 7fdf02ff5640 0 client.16422 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.865+0000 7fdf2804e740 1 -- 172.21.15.22:0/2398850087 shutdown_connections 2024-08-20T01:37:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.865+0000 7fdf2804e740 1 -- 172.21.15.22:0/2398850087 wait complete. 2024-08-20T01:37:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.866+0000 7fdf2804e740 20 client.16422 trim_cache size 0 max 16384 2024-08-20T01:37:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.890+0000 7fdf2804e740 1 Processor -- start 2024-08-20T01:37:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.890+0000 7fdf2804e740 1 -- start start 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.890+0000 7fdf2804e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed11ce0 0x55ed8ed03780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.891+0000 7fdf2804e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed8ed14610 0x55ed8ed17b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.891+0000 7fdf2804e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed17050 0x55ed8ed18080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.891+0000 7fdf2804e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdf201aa5e0 con 0x55ed8ed17050 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.891+0000 7fdf2804e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdf201a7df0 con 0x55ed8ed11ce0 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.891+0000 7fdf2804e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdf201a5c40 con 0x55ed8ed14610 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.891+0000 7fdf1f59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed11ce0 0x55ed8ed03780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.891+0000 7fdf1f59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed11ce0 0x55ed8ed03780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:59362/0 (socket says 172.21.15.22:59362) 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.891+0000 7fdf1f59e640 1 -- 172.21.15.22:0/2950659385 learned_addr learned my addr 172.21.15.22:0/2950659385 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.891+0000 7fdf1f59e640 1 --2- 172.21.15.22:0/2950659385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed17050 0x55ed8ed18080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.891+0000 7fdf1f59e640 1 -- 172.21.15.22:0/2950659385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed8ed14610 msgr2=0x55ed8ed17b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.891+0000 7fdf1f59e640 1 --2- 172.21.15.22:0/2950659385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed8ed14610 0x55ed8ed17b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.891+0000 7fdf1f59e640 1 -- 172.21.15.22:0/2950659385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed17050 msgr2=0x55ed8ed18080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.891+0000 7fdf1f59e640 1 --2- 172.21.15.22:0/2950659385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed17050 0x55ed8ed18080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.891+0000 7fdf1f59e640 1 -- 172.21.15.22:0/2950659385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed8ed14440 con 0x55ed8ed11ce0 2024-08-20T01:37:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.892+0000 7fdf1f59e640 1 --2- 172.21.15.22:0/2950659385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed11ce0 0x55ed8ed03780 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf18005ba0 tx=0x7fdf180118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e628a47053e89698 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.892+0000 7fdf04ff9640 1 -- 172.21.15.22:0/2950659385 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18037020 con 0x55ed8ed11ce0 2024-08-20T01:37:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.892+0000 7fdf04ff9640 1 -- 172.21.15.22:0/2950659385 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf18003de0 con 0x55ed8ed11ce0 2024-08-20T01:37:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.892+0000 7fdf04ff9640 1 -- 172.21.15.22:0/2950659385 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1802d040 con 0x55ed8ed11ce0 2024-08-20T01:37:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.893+0000 7fdf2804e740 1 -- 172.21.15.22:0/2950659385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed11ce0 msgr2=0x55ed8ed03780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.893+0000 7fdf2804e740 1 --2- 172.21.15.22:0/2950659385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed11ce0 0x55ed8ed03780 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf18005ba0 tx=0x7fdf180118d0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.893+0000 7fdf2804e740 1 -- 172.21.15.22:0/2950659385 shutdown_connections 2024-08-20T01:37:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.893+0000 7fdf2804e740 1 --2- 172.21.15.22:0/2950659385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed17050 0x55ed8ed18080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.893+0000 7fdf2804e740 1 --2- 172.21.15.22:0/2950659385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed8ed14610 0x55ed8ed17b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.893+0000 7fdf2804e740 1 --2- 172.21.15.22:0/2950659385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed11ce0 0x55ed8ed03780 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.893+0000 7fdf2804e740 1 -- 172.21.15.22:0/2950659385 >> 172.21.15.22:0/2950659385 conn(0x55ed8ed08a20 msgr2=0x55ed8ed17430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.893+0000 7fdf2804e740 1 -- 172.21.15.22:0/2950659385 shutdown_connections 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.893+0000 7fdf2804e740 1 -- 172.21.15.22:0/2950659385 wait complete. 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.893+0000 7fdf2804e740 1 -- start start 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.894+0000 7fdf2804e740 1 Processor -- start 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.894+0000 7fdf2804e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed8ed11ce0 0x55ed8ed108f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.894+0000 7fdf2804e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed14610 0x55ed8ed10ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.894+0000 7fdf2804e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed17050 0x55ed8ed93f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.894+0000 7fdf2804e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdf201a62b0 con 0x55ed8ed17050 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.894+0000 7fdf2804e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdf201a7720 con 0x55ed8ed14610 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.894+0000 7fdf1e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed14610 0x55ed8ed10ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.894+0000 7fdf1e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed14610 0x55ed8ed10ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:59366/0 (socket says 172.21.15.22:59366) 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.894+0000 7fdf1e59c640 1 -- 172.21.15.22:0/3725176260 learned_addr learned my addr 172.21.15.22:0/3725176260 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.894+0000 7fdf1f59e640 1 --2- 172.21.15.22:0/3725176260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed17050 0x55ed8ed93f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.894+0000 7fdf2804e740 1 -- 172.21.15.22:0/3725176260 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdf201a6980 con 0x55ed8ed11ce0 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.895+0000 7fdf1e59c640 1 -- 172.21.15.22:0/3725176260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed8ed11ce0 msgr2=0x55ed8ed108f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.895+0000 7fdf1e59c640 1 --2- 172.21.15.22:0/3725176260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed8ed11ce0 0x55ed8ed108f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.895+0000 7fdf1e59c640 1 -- 172.21.15.22:0/3725176260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed17050 msgr2=0x55ed8ed93f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.895+0000 7fdf1e59c640 1 --2- 172.21.15.22:0/3725176260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed17050 0x55ed8ed93f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.895+0000 7fdf1e59c640 1 -- 172.21.15.22:0/3725176260 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed8ed94670 con 0x55ed8ed14610 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.895+0000 7fdf1e59c640 1 --2- 172.21.15.22:0/3725176260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed14610 0x55ed8ed10ed0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdf1402a9e0 tx=0x7fdf14004230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c484ae96b3cebb9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.895+0000 7fdf2804e740 10 client.0 _ll_register_callbacks cb 0x7fdf18009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:49.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.895+0000 7fdf02ff5640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:37:49.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.895+0000 7fdf02ff5640 1 -- 172.21.15.22:0/3725176260 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14035040 con 0x55ed8ed14610 2024-08-20T01:37:49.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.895+0000 7fdf2804e740 1 -- 172.21.15.22:0/3725176260 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf18003de0 con 0x55ed8ed14610 2024-08-20T01:37:49.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.896+0000 7fdf02ff5640 1 -- 172.21.15.22:0/3725176260 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fdf14005240 con 0x55ed8ed14610 2024-08-20T01:37:49.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.896+0000 7fdf02ff5640 1 -- 172.21.15.22:0/3725176260 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fdf14054050 con 0x55ed8ed14610 2024-08-20T01:37:49.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.896+0000 7fdf2804e740 10 client.26057 fetch_fsmap learned FSMap version 31 2024-08-20T01:37:49.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.896+0000 7fdf2804e740 1 -- 172.21.15.22:0/3725176260 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55ed8ed959a0 con 0x55ed8ed14610 2024-08-20T01:37:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.898+0000 7fdf02ff5640 1 -- 172.21.15.22:0/3725176260 <== mon.2 v2:172.21.15.77:3300/0 4 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fdf14004770 con 0x55ed8ed14610 2024-08-20T01:37:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.898+0000 7fdf2804e740 10 client.26057 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:37:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.898+0000 7fdf2804e740 10 client.26057 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:37:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.898+0000 7fdf2804e740 20 client.26057 populate_metadata read hostname 'smithi022' 2024-08-20T01:37:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.898+0000 7fdf2804e740 1 --2- 172.21.15.22:0/3725176260 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ed8ed96260 0x55ed8ed98680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.898+0000 7fdf2804e740 4 client.26057 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:37:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.898+0000 7fdf2804e740 1 -- 172.21.15.22:0/3725176260 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fdf18003de0 con 0x55ed8ed96260 2024-08-20T01:37:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.898+0000 7fdf1f59e640 1 --2- 172.21.15.22:0/3725176260 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ed8ed96260 0x55ed8ed98680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.899+0000 7fdf1f59e640 1 --2- 172.21.15.22:0/3725176260 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ed8ed96260 0x55ed8ed98680 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52f2c210337ba44e server_cookie=27fdd3c2f2bcabb0 in_seq=0 out_seq=0 2024-08-20T01:37:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.899+0000 7fdf02ff5640 10 client.26057 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:49.955 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.953+0000 7fdf02ff5640 1 -- 172.21.15.22:0/3725176260 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fdf18003de0 con 0x55ed8ed96260 2024-08-20T01:37:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.953+0000 7fdf02ff5640 10 client.26057 handle_command_reply: tid=0 2024-08-20T01:37:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.953+0000 7fdf2804e740 1 client.26057 shutdown 2024-08-20T01:37:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.953+0000 7fdf2804e740 1 -- 172.21.15.22:0/3725176260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed14610 msgr2=0x55ed8ed10ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.953+0000 7fdf2804e740 1 --2- 172.21.15.22:0/3725176260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed14610 0x55ed8ed10ed0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdf1402a9e0 tx=0x7fdf14004230 comp rx=0 tx=0).stop 2024-08-20T01:37:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.953+0000 7fdf2804e740 1 -- 172.21.15.22:0/3725176260 shutdown_connections 2024-08-20T01:37:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.953+0000 7fdf2804e740 1 --2- 172.21.15.22:0/3725176260 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ed8ed96260 0x55ed8ed98680 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.954+0000 7fdf2804e740 1 --2- 172.21.15.22:0/3725176260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed8ed17050 0x55ed8ed93f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.954+0000 7fdf02ff5640 0 client.26057 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:37:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.954+0000 7fdf2804e740 1 --2- 172.21.15.22:0/3725176260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed8ed14610 0x55ed8ed10ed0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.954+0000 7fdf2804e740 1 --2- 172.21.15.22:0/3725176260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed8ed11ce0 0x55ed8ed108f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.954+0000 7fdf2804e740 1 -- 172.21.15.22:0/3725176260 >> 172.21.15.22:0/3725176260 conn(0x55ed8ed08a20 msgr2=0x55ed8ed17c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.954+0000 7fdf2804e740 1 -- 172.21.15.22:0/3725176260 shutdown_connections 2024-08-20T01:37:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.954+0000 7fdf2804e740 1 -- 172.21.15.22:0/3725176260 wait complete. 2024-08-20T01:37:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.954+0000 7fdf2804e740 20 client.26057 trim_cache size 0 max 16384 2024-08-20T01:37:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:37:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:37:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:37:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:37:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.955+0000 7fdf25188640 1 -- 172.21.15.22:0/2454716674 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fdf080b3bd0 msgr2=0x7fdf080b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.955+0000 7fdf25188640 1 --2- 172.21.15.22:0/2454716674 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fdf080b3bd0 0x7fdf080b6090 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000c6a0 tx=0x7fdf10000bc0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.955+0000 7fdf25188640 1 -- 172.21.15.22:0/2454716674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf20101580 msgr2=0x7fdf2006b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.955+0000 7fdf25188640 1 --2- 172.21.15.22:0/2454716674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf20101580 0x7fdf2006b9c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000e9f0 tx=0x7fdf1000eeb0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.955+0000 7fdf25188640 1 -- 172.21.15.22:0/2454716674 shutdown_connections 2024-08-20T01:37:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.955+0000 7fdf25188640 1 --2- 172.21.15.22:0/2454716674 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fdf080b3bd0 0x7fdf080b6090 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.955+0000 7fdf25188640 1 --2- 172.21.15.22:0/2454716674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf20103090 0x7fdf2019fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.955+0000 7fdf25188640 1 --2- 172.21.15.22:0/2454716674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf201026d0 0x7fdf2019d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.955+0000 7fdf25188640 1 --2- 172.21.15.22:0/2454716674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf20101580 0x7fdf2006b9c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.955+0000 7fdf25188640 1 -- 172.21.15.22:0/2454716674 >> 172.21.15.22:0/2454716674 conn(0x7fdf200fce60 msgr2=0x7fdf20105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.955+0000 7fdf25188640 1 -- 172.21.15.22:0/2454716674 shutdown_connections 2024-08-20T01:37:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:37:49.955+0000 7fdf25188640 1 -- 172.21.15.22:0/2454716674 wait complete. 2024-08-20T01:37:50.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:50 smithi022 ceph-mon[18709]: pgmap v547: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 865 KiB/s wr, 2.92k op/s 2024-08-20T01:37:51.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:50 smithi134 ceph-mon[22511]: pgmap v547: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 865 KiB/s wr, 2.92k op/s 2024-08-20T01:37:51.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:50 smithi077 ceph-mon[22251]: pgmap v547: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 865 KiB/s wr, 2.92k op/s 2024-08-20T01:37:52.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:52 smithi022 ceph-mon[18709]: pgmap v548: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.2 MiB/s wr, 3.21k op/s 2024-08-20T01:37:53.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:52 smithi134 ceph-mon[22511]: pgmap v548: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.2 MiB/s wr, 3.21k op/s 2024-08-20T01:37:53.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:52 smithi077 ceph-mon[22251]: pgmap v548: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.2 MiB/s wr, 3.21k op/s 2024-08-20T01:37:54.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:54 smithi022 ceph-mon[18709]: pgmap v549: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.6 MiB/s wr, 3.19k op/s 2024-08-20T01:37:55.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:54 smithi134 ceph-mon[22511]: pgmap v549: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.6 MiB/s wr, 3.19k op/s 2024-08-20T01:37:55.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:54 smithi077 ceph-mon[22251]: pgmap v549: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.6 MiB/s wr, 3.19k op/s 2024-08-20T01:37:55.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:55 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:56.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:55 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:56.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:55 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:56.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:56 smithi022 ceph-mon[18709]: pgmap v550: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.2 MiB/s wr, 2.40k op/s 2024-08-20T01:37:57.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:56 smithi134 ceph-mon[22511]: pgmap v550: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.2 MiB/s wr, 2.40k op/s 2024-08-20T01:37:57.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:56 smithi077 ceph-mon[22251]: pgmap v550: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.2 MiB/s wr, 2.40k op/s 2024-08-20T01:37:58.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:37:58 smithi022 ceph-mon[18709]: pgmap v551: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 2.31k op/s 2024-08-20T01:37:59.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:37:58 smithi134 ceph-mon[22511]: pgmap v551: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 2.31k op/s 2024-08-20T01:37:59.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:37:58 smithi077 ceph-mon[22251]: pgmap v551: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 2.31k op/s 2024-08-20T01:38:00.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:00 smithi022 ceph-mon[18709]: pgmap v552: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.2 MiB/s wr, 1.36k op/s 2024-08-20T01:38:01.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:00 smithi134 ceph-mon[22511]: pgmap v552: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.2 MiB/s wr, 1.36k op/s 2024-08-20T01:38:01.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:00 smithi077 ceph-mon[22251]: pgmap v552: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.2 MiB/s wr, 1.36k op/s 2024-08-20T01:38:02.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:02 smithi022 ceph-mon[18709]: pgmap v553: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 997 op/s 2024-08-20T01:38:03.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:02 smithi134 ceph-mon[22511]: pgmap v553: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 997 op/s 2024-08-20T01:38:03.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:02 smithi077 ceph-mon[22251]: pgmap v553: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 997 op/s 2024-08-20T01:38:03.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.063+0000 7fba826ba640 1 -- 172.21.15.22:0/4198995134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba7c101560 msgr2=0x7fba7c101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.063+0000 7fba826ba640 1 --2- 172.21.15.22:0/4198995134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba7c101560 0x7fba7c101960 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fba6c009930 tx=0x7fba6c02a420 comp rx=0 tx=0).stop 2024-08-20T01:38:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.063+0000 7fba826ba640 1 -- 172.21.15.22:0/4198995134 shutdown_connections 2024-08-20T01:38:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.063+0000 7fba826ba640 1 --2- 172.21.15.22:0/4198995134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba7c103070 0x7fba7c1099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.063+0000 7fba826ba640 1 --2- 172.21.15.22:0/4198995134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba7c1026b0 0x7fba7c102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.063+0000 7fba826ba640 1 --2- 172.21.15.22:0/4198995134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba7c101560 0x7fba7c101960 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.063+0000 7fba826ba640 1 -- 172.21.15.22:0/4198995134 >> 172.21.15.22:0/4198995134 conn(0x7fba7c0fce40 msgr2=0x7fba7c0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.063+0000 7fba826ba640 1 -- 172.21.15.22:0/4198995134 shutdown_connections 2024-08-20T01:38:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.063+0000 7fba826ba640 1 -- 172.21.15.22:0/4198995134 wait complete. 2024-08-20T01:38:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.064+0000 7fba826ba640 1 Processor -- start 2024-08-20T01:38:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.064+0000 7fba826ba640 1 -- start start 2024-08-20T01:38:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.064+0000 7fba826ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba7c101560 0x7fba7c105320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.064+0000 7fba826ba640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba7c1026b0 0x7fba7c103b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.064+0000 7fba826ba640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba7c103070 0x7fba7c1040c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.064+0000 7fba826ba640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c10d1b0 con 0x7fba7c1026b0 2024-08-20T01:38:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.064+0000 7fba826ba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c10d030 con 0x7fba7c101560 2024-08-20T01:38:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.064+0000 7fba826ba640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c10d330 con 0x7fba7c103070 2024-08-20T01:38:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.064+0000 7fba73fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba7c1026b0 0x7fba7c103b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.064+0000 7fba73fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba7c1026b0 0x7fba7c103b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39964/0 (socket says 172.21.15.22:39964) 2024-08-20T01:38:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.064+0000 7fba73fff640 1 -- 172.21.15.22:0/2311989797 learned_addr learned my addr 172.21.15.22:0/2311989797 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.064+0000 7fba7bfff640 1 --2- 172.21.15.22:0/2311989797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba7c101560 0x7fba7c105320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.064+0000 7fba80c57640 1 --2- 172.21.15.22:0/2311989797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba7c103070 0x7fba7c1040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.064+0000 7fba73fff640 1 -- 172.21.15.22:0/2311989797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba7c103070 msgr2=0x7fba7c1040c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.064+0000 7fba73fff640 1 --2- 172.21.15.22:0/2311989797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba7c103070 0x7fba7c1040c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.065+0000 7fba73fff640 1 -- 172.21.15.22:0/2311989797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba7c101560 msgr2=0x7fba7c105320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.065+0000 7fba73fff640 1 --2- 172.21.15.22:0/2311989797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba7c101560 0x7fba7c105320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.065+0000 7fba73fff640 1 -- 172.21.15.22:0/2311989797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba7c104930 con 0x7fba7c1026b0 2024-08-20T01:38:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.065+0000 7fba73fff640 1 --2- 172.21.15.22:0/2311989797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba7c1026b0 0x7fba7c103b80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fba6400e9f0 tx=0x7fba6400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.065+0000 7fba79ffb640 1 -- 172.21.15.22:0/2311989797 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6400cd80 con 0x7fba7c1026b0 2024-08-20T01:38:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.065+0000 7fba826ba640 1 -- 172.21.15.22:0/2311989797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba7c1a2b90 con 0x7fba7c1026b0 2024-08-20T01:38:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.065+0000 7fba79ffb640 1 -- 172.21.15.22:0/2311989797 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba640108e0 con 0x7fba7c1026b0 2024-08-20T01:38:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.065+0000 7fba79ffb640 1 -- 172.21.15.22:0/2311989797 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64018980 con 0x7fba7c1026b0 2024-08-20T01:38:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.065+0000 7fba826ba640 1 -- 172.21.15.22:0/2311989797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba7c1a30b0 con 0x7fba7c1026b0 2024-08-20T01:38:03.077 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.067+0000 7fba854a5740 1 Processor -- start 2024-08-20T01:38:03.077 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.067+0000 7fba79ffb640 1 -- 172.21.15.22:0/2311989797 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fba64010430 con 0x7fba7c1026b0 2024-08-20T01:38:03.077 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.067+0000 7fba854a5740 1 -- start start 2024-08-20T01:38:03.077 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.067+0000 7fba854a5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68aa8d0 0x5586c68accc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.077 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba854a5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68ad200 0x5586c68af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.077 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba854a5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68afc40 0x5586c68b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.077 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba854a5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5586c681d360 con 0x5586c68ad200 2024-08-20T01:38:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba854a5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5586c680c860 con 0x5586c68aa8d0 2024-08-20T01:38:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba854a5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5586c68108a0 con 0x5586c68afc40 2024-08-20T01:38:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba7bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68ad200 0x5586c68af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba73fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68afc40 0x5586c68b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba7bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68ad200 0x5586c68af5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39972/0 (socket says 172.21.15.22:39972) 2024-08-20T01:38:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba7bfff640 1 -- 172.21.15.22:0/2210979804 learned_addr learned my addr 172.21.15.22:0/2210979804 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba80c57640 1 --2- 172.21.15.22:0/2210979804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68aa8d0 0x5586c68accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba7bfff640 1 -- 172.21.15.22:0/2210979804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68afc40 msgr2=0x5586c68b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba7bfff640 1 --2- 172.21.15.22:0/2210979804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68afc40 0x5586c68b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba7bfff640 1 -- 172.21.15.22:0/2210979804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68aa8d0 msgr2=0x5586c68accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba7bfff640 1 --2- 172.21.15.22:0/2210979804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68aa8d0 0x5586c68accc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba7bfff640 1 -- 172.21.15.22:0/2210979804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586c67b3e40 con 0x5586c68ad200 2024-08-20T01:38:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba79ffb640 1 --2- 172.21.15.22:0/2311989797 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fba680b3bd0 0x7fba680b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba7bfff640 1 --2- 172.21.15.22:0/2210979804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68ad200 0x5586c68af5f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fba6c02a940 tx=0x7fba6c005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a631c4e3824720a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba80c57640 1 --2- 172.21.15.22:0/2311989797 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fba680b3bd0 0x7fba680b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba727fc640 1 -- 172.21.15.22:0/2210979804 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6c035030 con 0x5586c68ad200 2024-08-20T01:38:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.068+0000 7fba79ffb640 1 -- 172.21.15.22:0/2311989797 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fba640e3f40 con 0x7fba7c1026b0 2024-08-20T01:38:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.069+0000 7fba727fc640 1 -- 172.21.15.22:0/2210979804 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba6c040070 con 0x5586c68ad200 2024-08-20T01:38:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.069+0000 7fba727fc640 1 -- 172.21.15.22:0/2210979804 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6c003850 con 0x5586c68ad200 2024-08-20T01:38:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.069+0000 7fba854a5740 1 -- 172.21.15.22:0/2210979804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68ad200 msgr2=0x5586c68af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.069+0000 7fba80c57640 1 --2- 172.21.15.22:0/2311989797 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fba680b3bd0 0x7fba680b6090 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fba74005fd0 tx=0x7fba74009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.069+0000 7fba854a5740 1 --2- 172.21.15.22:0/2210979804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68ad200 0x5586c68af5f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fba6c02a940 tx=0x7fba6c005de0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.069+0000 7fba854a5740 1 -- 172.21.15.22:0/2210979804 shutdown_connections 2024-08-20T01:38:03.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.069+0000 7fba854a5740 1 --2- 172.21.15.22:0/2210979804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68afc40 0x5586c68b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.069+0000 7fba854a5740 1 --2- 172.21.15.22:0/2210979804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68ad200 0x5586c68af5f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.069+0000 7fba854a5740 1 --2- 172.21.15.22:0/2210979804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68aa8d0 0x5586c68accc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.069+0000 7fba854a5740 1 -- 172.21.15.22:0/2210979804 >> 172.21.15.22:0/2210979804 conn(0x5586c68a5a20 msgr2=0x5586c68a67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:03.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.069+0000 7fba854a5740 1 -- 172.21.15.22:0/2210979804 shutdown_connections 2024-08-20T01:38:03.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.069+0000 7fba854a5740 1 -- 172.21.15.22:0/2210979804 wait complete. 2024-08-20T01:38:03.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.070+0000 7fba854a5740 1 -- start start 2024-08-20T01:38:03.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.070+0000 7fba854a5740 1 Processor -- start 2024-08-20T01:38:03.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.070+0000 7fba854a5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68aa8d0 0x5586c68b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.070+0000 7fba854a5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68ad200 0x5586c68b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.070+0000 7fba854a5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68afc40 0x5586c68b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.070+0000 7fba854a5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5586c6745ab0 con 0x5586c68aa8d0 2024-08-20T01:38:03.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.070+0000 7fba854a5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5586c6793780 con 0x5586c68ad200 2024-08-20T01:38:03.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.070+0000 7fba854a5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5586c68b2bc0 con 0x5586c68afc40 2024-08-20T01:38:03.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.070+0000 7fba854a5740 10 client.0 _ll_register_callbacks cb 0x5586c651ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:03.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.070+0000 7fba7bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68aa8d0 0x5586c68b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.070+0000 7fba7bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68aa8d0 0x5586c68b40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39976/0 (socket says 172.21.15.22:39976) 2024-08-20T01:38:03.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.070+0000 7fba7bfff640 1 -- 172.21.15.22:0/2771842537 learned_addr learned my addr 172.21.15.22:0/2771842537 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:03.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.070+0000 7fba73fff640 1 --2- 172.21.15.22:0/2771842537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68ad200 0x5586c68b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.070+0000 7fba80c57640 1 --2- 172.21.15.22:0/2771842537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68afc40 0x5586c68b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.070+0000 7fba7bfff640 1 -- 172.21.15.22:0/2771842537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68afc40 msgr2=0x5586c68b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.071+0000 7fba7bfff640 1 --2- 172.21.15.22:0/2771842537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68afc40 0x5586c68b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.071+0000 7fba7bfff640 1 -- 172.21.15.22:0/2771842537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68ad200 msgr2=0x5586c68b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.071+0000 7fba7bfff640 1 --2- 172.21.15.22:0/2771842537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68ad200 0x5586c68b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.071+0000 7fba7bfff640 1 -- 172.21.15.22:0/2771842537 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586c656f790 con 0x5586c68aa8d0 2024-08-20T01:38:03.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.071+0000 7fba73fff640 1 --2- 172.21.15.22:0/2771842537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68ad200 0x5586c68b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:03.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.071+0000 7fba7bfff640 1 --2- 172.21.15.22:0/2771842537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68aa8d0 0x5586c68b40c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fba6c031f60 tx=0x7fba6c02ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3450427931381c95 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:03.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.071+0000 7fba5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:38:03.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.071+0000 7fba5b7fe640 1 -- 172.21.15.22:0/2771842537 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6c035070 con 0x5586c68aa8d0 2024-08-20T01:38:03.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.071+0000 7fba5b7fe640 1 -- 172.21.15.22:0/2771842537 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fba6c0315a0 con 0x5586c68aa8d0 2024-08-20T01:38:03.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.071+0000 7fba854a5740 1 -- 172.21.15.22:0/2771842537 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5586c67bbe00 con 0x5586c68aa8d0 2024-08-20T01:38:03.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.071+0000 7fba5b7fe640 1 -- 172.21.15.22:0/2771842537 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fba6c0317a0 con 0x5586c68aa8d0 2024-08-20T01:38:03.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.071+0000 7fba854a5740 10 client.16440 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:03.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.071+0000 7fba854a5740 1 -- 172.21.15.22:0/2771842537 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5586c65e8620 con 0x5586c68aa8d0 2024-08-20T01:38:03.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.071+0000 7fba5b7fe640 1 -- 172.21.15.22:0/2771842537 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5586c67bbe00 con 0x5586c68aa8d0 2024-08-20T01:38:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.071+0000 7fba5b7fe640 1 -- 172.21.15.22:0/2771842537 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fba6c045630 con 0x5586c68aa8d0 2024-08-20T01:38:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.072+0000 7fba854a5740 10 client.16440 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.072+0000 7fba854a5740 10 client.16440 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:38:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.072+0000 7fba854a5740 20 client.16440 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.072+0000 7fba854a5740 1 --2- 172.21.15.22:0/2771842537 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5586c68bf4f0 0x5586c68c1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.072+0000 7fba854a5740 4 client.16440 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.072+0000 7fba854a5740 1 -- 172.21.15.22:0/2771842537 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586c681f2b0 con 0x5586c68bf4f0 2024-08-20T01:38:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.072+0000 7fba73fff640 1 --2- 172.21.15.22:0/2771842537 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5586c68bf4f0 0x5586c68c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.072+0000 7fba73fff640 1 --2- 172.21.15.22:0/2771842537 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5586c68bf4f0 0x5586c68c1970 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d67ebd275b71506d server_cookie=efc3f2d593eb3a4a in_seq=0 out_seq=0 2024-08-20T01:38:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.072+0000 7fba5b7fe640 10 client.16440 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.073+0000 7fba5b7fe640 1 -- 172.21.15.22:0/2771842537 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5586c681f2b0 con 0x5586c68bf4f0 2024-08-20T01:38:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.073+0000 7fba5b7fe640 10 client.16440 handle_command_reply: tid=0 2024-08-20T01:38:03.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.073+0000 7fba854a5740 1 client.16440 shutdown 2024-08-20T01:38:03.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.073+0000 7fba854a5740 1 -- 172.21.15.22:0/2771842537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68aa8d0 msgr2=0x5586c68b40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.073+0000 7fba854a5740 1 --2- 172.21.15.22:0/2771842537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68aa8d0 0x5586c68b40c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fba6c031f60 tx=0x7fba6c02ab50 comp rx=0 tx=0).stop 2024-08-20T01:38:03.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.073+0000 7fba854a5740 1 -- 172.21.15.22:0/2771842537 shutdown_connections 2024-08-20T01:38:03.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.073+0000 7fba854a5740 1 --2- 172.21.15.22:0/2771842537 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5586c68bf4f0 0x5586c68c1970 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.073+0000 7fba854a5740 1 --2- 172.21.15.22:0/2771842537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68afc40 0x5586c68b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.073+0000 7fba854a5740 1 --2- 172.21.15.22:0/2771842537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68ad200 0x5586c68b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.073+0000 7fba5b7fe640 0 client.16440 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:03.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.073+0000 7fba854a5740 1 --2- 172.21.15.22:0/2771842537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68aa8d0 0x5586c68b40c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.073+0000 7fba854a5740 1 -- 172.21.15.22:0/2771842537 >> 172.21.15.22:0/2771842537 conn(0x5586c68a5a20 msgr2=0x5586c68a4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:03.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.073+0000 7fba854a5740 1 -- 172.21.15.22:0/2771842537 shutdown_connections 2024-08-20T01:38:03.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.073+0000 7fba854a5740 1 -- 172.21.15.22:0/2771842537 wait complete. 2024-08-20T01:38:03.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.073+0000 7fba854a5740 20 client.16440 trim_cache size 0 max 16384 2024-08-20T01:38:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba854a5740 1 Processor -- start 2024-08-20T01:38:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba854a5740 1 -- start start 2024-08-20T01:38:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba854a5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68aa8d0 0x5586c68b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba854a5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68ad200 0x5586c68a0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba854a5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68afc40 0x5586c68a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba854a5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c1ae8e0 con 0x5586c68aa8d0 2024-08-20T01:38:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba854a5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c1ac0f0 con 0x5586c68ad200 2024-08-20T01:38:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba854a5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c1a9f40 con 0x5586c68afc40 2024-08-20T01:38:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba7bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68aa8d0 0x5586c68b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba7bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68aa8d0 0x5586c68b36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39980/0 (socket says 172.21.15.22:39980) 2024-08-20T01:38:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba80c57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68afc40 0x5586c68a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba7bfff640 1 -- 172.21.15.22:0/379072630 learned_addr learned my addr 172.21.15.22:0/379072630 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba73fff640 1 --2- 172.21.15.22:0/379072630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68ad200 0x5586c68a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba7bfff640 1 -- 172.21.15.22:0/379072630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68afc40 msgr2=0x5586c68a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba7bfff640 1 --2- 172.21.15.22:0/379072630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68afc40 0x5586c68a42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba7bfff640 1 -- 172.21.15.22:0/379072630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68ad200 msgr2=0x5586c68a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba7bfff640 1 --2- 172.21.15.22:0/379072630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68ad200 0x5586c68a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba7bfff640 1 -- 172.21.15.22:0/379072630 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586c68a5850 con 0x5586c68aa8d0 2024-08-20T01:38:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba73fff640 1 --2- 172.21.15.22:0/379072630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68ad200 0x5586c68a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.089+0000 7fba7bfff640 1 --2- 172.21.15.22:0/379072630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68aa8d0 0x5586c68b36d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fba6c000c00 tx=0x7fba6c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a39c68ce56b451 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.090+0000 7fba71ffb640 1 -- 172.21.15.22:0/379072630 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6c035050 con 0x5586c68aa8d0 2024-08-20T01:38:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.090+0000 7fba71ffb640 1 -- 172.21.15.22:0/379072630 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba6c054030 con 0x5586c68aa8d0 2024-08-20T01:38:03.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.090+0000 7fba71ffb640 1 -- 172.21.15.22:0/379072630 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6c003850 con 0x5586c68aa8d0 2024-08-20T01:38:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.090+0000 7fba854a5740 1 -- 172.21.15.22:0/379072630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68aa8d0 msgr2=0x5586c68b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.090+0000 7fba854a5740 1 --2- 172.21.15.22:0/379072630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68aa8d0 0x5586c68b36d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fba6c000c00 tx=0x7fba6c005fd0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.090+0000 7fba854a5740 1 -- 172.21.15.22:0/379072630 shutdown_connections 2024-08-20T01:38:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.090+0000 7fba854a5740 1 --2- 172.21.15.22:0/379072630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68afc40 0x5586c68a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.090+0000 7fba854a5740 1 --2- 172.21.15.22:0/379072630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68ad200 0x5586c68a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.090+0000 7fba854a5740 1 --2- 172.21.15.22:0/379072630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68aa8d0 0x5586c68b36d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.090+0000 7fba854a5740 1 -- 172.21.15.22:0/379072630 >> 172.21.15.22:0/379072630 conn(0x5586c68a5a20 msgr2=0x5586c68b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.091+0000 7fba854a5740 1 -- 172.21.15.22:0/379072630 shutdown_connections 2024-08-20T01:38:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.091+0000 7fba854a5740 1 -- 172.21.15.22:0/379072630 wait complete. 2024-08-20T01:38:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.091+0000 7fba854a5740 1 -- start start 2024-08-20T01:38:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.091+0000 7fba854a5740 1 Processor -- start 2024-08-20T01:38:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.091+0000 7fba854a5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68aa8d0 0x5586c68bb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.091+0000 7fba854a5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68ad200 0x5586c68ba540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.091+0000 7fba854a5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68afc40 0x5586c68baa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.091+0000 7fba854a5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c1aa5b0 con 0x5586c68ad200 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.091+0000 7fba854a5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c1aba20 con 0x5586c68afc40 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.091+0000 7fba854a5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c1aac80 con 0x5586c68aa8d0 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.091+0000 7fba854a5740 10 client.0 _ll_register_callbacks cb 0x7fba74009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.091+0000 7fba73fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68ad200 0x5586c68ba540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.091+0000 7fba73fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68ad200 0x5586c68ba540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39988/0 (socket says 172.21.15.22:39988) 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.091+0000 7fba73fff640 1 -- 172.21.15.22:0/4087948657 learned_addr learned my addr 172.21.15.22:0/4087948657 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.091+0000 7fba7bfff640 1 --2- 172.21.15.22:0/4087948657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68aa8d0 0x5586c68bb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.091+0000 7fba80c57640 1 --2- 172.21.15.22:0/4087948657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68afc40 0x5586c68baa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.092+0000 7fba73fff640 1 -- 172.21.15.22:0/4087948657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68aa8d0 msgr2=0x5586c68bb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.092+0000 7fba73fff640 1 --2- 172.21.15.22:0/4087948657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68aa8d0 0x5586c68bb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.092+0000 7fba73fff640 1 -- 172.21.15.22:0/4087948657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68afc40 msgr2=0x5586c68baa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.092+0000 7fba73fff640 1 --2- 172.21.15.22:0/4087948657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68afc40 0x5586c68baa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.092+0000 7fba73fff640 1 -- 172.21.15.22:0/4087948657 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586c68bafc0 con 0x5586c68ad200 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.092+0000 7fba73fff640 1 --2- 172.21.15.22:0/4087948657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68ad200 0x5586c68ba540 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fba6400c6a0 tx=0x7fba6400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d1b93cec6acd26 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.092+0000 7fba5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.092+0000 7fba5b7fe640 1 -- 172.21.15.22:0/4087948657 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64010720 con 0x5586c68ad200 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.092+0000 7fba854a5740 1 -- 172.21.15.22:0/4087948657 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba6c054030 con 0x5586c68ad200 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.092+0000 7fba5b7fe640 1 -- 172.21.15.22:0/4087948657 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fba640c0230 con 0x5586c68ad200 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.092+0000 7fba5b7fe640 1 -- 172.21.15.22:0/4087948657 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fba640aaa10 con 0x5586c68ad200 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.092+0000 7fba854a5740 10 client.16446 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.092+0000 7fba854a5740 1 -- 172.21.15.22:0/4087948657 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5586c68b9e30 con 0x5586c68ad200 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.092+0000 7fba5b7fe640 1 -- 172.21.15.22:0/4087948657 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba6c054030 con 0x5586c68ad200 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.093+0000 7fba5b7fe640 1 -- 172.21.15.22:0/4087948657 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fba640aa160 con 0x5586c68ad200 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.093+0000 7fba854a5740 10 client.16446 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.093+0000 7fba854a5740 10 client.16446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.093+0000 7fba854a5740 20 client.16446 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.093+0000 7fba854a5740 1 --2- 172.21.15.22:0/4087948657 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5586c692aa60 0x5586c692ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.093+0000 7fba854a5740 4 client.16446 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.093+0000 7fba854a5740 1 -- 172.21.15.22:0/4087948657 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5586c681ad50 con 0x5586c692aa60 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.093+0000 7fba7bfff640 1 --2- 172.21.15.22:0/4087948657 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5586c692aa60 0x5586c692ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.093+0000 7fba7bfff640 1 --2- 172.21.15.22:0/4087948657 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5586c692aa60 0x5586c692ce80 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27d92366a1e25b4d server_cookie=d3fc03acbcbe00f1 in_seq=0 out_seq=0 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:03.093+0000 7fba5b7fe640 10 client.16446 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:03.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:03 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:38:03.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:03 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:38:04.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:03 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:38:04.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:03 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:38:04.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:03 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:38:04.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:03 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:38:04.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:04 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:38:04.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:04 smithi022 ceph-mon[18709]: pgmap v554: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 768 op/s 2024-08-20T01:38:05.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:04 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:38:05.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:04 smithi134 ceph-mon[22511]: pgmap v554: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 768 op/s 2024-08-20T01:38:05.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:04 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:38:05.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:04 smithi077 ceph-mon[22251]: pgmap v554: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 768 op/s 2024-08-20T01:38:06.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:06 smithi022 ceph-mon[18709]: pgmap v555: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 477 op/s 2024-08-20T01:38:07.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:06 smithi134 ceph-mon[22511]: pgmap v555: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 477 op/s 2024-08-20T01:38:07.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:06 smithi077 ceph-mon[22251]: pgmap v555: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 477 op/s 2024-08-20T01:38:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.411+0000 7fba5b7fe640 1 -- 172.21.15.22:0/4087948657 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5586c681ad50 con 0x5586c692aa60 2024-08-20T01:38:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.411+0000 7fba5b7fe640 10 client.16446 handle_command_reply: tid=0 2024-08-20T01:38:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.411+0000 7fba854a5740 1 client.16446 shutdown 2024-08-20T01:38:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.412+0000 7fba854a5740 1 -- 172.21.15.22:0/4087948657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68ad200 msgr2=0x5586c68ba540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.412+0000 7fba854a5740 1 --2- 172.21.15.22:0/4087948657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68ad200 0x5586c68ba540 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fba6400c6a0 tx=0x7fba6400cf20 comp rx=0 tx=0).stop 2024-08-20T01:38:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.412+0000 7fba854a5740 1 -- 172.21.15.22:0/4087948657 shutdown_connections 2024-08-20T01:38:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.412+0000 7fba854a5740 1 --2- 172.21.15.22:0/4087948657 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5586c692aa60 0x5586c692ce80 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.412+0000 7fba854a5740 1 --2- 172.21.15.22:0/4087948657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5586c68afc40 0x5586c68baa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.412+0000 7fba854a5740 1 --2- 172.21.15.22:0/4087948657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c68ad200 0x5586c68ba540 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.412+0000 7fba5b7fe640 0 client.16446 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:07.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.412+0000 7fba854a5740 1 --2- 172.21.15.22:0/4087948657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5586c68aa8d0 0x5586c68bb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.412+0000 7fba854a5740 1 -- 172.21.15.22:0/4087948657 >> 172.21.15.22:0/4087948657 conn(0x5586c68a5a20 msgr2=0x5586c68a42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:07.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.412+0000 7fba854a5740 1 -- 172.21.15.22:0/4087948657 shutdown_connections 2024-08-20T01:38:07.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.412+0000 7fba854a5740 1 -- 172.21.15.22:0/4087948657 wait complete. 2024-08-20T01:38:07.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.412+0000 7fba854a5740 20 client.16446 trim_cache size 0 max 16384 2024-08-20T01:38:07.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:38:07.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:38:07.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:38:07.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:38:07.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.413+0000 7fba826ba640 1 -- 172.21.15.22:0/2311989797 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fba680b3bd0 msgr2=0x7fba680b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:07.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.413+0000 7fba826ba640 1 --2- 172.21.15.22:0/2311989797 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fba680b3bd0 0x7fba680b6090 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fba74005fd0 tx=0x7fba74009500 comp rx=0 tx=0).stop 2024-08-20T01:38:07.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.413+0000 7fba826ba640 1 -- 172.21.15.22:0/2311989797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba7c1026b0 msgr2=0x7fba7c103b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:07.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.413+0000 7fba826ba640 1 --2- 172.21.15.22:0/2311989797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba7c1026b0 0x7fba7c103b80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fba6400e9f0 tx=0x7fba6400eeb0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.413+0000 7fba826ba640 1 -- 172.21.15.22:0/2311989797 shutdown_connections 2024-08-20T01:38:07.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.413+0000 7fba826ba640 1 --2- 172.21.15.22:0/2311989797 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fba680b3bd0 0x7fba680b6090 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.413+0000 7fba826ba640 1 --2- 172.21.15.22:0/2311989797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba7c103070 0x7fba7c1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.413+0000 7fba826ba640 1 --2- 172.21.15.22:0/2311989797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba7c1026b0 0x7fba7c103b80 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.413+0000 7fba826ba640 1 --2- 172.21.15.22:0/2311989797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba7c101560 0x7fba7c105320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.413+0000 7fba826ba640 1 -- 172.21.15.22:0/2311989797 >> 172.21.15.22:0/2311989797 conn(0x7fba7c0fce40 msgr2=0x7fba7c0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:07.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.413+0000 7fba826ba640 1 -- 172.21.15.22:0/2311989797 shutdown_connections 2024-08-20T01:38:07.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:07.413+0000 7fba826ba640 1 -- 172.21.15.22:0/2311989797 wait complete. 2024-08-20T01:38:08.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:08 smithi022 ceph-mon[18709]: pgmap v556: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 1.42k op/s 2024-08-20T01:38:09.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:08 smithi134 ceph-mon[22511]: pgmap v556: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 1.42k op/s 2024-08-20T01:38:09.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:08 smithi077 ceph-mon[22251]: pgmap v556: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 1.42k op/s 2024-08-20T01:38:10.889 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:10 smithi022 ceph-mon[18709]: pgmap v557: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 1.79k op/s 2024-08-20T01:38:11.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:10 smithi134 ceph-mon[22511]: pgmap v557: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 1.79k op/s 2024-08-20T01:38:11.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:10 smithi077 ceph-mon[22251]: pgmap v557: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 1.79k op/s 2024-08-20T01:38:12.450 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:38:12.794 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:12.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:12 smithi022 ceph-mon[18709]: pgmap v558: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.2 MiB/s wr, 1.91k op/s 2024-08-20T01:38:13.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:12 smithi134 ceph-mon[22511]: pgmap v558: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.2 MiB/s wr, 1.91k op/s 2024-08-20T01:38:13.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:12 smithi077 ceph-mon[22251]: pgmap v558: 97 pgs: 97 active+clean; 1.8 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.2 MiB/s wr, 1.91k op/s 2024-08-20T01:38:13.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.416+0000 7f42126a9640 1 -- 172.21.15.22:0/2520803674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f420c104290 msgr2=0x7f420c10c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:13.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.416+0000 7f42126a9640 1 --2- 172.21.15.22:0/2520803674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f420c104290 0x7f420c10c870 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4200009900 tx=0x7f420002a410 comp rx=0 tx=0).stop 2024-08-20T01:38:13.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.416+0000 7f42126a9640 1 -- 172.21.15.22:0/2520803674 shutdown_connections 2024-08-20T01:38:13.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.416+0000 7f42126a9640 1 --2- 172.21.15.22:0/2520803674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f420c10ce40 0x7f420c10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.416+0000 7f42126a9640 1 --2- 172.21.15.22:0/2520803674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f420c104290 0x7f420c10c870 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.416+0000 7f42126a9640 1 --2- 172.21.15.22:0/2520803674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f420c103890 0x7f420c103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.416+0000 7f42126a9640 1 -- 172.21.15.22:0/2520803674 >> 172.21.15.22:0/2520803674 conn(0x7f420c0fd400 msgr2=0x7f420c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.416+0000 7f42126a9640 1 -- 172.21.15.22:0/2520803674 shutdown_connections 2024-08-20T01:38:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.416+0000 7f42126a9640 1 -- 172.21.15.22:0/2520803674 wait complete. 2024-08-20T01:38:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.416+0000 7f42126a9640 1 Processor -- start 2024-08-20T01:38:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.416+0000 7f42126a9640 1 -- start start 2024-08-20T01:38:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.417+0000 7f42126a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f420c103890 0x7f420c198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.417+0000 7f42126a9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f420c104290 0x7f420c1994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.417+0000 7f42126a9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f420c10ce40 0x7f420c19e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.417+0000 7f42126a9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f420c112ab0 con 0x7f420c104290 2024-08-20T01:38:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.417+0000 7f42126a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f420c112930 con 0x7f420c103890 2024-08-20T01:38:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.417+0000 7f42126a9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f420c112c30 con 0x7f420c10ce40 2024-08-20T01:38:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.417+0000 7f420b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f420c104290 0x7f420c1994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.417+0000 7f420bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f420c103890 0x7f420c198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.417+0000 7f420b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f420c104290 0x7f420c1994e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38144/0 (socket says 172.21.15.22:38144) 2024-08-20T01:38:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.417+0000 7f420b7fe640 1 -- 172.21.15.22:0/2182654142 learned_addr learned my addr 172.21.15.22:0/2182654142 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.417+0000 7f4210c46640 1 --2- 172.21.15.22:0/2182654142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f420c10ce40 0x7f420c19e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.417+0000 7f4210c46640 1 -- 172.21.15.22:0/2182654142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f420c103890 msgr2=0x7f420c198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.417+0000 7f4210c46640 1 --2- 172.21.15.22:0/2182654142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f420c103890 0x7f420c198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.417+0000 7f4210c46640 1 -- 172.21.15.22:0/2182654142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f420c104290 msgr2=0x7f420c1994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.417+0000 7f4210c46640 1 --2- 172.21.15.22:0/2182654142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f420c104290 0x7f420c1994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.417+0000 7f4210c46640 1 -- 172.21.15.22:0/2182654142 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f420c19f050 con 0x7f420c10ce40 2024-08-20T01:38:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.417+0000 7f420bfff640 1 --2- 172.21.15.22:0/2182654142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f420c103890 0x7f420c198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.417+0000 7f420b7fe640 1 --2- 172.21.15.22:0/2182654142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f420c104290 0x7f420c1994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.418+0000 7f4210c46640 1 --2- 172.21.15.22:0/2182654142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f420c10ce40 0x7f420c19e880 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4204005fd0 tx=0x7f420400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:13.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.418+0000 7f42097fa640 1 -- 172.21.15.22:0/2182654142 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420400cdf0 con 0x7f420c10ce40 2024-08-20T01:38:13.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.418+0000 7f42126a9640 1 -- 172.21.15.22:0/2182654142 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f420c19f340 con 0x7f420c10ce40 2024-08-20T01:38:13.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.418+0000 7f42097fa640 1 -- 172.21.15.22:0/2182654142 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4204005020 con 0x7f420c10ce40 2024-08-20T01:38:13.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.418+0000 7f42097fa640 1 -- 172.21.15.22:0/2182654142 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4204010690 con 0x7f420c10ce40 2024-08-20T01:38:13.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.418+0000 7f42126a9640 1 -- 172.21.15.22:0/2182654142 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f420c1017c0 con 0x7f420c10ce40 2024-08-20T01:38:13.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.421+0000 7f42097fa640 1 -- 172.21.15.22:0/2182654142 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4204005460 con 0x7f420c10ce40 2024-08-20T01:38:13.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.421+0000 7f4214aa2740 1 Processor -- start 2024-08-20T01:38:13.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.421+0000 7f4214aa2740 1 -- start start 2024-08-20T01:38:13.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.421+0000 7f4214aa2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a23830 0x55a053a23c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:13.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.421+0000 7f4214aa2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a24150 0x55a053a2fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:13.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.421+0000 7f4214aa2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a300e0 0x55a053a324d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:13.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.421+0000 7f4214aa2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a05399a8e0 con 0x55a053a300e0 2024-08-20T01:38:13.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.421+0000 7f4214aa2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a053989de0 con 0x55a053a23830 2024-08-20T01:38:13.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.421+0000 7f4214aa2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a05398de20 con 0x55a053a24150 2024-08-20T01:38:13.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.421+0000 7f420b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a300e0 0x55a053a324d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:13.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.421+0000 7f420bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a24150 0x55a053a2fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:13.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.421+0000 7f420b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a300e0 0x55a053a324d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38148/0 (socket says 172.21.15.22:38148) 2024-08-20T01:38:13.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.421+0000 7f420bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a24150 0x55a053a2fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:49834/0 (socket says 172.21.15.22:49834) 2024-08-20T01:38:13.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.421+0000 7f420b7fe640 1 -- 172.21.15.22:0/2104141850 learned_addr learned my addr 172.21.15.22:0/2104141850 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:13.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.421+0000 7f420b7fe640 1 --2- 172.21.15.22:0/2104141850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a23830 0x55a053a23c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:13.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.422+0000 7f42097fa640 1 --2- 172.21.15.22:0/2182654142 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f41f40b3bd0 0x7f41f40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:13.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.422+0000 7f420bfff640 1 -- 172.21.15.22:0/2104141850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a23830 msgr2=0x55a053a23c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:13.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.422+0000 7f420bfff640 1 --2- 172.21.15.22:0/2104141850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a23830 0x55a053a23c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.422+0000 7f420bfff640 1 -- 172.21.15.22:0/2104141850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a300e0 msgr2=0x55a053a324d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:13.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.422+0000 7f420bfff640 1 --2- 172.21.15.22:0/2104141850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a300e0 0x55a053a324d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.422+0000 7f420bfff640 1 -- 172.21.15.22:0/2104141850 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0536e9650 con 0x55a053a24150 2024-08-20T01:38:13.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.422+0000 7f4210c46640 1 --2- 172.21.15.22:0/2182654142 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f41f40b3bd0 0x7f41f40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:13.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.422+0000 7f42097fa640 1 -- 172.21.15.22:0/2182654142 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f42040e4210 con 0x7f420c10ce40 2024-08-20T01:38:13.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.422+0000 7f420bfff640 1 --2- 172.21.15.22:0/2104141850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a24150 0x55a053a2fba0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0096c0 tx=0x7f41fc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f1c5c86218c045b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:13.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.422+0000 7f41f27fc640 1 -- 172.21.15.22:0/2104141850 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc008810 con 0x55a053a24150 2024-08-20T01:38:13.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.422+0000 7f41f27fc640 1 -- 172.21.15.22:0/2104141850 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41fc01f070 con 0x55a053a24150 2024-08-20T01:38:13.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.422+0000 7f41f27fc640 1 -- 172.21.15.22:0/2104141850 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc01acb0 con 0x55a053a24150 2024-08-20T01:38:13.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.423+0000 7f4214aa2740 1 -- 172.21.15.22:0/2104141850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a24150 msgr2=0x55a053a2fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:13.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.423+0000 7f4214aa2740 1 --2- 172.21.15.22:0/2104141850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a24150 0x55a053a2fba0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0096c0 tx=0x7f41fc009b80 comp rx=0 tx=0).stop 2024-08-20T01:38:13.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.423+0000 7f4210c46640 1 --2- 172.21.15.22:0/2182654142 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f41f40b3bd0 0x7f41f40b6090 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f42040e1cb0 tx=0x7f420400cf90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:13.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.423+0000 7f4214aa2740 1 -- 172.21.15.22:0/2104141850 shutdown_connections 2024-08-20T01:38:13.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.423+0000 7f4214aa2740 1 --2- 172.21.15.22:0/2104141850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a300e0 0x55a053a324d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.423+0000 7f4214aa2740 1 --2- 172.21.15.22:0/2104141850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a24150 0x55a053a2fba0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.423+0000 7f4214aa2740 1 --2- 172.21.15.22:0/2104141850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a23830 0x55a053a23c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.423+0000 7f4214aa2740 1 -- 172.21.15.22:0/2104141850 >> 172.21.15.22:0/2104141850 conn(0x55a053a21660 msgr2=0x55a053a22800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:13.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.423+0000 7f4214aa2740 1 -- 172.21.15.22:0/2104141850 shutdown_connections 2024-08-20T01:38:13.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.423+0000 7f4214aa2740 1 -- 172.21.15.22:0/2104141850 wait complete. 2024-08-20T01:38:13.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.423+0000 7f4214aa2740 1 -- start start 2024-08-20T01:38:13.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.424+0000 7f4214aa2740 1 Processor -- start 2024-08-20T01:38:13.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.424+0000 7f4214aa2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a23830 0x55a053a2d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:13.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.424+0000 7f4214aa2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a24150 0x55a053a2d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:13.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.424+0000 7f4214aa2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a300e0 0x55a053a2db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:13.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.424+0000 7f4214aa2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a0537ec700 con 0x55a053a24150 2024-08-20T01:38:13.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.424+0000 7f4214aa2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a0539107c0 con 0x55a053a23830 2024-08-20T01:38:13.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.424+0000 7f4214aa2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a053a32d90 con 0x55a053a300e0 2024-08-20T01:38:13.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.424+0000 7f4214aa2740 10 client.0 _ll_register_callbacks cb 0x55a0539836b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:13.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.424+0000 7f420bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a24150 0x55a053a2d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:13.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.424+0000 7f420b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a300e0 0x55a053a2db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:13.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.424+0000 7f420b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a300e0 0x55a053a2db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:49846/0 (socket says 172.21.15.22:49846) 2024-08-20T01:38:13.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.424+0000 7f420b7fe640 1 -- 172.21.15.22:0/2532363061 learned_addr learned my addr 172.21.15.22:0/2532363061 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:13.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.424+0000 7f420bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a24150 0x55a053a2d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38164/0 (socket says 172.21.15.22:38164) 2024-08-20T01:38:13.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.424+0000 7f420b7fe640 1 --2- 172.21.15.22:0/2532363061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a23830 0x55a053a2d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.425+0000 7f420b7fe640 1 -- 172.21.15.22:0/2532363061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a23830 msgr2=0x55a053a2d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.425+0000 7f420b7fe640 1 --2- 172.21.15.22:0/2532363061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a23830 0x55a053a2d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.425+0000 7f420b7fe640 1 -- 172.21.15.22:0/2532363061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a24150 msgr2=0x55a053a2d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.425+0000 7f420b7fe640 1 --2- 172.21.15.22:0/2532363061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a24150 0x55a053a2d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.425+0000 7f420b7fe640 1 -- 172.21.15.22:0/2532363061 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a053a3c140 con 0x55a053a300e0 2024-08-20T01:38:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.425+0000 7f420b7fe640 1 --2- 172.21.15.22:0/2532363061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a300e0 0x55a053a2db00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4200003e90 tx=0x7f4200009680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d78d625128318da7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.425+0000 7f41eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:38:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.425+0000 7f41eb7fe640 1 -- 172.21.15.22:0/2532363061 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200035070 con 0x55a053a300e0 2024-08-20T01:38:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.425+0000 7f4214aa2740 1 -- 172.21.15.22:0/2532363061 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a053939100 con 0x55a053a300e0 2024-08-20T01:38:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.425+0000 7f41eb7fe640 1 -- 172.21.15.22:0/2532363061 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f42000328f0 con 0x55a053a300e0 2024-08-20T01:38:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.425+0000 7f41eb7fe640 1 -- 172.21.15.22:0/2532363061 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4200032af0 con 0x55a053a300e0 2024-08-20T01:38:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.425+0000 7f4214aa2740 10 client.26104 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.425+0000 7f4214aa2740 1 -- 172.21.15.22:0/2532363061 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a053a3eb40 con 0x55a053a300e0 2024-08-20T01:38:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.425+0000 7f41eb7fe640 1 -- 172.21.15.22:0/2532363061 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a053939100 con 0x55a053a300e0 2024-08-20T01:38:13.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.426+0000 7f41eb7fe640 1 -- 172.21.15.22:0/2532363061 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f420003dc30 con 0x55a053a300e0 2024-08-20T01:38:13.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.426+0000 7f4214aa2740 10 client.26104 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:13.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.426+0000 7f4214aa2740 10 client.26104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:38:13.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.426+0000 7f4214aa2740 20 client.26104 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:13.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.426+0000 7f4214aa2740 1 --2- 172.21.15.22:0/2532363061 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a053a3fff0 0x55a053a423e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:13.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.426+0000 7f4214aa2740 4 client.26104 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:13.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.426+0000 7f4214aa2740 1 -- 172.21.15.22:0/2532363061 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a05399c830 con 0x55a053a3fff0 2024-08-20T01:38:13.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.426+0000 7f420bfff640 1 --2- 172.21.15.22:0/2532363061 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a053a3fff0 0x55a053a423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:13.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.426+0000 7f420bfff640 1 --2- 172.21.15.22:0/2532363061 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a053a3fff0 0x55a053a423e0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae6df98ab27ec1a5 server_cookie=faa056b6febc891d in_seq=0 out_seq=0 2024-08-20T01:38:13.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.426+0000 7f41eb7fe640 10 client.26104 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:13.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.427+0000 7f41eb7fe640 1 -- 172.21.15.22:0/2532363061 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a05399c830 con 0x55a053a3fff0 2024-08-20T01:38:13.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.427+0000 7f41eb7fe640 10 client.26104 handle_command_reply: tid=0 2024-08-20T01:38:13.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.427+0000 7f4214aa2740 1 client.26104 shutdown 2024-08-20T01:38:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.427+0000 7f4214aa2740 1 -- 172.21.15.22:0/2532363061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a300e0 msgr2=0x55a053a2db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.427+0000 7f4214aa2740 1 --2- 172.21.15.22:0/2532363061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a300e0 0x55a053a2db00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4200003e90 tx=0x7f4200009680 comp rx=0 tx=0).stop 2024-08-20T01:38:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.427+0000 7f4214aa2740 1 -- 172.21.15.22:0/2532363061 shutdown_connections 2024-08-20T01:38:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.427+0000 7f4214aa2740 1 --2- 172.21.15.22:0/2532363061 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a053a3fff0 0x55a053a423e0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.427+0000 7f4214aa2740 1 --2- 172.21.15.22:0/2532363061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a300e0 0x55a053a2db00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.427+0000 7f4214aa2740 1 --2- 172.21.15.22:0/2532363061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a24150 0x55a053a2d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.427+0000 7f41eb7fe640 0 client.26104 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.427+0000 7f4214aa2740 1 --2- 172.21.15.22:0/2532363061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a23830 0x55a053a2d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.427+0000 7f4214aa2740 1 -- 172.21.15.22:0/2532363061 >> 172.21.15.22:0/2532363061 conn(0x55a053a21660 msgr2=0x55a053a27200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.427+0000 7f4214aa2740 1 -- 172.21.15.22:0/2532363061 shutdown_connections 2024-08-20T01:38:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.427+0000 7f4214aa2740 1 -- 172.21.15.22:0/2532363061 wait complete. 2024-08-20T01:38:13.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.427+0000 7f4214aa2740 20 client.26104 trim_cache size 0 max 16384 2024-08-20T01:38:13.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.446+0000 7f4214aa2740 1 Processor -- start 2024-08-20T01:38:13.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.446+0000 7f4214aa2740 1 -- start start 2024-08-20T01:38:13.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.446+0000 7f4214aa2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a23830 0x55a053a2edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:13.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.446+0000 7f4214aa2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a24150 0x55a053a47c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.446+0000 7f4214aa2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a300e0 0x55a053a481d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.446+0000 7f4214aa2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1ae9a0 con 0x55a053a24150 2024-08-20T01:38:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.446+0000 7f4214aa2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1ac1b0 con 0x55a053a300e0 2024-08-20T01:38:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.446+0000 7f4214aa2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1aa000 con 0x55a053a23830 2024-08-20T01:38:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.446+0000 7f420b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a23830 0x55a053a2edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.446+0000 7f420b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a23830 0x55a053a2edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:49858/0 (socket says 172.21.15.22:49858) 2024-08-20T01:38:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.446+0000 7f420b7fe640 1 -- 172.21.15.22:0/2384769734 learned_addr learned my addr 172.21.15.22:0/2384769734 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.446+0000 7f420b7fe640 1 --2- 172.21.15.22:0/2384769734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a300e0 0x55a053a481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.447+0000 7f420bfff640 1 --2- 172.21.15.22:0/2384769734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a24150 0x55a053a47c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.447+0000 7f420b7fe640 1 -- 172.21.15.22:0/2384769734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a300e0 msgr2=0x55a053a481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.447+0000 7f420b7fe640 1 --2- 172.21.15.22:0/2384769734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a300e0 0x55a053a481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.447+0000 7f420b7fe640 1 -- 172.21.15.22:0/2384769734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a24150 msgr2=0x55a053a47c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:13.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.447+0000 7f420b7fe640 1 --2- 172.21.15.22:0/2384769734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a24150 0x55a053a47c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.447+0000 7f420b7fe640 1 -- 172.21.15.22:0/2384769734 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a053a2b580 con 0x55a053a23830 2024-08-20T01:38:13.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.447+0000 7f420b7fe640 1 --2- 172.21.15.22:0/2384769734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a23830 0x55a053a2edc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4200057870 tx=0x7f4200032c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d896a22f308c9ee3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:13.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.447+0000 7f41f1ffb640 1 -- 172.21.15.22:0/2384769734 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200035040 con 0x55a053a23830 2024-08-20T01:38:13.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.447+0000 7f41f1ffb640 1 -- 172.21.15.22:0/2384769734 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4200057e40 con 0x55a053a23830 2024-08-20T01:38:13.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.447+0000 7f41f1ffb640 1 -- 172.21.15.22:0/2384769734 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420003d690 con 0x55a053a23830 2024-08-20T01:38:13.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.448+0000 7f4214aa2740 1 -- 172.21.15.22:0/2384769734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a23830 msgr2=0x55a053a2edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:13.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.448+0000 7f4214aa2740 1 --2- 172.21.15.22:0/2384769734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a23830 0x55a053a2edc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4200057870 tx=0x7f4200032c90 comp rx=0 tx=0).stop 2024-08-20T01:38:13.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.448+0000 7f4214aa2740 1 -- 172.21.15.22:0/2384769734 shutdown_connections 2024-08-20T01:38:13.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.448+0000 7f4214aa2740 1 --2- 172.21.15.22:0/2384769734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a300e0 0x55a053a481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.448+0000 7f4214aa2740 1 --2- 172.21.15.22:0/2384769734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a24150 0x55a053a47c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.448+0000 7f4214aa2740 1 --2- 172.21.15.22:0/2384769734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a23830 0x55a053a2edc0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.448+0000 7f4214aa2740 1 -- 172.21.15.22:0/2384769734 >> 172.21.15.22:0/2384769734 conn(0x55a053a21660 msgr2=0x55a053a2e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:13.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.448+0000 7f4214aa2740 1 -- 172.21.15.22:0/2384769734 shutdown_connections 2024-08-20T01:38:13.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.448+0000 7f4214aa2740 1 -- 172.21.15.22:0/2384769734 wait complete. 2024-08-20T01:38:13.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.449+0000 7f4214aa2740 1 -- start start 2024-08-20T01:38:13.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.449+0000 7f4214aa2740 1 Processor -- start 2024-08-20T01:38:13.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.449+0000 7f4214aa2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a23830 0x55a053a32fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:13.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.449+0000 7f4214aa2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a24150 0x55a053a33520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:13.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.449+0000 7f4214aa2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a300e0 0x55a053a33a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:13.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.449+0000 7f4214aa2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1aa670 con 0x55a053a24150 2024-08-20T01:38:13.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.449+0000 7f4214aa2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1abae0 con 0x55a053a300e0 2024-08-20T01:38:13.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.449+0000 7f4214aa2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1aad40 con 0x55a053a23830 2024-08-20T01:38:13.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.449+0000 7f4214aa2740 10 client.0 _ll_register_callbacks cb 0x7f4200003d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:13.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.449+0000 7f420bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a24150 0x55a053a33520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:13.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.449+0000 7f420b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a23830 0x55a053a32fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:13.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.449+0000 7f420bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a24150 0x55a053a33520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38180/0 (socket says 172.21.15.22:38180) 2024-08-20T01:38:13.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.449+0000 7f420bfff640 1 -- 172.21.15.22:0/1902571420 learned_addr learned my addr 172.21.15.22:0/1902571420 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:13.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.449+0000 7f420b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a23830 0x55a053a32fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:49872/0 (socket says 172.21.15.22:49872) 2024-08-20T01:38:13.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.450+0000 7f420b7fe640 1 --2- 172.21.15.22:0/1902571420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a300e0 0x55a053a33a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:13.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.450+0000 7f420b7fe640 1 -- 172.21.15.22:0/1902571420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a300e0 msgr2=0x55a053a33a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:13.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.450+0000 7f420b7fe640 1 --2- 172.21.15.22:0/1902571420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a300e0 0x55a053a33a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.450+0000 7f420b7fe640 1 -- 172.21.15.22:0/1902571420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a24150 msgr2=0x55a053a33520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:13.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.450+0000 7f420b7fe640 1 --2- 172.21.15.22:0/1902571420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a24150 0x55a053a33520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.450+0000 7f420b7fe640 1 -- 172.21.15.22:0/1902571420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a053aa8db0 con 0x55a053a23830 2024-08-20T01:38:13.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.450+0000 7f420bfff640 1 --2- 172.21.15.22:0/1902571420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a24150 0x55a053a33520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:13.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.450+0000 7f420b7fe640 1 --2- 172.21.15.22:0/1902571420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a23830 0x55a053a32fe0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4200009400 tx=0x7f42000039f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b676fabd20b5f9fc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:13.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.450+0000 7f41eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:38:13.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.450+0000 7f41eb7fe640 1 -- 172.21.15.22:0/1902571420 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200035040 con 0x55a053a23830 2024-08-20T01:38:13.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.450+0000 7f41eb7fe640 1 -- 172.21.15.22:0/1902571420 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f420003d800 con 0x55a053a23830 2024-08-20T01:38:13.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.450+0000 7f4214aa2740 1 -- 172.21.15.22:0/1902571420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a0539982d0 con 0x55a053a23830 2024-08-20T01:38:13.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.450+0000 7f41eb7fe640 1 -- 172.21.15.22:0/1902571420 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4200032d40 con 0x55a053a23830 2024-08-20T01:38:13.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.450+0000 7f4214aa2740 10 client.26110 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:13.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.450+0000 7f4214aa2740 1 -- 172.21.15.22:0/1902571420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a053aaa0a0 con 0x55a053a23830 2024-08-20T01:38:13.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.451+0000 7f41eb7fe640 1 -- 172.21.15.22:0/1902571420 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a0539982d0 con 0x55a053a23830 2024-08-20T01:38:13.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.451+0000 7f41eb7fe640 1 -- 172.21.15.22:0/1902571420 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f4200048070 con 0x55a053a23830 2024-08-20T01:38:13.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.451+0000 7f4214aa2740 10 client.26110 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:13.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.451+0000 7f4214aa2740 10 client.26110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:38:13.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.451+0000 7f4214aa2740 20 client.26110 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:13.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.451+0000 7f4214aa2740 1 --2- 172.21.15.22:0/1902571420 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a053aaa680 0x55a053aacaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:13.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.451+0000 7f4214aa2740 4 client.26110 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:38:13.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.451+0000 7f4214aa2740 1 -- 172.21.15.22:0/1902571420 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a053995a10 con 0x55a053aaa680 2024-08-20T01:38:13.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.451+0000 7f420bfff640 1 --2- 172.21.15.22:0/1902571420 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a053aaa680 0x55a053aacaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:13.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.452+0000 7f420bfff640 1 --2- 172.21.15.22:0/1902571420 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a053aaa680 0x55a053aacaa0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d91cacf6eecfd397 server_cookie=da4f907cd1f32b8e in_seq=0 out_seq=0 2024-08-20T01:38:13.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.452+0000 7f41eb7fe640 10 client.26110 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:13.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.452+0000 7f41eb7fe640 1 -- 172.21.15.22:0/1902571420 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a053995a10 con 0x55a053aaa680 2024-08-20T01:38:13.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.452+0000 7f41eb7fe640 10 client.26110 handle_command_reply: tid=0 2024-08-20T01:38:13.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.452+0000 7f4214aa2740 1 client.26110 shutdown 2024-08-20T01:38:13.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.452+0000 7f4214aa2740 1 -- 172.21.15.22:0/1902571420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a23830 msgr2=0x55a053a32fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:13.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.452+0000 7f4214aa2740 1 --2- 172.21.15.22:0/1902571420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a23830 0x55a053a32fe0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4200009400 tx=0x7f42000039f0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.452+0000 7f4214aa2740 1 -- 172.21.15.22:0/1902571420 shutdown_connections 2024-08-20T01:38:13.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.452+0000 7f4214aa2740 1 --2- 172.21.15.22:0/1902571420 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a053aaa680 0x55a053aacaa0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.452+0000 7f4214aa2740 1 --2- 172.21.15.22:0/1902571420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a053a300e0 0x55a053a33a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.452+0000 7f4214aa2740 1 --2- 172.21.15.22:0/1902571420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a053a24150 0x55a053a33520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.452+0000 7f41eb7fe640 0 client.26110 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:13.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.452+0000 7f4214aa2740 1 --2- 172.21.15.22:0/1902571420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a053a23830 0x55a053a32fe0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.452+0000 7f4214aa2740 1 -- 172.21.15.22:0/1902571420 >> 172.21.15.22:0/1902571420 conn(0x55a053a21660 msgr2=0x55a053a2eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:13.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.452+0000 7f4214aa2740 1 -- 172.21.15.22:0/1902571420 shutdown_connections 2024-08-20T01:38:13.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.452+0000 7f4214aa2740 1 -- 172.21.15.22:0/1902571420 wait complete. 2024-08-20T01:38:13.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.452+0000 7f4214aa2740 20 client.26110 trim_cache size 0 max 16384 2024-08-20T01:38:13.458 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:38:13.459 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-08-20T01:38:13.459 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-08-20T01:38:13.459 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:38:13.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.453+0000 7f42126a9640 1 -- 172.21.15.22:0/2182654142 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f41f40b3bd0 msgr2=0x7f41f40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:13.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.453+0000 7f42126a9640 1 --2- 172.21.15.22:0/2182654142 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f41f40b3bd0 0x7f41f40b6090 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f42040e1cb0 tx=0x7f420400cf90 comp rx=0 tx=0).stop 2024-08-20T01:38:13.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.453+0000 7f42126a9640 1 -- 172.21.15.22:0/2182654142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f420c10ce40 msgr2=0x7f420c19e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:13.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.453+0000 7f42126a9640 1 --2- 172.21.15.22:0/2182654142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f420c10ce40 0x7f420c19e880 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4204005fd0 tx=0x7f420400ef10 comp rx=0 tx=0).stop 2024-08-20T01:38:13.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.453+0000 7f42126a9640 1 -- 172.21.15.22:0/2182654142 shutdown_connections 2024-08-20T01:38:13.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.453+0000 7f42126a9640 1 --2- 172.21.15.22:0/2182654142 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f41f40b3bd0 0x7f41f40b6090 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.453+0000 7f42126a9640 1 --2- 172.21.15.22:0/2182654142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f420c10ce40 0x7f420c19e880 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.453+0000 7f42126a9640 1 --2- 172.21.15.22:0/2182654142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f420c104290 0x7f420c1994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.453+0000 7f42126a9640 1 --2- 172.21.15.22:0/2182654142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f420c103890 0x7f420c198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:13.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.453+0000 7f42126a9640 1 -- 172.21.15.22:0/2182654142 >> 172.21.15.22:0/2182654142 conn(0x7f420c0fd400 msgr2=0x7f420c0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:13.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.453+0000 7f42126a9640 1 -- 172.21.15.22:0/2182654142 shutdown_connections 2024-08-20T01:38:13.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:13.453+0000 7f42126a9640 1 -- 172.21.15.22:0/2182654142 wait complete. 2024-08-20T01:38:14.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:14 smithi022 ceph-mon[18709]: pgmap v559: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.0 MiB/s wr, 1.98k op/s 2024-08-20T01:38:15.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:14 smithi134 ceph-mon[22511]: pgmap v559: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.0 MiB/s wr, 1.98k op/s 2024-08-20T01:38:15.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:14 smithi077 ceph-mon[22251]: pgmap v559: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.0 MiB/s wr, 1.98k op/s 2024-08-20T01:38:15.229 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:38:15.229 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:38:15.500 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.254+0000 7ff38c3a8640 1 -- 172.21.15.22:0/3686267829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff384102ad0 msgr2=0x7ff384102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.254+0000 7ff38c3a8640 1 --2- 172.21.15.22:0/3686267829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff384102ad0 0x7ff384102eb0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff380009900 tx=0x7ff38002a410 comp rx=0 tx=0).stop 2024-08-20T01:38:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.254+0000 7ff38c3a8640 1 -- 172.21.15.22:0/3686267829 shutdown_connections 2024-08-20T01:38:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.254+0000 7ff38c3a8640 1 --2- 172.21.15.22:0/3686267829 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff384108e60 0x7ff38410f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.254+0000 7ff38c3a8640 1 --2- 172.21.15.22:0/3686267829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3841084e0 0x7ff384108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.254+0000 7ff38c3a8640 1 --2- 172.21.15.22:0/3686267829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff384102ad0 0x7ff384102eb0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.254+0000 7ff38c3a8640 1 -- 172.21.15.22:0/3686267829 >> 172.21.15.22:0/3686267829 conn(0x7ff3840fe540 msgr2=0x7ff384100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.254+0000 7ff38c3a8640 1 -- 172.21.15.22:0/3686267829 shutdown_connections 2024-08-20T01:38:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.254+0000 7ff38c3a8640 1 -- 172.21.15.22:0/3686267829 wait complete. 2024-08-20T01:38:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.254+0000 7ff38c3a8640 1 Processor -- start 2024-08-20T01:38:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.254+0000 7ff38c3a8640 1 -- start start 2024-08-20T01:38:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.255+0000 7ff38c3a8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff384102ad0 0x7ff384198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.255+0000 7ff38c3a8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3841084e0 0x7ff384199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.255+0000 7ff38c3a8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff384108e60 0x7ff38419e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.255+0000 7ff38c3a8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff384112b70 con 0x7ff3841084e0 2024-08-20T01:38:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.255+0000 7ff38c3a8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff3841129f0 con 0x7ff384102ad0 2024-08-20T01:38:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.255+0000 7ff38c3a8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff384112cf0 con 0x7ff384108e60 2024-08-20T01:38:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.255+0000 7ff38a144640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff384102ad0 0x7ff384198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.255+0000 7ff389943640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3841084e0 0x7ff384199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.255+0000 7ff38a144640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff384102ad0 0x7ff384198fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:37108/0 (socket says 172.21.15.22:37108) 2024-08-20T01:38:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.255+0000 7ff38a144640 1 -- 172.21.15.22:0/632757811 learned_addr learned my addr 172.21.15.22:0/632757811 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.255+0000 7ff38a945640 1 --2- 172.21.15.22:0/632757811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff384108e60 0x7ff38419e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.255+0000 7ff38a144640 1 -- 172.21.15.22:0/632757811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff384108e60 msgr2=0x7ff38419e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.255+0000 7ff38a144640 1 --2- 172.21.15.22:0/632757811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff384108e60 0x7ff38419e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.255+0000 7ff38a144640 1 -- 172.21.15.22:0/632757811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3841084e0 msgr2=0x7ff384199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.255+0000 7ff38a144640 1 --2- 172.21.15.22:0/632757811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3841084e0 0x7ff384199500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.255+0000 7ff38a144640 1 -- 172.21.15.22:0/632757811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38419f070 con 0x7ff384102ad0 2024-08-20T01:38:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.255+0000 7ff389943640 1 --2- 172.21.15.22:0/632757811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3841084e0 0x7ff384199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.255+0000 7ff38a144640 1 --2- 172.21.15.22:0/632757811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff384102ad0 0x7ff384198fc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff380005ab0 tx=0x7ff380003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.256+0000 7ff37b7fe640 1 -- 172.21.15.22:0/632757811 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38003f070 con 0x7ff384102ad0 2024-08-20T01:38:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.256+0000 7ff38c3a8640 1 -- 172.21.15.22:0/632757811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff38419f300 con 0x7ff384102ad0 2024-08-20T01:38:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.256+0000 7ff37b7fe640 1 -- 172.21.15.22:0/632757811 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff380031d60 con 0x7ff384102ad0 2024-08-20T01:38:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.256+0000 7ff37b7fe640 1 -- 172.21.15.22:0/632757811 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff380035030 con 0x7ff384102ad0 2024-08-20T01:38:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.256+0000 7ff38c3a8640 1 -- 172.21.15.22:0/632757811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3841a5a20 con 0x7ff384102ad0 2024-08-20T01:38:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.257+0000 7ff38c3a8640 1 -- 172.21.15.22:0/632757811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff384102eb0 con 0x7ff384102ad0 2024-08-20T01:38:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.258+0000 7ff37b7fe640 1 -- 172.21.15.22:0/632757811 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff380042070 con 0x7ff384102ad0 2024-08-20T01:38:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.259+0000 7ff37b7fe640 1 --2- 172.21.15.22:0/632757811 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff3700b3bd0 0x7ff3700b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.259+0000 7ff389943640 1 --2- 172.21.15.22:0/632757811 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff3700b3bd0 0x7ff3700b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.259+0000 7ff37b7fe640 1 -- 172.21.15.22:0/632757811 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ff380104ad0 con 0x7ff384102ad0 2024-08-20T01:38:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.259+0000 7ff389943640 1 --2- 172.21.15.22:0/632757811 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff3700b3bd0 0x7ff3700b6090 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff384107f90 tx=0x7ff37400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.262+0000 7ff37b7fe640 1 -- 172.21.15.22:0/632757811 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff3800cba30 con 0x7ff384102ad0 2024-08-20T01:38:16.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.497+0000 7ff38c3a8640 1 -- 172.21.15.22:0/632757811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3841a5d10 con 0x7ff384102ad0 2024-08-20T01:38:16.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.497+0000 7ff37b7fe640 1 -- 172.21.15.22:0/632757811 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11915 (secure 0 0 0) 0x7ff3800cff80 con 0x7ff384102ad0 2024-08-20T01:38:16.500 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:38:16.500 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":31,"btime":"2024-08-20T01:36:38:097249+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:36:37.446760+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24586,24575,24565]},"id":1}]} 2024-08-20T01:38:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 31 2024-08-20T01:38:16.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.500+0000 7ff38c3a8640 1 -- 172.21.15.22:0/632757811 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff3700b3bd0 msgr2=0x7ff3700b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:16.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.500+0000 7ff38c3a8640 1 --2- 172.21.15.22:0/632757811 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff3700b3bd0 0x7ff3700b6090 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff384107f90 tx=0x7ff37400b410 comp rx=0 tx=0).stop 2024-08-20T01:38:16.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.500+0000 7ff38c3a8640 1 -- 172.21.15.22:0/632757811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff384102ad0 msgr2=0x7ff384198fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:16.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.500+0000 7ff38c3a8640 1 --2- 172.21.15.22:0/632757811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff384102ad0 0x7ff384198fc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff380005ab0 tx=0x7ff380003cd0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.500+0000 7ff38c3a8640 1 -- 172.21.15.22:0/632757811 shutdown_connections 2024-08-20T01:38:16.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.500+0000 7ff38c3a8640 1 --2- 172.21.15.22:0/632757811 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff3700b3bd0 0x7ff3700b6090 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.500+0000 7ff38c3a8640 1 --2- 172.21.15.22:0/632757811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff384108e60 0x7ff38419e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.500+0000 7ff38c3a8640 1 --2- 172.21.15.22:0/632757811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3841084e0 0x7ff384199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.500+0000 7ff38c3a8640 1 --2- 172.21.15.22:0/632757811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff384102ad0 0x7ff384198fc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.500+0000 7ff38c3a8640 1 -- 172.21.15.22:0/632757811 >> 172.21.15.22:0/632757811 conn(0x7ff3840fe540 msgr2=0x7ff3840ffe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:16.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.500+0000 7ff38c3a8640 1 -- 172.21.15.22:0/632757811 shutdown_connections 2024-08-20T01:38:16.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:16.500+0000 7ff38c3a8640 1 -- 172.21.15.22:0/632757811 wait complete. 2024-08-20T01:38:16.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:16 smithi022 ceph-mon[18709]: pgmap v560: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.1 MiB/s wr, 1.91k op/s 2024-08-20T01:38:16.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:16 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/632757811' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:38:17.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:16 smithi134 ceph-mon[22511]: pgmap v560: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.1 MiB/s wr, 1.91k op/s 2024-08-20T01:38:17.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:16 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/632757811' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:38:17.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:16 smithi077 ceph-mon[22251]: pgmap v560: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.1 MiB/s wr, 1.91k op/s 2024-08-20T01:38:17.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:16 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/632757811' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:38:17.215 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:38:17.482 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.009+0000 7fee48a36640 1 -- 172.21.15.22:0/4211085550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee44101520 msgr2=0x7fee44101900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.009+0000 7fee48a36640 1 --2- 172.21.15.22:0/4211085550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee44101520 0x7fee44101900 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fee34009900 tx=0x7fee3402a3f0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.009+0000 7fee48a36640 1 -- 172.21.15.22:0/4211085550 shutdown_connections 2024-08-20T01:38:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.009+0000 7fee48a36640 1 --2- 172.21.15.22:0/4211085550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee441074d0 0x7fee4410dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.009+0000 7fee48a36640 1 --2- 172.21.15.22:0/4211085550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee44106b50 0x7fee44106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.009+0000 7fee48a36640 1 --2- 172.21.15.22:0/4211085550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee44101520 0x7fee44101900 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.009+0000 7fee48a36640 1 -- 172.21.15.22:0/4211085550 >> 172.21.15.22:0/4211085550 conn(0x7fee44076c80 msgr2=0x7fee44077090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.009+0000 7fee48a36640 1 -- 172.21.15.22:0/4211085550 shutdown_connections 2024-08-20T01:38:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.009+0000 7fee48a36640 1 -- 172.21.15.22:0/4211085550 wait complete. 2024-08-20T01:38:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.010+0000 7fee48a36640 1 Processor -- start 2024-08-20T01:38:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.010+0000 7fee48a36640 1 -- start start 2024-08-20T01:38:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.010+0000 7fee48a36640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee44101520 0x7fee44199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.010+0000 7fee48a36640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee44106b50 0x7fee44199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.010+0000 7fee48a36640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee441074d0 0x7fee4419e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.010+0000 7fee48a36640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fee44112b00 con 0x7fee441074d0 2024-08-20T01:38:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.010+0000 7fee48a36640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fee44112980 con 0x7fee44101520 2024-08-20T01:38:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.010+0000 7fee48a36640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fee44112c80 con 0x7fee44106b50 2024-08-20T01:38:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.011+0000 7fee4259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee44101520 0x7fee44199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.011+0000 7fee4259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee44101520 0x7fee44199030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:37124/0 (socket says 172.21.15.22:37124) 2024-08-20T01:38:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.011+0000 7fee42d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee441074d0 0x7fee4419e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.011+0000 7fee4259c640 1 -- 172.21.15.22:0/997546694 learned_addr learned my addr 172.21.15.22:0/997546694 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.011+0000 7fee41d9b640 1 --2- 172.21.15.22:0/997546694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee44106b50 0x7fee44199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.011+0000 7fee4259c640 1 -- 172.21.15.22:0/997546694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee44106b50 msgr2=0x7fee44199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:18.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.011+0000 7fee4259c640 1 --2- 172.21.15.22:0/997546694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee44106b50 0x7fee44199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.011+0000 7fee4259c640 1 -- 172.21.15.22:0/997546694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee441074d0 msgr2=0x7fee4419e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:18.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.011+0000 7fee4259c640 1 --2- 172.21.15.22:0/997546694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee441074d0 0x7fee4419e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.011+0000 7fee4259c640 1 -- 172.21.15.22:0/997546694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee4419f0e0 con 0x7fee44101520 2024-08-20T01:38:18.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.011+0000 7fee41d9b640 1 --2- 172.21.15.22:0/997546694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee44106b50 0x7fee44199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:18.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.011+0000 7fee42d9d640 1 --2- 172.21.15.22:0/997546694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee441074d0 0x7fee4419e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:18.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.011+0000 7fee4259c640 1 --2- 172.21.15.22:0/997546694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee44101520 0x7fee44199030 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fee34005940 tx=0x7fee340042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:18.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.011+0000 7fee337fe640 1 -- 172.21.15.22:0/997546694 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3403f030 con 0x7fee44101520 2024-08-20T01:38:18.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.011+0000 7fee48a36640 1 -- 172.21.15.22:0/997546694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee4419f370 con 0x7fee44101520 2024-08-20T01:38:18.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.011+0000 7fee337fe640 1 -- 172.21.15.22:0/997546694 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee34003cb0 con 0x7fee44101520 2024-08-20T01:38:18.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.011+0000 7fee337fe640 1 -- 172.21.15.22:0/997546694 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee34035070 con 0x7fee44101520 2024-08-20T01:38:18.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.011+0000 7fee48a36640 1 -- 172.21.15.22:0/997546694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee441a5a90 con 0x7fee44101520 2024-08-20T01:38:18.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.014+0000 7fee4ae2f740 1 Processor -- start 2024-08-20T01:38:18.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.014+0000 7fee4ae2f740 1 -- start start 2024-08-20T01:38:18.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.014+0000 7fee337fe640 1 -- 172.21.15.22:0/997546694 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fee34042030 con 0x7fee44101520 2024-08-20T01:38:18.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.014+0000 7fee4ae2f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ad9f3880 0x5555ad9f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:18.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.014+0000 7fee4ae2f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f41a0 0x5555ada04000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:18.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.015+0000 7fee4ae2f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ada04540 0x5555ada06930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:18.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.015+0000 7fee4ae2f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5555ad96a930 con 0x5555ad9f41a0 2024-08-20T01:38:18.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.015+0000 7fee4ae2f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5555ad959e30 con 0x5555ad9f3880 2024-08-20T01:38:18.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.015+0000 7fee4ae2f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5555ad95de70 con 0x5555ada04540 2024-08-20T01:38:18.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.015+0000 7fee42d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ad9f3880 0x5555ad9f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:18.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.015+0000 7fee4259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f41a0 0x5555ada04000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:18.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.015+0000 7fee42d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ad9f3880 0x5555ad9f3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:37138/0 (socket says 172.21.15.22:37138) 2024-08-20T01:38:18.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.015+0000 7fee42d9d640 1 -- 172.21.15.22:0/1206494490 learned_addr learned my addr 172.21.15.22:0/1206494490 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:18.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.015+0000 7fee41d9b640 1 --2- 172.21.15.22:0/1206494490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ada04540 0x5555ada06930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:18.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.015+0000 7fee42d9d640 1 -- 172.21.15.22:0/1206494490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ada04540 msgr2=0x5555ada06930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:18.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.015+0000 7fee42d9d640 1 --2- 172.21.15.22:0/1206494490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ada04540 0x5555ada06930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.015+0000 7fee42d9d640 1 -- 172.21.15.22:0/1206494490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f41a0 msgr2=0x5555ada04000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:18.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.015+0000 7fee42d9d640 1 --2- 172.21.15.22:0/1206494490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f41a0 0x5555ada04000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.015+0000 7fee42d9d640 1 -- 172.21.15.22:0/1206494490 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555ad6b9650 con 0x5555ad9f3880 2024-08-20T01:38:18.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.016+0000 7fee42d9d640 1 --2- 172.21.15.22:0/1206494490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ad9f3880 0x5555ad9f3c60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fee3c010750 tx=0x7fee3c010c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16494e63f44e2d6b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:18.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.016+0000 7fee337fe640 1 --2- 172.21.15.22:0/997546694 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fee2c0b3c50 0x7fee2c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:18.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.016+0000 7fee4259c640 1 --2- 172.21.15.22:0/997546694 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fee2c0b3c50 0x7fee2c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:18.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.016+0000 7fee337fe640 1 -- 172.21.15.22:0/997546694 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fee34104480 con 0x7fee44101520 2024-08-20T01:38:18.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.016+0000 7fee30ff9640 1 -- 172.21.15.22:0/1206494490 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3c00ead0 con 0x5555ad9f3880 2024-08-20T01:38:18.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.016+0000 7fee30ff9640 1 -- 172.21.15.22:0/1206494490 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee3c010e60 con 0x5555ad9f3880 2024-08-20T01:38:18.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.016+0000 7fee30ff9640 1 -- 172.21.15.22:0/1206494490 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3c011640 con 0x5555ad9f3880 2024-08-20T01:38:18.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.017+0000 7fee4ae2f740 1 -- 172.21.15.22:0/1206494490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ad9f3880 msgr2=0x5555ad9f3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:18.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.017+0000 7fee4259c640 1 --2- 172.21.15.22:0/997546694 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fee2c0b3c50 0x7fee2c0b6110 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x5555ad9f6a00 tx=0x7fee34109040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:18.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.017+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/1206494490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ad9f3880 0x5555ad9f3c60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fee3c010750 tx=0x7fee3c010c10 comp rx=0 tx=0).stop 2024-08-20T01:38:18.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.017+0000 7fee4ae2f740 1 -- 172.21.15.22:0/1206494490 shutdown_connections 2024-08-20T01:38:18.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.017+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/1206494490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ada04540 0x5555ada06930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.017+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/1206494490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f41a0 0x5555ada04000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.017+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/1206494490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ad9f3880 0x5555ad9f3c60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.017+0000 7fee4ae2f740 1 -- 172.21.15.22:0/1206494490 >> 172.21.15.22:0/1206494490 conn(0x5555ad9f16b0 msgr2=0x5555ad9f2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.017+0000 7fee4ae2f740 1 -- 172.21.15.22:0/1206494490 shutdown_connections 2024-08-20T01:38:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.017+0000 7fee4ae2f740 1 -- 172.21.15.22:0/1206494490 wait complete. 2024-08-20T01:38:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.017+0000 7fee4ae2f740 1 -- start start 2024-08-20T01:38:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.018+0000 7fee4ae2f740 1 Processor -- start 2024-08-20T01:38:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.018+0000 7fee4ae2f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f3880 0x5555ada03f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.018+0000 7fee4ae2f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ad9f41a0 0x5555ada013b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.018+0000 7fee4ae2f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ada04540 0x5555ada01b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.018+0000 7fee4ae2f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5555ad7bc700 con 0x5555ad9f3880 2024-08-20T01:38:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.018+0000 7fee4ae2f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5555ad8e0810 con 0x5555ada04540 2024-08-20T01:38:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.018+0000 7fee4ae2f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5555ada071f0 con 0x5555ad9f41a0 2024-08-20T01:38:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.018+0000 7fee4ae2f740 10 client.0 _ll_register_callbacks cb 0x5555ad953700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:18.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.018+0000 7fee42d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f3880 0x5555ada03f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:18.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.018+0000 7fee41d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ad9f41a0 0x5555ada013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:18.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.018+0000 7fee42d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f3880 0x5555ada03f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38222/0 (socket says 172.21.15.22:38222) 2024-08-20T01:38:18.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.018+0000 7fee42d9d640 1 -- 172.21.15.22:0/3336642073 learned_addr learned my addr 172.21.15.22:0/3336642073 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:18.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.018+0000 7fee42d9d640 1 --2- 172.21.15.22:0/3336642073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ada04540 0x5555ada01b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:18.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.019+0000 7fee41d9b640 1 -- 172.21.15.22:0/3336642073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ada04540 msgr2=0x5555ada01b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:18.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.019+0000 7fee41d9b640 1 --2- 172.21.15.22:0/3336642073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ada04540 0x5555ada01b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.019+0000 7fee41d9b640 1 -- 172.21.15.22:0/3336642073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f3880 msgr2=0x5555ada03f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:18.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.019+0000 7fee41d9b640 1 --2- 172.21.15.22:0/3336642073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f3880 0x5555ada03f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.019+0000 7fee41d9b640 1 -- 172.21.15.22:0/3336642073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555ada10580 con 0x5555ad9f41a0 2024-08-20T01:38:18.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.019+0000 7fee42d9d640 1 --2- 172.21.15.22:0/3336642073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f3880 0x5555ada03f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:18.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.019+0000 7fee41d9b640 1 --2- 172.21.15.22:0/3336642073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ad9f41a0 0x5555ada013b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fee44106140 tx=0x7fee380117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7a18b829f19daf4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:18.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.019+0000 7fee29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:38:18.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.019+0000 7fee29ffb640 1 -- 172.21.15.22:0/3336642073 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee38005220 con 0x5555ad9f41a0 2024-08-20T01:38:18.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.019+0000 7fee4ae2f740 1 -- 172.21.15.22:0/3336642073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5555ad909150 con 0x5555ad9f41a0 2024-08-20T01:38:18.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.019+0000 7fee29ffb640 1 -- 172.21.15.22:0/3336642073 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fee380053c0 con 0x5555ad9f41a0 2024-08-20T01:38:18.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.020+0000 7fee29ffb640 1 -- 172.21.15.22:0/3336642073 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fee380055c0 con 0x5555ad9f41a0 2024-08-20T01:38:18.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.020+0000 7fee4ae2f740 10 client.26128 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:18.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.020+0000 7fee4ae2f740 1 -- 172.21.15.22:0/3336642073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5555ada12ee0 con 0x5555ad9f41a0 2024-08-20T01:38:18.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.020+0000 7fee29ffb640 1 -- 172.21.15.22:0/3336642073 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5555ad909150 con 0x5555ad9f41a0 2024-08-20T01:38:18.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.020+0000 7fee29ffb640 1 -- 172.21.15.22:0/3336642073 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fee3801b8c0 con 0x5555ad9f41a0 2024-08-20T01:38:18.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.020+0000 7fee4ae2f740 10 client.26128 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:18.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.020+0000 7fee4ae2f740 10 client.26128 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:38:18.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.020+0000 7fee4ae2f740 20 client.26128 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:18.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.020+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/3336642073 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5555ada142f0 0x5555ada16700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:18.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.020+0000 7fee4ae2f740 4 client.26128 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:18.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.020+0000 7fee4ae2f740 1 -- 172.21.15.22:0/3336642073 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555ad96c880 con 0x5555ada142f0 2024-08-20T01:38:18.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.020+0000 7fee42d9d640 1 --2- 172.21.15.22:0/3336642073 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5555ada142f0 0x5555ada16700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:18.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.021+0000 7fee29ffb640 10 client.26128 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:38:18.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.021+0000 7fee42d9d640 1 --2- 172.21.15.22:0/3336642073 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5555ada142f0 0x5555ada16700 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a284f1c1022658af server_cookie=785b3a70794839b8 in_seq=0 out_seq=0 2024-08-20T01:38:18.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.021+0000 7fee29ffb640 1 -- 172.21.15.22:0/3336642073 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5555ad96c880 con 0x5555ada142f0 2024-08-20T01:38:18.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.021+0000 7fee29ffb640 10 client.26128 handle_command_reply: tid=0 2024-08-20T01:38:18.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.022+0000 7fee4ae2f740 1 client.26128 shutdown 2024-08-20T01:38:18.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.022+0000 7fee4ae2f740 1 -- 172.21.15.22:0/3336642073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ad9f41a0 msgr2=0x5555ada013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:18.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.022+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/3336642073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ad9f41a0 0x5555ada013b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fee44106140 tx=0x7fee380117b0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.022+0000 7fee4ae2f740 1 -- 172.21.15.22:0/3336642073 shutdown_connections 2024-08-20T01:38:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.022+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/3336642073 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5555ada142f0 0x5555ada16700 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.022+0000 7fee29ffb640 0 client.26128 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:38:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.022+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/3336642073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ada04540 0x5555ada01b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.022+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/3336642073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ad9f41a0 0x5555ada013b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.022+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/3336642073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f3880 0x5555ada03f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.022+0000 7fee4ae2f740 1 -- 172.21.15.22:0/3336642073 >> 172.21.15.22:0/3336642073 conn(0x5555ad9f16b0 msgr2=0x5555ad9f7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.022+0000 7fee4ae2f740 1 -- 172.21.15.22:0/3336642073 shutdown_connections 2024-08-20T01:38:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.022+0000 7fee4ae2f740 1 -- 172.21.15.22:0/3336642073 wait complete. 2024-08-20T01:38:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.022+0000 7fee4ae2f740 20 client.26128 trim_cache size 0 max 16384 2024-08-20T01:38:18.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.035+0000 7fee4ae2f740 1 Processor -- start 2024-08-20T01:38:18.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.035+0000 7fee4ae2f740 1 -- start start 2024-08-20T01:38:18.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.035+0000 7fee4ae2f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ad9f3880 0x5555ad9ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:18.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.035+0000 7fee4ae2f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f41a0 0x5555ada00170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:18.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.035+0000 7fee4ae2f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ada04540 0x5555ada1c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:18.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.035+0000 7fee4ae2f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fee441ae920 con 0x5555ad9f41a0 2024-08-20T01:38:18.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.035+0000 7fee4ae2f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fee441ac130 con 0x5555ad9f3880 2024-08-20T01:38:18.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.035+0000 7fee4ae2f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fee441a9f80 con 0x5555ada04540 2024-08-20T01:38:18.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.035+0000 7fee41d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f41a0 0x5555ada00170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:18.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.035+0000 7fee41d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f41a0 0x5555ada00170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38224/0 (socket says 172.21.15.22:38224) 2024-08-20T01:38:18.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.035+0000 7fee41d9b640 1 -- 172.21.15.22:0/2806782687 learned_addr learned my addr 172.21.15.22:0/2806782687 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:18.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.035+0000 7fee42d9d640 1 --2- 172.21.15.22:0/2806782687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ad9f3880 0x5555ad9ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:18.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.035+0000 7fee42d9d640 1 --2- 172.21.15.22:0/2806782687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ada04540 0x5555ada1c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:18.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.036+0000 7fee41d9b640 1 -- 172.21.15.22:0/2806782687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ada04540 msgr2=0x5555ada1c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:18.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.036+0000 7fee41d9b640 1 --2- 172.21.15.22:0/2806782687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ada04540 0x5555ada1c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.036+0000 7fee41d9b640 1 -- 172.21.15.22:0/2806782687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ad9f3880 msgr2=0x5555ad9ffc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:18.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.036+0000 7fee41d9b640 1 --2- 172.21.15.22:0/2806782687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ad9f3880 0x5555ad9ffc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.036+0000 7fee41d9b640 1 -- 172.21.15.22:0/2806782687 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555ada01eb0 con 0x5555ad9f41a0 2024-08-20T01:38:18.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.036+0000 7fee41d9b640 1 --2- 172.21.15.22:0/2806782687 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f41a0 0x5555ada00170 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fee3801bc90 tx=0x7fee3800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deee903a84c75738 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:18.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.036+0000 7fee2bfff640 1 -- 172.21.15.22:0/2806782687 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee38035070 con 0x5555ad9f41a0 2024-08-20T01:38:18.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.036+0000 7fee2bfff640 1 -- 172.21.15.22:0/2806782687 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee3802c040 con 0x5555ad9f41a0 2024-08-20T01:38:18.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.036+0000 7fee2bfff640 1 -- 172.21.15.22:0/2806782687 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee38012de0 con 0x5555ad9f41a0 2024-08-20T01:38:18.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.037+0000 7fee4ae2f740 1 -- 172.21.15.22:0/2806782687 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f41a0 msgr2=0x5555ada00170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:18.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.037+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/2806782687 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f41a0 0x5555ada00170 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fee3801bc90 tx=0x7fee3800b6a0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.037+0000 7fee4ae2f740 1 -- 172.21.15.22:0/2806782687 shutdown_connections 2024-08-20T01:38:18.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.037+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/2806782687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ada04540 0x5555ada1c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.037+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/2806782687 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f41a0 0x5555ada00170 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.037+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/2806782687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ad9f3880 0x5555ad9ffc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.037+0000 7fee4ae2f740 1 -- 172.21.15.22:0/2806782687 >> 172.21.15.22:0/2806782687 conn(0x5555ad9f16b0 msgr2=0x5555ada054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:18.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.037+0000 7fee4ae2f740 1 -- 172.21.15.22:0/2806782687 shutdown_connections 2024-08-20T01:38:18.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.037+0000 7fee4ae2f740 1 -- 172.21.15.22:0/2806782687 wait complete. 2024-08-20T01:38:18.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.037+0000 7fee4ae2f740 1 -- start start 2024-08-20T01:38:18.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.037+0000 7fee4ae2f740 1 Processor -- start 2024-08-20T01:38:18.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee4ae2f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f3880 0x5555ada0c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:18.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee4ae2f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ad9f41a0 0x5555ada0ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:18.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee4ae2f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ada04540 0x5555ad9f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:18.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee4ae2f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fee441aa5f0 con 0x5555ad9f3880 2024-08-20T01:38:18.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee4ae2f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fee441aba60 con 0x5555ad9f41a0 2024-08-20T01:38:18.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee4ae2f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fee441aacc0 con 0x5555ada04540 2024-08-20T01:38:18.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee4ae2f740 10 client.0 _ll_register_callbacks cb 0x7fee3800ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:18.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee42d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f3880 0x5555ada0c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:18.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee42d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f3880 0x5555ada0c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38232/0 (socket says 172.21.15.22:38232) 2024-08-20T01:38:18.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee42d9d640 1 -- 172.21.15.22:0/4216802317 learned_addr learned my addr 172.21.15.22:0/4216802317 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:18.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee41d9b640 1 --2- 172.21.15.22:0/4216802317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ad9f41a0 0x5555ada0ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:18.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee42d9d640 1 --2- 172.21.15.22:0/4216802317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ada04540 0x5555ad9f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:18.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee42d9d640 1 -- 172.21.15.22:0/4216802317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ada04540 msgr2=0x5555ad9f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:18.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee42d9d640 1 --2- 172.21.15.22:0/4216802317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ada04540 0x5555ad9f59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee42d9d640 1 -- 172.21.15.22:0/4216802317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ad9f41a0 msgr2=0x5555ada0ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:18.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee42d9d640 1 --2- 172.21.15.22:0/4216802317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ad9f41a0 0x5555ada0ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee42d9d640 1 -- 172.21.15.22:0/4216802317 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555ad9f61d0 con 0x5555ad9f3880 2024-08-20T01:38:18.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee41d9b640 1 --2- 172.21.15.22:0/4216802317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ad9f41a0 0x5555ada0ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:18.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee42d9d640 1 --2- 172.21.15.22:0/4216802317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f3880 0x5555ada0c770 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009eb0 tx=0x7fee3c010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a4bc70ec0fba60 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:18.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:38:18.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee29ffb640 1 -- 172.21.15.22:0/4216802317 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0049a0 con 0x5555ad9f3880 2024-08-20T01:38:18.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee29ffb640 1 -- 172.21.15.22:0/4216802317 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fee3c004b40 con 0x5555ad9f3880 2024-08-20T01:38:18.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.038+0000 7fee4ae2f740 1 -- 172.21.15.22:0/4216802317 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee3802c040 con 0x5555ad9f3880 2024-08-20T01:38:18.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.039+0000 7fee29ffb640 1 -- 172.21.15.22:0/4216802317 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fee3c004d40 con 0x5555ad9f3880 2024-08-20T01:38:18.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.039+0000 7fee4ae2f740 10 client.16488 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:18.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.039+0000 7fee4ae2f740 1 -- 172.21.15.22:0/4216802317 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5555ada1c230 con 0x5555ad9f3880 2024-08-20T01:38:18.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.039+0000 7fee29ffb640 1 -- 172.21.15.22:0/4216802317 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee3802c040 con 0x5555ad9f3880 2024-08-20T01:38:18.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.039+0000 7fee29ffb640 1 -- 172.21.15.22:0/4216802317 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fee3c00f040 con 0x5555ad9f3880 2024-08-20T01:38:18.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.039+0000 7fee4ae2f740 10 client.16488 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:18.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.039+0000 7fee4ae2f740 10 client.16488 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:38:18.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.039+0000 7fee4ae2f740 20 client.16488 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:18.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.039+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/4216802317 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5555ada7f030 0x5555ada81450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:18.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.039+0000 7fee4ae2f740 4 client.16488 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:38:18.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.039+0000 7fee4ae2f740 1 -- 172.21.15.22:0/4216802317 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5555ad968320 con 0x5555ada7f030 2024-08-20T01:38:18.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.039+0000 7fee41d9b640 1 --2- 172.21.15.22:0/4216802317 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5555ada7f030 0x5555ada81450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:18.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.040+0000 7fee41d9b640 1 --2- 172.21.15.22:0/4216802317 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5555ada7f030 0x5555ada81450 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=638751c483f6dea3 server_cookie=53bff0436d6f5a84 in_seq=0 out_seq=0 2024-08-20T01:38:18.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.040+0000 7fee29ffb640 10 client.16488 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:38:18.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.276+0000 7fee29ffb640 1 -- 172.21.15.22:0/4216802317 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5555ad968320 con 0x5555ada7f030 2024-08-20T01:38:18.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.276+0000 7fee29ffb640 10 client.16488 handle_command_reply: tid=0 2024-08-20T01:38:18.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.276+0000 7fee4ae2f740 1 client.16488 shutdown 2024-08-20T01:38:18.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.276+0000 7fee4ae2f740 1 -- 172.21.15.22:0/4216802317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f3880 msgr2=0x5555ada0c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:18.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.276+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/4216802317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f3880 0x5555ada0c770 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009eb0 tx=0x7fee3c010c10 comp rx=0 tx=0).stop 2024-08-20T01:38:18.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.276+0000 7fee4ae2f740 1 -- 172.21.15.22:0/4216802317 shutdown_connections 2024-08-20T01:38:18.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.276+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/4216802317 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5555ada7f030 0x5555ada81450 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.276+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/4216802317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555ada04540 0x5555ad9f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.276+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/4216802317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5555ad9f41a0 0x5555ada0ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.276+0000 7fee4ae2f740 1 --2- 172.21.15.22:0/4216802317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5555ad9f3880 0x5555ada0c770 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.276+0000 7fee29ffb640 0 client.16488 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:38:18.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.276+0000 7fee4ae2f740 1 -- 172.21.15.22:0/4216802317 >> 172.21.15.22:0/4216802317 conn(0x5555ad9f16b0 msgr2=0x5555ad9ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:18.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.276+0000 7fee4ae2f740 1 -- 172.21.15.22:0/4216802317 shutdown_connections 2024-08-20T01:38:18.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.276+0000 7fee4ae2f740 1 -- 172.21.15.22:0/4216802317 wait complete. 2024-08-20T01:38:18.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.276+0000 7fee4ae2f740 20 client.16488 trim_cache size 0 max 16384 2024-08-20T01:38:18.281 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:38:18.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.277+0000 7fee48a36640 1 -- 172.21.15.22:0/997546694 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fee2c0b3c50 msgr2=0x7fee2c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:18.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.277+0000 7fee48a36640 1 --2- 172.21.15.22:0/997546694 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fee2c0b3c50 0x7fee2c0b6110 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x5555ad9f6a00 tx=0x7fee34109040 comp rx=0 tx=0).stop 2024-08-20T01:38:18.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.277+0000 7fee48a36640 1 -- 172.21.15.22:0/997546694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee44101520 msgr2=0x7fee44199030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:18.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.277+0000 7fee48a36640 1 --2- 172.21.15.22:0/997546694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee44101520 0x7fee44199030 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fee34005940 tx=0x7fee340042f0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.277+0000 7fee48a36640 1 -- 172.21.15.22:0/997546694 shutdown_connections 2024-08-20T01:38:18.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.277+0000 7fee48a36640 1 --2- 172.21.15.22:0/997546694 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fee2c0b3c50 0x7fee2c0b6110 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.277+0000 7fee48a36640 1 --2- 172.21.15.22:0/997546694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee441074d0 0x7fee4419e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.277+0000 7fee48a36640 1 --2- 172.21.15.22:0/997546694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee44106b50 0x7fee44199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.277+0000 7fee48a36640 1 --2- 172.21.15.22:0/997546694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee44101520 0x7fee44199030 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:18.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.277+0000 7fee48a36640 1 -- 172.21.15.22:0/997546694 >> 172.21.15.22:0/997546694 conn(0x7fee44076c80 msgr2=0x7fee44102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:18.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.277+0000 7fee48a36640 1 -- 172.21.15.22:0/997546694 shutdown_connections 2024-08-20T01:38:18.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:18.277+0000 7fee48a36640 1 -- 172.21.15.22:0/997546694 wait complete. 2024-08-20T01:38:18.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:18 smithi022 ceph-mon[18709]: pgmap v561: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 2.08k op/s 2024-08-20T01:38:19.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:18 smithi134 ceph-mon[22511]: pgmap v561: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 2.08k op/s 2024-08-20T01:38:19.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:18 smithi077 ceph-mon[22251]: pgmap v561: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 2.08k op/s 2024-08-20T01:38:19.327 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:38:19.588 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:20.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.269+0000 7fcb73ff6640 1 -- 172.21.15.22:0/1937750865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb6c10f110 msgr2=0x7fcb6c111500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.269+0000 7fcb73ff6640 1 --2- 172.21.15.22:0/1937750865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb6c10f110 0x7fcb6c111500 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fcb64009ca0 tx=0x7fcb6402a950 comp rx=0 tx=0).stop 2024-08-20T01:38:20.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.269+0000 7fcb73ff6640 1 -- 172.21.15.22:0/1937750865 shutdown_connections 2024-08-20T01:38:20.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.269+0000 7fcb73ff6640 1 --2- 172.21.15.22:0/1937750865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb6c10f110 0x7fcb6c111500 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.269+0000 7fcb73ff6640 1 --2- 172.21.15.22:0/1937750865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb6c101e80 0x7fcb6c10ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.269+0000 7fcb73ff6640 1 --2- 172.21.15.22:0/1937750865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb6c101560 0x7fcb6c101940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.269+0000 7fcb73ff6640 1 -- 172.21.15.22:0/1937750865 >> 172.21.15.22:0/1937750865 conn(0x7fcb6c0fd410 msgr2=0x7fcb6c0ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:20.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.269+0000 7fcb73ff6640 1 -- 172.21.15.22:0/1937750865 shutdown_connections 2024-08-20T01:38:20.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.269+0000 7fcb73ff6640 1 -- 172.21.15.22:0/1937750865 wait complete. 2024-08-20T01:38:20.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.269+0000 7fcb73ff6640 1 Processor -- start 2024-08-20T01:38:20.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.269+0000 7fcb73ff6640 1 -- start start 2024-08-20T01:38:20.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.270+0000 7fcb73ff6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb6c101560 0x7fcb6c19b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.270+0000 7fcb73ff6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb6c101e80 0x7fcb6c19b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.270+0000 7fcb73ff6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb6c10f110 0x7fcb6c1a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.270+0000 7fcb73ff6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c114c90 con 0x7fcb6c101e80 2024-08-20T01:38:20.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.270+0000 7fcb73ff6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c114b10 con 0x7fcb6c10f110 2024-08-20T01:38:20.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.270+0000 7fcb73ff6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c114e10 con 0x7fcb6c101560 2024-08-20T01:38:20.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.270+0000 7fcb71591640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb6c101e80 0x7fcb6c19b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.270+0000 7fcb71d92640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb6c101560 0x7fcb6c19b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.270+0000 7fcb71591640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb6c101e80 0x7fcb6c19b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51440/0 (socket says 172.21.15.22:51440) 2024-08-20T01:38:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.270+0000 7fcb71591640 1 -- 172.21.15.22:0/222382304 learned_addr learned my addr 172.21.15.22:0/222382304 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.270+0000 7fcb71d92640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb6c101560 0x7fcb6c19b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:35692/0 (socket says 172.21.15.22:35692) 2024-08-20T01:38:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.270+0000 7fcb72593640 1 --2- 172.21.15.22:0/222382304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb6c10f110 0x7fcb6c1a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.270+0000 7fcb71d92640 1 -- 172.21.15.22:0/222382304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb6c10f110 msgr2=0x7fcb6c1a0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.270+0000 7fcb71d92640 1 --2- 172.21.15.22:0/222382304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb6c10f110 0x7fcb6c1a0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.270+0000 7fcb71d92640 1 -- 172.21.15.22:0/222382304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb6c101e80 msgr2=0x7fcb6c19b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.270+0000 7fcb71d92640 1 --2- 172.21.15.22:0/222382304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb6c101e80 0x7fcb6c19b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.270+0000 7fcb71d92640 1 -- 172.21.15.22:0/222382304 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c1a14a0 con 0x7fcb6c101560 2024-08-20T01:38:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.270+0000 7fcb71591640 1 --2- 172.21.15.22:0/222382304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb6c101e80 0x7fcb6c19b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.270+0000 7fcb71d92640 1 --2- 172.21.15.22:0/222382304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb6c101560 0x7fcb6c19b3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800c970 tx=0x7fcb6800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.271+0000 7fcb62ffd640 1 -- 172.21.15.22:0/222382304 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb68007bb0 con 0x7fcb6c101560 2024-08-20T01:38:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.271+0000 7fcb73ff6640 1 -- 172.21.15.22:0/222382304 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6c1a1790 con 0x7fcb6c101560 2024-08-20T01:38:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.271+0000 7fcb73ff6640 1 -- 172.21.15.22:0/222382304 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb6c1a8020 con 0x7fcb6c101560 2024-08-20T01:38:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.271+0000 7fcb62ffd640 1 -- 172.21.15.22:0/222382304 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb68007d50 con 0x7fcb6c101560 2024-08-20T01:38:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.271+0000 7fcb62ffd640 1 -- 172.21.15.22:0/222382304 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb68018780 con 0x7fcb6c101560 2024-08-20T01:38:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.273+0000 7fcb763ef740 1 Processor -- start 2024-08-20T01:38:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.273+0000 7fcb763ef740 1 -- start start 2024-08-20T01:38:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.273+0000 7fcb763ef740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e8880 0x55ede35e8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.273+0000 7fcb763ef740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35e91a0 0x55ede35f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.273+0000 7fcb763ef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35f5130 0x55ede35f7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.273+0000 7fcb763ef740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ede355f930 con 0x55ede35e91a0 2024-08-20T01:38:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.273+0000 7fcb763ef740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ede354ee30 con 0x55ede35e8880 2024-08-20T01:38:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.273+0000 7fcb763ef740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ede3552e70 con 0x55ede35f5130 2024-08-20T01:38:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.274+0000 7fcb62ffd640 1 -- 172.21.15.22:0/222382304 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcb6800f450 con 0x7fcb6c101560 2024-08-20T01:38:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.274+0000 7fcb71591640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35f5130 0x55ede35f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.274+0000 7fcb71591640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35f5130 0x55ede35f7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:35694/0 (socket says 172.21.15.22:35694) 2024-08-20T01:38:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.274+0000 7fcb71591640 1 -- 172.21.15.22:0/2917569116 learned_addr learned my addr 172.21.15.22:0/2917569116 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.274+0000 7fcb71d92640 1 --2- 172.21.15.22:0/2917569116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35e91a0 0x55ede35f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.274+0000 7fcb72593640 1 --2- 172.21.15.22:0/2917569116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e8880 0x55ede35e8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.274+0000 7fcb71591640 1 -- 172.21.15.22:0/2917569116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e8880 msgr2=0x55ede35e8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.274+0000 7fcb71591640 1 --2- 172.21.15.22:0/2917569116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e8880 0x55ede35e8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.274+0000 7fcb71591640 1 -- 172.21.15.22:0/2917569116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35e91a0 msgr2=0x55ede35f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.274+0000 7fcb71591640 1 --2- 172.21.15.22:0/2917569116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35e91a0 0x55ede35f4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.274+0000 7fcb71591640 1 -- 172.21.15.22:0/2917569116 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ede32ae650 con 0x55ede35f5130 2024-08-20T01:38:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.274+0000 7fcb71d92640 1 --2- 172.21.15.22:0/2917569116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35e91a0 0x55ede35f4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.274+0000 7fcb71591640 1 --2- 172.21.15.22:0/2917569116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35f5130 0x55ede35f7520 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c011540 tx=0x7fcb5c011a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=771f6667807c52da server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.274+0000 7fcb57fff640 1 -- 172.21.15.22:0/2917569116 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c00f640 con 0x55ede35f5130 2024-08-20T01:38:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.275+0000 7fcb57fff640 1 -- 172.21.15.22:0/2917569116 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb5c00fc90 con 0x55ede35f5130 2024-08-20T01:38:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.275+0000 7fcb57fff640 1 -- 172.21.15.22:0/2917569116 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c019d40 con 0x55ede35f5130 2024-08-20T01:38:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.275+0000 7fcb62ffd640 1 --2- 172.21.15.22:0/222382304 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcb580b3bd0 0x7fcb580b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.275+0000 7fcb72593640 1 --2- 172.21.15.22:0/222382304 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcb580b3bd0 0x7fcb580b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.275+0000 7fcb62ffd640 1 -- 172.21.15.22:0/222382304 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fcb680e3c20 con 0x7fcb6c101560 2024-08-20T01:38:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.275+0000 7fcb763ef740 1 -- 172.21.15.22:0/2917569116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35f5130 msgr2=0x55ede35f7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.275+0000 7fcb72593640 1 --2- 172.21.15.22:0/222382304 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcb580b3bd0 0x7fcb580b6090 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcb64005e30 tx=0x7fcb64005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.275+0000 7fcb763ef740 1 --2- 172.21.15.22:0/2917569116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35f5130 0x55ede35f7520 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c011540 tx=0x7fcb5c011a00 comp rx=0 tx=0).stop 2024-08-20T01:38:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.275+0000 7fcb763ef740 1 -- 172.21.15.22:0/2917569116 shutdown_connections 2024-08-20T01:38:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.275+0000 7fcb763ef740 1 --2- 172.21.15.22:0/2917569116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35f5130 0x55ede35f7520 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.275+0000 7fcb763ef740 1 --2- 172.21.15.22:0/2917569116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35e91a0 0x55ede35f4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.275+0000 7fcb763ef740 1 --2- 172.21.15.22:0/2917569116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e8880 0x55ede35e8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.275+0000 7fcb763ef740 1 -- 172.21.15.22:0/2917569116 >> 172.21.15.22:0/2917569116 conn(0x55ede35e66b0 msgr2=0x55ede35e7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.275+0000 7fcb763ef740 1 -- 172.21.15.22:0/2917569116 shutdown_connections 2024-08-20T01:38:20.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.275+0000 7fcb763ef740 1 -- 172.21.15.22:0/2917569116 wait complete. 2024-08-20T01:38:20.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.276+0000 7fcb763ef740 1 -- start start 2024-08-20T01:38:20.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.276+0000 7fcb763ef740 1 Processor -- start 2024-08-20T01:38:20.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.276+0000 7fcb763ef740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35e8880 0x55ede35f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.276+0000 7fcb763ef740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e91a0 0x55ede35f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.276+0000 7fcb763ef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35f5130 0x55ede35f2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.276+0000 7fcb763ef740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ede33b1700 con 0x55ede35e8880 2024-08-20T01:38:20.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.276+0000 7fcb763ef740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ede34d5810 con 0x55ede35e91a0 2024-08-20T01:38:20.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.276+0000 7fcb763ef740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ede35f7de0 con 0x55ede35f5130 2024-08-20T01:38:20.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.276+0000 7fcb71d92640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35e8880 0x55ede35f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.276+0000 7fcb71d92640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35e8880 0x55ede35f20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51470/0 (socket says 172.21.15.22:51470) 2024-08-20T01:38:20.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.276+0000 7fcb71d92640 1 -- 172.21.15.22:0/736552034 learned_addr learned my addr 172.21.15.22:0/736552034 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:20.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.276+0000 7fcb72593640 1 --2- 172.21.15.22:0/736552034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35f5130 0x55ede35f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.276+0000 7fcb763ef740 10 client.0 _ll_register_callbacks cb 0x55ede3548700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:20.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.277+0000 7fcb71591640 1 --2- 172.21.15.22:0/736552034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e91a0 0x55ede35f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.277+0000 7fcb71d92640 1 -- 172.21.15.22:0/736552034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35f5130 msgr2=0x55ede35f2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.277+0000 7fcb71d92640 1 --2- 172.21.15.22:0/736552034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35f5130 0x55ede35f2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.277+0000 7fcb71d92640 1 -- 172.21.15.22:0/736552034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e91a0 msgr2=0x55ede35f25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.277+0000 7fcb71d92640 1 --2- 172.21.15.22:0/736552034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e91a0 0x55ede35f25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.277+0000 7fcb71d92640 1 -- 172.21.15.22:0/736552034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ede36011c0 con 0x55ede35e8880 2024-08-20T01:38:20.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.277+0000 7fcb71d92640 1 --2- 172.21.15.22:0/736552034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35e8880 0x55ede35f20b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fcb680a6bb0 tx=0x7fcb680aa2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf092470e64d2ccf server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:20.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.277+0000 7fcb557fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:38:20.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.277+0000 7fcb557fa640 1 -- 172.21.15.22:0/736552034 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb680abe60 con 0x55ede35e8880 2024-08-20T01:38:20.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.277+0000 7fcb557fa640 1 -- 172.21.15.22:0/736552034 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fcb680a7120 con 0x55ede35e8880 2024-08-20T01:38:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.277+0000 7fcb763ef740 1 -- 172.21.15.22:0/736552034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ede34fe150 con 0x55ede35e8880 2024-08-20T01:38:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.277+0000 7fcb557fa640 1 -- 172.21.15.22:0/736552034 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fcb680ab230 con 0x55ede35e8880 2024-08-20T01:38:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.277+0000 7fcb763ef740 10 client.16500 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.277+0000 7fcb763ef740 1 -- 172.21.15.22:0/736552034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ede3603bb0 con 0x55ede35e8880 2024-08-20T01:38:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.278+0000 7fcb557fa640 1 -- 172.21.15.22:0/736552034 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ede34fe150 con 0x55ede35e8880 2024-08-20T01:38:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.278+0000 7fcb557fa640 1 -- 172.21.15.22:0/736552034 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fcb680920e0 con 0x55ede35e8880 2024-08-20T01:38:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.278+0000 7fcb763ef740 10 client.16500 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.278+0000 7fcb763ef740 10 client.16500 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:38:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.278+0000 7fcb763ef740 20 client.16500 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.278+0000 7fcb763ef740 1 --2- 172.21.15.22:0/736552034 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55ede36050c0 0x55ede3607560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.278+0000 7fcb763ef740 4 client.16500 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.278+0000 7fcb763ef740 1 -- 172.21.15.22:0/736552034 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ede3561880 con 0x55ede36050c0 2024-08-20T01:38:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.278+0000 7fcb71591640 1 --2- 172.21.15.22:0/736552034 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55ede36050c0 0x55ede3607560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.279+0000 7fcb557fa640 10 client.16500 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:38:20.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.279+0000 7fcb71591640 1 --2- 172.21.15.22:0/736552034 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55ede36050c0 0x55ede3607560 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e64f8644c4b59bad server_cookie=daf07a0457f703de in_seq=0 out_seq=0 2024-08-20T01:38:20.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.279+0000 7fcb557fa640 1 -- 172.21.15.22:0/736552034 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ede3561880 con 0x55ede36050c0 2024-08-20T01:38:20.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.279+0000 7fcb557fa640 10 client.16500 handle_command_reply: tid=0 2024-08-20T01:38:20.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.279+0000 7fcb763ef740 1 client.16500 shutdown 2024-08-20T01:38:20.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.279+0000 7fcb763ef740 1 -- 172.21.15.22:0/736552034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35e8880 msgr2=0x55ede35f20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.279+0000 7fcb763ef740 1 --2- 172.21.15.22:0/736552034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35e8880 0x55ede35f20b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fcb680a6bb0 tx=0x7fcb680aa2a0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.280+0000 7fcb763ef740 1 -- 172.21.15.22:0/736552034 shutdown_connections 2024-08-20T01:38:20.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.280+0000 7fcb763ef740 1 --2- 172.21.15.22:0/736552034 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55ede36050c0 0x55ede3607560 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.280+0000 7fcb763ef740 1 --2- 172.21.15.22:0/736552034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35f5130 0x55ede35f2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.280+0000 7fcb557fa640 0 client.16500 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:38:20.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.280+0000 7fcb763ef740 1 --2- 172.21.15.22:0/736552034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e91a0 0x55ede35f25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.280+0000 7fcb763ef740 1 --2- 172.21.15.22:0/736552034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35e8880 0x55ede35f20b0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.280+0000 7fcb763ef740 1 -- 172.21.15.22:0/736552034 >> 172.21.15.22:0/736552034 conn(0x55ede35e66b0 msgr2=0x55ede35ec250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:20.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.280+0000 7fcb763ef740 1 -- 172.21.15.22:0/736552034 shutdown_connections 2024-08-20T01:38:20.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.280+0000 7fcb763ef740 1 -- 172.21.15.22:0/736552034 wait complete. 2024-08-20T01:38:20.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.280+0000 7fcb763ef740 20 client.16500 trim_cache size 0 max 16384 2024-08-20T01:38:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.293+0000 7fcb763ef740 1 Processor -- start 2024-08-20T01:38:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.293+0000 7fcb763ef740 1 -- start start 2024-08-20T01:38:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.293+0000 7fcb763ef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35e8880 0x55ede35f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.293+0000 7fcb763ef740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e91a0 0x55ede360ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.293+0000 7fcb763ef740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35f5130 0x55ede360d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.293+0000 7fcb763ef740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c1b2c60 con 0x55ede35f5130 2024-08-20T01:38:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.293+0000 7fcb763ef740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c1b0470 con 0x55ede35e91a0 2024-08-20T01:38:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.293+0000 7fcb763ef740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c1ae2c0 con 0x55ede35e8880 2024-08-20T01:38:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.294+0000 7fcb72593640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35f5130 0x55ede360d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.294+0000 7fcb71d92640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35e8880 0x55ede35f3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.294+0000 7fcb71d92640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35e8880 0x55ede35f3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:35706/0 (socket says 172.21.15.22:35706) 2024-08-20T01:38:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.294+0000 7fcb72593640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35f5130 0x55ede360d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51474/0 (socket says 172.21.15.22:51474) 2024-08-20T01:38:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.294+0000 7fcb71d92640 1 -- 172.21.15.22:0/2267441861 learned_addr learned my addr 172.21.15.22:0/2267441861 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.294+0000 7fcb71591640 1 --2- 172.21.15.22:0/2267441861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e91a0 0x55ede360ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.294+0000 7fcb72593640 1 -- 172.21.15.22:0/2267441861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35e8880 msgr2=0x55ede35f3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.294+0000 7fcb72593640 1 --2- 172.21.15.22:0/2267441861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35e8880 0x55ede35f3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.294+0000 7fcb72593640 1 -- 172.21.15.22:0/2267441861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e91a0 msgr2=0x55ede360ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.294+0000 7fcb72593640 1 --2- 172.21.15.22:0/2267441861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e91a0 0x55ede360ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.294+0000 7fcb72593640 1 -- 172.21.15.22:0/2267441861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ede35e7130 con 0x55ede35f5130 2024-08-20T01:38:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.294+0000 7fcb71d92640 1 --2- 172.21.15.22:0/2267441861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35e8880 0x55ede35f3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.294+0000 7fcb72593640 1 --2- 172.21.15.22:0/2267441861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35f5130 0x55ede360d370 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fcb64005cc0 tx=0x7fcb64045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ddaad69e7fc24f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:20.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.294+0000 7fcb577fe640 1 -- 172.21.15.22:0/2267441861 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64056070 con 0x55ede35f5130 2024-08-20T01:38:20.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.294+0000 7fcb577fe640 1 -- 172.21.15.22:0/2267441861 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb64003d70 con 0x55ede35f5130 2024-08-20T01:38:20.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.294+0000 7fcb577fe640 1 -- 172.21.15.22:0/2267441861 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64034040 con 0x55ede35f5130 2024-08-20T01:38:20.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.295+0000 7fcb763ef740 1 -- 172.21.15.22:0/2267441861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35f5130 msgr2=0x55ede360d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.295+0000 7fcb763ef740 1 --2- 172.21.15.22:0/2267441861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35f5130 0x55ede360d370 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fcb64005cc0 tx=0x7fcb64045000 comp rx=0 tx=0).stop 2024-08-20T01:38:20.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.295+0000 7fcb763ef740 1 -- 172.21.15.22:0/2267441861 shutdown_connections 2024-08-20T01:38:20.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.295+0000 7fcb763ef740 1 --2- 172.21.15.22:0/2267441861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35f5130 0x55ede360d370 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.295+0000 7fcb763ef740 1 --2- 172.21.15.22:0/2267441861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e91a0 0x55ede360ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.295+0000 7fcb763ef740 1 --2- 172.21.15.22:0/2267441861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35e8880 0x55ede35f3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.295+0000 7fcb763ef740 1 -- 172.21.15.22:0/2267441861 >> 172.21.15.22:0/2267441861 conn(0x55ede35e66b0 msgr2=0x55ede35f36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.295+0000 7fcb763ef740 1 -- 172.21.15.22:0/2267441861 shutdown_connections 2024-08-20T01:38:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.295+0000 7fcb763ef740 1 -- 172.21.15.22:0/2267441861 wait complete. 2024-08-20T01:38:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.295+0000 7fcb763ef740 1 -- start start 2024-08-20T01:38:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.296+0000 7fcb763ef740 1 Processor -- start 2024-08-20T01:38:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.296+0000 7fcb763ef740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e8880 0x55ede35f9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.296+0000 7fcb763ef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35e91a0 0x55ede35f95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.296+0000 7fcb763ef740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35f5130 0x55ede35f9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.296+0000 7fcb763ef740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c1ae930 con 0x55ede35f5130 2024-08-20T01:38:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.296+0000 7fcb763ef740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c1afda0 con 0x55ede35e8880 2024-08-20T01:38:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.296+0000 7fcb763ef740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c1af000 con 0x55ede35e91a0 2024-08-20T01:38:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.296+0000 7fcb763ef740 10 client.0 _ll_register_callbacks cb 0x7fcb680aa900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.296+0000 7fcb71d92640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e8880 0x55ede35f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.296+0000 7fcb72593640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35f5130 0x55ede35f9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.296+0000 7fcb71591640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35e91a0 0x55ede35f95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.296+0000 7fcb71591640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35e91a0 0x55ede35f95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:35718/0 (socket says 172.21.15.22:35718) 2024-08-20T01:38:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.296+0000 7fcb71d92640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e8880 0x55ede35f9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:59548/0 (socket says 172.21.15.22:59548) 2024-08-20T01:38:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.296+0000 7fcb71591640 1 -- 172.21.15.22:0/3324964279 learned_addr learned my addr 172.21.15.22:0/3324964279 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.297+0000 7fcb72593640 1 -- 172.21.15.22:0/3324964279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35e91a0 msgr2=0x55ede35f95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.297+0000 7fcb72593640 1 --2- 172.21.15.22:0/3324964279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35e91a0 0x55ede35f95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.297+0000 7fcb72593640 1 -- 172.21.15.22:0/3324964279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e8880 msgr2=0x55ede35f9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.297+0000 7fcb72593640 1 --2- 172.21.15.22:0/3324964279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e8880 0x55ede35f9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.297+0000 7fcb72593640 1 -- 172.21.15.22:0/3324964279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ede366efb0 con 0x55ede35f5130 2024-08-20T01:38:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.297+0000 7fcb71591640 1 --2- 172.21.15.22:0/3324964279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35e91a0 0x55ede35f95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.297+0000 7fcb72593640 1 --2- 172.21.15.22:0/3324964279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35f5130 0x55ede35f9ae0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fcb64005fc0 tx=0x7fcb64030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4927cd9d03ba1805 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.297+0000 7fcb557fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:38:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.297+0000 7fcb557fa640 1 -- 172.21.15.22:0/3324964279 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64056040 con 0x55ede35f5130 2024-08-20T01:38:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.297+0000 7fcb557fa640 1 -- 172.21.15.22:0/3324964279 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fcb64030de0 con 0x55ede35f5130 2024-08-20T01:38:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.297+0000 7fcb763ef740 1 -- 172.21.15.22:0/3324964279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb64003d70 con 0x55ede35f5130 2024-08-20T01:38:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.297+0000 7fcb557fa640 1 -- 172.21.15.22:0/3324964279 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fcb64030440 con 0x55ede35f5130 2024-08-20T01:38:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.297+0000 7fcb763ef740 10 client.16506 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.297+0000 7fcb763ef740 1 -- 172.21.15.22:0/3324964279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ede36702b0 con 0x55ede35f5130 2024-08-20T01:38:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.298+0000 7fcb557fa640 1 -- 172.21.15.22:0/3324964279 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb64003d70 con 0x55ede35f5130 2024-08-20T01:38:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.298+0000 7fcb557fa640 1 -- 172.21.15.22:0/3324964279 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fcb64059070 con 0x55ede35f5130 2024-08-20T01:38:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.298+0000 7fcb763ef740 10 client.16506 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.298+0000 7fcb763ef740 10 client.16506 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:38:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.298+0000 7fcb763ef740 20 client.16506 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.298+0000 7fcb763ef740 1 --2- 172.21.15.22:0/3324964279 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55ede3670a00 0x55ede3672e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.298+0000 7fcb763ef740 4 client.16506 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:38:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.298+0000 7fcb763ef740 1 -- 172.21.15.22:0/3324964279 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ede355d320 con 0x55ede3670a00 2024-08-20T01:38:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.298+0000 7fcb71d92640 1 --2- 172.21.15.22:0/3324964279 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55ede3670a00 0x55ede3672e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.298+0000 7fcb71d92640 1 --2- 172.21.15.22:0/3324964279 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55ede3670a00 0x55ede3672e20 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2ccfa47fb5337c9e server_cookie=5a0edb07a261cb4a in_seq=0 out_seq=0 2024-08-20T01:38:20.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.298+0000 7fcb557fa640 10 client.16506 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:38:20.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.299+0000 7fcb557fa640 1 -- 172.21.15.22:0/3324964279 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ede355d320 con 0x55ede3670a00 2024-08-20T01:38:20.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.299+0000 7fcb557fa640 10 client.16506 handle_command_reply: tid=0 2024-08-20T01:38:20.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.299+0000 7fcb763ef740 1 client.16506 shutdown 2024-08-20T01:38:20.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.299+0000 7fcb763ef740 1 -- 172.21.15.22:0/3324964279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35f5130 msgr2=0x55ede35f9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.299+0000 7fcb763ef740 1 --2- 172.21.15.22:0/3324964279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35f5130 0x55ede35f9ae0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fcb64005fc0 tx=0x7fcb64030d70 comp rx=0 tx=0).stop 2024-08-20T01:38:20.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.299+0000 7fcb763ef740 1 -- 172.21.15.22:0/3324964279 shutdown_connections 2024-08-20T01:38:20.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.299+0000 7fcb763ef740 1 --2- 172.21.15.22:0/3324964279 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55ede3670a00 0x55ede3672e20 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.299+0000 7fcb763ef740 1 --2- 172.21.15.22:0/3324964279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ede35f5130 0x55ede35f9ae0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.299+0000 7fcb763ef740 1 --2- 172.21.15.22:0/3324964279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ede35e91a0 0x55ede35f95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.299+0000 7fcb557fa640 0 client.16506 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:38:20.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.299+0000 7fcb763ef740 1 --2- 172.21.15.22:0/3324964279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ede35e8880 0x55ede35f9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.299+0000 7fcb763ef740 1 -- 172.21.15.22:0/3324964279 >> 172.21.15.22:0/3324964279 conn(0x55ede35e66b0 msgr2=0x55ede35f3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:20.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.299+0000 7fcb763ef740 1 -- 172.21.15.22:0/3324964279 shutdown_connections 2024-08-20T01:38:20.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.299+0000 7fcb763ef740 1 -- 172.21.15.22:0/3324964279 wait complete. 2024-08-20T01:38:20.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.299+0000 7fcb763ef740 20 client.16506 trim_cache size 0 max 16384 2024-08-20T01:38:20.307 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:38:20.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.300+0000 7fcb73ff6640 1 -- 172.21.15.22:0/222382304 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcb580b3bd0 msgr2=0x7fcb580b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.300+0000 7fcb73ff6640 1 --2- 172.21.15.22:0/222382304 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcb580b3bd0 0x7fcb580b6090 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcb64005e30 tx=0x7fcb64005c50 comp rx=0 tx=0).stop 2024-08-20T01:38:20.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.300+0000 7fcb73ff6640 1 -- 172.21.15.22:0/222382304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb6c101560 msgr2=0x7fcb6c19b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.300+0000 7fcb73ff6640 1 --2- 172.21.15.22:0/222382304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb6c101560 0x7fcb6c19b3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800c970 tx=0x7fcb6800ce30 comp rx=0 tx=0).stop 2024-08-20T01:38:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.300+0000 7fcb73ff6640 1 -- 172.21.15.22:0/222382304 shutdown_connections 2024-08-20T01:38:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.300+0000 7fcb73ff6640 1 --2- 172.21.15.22:0/222382304 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcb580b3bd0 0x7fcb580b6090 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.300+0000 7fcb73ff6640 1 --2- 172.21.15.22:0/222382304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb6c10f110 0x7fcb6c1a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.300+0000 7fcb73ff6640 1 --2- 172.21.15.22:0/222382304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb6c101e80 0x7fcb6c19b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.300+0000 7fcb73ff6640 1 --2- 172.21.15.22:0/222382304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb6c101560 0x7fcb6c19b3f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.300+0000 7fcb73ff6640 1 -- 172.21.15.22:0/222382304 >> 172.21.15.22:0/222382304 conn(0x7fcb6c0fd410 msgr2=0x7fcb6c1103d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.300+0000 7fcb73ff6640 1 -- 172.21.15.22:0/222382304 shutdown_connections 2024-08-20T01:38:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:20.300+0000 7fcb73ff6640 1 -- 172.21.15.22:0/222382304 wait complete. 2024-08-20T01:38:20.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.504+0000 7f736c860640 1 -- 172.21.15.22:0/213435979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7368104190 msgr2=0x7f736810ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.504+0000 7f736c860640 1 --2- 172.21.15.22:0/213435979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7368104190 0x7f736810ab10 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7360009cd0 tx=0x7f736002a8e0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.504+0000 7f736c860640 1 -- 172.21.15.22:0/213435979 shutdown_connections 2024-08-20T01:38:20.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.504+0000 7f736c860640 1 --2- 172.21.15.22:0/213435979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7368104190 0x7f736810ab10 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.504+0000 7f736c860640 1 --2- 172.21.15.22:0/213435979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73681037d0 0x7f7368103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.504+0000 7f736c860640 1 --2- 172.21.15.22:0/213435979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7368102680 0x7f7368102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.504+0000 7f736c860640 1 -- 172.21.15.22:0/213435979 >> 172.21.15.22:0/213435979 conn(0x7f73680fdf40 msgr2=0x7f7368100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:20.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.504+0000 7f736c860640 1 -- 172.21.15.22:0/213435979 shutdown_connections 2024-08-20T01:38:20.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.504+0000 7f736c860640 1 -- 172.21.15.22:0/213435979 wait complete. 2024-08-20T01:38:20.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.505+0000 7f736c860640 1 Processor -- start 2024-08-20T01:38:20.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.505+0000 7f736c860640 1 -- start start 2024-08-20T01:38:20.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.505+0000 7f736c860640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7368102680 0x7f7368198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.505+0000 7f736c860640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73681037d0 0x7f7368199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.505+0000 7f736c860640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7368104190 0x7f7368199d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.505+0000 7f736c860640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f736810e360 con 0x7f7368104190 2024-08-20T01:38:20.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.505+0000 7f736c860640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f736810e1e0 con 0x7f7368102680 2024-08-20T01:38:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.505+0000 7f736c860640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f736810e4e0 con 0x7f73681037d0 2024-08-20T01:38:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.505+0000 7f7366d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7368104190 0x7f7368199d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.505+0000 7f7366d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7368104190 0x7f7368199d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51510/0 (socket says 172.21.15.22:51510) 2024-08-20T01:38:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.505+0000 7f7366d9d640 1 -- 172.21.15.22:0/314983055 learned_addr learned my addr 172.21.15.22:0/314983055 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.505+0000 7f7365d9b640 1 --2- 172.21.15.22:0/314983055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73681037d0 0x7f7368199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.505+0000 7f736659c640 1 --2- 172.21.15.22:0/314983055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7368102680 0x7f7368198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.506+0000 7f7366d9d640 1 -- 172.21.15.22:0/314983055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73681037d0 msgr2=0x7f7368199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.506+0000 7f7366d9d640 1 --2- 172.21.15.22:0/314983055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73681037d0 0x7f7368199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.506+0000 7f7366d9d640 1 -- 172.21.15.22:0/314983055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7368102680 msgr2=0x7f7368198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.506+0000 7f7366d9d640 1 --2- 172.21.15.22:0/314983055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7368102680 0x7f7368198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.506+0000 7f7366d9d640 1 -- 172.21.15.22:0/314983055 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736819a630 con 0x7f7368104190 2024-08-20T01:38:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.506+0000 7f736659c640 1 --2- 172.21.15.22:0/314983055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7368102680 0x7f7368198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.506+0000 7f7365d9b640 1 --2- 172.21.15.22:0/314983055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73681037d0 0x7f7368199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.506+0000 7f7366d9d640 1 --2- 172.21.15.22:0/314983055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7368104190 0x7f7368199d70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f736002ae00 tx=0x7f7360003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:20.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.506+0000 7f73577fe640 1 -- 172.21.15.22:0/314983055 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7360004040 con 0x7f7368104190 2024-08-20T01:38:20.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.506+0000 7f736c860640 1 -- 172.21.15.22:0/314983055 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f736819a8c0 con 0x7f7368104190 2024-08-20T01:38:20.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.506+0000 7f73577fe640 1 -- 172.21.15.22:0/314983055 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7360004690 con 0x7f7368104190 2024-08-20T01:38:20.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.506+0000 7f73577fe640 1 -- 172.21.15.22:0/314983055 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7360030de0 con 0x7f7368104190 2024-08-20T01:38:20.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.506+0000 7f736c860640 1 -- 172.21.15.22:0/314983055 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73681a0ff0 con 0x7f7368104190 2024-08-20T01:38:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.509+0000 7f73577fe640 1 -- 172.21.15.22:0/314983055 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f73600305a0 con 0x7f7368104190 2024-08-20T01:38:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.509+0000 7f736f655740 1 Processor -- start 2024-08-20T01:38:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.509+0000 7f736f655740 1 -- start start 2024-08-20T01:38:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f736f655740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2ee630 0x558d7b2f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f736f655740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2f0f60 0x558d7b2f3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f736f655740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f39a0 0x558d7b2f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f736f655740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558d7b261360 con 0x558d7b2f0f60 2024-08-20T01:38:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f736f655740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558d7b250860 con 0x558d7b2ee630 2024-08-20T01:38:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f736f655740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558d7b2548a0 con 0x558d7b2f39a0 2024-08-20T01:38:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f736659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2f0f60 0x558d7b2f3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f7365d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2ee630 0x558d7b2f0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f7365d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2ee630 0x558d7b2f0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:59576/0 (socket says 172.21.15.22:59576) 2024-08-20T01:38:20.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f736659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2f0f60 0x558d7b2f3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51526/0 (socket says 172.21.15.22:51526) 2024-08-20T01:38:20.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f7365d9b640 1 -- 172.21.15.22:0/4164379365 learned_addr learned my addr 172.21.15.22:0/4164379365 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:20.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f7365d9b640 1 --2- 172.21.15.22:0/4164379365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f39a0 0x558d7b2f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f7365d9b640 1 -- 172.21.15.22:0/4164379365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f39a0 msgr2=0x558d7b2f5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f7365d9b640 1 --2- 172.21.15.22:0/4164379365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f39a0 0x558d7b2f5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f7365d9b640 1 -- 172.21.15.22:0/4164379365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2f0f60 msgr2=0x558d7b2f3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f7365d9b640 1 --2- 172.21.15.22:0/4164379365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2f0f60 0x558d7b2f3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f7365d9b640 1 -- 172.21.15.22:0/4164379365 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d7b1f7e40 con 0x558d7b2ee630 2024-08-20T01:38:20.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f73577fe640 1 --2- 172.21.15.22:0/314983055 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f73500b3bd0 0x7f73500b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f736659c640 1 --2- 172.21.15.22:0/314983055 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f73500b3bd0 0x7f73500b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f7365d9b640 1 --2- 172.21.15.22:0/4164379365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2ee630 0x558d7b2f0a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f735c004650 tx=0x7f735c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c378c2474c684d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:20.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.510+0000 7f73577fe640 1 -- 172.21.15.22:0/314983055 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f736002e030 con 0x7f7368104190 2024-08-20T01:38:20.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.511+0000 7f7354ff9640 1 -- 172.21.15.22:0/4164379365 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c00fc50 con 0x558d7b2ee630 2024-08-20T01:38:20.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.511+0000 7f7354ff9640 1 -- 172.21.15.22:0/4164379365 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f735c00fdf0 con 0x558d7b2ee630 2024-08-20T01:38:20.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.511+0000 7f7354ff9640 1 -- 172.21.15.22:0/4164379365 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c00e610 con 0x558d7b2ee630 2024-08-20T01:38:20.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.511+0000 7f736f655740 1 -- 172.21.15.22:0/4164379365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2ee630 msgr2=0x558d7b2f0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.511+0000 7f736659c640 1 --2- 172.21.15.22:0/314983055 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f73500b3bd0 0x7f73500b6090 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7358012640 tx=0x7f7358005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:20.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.511+0000 7f736f655740 1 --2- 172.21.15.22:0/4164379365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2ee630 0x558d7b2f0a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f735c004650 tx=0x7f735c009b80 comp rx=0 tx=0).stop 2024-08-20T01:38:20.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.511+0000 7f736f655740 1 -- 172.21.15.22:0/4164379365 shutdown_connections 2024-08-20T01:38:20.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.511+0000 7f736f655740 1 --2- 172.21.15.22:0/4164379365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f39a0 0x558d7b2f5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.511+0000 7f736f655740 1 --2- 172.21.15.22:0/4164379365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2f0f60 0x558d7b2f3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.511+0000 7f736f655740 1 --2- 172.21.15.22:0/4164379365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2ee630 0x558d7b2f0a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.511+0000 7f736f655740 1 -- 172.21.15.22:0/4164379365 >> 172.21.15.22:0/4164379365 conn(0x558d7b2e9730 msgr2=0x558d7b2ea510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:20.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.512+0000 7f736f655740 1 -- 172.21.15.22:0/4164379365 shutdown_connections 2024-08-20T01:38:20.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.512+0000 7f736f655740 1 -- 172.21.15.22:0/4164379365 wait complete. 2024-08-20T01:38:20.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.512+0000 7f736f655740 1 -- start start 2024-08-20T01:38:20.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.512+0000 7f736f655740 1 Processor -- start 2024-08-20T01:38:20.520 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.512+0000 7f736f655740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2ee630 0x558d7b2f7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.520 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.512+0000 7f736f655740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f0f60 0x558d7b2f8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.520 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.512+0000 7f736f655740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2f39a0 0x558d7b2f9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.520 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.512+0000 7f736f655740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558d7b189ab0 con 0x558d7b2f39a0 2024-08-20T01:38:20.520 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.512+0000 7f736f655740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558d7b1d7780 con 0x558d7b2ee630 2024-08-20T01:38:20.520 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.512+0000 7f736f655740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558d7b2f6980 con 0x558d7b2f0f60 2024-08-20T01:38:20.520 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.512+0000 7f736f655740 10 client.0 _ll_register_callbacks cb 0x558d7af5fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:20.520 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.512+0000 7f7366d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2f39a0 0x558d7b2f9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.520 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.512+0000 7f7365d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f0f60 0x558d7b2f8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.520 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.512+0000 7f736659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2ee630 0x558d7b2f7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.520 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.512+0000 7f7365d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f0f60 0x558d7b2f8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:35760/0 (socket says 172.21.15.22:35760) 2024-08-20T01:38:20.520 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.512+0000 7f7366d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2f39a0 0x558d7b2f9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51532/0 (socket says 172.21.15.22:51532) 2024-08-20T01:38:20.520 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.512+0000 7f7365d9b640 1 -- 172.21.15.22:0/1692926437 learned_addr learned my addr 172.21.15.22:0/1692926437 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.513+0000 7f7365d9b640 1 -- 172.21.15.22:0/1692926437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2ee630 msgr2=0x558d7b2f7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.513+0000 7f7365d9b640 1 --2- 172.21.15.22:0/1692926437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2ee630 0x558d7b2f7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.513+0000 7f7365d9b640 1 -- 172.21.15.22:0/1692926437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2f39a0 msgr2=0x558d7b2f9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.513+0000 7f7365d9b640 1 --2- 172.21.15.22:0/1692926437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2f39a0 0x558d7b2f9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.513+0000 7f7365d9b640 1 -- 172.21.15.22:0/1692926437 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d7afb3790 con 0x558d7b2f0f60 2024-08-20T01:38:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.513+0000 7f7365d9b640 1 --2- 172.21.15.22:0/1692926437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f0f60 0x558d7b2f8550 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f735c005bc0 tx=0x7f735c005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a85582976a8e0027 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.513+0000 7f734dffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:38:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.513+0000 7f734dffb640 1 -- 172.21.15.22:0/1692926437 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c02e060 con 0x558d7b2f0f60 2024-08-20T01:38:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.513+0000 7f734dffb640 1 -- 172.21.15.22:0/1692926437 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f735c005410 con 0x558d7b2f0f60 2024-08-20T01:38:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.513+0000 7f736f655740 1 -- 172.21.15.22:0/1692926437 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558d7b1ffe00 con 0x558d7b2f0f60 2024-08-20T01:38:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.513+0000 7f734dffb640 1 -- 172.21.15.22:0/1692926437 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f735c025050 con 0x558d7b2f0f60 2024-08-20T01:38:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.513+0000 7f736f655740 10 client.26164 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.513+0000 7f736f655740 1 -- 172.21.15.22:0/1692926437 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558d7b02c620 con 0x558d7b2f0f60 2024-08-20T01:38:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.514+0000 7f734dffb640 1 -- 172.21.15.22:0/1692926437 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558d7b1ffe00 con 0x558d7b2f0f60 2024-08-20T01:38:20.522 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.514+0000 7f734dffb640 1 -- 172.21.15.22:0/1692926437 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f735c01d020 con 0x558d7b2f0f60 2024-08-20T01:38:20.522 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.514+0000 7f736f655740 10 client.26164 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:20.522 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.514+0000 7f736f655740 10 client.26164 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:38:20.522 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.514+0000 7f736f655740 20 client.26164 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:20.522 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.514+0000 7f736f655740 1 --2- 172.21.15.22:0/1692926437 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558d7b303ae0 0x558d7b305f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.522 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.514+0000 7f736f655740 4 client.26164 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:20.522 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.514+0000 7f736f655740 1 -- 172.21.15.22:0/1692926437 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d7b2632b0 con 0x558d7b303ae0 2024-08-20T01:38:20.522 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.514+0000 7f736659c640 1 --2- 172.21.15.22:0/1692926437 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558d7b303ae0 0x558d7b305f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.514+0000 7f734dffb640 10 client.26164 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:20.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.514+0000 7f736659c640 1 --2- 172.21.15.22:0/1692926437 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558d7b303ae0 0x558d7b305f20 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5126358c8273b9f3 server_cookie=746bc71ece0e2ba0 in_seq=0 out_seq=0 2024-08-20T01:38:20.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.515+0000 7f734dffb640 1 -- 172.21.15.22:0/1692926437 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558d7b2632b0 con 0x558d7b303ae0 2024-08-20T01:38:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.515+0000 7f734dffb640 10 client.26164 handle_command_reply: tid=0 2024-08-20T01:38:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.515+0000 7f736f655740 1 client.26164 shutdown 2024-08-20T01:38:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.515+0000 7f736f655740 1 -- 172.21.15.22:0/1692926437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f0f60 msgr2=0x558d7b2f8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.515+0000 7f736f655740 1 --2- 172.21.15.22:0/1692926437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f0f60 0x558d7b2f8550 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f735c005bc0 tx=0x7f735c005f10 comp rx=0 tx=0).stop 2024-08-20T01:38:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.515+0000 7f736f655740 1 -- 172.21.15.22:0/1692926437 shutdown_connections 2024-08-20T01:38:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.515+0000 7f736f655740 1 --2- 172.21.15.22:0/1692926437 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558d7b303ae0 0x558d7b305f20 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.515+0000 7f736f655740 1 --2- 172.21.15.22:0/1692926437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2f39a0 0x558d7b2f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.515+0000 7f734dffb640 0 client.26164 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.515+0000 7f736f655740 1 --2- 172.21.15.22:0/1692926437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f0f60 0x558d7b2f8550 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.515+0000 7f736f655740 1 --2- 172.21.15.22:0/1692926437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2ee630 0x558d7b2f7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.515+0000 7f736f655740 1 -- 172.21.15.22:0/1692926437 >> 172.21.15.22:0/1692926437 conn(0x558d7b2e9730 msgr2=0x558d7b2e8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.515+0000 7f736f655740 1 -- 172.21.15.22:0/1692926437 shutdown_connections 2024-08-20T01:38:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.515+0000 7f736f655740 1 -- 172.21.15.22:0/1692926437 wait complete. 2024-08-20T01:38:20.525 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.515+0000 7f736f655740 20 client.26164 trim_cache size 0 max 16384 2024-08-20T01:38:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.532+0000 7f736f655740 1 Processor -- start 2024-08-20T01:38:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.532+0000 7f736f655740 1 -- start start 2024-08-20T01:38:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.532+0000 7f736f655740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2ee630 0x558d7b2f7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.532+0000 7f736f655740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2f0f60 0x558d7b2f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.532+0000 7f736f655740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f39a0 0x558d7b2f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.532+0000 7f736f655740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f73681ac720 con 0x558d7b2ee630 2024-08-20T01:38:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.532+0000 7f736f655740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f73681a9f30 con 0x558d7b2f0f60 2024-08-20T01:38:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.532+0000 7f736f655740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f73681a7d80 con 0x558d7b2f39a0 2024-08-20T01:38:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.532+0000 7f736659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2ee630 0x558d7b2f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.532+0000 7f7366d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f39a0 0x558d7b2f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.532+0000 7f736659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2ee630 0x558d7b2f7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51542/0 (socket says 172.21.15.22:51542) 2024-08-20T01:38:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.532+0000 7f736659c640 1 -- 172.21.15.22:0/1224529709 learned_addr learned my addr 172.21.15.22:0/1224529709 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.532+0000 7f7365d9b640 1 --2- 172.21.15.22:0/1224529709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2f0f60 0x558d7b2f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.532+0000 7f7365d9b640 1 -- 172.21.15.22:0/1224529709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f39a0 msgr2=0x558d7b2f42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.532+0000 7f7365d9b640 1 --2- 172.21.15.22:0/1224529709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f39a0 0x558d7b2f42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.532+0000 7f7365d9b640 1 -- 172.21.15.22:0/1224529709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2ee630 msgr2=0x558d7b2f7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.532+0000 7f7365d9b640 1 --2- 172.21.15.22:0/1224529709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2ee630 0x558d7b2f7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.532+0000 7f7365d9b640 1 -- 172.21.15.22:0/1224529709 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d7b3065a0 con 0x558d7b2f0f60 2024-08-20T01:38:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.532+0000 7f7366d9d640 1 --2- 172.21.15.22:0/1224529709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f39a0 0x558d7b2f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.533+0000 7f7365d9b640 1 --2- 172.21.15.22:0/1224529709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2f0f60 0x558d7b2f3d80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f735c004b20 tx=0x7f735c01fec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a872cc8b6fdd7e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.533+0000 7f734ffff640 1 -- 172.21.15.22:0/1224529709 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c02e040 con 0x558d7b2f0f60 2024-08-20T01:38:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.533+0000 7f734ffff640 1 -- 172.21.15.22:0/1224529709 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f735c004520 con 0x558d7b2f0f60 2024-08-20T01:38:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.533+0000 7f734ffff640 1 -- 172.21.15.22:0/1224529709 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c01f6a0 con 0x558d7b2f0f60 2024-08-20T01:38:20.542 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.533+0000 7f736f655740 1 -- 172.21.15.22:0/1224529709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2f0f60 msgr2=0x558d7b2f3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.533+0000 7f736f655740 1 --2- 172.21.15.22:0/1224529709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2f0f60 0x558d7b2f3d80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f735c004b20 tx=0x7f735c01fec0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.533+0000 7f736f655740 1 -- 172.21.15.22:0/1224529709 shutdown_connections 2024-08-20T01:38:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.533+0000 7f736f655740 1 --2- 172.21.15.22:0/1224529709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f39a0 0x558d7b2f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.533+0000 7f736f655740 1 --2- 172.21.15.22:0/1224529709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2f0f60 0x558d7b2f3d80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.533+0000 7f736f655740 1 --2- 172.21.15.22:0/1224529709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2ee630 0x558d7b2f7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.533+0000 7f736f655740 1 -- 172.21.15.22:0/1224529709 >> 172.21.15.22:0/1224529709 conn(0x558d7b2e9730 msgr2=0x558d7b2f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f736f655740 1 -- 172.21.15.22:0/1224529709 shutdown_connections 2024-08-20T01:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f736f655740 1 -- 172.21.15.22:0/1224529709 wait complete. 2024-08-20T01:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f736f655740 1 -- start start 2024-08-20T01:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f736f655740 1 Processor -- start 2024-08-20T01:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f736f655740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2ee630 0x558d7b2fc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f736f655740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2f0f60 0x558d7b2fce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f736f655740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f39a0 0x558d7b2fd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f736f655740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f73681a83f0 con 0x558d7b2f0f60 2024-08-20T01:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f736f655740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f73681a9860 con 0x558d7b2ee630 2024-08-20T01:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f736f655740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f73681a8ac0 con 0x558d7b2f39a0 2024-08-20T01:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f736f655740 10 client.0 _ll_register_callbacks cb 0x7f7358009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f7365d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2f0f60 0x558d7b2fce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f7365d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2f0f60 0x558d7b2fce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51548/0 (socket says 172.21.15.22:51548) 2024-08-20T01:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f7365d9b640 1 -- 172.21.15.22:0/3758702102 learned_addr learned my addr 172.21.15.22:0/3758702102 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f7366d9d640 1 --2- 172.21.15.22:0/3758702102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f39a0 0x558d7b2fd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f736659c640 1 --2- 172.21.15.22:0/3758702102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2ee630 0x558d7b2fc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f7365d9b640 1 -- 172.21.15.22:0/3758702102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f39a0 msgr2=0x558d7b2fd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f7365d9b640 1 --2- 172.21.15.22:0/3758702102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f39a0 0x558d7b2fd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f7365d9b640 1 -- 172.21.15.22:0/3758702102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2ee630 msgr2=0x558d7b2fc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f7365d9b640 1 --2- 172.21.15.22:0/3758702102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2ee630 0x558d7b2fc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.534+0000 7f7365d9b640 1 -- 172.21.15.22:0/3758702102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d7b2fe100 con 0x558d7b2f0f60 2024-08-20T01:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.535+0000 7f7365d9b640 1 --2- 172.21.15.22:0/3758702102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2f0f60 0x558d7b2fce80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f735c0115a0 tx=0x7f735c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f6c59e6e77fe07 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.535+0000 7f734dffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.535+0000 7f734dffb640 1 -- 172.21.15.22:0/3758702102 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c02e070 con 0x558d7b2f0f60 2024-08-20T01:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.535+0000 7f734dffb640 1 -- 172.21.15.22:0/3758702102 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f735c01f640 con 0x558d7b2f0f60 2024-08-20T01:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.535+0000 7f736f655740 1 -- 172.21.15.22:0/3758702102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f735c004520 con 0x558d7b2f0f60 2024-08-20T01:38:20.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.535+0000 7f734dffb640 1 -- 172.21.15.22:0/3758702102 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f735c01f8a0 con 0x558d7b2f0f60 2024-08-20T01:38:20.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.535+0000 7f736f655740 10 client.16524 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:20.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.535+0000 7f736f655740 1 -- 172.21.15.22:0/3758702102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558d7b2ff470 con 0x558d7b2f0f60 2024-08-20T01:38:20.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.535+0000 7f734dffb640 1 -- 172.21.15.22:0/3758702102 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f735c004520 con 0x558d7b2f0f60 2024-08-20T01:38:20.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.535+0000 7f734dffb640 1 -- 172.21.15.22:0/3758702102 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f735c044030 con 0x558d7b2f0f60 2024-08-20T01:38:20.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.535+0000 7f736f655740 10 client.16524 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:20.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.535+0000 7f736f655740 10 client.16524 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:38:20.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.535+0000 7f736f655740 20 client.16524 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:20.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.536+0000 7f736f655740 1 --2- 172.21.15.22:0/3758702102 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558d7b36e800 0x558d7b370bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.536+0000 7f736f655740 4 client.16524 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:38:20.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.536+0000 7f736f655740 1 -- 172.21.15.22:0/3758702102 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558d7b25ed50 con 0x558d7b36e800 2024-08-20T01:38:20.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.536+0000 7f736659c640 1 --2- 172.21.15.22:0/3758702102 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558d7b36e800 0x558d7b370bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.536+0000 7f734dffb640 10 client.16524 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:20.547 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.536+0000 7f736659c640 1 --2- 172.21.15.22:0/3758702102 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558d7b36e800 0x558d7b370bf0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad3886427f0d9598 server_cookie=9a10b20793efb63e in_seq=0 out_seq=0 2024-08-20T01:38:20.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:20 smithi022 ceph-mon[18709]: pgmap v562: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.6 MiB/s wr, 1.17k op/s 2024-08-20T01:38:20.954 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:38:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.977+0000 7f734dffb640 1 -- 172.21.15.22:0/3758702102 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558d7b25ed50 con 0x558d7b36e800 2024-08-20T01:38:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.977+0000 7f734dffb640 10 client.16524 handle_command_reply: tid=0 2024-08-20T01:38:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.977+0000 7f736f655740 1 client.16524 shutdown 2024-08-20T01:38:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.978+0000 7f736f655740 1 -- 172.21.15.22:0/3758702102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2f0f60 msgr2=0x558d7b2fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.978+0000 7f736f655740 1 --2- 172.21.15.22:0/3758702102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2f0f60 0x558d7b2fce80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f735c0115a0 tx=0x7f735c005850 comp rx=0 tx=0).stop 2024-08-20T01:38:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.978+0000 7f736f655740 1 -- 172.21.15.22:0/3758702102 shutdown_connections 2024-08-20T01:38:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.978+0000 7f736f655740 1 --2- 172.21.15.22:0/3758702102 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558d7b36e800 0x558d7b370bf0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.978+0000 7f736f655740 1 --2- 172.21.15.22:0/3758702102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d7b2f39a0 0x558d7b2fd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.978+0000 7f736f655740 1 --2- 172.21.15.22:0/3758702102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d7b2f0f60 0x558d7b2fce80 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.978+0000 7f736f655740 1 --2- 172.21.15.22:0/3758702102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558d7b2ee630 0x558d7b2fc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.978+0000 7f736f655740 1 -- 172.21.15.22:0/3758702102 >> 172.21.15.22:0/3758702102 conn(0x558d7b2e9730 msgr2=0x558d7b2f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.978+0000 7f734dffb640 0 client.16524 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.978+0000 7f736f655740 1 -- 172.21.15.22:0/3758702102 shutdown_connections 2024-08-20T01:38:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.978+0000 7f736f655740 1 -- 172.21.15.22:0/3758702102 wait complete. 2024-08-20T01:38:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.978+0000 7f736f655740 20 client.16524 trim_cache size 0 max 16384 2024-08-20T01:38:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:38:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:38:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:38:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:38:20.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.979+0000 7f736c860640 1 -- 172.21.15.22:0/314983055 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f73500b3bd0 msgr2=0x7f73500b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.979+0000 7f736c860640 1 --2- 172.21.15.22:0/314983055 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f73500b3bd0 0x7f73500b6090 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7358012640 tx=0x7f7358005f90 comp rx=0 tx=0).stop 2024-08-20T01:38:20.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.979+0000 7f736c860640 1 -- 172.21.15.22:0/314983055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7368104190 msgr2=0x7f7368199d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.979+0000 7f736c860640 1 --2- 172.21.15.22:0/314983055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7368104190 0x7f7368199d70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f736002ae00 tx=0x7f7360003ba0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.979+0000 7f736c860640 1 -- 172.21.15.22:0/314983055 shutdown_connections 2024-08-20T01:38:20.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.979+0000 7f736c860640 1 --2- 172.21.15.22:0/314983055 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f73500b3bd0 0x7f73500b6090 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.979+0000 7f736c860640 1 --2- 172.21.15.22:0/314983055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7368104190 0x7f7368199d70 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.979+0000 7f736c860640 1 --2- 172.21.15.22:0/314983055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73681037d0 0x7f7368199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.979+0000 7f736c860640 1 --2- 172.21.15.22:0/314983055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7368102680 0x7f7368198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.980+0000 7f736c860640 1 -- 172.21.15.22:0/314983055 >> 172.21.15.22:0/314983055 conn(0x7f73680fdf40 msgr2=0x7f7368104ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:20.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.980+0000 7f736c860640 1 -- 172.21.15.22:0/314983055 shutdown_connections 2024-08-20T01:38:20.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:20.980+0000 7f736c860640 1 -- 172.21.15.22:0/314983055 wait complete. 2024-08-20T01:38:21.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:20 smithi134 ceph-mon[22511]: pgmap v562: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.6 MiB/s wr, 1.17k op/s 2024-08-20T01:38:21.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:20 smithi077 ceph-mon[22251]: pgmap v562: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.6 MiB/s wr, 1.17k op/s 2024-08-20T01:38:21.253 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:22.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.130+0000 7f2f616d4640 1 -- 172.21.15.22:0/1369715592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c10f070 msgr2=0x7f2f5c111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:22.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.130+0000 7f2f616d4640 1 --2- 172.21.15.22:0/1369715592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c10f070 0x7f2f5c111480 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009ca0 tx=0x7f2f4c02a950 comp rx=0 tx=0).stop 2024-08-20T01:38:22.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.130+0000 7f2f616d4640 1 -- 172.21.15.22:0/1369715592 shutdown_connections 2024-08-20T01:38:22.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.130+0000 7f2f616d4640 1 --2- 172.21.15.22:0/1369715592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c10f070 0x7f2f5c111480 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.130+0000 7f2f616d4640 1 --2- 172.21.15.22:0/1369715592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f5c075b50 0x7f2f5c10eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.130+0000 7f2f616d4640 1 --2- 172.21.15.22:0/1369715592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f5c075230 0x7f2f5c075610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.130+0000 7f2f616d4640 1 -- 172.21.15.22:0/1369715592 >> 172.21.15.22:0/1369715592 conn(0x7f2f5c0fe550 msgr2=0x7f2f5c100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:22.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.130+0000 7f2f616d4640 1 -- 172.21.15.22:0/1369715592 shutdown_connections 2024-08-20T01:38:22.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.130+0000 7f2f616d4640 1 -- 172.21.15.22:0/1369715592 wait complete. 2024-08-20T01:38:22.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.131+0000 7f2f616d4640 1 Processor -- start 2024-08-20T01:38:22.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.131+0000 7f2f616d4640 1 -- start start 2024-08-20T01:38:22.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.131+0000 7f2f616d4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c075230 0x7f2f5c19b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:22.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.131+0000 7f2f616d4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f5c075b50 0x7f2f5c19b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:22.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.131+0000 7f2f616d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f5c10f070 0x7f2f5c1a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:22.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.131+0000 7f2f616d4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c114c90 con 0x7f2f5c075230 2024-08-20T01:38:22.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.131+0000 7f2f616d4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c114b10 con 0x7f2f5c10f070 2024-08-20T01:38:22.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.131+0000 7f2f616d4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c114e10 con 0x7f2f5c075b50 2024-08-20T01:38:22.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.131+0000 7f2f5affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c075230 0x7f2f5c19b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:22.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.131+0000 7f2f5affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c075230 0x7f2f5c19b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51562/0 (socket says 172.21.15.22:51562) 2024-08-20T01:38:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.131+0000 7f2f5affd640 1 -- 172.21.15.22:0/1974575616 learned_addr learned my addr 172.21.15.22:0/1974575616 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.131+0000 7f2f5b7fe640 1 --2- 172.21.15.22:0/1974575616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f5c10f070 0x7f2f5c1a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.131+0000 7f2f5a7fc640 1 --2- 172.21.15.22:0/1974575616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f5c075b50 0x7f2f5c19b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.132+0000 7f2f5affd640 1 -- 172.21.15.22:0/1974575616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f5c075b50 msgr2=0x7f2f5c19b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.132+0000 7f2f5affd640 1 --2- 172.21.15.22:0/1974575616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f5c075b50 0x7f2f5c19b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.132+0000 7f2f5affd640 1 -- 172.21.15.22:0/1974575616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f5c10f070 msgr2=0x7f2f5c1a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.132+0000 7f2f5affd640 1 --2- 172.21.15.22:0/1974575616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f5c10f070 0x7f2f5c1a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.132+0000 7f2f5affd640 1 -- 172.21.15.22:0/1974575616 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c1a1370 con 0x7f2f5c075230 2024-08-20T01:38:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.132+0000 7f2f5affd640 1 --2- 172.21.15.22:0/1974575616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c075230 0x7f2f5c19b2c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400d950 tx=0x7f2f5400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.132+0000 7f2f53fff640 1 -- 172.21.15.22:0/1974575616 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f54017070 con 0x7f2f5c075230 2024-08-20T01:38:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.132+0000 7f2f616d4640 1 -- 172.21.15.22:0/1974575616 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5c1a1660 con 0x7f2f5c075230 2024-08-20T01:38:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.132+0000 7f2f53fff640 1 -- 172.21.15.22:0/1974575616 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f54009c30 con 0x7f2f5c075230 2024-08-20T01:38:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.132+0000 7f2f53fff640 1 -- 172.21.15.22:0/1974575616 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400f620 con 0x7f2f5c075230 2024-08-20T01:38:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.132+0000 7f2f616d4640 1 -- 172.21.15.22:0/1974575616 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5c1a7ef0 con 0x7f2f5c075230 2024-08-20T01:38:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.135+0000 7f2f63acd740 1 Processor -- start 2024-08-20T01:38:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.135+0000 7f2f63acd740 1 -- start start 2024-08-20T01:38:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.136+0000 7f2f63acd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 0x5558402a4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.136+0000 7f2f63acd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.136+0000 7f2f63acd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402b0fe0 0x5558402b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.136+0000 7f2f63acd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55584021b930 con 0x5558402a5050 2024-08-20T01:38:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.136+0000 7f2f63acd740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55584020ae30 con 0x5558402b0fe0 2024-08-20T01:38:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.136+0000 7f2f63acd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55584020ee70 con 0x5558402a4730 2024-08-20T01:38:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.136+0000 7f2f53fff640 1 -- 172.21.15.22:0/1974575616 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2f54010460 con 0x7f2f5c075230 2024-08-20T01:38:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.136+0000 7f2f5b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 0x5558402a4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.136+0000 7f2f5b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 0x5558402a4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:35796/0 (socket says 172.21.15.22:35796) 2024-08-20T01:38:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.136+0000 7f2f5affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.136+0000 7f2f5b7fe640 1 -- 172.21.15.22:0/2438282672 learned_addr learned my addr 172.21.15.22:0/2438282672 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.136+0000 7f2f5a7fc640 1 --2- 172.21.15.22:0/2438282672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402b0fe0 0x5558402b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.136+0000 7f2f5affd640 1 -- 172.21.15.22:0/2438282672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 msgr2=0x5558402a4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.136+0000 7f2f5affd640 1 --2- 172.21.15.22:0/2438282672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 0x5558402a4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.136+0000 7f2f5affd640 1 -- 172.21.15.22:0/2438282672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402b0fe0 msgr2=0x5558402b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.136+0000 7f2f5affd640 1 --2- 172.21.15.22:0/2438282672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402b0fe0 0x5558402b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.136+0000 7f2f5affd640 1 -- 172.21.15.22:0/2438282672 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55583ff6a650 con 0x5558402a5050 2024-08-20T01:38:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.136+0000 7f2f5b7fe640 1 --2- 172.21.15.22:0/2438282672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 0x5558402a4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.136+0000 7f2f5a7fc640 1 --2- 172.21.15.22:0/2438282672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402b0fe0 0x5558402b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.137+0000 7f2f5affd640 1 --2- 172.21.15.22:0/2438282672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402b0aa0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2f540e1220 tx=0x7f2f540eb690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284c4a1d2ffaf004 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.137+0000 7f2f517fa640 1 -- 172.21.15.22:0/2438282672 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f540f2070 con 0x5558402a5050 2024-08-20T01:38:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.137+0000 7f2f517fa640 1 -- 172.21.15.22:0/2438282672 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f540eeaf0 con 0x5558402a5050 2024-08-20T01:38:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.137+0000 7f2f517fa640 1 -- 172.21.15.22:0/2438282672 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f540e55e0 con 0x5558402a5050 2024-08-20T01:38:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.137+0000 7f2f53fff640 1 --2- 172.21.15.22:0/1974575616 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2f480b3bd0 0x7f2f480b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.137+0000 7f2f5b7fe640 1 --2- 172.21.15.22:0/1974575616 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2f480b3bd0 0x7f2f480b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.137+0000 7f2f53fff640 1 -- 172.21.15.22:0/1974575616 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f2f540e37c0 con 0x7f2f5c075230 2024-08-20T01:38:22.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.138+0000 7f2f63acd740 1 -- 172.21.15.22:0/2438282672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 msgr2=0x5558402b0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:22.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.138+0000 7f2f63acd740 1 --2- 172.21.15.22:0/2438282672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402b0aa0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2f540e1220 tx=0x7f2f540eb690 comp rx=0 tx=0).stop 2024-08-20T01:38:22.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.138+0000 7f2f63acd740 1 -- 172.21.15.22:0/2438282672 shutdown_connections 2024-08-20T01:38:22.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.138+0000 7f2f63acd740 1 --2- 172.21.15.22:0/2438282672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402b0fe0 0x5558402b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.138+0000 7f2f63acd740 1 --2- 172.21.15.22:0/2438282672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402b0aa0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.138+0000 7f2f63acd740 1 --2- 172.21.15.22:0/2438282672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 0x5558402a4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.138+0000 7f2f63acd740 1 -- 172.21.15.22:0/2438282672 >> 172.21.15.22:0/2438282672 conn(0x5558402a2560 msgr2=0x5558402a3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:22.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.138+0000 7f2f5b7fe640 1 --2- 172.21.15.22:0/1974575616 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2f480b3bd0 0x7f2f480b6090 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009430 tx=0x7f2f4c005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:22.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.138+0000 7f2f63acd740 1 -- 172.21.15.22:0/2438282672 shutdown_connections 2024-08-20T01:38:22.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.138+0000 7f2f63acd740 1 -- 172.21.15.22:0/2438282672 wait complete. 2024-08-20T01:38:22.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.138+0000 7f2f63acd740 1 -- start start 2024-08-20T01:38:22.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.138+0000 7f2f63acd740 1 Processor -- start 2024-08-20T01:38:22.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f63acd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402a4730 0x5558402adf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:22.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f63acd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402ae490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:22.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f63acd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402b0fe0 0x5558402ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:22.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f63acd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55584006d700 con 0x5558402a5050 2024-08-20T01:38:22.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f63acd740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555840191810 con 0x5558402a4730 2024-08-20T01:38:22.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f63acd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5558402b3c90 con 0x5558402b0fe0 2024-08-20T01:38:22.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f63acd740 10 client.0 _ll_register_callbacks cb 0x555840204700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:22.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f5a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:22.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f5a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402ae490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51580/0 (socket says 172.21.15.22:51580) 2024-08-20T01:38:22.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f5a7fc640 1 -- 172.21.15.22:0/908542999 learned_addr learned my addr 172.21.15.22:0/908542999 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:22.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f5b7fe640 1 --2- 172.21.15.22:0/908542999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402b0fe0 0x5558402ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:22.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f5affd640 1 --2- 172.21.15.22:0/908542999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402a4730 0x5558402adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:22.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f5a7fc640 1 -- 172.21.15.22:0/908542999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402b0fe0 msgr2=0x5558402ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:22.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f5a7fc640 1 --2- 172.21.15.22:0/908542999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402b0fe0 0x5558402ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f5a7fc640 1 -- 172.21.15.22:0/908542999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402a4730 msgr2=0x5558402adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:22.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f5a7fc640 1 --2- 172.21.15.22:0/908542999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402a4730 0x5558402adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f5a7fc640 1 -- 172.21.15.22:0/908542999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558402bd040 con 0x5558402a5050 2024-08-20T01:38:22.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f5a7fc640 1 --2- 172.21.15.22:0/908542999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402ae490 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400b9f0 tx=0x7f2f4400beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235c6c540426f3da server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:22.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f427fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:38:22.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f427fc640 1 -- 172.21.15.22:0/908542999 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f44003d60 con 0x5558402a5050 2024-08-20T01:38:22.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f427fc640 1 -- 172.21.15.22:0/908542999 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f2f44005020 con 0x5558402a5050 2024-08-20T01:38:22.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.139+0000 7f2f63acd740 1 -- 172.21.15.22:0/908542999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5558401ba150 con 0x5558402a5050 2024-08-20T01:38:22.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.140+0000 7f2f427fc640 1 -- 172.21.15.22:0/908542999 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2f44005220 con 0x5558402a5050 2024-08-20T01:38:22.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.140+0000 7f2f63acd740 10 client.16536 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:22.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.140+0000 7f2f63acd740 1 -- 172.21.15.22:0/908542999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5558402bfa50 con 0x5558402a5050 2024-08-20T01:38:22.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.140+0000 7f2f427fc640 1 -- 172.21.15.22:0/908542999 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5558401ba150 con 0x5558402a5050 2024-08-20T01:38:22.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.140+0000 7f2f427fc640 1 -- 172.21.15.22:0/908542999 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f2f4401b470 con 0x5558402a5050 2024-08-20T01:38:22.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.140+0000 7f2f63acd740 10 client.16536 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:22.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.140+0000 7f2f63acd740 10 client.16536 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:38:22.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.140+0000 7f2f63acd740 20 client.16536 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.140+0000 7f2f63acd740 1 --2- 172.21.15.22:0/908542999 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5558402c0f60 0x5558402c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.140+0000 7f2f63acd740 4 client.16536 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.140+0000 7f2f63acd740 1 -- 172.21.15.22:0/908542999 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55584021d880 con 0x5558402c0f60 2024-08-20T01:38:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.140+0000 7f2f5affd640 1 --2- 172.21.15.22:0/908542999 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5558402c0f60 0x5558402c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.141+0000 7f2f5affd640 1 --2- 172.21.15.22:0/908542999 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5558402c0f60 0x5558402c33b0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62fd5304beb6fa95 server_cookie=ea0ce8bf42d8c66c in_seq=0 out_seq=0 2024-08-20T01:38:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.141+0000 7f2f427fc640 10 client.16536 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.142+0000 7f2f427fc640 1 -- 172.21.15.22:0/908542999 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55584021d880 con 0x5558402c0f60 2024-08-20T01:38:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.142+0000 7f2f427fc640 10 client.16536 handle_command_reply: tid=0 2024-08-20T01:38:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.142+0000 7f2f63acd740 1 client.16536 shutdown 2024-08-20T01:38:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.142+0000 7f2f63acd740 1 -- 172.21.15.22:0/908542999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 msgr2=0x5558402ae490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.142+0000 7f2f63acd740 1 --2- 172.21.15.22:0/908542999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402ae490 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400b9f0 tx=0x7f2f4400beb0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.142+0000 7f2f63acd740 1 -- 172.21.15.22:0/908542999 shutdown_connections 2024-08-20T01:38:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.142+0000 7f2f63acd740 1 --2- 172.21.15.22:0/908542999 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5558402c0f60 0x5558402c33b0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.142+0000 7f2f63acd740 1 --2- 172.21.15.22:0/908542999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402b0fe0 0x5558402ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.142+0000 7f2f427fc640 0 client.16536 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.142+0000 7f2f63acd740 1 --2- 172.21.15.22:0/908542999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402ae490 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.142+0000 7f2f63acd740 1 --2- 172.21.15.22:0/908542999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402a4730 0x5558402adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.142+0000 7f2f63acd740 1 -- 172.21.15.22:0/908542999 >> 172.21.15.22:0/908542999 conn(0x5558402a2560 msgr2=0x5558402a8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.142+0000 7f2f63acd740 1 -- 172.21.15.22:0/908542999 shutdown_connections 2024-08-20T01:38:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.142+0000 7f2f63acd740 1 -- 172.21.15.22:0/908542999 wait complete. 2024-08-20T01:38:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.142+0000 7f2f63acd740 20 client.16536 trim_cache size 0 max 16384 2024-08-20T01:38:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.156+0000 7f2f63acd740 1 Processor -- start 2024-08-20T01:38:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.156+0000 7f2f63acd740 1 -- start start 2024-08-20T01:38:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.156+0000 7f2f63acd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 0x5558402a88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.156+0000 7f2f63acd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.156+0000 7f2f63acd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402b0fe0 0x5558402c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.156+0000 7f2f63acd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1b2f00 con 0x5558402a5050 2024-08-20T01:38:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.156+0000 7f2f63acd740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1b0710 con 0x5558402b0fe0 2024-08-20T01:38:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.156+0000 7f2f63acd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1ae560 con 0x5558402a4730 2024-08-20T01:38:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.156+0000 7f2f5a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.156+0000 7f2f5affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 0x5558402a88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.156+0000 7f2f5a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402a13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51582/0 (socket says 172.21.15.22:51582) 2024-08-20T01:38:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.156+0000 7f2f5affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 0x5558402a88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:35816/0 (socket says 172.21.15.22:35816) 2024-08-20T01:38:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.156+0000 7f2f5a7fc640 1 -- 172.21.15.22:0/3670930334 learned_addr learned my addr 172.21.15.22:0/3670930334 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.157+0000 7f2f5b7fe640 1 --2- 172.21.15.22:0/3670930334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402b0fe0 0x5558402c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.157+0000 7f2f5affd640 1 -- 172.21.15.22:0/3670930334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402b0fe0 msgr2=0x5558402c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.157+0000 7f2f5affd640 1 --2- 172.21.15.22:0/3670930334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402b0fe0 0x5558402c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.157+0000 7f2f5affd640 1 -- 172.21.15.22:0/3670930334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 msgr2=0x5558402a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.157+0000 7f2f5affd640 1 --2- 172.21.15.22:0/3670930334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402a13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.157+0000 7f2f5affd640 1 -- 172.21.15.22:0/3670930334 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558402a2fe0 con 0x5558402a4730 2024-08-20T01:38:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.157+0000 7f2f5b7fe640 1 --2- 172.21.15.22:0/3670930334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402b0fe0 0x5558402c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:22.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.157+0000 7f2f5a7fc640 1 --2- 172.21.15.22:0/3670930334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:22.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.157+0000 7f2f5affd640 1 --2- 172.21.15.22:0/3670930334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 0x5558402a88f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2f540aa710 tx=0x7f2f54005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41b9f4a9a7f4bf83 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:22.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.157+0000 7f2f50ff9640 1 -- 172.21.15.22:0/3670930334 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f54020070 con 0x5558402a4730 2024-08-20T01:38:22.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.157+0000 7f2f50ff9640 1 -- 172.21.15.22:0/3670930334 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f540ebe90 con 0x5558402a4730 2024-08-20T01:38:22.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.157+0000 7f2f50ff9640 1 -- 172.21.15.22:0/3670930334 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f540f2070 con 0x5558402a4730 2024-08-20T01:38:22.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.158+0000 7f2f63acd740 1 -- 172.21.15.22:0/3670930334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 msgr2=0x5558402a88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:22.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.158+0000 7f2f63acd740 1 --2- 172.21.15.22:0/3670930334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 0x5558402a88f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2f540aa710 tx=0x7f2f54005880 comp rx=0 tx=0).stop 2024-08-20T01:38:22.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.158+0000 7f2f63acd740 1 -- 172.21.15.22:0/3670930334 shutdown_connections 2024-08-20T01:38:22.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.158+0000 7f2f63acd740 1 --2- 172.21.15.22:0/3670930334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402b0fe0 0x5558402c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.158+0000 7f2f63acd740 1 --2- 172.21.15.22:0/3670930334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.158+0000 7f2f63acd740 1 --2- 172.21.15.22:0/3670930334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 0x5558402a88f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.158+0000 7f2f63acd740 1 -- 172.21.15.22:0/3670930334 >> 172.21.15.22:0/3670930334 conn(0x5558402a2560 msgr2=0x5558402a0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:22.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.158+0000 7f2f63acd740 1 -- 172.21.15.22:0/3670930334 shutdown_connections 2024-08-20T01:38:22.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.158+0000 7f2f63acd740 1 -- 172.21.15.22:0/3670930334 wait complete. 2024-08-20T01:38:22.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.158+0000 7f2f63acd740 1 -- start start 2024-08-20T01:38:22.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.159+0000 7f2f63acd740 1 Processor -- start 2024-08-20T01:38:22.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.159+0000 7f2f63acd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 0x5558402b8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:22.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.159+0000 7f2f63acd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402b9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:22.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.159+0000 7f2f63acd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402b0fe0 0x5558402aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:22.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.159+0000 7f2f63acd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1aebd0 con 0x5558402a5050 2024-08-20T01:38:22.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.159+0000 7f2f63acd740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1b0040 con 0x5558402b0fe0 2024-08-20T01:38:22.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.159+0000 7f2f63acd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1af2a0 con 0x5558402a4730 2024-08-20T01:38:22.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.159+0000 7f2f63acd740 10 client.0 _ll_register_callbacks cb 0x7f2f44004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:22.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.159+0000 7f2f5affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 0x5558402b8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:22.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.159+0000 7f2f5b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402b0fe0 0x5558402aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:22.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.159+0000 7f2f5affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 0x5558402b8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:35828/0 (socket says 172.21.15.22:35828) 2024-08-20T01:38:22.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.159+0000 7f2f5a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402b9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:22.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.159+0000 7f2f5affd640 1 -- 172.21.15.22:0/1525415784 learned_addr learned my addr 172.21.15.22:0/1525415784 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:22.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.159+0000 7f2f5b7fe640 1 -- 172.21.15.22:0/1525415784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 msgr2=0x5558402b8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:22.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.159+0000 7f2f5b7fe640 1 --2- 172.21.15.22:0/1525415784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 0x5558402b8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.159+0000 7f2f5b7fe640 1 -- 172.21.15.22:0/1525415784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 msgr2=0x5558402b9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:22.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.159+0000 7f2f5b7fe640 1 --2- 172.21.15.22:0/1525415784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402b9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.159+0000 7f2f5b7fe640 1 -- 172.21.15.22:0/1525415784 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558402b9b80 con 0x5558402b0fe0 2024-08-20T01:38:22.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.159+0000 7f2f5affd640 1 --2- 172.21.15.22:0/1525415784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 0x5558402b8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:22.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.160+0000 7f2f5b7fe640 1 --2- 172.21.15.22:0/1525415784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402b0fe0 0x5558402aa2c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c030040 tx=0x7f2f4c0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be3c7638edfc27cd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:22.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.160+0000 7f2f427fc640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:38:22.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.160+0000 7f2f427fc640 1 -- 172.21.15.22:0/1525415784 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c034040 con 0x5558402b0fe0 2024-08-20T01:38:22.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.160+0000 7f2f63acd740 1 -- 172.21.15.22:0/1525415784 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f540ebe90 con 0x5558402b0fe0 2024-08-20T01:38:22.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.160+0000 7f2f427fc640 1 -- 172.21.15.22:0/1525415784 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f2f4c004690 con 0x5558402b0fe0 2024-08-20T01:38:22.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.160+0000 7f2f427fc640 1 -- 172.21.15.22:0/1525415784 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2f4c053480 con 0x5558402b0fe0 2024-08-20T01:38:22.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.160+0000 7f2f63acd740 10 client.26168 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:22.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.160+0000 7f2f63acd740 1 -- 172.21.15.22:0/1525415784 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55584032b2e0 con 0x5558402b0fe0 2024-08-20T01:38:22.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.160+0000 7f2f427fc640 1 -- 172.21.15.22:0/1525415784 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f540ebe90 con 0x5558402b0fe0 2024-08-20T01:38:22.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.160+0000 7f2f427fc640 1 -- 172.21.15.22:0/1525415784 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f2f4c0304b0 con 0x5558402b0fe0 2024-08-20T01:38:22.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.160+0000 7f2f63acd740 10 client.26168 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:22.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.160+0000 7f2f63acd740 10 client.26168 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:38:22.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.160+0000 7f2f63acd740 20 client.26168 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:22.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.160+0000 7f2f63acd740 1 --2- 172.21.15.22:0/1525415784 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5558402c0f60 0x55584032da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:22.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.160+0000 7f2f63acd740 4 client.26168 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:38:22.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.160+0000 7f2f63acd740 1 -- 172.21.15.22:0/1525415784 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555840219320 con 0x5558402c0f60 2024-08-20T01:38:22.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.161+0000 7f2f5affd640 1 --2- 172.21.15.22:0/1525415784 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5558402c0f60 0x55584032da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:22.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.161+0000 7f2f5affd640 1 --2- 172.21.15.22:0/1525415784 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5558402c0f60 0x55584032da70 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=400a638e53f3b955 server_cookie=1140ef6f374b566f in_seq=0 out_seq=0 2024-08-20T01:38:22.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.161+0000 7f2f427fc640 10 client.26168 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:22.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.161+0000 7f2f427fc640 1 -- 172.21.15.22:0/1525415784 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555840219320 con 0x5558402c0f60 2024-08-20T01:38:22.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.161+0000 7f2f427fc640 10 client.26168 handle_command_reply: tid=0 2024-08-20T01:38:22.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.161+0000 7f2f63acd740 1 client.26168 shutdown 2024-08-20T01:38:22.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.161+0000 7f2f63acd740 1 -- 172.21.15.22:0/1525415784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402b0fe0 msgr2=0x5558402aa2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:22.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.161+0000 7f2f63acd740 1 --2- 172.21.15.22:0/1525415784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402b0fe0 0x5558402aa2c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c030040 tx=0x7f2f4c0095c0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.161+0000 7f2f63acd740 1 -- 172.21.15.22:0/1525415784 shutdown_connections 2024-08-20T01:38:22.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.161+0000 7f2f63acd740 1 --2- 172.21.15.22:0/1525415784 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5558402c0f60 0x55584032da70 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.161+0000 7f2f63acd740 1 --2- 172.21.15.22:0/1525415784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558402b0fe0 0x5558402aa2c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.161+0000 7f2f63acd740 1 --2- 172.21.15.22:0/1525415784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558402a5050 0x5558402b9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.161+0000 7f2f427fc640 0 client.26168 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:22.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.161+0000 7f2f63acd740 1 --2- 172.21.15.22:0/1525415784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5558402a4730 0x5558402b8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.161+0000 7f2f63acd740 1 -- 172.21.15.22:0/1525415784 >> 172.21.15.22:0/1525415784 conn(0x5558402a2560 msgr2=0x5558402a14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:22.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.161+0000 7f2f63acd740 1 -- 172.21.15.22:0/1525415784 shutdown_connections 2024-08-20T01:38:22.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.161+0000 7f2f63acd740 1 -- 172.21.15.22:0/1525415784 wait complete. 2024-08-20T01:38:22.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.161+0000 7f2f63acd740 20 client.26168 trim_cache size 0 max 16384 2024-08-20T01:38:22.170 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:38:22.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.162+0000 7f2f616d4640 1 -- 172.21.15.22:0/1974575616 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2f480b3bd0 msgr2=0x7f2f480b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:22.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.162+0000 7f2f616d4640 1 --2- 172.21.15.22:0/1974575616 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2f480b3bd0 0x7f2f480b6090 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009430 tx=0x7f2f4c005c50 comp rx=0 tx=0).stop 2024-08-20T01:38:22.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.162+0000 7f2f616d4640 1 -- 172.21.15.22:0/1974575616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c075230 msgr2=0x7f2f5c19b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:22.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.162+0000 7f2f616d4640 1 --2- 172.21.15.22:0/1974575616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c075230 0x7f2f5c19b2c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400d950 tx=0x7f2f5400de10 comp rx=0 tx=0).stop 2024-08-20T01:38:22.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.162+0000 7f2f616d4640 1 -- 172.21.15.22:0/1974575616 shutdown_connections 2024-08-20T01:38:22.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.162+0000 7f2f616d4640 1 --2- 172.21.15.22:0/1974575616 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f2f480b3bd0 0x7f2f480b6090 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.162+0000 7f2f616d4640 1 --2- 172.21.15.22:0/1974575616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f5c10f070 0x7f2f5c1a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.162+0000 7f2f616d4640 1 --2- 172.21.15.22:0/1974575616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f5c075b50 0x7f2f5c19b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.162+0000 7f2f616d4640 1 --2- 172.21.15.22:0/1974575616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c075230 0x7f2f5c19b2c0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:22.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.162+0000 7f2f616d4640 1 -- 172.21.15.22:0/1974575616 >> 172.21.15.22:0/1974575616 conn(0x7f2f5c0fe550 msgr2=0x7f2f5c0ff150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:22.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.162+0000 7f2f616d4640 1 -- 172.21.15.22:0/1974575616 shutdown_connections 2024-08-20T01:38:22.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:22.162+0000 7f2f616d4640 1 -- 172.21.15.22:0/1974575616 wait complete. 2024-08-20T01:38:22.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:22 smithi022 ceph-mon[18709]: pgmap v563: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.0 MiB/s wr, 777 op/s 2024-08-20T01:38:23.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:22 smithi134 ceph-mon[22511]: pgmap v563: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.0 MiB/s wr, 777 op/s 2024-08-20T01:38:23.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:22 smithi077 ceph-mon[22251]: pgmap v563: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.0 MiB/s wr, 777 op/s 2024-08-20T01:38:23.832 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:38:23.832 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:38:24.150 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:24.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.628+0000 7fddc908d640 1 -- 172.21.15.22:0/3987028741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddc4103870 msgr2=0x7fddc4103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:24.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.628+0000 7fddc908d640 1 --2- 172.21.15.22:0/3987028741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddc4103870 0x7fddc4103c50 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009ca0 tx=0x7fddb402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.628+0000 7fddc908d640 1 -- 172.21.15.22:0/3987028741 shutdown_connections 2024-08-20T01:38:24.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.628+0000 7fddc908d640 1 --2- 172.21.15.22:0/3987028741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddc410ce20 0x7fddc410f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.628+0000 7fddc908d640 1 --2- 172.21.15.22:0/3987028741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddc4104270 0x7fddc410c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.628+0000 7fddc908d640 1 --2- 172.21.15.22:0/3987028741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddc4103870 0x7fddc4103c50 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.628+0000 7fddc908d640 1 -- 172.21.15.22:0/3987028741 >> 172.21.15.22:0/3987028741 conn(0x7fddc40fd400 msgr2=0x7fddc40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:24.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.629+0000 7fddc908d640 1 -- 172.21.15.22:0/3987028741 shutdown_connections 2024-08-20T01:38:24.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.629+0000 7fddc908d640 1 -- 172.21.15.22:0/3987028741 wait complete. 2024-08-20T01:38:24.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.629+0000 7fddc908d640 1 Processor -- start 2024-08-20T01:38:24.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.629+0000 7fddc908d640 1 -- start start 2024-08-20T01:38:24.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.630+0000 7fddc908d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddc4103870 0x7fddc4198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.630+0000 7fddc908d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddc4104270 0x7fddc4199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.630+0000 7fddc908d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddc410ce20 0x7fddc419e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.630+0000 7fddc908d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fddc4112a60 con 0x7fddc410ce20 2024-08-20T01:38:24.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.630+0000 7fddc908d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fddc41128e0 con 0x7fddc4103870 2024-08-20T01:38:24.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.630+0000 7fddc908d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fddc4112be0 con 0x7fddc4104270 2024-08-20T01:38:24.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.630+0000 7fddc359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddc410ce20 0x7fddc419e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.630+0000 7fddc359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddc410ce20 0x7fddc419e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51612/0 (socket says 172.21.15.22:51612) 2024-08-20T01:38:24.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.630+0000 7fddc259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddc4104270 0x7fddc4199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.630+0000 7fddc359e640 1 -- 172.21.15.22:0/236401136 learned_addr learned my addr 172.21.15.22:0/236401136 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:24.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.630+0000 7fddc2d9d640 1 --2- 172.21.15.22:0/236401136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddc4103870 0x7fddc4198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.630+0000 7fddc359e640 1 -- 172.21.15.22:0/236401136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddc4104270 msgr2=0x7fddc4199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:24.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.630+0000 7fddc359e640 1 --2- 172.21.15.22:0/236401136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddc4104270 0x7fddc4199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.630+0000 7fddc359e640 1 -- 172.21.15.22:0/236401136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddc4103870 msgr2=0x7fddc4198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:24.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.630+0000 7fddc359e640 1 --2- 172.21.15.22:0/236401136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddc4103870 0x7fddc4198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.630+0000 7fddc359e640 1 -- 172.21.15.22:0/236401136 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc419ef00 con 0x7fddc410ce20 2024-08-20T01:38:24.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.630+0000 7fddc359e640 1 --2- 172.21.15.22:0/236401136 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddc410ce20 0x7fddc419e730 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00e970 tx=0x7fddbc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:24.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.631+0000 7fddabfff640 1 -- 172.21.15.22:0/236401136 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00ccc0 con 0x7fddc410ce20 2024-08-20T01:38:24.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.631+0000 7fddc908d640 1 -- 172.21.15.22:0/236401136 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc419f1f0 con 0x7fddc410ce20 2024-08-20T01:38:24.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.631+0000 7fddabfff640 1 -- 172.21.15.22:0/236401136 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddbc00ce60 con 0x7fddc410ce20 2024-08-20T01:38:24.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.631+0000 7fddabfff640 1 -- 172.21.15.22:0/236401136 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc010430 con 0x7fddc410ce20 2024-08-20T01:38:24.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.631+0000 7fddc908d640 1 -- 172.21.15.22:0/236401136 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc41a5a80 con 0x7fddc410ce20 2024-08-20T01:38:24.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.634+0000 7fddcb486740 1 Processor -- start 2024-08-20T01:38:24.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.634+0000 7fddabfff640 1 -- 172.21.15.22:0/236401136 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fddbc004f20 con 0x7fddc410ce20 2024-08-20T01:38:24.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.634+0000 7fddcb486740 1 -- start start 2024-08-20T01:38:24.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.634+0000 7fddcb486740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d7633b0 0x55846d763790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.634+0000 7fddcb486740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d763cd0 0x55846d76f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.634+0000 7fddcb486740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d76fc60 0x55846d772050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.634+0000 7fddcb486740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55846d6d9940 con 0x55846d7633b0 2024-08-20T01:38:24.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.634+0000 7fddcb486740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55846d6c8e40 con 0x55846d76fc60 2024-08-20T01:38:24.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.634+0000 7fddcb486740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55846d6cce80 con 0x55846d763cd0 2024-08-20T01:38:24.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.634+0000 7fddc259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d7633b0 0x55846d763790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.634+0000 7fddc259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d7633b0 0x55846d763790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51616/0 (socket says 172.21.15.22:51616) 2024-08-20T01:38:24.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.634+0000 7fddc259c640 1 -- 172.21.15.22:0/2743959860 learned_addr learned my addr 172.21.15.22:0/2743959860 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:24.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.634+0000 7fddc2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d763cd0 0x55846d76f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.634+0000 7fddc259c640 1 --2- 172.21.15.22:0/2743959860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d76fc60 0x55846d772050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.634+0000 7fddc2d9d640 1 -- 172.21.15.22:0/2743959860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d76fc60 msgr2=0x55846d772050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:24.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.634+0000 7fddc2d9d640 1 --2- 172.21.15.22:0/2743959860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d76fc60 0x55846d772050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.635+0000 7fddc2d9d640 1 -- 172.21.15.22:0/2743959860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d7633b0 msgr2=0x55846d763790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:24.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.635+0000 7fddc2d9d640 1 --2- 172.21.15.22:0/2743959860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d7633b0 0x55846d763790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.635+0000 7fddabfff640 1 --2- 172.21.15.22:0/236401136 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fddac0b3bd0 0x7fddac0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.635+0000 7fddc2d9d640 1 -- 172.21.15.22:0/2743959860 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55846d665520 con 0x55846d763cd0 2024-08-20T01:38:24.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.635+0000 7fddc259c640 1 --2- 172.21.15.22:0/2743959860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d7633b0 0x55846d763790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:24.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.635+0000 7fddc359e640 1 --2- 172.21.15.22:0/236401136 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fddac0b3bd0 0x7fddac0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.635+0000 7fddc2d9d640 1 --2- 172.21.15.22:0/2743959860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d763cd0 0x55846d76f720 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fddb4006010 tx=0x7fddb4005fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f737b8e8f9be7e12 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:24.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.635+0000 7fdda97fa640 1 -- 172.21.15.22:0/2743959860 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4031db0 con 0x55846d763cd0 2024-08-20T01:38:24.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.635+0000 7fdda97fa640 1 -- 172.21.15.22:0/2743959860 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddb4036070 con 0x55846d763cd0 2024-08-20T01:38:24.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.635+0000 7fdda97fa640 1 -- 172.21.15.22:0/2743959860 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4004330 con 0x55846d763cd0 2024-08-20T01:38:24.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.635+0000 7fddabfff640 1 -- 172.21.15.22:0/236401136 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fddbc0b39d0 con 0x7fddc410ce20 2024-08-20T01:38:24.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.636+0000 7fddcb486740 1 -- 172.21.15.22:0/2743959860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d763cd0 msgr2=0x55846d76f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:24.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.636+0000 7fddcb486740 1 --2- 172.21.15.22:0/2743959860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d763cd0 0x55846d76f720 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fddb4006010 tx=0x7fddb4005fa0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.636+0000 7fddc359e640 1 --2- 172.21.15.22:0/236401136 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fddac0b3bd0 0x7fddac0b6090 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0aad40 tx=0x7fddbc094040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:24.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.636+0000 7fddcb486740 1 -- 172.21.15.22:0/2743959860 shutdown_connections 2024-08-20T01:38:24.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.636+0000 7fddcb486740 1 --2- 172.21.15.22:0/2743959860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d76fc60 0x55846d772050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.636+0000 7fddcb486740 1 --2- 172.21.15.22:0/2743959860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d763cd0 0x55846d76f720 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.636+0000 7fddcb486740 1 --2- 172.21.15.22:0/2743959860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d7633b0 0x55846d763790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.636+0000 7fddcb486740 1 -- 172.21.15.22:0/2743959860 >> 172.21.15.22:0/2743959860 conn(0x55846d7611e0 msgr2=0x55846d762380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:24.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.636+0000 7fddcb486740 1 -- 172.21.15.22:0/2743959860 shutdown_connections 2024-08-20T01:38:24.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.636+0000 7fddcb486740 1 -- 172.21.15.22:0/2743959860 wait complete. 2024-08-20T01:38:24.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.636+0000 7fddcb486740 1 -- start start 2024-08-20T01:38:24.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.636+0000 7fddcb486740 1 Processor -- start 2024-08-20T01:38:24.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fddcb486740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d7633b0 0x55846d76cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fddcb486740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d763cd0 0x55846d76d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fddcb486740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d76fc60 0x55846d76d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fddcb486740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55846d52b890 con 0x55846d76fc60 2024-08-20T01:38:24.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fddcb486740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55846d64f700 con 0x55846d7633b0 2024-08-20T01:38:24.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fddcb486740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55846d7727d0 con 0x55846d763cd0 2024-08-20T01:38:24.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fddcb486740 10 client.0 _ll_register_callbacks cb 0x55846d6c46f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:24.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fddc2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d763cd0 0x55846d76d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fddc259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d76fc60 0x55846d76d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fddc2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d763cd0 0x55846d76d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:35868/0 (socket says 172.21.15.22:35868) 2024-08-20T01:38:24.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fddc2d9d640 1 -- 172.21.15.22:0/2229677306 learned_addr learned my addr 172.21.15.22:0/2229677306 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:24.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fddc259c640 1 --2- 172.21.15.22:0/2229677306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d7633b0 0x55846d76cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fddc2d9d640 1 -- 172.21.15.22:0/2229677306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d7633b0 msgr2=0x55846d76cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:24.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fddc2d9d640 1 --2- 172.21.15.22:0/2229677306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d7633b0 0x55846d76cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fddc2d9d640 1 -- 172.21.15.22:0/2229677306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d76fc60 msgr2=0x55846d76d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:24.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fddc2d9d640 1 --2- 172.21.15.22:0/2229677306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d76fc60 0x55846d76d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fddc2d9d640 1 -- 172.21.15.22:0/2229677306 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55846d428930 con 0x55846d763cd0 2024-08-20T01:38:24.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fddc259c640 1 --2- 172.21.15.22:0/2229677306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d76fc60 0x55846d76d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:24.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fddc2d9d640 1 --2- 172.21.15.22:0/2229677306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d763cd0 0x55846d76d1a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fddb4003ba0 tx=0x7fddb4003bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35c6fb0c5dfcb193 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:24.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.637+0000 7fdda6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:38:24.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.638+0000 7fdda6ff5640 1 -- 172.21.15.22:0/2229677306 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4031660 con 0x55846d763cd0 2024-08-20T01:38:24.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.638+0000 7fddcb486740 1 -- 172.21.15.22:0/2229677306 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddb4036070 con 0x55846d763cd0 2024-08-20T01:38:24.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.638+0000 7fdda6ff5640 1 -- 172.21.15.22:0/2229677306 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fddb4031800 con 0x55846d763cd0 2024-08-20T01:38:24.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.638+0000 7fdda6ff5640 1 -- 172.21.15.22:0/2229677306 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fddb40040b0 con 0x55846d763cd0 2024-08-20T01:38:24.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.638+0000 7fddcb486740 10 client.26200 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:24.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.638+0000 7fddcb486740 1 -- 172.21.15.22:0/2229677306 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55846d77e3c0 con 0x55846d763cd0 2024-08-20T01:38:24.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.638+0000 7fdda6ff5640 1 -- 172.21.15.22:0/2229677306 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddb4036070 con 0x55846d763cd0 2024-08-20T01:38:24.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.638+0000 7fdda6ff5640 1 -- 172.21.15.22:0/2229677306 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fddb4043020 con 0x55846d763cd0 2024-08-20T01:38:24.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.638+0000 7fddcb486740 10 client.26200 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:24.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.638+0000 7fddcb486740 10 client.26200 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:38:24.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.638+0000 7fddcb486740 20 client.26200 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:24.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.638+0000 7fddcb486740 1 --2- 172.21.15.22:0/2229677306 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55846d77f710 0x55846d781b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.638+0000 7fddcb486740 4 client.26200 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:24.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.638+0000 7fddcb486740 1 -- 172.21.15.22:0/2229677306 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55846d6db890 con 0x55846d77f710 2024-08-20T01:38:24.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.638+0000 7fddc259c640 1 --2- 172.21.15.22:0/2229677306 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55846d77f710 0x55846d781b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.639+0000 7fddc259c640 1 --2- 172.21.15.22:0/2229677306 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55846d77f710 0x55846d781b00 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=379415cdd7f773db server_cookie=46a7d537cea0579d in_seq=0 out_seq=0 2024-08-20T01:38:24.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.639+0000 7fdda6ff5640 10 client.26200 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:24.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.639+0000 7fdda6ff5640 1 -- 172.21.15.22:0/2229677306 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55846d6db890 con 0x55846d77f710 2024-08-20T01:38:24.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.639+0000 7fdda6ff5640 10 client.26200 handle_command_reply: tid=0 2024-08-20T01:38:24.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.639+0000 7fddcb486740 1 client.26200 shutdown 2024-08-20T01:38:24.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.640+0000 7fddcb486740 1 -- 172.21.15.22:0/2229677306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d763cd0 msgr2=0x55846d76d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:24.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.640+0000 7fddcb486740 1 --2- 172.21.15.22:0/2229677306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d763cd0 0x55846d76d1a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fddb4003ba0 tx=0x7fddb4003bd0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.640+0000 7fddcb486740 1 -- 172.21.15.22:0/2229677306 shutdown_connections 2024-08-20T01:38:24.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.640+0000 7fddcb486740 1 --2- 172.21.15.22:0/2229677306 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55846d77f710 0x55846d781b00 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.640+0000 7fddcb486740 1 --2- 172.21.15.22:0/2229677306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d76fc60 0x55846d76d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.640+0000 7fddcb486740 1 --2- 172.21.15.22:0/2229677306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d763cd0 0x55846d76d1a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.640+0000 7fddcb486740 1 --2- 172.21.15.22:0/2229677306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d7633b0 0x55846d76cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.640+0000 7fddcb486740 1 -- 172.21.15.22:0/2229677306 >> 172.21.15.22:0/2229677306 conn(0x55846d7611e0 msgr2=0x55846d766d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:24.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.640+0000 7fdda6ff5640 0 client.26200 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:24.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.640+0000 7fddcb486740 1 -- 172.21.15.22:0/2229677306 shutdown_connections 2024-08-20T01:38:24.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.640+0000 7fddcb486740 1 -- 172.21.15.22:0/2229677306 wait complete. 2024-08-20T01:38:24.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.640+0000 7fddcb486740 20 client.26200 trim_cache size 0 max 16384 2024-08-20T01:38:24.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.657+0000 7fddcb486740 1 Processor -- start 2024-08-20T01:38:24.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.657+0000 7fddcb486740 1 -- start start 2024-08-20T01:38:24.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.657+0000 7fddcb486740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d7633b0 0x55846d766b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.657+0000 7fddcb486740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d763cd0 0x55846d767060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.657+0000 7fddcb486740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d76fc60 0x55846d787310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.657+0000 7fddcb486740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fddc41b0a10 con 0x55846d7633b0 2024-08-20T01:38:24.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.657+0000 7fddcb486740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fddc41ae220 con 0x55846d763cd0 2024-08-20T01:38:24.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.657+0000 7fddcb486740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fddc41ac070 con 0x55846d76fc60 2024-08-20T01:38:24.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.658+0000 7fddc259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d7633b0 0x55846d766b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.658+0000 7fddc259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d7633b0 0x55846d766b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51636/0 (socket says 172.21.15.22:51636) 2024-08-20T01:38:24.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.658+0000 7fddc259c640 1 -- 172.21.15.22:0/1363717561 learned_addr learned my addr 172.21.15.22:0/1363717561 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:24.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.658+0000 7fddc259c640 1 --2- 172.21.15.22:0/1363717561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d76fc60 0x55846d787310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.658+0000 7fddc2d9d640 1 --2- 172.21.15.22:0/1363717561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d763cd0 0x55846d767060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.658+0000 7fddc259c640 1 -- 172.21.15.22:0/1363717561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d76fc60 msgr2=0x55846d787310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:24.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.658+0000 7fddc259c640 1 --2- 172.21.15.22:0/1363717561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d76fc60 0x55846d787310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.658+0000 7fddc259c640 1 -- 172.21.15.22:0/1363717561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d763cd0 msgr2=0x55846d767060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:24.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.658+0000 7fddc259c640 1 --2- 172.21.15.22:0/1363717561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d763cd0 0x55846d767060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.658+0000 7fddc259c640 1 -- 172.21.15.22:0/1363717561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55846d761010 con 0x55846d7633b0 2024-08-20T01:38:24.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.658+0000 7fddc259c640 1 --2- 172.21.15.22:0/1363717561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d7633b0 0x55846d766b20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fddb80057c0 tx=0x7fddb800a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f00cc7a5ede2c5d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:24.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.658+0000 7fdda8ff9640 1 -- 172.21.15.22:0/1363717561 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb800e4d0 con 0x55846d7633b0 2024-08-20T01:38:24.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.658+0000 7fdda8ff9640 1 -- 172.21.15.22:0/1363717561 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddb8027070 con 0x55846d7633b0 2024-08-20T01:38:24.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.658+0000 7fdda8ff9640 1 -- 172.21.15.22:0/1363717561 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb800f810 con 0x55846d7633b0 2024-08-20T01:38:24.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.659+0000 7fddcb486740 1 -- 172.21.15.22:0/1363717561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d7633b0 msgr2=0x55846d766b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:24.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.659+0000 7fddcb486740 1 --2- 172.21.15.22:0/1363717561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d7633b0 0x55846d766b20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fddb80057c0 tx=0x7fddb800a2d0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.659+0000 7fddcb486740 1 -- 172.21.15.22:0/1363717561 shutdown_connections 2024-08-20T01:38:24.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.659+0000 7fddcb486740 1 --2- 172.21.15.22:0/1363717561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d76fc60 0x55846d787310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.659+0000 7fddcb486740 1 --2- 172.21.15.22:0/1363717561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d763cd0 0x55846d767060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.659+0000 7fddcb486740 1 --2- 172.21.15.22:0/1363717561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d7633b0 0x55846d766b20 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.659+0000 7fddcb486740 1 -- 172.21.15.22:0/1363717561 >> 172.21.15.22:0/1363717561 conn(0x55846d7611e0 msgr2=0x55846d766410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:24.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.659+0000 7fddcb486740 1 -- 172.21.15.22:0/1363717561 shutdown_connections 2024-08-20T01:38:24.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.659+0000 7fddcb486740 1 -- 172.21.15.22:0/1363717561 wait complete. 2024-08-20T01:38:24.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.659+0000 7fddcb486740 1 -- start start 2024-08-20T01:38:24.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.660+0000 7fddcb486740 1 Processor -- start 2024-08-20T01:38:24.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.660+0000 7fddcb486740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d7633b0 0x55846d777e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.660+0000 7fddcb486740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d763cd0 0x55846d778380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.660+0000 7fddcb486740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d76fc60 0x55846d773520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.660+0000 7fddcb486740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fddc41ac6e0 con 0x55846d76fc60 2024-08-20T01:38:24.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.660+0000 7fddcb486740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fddc41adb50 con 0x55846d763cd0 2024-08-20T01:38:24.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.660+0000 7fddcb486740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fddc41acdb0 con 0x55846d7633b0 2024-08-20T01:38:24.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.660+0000 7fddcb486740 10 client.0 _ll_register_callbacks cb 0x7fddb800a820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:24.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.660+0000 7fddc259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d76fc60 0x55846d773520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.660+0000 7fddc2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d763cd0 0x55846d778380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.660+0000 7fddc2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d763cd0 0x55846d778380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:59706/0 (socket says 172.21.15.22:59706) 2024-08-20T01:38:24.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.660+0000 7fddc259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d76fc60 0x55846d773520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51642/0 (socket says 172.21.15.22:51642) 2024-08-20T01:38:24.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.660+0000 7fddc2d9d640 1 -- 172.21.15.22:0/2698869384 learned_addr learned my addr 172.21.15.22:0/2698869384 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:24.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.660+0000 7fddc259c640 1 --2- 172.21.15.22:0/2698869384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d7633b0 0x55846d777e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.660+0000 7fddc2d9d640 1 -- 172.21.15.22:0/2698869384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d7633b0 msgr2=0x55846d777e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:24.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.660+0000 7fddc2d9d640 1 --2- 172.21.15.22:0/2698869384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d7633b0 0x55846d777e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.660+0000 7fddc2d9d640 1 -- 172.21.15.22:0/2698869384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d76fc60 msgr2=0x55846d773520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:24.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.660+0000 7fddc2d9d640 1 --2- 172.21.15.22:0/2698869384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d76fc60 0x55846d773520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.660+0000 7fddc2d9d640 1 -- 172.21.15.22:0/2698869384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55846d772440 con 0x55846d763cd0 2024-08-20T01:38:24.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.661+0000 7fddc2d9d640 1 --2- 172.21.15.22:0/2698869384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d763cd0 0x55846d778380 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fddb4002230 tx=0x7fddb4004020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96838b4cd2511131 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:24.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.661+0000 7fdda6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:38:24.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.661+0000 7fdda6ff5640 1 -- 172.21.15.22:0/2698869384 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4040020 con 0x55846d763cd0 2024-08-20T01:38:24.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.661+0000 7fdda6ff5640 1 -- 172.21.15.22:0/2698869384 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fddb402f660 con 0x55846d763cd0 2024-08-20T01:38:24.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.661+0000 7fddcb486740 1 -- 172.21.15.22:0/2698869384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddb8027070 con 0x55846d763cd0 2024-08-20T01:38:24.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.661+0000 7fdda6ff5640 1 -- 172.21.15.22:0/2698869384 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fddb4066050 con 0x55846d763cd0 2024-08-20T01:38:24.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.661+0000 7fddcb486740 10 client.26183 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:24.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.661+0000 7fddcb486740 1 -- 172.21.15.22:0/2698869384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55846d761c60 con 0x55846d763cd0 2024-08-20T01:38:24.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.661+0000 7fdda6ff5640 1 -- 172.21.15.22:0/2698869384 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddb8027070 con 0x55846d763cd0 2024-08-20T01:38:24.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.661+0000 7fdda6ff5640 1 -- 172.21.15.22:0/2698869384 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fddb405f060 con 0x55846d763cd0 2024-08-20T01:38:24.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.661+0000 7fddcb486740 10 client.26183 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:24.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.661+0000 7fddcb486740 10 client.26183 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:38:24.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.661+0000 7fddcb486740 20 client.26183 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:24.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.661+0000 7fddcb486740 1 --2- 172.21.15.22:0/2698869384 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55846d7ea320 0x55846d7ec740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.661+0000 7fddcb486740 4 client.26183 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:38:24.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.661+0000 7fddcb486740 1 -- 172.21.15.22:0/2698869384 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55846d6d7330 con 0x55846d7ea320 2024-08-20T01:38:24.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.662+0000 7fddc259c640 1 --2- 172.21.15.22:0/2698869384 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55846d7ea320 0x55846d7ec740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.662+0000 7fdda6ff5640 10 client.26183 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:24.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.662+0000 7fddc259c640 1 --2- 172.21.15.22:0/2698869384 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55846d7ea320 0x55846d7ec740 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=829089863429a434 server_cookie=d90422fe591dc829 in_seq=0 out_seq=0 2024-08-20T01:38:24.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.663+0000 7fdda6ff5640 1 -- 172.21.15.22:0/2698869384 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55846d6d7330 con 0x55846d7ea320 2024-08-20T01:38:24.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.663+0000 7fdda6ff5640 10 client.26183 handle_command_reply: tid=0 2024-08-20T01:38:24.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.663+0000 7fddcb486740 1 client.26183 shutdown 2024-08-20T01:38:24.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.663+0000 7fddcb486740 1 -- 172.21.15.22:0/2698869384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d763cd0 msgr2=0x55846d778380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:24.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.663+0000 7fddcb486740 1 --2- 172.21.15.22:0/2698869384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d763cd0 0x55846d778380 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fddb4002230 tx=0x7fddb4004020 comp rx=0 tx=0).stop 2024-08-20T01:38:24.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.663+0000 7fddcb486740 1 -- 172.21.15.22:0/2698869384 shutdown_connections 2024-08-20T01:38:24.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.663+0000 7fddcb486740 1 --2- 172.21.15.22:0/2698869384 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55846d7ea320 0x55846d7ec740 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.663+0000 7fddcb486740 1 --2- 172.21.15.22:0/2698869384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55846d76fc60 0x55846d773520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.663+0000 7fddcb486740 1 --2- 172.21.15.22:0/2698869384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55846d763cd0 0x55846d778380 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.663+0000 7fddcb486740 1 --2- 172.21.15.22:0/2698869384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55846d7633b0 0x55846d777e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.663+0000 7fddcb486740 1 -- 172.21.15.22:0/2698869384 >> 172.21.15.22:0/2698869384 conn(0x55846d7611e0 msgr2=0x55846d766c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:24.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.663+0000 7fdda6ff5640 0 client.26183 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:24.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.663+0000 7fddcb486740 1 -- 172.21.15.22:0/2698869384 shutdown_connections 2024-08-20T01:38:24.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.663+0000 7fddcb486740 1 -- 172.21.15.22:0/2698869384 wait complete. 2024-08-20T01:38:24.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.663+0000 7fddcb486740 20 client.26183 trim_cache size 0 max 16384 2024-08-20T01:38:24.672 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:38:24.672 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-08-20T01:38:24.672 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "4c3f24d1-e121-4326-b2ea-a5d3efc63204", 2024-08-20T01:38:24.672 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-08-20T01:38:24.672 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:38:24.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.664+0000 7fddc908d640 1 -- 172.21.15.22:0/236401136 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fddac0b3bd0 msgr2=0x7fddac0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:24.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.664+0000 7fddc908d640 1 --2- 172.21.15.22:0/236401136 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fddac0b3bd0 0x7fddac0b6090 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0aad40 tx=0x7fddbc094040 comp rx=0 tx=0).stop 2024-08-20T01:38:24.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.664+0000 7fddc908d640 1 -- 172.21.15.22:0/236401136 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddc410ce20 msgr2=0x7fddc419e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:24.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.664+0000 7fddc908d640 1 --2- 172.21.15.22:0/236401136 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddc410ce20 0x7fddc419e730 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00e970 tx=0x7fddbc00ed70 comp rx=0 tx=0).stop 2024-08-20T01:38:24.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.664+0000 7fddc908d640 1 -- 172.21.15.22:0/236401136 shutdown_connections 2024-08-20T01:38:24.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.664+0000 7fddc908d640 1 --2- 172.21.15.22:0/236401136 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fddac0b3bd0 0x7fddac0b6090 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.664+0000 7fddc908d640 1 --2- 172.21.15.22:0/236401136 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddc410ce20 0x7fddc419e730 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.664+0000 7fddc908d640 1 --2- 172.21.15.22:0/236401136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddc4104270 0x7fddc4199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.664+0000 7fddc908d640 1 --2- 172.21.15.22:0/236401136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddc4103870 0x7fddc4198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.664+0000 7fddc908d640 1 -- 172.21.15.22:0/236401136 >> 172.21.15.22:0/236401136 conn(0x7fddc40fd400 msgr2=0x7fddc410efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:24.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.664+0000 7fddc908d640 1 -- 172.21.15.22:0/236401136 shutdown_connections 2024-08-20T01:38:24.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:24.664+0000 7fddc908d640 1 -- 172.21.15.22:0/236401136 wait complete. 2024-08-20T01:38:24.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:24 smithi022 ceph-mon[18709]: pgmap v564: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.7 MiB/s wr, 740 op/s 2024-08-20T01:38:25.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:24 smithi134 ceph-mon[22511]: pgmap v564: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.7 MiB/s wr, 740 op/s 2024-08-20T01:38:25.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:24 smithi077 ceph-mon[22251]: pgmap v564: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.7 MiB/s wr, 740 op/s 2024-08-20T01:38:25.648 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:38:25.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:25 smithi022 ceph-mon[18709]: scrub queued for path: / 2024-08-20T01:38:25.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:25 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:25.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:25 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:38:25.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:25 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:38:25.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:25 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:38:25.975 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:26.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:25 smithi134 ceph-mon[22511]: scrub queued for path: / 2024-08-20T01:38:26.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:25 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:26.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:25 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:38:26.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:25 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:38:26.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:25 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:38:26.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:25 smithi077 ceph-mon[22251]: scrub queued for path: / 2024-08-20T01:38:26.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:25 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:26.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:25 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:38:26.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:25 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:38:26.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:25 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:38:26.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.463+0000 7f8a8a1c6640 1 -- 172.21.15.22:0/3805335279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a841073a0 msgr2=0x7f8a841077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:26.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.463+0000 7f8a8a1c6640 1 --2- 172.21.15.22:0/3805335279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a841073a0 0x7f8a841077e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c009900 tx=0x7f8a6c02a410 comp rx=0 tx=0).stop 2024-08-20T01:38:26.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.463+0000 7f8a8a1c6640 1 -- 172.21.15.22:0/3805335279 shutdown_connections 2024-08-20T01:38:26.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.463+0000 7f8a8a1c6640 1 --2- 172.21.15.22:0/3805335279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a84107d20 0x7f8a8410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.463+0000 7f8a8a1c6640 1 --2- 172.21.15.22:0/3805335279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a841073a0 0x7f8a841077e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.463+0000 7f8a8a1c6640 1 --2- 172.21.15.22:0/3805335279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a84101990 0x7f8a84101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.463+0000 7f8a8a1c6640 1 -- 172.21.15.22:0/3805335279 >> 172.21.15.22:0/3805335279 conn(0x7f8a840fd400 msgr2=0x7f8a840ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:26.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.463+0000 7f8a8a1c6640 1 -- 172.21.15.22:0/3805335279 shutdown_connections 2024-08-20T01:38:26.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.463+0000 7f8a8a1c6640 1 -- 172.21.15.22:0/3805335279 wait complete. 2024-08-20T01:38:26.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.464+0000 7f8a8a1c6640 1 Processor -- start 2024-08-20T01:38:26.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.464+0000 7f8a8a1c6640 1 -- start start 2024-08-20T01:38:26.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.464+0000 7f8a8a1c6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a84101990 0x7f8a84199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.464+0000 7f8a8a1c6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a841073a0 0x7f8a8419a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.464+0000 7f8a8a1c6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a84107d20 0x7f8a8419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.464+0000 7f8a8a1c6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841119a0 con 0x7f8a84107d20 2024-08-20T01:38:26.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.464+0000 7f8a8a1c6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a84111820 con 0x7f8a841073a0 2024-08-20T01:38:26.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.464+0000 7f8a8a1c6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8a84111b20 con 0x7f8a84101990 2024-08-20T01:38:26.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.464+0000 7f8a837fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a84101990 0x7f8a84199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.464+0000 7f8a83fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a84107d20 0x7f8a8419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.464+0000 7f8a837fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a84101990 0x7f8a84199e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:35906/0 (socket says 172.21.15.22:35906) 2024-08-20T01:38:26.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.464+0000 7f8a7bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a841073a0 0x7f8a8419a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.464+0000 7f8a837fe640 1 -- 172.21.15.22:0/2753301016 learned_addr learned my addr 172.21.15.22:0/2753301016 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:26.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.464+0000 7f8a837fe640 1 -- 172.21.15.22:0/2753301016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a841073a0 msgr2=0x7f8a8419a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:26.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.464+0000 7f8a837fe640 1 --2- 172.21.15.22:0/2753301016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a841073a0 0x7f8a8419a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.464+0000 7f8a837fe640 1 -- 172.21.15.22:0/2753301016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a84107d20 msgr2=0x7f8a8419a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:26.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.464+0000 7f8a837fe640 1 --2- 172.21.15.22:0/2753301016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a84107d20 0x7f8a8419a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.464+0000 7f8a837fe640 1 -- 172.21.15.22:0/2753301016 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a841a5200 con 0x7f8a84101990 2024-08-20T01:38:26.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.465+0000 7f8a837fe640 1 --2- 172.21.15.22:0/2753301016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a84101990 0x7f8a84199e20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400e9f0 tx=0x7f8a7400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:26.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.465+0000 7f8a817fa640 1 -- 172.21.15.22:0/2753301016 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7400cd80 con 0x7f8a84101990 2024-08-20T01:38:26.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.465+0000 7f8a817fa640 1 -- 172.21.15.22:0/2753301016 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a740054d0 con 0x7f8a84101990 2024-08-20T01:38:26.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.465+0000 7f8a8a1c6640 1 -- 172.21.15.22:0/2753301016 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a841a54f0 con 0x7f8a84101990 2024-08-20T01:38:26.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.465+0000 7f8a817fa640 1 -- 172.21.15.22:0/2753301016 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74010690 con 0x7f8a84101990 2024-08-20T01:38:26.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.465+0000 7f8a8a1c6640 1 -- 172.21.15.22:0/2753301016 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a841a59b0 con 0x7f8a84101990 2024-08-20T01:38:26.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.467+0000 7f8a8c5bf740 1 Processor -- start 2024-08-20T01:38:26.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.467+0000 7f8a817fa640 1 -- 172.21.15.22:0/2753301016 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8a74004e90 con 0x7f8a84101990 2024-08-20T01:38:26.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.467+0000 7f8a8c5bf740 1 -- start start 2024-08-20T01:38:26.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.468+0000 7f8a8c5bf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c47266e0 0x5587c4726ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.468+0000 7f8a8c5bf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4727000 0x5587c4732a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.468+0000 7f8a8c5bf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c4732f90 0x5587c4735380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.468+0000 7f8a8c5bf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5587c469d8e0 con 0x5587c4732f90 2024-08-20T01:38:26.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.468+0000 7f8a8c5bf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5587c468cde0 con 0x5587c47266e0 2024-08-20T01:38:26.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.468+0000 7f8a8c5bf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5587c4690e20 con 0x5587c4727000 2024-08-20T01:38:26.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.468+0000 7f8a7bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c4732f90 0x5587c4735380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.468+0000 7f8a7bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c4732f90 0x5587c4735380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51674/0 (socket says 172.21.15.22:51674) 2024-08-20T01:38:26.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.468+0000 7f8a7bfff640 1 -- 172.21.15.22:0/3626848057 learned_addr learned my addr 172.21.15.22:0/3626848057 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:26.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.468+0000 7f8a837fe640 1 --2- 172.21.15.22:0/3626848057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4727000 0x5587c4732a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.468+0000 7f8a83fff640 1 --2- 172.21.15.22:0/3626848057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c47266e0 0x5587c4726ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.468+0000 7f8a7bfff640 1 -- 172.21.15.22:0/3626848057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4727000 msgr2=0x5587c4732a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:26.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.468+0000 7f8a7bfff640 1 --2- 172.21.15.22:0/3626848057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4727000 0x5587c4732a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.468+0000 7f8a7bfff640 1 -- 172.21.15.22:0/3626848057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c47266e0 msgr2=0x5587c4726ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:26.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.468+0000 7f8a7bfff640 1 --2- 172.21.15.22:0/3626848057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c47266e0 0x5587c4726ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.468+0000 7f8a7bfff640 1 -- 172.21.15.22:0/3626848057 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587c43ec650 con 0x5587c4732f90 2024-08-20T01:38:26.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.468+0000 7f8a837fe640 1 --2- 172.21.15.22:0/3626848057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4727000 0x5587c4732a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:26.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.468+0000 7f8a817fa640 1 --2- 172.21.15.22:0/2753301016 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8a700b3bd0 0x7f8a700b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.468+0000 7f8a7bfff640 1 --2- 172.21.15.22:0/3626848057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c4732f90 0x5587c4735380 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c033000 tx=0x7f8a6c032b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d255c356afe644a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:26.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.469+0000 7f8a83fff640 1 --2- 172.21.15.22:0/2753301016 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8a700b3bd0 0x7f8a700b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.469+0000 7f8a817fa640 1 -- 172.21.15.22:0/2753301016 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f8a740e4070 con 0x7f8a84101990 2024-08-20T01:38:26.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.469+0000 7f8a79ffb640 1 -- 172.21.15.22:0/3626848057 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c035040 con 0x5587c4732f90 2024-08-20T01:38:26.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.469+0000 7f8a79ffb640 1 -- 172.21.15.22:0/3626848057 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a6c004030 con 0x5587c4732f90 2024-08-20T01:38:26.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.469+0000 7f8a79ffb640 1 -- 172.21.15.22:0/3626848057 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c0054d0 con 0x5587c4732f90 2024-08-20T01:38:26.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.469+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/3626848057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c4732f90 msgr2=0x5587c4735380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:26.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.469+0000 7f8a83fff640 1 --2- 172.21.15.22:0/2753301016 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8a700b3bd0 0x7f8a700b6090 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8a8419ae00 tx=0x7f8a7c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:26.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.469+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/3626848057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c4732f90 0x5587c4735380 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c033000 tx=0x7f8a6c032b20 comp rx=0 tx=0).stop 2024-08-20T01:38:26.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.469+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/3626848057 shutdown_connections 2024-08-20T01:38:26.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.469+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/3626848057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c4732f90 0x5587c4735380 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.469+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/3626848057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4727000 0x5587c4732a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.469+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/3626848057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c47266e0 0x5587c4726ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.469+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/3626848057 >> 172.21.15.22:0/3626848057 conn(0x5587c4724510 msgr2=0x5587c47256b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:26.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.469+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/3626848057 shutdown_connections 2024-08-20T01:38:26.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.469+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/3626848057 wait complete. 2024-08-20T01:38:26.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.470+0000 7f8a8c5bf740 1 -- start start 2024-08-20T01:38:26.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.470+0000 7f8a8c5bf740 1 Processor -- start 2024-08-20T01:38:26.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.470+0000 7f8a8c5bf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c47266e0 0x5587c472ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.470+0000 7f8a8c5bf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c4727000 0x5587c4730480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.470+0000 7f8a8c5bf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4732f90 0x5587c47309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.470+0000 7f8a8c5bf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5587c44ef700 con 0x5587c4727000 2024-08-20T01:38:26.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.470+0000 7f8a8c5bf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5587c46137c0 con 0x5587c47266e0 2024-08-20T01:38:26.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.470+0000 7f8a8c5bf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5587c4735be0 con 0x5587c4732f90 2024-08-20T01:38:26.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.470+0000 7f8a8c5bf740 10 client.0 _ll_register_callbacks cb 0x5587c46866b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.470+0000 7f8a7bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c4727000 0x5587c4730480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.470+0000 7f8a7bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c4727000 0x5587c4730480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51686/0 (socket says 172.21.15.22:51686) 2024-08-20T01:38:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.470+0000 7f8a7bfff640 1 -- 172.21.15.22:0/323635653 learned_addr learned my addr 172.21.15.22:0/323635653 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.470+0000 7f8a837fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c47266e0 0x5587c472ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.471+0000 7f8a83fff640 1 --2- 172.21.15.22:0/323635653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4732f90 0x5587c47309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.471+0000 7f8a7bfff640 1 -- 172.21.15.22:0/323635653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4732f90 msgr2=0x5587c47309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.471+0000 7f8a7bfff640 1 --2- 172.21.15.22:0/323635653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4732f90 0x5587c47309c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.471+0000 7f8a7bfff640 1 -- 172.21.15.22:0/323635653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c47266e0 msgr2=0x5587c472ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.471+0000 7f8a7bfff640 1 --2- 172.21.15.22:0/323635653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c47266e0 0x5587c472ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.471+0000 7f8a7bfff640 1 -- 172.21.15.22:0/323635653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587c473efc0 con 0x5587c4727000 2024-08-20T01:38:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.471+0000 7f8a837fe640 1 --2- 172.21.15.22:0/323635653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c47266e0 0x5587c472ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:26.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.471+0000 7f8a7bfff640 1 --2- 172.21.15.22:0/323635653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c4727000 0x5587c4730480 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0096c0 tx=0x7f8a6c005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11f397a0d72bdba server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.471+0000 7f8a62ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:38:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.471+0000 7f8a62ffd640 1 -- 172.21.15.22:0/323635653 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c04d060 con 0x5587c4727000 2024-08-20T01:38:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.471+0000 7f8a62ffd640 1 -- 172.21.15.22:0/323635653 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f8a6c0316a0 con 0x5587c4727000 2024-08-20T01:38:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.471+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/323635653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5587c463c100 con 0x5587c4727000 2024-08-20T01:38:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.471+0000 7f8a62ffd640 1 -- 172.21.15.22:0/323635653 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8a6c035040 con 0x5587c4727000 2024-08-20T01:38:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.471+0000 7f8a8c5bf740 10 client.16572 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.471+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/323635653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5587c4741950 con 0x5587c4727000 2024-08-20T01:38:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.472+0000 7f8a62ffd640 1 -- 172.21.15.22:0/323635653 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5587c463c100 con 0x5587c4727000 2024-08-20T01:38:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.472+0000 7f8a62ffd640 1 -- 172.21.15.22:0/323635653 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f8a6c004af0 con 0x5587c4727000 2024-08-20T01:38:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.472+0000 7f8a8c5bf740 10 client.16572 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.472+0000 7f8a8c5bf740 10 client.16572 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:38:26.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.472+0000 7f8a8c5bf740 20 client.16572 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.472+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/323635653 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5587c4742ca0 0x5587c4745090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.472+0000 7f8a8c5bf740 4 client.16572 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.472+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/323635653 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587c469f830 con 0x5587c4742ca0 2024-08-20T01:38:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.472+0000 7f8a837fe640 1 --2- 172.21.15.22:0/323635653 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5587c4742ca0 0x5587c4745090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.472+0000 7f8a837fe640 1 --2- 172.21.15.22:0/323635653 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5587c4742ca0 0x5587c4745090 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c1558fa2ab55d60 server_cookie=77830b2f9a9c4d10 in_seq=0 out_seq=0 2024-08-20T01:38:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.472+0000 7f8a62ffd640 10 client.16572 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.473+0000 7f8a62ffd640 1 -- 172.21.15.22:0/323635653 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5587c469f830 con 0x5587c4742ca0 2024-08-20T01:38:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.473+0000 7f8a62ffd640 10 client.16572 handle_command_reply: tid=0 2024-08-20T01:38:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.473+0000 7f8a8c5bf740 1 client.16572 shutdown 2024-08-20T01:38:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.473+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/323635653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c4727000 msgr2=0x5587c4730480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.473+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/323635653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c4727000 0x5587c4730480 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0096c0 tx=0x7f8a6c005050 comp rx=0 tx=0).stop 2024-08-20T01:38:26.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.473+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/323635653 shutdown_connections 2024-08-20T01:38:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.473+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/323635653 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5587c4742ca0 0x5587c4745090 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.473+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/323635653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4732f90 0x5587c47309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.473+0000 7f8a62ffd640 0 client.16572 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.473+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/323635653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c4727000 0x5587c4730480 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.473+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/323635653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c47266e0 0x5587c472ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.473+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/323635653 >> 172.21.15.22:0/323635653 conn(0x5587c4724510 msgr2=0x5587c472a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.473+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/323635653 shutdown_connections 2024-08-20T01:38:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.473+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/323635653 wait complete. 2024-08-20T01:38:26.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.474+0000 7f8a8c5bf740 20 client.16572 trim_cache size 0 max 16384 2024-08-20T01:38:26.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.491+0000 7f8a8c5bf740 1 Processor -- start 2024-08-20T01:38:26.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.491+0000 7f8a8c5bf740 1 -- start start 2024-08-20T01:38:26.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.492+0000 7f8a8c5bf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c47266e0 0x5587c47305c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.492+0000 7f8a8c5bf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c4727000 0x5587c474a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.492+0000 7f8a8c5bf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4732f90 0x5587c474ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.492+0000 7f8a8c5bf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841b0af0 con 0x5587c47266e0 2024-08-20T01:38:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.492+0000 7f8a8c5bf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841ae300 con 0x5587c4727000 2024-08-20T01:38:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.492+0000 7f8a8c5bf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841ac150 con 0x5587c4732f90 2024-08-20T01:38:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.492+0000 7f8a837fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c47266e0 0x5587c47305c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.492+0000 7f8a837fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c47266e0 0x5587c47305c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51696/0 (socket says 172.21.15.22:51696) 2024-08-20T01:38:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.492+0000 7f8a837fe640 1 -- 172.21.15.22:0/125449712 learned_addr learned my addr 172.21.15.22:0/125449712 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.492+0000 7f8a7bfff640 1 --2- 172.21.15.22:0/125449712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c4727000 0x5587c474a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.492+0000 7f8a83fff640 1 --2- 172.21.15.22:0/125449712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4732f90 0x5587c474ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.492+0000 7f8a837fe640 1 -- 172.21.15.22:0/125449712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4732f90 msgr2=0x5587c474ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:26.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.492+0000 7f8a837fe640 1 --2- 172.21.15.22:0/125449712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4732f90 0x5587c474ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.492+0000 7f8a837fe640 1 -- 172.21.15.22:0/125449712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c4727000 msgr2=0x5587c474a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:26.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.492+0000 7f8a837fe640 1 --2- 172.21.15.22:0/125449712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c4727000 0x5587c474a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.492+0000 7f8a837fe640 1 -- 172.21.15.22:0/125449712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587c4724f90 con 0x5587c47266e0 2024-08-20T01:38:26.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.492+0000 7f8a7bfff640 1 --2- 172.21.15.22:0/125449712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c4727000 0x5587c474a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:26.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.492+0000 7f8a83fff640 1 --2- 172.21.15.22:0/125449712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4732f90 0x5587c474ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:26.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.492+0000 7f8a837fe640 1 --2- 172.21.15.22:0/125449712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c47266e0 0x5587c47305c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8a740a74c0 tx=0x7f8a74004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e180da901f1ce5f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:26.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.493+0000 7f8a797fa640 1 -- 172.21.15.22:0/125449712 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a740aa690 con 0x5587c47266e0 2024-08-20T01:38:26.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.493+0000 7f8a797fa640 1 -- 172.21.15.22:0/125449712 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a740aaa30 con 0x5587c47266e0 2024-08-20T01:38:26.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.493+0000 7f8a797fa640 1 -- 172.21.15.22:0/125449712 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74005180 con 0x5587c47266e0 2024-08-20T01:38:26.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.493+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/125449712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c47266e0 msgr2=0x5587c47305c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:26.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.493+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/125449712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c47266e0 0x5587c47305c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8a740a74c0 tx=0x7f8a74004a90 comp rx=0 tx=0).stop 2024-08-20T01:38:26.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.493+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/125449712 shutdown_connections 2024-08-20T01:38:26.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.493+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/125449712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4732f90 0x5587c474ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.493+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/125449712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c4727000 0x5587c474a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.493+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/125449712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c47266e0 0x5587c47305c0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.493+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/125449712 >> 172.21.15.22:0/125449712 conn(0x5587c4724510 msgr2=0x5587c472feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:26.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.493+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/125449712 shutdown_connections 2024-08-20T01:38:26.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.493+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/125449712 wait complete. 2024-08-20T01:38:26.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.494+0000 7f8a8c5bf740 1 -- start start 2024-08-20T01:38:26.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.494+0000 7f8a8c5bf740 1 Processor -- start 2024-08-20T01:38:26.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.494+0000 7f8a8c5bf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c47266e0 0x5587c4735fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.494+0000 7f8a8c5bf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4727000 0x5587c4736520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.494+0000 7f8a8c5bf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c4732f90 0x5587c47ab680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.494+0000 7f8a8c5bf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841ac7c0 con 0x5587c47266e0 2024-08-20T01:38:26.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.494+0000 7f8a8c5bf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841adc30 con 0x5587c4732f90 2024-08-20T01:38:26.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.494+0000 7f8a8c5bf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841ace90 con 0x5587c4727000 2024-08-20T01:38:26.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.494+0000 7f8a8c5bf740 10 client.0 _ll_register_callbacks cb 0x7f8a6c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:26.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.494+0000 7f8a837fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c47266e0 0x5587c4735fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.494+0000 7f8a7bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4727000 0x5587c4736520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.494+0000 7f8a837fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c47266e0 0x5587c4735fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51704/0 (socket says 172.21.15.22:51704) 2024-08-20T01:38:26.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.494+0000 7f8a837fe640 1 -- 172.21.15.22:0/2742352758 learned_addr learned my addr 172.21.15.22:0/2742352758 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:26.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.495+0000 7f8a83fff640 1 --2- 172.21.15.22:0/2742352758 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c4732f90 0x5587c47ab680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.495+0000 7f8a837fe640 1 -- 172.21.15.22:0/2742352758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4727000 msgr2=0x5587c4736520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:26.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.495+0000 7f8a837fe640 1 --2- 172.21.15.22:0/2742352758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4727000 0x5587c4736520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.495+0000 7f8a837fe640 1 -- 172.21.15.22:0/2742352758 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c4732f90 msgr2=0x5587c47ab680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:26.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.495+0000 7f8a837fe640 1 --2- 172.21.15.22:0/2742352758 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c4732f90 0x5587c47ab680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.495+0000 7f8a837fe640 1 -- 172.21.15.22:0/2742352758 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587c4736e20 con 0x5587c47266e0 2024-08-20T01:38:26.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.495+0000 7f8a7bfff640 1 --2- 172.21.15.22:0/2742352758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4727000 0x5587c4736520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:26.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.495+0000 7f8a83fff640 1 --2- 172.21.15.22:0/2742352758 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c4732f90 0x5587c47ab680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:26.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.495+0000 7f8a837fe640 1 --2- 172.21.15.22:0/2742352758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c47266e0 0x5587c4735fe0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400e9c0 tx=0x7f8a74005180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0fce2f2f13f6a83 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:26.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.495+0000 7f8a62ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:38:26.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.495+0000 7f8a62ffd640 1 -- 172.21.15.22:0/2742352758 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a740aaf20 con 0x5587c47266e0 2024-08-20T01:38:26.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.495+0000 7f8a62ffd640 1 -- 172.21.15.22:0/2742352758 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f8a740ab180 con 0x5587c47266e0 2024-08-20T01:38:26.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.495+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/2742352758 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a740aaa30 con 0x5587c47266e0 2024-08-20T01:38:26.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.495+0000 7f8a62ffd640 1 -- 172.21.15.22:0/2742352758 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8a74005680 con 0x5587c47266e0 2024-08-20T01:38:26.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.495+0000 7f8a8c5bf740 10 client.16578 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:26.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.495+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/2742352758 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5587c47acd00 con 0x5587c47266e0 2024-08-20T01:38:26.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.495+0000 7f8a62ffd640 1 -- 172.21.15.22:0/2742352758 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a740aaa30 con 0x5587c47266e0 2024-08-20T01:38:26.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.496+0000 7f8a62ffd640 1 -- 172.21.15.22:0/2742352758 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f8a740ae030 con 0x5587c47266e0 2024-08-20T01:38:26.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.496+0000 7f8a8c5bf740 10 client.16578 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:26.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.496+0000 7f8a8c5bf740 10 client.16578 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:38:26.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.496+0000 7f8a8c5bf740 20 client.16578 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:26.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.496+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/2742352758 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5587c47ad410 0x5587c47af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.496+0000 7f8a8c5bf740 4 client.16578 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:38:26.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.496+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/2742352758 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5587c469b2d0 con 0x5587c47ad410 2024-08-20T01:38:26.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.496+0000 7f8a7bfff640 1 --2- 172.21.15.22:0/2742352758 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5587c47ad410 0x5587c47af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.496+0000 7f8a7bfff640 1 --2- 172.21.15.22:0/2742352758 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5587c47ad410 0x5587c47af830 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bac7455af61a6a15 server_cookie=306083325f097905 in_seq=0 out_seq=0 2024-08-20T01:38:26.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.496+0000 7f8a62ffd640 10 client.16578 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:26.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.496+0000 7f8a62ffd640 1 -- 172.21.15.22:0/2742352758 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x5587c469b2d0 con 0x5587c47ad410 2024-08-20T01:38:26.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.496+0000 7f8a62ffd640 10 client.16578 handle_command_reply: tid=0 2024-08-20T01:38:26.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.496+0000 7f8a8c5bf740 1 client.16578 shutdown 2024-08-20T01:38:26.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.497+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/2742352758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c47266e0 msgr2=0x5587c4735fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:26.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.497+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/2742352758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c47266e0 0x5587c4735fe0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400e9c0 tx=0x7f8a74005180 comp rx=0 tx=0).stop 2024-08-20T01:38:26.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.497+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/2742352758 shutdown_connections 2024-08-20T01:38:26.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.497+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/2742352758 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5587c47ad410 0x5587c47af830 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.497+0000 7f8a62ffd640 0 client.16578 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:26.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.497+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/2742352758 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587c4732f90 0x5587c47ab680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.497+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/2742352758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5587c4727000 0x5587c4736520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.497+0000 7f8a8c5bf740 1 --2- 172.21.15.22:0/2742352758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c47266e0 0x5587c4735fe0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.497+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/2742352758 >> 172.21.15.22:0/2742352758 conn(0x5587c4724510 msgr2=0x5587c4731570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:26.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.497+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/2742352758 shutdown_connections 2024-08-20T01:38:26.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.497+0000 7f8a8c5bf740 1 -- 172.21.15.22:0/2742352758 wait complete. 2024-08-20T01:38:26.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.497+0000 7f8a8c5bf740 20 client.16578 trim_cache size 0 max 16384 2024-08-20T01:38:26.507 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:38:26.507 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "scrub active (12394 inodes in the stack)", 2024-08-20T01:38:26.508 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-08-20T01:38:26.508 INFO:teuthology.orchestra.run.smithi022.stdout: "4c3f24d1-e121-4326-b2ea-a5d3efc63204": { 2024-08-20T01:38:26.508 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-08-20T01:38:26.508 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "4c3f24d1-e121-4326-b2ea-a5d3efc63204", 2024-08-20T01:38:26.508 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-08-20T01:38:26.508 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:38:26.508 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:38:26.508 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:38:26.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.498+0000 7f8a8a1c6640 1 -- 172.21.15.22:0/2753301016 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8a700b3bd0 msgr2=0x7f8a700b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:26.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.498+0000 7f8a8a1c6640 1 --2- 172.21.15.22:0/2753301016 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8a700b3bd0 0x7f8a700b6090 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8a8419ae00 tx=0x7f8a7c009500 comp rx=0 tx=0).stop 2024-08-20T01:38:26.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.498+0000 7f8a8a1c6640 1 -- 172.21.15.22:0/2753301016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a84101990 msgr2=0x7f8a84199e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:26.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.498+0000 7f8a8a1c6640 1 --2- 172.21.15.22:0/2753301016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a84101990 0x7f8a84199e20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400e9f0 tx=0x7f8a7400edf0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.498+0000 7f8a8a1c6640 1 -- 172.21.15.22:0/2753301016 shutdown_connections 2024-08-20T01:38:26.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.498+0000 7f8a8a1c6640 1 --2- 172.21.15.22:0/2753301016 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8a700b3bd0 0x7f8a700b6090 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.498+0000 7f8a8a1c6640 1 --2- 172.21.15.22:0/2753301016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a84107d20 0x7f8a8419a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.498+0000 7f8a8a1c6640 1 --2- 172.21.15.22:0/2753301016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a841073a0 0x7f8a8419a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.498+0000 7f8a8a1c6640 1 --2- 172.21.15.22:0/2753301016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a84101990 0x7f8a84199e20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.498+0000 7f8a8a1c6640 1 -- 172.21.15.22:0/2753301016 >> 172.21.15.22:0/2753301016 conn(0x7f8a840fd400 msgr2=0x7f8a840ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:26.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.498+0000 7f8a8a1c6640 1 -- 172.21.15.22:0/2753301016 shutdown_connections 2024-08-20T01:38:26.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:26.498+0000 7f8a8a1c6640 1 -- 172.21.15.22:0/2753301016 wait complete. 2024-08-20T01:38:26.983 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:26 smithi022 ceph-mon[18709]: pgmap v565: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 605 op/s 2024-08-20T01:38:26.983 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:26 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:27.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:26 smithi134 ceph-mon[22511]: pgmap v565: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 605 op/s 2024-08-20T01:38:27.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:26 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:27.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:26 smithi077 ceph-mon[22251]: pgmap v565: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 605 op/s 2024-08-20T01:38:27.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:26 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:27.301 INFO:tasks.cephfs.filesystem:scrub status for tag:4c3f24d1-e121-4326-b2ea-a5d3efc63204 - {'path': '/', 'tag': '4c3f24d1-e121-4326-b2ea-a5d3efc63204', 'options': 'recursive,force'} 2024-08-20T01:38:29.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:28 smithi134 ceph-mon[22511]: pgmap v566: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.5 MiB/s wr, 1.36k op/s 2024-08-20T01:38:29.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:28 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:29.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:28 smithi077 ceph-mon[22251]: pgmap v566: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.5 MiB/s wr, 1.36k op/s 2024-08-20T01:38:29.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:28 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:29.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:28 smithi022 ceph-mon[18709]: pgmap v566: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.5 MiB/s wr, 1.36k op/s 2024-08-20T01:38:29.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:28 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:31.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:30 smithi134 ceph-mon[22511]: pgmap v567: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.1 MiB/s wr, 1.87k op/s 2024-08-20T01:38:31.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:30 smithi077 ceph-mon[22251]: pgmap v567: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.1 MiB/s wr, 1.87k op/s 2024-08-20T01:38:31.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:30 smithi022 ceph-mon[18709]: pgmap v567: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.1 MiB/s wr, 1.87k op/s 2024-08-20T01:38:33.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:32 smithi134 ceph-mon[22511]: pgmap v568: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.4 MiB/s wr, 2.49k op/s 2024-08-20T01:38:33.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:32 smithi077 ceph-mon[22251]: pgmap v568: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.4 MiB/s wr, 2.49k op/s 2024-08-20T01:38:33.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:32 smithi022 ceph-mon[18709]: pgmap v568: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.4 MiB/s wr, 2.49k op/s 2024-08-20T01:38:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.083+0000 7ff0b645f640 1 -- 172.21.15.22:0/754991605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0b0104190 msgr2=0x7ff0b010ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.083+0000 7ff0b645f640 1 --2- 172.21.15.22:0/754991605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0b0104190 0x7ff0b010ab10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8009cd0 tx=0x7ff0a802a8e0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.083+0000 7ff0b645f640 1 -- 172.21.15.22:0/754991605 shutdown_connections 2024-08-20T01:38:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.083+0000 7ff0b645f640 1 --2- 172.21.15.22:0/754991605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0b0104190 0x7ff0b010ab10 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.083+0000 7ff0b645f640 1 --2- 172.21.15.22:0/754991605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b01037d0 0x7ff0b0103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.083+0000 7ff0b645f640 1 --2- 172.21.15.22:0/754991605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0b0102680 0x7ff0b0102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.083+0000 7ff0b645f640 1 -- 172.21.15.22:0/754991605 >> 172.21.15.22:0/754991605 conn(0x7ff0b00fdf40 msgr2=0x7ff0b0100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.083+0000 7ff0b645f640 1 -- 172.21.15.22:0/754991605 shutdown_connections 2024-08-20T01:38:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.083+0000 7ff0b645f640 1 -- 172.21.15.22:0/754991605 wait complete. 2024-08-20T01:38:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.083+0000 7ff0b645f640 1 Processor -- start 2024-08-20T01:38:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.084+0000 7ff0b645f640 1 -- start start 2024-08-20T01:38:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.084+0000 7ff0b645f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b0102680 0x7ff0b0076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.084+0000 7ff0b645f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0b01037d0 0x7ff0b0075270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.084+0000 7ff0b645f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0b0104190 0x7ff0b00757b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.084+0000 7ff0b645f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b010e2f0 con 0x7ff0b0104190 2024-08-20T01:38:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.084+0000 7ff0b645f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b010e170 con 0x7ff0b0102680 2024-08-20T01:38:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.084+0000 7ff0b645f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b010e470 con 0x7ff0b01037d0 2024-08-20T01:38:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.084+0000 7ff0b49fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0b0104190 0x7ff0b00757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.084+0000 7ff0affff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b0102680 0x7ff0b0076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.084+0000 7ff0af7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0b01037d0 0x7ff0b0075270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.084+0000 7ff0b49fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0b0104190 0x7ff0b00757b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48698/0 (socket says 172.21.15.22:48698) 2024-08-20T01:38:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.084+0000 7ff0b49fc640 1 -- 172.21.15.22:0/1420201812 learned_addr learned my addr 172.21.15.22:0/1420201812 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:34.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.084+0000 7ff0affff640 1 --2- 172.21.15.22:0/1420201812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b0102680 0x7ff0b0076a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:51928/0 (socket says 172.21.15.22:51928) 2024-08-20T01:38:34.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.084+0000 7ff0b49fc640 1 -- 172.21.15.22:0/1420201812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0b01037d0 msgr2=0x7ff0b0075270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:34.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.084+0000 7ff0b49fc640 1 --2- 172.21.15.22:0/1420201812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0b01037d0 0x7ff0b0075270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.084+0000 7ff0b49fc640 1 -- 172.21.15.22:0/1420201812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b0102680 msgr2=0x7ff0b0076a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:34.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.084+0000 7ff0b49fc640 1 --2- 172.21.15.22:0/1420201812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b0102680 0x7ff0b0076a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.084+0000 7ff0b49fc640 1 -- 172.21.15.22:0/1420201812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b0076020 con 0x7ff0b0104190 2024-08-20T01:38:34.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.085+0000 7ff0b49fc640 1 --2- 172.21.15.22:0/1420201812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0b0104190 0x7ff0b00757b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8004af0 tx=0x7ff0a8009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:34.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.085+0000 7ff0ad7fa640 1 -- 172.21.15.22:0/1420201812 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8004040 con 0x7ff0b0104190 2024-08-20T01:38:34.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.085+0000 7ff0ad7fa640 1 -- 172.21.15.22:0/1420201812 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0a8004690 con 0x7ff0b0104190 2024-08-20T01:38:34.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.085+0000 7ff0b645f640 1 -- 172.21.15.22:0/1420201812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b01a2b20 con 0x7ff0b0104190 2024-08-20T01:38:34.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.085+0000 7ff0ad7fa640 1 -- 172.21.15.22:0/1420201812 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a803b400 con 0x7ff0b0104190 2024-08-20T01:38:34.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.085+0000 7ff0b645f640 1 -- 172.21.15.22:0/1420201812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b01a2fe0 con 0x7ff0b0104190 2024-08-20T01:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.087+0000 7ff0b924c740 1 Processor -- start 2024-08-20T01:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.087+0000 7ff0ad7fa640 1 -- 172.21.15.22:0/1420201812 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff0a80305a0 con 0x7ff0b0104190 2024-08-20T01:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.087+0000 7ff0b924c740 1 -- start start 2024-08-20T01:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0b924c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fbe8d0 0x564510fc0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0b924c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fc1200 0x564510fc35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0b924c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fc3c40 0x564510fc6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0b924c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564510f31360 con 0x564510fbe8d0 2024-08-20T01:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0b924c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564510f20860 con 0x564510fc1200 2024-08-20T01:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0b924c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564510f248a0 con 0x564510fc3c40 2024-08-20T01:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0af7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fbe8d0 0x564510fc0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0af7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fbe8d0 0x564510fc0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48704/0 (socket says 172.21.15.22:48704) 2024-08-20T01:38:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0affff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fc1200 0x564510fc35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0af7fe640 1 -- 172.21.15.22:0/3757079577 learned_addr learned my addr 172.21.15.22:0/3757079577 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0af7fe640 1 --2- 172.21.15.22:0/3757079577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fc3c40 0x564510fc6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0ad7fa640 1 --2- 172.21.15.22:0/1420201812 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff0980b3bd0 0x7ff0980b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0affff640 1 -- 172.21.15.22:0/3757079577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fc3c40 msgr2=0x564510fc6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0affff640 1 --2- 172.21.15.22:0/3757079577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fc3c40 0x564510fc6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0affff640 1 -- 172.21.15.22:0/3757079577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fbe8d0 msgr2=0x564510fc0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0affff640 1 --2- 172.21.15.22:0/3757079577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fbe8d0 0x564510fc0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0affff640 1 -- 172.21.15.22:0/3757079577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564510ec7e40 con 0x564510fc1200 2024-08-20T01:38:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0b49fc640 1 --2- 172.21.15.22:0/1420201812 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff0980b3bd0 0x7ff0980b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0ad7fa640 1 -- 172.21.15.22:0/1420201812 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ff0a802e030 con 0x7ff0b0104190 2024-08-20T01:38:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.088+0000 7ff0affff640 1 --2- 172.21.15.22:0/3757079577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fc1200 0x564510fc35f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0009c00 tx=0x7ff0a0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=537b77004f99d61 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.089+0000 7ff0967fc640 1 -- 172.21.15.22:0/3757079577 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0004050 con 0x564510fc1200 2024-08-20T01:38:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.089+0000 7ff0967fc640 1 -- 172.21.15.22:0/3757079577 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0a00054d0 con 0x564510fc1200 2024-08-20T01:38:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.089+0000 7ff0967fc640 1 -- 172.21.15.22:0/3757079577 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0004d40 con 0x564510fc1200 2024-08-20T01:38:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.089+0000 7ff0b924c740 1 -- 172.21.15.22:0/3757079577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fc1200 msgr2=0x564510fc35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.089+0000 7ff0b924c740 1 --2- 172.21.15.22:0/3757079577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fc1200 0x564510fc35f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0009c00 tx=0x7ff0a0011810 comp rx=0 tx=0).stop 2024-08-20T01:38:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.089+0000 7ff0b49fc640 1 --2- 172.21.15.22:0/1420201812 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff0980b3bd0 0x7ff0980b6090 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80cbaf0 tx=0x7ff0a80c0630 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.089+0000 7ff0b924c740 1 -- 172.21.15.22:0/3757079577 shutdown_connections 2024-08-20T01:38:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.089+0000 7ff0b924c740 1 --2- 172.21.15.22:0/3757079577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fc3c40 0x564510fc6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.089+0000 7ff0b924c740 1 --2- 172.21.15.22:0/3757079577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fc1200 0x564510fc35f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.089+0000 7ff0b924c740 1 --2- 172.21.15.22:0/3757079577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fbe8d0 0x564510fc0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.089+0000 7ff0b924c740 1 -- 172.21.15.22:0/3757079577 >> 172.21.15.22:0/3757079577 conn(0x564510fb9a20 msgr2=0x564510fba7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.089+0000 7ff0b924c740 1 -- 172.21.15.22:0/3757079577 shutdown_connections 2024-08-20T01:38:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.089+0000 7ff0b924c740 1 -- 172.21.15.22:0/3757079577 wait complete. 2024-08-20T01:38:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.090+0000 7ff0b924c740 1 -- start start 2024-08-20T01:38:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.090+0000 7ff0b924c740 1 Processor -- start 2024-08-20T01:38:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.090+0000 7ff0b924c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fbe8d0 0x564510fc8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.090+0000 7ff0b924c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fc1200 0x564510fc87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.090+0000 7ff0b924c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fc3c40 0x564510fc9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.090+0000 7ff0b924c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564510e59ab0 con 0x564510fc3c40 2024-08-20T01:38:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.090+0000 7ff0b924c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564510ea7780 con 0x564510fbe8d0 2024-08-20T01:38:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.090+0000 7ff0b924c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564510fc6c20 con 0x564510fc1200 2024-08-20T01:38:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.090+0000 7ff0b924c740 10 client.0 _ll_register_callbacks cb 0x564510c2fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.090+0000 7ff0affff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fc1200 0x564510fc87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.090+0000 7ff0af7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fc3c40 0x564510fc9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.090+0000 7ff0affff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fc1200 0x564510fc87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:49854/0 (socket says 172.21.15.22:49854) 2024-08-20T01:38:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.090+0000 7ff0affff640 1 -- 172.21.15.22:0/2152265875 learned_addr learned my addr 172.21.15.22:0/2152265875 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.091+0000 7ff0af7fe640 1 --2- 172.21.15.22:0/2152265875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fbe8d0 0x564510fc8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.091+0000 7ff0affff640 1 -- 172.21.15.22:0/2152265875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fbe8d0 msgr2=0x564510fc8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.091+0000 7ff0affff640 1 --2- 172.21.15.22:0/2152265875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fbe8d0 0x564510fc8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.091+0000 7ff0affff640 1 -- 172.21.15.22:0/2152265875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fc3c40 msgr2=0x564510fc9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.091+0000 7ff0affff640 1 --2- 172.21.15.22:0/2152265875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fc3c40 0x564510fc9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.091+0000 7ff0affff640 1 -- 172.21.15.22:0/2152265875 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564510c83790 con 0x564510fc1200 2024-08-20T01:38:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.091+0000 7ff0affff640 1 --2- 172.21.15.22:0/2152265875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fc1200 0x564510fc87c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0005bc0 tx=0x7ff0a0004760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e83b74698e17f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.091+0000 7ff08f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:38:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.091+0000 7ff08f7fe640 1 -- 172.21.15.22:0/2152265875 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0029070 con 0x564510fc1200 2024-08-20T01:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.091+0000 7ff0b924c740 1 -- 172.21.15.22:0/2152265875 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564510ecfe00 con 0x564510fc1200 2024-08-20T01:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.091+0000 7ff08f7fe640 1 -- 172.21.15.22:0/2152265875 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ff0a0003a00 con 0x564510fc1200 2024-08-20T01:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.091+0000 7ff08f7fe640 1 -- 172.21.15.22:0/2152265875 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff0a0035050 con 0x564510fc1200 2024-08-20T01:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.091+0000 7ff0b924c740 10 client.26236 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.091+0000 7ff0b924c740 1 -- 172.21.15.22:0/2152265875 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564510cfc620 con 0x564510fc1200 2024-08-20T01:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.092+0000 7ff08f7fe640 1 -- 172.21.15.22:0/2152265875 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564510ecfe00 con 0x564510fc1200 2024-08-20T01:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.092+0000 7ff08f7fe640 1 -- 172.21.15.22:0/2152265875 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7ff0a0023ae0 con 0x564510fc1200 2024-08-20T01:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.092+0000 7ff0b924c740 10 client.26236 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.092+0000 7ff0b924c740 10 client.26236 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.092+0000 7ff0b924c740 20 client.26236 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.092+0000 7ff0b924c740 1 --2- 172.21.15.22:0/2152265875 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564510fd37b0 0x564510fd5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.092+0000 7ff0b924c740 4 client.26236 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.092+0000 7ff0b924c740 1 -- 172.21.15.22:0/2152265875 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564510f332b0 con 0x564510fd37b0 2024-08-20T01:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.092+0000 7ff0af7fe640 1 --2- 172.21.15.22:0/2152265875 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564510fd37b0 0x564510fd5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.093+0000 7ff0af7fe640 1 --2- 172.21.15.22:0/2152265875 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564510fd37b0 0x564510fd5bd0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63213261a462229c server_cookie=58541e5b13dab881 in_seq=0 out_seq=0 2024-08-20T01:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.093+0000 7ff08f7fe640 10 client.26236 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.093+0000 7ff08f7fe640 1 -- 172.21.15.22:0/2152265875 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564510f332b0 con 0x564510fd37b0 2024-08-20T01:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.093+0000 7ff08f7fe640 10 client.26236 handle_command_reply: tid=0 2024-08-20T01:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.093+0000 7ff0b924c740 1 client.26236 shutdown 2024-08-20T01:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.093+0000 7ff0b924c740 1 -- 172.21.15.22:0/2152265875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fc1200 msgr2=0x564510fc87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.093+0000 7ff0b924c740 1 --2- 172.21.15.22:0/2152265875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fc1200 0x564510fc87c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0005bc0 tx=0x7ff0a0004760 comp rx=0 tx=0).stop 2024-08-20T01:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.093+0000 7ff0b924c740 1 -- 172.21.15.22:0/2152265875 shutdown_connections 2024-08-20T01:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.093+0000 7ff0b924c740 1 --2- 172.21.15.22:0/2152265875 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564510fd37b0 0x564510fd5bd0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.093+0000 7ff0b924c740 1 --2- 172.21.15.22:0/2152265875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fc3c40 0x564510fc9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.093+0000 7ff08f7fe640 0 client.26236 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.093+0000 7ff0b924c740 1 --2- 172.21.15.22:0/2152265875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fc1200 0x564510fc87c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.093+0000 7ff0b924c740 1 --2- 172.21.15.22:0/2152265875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fbe8d0 0x564510fc8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.093+0000 7ff0b924c740 1 -- 172.21.15.22:0/2152265875 >> 172.21.15.22:0/2152265875 conn(0x564510fb9a20 msgr2=0x564510fb8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.094+0000 7ff0b924c740 1 -- 172.21.15.22:0/2152265875 shutdown_connections 2024-08-20T01:38:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.094+0000 7ff0b924c740 1 -- 172.21.15.22:0/2152265875 wait complete. 2024-08-20T01:38:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.094+0000 7ff0b924c740 20 client.26236 trim_cache size 0 max 16384 2024-08-20T01:38:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0b924c740 1 Processor -- start 2024-08-20T01:38:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0b924c740 1 -- start start 2024-08-20T01:38:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0b924c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fbe8d0 0x564510fc7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0b924c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fc1200 0x564510fc4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0b924c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fc3c40 0x564510fc4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0b924c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b01ae890 con 0x564510fc1200 2024-08-20T01:38:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0b924c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b01ac0a0 con 0x564510fc3c40 2024-08-20T01:38:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0b924c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b01a9ef0 con 0x564510fbe8d0 2024-08-20T01:38:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0affff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fc1200 0x564510fc4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0affff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fc1200 0x564510fc4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48720/0 (socket says 172.21.15.22:48720) 2024-08-20T01:38:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0affff640 1 -- 172.21.15.22:0/1325194059 learned_addr learned my addr 172.21.15.22:0/1325194059 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0af7fe640 1 --2- 172.21.15.22:0/1325194059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fbe8d0 0x564510fc7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0af7fe640 1 --2- 172.21.15.22:0/1325194059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fc3c40 0x564510fc4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0affff640 1 -- 172.21.15.22:0/1325194059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fbe8d0 msgr2=0x564510fc7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0affff640 1 --2- 172.21.15.22:0/1325194059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fbe8d0 0x564510fc7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0affff640 1 -- 172.21.15.22:0/1325194059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fc3c40 msgr2=0x564510fc4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0affff640 1 --2- 172.21.15.22:0/1325194059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fc3c40 0x564510fc4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0affff640 1 -- 172.21.15.22:0/1325194059 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564510fb4780 con 0x564510fc1200 2024-08-20T01:38:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0af7fe640 1 --2- 172.21.15.22:0/1325194059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fbe8d0 0x564510fc7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.109+0000 7ff0affff640 1 --2- 172.21.15.22:0/1325194059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fc1200 0x564510fc4020 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0023040 tx=0x7ff0a0019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac15c84ce3d3af4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.110+0000 7ff095ffb640 1 -- 172.21.15.22:0/1325194059 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0032020 con 0x564510fc1200 2024-08-20T01:38:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.110+0000 7ff095ffb640 1 -- 172.21.15.22:0/1325194059 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0a0019dd0 con 0x564510fc1200 2024-08-20T01:38:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.110+0000 7ff095ffb640 1 -- 172.21.15.22:0/1325194059 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0029070 con 0x564510fc1200 2024-08-20T01:38:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.110+0000 7ff0b924c740 1 -- 172.21.15.22:0/1325194059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fc1200 msgr2=0x564510fc4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.110+0000 7ff0b924c740 1 --2- 172.21.15.22:0/1325194059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fc1200 0x564510fc4020 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0023040 tx=0x7ff0a0019480 comp rx=0 tx=0).stop 2024-08-20T01:38:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.110+0000 7ff0b924c740 1 -- 172.21.15.22:0/1325194059 shutdown_connections 2024-08-20T01:38:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.110+0000 7ff0b924c740 1 --2- 172.21.15.22:0/1325194059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fc3c40 0x564510fc4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.110+0000 7ff0b924c740 1 --2- 172.21.15.22:0/1325194059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fc1200 0x564510fc4020 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.110+0000 7ff0b924c740 1 --2- 172.21.15.22:0/1325194059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fbe8d0 0x564510fc7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.110+0000 7ff0b924c740 1 -- 172.21.15.22:0/1325194059 >> 172.21.15.22:0/1325194059 conn(0x564510fb9a20 msgr2=0x564510fc7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:34.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.110+0000 7ff0b924c740 1 -- 172.21.15.22:0/1325194059 shutdown_connections 2024-08-20T01:38:34.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.110+0000 7ff0b924c740 1 -- 172.21.15.22:0/1325194059 wait complete. 2024-08-20T01:38:34.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.111+0000 7ff0b924c740 1 -- start start 2024-08-20T01:38:34.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.111+0000 7ff0b924c740 1 Processor -- start 2024-08-20T01:38:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.111+0000 7ff0b924c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fbe8d0 0x564510fcd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.111+0000 7ff0b924c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fc1200 0x564510fcd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.111+0000 7ff0b924c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fc3c40 0x564510fce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.111+0000 7ff0b924c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b01aa560 con 0x564510fc3c40 2024-08-20T01:38:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.111+0000 7ff0b924c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b01ab9d0 con 0x564510fbe8d0 2024-08-20T01:38:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.111+0000 7ff0b924c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b01aac30 con 0x564510fc1200 2024-08-20T01:38:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.111+0000 7ff0b924c740 10 client.0 _ll_register_callbacks cb 0x7ff0a400bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.111+0000 7ff0af7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fc3c40 0x564510fce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.111+0000 7ff0af7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fc3c40 0x564510fce2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48726/0 (socket says 172.21.15.22:48726) 2024-08-20T01:38:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.111+0000 7ff0af7fe640 1 -- 172.21.15.22:0/2884423512 learned_addr learned my addr 172.21.15.22:0/2884423512 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.111+0000 7ff0affff640 1 --2- 172.21.15.22:0/2884423512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fc1200 0x564510fcd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.111+0000 7ff0af7fe640 1 --2- 172.21.15.22:0/2884423512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fbe8d0 0x564510fcd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.112+0000 7ff0affff640 1 -- 172.21.15.22:0/2884423512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fbe8d0 msgr2=0x564510fcd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.112+0000 7ff0affff640 1 --2- 172.21.15.22:0/2884423512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fbe8d0 0x564510fcd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.112+0000 7ff0affff640 1 -- 172.21.15.22:0/2884423512 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fc3c40 msgr2=0x564510fce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.112+0000 7ff0affff640 1 --2- 172.21.15.22:0/2884423512 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fc3c40 0x564510fce2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.112+0000 7ff0affff640 1 -- 172.21.15.22:0/2884423512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564510fcead0 con 0x564510fc1200 2024-08-20T01:38:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.112+0000 7ff0af7fe640 1 --2- 172.21.15.22:0/2884423512 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fc3c40 0x564510fce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.112+0000 7ff0affff640 1 --2- 172.21.15.22:0/2884423512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fc1200 0x564510fcd6d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0011850 tx=0x7ff0a0009ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de578da692cedbd5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.112+0000 7ff08f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:38:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.112+0000 7ff08f7fe640 1 -- 172.21.15.22:0/2884423512 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0029040 con 0x564510fc1200 2024-08-20T01:38:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.112+0000 7ff08f7fe640 1 -- 172.21.15.22:0/2884423512 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ff0a0019920 con 0x564510fc1200 2024-08-20T01:38:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.112+0000 7ff0b924c740 1 -- 172.21.15.22:0/2884423512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0a0019dd0 con 0x564510fc1200 2024-08-20T01:38:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.112+0000 7ff08f7fe640 1 -- 172.21.15.22:0/2884423512 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff0a0019b60 con 0x564510fc1200 2024-08-20T01:38:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.112+0000 7ff0b924c740 10 client.26242 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.112+0000 7ff0b924c740 1 -- 172.21.15.22:0/2884423512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564510fcfe40 con 0x564510fc1200 2024-08-20T01:38:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.112+0000 7ff08f7fe640 1 -- 172.21.15.22:0/2884423512 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0a0019dd0 con 0x564510fc1200 2024-08-20T01:38:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.113+0000 7ff08f7fe640 1 -- 172.21.15.22:0/2884423512 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7ff0a00235d0 con 0x564510fc1200 2024-08-20T01:38:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.113+0000 7ff0b924c740 10 client.26242 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.113+0000 7ff0b924c740 10 client.26242 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:38:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.113+0000 7ff0b924c740 20 client.26242 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.113+0000 7ff0b924c740 1 --2- 172.21.15.22:0/2884423512 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56451103e6f0 0x564511040b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.113+0000 7ff0b924c740 4 client.26242 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:38:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.113+0000 7ff0b924c740 1 -- 172.21.15.22:0/2884423512 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564510f2ed50 con 0x56451103e6f0 2024-08-20T01:38:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.113+0000 7ff0af7fe640 1 --2- 172.21.15.22:0/2884423512 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56451103e6f0 0x564511040b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.113+0000 7ff0af7fe640 1 --2- 172.21.15.22:0/2884423512 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56451103e6f0 0x564511040b10 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=546628e4ac761cb8 server_cookie=af47e52bf51083b4 in_seq=0 out_seq=0 2024-08-20T01:38:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.113+0000 7ff08f7fe640 10 client.26242 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:34.136 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.133+0000 7ff08f7fe640 1 -- 172.21.15.22:0/2884423512 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564510f2ed50 con 0x56451103e6f0 2024-08-20T01:38:34.136 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.133+0000 7ff08f7fe640 10 client.26242 handle_command_reply: tid=0 2024-08-20T01:38:34.136 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.134+0000 7ff0b924c740 1 client.26242 shutdown 2024-08-20T01:38:34.136 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.134+0000 7ff0b924c740 1 -- 172.21.15.22:0/2884423512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fc1200 msgr2=0x564510fcd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:34.136 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.134+0000 7ff0b924c740 1 --2- 172.21.15.22:0/2884423512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fc1200 0x564510fcd6d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0011850 tx=0x7ff0a0009ad0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.136 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.134+0000 7ff0b924c740 1 -- 172.21.15.22:0/2884423512 shutdown_connections 2024-08-20T01:38:34.136 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.134+0000 7ff0b924c740 1 --2- 172.21.15.22:0/2884423512 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56451103e6f0 0x564511040b10 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.136 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.134+0000 7ff0b924c740 1 --2- 172.21.15.22:0/2884423512 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564510fc3c40 0x564510fce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.136 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.134+0000 7ff0b924c740 1 --2- 172.21.15.22:0/2884423512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564510fc1200 0x564510fcd6d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.136 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.134+0000 7ff0b924c740 1 --2- 172.21.15.22:0/2884423512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564510fbe8d0 0x564510fcd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.136 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.134+0000 7ff08f7fe640 0 client.26242 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:34.136 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.134+0000 7ff0b924c740 1 -- 172.21.15.22:0/2884423512 >> 172.21.15.22:0/2884423512 conn(0x564510fb9a20 msgr2=0x564510fb82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:34.137 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.134+0000 7ff0b924c740 1 -- 172.21.15.22:0/2884423512 shutdown_connections 2024-08-20T01:38:34.137 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.134+0000 7ff0b924c740 1 -- 172.21.15.22:0/2884423512 wait complete. 2024-08-20T01:38:34.137 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.134+0000 7ff0b924c740 20 client.26242 trim_cache size 0 max 16384 2024-08-20T01:38:34.137 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:38:34.137 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:38:34.137 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:38:34.137 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:38:34.138 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.134+0000 7ff0b645f640 1 -- 172.21.15.22:0/1420201812 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff0980b3bd0 msgr2=0x7ff0980b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:34.138 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.134+0000 7ff0b645f640 1 --2- 172.21.15.22:0/1420201812 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff0980b3bd0 0x7ff0980b6090 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80cbaf0 tx=0x7ff0a80c0630 comp rx=0 tx=0).stop 2024-08-20T01:38:34.138 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.134+0000 7ff0b645f640 1 -- 172.21.15.22:0/1420201812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0b0104190 msgr2=0x7ff0b00757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:34.138 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.134+0000 7ff0b645f640 1 --2- 172.21.15.22:0/1420201812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0b0104190 0x7ff0b00757b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8004af0 tx=0x7ff0a8009890 comp rx=0 tx=0).stop 2024-08-20T01:38:34.138 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.135+0000 7ff0b645f640 1 -- 172.21.15.22:0/1420201812 shutdown_connections 2024-08-20T01:38:34.138 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.135+0000 7ff0b645f640 1 --2- 172.21.15.22:0/1420201812 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff0980b3bd0 0x7ff0980b6090 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.138 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.135+0000 7ff0b645f640 1 --2- 172.21.15.22:0/1420201812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0b0104190 0x7ff0b00757b0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.138 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.135+0000 7ff0b645f640 1 --2- 172.21.15.22:0/1420201812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0b01037d0 0x7ff0b0075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.138 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.135+0000 7ff0b645f640 1 --2- 172.21.15.22:0/1420201812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b0102680 0x7ff0b0076a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:34.139 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.135+0000 7ff0b645f640 1 -- 172.21.15.22:0/1420201812 >> 172.21.15.22:0/1420201812 conn(0x7ff0b00fdf40 msgr2=0x7ff0b0106b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:34.139 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.135+0000 7ff0b645f640 1 -- 172.21.15.22:0/1420201812 shutdown_connections 2024-08-20T01:38:34.139 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:34.135+0000 7ff0b645f640 1 -- 172.21.15.22:0/1420201812 wait complete. 2024-08-20T01:38:35.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:34 smithi134 ceph-mon[22511]: pgmap v569: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 2.6 MiB/s wr, 2.77k op/s 2024-08-20T01:38:35.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:34 smithi077 ceph-mon[22251]: pgmap v569: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 2.6 MiB/s wr, 2.77k op/s 2024-08-20T01:38:35.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:34 smithi022 ceph-mon[18709]: pgmap v569: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 2.6 MiB/s wr, 2.77k op/s 2024-08-20T01:38:37.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:36 smithi134 ceph-mon[22511]: pgmap v570: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.6 MiB/s wr, 2.64k op/s 2024-08-20T01:38:37.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:36 smithi077 ceph-mon[22251]: pgmap v570: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.6 MiB/s wr, 2.64k op/s 2024-08-20T01:38:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:36 smithi022 ceph-mon[18709]: pgmap v570: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.6 MiB/s wr, 2.64k op/s 2024-08-20T01:38:39.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:38 smithi134 ceph-mon[22511]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 1.7 MiB/s wr, 3.10k op/s 2024-08-20T01:38:39.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:38 smithi077 ceph-mon[22251]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 1.7 MiB/s wr, 3.10k op/s 2024-08-20T01:38:39.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:38 smithi022 ceph-mon[18709]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 1.7 MiB/s wr, 3.10k op/s 2024-08-20T01:38:40.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:39 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:38:40.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:39 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:38:40.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:39 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:38:41.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:40 smithi134 ceph-mon[22511]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 986 KiB/s wr, 2.63k op/s 2024-08-20T01:38:41.260 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.261 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.261 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.261 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.261 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:40 smithi134 ceph-mon[22511]: Adjusting osd_memory_target on smithi134 to 176.0M 2024-08-20T01:38:41.261 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:40 smithi134 ceph-mon[22511]: Unable to set osd_memory_target on smithi134 to 184597504: error parsing value: Value '184597504' is below minimum 939524096 2024-08-20T01:38:41.261 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.261 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.261 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.261 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.261 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:40 smithi134 ceph-mon[22511]: Adjusting osd_memory_target on smithi077 to 176.0M 2024-08-20T01:38:41.261 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:40 smithi134 ceph-mon[22511]: Unable to set osd_memory_target on smithi077 to 184576000: error parsing value: Value '184576000' is below minimum 939524096 2024-08-20T01:38:41.261 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:38:41.262 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:38:41.262 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:38:41.262 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:40 smithi022 ceph-mon[18709]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 986 KiB/s wr, 2.63k op/s 2024-08-20T01:38:41.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:40 smithi022 ceph-mon[18709]: Adjusting osd_memory_target on smithi134 to 176.0M 2024-08-20T01:38:41.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:40 smithi022 ceph-mon[18709]: Unable to set osd_memory_target on smithi134 to 184597504: error parsing value: Value '184597504' is below minimum 939524096 2024-08-20T01:38:41.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:40 smithi022 ceph-mon[18709]: Adjusting osd_memory_target on smithi077 to 176.0M 2024-08-20T01:38:41.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:40 smithi022 ceph-mon[18709]: Unable to set osd_memory_target on smithi077 to 184576000: error parsing value: Value '184576000' is below minimum 939524096 2024-08-20T01:38:41.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:38:41.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:38:41.264 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:38:41.264 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:40 smithi077 ceph-mon[22251]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 986 KiB/s wr, 2.63k op/s 2024-08-20T01:38:41.264 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.264 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.264 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.264 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.264 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:40 smithi077 ceph-mon[22251]: Adjusting osd_memory_target on smithi134 to 176.0M 2024-08-20T01:38:41.264 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:40 smithi077 ceph-mon[22251]: Unable to set osd_memory_target on smithi134 to 184597504: error parsing value: Value '184597504' is below minimum 939524096 2024-08-20T01:38:41.264 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.264 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.264 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.264 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T01:38:41.264 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:40 smithi077 ceph-mon[22251]: Adjusting osd_memory_target on smithi077 to 176.0M 2024-08-20T01:38:41.265 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:40 smithi077 ceph-mon[22251]: Unable to set osd_memory_target on smithi077 to 184576000: error parsing value: Value '184576000' is below minimum 939524096 2024-08-20T01:38:41.265 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:38:41.265 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:38:41.265 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:38:43.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:42 smithi134 ceph-mon[22511]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.3 MiB/s wr, 2.27k op/s 2024-08-20T01:38:43.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:42 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:43.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:42 smithi077 ceph-mon[22251]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.3 MiB/s wr, 2.27k op/s 2024-08-20T01:38:43.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:42 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:43.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:42 smithi022 ceph-mon[18709]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.3 MiB/s wr, 2.27k op/s 2024-08-20T01:38:43.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:42 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:45.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:44 smithi134 ceph-mon[22511]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 834 KiB/s wr, 1.96k op/s 2024-08-20T01:38:45.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:44 smithi077 ceph-mon[22251]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 834 KiB/s wr, 1.96k op/s 2024-08-20T01:38:45.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:44 smithi022 ceph-mon[18709]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 834 KiB/s wr, 1.96k op/s 2024-08-20T01:38:47.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:46 smithi134 ceph-mon[22511]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.2 MiB/s wr, 1.57k op/s 2024-08-20T01:38:47.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:46 smithi077 ceph-mon[22251]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.2 MiB/s wr, 1.57k op/s 2024-08-20T01:38:47.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:46 smithi022 ceph-mon[18709]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.2 MiB/s wr, 1.57k op/s 2024-08-20T01:38:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.267+0000 7f401aca8640 1 -- 172.21.15.22:0/2690380194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014101580 msgr2=0x7f4014101980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.267+0000 7f401aca8640 1 --2- 172.21.15.22:0/2690380194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014101580 0x7f4014101980 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f4008009930 tx=0x7f400802a420 comp rx=0 tx=0).stop 2024-08-20T01:38:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.267+0000 7f401aca8640 1 -- 172.21.15.22:0/2690380194 shutdown_connections 2024-08-20T01:38:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.267+0000 7f401aca8640 1 --2- 172.21.15.22:0/2690380194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4014103090 0x7f4014109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.267+0000 7f401aca8640 1 --2- 172.21.15.22:0/2690380194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40141026d0 0x7f4014102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.267+0000 7f401aca8640 1 --2- 172.21.15.22:0/2690380194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014101580 0x7f4014101980 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.267+0000 7f401aca8640 1 -- 172.21.15.22:0/2690380194 >> 172.21.15.22:0/2690380194 conn(0x7f40140fce40 msgr2=0x7f40140ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:47.270 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.268+0000 7f401aca8640 1 -- 172.21.15.22:0/2690380194 shutdown_connections 2024-08-20T01:38:47.270 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.268+0000 7f401aca8640 1 -- 172.21.15.22:0/2690380194 wait complete. 2024-08-20T01:38:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.269+0000 7f401aca8640 1 Processor -- start 2024-08-20T01:38:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.270+0000 7f401aca8640 1 -- start start 2024-08-20T01:38:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.270+0000 7f401aca8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014101580 0x7f4014197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.270+0000 7f401aca8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40141026d0 0x7f4014198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.270+0000 7f401aca8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4014103090 0x7f4014198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.270+0000 7f401aca8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f401410d2a0 con 0x7f4014101580 2024-08-20T01:38:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.270+0000 7f401aca8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f401410d120 con 0x7f4014103090 2024-08-20T01:38:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.271+0000 7f4018a44640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014101580 0x7f4014197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.271+0000 7f4018a44640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014101580 0x7f4014197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43260/0 (socket says 172.21.15.22:43260) 2024-08-20T01:38:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.271+0000 7f4018a44640 1 -- 172.21.15.22:0/1628764951 learned_addr learned my addr 172.21.15.22:0/1628764951 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.271+0000 7f401aca8640 1 -- 172.21.15.22:0/1628764951 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f401410d420 con 0x7f40141026d0 2024-08-20T01:38:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.271+0000 7f4013fff640 1 --2- 172.21.15.22:0/1628764951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40141026d0 0x7f4014198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.271+0000 7f4018a44640 1 -- 172.21.15.22:0/1628764951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40141026d0 msgr2=0x7f4014198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.271+0000 7f4018a44640 1 --2- 172.21.15.22:0/1628764951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40141026d0 0x7f4014198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.271+0000 7f4018a44640 1 -- 172.21.15.22:0/1628764951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4014103090 msgr2=0x7f4014198ca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T01:38:47.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.271+0000 7f4018a44640 1 --2- 172.21.15.22:0/1628764951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4014103090 0x7f4014198ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.271+0000 7f4018a44640 1 -- 172.21.15.22:0/1628764951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4014199560 con 0x7f4014101580 2024-08-20T01:38:47.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.272+0000 7f4018a44640 1 --2- 172.21.15.22:0/1628764951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014101580 0x7f4014197a20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4008031500 tx=0x7f4008003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:47.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.272+0000 7f4011ffb640 1 -- 172.21.15.22:0/1628764951 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400803f070 con 0x7f4014101580 2024-08-20T01:38:47.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.272+0000 7f4011ffb640 1 -- 172.21.15.22:0/1628764951 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4008031c50 con 0x7f4014101580 2024-08-20T01:38:47.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.272+0000 7f4011ffb640 1 -- 172.21.15.22:0/1628764951 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4008035030 con 0x7f4014101580 2024-08-20T01:38:47.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.272+0000 7f401aca8640 1 -- 172.21.15.22:0/1628764951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40141997f0 con 0x7f4014101580 2024-08-20T01:38:47.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.273+0000 7f401aca8640 1 -- 172.21.15.22:0/1628764951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f401419fdc0 con 0x7f4014101580 2024-08-20T01:38:47.278 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.276+0000 7f401da95740 1 Processor -- start 2024-08-20T01:38:47.278 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.276+0000 7f401da95740 1 -- start start 2024-08-20T01:38:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.278+0000 7f401da95740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc62810 0x5613cdc64c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.278+0000 7f401da95740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc65220 0x5613cdc676b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.278+0000 7f401da95740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc67dc0 0x5613cdc6a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.278+0000 7f401da95740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5613cdbd1360 con 0x5613cdc62810 2024-08-20T01:38:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.278+0000 7f401da95740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5613cdbc0860 con 0x5613cdc65220 2024-08-20T01:38:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.278+0000 7f401da95740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5613cdbc48a0 con 0x5613cdc67dc0 2024-08-20T01:38:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.278+0000 7f4019245640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc62810 0x5613cdc64c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.278+0000 7f4019245640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc62810 0x5613cdc64c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43268/0 (socket says 172.21.15.22:43268) 2024-08-20T01:38:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.278+0000 7f4019245640 1 -- 172.21.15.22:0/4050544933 learned_addr learned my addr 172.21.15.22:0/4050544933 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.279+0000 7f4013fff640 1 --2- 172.21.15.22:0/4050544933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc67dc0 0x5613cdc6a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.279+0000 7f4019245640 1 -- 172.21.15.22:0/4050544933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc67dc0 msgr2=0x5613cdc6a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.279+0000 7f4019245640 1 --2- 172.21.15.22:0/4050544933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc67dc0 0x5613cdc6a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.279+0000 7f4019245640 1 -- 172.21.15.22:0/4050544933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc65220 msgr2=0x5613cdc676b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:38:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.279+0000 7f4019245640 1 --2- 172.21.15.22:0/4050544933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc65220 0x5613cdc676b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.279+0000 7f4019245640 1 -- 172.21.15.22:0/4050544933 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613cdb67e40 con 0x5613cdc62810 2024-08-20T01:38:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.279+0000 7f4013fff640 1 --2- 172.21.15.22:0/4050544933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc67dc0 0x5613cdc6a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.279+0000 7f4019245640 1 --2- 172.21.15.22:0/4050544933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc62810 0x5613cdc64c00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f400c014930 tx=0x7f400c014a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415e6811b48c5335 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.280+0000 7f3ffeffd640 1 -- 172.21.15.22:0/4050544933 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c00fd60 con 0x5613cdc62810 2024-08-20T01:38:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.280+0000 7f3ffeffd640 1 -- 172.21.15.22:0/4050544933 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f400c011580 con 0x5613cdc62810 2024-08-20T01:38:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.280+0000 7f3ffeffd640 1 -- 172.21.15.22:0/4050544933 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c00aab0 con 0x5613cdc62810 2024-08-20T01:38:47.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.281+0000 7f401da95740 1 -- 172.21.15.22:0/4050544933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc62810 msgr2=0x5613cdc64c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:47.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.281+0000 7f401da95740 1 --2- 172.21.15.22:0/4050544933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc62810 0x5613cdc64c00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f400c014930 tx=0x7f400c014a20 comp rx=0 tx=0).stop 2024-08-20T01:38:47.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.281+0000 7f4011ffb640 1 -- 172.21.15.22:0/1628764951 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4008042070 con 0x7f4014101580 2024-08-20T01:38:47.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.281+0000 7f401da95740 1 -- 172.21.15.22:0/4050544933 shutdown_connections 2024-08-20T01:38:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.281+0000 7f401da95740 1 --2- 172.21.15.22:0/4050544933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc67dc0 0x5613cdc6a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.281+0000 7f401da95740 1 --2- 172.21.15.22:0/4050544933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc65220 0x5613cdc676b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.281+0000 7f401da95740 1 --2- 172.21.15.22:0/4050544933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc62810 0x5613cdc64c00 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.281+0000 7f401da95740 1 -- 172.21.15.22:0/4050544933 >> 172.21.15.22:0/4050544933 conn(0x5613cdc5aab0 msgr2=0x5613cdc59100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.282+0000 7f401da95740 1 -- 172.21.15.22:0/4050544933 shutdown_connections 2024-08-20T01:38:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.282+0000 7f401da95740 1 -- 172.21.15.22:0/4050544933 wait complete. 2024-08-20T01:38:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.282+0000 7f401da95740 1 -- start start 2024-08-20T01:38:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.282+0000 7f401da95740 1 Processor -- start 2024-08-20T01:38:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.283+0000 7f401da95740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc62810 0x5613cdc61ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.283+0000 7f401da95740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc65220 0x5613cdc60bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.283+0000 7f401da95740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc67dc0 0x5613cdc61250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.283+0000 7f401da95740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5613cdaf9ab0 con 0x5613cdc62810 2024-08-20T01:38:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.283+0000 7f401da95740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5613cdb47780 con 0x5613cdc67dc0 2024-08-20T01:38:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.283+0000 7f401da95740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5613cdc5b430 con 0x5613cdc65220 2024-08-20T01:38:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.283+0000 7f401da95740 10 client.0 _ll_register_callbacks cb 0x5613cd8cfa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.284+0000 7f4013fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc67dc0 0x5613cdc61250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.284+0000 7f4013fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc67dc0 0x5613cdc61250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:35624/0 (socket says 172.21.15.22:35624) 2024-08-20T01:38:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.284+0000 7f4013fff640 1 -- 172.21.15.22:0/306022848 learned_addr learned my addr 172.21.15.22:0/306022848 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.284+0000 7f4018a44640 1 --2- 172.21.15.22:0/306022848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc65220 0x5613cdc60bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.284+0000 7f4011ffb640 1 --2- 172.21.15.22:0/1628764951 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f40040b3ae0 0x7f40040b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.285+0000 7f4011ffb640 1 -- 172.21.15.22:0/1628764951 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f4008104480 con 0x7f4014101580 2024-08-20T01:38:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.285+0000 7f4019245640 1 --2- 172.21.15.22:0/1628764951 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f40040b3ae0 0x7f40040b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.285+0000 7f4018a44640 1 -- 172.21.15.22:0/306022848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc67dc0 msgr2=0x5613cdc61250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.285+0000 7f4018a44640 1 --2- 172.21.15.22:0/306022848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc67dc0 0x5613cdc61250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.285+0000 7f4018a44640 1 -- 172.21.15.22:0/306022848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc62810 msgr2=0x5613cdc61ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.285+0000 7f4018a44640 1 --2- 172.21.15.22:0/306022848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc62810 0x5613cdc61ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.285+0000 7f4018a44640 1 -- 172.21.15.22:0/306022848 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613cd923790 con 0x5613cdc65220 2024-08-20T01:38:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.285+0000 7f4018a44640 1 --2- 172.21.15.22:0/306022848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc65220 0x5613cdc60bf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4008101ee0 tx=0x7f400803b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40e6151f7f5282c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.285+0000 7f3ff3fff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:38:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.286+0000 7f4019245640 1 --2- 172.21.15.22:0/1628764951 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f40040b3ae0 0x7f40040b5fa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f400c0146c0 tx=0x7f400c004b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.286+0000 7f3ff3fff640 1 -- 172.21.15.22:0/306022848 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4008049070 con 0x5613cdc65220 2024-08-20T01:38:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.286+0000 7f401da95740 1 -- 172.21.15.22:0/306022848 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5613cdb6fe00 con 0x5613cdc65220 2024-08-20T01:38:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.286+0000 7f3ff3fff640 1 -- 172.21.15.22:0/306022848 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f40080d41c0 con 0x5613cdc65220 2024-08-20T01:38:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.286+0000 7f3ff3fff640 1 -- 172.21.15.22:0/306022848 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f40080cab00 con 0x5613cdc65220 2024-08-20T01:38:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.286+0000 7f401da95740 10 client.26248 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.286+0000 7f401da95740 1 -- 172.21.15.22:0/306022848 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5613cd99c620 con 0x5613cdc65220 2024-08-20T01:38:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.286+0000 7f3ff3fff640 1 -- 172.21.15.22:0/306022848 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5613cdb6fe00 con 0x5613cdc65220 2024-08-20T01:38:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.287+0000 7f3ff3fff640 1 -- 172.21.15.22:0/306022848 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f40081040c0 con 0x5613cdc65220 2024-08-20T01:38:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.287+0000 7f401da95740 10 client.26248 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.287+0000 7f401da95740 10 client.26248 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:38:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.287+0000 7f401da95740 20 client.26248 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.287+0000 7f401da95740 1 --2- 172.21.15.22:0/306022848 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5613cdc736a0 0x5613cdc75a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.287+0000 7f401da95740 4 client.26248 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.287+0000 7f401da95740 1 -- 172.21.15.22:0/306022848 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613cdbd32b0 con 0x5613cdc736a0 2024-08-20T01:38:47.291 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.287+0000 7f4013fff640 1 --2- 172.21.15.22:0/306022848 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5613cdc736a0 0x5613cdc75a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:47.291 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.288+0000 7f3ff3fff640 10 client.26248 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:47.291 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.288+0000 7f4013fff640 1 --2- 172.21.15.22:0/306022848 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5613cdc736a0 0x5613cdc75a90 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3b957a06b6d8d80 server_cookie=a2e9f8edd2063173 in_seq=0 out_seq=0 2024-08-20T01:38:47.291 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.289+0000 7f3ff3fff640 1 -- 172.21.15.22:0/306022848 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5613cdbd32b0 con 0x5613cdc736a0 2024-08-20T01:38:47.291 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.289+0000 7f3ff3fff640 10 client.26248 handle_command_reply: tid=0 2024-08-20T01:38:47.291 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.289+0000 7f401da95740 1 client.26248 shutdown 2024-08-20T01:38:47.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.291+0000 7f401da95740 1 -- 172.21.15.22:0/306022848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc65220 msgr2=0x5613cdc60bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:47.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.291+0000 7f401da95740 1 --2- 172.21.15.22:0/306022848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc65220 0x5613cdc60bf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4008101ee0 tx=0x7f400803b8e0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.291+0000 7f401da95740 1 -- 172.21.15.22:0/306022848 shutdown_connections 2024-08-20T01:38:47.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.291+0000 7f401da95740 1 --2- 172.21.15.22:0/306022848 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5613cdc736a0 0x5613cdc75a90 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.291+0000 7f401da95740 1 --2- 172.21.15.22:0/306022848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc67dc0 0x5613cdc61250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.291+0000 7f401da95740 1 --2- 172.21.15.22:0/306022848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc65220 0x5613cdc60bf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.291+0000 7f401da95740 1 --2- 172.21.15.22:0/306022848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc62810 0x5613cdc61ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.295 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.291+0000 7f401da95740 1 -- 172.21.15.22:0/306022848 >> 172.21.15.22:0/306022848 conn(0x5613cdc5aab0 msgr2=0x5613cdc58850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:47.295 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.292+0000 7f3ff3fff640 0 client.26248 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:47.295 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.292+0000 7f401da95740 1 -- 172.21.15.22:0/306022848 shutdown_connections 2024-08-20T01:38:47.295 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.293+0000 7f401da95740 1 -- 172.21.15.22:0/306022848 wait complete. 2024-08-20T01:38:47.295 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.293+0000 7f401da95740 20 client.26248 trim_cache size 0 max 16384 2024-08-20T01:38:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.309+0000 7f401da95740 1 Processor -- start 2024-08-20T01:38:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.309+0000 7f401da95740 1 -- start start 2024-08-20T01:38:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.309+0000 7f401da95740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc62810 0x5613cdc756b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.309+0000 7f401da95740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc65220 0x5613cdc58030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.309+0000 7f401da95740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc67dc0 0x5613cdc58570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.309+0000 7f401da95740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f40141aa570 con 0x5613cdc65220 2024-08-20T01:38:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.309+0000 7f401da95740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f40141a7d80 con 0x5613cdc67dc0 2024-08-20T01:38:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.309+0000 7f401da95740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f40141a5bd0 con 0x5613cdc62810 2024-08-20T01:38:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.309+0000 7f4013fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc65220 0x5613cdc58030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.309+0000 7f4018a44640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc62810 0x5613cdc756b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.309+0000 7f4013fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc65220 0x5613cdc58030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43294/0 (socket says 172.21.15.22:43294) 2024-08-20T01:38:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.309+0000 7f4018a44640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc62810 0x5613cdc756b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:56270/0 (socket says 172.21.15.22:56270) 2024-08-20T01:38:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.309+0000 7f4013fff640 1 -- 172.21.15.22:0/1802195107 learned_addr learned my addr 172.21.15.22:0/1802195107 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.309+0000 7f4019245640 1 --2- 172.21.15.22:0/1802195107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc67dc0 0x5613cdc58570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.309+0000 7f4013fff640 1 -- 172.21.15.22:0/1802195107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc62810 msgr2=0x5613cdc756b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.309+0000 7f4013fff640 1 --2- 172.21.15.22:0/1802195107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc62810 0x5613cdc756b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.309+0000 7f4013fff640 1 -- 172.21.15.22:0/1802195107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc67dc0 msgr2=0x5613cdc58570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.309+0000 7f4013fff640 1 --2- 172.21.15.22:0/1802195107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc67dc0 0x5613cdc58570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.309+0000 7f4013fff640 1 -- 172.21.15.22:0/1802195107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613cdc615c0 con 0x5613cdc65220 2024-08-20T01:38:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.310+0000 7f4013fff640 1 --2- 172.21.15.22:0/1802195107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc65220 0x5613cdc58030 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x5613cdc76300 tx=0x7f4000014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82280149983b4ccc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.310+0000 7f3ffe7fc640 1 -- 172.21.15.22:0/1802195107 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000004030 con 0x5613cdc65220 2024-08-20T01:38:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.310+0000 7f3ffe7fc640 1 -- 172.21.15.22:0/1802195107 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40000035f0 con 0x5613cdc65220 2024-08-20T01:38:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.310+0000 7f3ffe7fc640 1 -- 172.21.15.22:0/1802195107 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40000126b0 con 0x5613cdc65220 2024-08-20T01:38:47.316 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.310+0000 7f401da95740 1 -- 172.21.15.22:0/1802195107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc65220 msgr2=0x5613cdc58030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:47.316 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.310+0000 7f401da95740 1 --2- 172.21.15.22:0/1802195107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc65220 0x5613cdc58030 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x5613cdc76300 tx=0x7f4000014840 comp rx=0 tx=0).stop 2024-08-20T01:38:47.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.311+0000 7f401da95740 1 -- 172.21.15.22:0/1802195107 shutdown_connections 2024-08-20T01:38:47.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.311+0000 7f401da95740 1 --2- 172.21.15.22:0/1802195107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc67dc0 0x5613cdc58570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.311+0000 7f401da95740 1 --2- 172.21.15.22:0/1802195107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc65220 0x5613cdc58030 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.311+0000 7f401da95740 1 --2- 172.21.15.22:0/1802195107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc62810 0x5613cdc756b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.311+0000 7f401da95740 1 -- 172.21.15.22:0/1802195107 >> 172.21.15.22:0/1802195107 conn(0x5613cdc5aab0 msgr2=0x5613cdc5ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:47.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.311+0000 7f401da95740 1 -- 172.21.15.22:0/1802195107 shutdown_connections 2024-08-20T01:38:47.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.311+0000 7f401da95740 1 -- 172.21.15.22:0/1802195107 wait complete. 2024-08-20T01:38:47.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.311+0000 7f401da95740 1 -- start start 2024-08-20T01:38:47.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.311+0000 7f401da95740 1 Processor -- start 2024-08-20T01:38:47.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.311+0000 7f401da95740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc62810 0x5613cdc6feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:47.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.311+0000 7f401da95740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc65220 0x5613cdc70550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:47.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.311+0000 7f401da95740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc67dc0 0x5613cdc6eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:47.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.311+0000 7f401da95740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f40141a6240 con 0x5613cdc67dc0 2024-08-20T01:38:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.311+0000 7f401da95740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f40141a76b0 con 0x5613cdc65220 2024-08-20T01:38:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.311+0000 7f401da95740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f40141a6910 con 0x5613cdc62810 2024-08-20T01:38:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.311+0000 7f4018a44640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc62810 0x5613cdc6feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.312+0000 7f4018a44640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc62810 0x5613cdc6feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:56278/0 (socket says 172.21.15.22:56278) 2024-08-20T01:38:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.312+0000 7f4018a44640 1 -- 172.21.15.22:0/4186337805 learned_addr learned my addr 172.21.15.22:0/4186337805 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.312+0000 7f4019245640 1 --2- 172.21.15.22:0/4186337805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc67dc0 0x5613cdc6eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.312+0000 7f4013fff640 1 --2- 172.21.15.22:0/4186337805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc65220 0x5613cdc70550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.312+0000 7f401da95740 10 client.0 _ll_register_callbacks cb 0x7f4008107c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.312+0000 7f4018a44640 1 -- 172.21.15.22:0/4186337805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc65220 msgr2=0x5613cdc70550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.312+0000 7f4018a44640 1 --2- 172.21.15.22:0/4186337805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc65220 0x5613cdc70550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.312+0000 7f4018a44640 1 -- 172.21.15.22:0/4186337805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc67dc0 msgr2=0x5613cdc6eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.312+0000 7f4018a44640 1 --2- 172.21.15.22:0/4186337805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc67dc0 0x5613cdc6eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.312+0000 7f4018a44640 1 -- 172.21.15.22:0/4186337805 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613cdc6f4d0 con 0x5613cdc62810 2024-08-20T01:38:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.312+0000 7f4018a44640 1 --2- 172.21.15.22:0/4186337805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc62810 0x5613cdc6feb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f40080cb320 tx=0x7f40080cfa80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75fb113694639e84 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.312+0000 7f3ff3fff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:38:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.312+0000 7f3ff3fff640 1 -- 172.21.15.22:0/4186337805 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4008049040 con 0x5613cdc62810 2024-08-20T01:38:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.312+0000 7f401da95740 1 -- 172.21.15.22:0/4186337805 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40000035f0 con 0x5613cdc62810 2024-08-20T01:38:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.312+0000 7f3ff3fff640 1 -- 172.21.15.22:0/4186337805 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f40080317a0 con 0x5613cdc62810 2024-08-20T01:38:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.312+0000 7f3ff3fff640 1 -- 172.21.15.22:0/4186337805 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f40080cb160 con 0x5613cdc62810 2024-08-20T01:38:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.312+0000 7f401da95740 10 client.26254 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.312+0000 7f401da95740 1 -- 172.21.15.22:0/4186337805 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5613cdc6e330 con 0x5613cdc62810 2024-08-20T01:38:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.313+0000 7f3ff3fff640 1 -- 172.21.15.22:0/4186337805 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40000035f0 con 0x5613cdc62810 2024-08-20T01:38:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.313+0000 7f3ff3fff640 1 -- 172.21.15.22:0/4186337805 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f40080c6d00 con 0x5613cdc62810 2024-08-20T01:38:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.313+0000 7f401da95740 10 client.26254 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.313+0000 7f401da95740 10 client.26254 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:38:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.313+0000 7f401da95740 20 client.26254 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.313+0000 7f401da95740 1 --2- 172.21.15.22:0/4186337805 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5613cdcde840 0x5613cdce0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.313+0000 7f401da95740 4 client.26254 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:38:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.313+0000 7f401da95740 1 -- 172.21.15.22:0/4186337805 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5613cdbced50 con 0x5613cdcde840 2024-08-20T01:38:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.313+0000 7f4013fff640 1 --2- 172.21.15.22:0/4186337805 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5613cdcde840 0x5613cdce0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.313+0000 7f3ff3fff640 10 client.26254 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.313+0000 7f4013fff640 1 --2- 172.21.15.22:0/4186337805 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5613cdcde840 0x5613cdce0c60 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0aa4ec1f78b709b server_cookie=cb5207e5bfc419e2 in_seq=0 out_seq=0 2024-08-20T01:38:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.329+0000 7f3ff3fff640 1 -- 172.21.15.22:0/4186337805 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5613cdbced50 con 0x5613cdcde840 2024-08-20T01:38:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.329+0000 7f3ff3fff640 10 client.26254 handle_command_reply: tid=0 2024-08-20T01:38:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.329+0000 7f401da95740 1 client.26254 shutdown 2024-08-20T01:38:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.329+0000 7f401da95740 1 -- 172.21.15.22:0/4186337805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc62810 msgr2=0x5613cdc6feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.329+0000 7f401da95740 1 --2- 172.21.15.22:0/4186337805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc62810 0x5613cdc6feb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f40080cb320 tx=0x7f40080cfa80 comp rx=0 tx=0).stop 2024-08-20T01:38:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.329+0000 7f401da95740 1 -- 172.21.15.22:0/4186337805 shutdown_connections 2024-08-20T01:38:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.329+0000 7f401da95740 1 --2- 172.21.15.22:0/4186337805 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5613cdcde840 0x5613cdce0c60 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f401da95740 1 --2- 172.21.15.22:0/4186337805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613cdc67dc0 0x5613cdc6eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f3ff3fff640 0 client.26254 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f401da95740 1 --2- 172.21.15.22:0/4186337805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613cdc65220 0x5613cdc70550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f401da95740 1 --2- 172.21.15.22:0/4186337805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613cdc62810 0x5613cdc6feb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f401da95740 1 -- 172.21.15.22:0/4186337805 >> 172.21.15.22:0/4186337805 conn(0x5613cdc5aab0 msgr2=0x5613cdc65660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f401da95740 1 -- 172.21.15.22:0/4186337805 shutdown_connections 2024-08-20T01:38:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f401da95740 1 -- 172.21.15.22:0/4186337805 wait complete. 2024-08-20T01:38:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f401da95740 20 client.26254 trim_cache size 0 max 16384 2024-08-20T01:38:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:38:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:38:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:38:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:38:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f401aca8640 1 -- 172.21.15.22:0/1628764951 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f40040b3ae0 msgr2=0x7f40040b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f401aca8640 1 --2- 172.21.15.22:0/1628764951 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f40040b3ae0 0x7f40040b5fa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f400c0146c0 tx=0x7f400c004b50 comp rx=0 tx=0).stop 2024-08-20T01:38:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f401aca8640 1 -- 172.21.15.22:0/1628764951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014101580 msgr2=0x7f4014197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f401aca8640 1 --2- 172.21.15.22:0/1628764951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014101580 0x7f4014197a20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4008031500 tx=0x7f4008003c10 comp rx=0 tx=0).stop 2024-08-20T01:38:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f401aca8640 1 -- 172.21.15.22:0/1628764951 shutdown_connections 2024-08-20T01:38:47.336 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f401aca8640 1 --2- 172.21.15.22:0/1628764951 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f40040b3ae0 0x7f40040b5fa0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.336 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f401aca8640 1 --2- 172.21.15.22:0/1628764951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4014103090 0x7f4014198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.336 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f401aca8640 1 --2- 172.21.15.22:0/1628764951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40141026d0 0x7f4014198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.336 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f401aca8640 1 --2- 172.21.15.22:0/1628764951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014101580 0x7f4014197a20 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:47.336 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f401aca8640 1 -- 172.21.15.22:0/1628764951 >> 172.21.15.22:0/1628764951 conn(0x7f40140fce40 msgr2=0x7f4014105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:47.336 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f401aca8640 1 -- 172.21.15.22:0/1628764951 shutdown_connections 2024-08-20T01:38:47.336 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:38:47.330+0000 7f401aca8640 1 -- 172.21.15.22:0/1628764951 wait complete. 2024-08-20T01:38:49.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:48 smithi134 ceph-mon[22511]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 1.72k op/s 2024-08-20T01:38:49.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:48 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:38:49.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:48 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:38:49.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:48 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:38:49.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:48 smithi077 ceph-mon[22251]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 1.72k op/s 2024-08-20T01:38:49.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:48 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:38:49.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:48 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:38:49.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:48 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:38:49.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:48 smithi022 ceph-mon[18709]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 1.72k op/s 2024-08-20T01:38:49.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:48 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:38:49.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:48 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:38:49.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:48 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:38:51.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:50 smithi134 ceph-mon[22511]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1020 KiB/s wr, 1.28k op/s 2024-08-20T01:38:51.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:50 smithi077 ceph-mon[22251]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1020 KiB/s wr, 1.28k op/s 2024-08-20T01:38:51.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:50 smithi022 ceph-mon[18709]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1020 KiB/s wr, 1.28k op/s 2024-08-20T01:38:52.939 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:52 smithi022 ceph-mon[18709]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 1.05k op/s 2024-08-20T01:38:53.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:52 smithi134 ceph-mon[22511]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 1.05k op/s 2024-08-20T01:38:53.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:52 smithi077 ceph-mon[22251]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 1.05k op/s 2024-08-20T01:38:55.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:54 smithi134 ceph-mon[22511]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 762 op/s 2024-08-20T01:38:55.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:54 smithi077 ceph-mon[22251]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 762 op/s 2024-08-20T01:38:55.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:54 smithi022 ceph-mon[18709]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 762 op/s 2024-08-20T01:38:57.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:56 smithi134 ceph-mon[22511]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 376 op/s 2024-08-20T01:38:57.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:56 smithi077 ceph-mon[22251]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 376 op/s 2024-08-20T01:38:57.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:56 smithi022 ceph-mon[18709]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 376 op/s 2024-08-20T01:38:57.302 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:38:57.600 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:58.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.223+0000 7f0cbd64b640 1 -- 172.21.15.22:0/4011757596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb81084e0 msgr2=0x7f0cb8108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:58.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.223+0000 7f0cbd64b640 1 --2- 172.21.15.22:0/4011757596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb81084e0 0x7f0cb8108920 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0009900 tx=0x7f0ca002a410 comp rx=0 tx=0).stop 2024-08-20T01:38:58.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.223+0000 7f0cbd64b640 1 -- 172.21.15.22:0/4011757596 shutdown_connections 2024-08-20T01:38:58.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.223+0000 7f0cbd64b640 1 --2- 172.21.15.22:0/4011757596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cb8108e60 0x7f0cb810f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.223+0000 7f0cbd64b640 1 --2- 172.21.15.22:0/4011757596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb81084e0 0x7f0cb8108920 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.223+0000 7f0cbd64b640 1 --2- 172.21.15.22:0/4011757596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cb8102ad0 0x7f0cb8102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.223+0000 7f0cbd64b640 1 -- 172.21.15.22:0/4011757596 >> 172.21.15.22:0/4011757596 conn(0x7f0cb80fe540 msgr2=0x7f0cb8100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:58.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.223+0000 7f0cbd64b640 1 -- 172.21.15.22:0/4011757596 shutdown_connections 2024-08-20T01:38:58.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.223+0000 7f0cbd64b640 1 -- 172.21.15.22:0/4011757596 wait complete. 2024-08-20T01:38:58.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.224+0000 7f0cbd64b640 1 Processor -- start 2024-08-20T01:38:58.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.224+0000 7f0cbd64b640 1 -- start start 2024-08-20T01:38:58.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.224+0000 7f0cbd64b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cb8102ad0 0x7f0cb8196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:58.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.224+0000 7f0cbd64b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cb81084e0 0x7f0cb8197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.224+0000 7f0cbd64b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb8108e60 0x7f0cb819c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.224+0000 7f0cbd64b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb8110960 con 0x7f0cb8108e60 2024-08-20T01:38:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.224+0000 7f0cbd64b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb81107e0 con 0x7f0cb81084e0 2024-08-20T01:38:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.224+0000 7f0cbd64b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb8110ae0 con 0x7f0cb8102ad0 2024-08-20T01:38:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.224+0000 7f0cb77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb8108e60 0x7f0cb819c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.224+0000 7f0cb77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb8108e60 0x7f0cb819c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38854/0 (socket says 172.21.15.22:38854) 2024-08-20T01:38:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.224+0000 7f0cb77fe640 1 -- 172.21.15.22:0/1250465566 learned_addr learned my addr 172.21.15.22:0/1250465566 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.224+0000 7f0cb6ffd640 1 --2- 172.21.15.22:0/1250465566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cb8102ad0 0x7f0cb8196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.225+0000 7f0cb67fc640 1 --2- 172.21.15.22:0/1250465566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cb81084e0 0x7f0cb8197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.225+0000 7f0cb77fe640 1 -- 172.21.15.22:0/1250465566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cb8102ad0 msgr2=0x7f0cb8196df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.225+0000 7f0cb77fe640 1 --2- 172.21.15.22:0/1250465566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cb8102ad0 0x7f0cb8196df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.225+0000 7f0cb77fe640 1 -- 172.21.15.22:0/1250465566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cb81084e0 msgr2=0x7f0cb8197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.225+0000 7f0cb77fe640 1 --2- 172.21.15.22:0/1250465566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cb81084e0 0x7f0cb8197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.225+0000 7f0cb77fe640 1 -- 172.21.15.22:0/1250465566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb819cea0 con 0x7f0cb8108e60 2024-08-20T01:38:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.225+0000 7f0cb67fc640 1 --2- 172.21.15.22:0/1250465566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cb81084e0 0x7f0cb8197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.225+0000 7f0cb77fe640 1 --2- 172.21.15.22:0/1250465566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb8108e60 0x7f0cb819c6d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800edb0 tx=0x7f0ca8012490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.225+0000 7f0caffff640 1 -- 172.21.15.22:0/1250465566 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca801c030 con 0x7f0cb8108e60 2024-08-20T01:38:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.225+0000 7f0cbd64b640 1 -- 172.21.15.22:0/1250465566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cb819d190 con 0x7f0cb8108e60 2024-08-20T01:38:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.225+0000 7f0caffff640 1 -- 172.21.15.22:0/1250465566 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ca8012db0 con 0x7f0cb8108e60 2024-08-20T01:38:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.225+0000 7f0caffff640 1 -- 172.21.15.22:0/1250465566 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8018400 con 0x7f0cb8108e60 2024-08-20T01:38:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.225+0000 7f0cbd64b640 1 -- 172.21.15.22:0/1250465566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cb81a3a20 con 0x7f0cb8108e60 2024-08-20T01:38:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.228+0000 7f0caffff640 1 -- 172.21.15.22:0/1250465566 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0ca801f070 con 0x7f0cb8108e60 2024-08-20T01:38:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.228+0000 7f0cbfa44740 1 Processor -- start 2024-08-20T01:38:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.228+0000 7f0cbfa44740 1 -- start start 2024-08-20T01:38:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.228+0000 7f0cbfa44740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a8566e0 0x55901a856ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.228+0000 7f0cbfa44740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a857000 0x55901a862a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.228+0000 7f0cbfa44740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a862f90 0x55901a865380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.228+0000 7f0cbfa44740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55901a7cd8e0 con 0x55901a8566e0 2024-08-20T01:38:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.228+0000 7f0cbfa44740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55901a7bcde0 con 0x55901a862f90 2024-08-20T01:38:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.228+0000 7f0cbfa44740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55901a7c0e20 con 0x55901a857000 2024-08-20T01:38:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.228+0000 7f0cb6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a857000 0x55901a862a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.228+0000 7f0cb67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a8566e0 0x55901a856ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.228+0000 7f0cb6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a857000 0x55901a862a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:40234/0 (socket says 172.21.15.22:40234) 2024-08-20T01:38:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.228+0000 7f0cb6ffd640 1 -- 172.21.15.22:0/1454337915 learned_addr learned my addr 172.21.15.22:0/1454337915 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.229+0000 7f0cb6ffd640 1 -- 172.21.15.22:0/1454337915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a862f90 msgr2=0x55901a865380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.229+0000 7f0cb6ffd640 1 --2- 172.21.15.22:0/1454337915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a862f90 0x55901a865380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.229+0000 7f0cb6ffd640 1 -- 172.21.15.22:0/1454337915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a8566e0 msgr2=0x55901a856ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.229+0000 7f0cb6ffd640 1 --2- 172.21.15.22:0/1454337915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a8566e0 0x55901a856ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.229+0000 7f0cb6ffd640 1 -- 172.21.15.22:0/1454337915 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55901a51c650 con 0x55901a857000 2024-08-20T01:38:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.229+0000 7f0caffff640 1 --2- 172.21.15.22:0/1250465566 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0ca40b3bd0 0x7f0ca40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.229+0000 7f0cb67fc640 1 --2- 172.21.15.22:0/1250465566 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0ca40b3bd0 0x7f0ca40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.229+0000 7f0cb6ffd640 1 --2- 172.21.15.22:0/1454337915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a857000 0x55901a862a50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009d20 tx=0x7f0cb0011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89464a76266e4076 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.229+0000 7f0caffff640 1 -- 172.21.15.22:0/1250465566 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f0ca80e7be0 con 0x7f0cb8108e60 2024-08-20T01:38:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.229+0000 7f0cad7fa640 1 -- 172.21.15.22:0/1454337915 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0004230 con 0x55901a857000 2024-08-20T01:38:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.229+0000 7f0cad7fa640 1 -- 172.21.15.22:0/1454337915 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cb00043d0 con 0x55901a857000 2024-08-20T01:38:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.229+0000 7f0cad7fa640 1 -- 172.21.15.22:0/1454337915 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb00197c0 con 0x55901a857000 2024-08-20T01:38:58.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.230+0000 7f0cbfa44740 1 -- 172.21.15.22:0/1454337915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a857000 msgr2=0x55901a862a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.230+0000 7f0cb67fc640 1 --2- 172.21.15.22:0/1250465566 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0ca40b3bd0 0x7f0ca40b6090 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0005c40 tx=0x7f0ca0009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.230+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/1454337915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a857000 0x55901a862a50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009d20 tx=0x7f0cb0011810 comp rx=0 tx=0).stop 2024-08-20T01:38:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.230+0000 7f0cbfa44740 1 -- 172.21.15.22:0/1454337915 shutdown_connections 2024-08-20T01:38:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.230+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/1454337915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a862f90 0x55901a865380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.230+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/1454337915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a857000 0x55901a862a50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.230+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/1454337915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a8566e0 0x55901a856ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.230+0000 7f0cbfa44740 1 -- 172.21.15.22:0/1454337915 >> 172.21.15.22:0/1454337915 conn(0x55901a854510 msgr2=0x55901a8556b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.230+0000 7f0cbfa44740 1 -- 172.21.15.22:0/1454337915 shutdown_connections 2024-08-20T01:38:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.230+0000 7f0cbfa44740 1 -- 172.21.15.22:0/1454337915 wait complete. 2024-08-20T01:38:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.231+0000 7f0cbfa44740 1 -- start start 2024-08-20T01:38:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.231+0000 7f0cbfa44740 1 Processor -- start 2024-08-20T01:38:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.231+0000 7f0cbfa44740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a8566e0 0x55901a85ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.231+0000 7f0cbfa44740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 0x55901a860460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.231+0000 7f0cbfa44740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a862f90 0x55901a8609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.231+0000 7f0cbfa44740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55901a61f700 con 0x55901a857000 2024-08-20T01:38:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.231+0000 7f0cbfa44740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55901a7437c0 con 0x55901a862f90 2024-08-20T01:38:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.231+0000 7f0cbfa44740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55901a865c40 con 0x55901a8566e0 2024-08-20T01:38:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.231+0000 7f0cbfa44740 10 client.0 _ll_register_callbacks cb 0x55901a7b66b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.231+0000 7f0cb6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a8566e0 0x55901a85ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.231+0000 7f0cb67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 0x55901a860460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.231+0000 7f0cb67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 0x55901a860460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38872/0 (socket says 172.21.15.22:38872) 2024-08-20T01:38:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.231+0000 7f0cb67fc640 1 -- 172.21.15.22:0/3003741911 learned_addr learned my addr 172.21.15.22:0/3003741911 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.232+0000 7f0cb67fc640 1 -- 172.21.15.22:0/3003741911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a8566e0 msgr2=0x55901a85ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.232+0000 7f0cb67fc640 1 --2- 172.21.15.22:0/3003741911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a8566e0 0x55901a85ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.232+0000 7f0cb67fc640 1 -- 172.21.15.22:0/3003741911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a862f90 msgr2=0x55901a8609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.232+0000 7f0cb77fe640 1 --2- 172.21.15.22:0/3003741911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a862f90 0x55901a8609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.232+0000 7f0cb67fc640 1 --2- 172.21.15.22:0/3003741911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a862f90 0x55901a8609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.232+0000 7f0cb67fc640 1 -- 172.21.15.22:0/3003741911 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55901a86eff0 con 0x55901a857000 2024-08-20T01:38:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.232+0000 7f0cb6ffd640 1 --2- 172.21.15.22:0/3003741911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a8566e0 0x55901a85ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.232+0000 7f0cb77fe640 1 --2- 172.21.15.22:0/3003741911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a862f90 0x55901a8609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.232+0000 7f0cb67fc640 1 --2- 172.21.15.22:0/3003741911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 0x55901a860460 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0033000 tx=0x7f0ca002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2671a04b41df6169 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.232+0000 7f0c9e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:38:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.232+0000 7f0c9e7fc640 1 -- 172.21.15.22:0/3003741911 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0035050 con 0x55901a857000 2024-08-20T01:38:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.232+0000 7f0c9e7fc640 1 -- 172.21.15.22:0/3003741911 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f0ca0004ad0 con 0x55901a857000 2024-08-20T01:38:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.232+0000 7f0cbfa44740 1 -- 172.21.15.22:0/3003741911 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55901a76c100 con 0x55901a857000 2024-08-20T01:38:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.232+0000 7f0c9e7fc640 1 -- 172.21.15.22:0/3003741911 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0ca0004cd0 con 0x55901a857000 2024-08-20T01:38:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.232+0000 7f0cbfa44740 10 client.16623 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.232+0000 7f0cbfa44740 1 -- 172.21.15.22:0/3003741911 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55901a8719a0 con 0x55901a857000 2024-08-20T01:38:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.233+0000 7f0c9e7fc640 1 -- 172.21.15.22:0/3003741911 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55901a76c100 con 0x55901a857000 2024-08-20T01:38:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.233+0000 7f0c9e7fc640 1 -- 172.21.15.22:0/3003741911 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f0ca00324b0 con 0x55901a857000 2024-08-20T01:38:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.233+0000 7f0cbfa44740 10 client.16623 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.233+0000 7f0cbfa44740 10 client.16623 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:38:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.233+0000 7f0cbfa44740 20 client.16623 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.233+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/3003741911 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55901a872f20 0x55901a875380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.233+0000 7f0cbfa44740 4 client.16623 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.233+0000 7f0cbfa44740 1 -- 172.21.15.22:0/3003741911 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55901a7cf830 con 0x55901a872f20 2024-08-20T01:38:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.233+0000 7f0cb6ffd640 1 --2- 172.21.15.22:0/3003741911 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55901a872f20 0x55901a875380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.233+0000 7f0c9e7fc640 10 client.16623 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.233+0000 7f0cb6ffd640 1 --2- 172.21.15.22:0/3003741911 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55901a872f20 0x55901a875380 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13d602443f07954 server_cookie=a81d0b88754ee897 in_seq=0 out_seq=0 2024-08-20T01:38:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.369+0000 7f0c9e7fc640 1 -- 172.21.15.22:0/3003741911 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55901a7cf830 con 0x55901a872f20 2024-08-20T01:38:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.369+0000 7f0c9e7fc640 10 client.16623 handle_command_reply: tid=0 2024-08-20T01:38:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.369+0000 7f0cbfa44740 1 client.16623 shutdown 2024-08-20T01:38:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.369+0000 7f0cbfa44740 1 -- 172.21.15.22:0/3003741911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 msgr2=0x55901a860460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.369+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/3003741911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 0x55901a860460 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0033000 tx=0x7f0ca002a410 comp rx=0 tx=0).stop 2024-08-20T01:38:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.369+0000 7f0cbfa44740 1 -- 172.21.15.22:0/3003741911 shutdown_connections 2024-08-20T01:38:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.369+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/3003741911 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55901a872f20 0x55901a875380 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.369+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/3003741911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a862f90 0x55901a8609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.369+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/3003741911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 0x55901a860460 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.369+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/3003741911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a8566e0 0x55901a85ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.369+0000 7f0cbfa44740 1 -- 172.21.15.22:0/3003741911 >> 172.21.15.22:0/3003741911 conn(0x55901a854510 msgr2=0x55901a85a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:58.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.369+0000 7f0c9e7fc640 0 client.16623 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:58.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.369+0000 7f0cbfa44740 1 -- 172.21.15.22:0/3003741911 shutdown_connections 2024-08-20T01:38:58.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.369+0000 7f0cbfa44740 1 -- 172.21.15.22:0/3003741911 wait complete. 2024-08-20T01:38:58.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.369+0000 7f0cbfa44740 20 client.16623 trim_cache size 0 max 16384 2024-08-20T01:38:58.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.387+0000 7f0cbfa44740 1 Processor -- start 2024-08-20T01:38:58.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.388+0000 7f0cbfa44740 1 -- start start 2024-08-20T01:38:58.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.388+0000 7f0cbfa44740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a8566e0 0x55901a860420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:58.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.388+0000 7f0cbfa44740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 0x55901a860960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:58.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.388+0000 7f0cbfa44740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a862f90 0x55901a87ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:58.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.388+0000 7f0cbfa44740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb81aea80 con 0x55901a857000 2024-08-20T01:38:58.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.388+0000 7f0cbfa44740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb81ac290 con 0x55901a862f90 2024-08-20T01:38:58.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.388+0000 7f0cbfa44740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb81aa0e0 con 0x55901a8566e0 2024-08-20T01:38:58.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.388+0000 7f0cb67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 0x55901a860960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:58.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.388+0000 7f0cb6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a8566e0 0x55901a860420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:58.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.388+0000 7f0cb67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 0x55901a860960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38886/0 (socket says 172.21.15.22:38886) 2024-08-20T01:38:58.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.388+0000 7f0cb67fc640 1 -- 172.21.15.22:0/2925290780 learned_addr learned my addr 172.21.15.22:0/2925290780 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:58.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.388+0000 7f0cb77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a862f90 0x55901a87ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:58.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.388+0000 7f0cb6ffd640 1 -- 172.21.15.22:0/2925290780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a862f90 msgr2=0x55901a87ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:58.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.388+0000 7f0cb6ffd640 1 --2- 172.21.15.22:0/2925290780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a862f90 0x55901a87ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.388+0000 7f0cb6ffd640 1 -- 172.21.15.22:0/2925290780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 msgr2=0x55901a860960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:58.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.388+0000 7f0cb6ffd640 1 --2- 172.21.15.22:0/2925290780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 0x55901a860960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.389+0000 7f0cb6ffd640 1 -- 172.21.15.22:0/2925290780 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55901a854f90 con 0x55901a8566e0 2024-08-20T01:38:58.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.389+0000 7f0cb67fc640 1 --2- 172.21.15.22:0/2925290780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 0x55901a860960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:58.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.389+0000 7f0cb6ffd640 1 --2- 172.21.15.22:0/2925290780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a8566e0 0x55901a860420 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0cb001b040 tx=0x7f0cb0011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67c4a1331d55646d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:58.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.389+0000 7f0cacff9640 1 -- 172.21.15.22:0/2925290780 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0031070 con 0x55901a8566e0 2024-08-20T01:38:58.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.389+0000 7f0cacff9640 1 -- 172.21.15.22:0/2925290780 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cb00035f0 con 0x55901a8566e0 2024-08-20T01:38:58.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.389+0000 7f0cacff9640 1 -- 172.21.15.22:0/2925290780 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb002b5c0 con 0x55901a8566e0 2024-08-20T01:38:58.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.390+0000 7f0cbfa44740 1 -- 172.21.15.22:0/2925290780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a8566e0 msgr2=0x55901a860420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:58.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.390+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/2925290780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a8566e0 0x55901a860420 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0cb001b040 tx=0x7f0cb0011810 comp rx=0 tx=0).stop 2024-08-20T01:38:58.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.390+0000 7f0cbfa44740 1 -- 172.21.15.22:0/2925290780 shutdown_connections 2024-08-20T01:38:58.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.390+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/2925290780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a862f90 0x55901a87ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.390+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/2925290780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 0x55901a860960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.390+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/2925290780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a8566e0 0x55901a860420 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.390+0000 7f0cbfa44740 1 -- 172.21.15.22:0/2925290780 >> 172.21.15.22:0/2925290780 conn(0x55901a854510 msgr2=0x55901a85b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:58.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.390+0000 7f0cbfa44740 1 -- 172.21.15.22:0/2925290780 shutdown_connections 2024-08-20T01:38:58.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.390+0000 7f0cbfa44740 1 -- 172.21.15.22:0/2925290780 wait complete. 2024-08-20T01:38:58.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.391+0000 7f0cbfa44740 1 -- start start 2024-08-20T01:38:58.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.391+0000 7f0cbfa44740 1 Processor -- start 2024-08-20T01:38:58.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.391+0000 7f0cbfa44740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a8566e0 0x55901a86b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:58.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.391+0000 7f0cbfa44740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 0x55901a865e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:58.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.391+0000 7f0cbfa44740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a862f90 0x55901a866620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:58.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.391+0000 7f0cbfa44740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb81aa750 con 0x55901a857000 2024-08-20T01:38:58.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.391+0000 7f0cbfa44740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb81abbc0 con 0x55901a8566e0 2024-08-20T01:38:58.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.391+0000 7f0cbfa44740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb81aae20 con 0x55901a862f90 2024-08-20T01:38:58.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.391+0000 7f0cbfa44740 10 client.0 _ll_register_callbacks cb 0x7f0ca80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:58.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.391+0000 7f0cb67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 0x55901a865e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:58.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.391+0000 7f0cb67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 0x55901a865e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38902/0 (socket says 172.21.15.22:38902) 2024-08-20T01:38:58.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.391+0000 7f0cb67fc640 1 -- 172.21.15.22:0/577235447 learned_addr learned my addr 172.21.15.22:0/577235447 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:58.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.392+0000 7f0cb6ffd640 1 --2- 172.21.15.22:0/577235447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a8566e0 0x55901a86b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:58.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.392+0000 7f0cb77fe640 1 --2- 172.21.15.22:0/577235447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a862f90 0x55901a866620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:58.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.392+0000 7f0cb6ffd640 1 -- 172.21.15.22:0/577235447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a862f90 msgr2=0x55901a866620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:58.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.392+0000 7f0cb6ffd640 1 --2- 172.21.15.22:0/577235447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a862f90 0x55901a866620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.392+0000 7f0cb6ffd640 1 -- 172.21.15.22:0/577235447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 msgr2=0x55901a865e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:58.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.392+0000 7f0cb6ffd640 1 --2- 172.21.15.22:0/577235447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 0x55901a865e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.392+0000 7f0cb6ffd640 1 -- 172.21.15.22:0/577235447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55901a8dbc10 con 0x55901a8566e0 2024-08-20T01:38:58.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.392+0000 7f0cb6ffd640 1 --2- 172.21.15.22:0/577235447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a8566e0 0x55901a86b7a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00043b0 tx=0x7f0cb0005a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3adf12a2ab058bce server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:58.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.392+0000 7f0c9e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:38:58.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.392+0000 7f0c9e7fc640 1 -- 172.21.15.22:0/577235447 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0031050 con 0x55901a8566e0 2024-08-20T01:38:58.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.392+0000 7f0c9e7fc640 1 -- 172.21.15.22:0/577235447 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f0cb0005450 con 0x55901a8566e0 2024-08-20T01:38:58.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.392+0000 7f0cbfa44740 1 -- 172.21.15.22:0/577235447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cb00035f0 con 0x55901a8566e0 2024-08-20T01:38:58.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.393+0000 7f0c9e7fc640 1 -- 172.21.15.22:0/577235447 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0cb0005650 con 0x55901a8566e0 2024-08-20T01:38:58.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.393+0000 7f0cbfa44740 10 client.26240 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:58.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.393+0000 7f0cbfa44740 1 -- 172.21.15.22:0/577235447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55901a8dced0 con 0x55901a8566e0 2024-08-20T01:38:58.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.393+0000 7f0c9e7fc640 1 -- 172.21.15.22:0/577235447 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cb00035f0 con 0x55901a8566e0 2024-08-20T01:38:58.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.393+0000 7f0c9e7fc640 1 -- 172.21.15.22:0/577235447 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f0cb00049a0 con 0x55901a8566e0 2024-08-20T01:38:58.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.393+0000 7f0cbfa44740 10 client.26240 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:58.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.393+0000 7f0cbfa44740 10 client.26240 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:38:58.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.393+0000 7f0cbfa44740 20 client.26240 populate_metadata read hostname 'smithi022' 2024-08-20T01:38:58.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.393+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/577235447 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55901a8dd480 0x55901a8df8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:58.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.393+0000 7f0cbfa44740 4 client.26240 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:38:58.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.393+0000 7f0cbfa44740 1 -- 172.21.15.22:0/577235447 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55901a7cb2d0 con 0x55901a8dd480 2024-08-20T01:38:58.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.398+0000 7f0cb67fc640 1 --2- 172.21.15.22:0/577235447 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55901a8dd480 0x55901a8df8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:58.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.400+0000 7f0c9e7fc640 10 client.26240 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:58.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.400+0000 7f0cb67fc640 1 --2- 172.21.15.22:0/577235447 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55901a8dd480 0x55901a8df8a0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db938657f6674f28 server_cookie=b4d7b54828210580 in_seq=0 out_seq=0 2024-08-20T01:38:58.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.401+0000 7f0c9e7fc640 1 -- 172.21.15.22:0/577235447 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55901a7cb2d0 con 0x55901a8dd480 2024-08-20T01:38:58.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.401+0000 7f0c9e7fc640 10 client.26240 handle_command_reply: tid=0 2024-08-20T01:38:58.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.401+0000 7f0cbfa44740 1 client.26240 shutdown 2024-08-20T01:38:58.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.401+0000 7f0cbfa44740 1 -- 172.21.15.22:0/577235447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a8566e0 msgr2=0x55901a86b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:58.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.401+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/577235447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a8566e0 0x55901a86b7a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00043b0 tx=0x7f0cb0005a70 comp rx=0 tx=0).stop 2024-08-20T01:38:58.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.402+0000 7f0cbfa44740 1 -- 172.21.15.22:0/577235447 shutdown_connections 2024-08-20T01:38:58.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.402+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/577235447 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55901a8dd480 0x55901a8df8a0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.402+0000 7f0c9e7fc640 0 client.26240 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:38:58.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.402+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/577235447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55901a862f90 0x55901a866620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.402+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/577235447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55901a857000 0x55901a865e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.402+0000 7f0cbfa44740 1 --2- 172.21.15.22:0/577235447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55901a8566e0 0x55901a86b7a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.402+0000 7f0cbfa44740 1 -- 172.21.15.22:0/577235447 >> 172.21.15.22:0/577235447 conn(0x55901a854510 msgr2=0x55901a852bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:58.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.402+0000 7f0cbfa44740 1 -- 172.21.15.22:0/577235447 shutdown_connections 2024-08-20T01:38:58.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.402+0000 7f0cbfa44740 1 -- 172.21.15.22:0/577235447 wait complete. 2024-08-20T01:38:58.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.402+0000 7f0cbfa44740 20 client.26240 trim_cache size 0 max 16384 2024-08-20T01:38:58.405 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:38:58.405 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-08-20T01:38:58.405 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-08-20T01:38:58.405 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:38:58.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.404+0000 7f0cbd64b640 1 -- 172.21.15.22:0/1250465566 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0ca40b3bd0 msgr2=0x7f0ca40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:58.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.404+0000 7f0cbd64b640 1 --2- 172.21.15.22:0/1250465566 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0ca40b3bd0 0x7f0ca40b6090 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0005c40 tx=0x7f0ca0009560 comp rx=0 tx=0).stop 2024-08-20T01:38:58.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.404+0000 7f0cbd64b640 1 -- 172.21.15.22:0/1250465566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb8108e60 msgr2=0x7f0cb819c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:58.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.404+0000 7f0cbd64b640 1 --2- 172.21.15.22:0/1250465566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb8108e60 0x7f0cb819c6d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800edb0 tx=0x7f0ca8012490 comp rx=0 tx=0).stop 2024-08-20T01:38:58.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.404+0000 7f0cbd64b640 1 -- 172.21.15.22:0/1250465566 shutdown_connections 2024-08-20T01:38:58.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.404+0000 7f0cbd64b640 1 --2- 172.21.15.22:0/1250465566 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0ca40b3bd0 0x7f0ca40b6090 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.404+0000 7f0cbd64b640 1 --2- 172.21.15.22:0/1250465566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb8108e60 0x7f0cb819c6d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.404+0000 7f0cbd64b640 1 --2- 172.21.15.22:0/1250465566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cb81084e0 0x7f0cb8197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.404+0000 7f0cbd64b640 1 --2- 172.21.15.22:0/1250465566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cb8102ad0 0x7f0cb8196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:58.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.404+0000 7f0cbd64b640 1 -- 172.21.15.22:0/1250465566 >> 172.21.15.22:0/1250465566 conn(0x7f0cb80fe540 msgr2=0x7f0cb8100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:58.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.405+0000 7f0cbd64b640 1 -- 172.21.15.22:0/1250465566 shutdown_connections 2024-08-20T01:38:58.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:58.405+0000 7f0cbd64b640 1 -- 172.21.15.22:0/1250465566 wait complete. 2024-08-20T01:38:59.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:38:58 smithi134 ceph-mon[22511]: pgmap v581: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 455 op/s 2024-08-20T01:38:59.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:38:58 smithi077 ceph-mon[22251]: pgmap v581: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 455 op/s 2024-08-20T01:38:59.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:38:58 smithi022 ceph-mon[18709]: pgmap v581: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 455 op/s 2024-08-20T01:38:59.213 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:38:59.213 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:38:59.475 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:59.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.939+0000 7f44efcee640 1 -- 172.21.15.22:0/4077949469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e81042e0 msgr2=0x7f44e810c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:59.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.939+0000 7f44efcee640 1 --2- 172.21.15.22:0/4077949469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e81042e0 0x7f44e810c7d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f44d8009900 tx=0x7f44d802a410 comp rx=0 tx=0).stop 2024-08-20T01:38:59.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.939+0000 7f44efcee640 1 -- 172.21.15.22:0/4077949469 shutdown_connections 2024-08-20T01:38:59.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.939+0000 7f44efcee640 1 --2- 172.21.15.22:0/4077949469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44e810ce20 0x7f44e810f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:59.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.939+0000 7f44efcee640 1 --2- 172.21.15.22:0/4077949469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e81042e0 0x7f44e810c7d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:59.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.939+0000 7f44efcee640 1 --2- 172.21.15.22:0/4077949469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44e81039c0 0x7f44e8103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:59.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.939+0000 7f44efcee640 1 -- 172.21.15.22:0/4077949469 >> 172.21.15.22:0/4077949469 conn(0x7f44e80fd400 msgr2=0x7f44e80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:59.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.939+0000 7f44efcee640 1 -- 172.21.15.22:0/4077949469 shutdown_connections 2024-08-20T01:38:59.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.939+0000 7f44efcee640 1 -- 172.21.15.22:0/4077949469 wait complete. 2024-08-20T01:38:59.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.940+0000 7f44efcee640 1 Processor -- start 2024-08-20T01:38:59.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.940+0000 7f44efcee640 1 -- start start 2024-08-20T01:38:59.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.940+0000 7f44efcee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44e81039c0 0x7f44e8198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:59.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.940+0000 7f44efcee640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44e81042e0 0x7f44e81994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:59.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.940+0000 7f44efcee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e810ce20 0x7f44e819e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:59.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.940+0000 7f44efcee640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f44e8112a90 con 0x7f44e810ce20 2024-08-20T01:38:59.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.940+0000 7f44efcee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f44e8112910 con 0x7f44e81039c0 2024-08-20T01:38:59.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.940+0000 7f44efcee640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f44e8112c10 con 0x7f44e81042e0 2024-08-20T01:38:59.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.940+0000 7f44ee28b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e810ce20 0x7f44e819e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:59.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.940+0000 7f44ee28b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e810ce20 0x7f44e819e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37424/0 (socket says 172.21.15.22:37424) 2024-08-20T01:38:59.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.940+0000 7f44ee28b640 1 -- 172.21.15.22:0/803088215 learned_addr learned my addr 172.21.15.22:0/803088215 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:38:59.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.940+0000 7f44ed289640 1 --2- 172.21.15.22:0/803088215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44e81042e0 0x7f44e81994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:59.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.940+0000 7f44eda8a640 1 --2- 172.21.15.22:0/803088215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44e81039c0 0x7f44e8198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:59.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.941+0000 7f44ee28b640 1 -- 172.21.15.22:0/803088215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44e81042e0 msgr2=0x7f44e81994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:59.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.941+0000 7f44ee28b640 1 --2- 172.21.15.22:0/803088215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44e81042e0 0x7f44e81994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:59.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.941+0000 7f44ee28b640 1 -- 172.21.15.22:0/803088215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44e81039c0 msgr2=0x7f44e8198f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:59.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.941+0000 7f44ee28b640 1 --2- 172.21.15.22:0/803088215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44e81039c0 0x7f44e8198f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:59.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.941+0000 7f44ee28b640 1 -- 172.21.15.22:0/803088215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e819f030 con 0x7f44e810ce20 2024-08-20T01:38:59.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.941+0000 7f44ed289640 1 --2- 172.21.15.22:0/803088215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44e81042e0 0x7f44e81994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:59.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.941+0000 7f44ee28b640 1 --2- 172.21.15.22:0/803088215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e810ce20 0x7f44e819e860 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f44e000eb10 tx=0x7f44e000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:59.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.941+0000 7f44deffd640 1 -- 172.21.15.22:0/803088215 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e000ce20 con 0x7f44e810ce20 2024-08-20T01:38:59.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.941+0000 7f44deffd640 1 -- 172.21.15.22:0/803088215 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44e0005020 con 0x7f44e810ce20 2024-08-20T01:38:59.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.941+0000 7f44efcee640 1 -- 172.21.15.22:0/803088215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e819f320 con 0x7f44e810ce20 2024-08-20T01:38:59.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.941+0000 7f44deffd640 1 -- 172.21.15.22:0/803088215 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e0010690 con 0x7f44e810ce20 2024-08-20T01:38:59.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.941+0000 7f44efcee640 1 -- 172.21.15.22:0/803088215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e81a5bb0 con 0x7f44e810ce20 2024-08-20T01:38:59.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.942+0000 7f44efcee640 1 -- 172.21.15.22:0/803088215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e8103da0 con 0x7f44e810ce20 2024-08-20T01:38:59.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.943+0000 7f44deffd640 1 -- 172.21.15.22:0/803088215 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f44e0005510 con 0x7f44e810ce20 2024-08-20T01:38:59.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.944+0000 7f44deffd640 1 --2- 172.21.15.22:0/803088215 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f44d40b3c50 0x7f44d40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:59.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.944+0000 7f44deffd640 1 -- 172.21.15.22:0/803088215 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f44e00e45d0 con 0x7f44e810ce20 2024-08-20T01:38:59.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.944+0000 7f44eda8a640 1 --2- 172.21.15.22:0/803088215 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f44d40b3c50 0x7f44d40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:59.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.945+0000 7f44eda8a640 1 --2- 172.21.15.22:0/803088215 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f44d40b3c50 0x7f44d40b6110 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f44e400abe0 tx=0x7f44e400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:59.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:38:59.947+0000 7f44deffd640 1 -- 172.21.15.22:0/803088215 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f44e00abbe0 con 0x7f44e810ce20 2024-08-20T01:39:00.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:00.186+0000 7f44efcee640 1 -- 172.21.15.22:0/803088215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44e8107e00 con 0x7f44e810ce20 2024-08-20T01:39:00.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:00.187+0000 7f44deffd640 1 -- 172.21.15.22:0/803088215 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11915 (secure 0 0 0) 0x7f44e00ab4e0 con 0x7f44e810ce20 2024-08-20T01:39:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:39:00.189 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":31,"btime":"2024-08-20T01:36:38:097249+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:36:37.446760+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24586,24575,24565]},"id":1}]} 2024-08-20T01:39:00.189 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 31 2024-08-20T01:39:00.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:00.189+0000 7f44efcee640 1 -- 172.21.15.22:0/803088215 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f44d40b3c50 msgr2=0x7f44d40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:00.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:00.189+0000 7f44efcee640 1 --2- 172.21.15.22:0/803088215 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f44d40b3c50 0x7f44d40b6110 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f44e400abe0 tx=0x7f44e400a2d0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:00.189+0000 7f44efcee640 1 -- 172.21.15.22:0/803088215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e810ce20 msgr2=0x7f44e819e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:00.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:00.189+0000 7f44efcee640 1 --2- 172.21.15.22:0/803088215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e810ce20 0x7f44e819e860 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f44e000eb10 tx=0x7f44e000ef10 comp rx=0 tx=0).stop 2024-08-20T01:39:00.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:00.189+0000 7f44efcee640 1 -- 172.21.15.22:0/803088215 shutdown_connections 2024-08-20T01:39:00.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:00.189+0000 7f44efcee640 1 --2- 172.21.15.22:0/803088215 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f44d40b3c50 0x7f44d40b6110 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:00.189+0000 7f44efcee640 1 --2- 172.21.15.22:0/803088215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e810ce20 0x7f44e819e860 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:00.189+0000 7f44efcee640 1 --2- 172.21.15.22:0/803088215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44e81042e0 0x7f44e81994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:00.189+0000 7f44efcee640 1 --2- 172.21.15.22:0/803088215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44e81039c0 0x7f44e8198f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:00.189+0000 7f44efcee640 1 -- 172.21.15.22:0/803088215 >> 172.21.15.22:0/803088215 conn(0x7f44e80fd400 msgr2=0x7f44e80fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:00.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:00.189+0000 7f44efcee640 1 -- 172.21.15.22:0/803088215 shutdown_connections 2024-08-20T01:39:00.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:00.189+0000 7f44efcee640 1 -- 172.21.15.22:0/803088215 wait complete. 2024-08-20T01:39:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.431+0000 7fbbf719b640 1 -- 172.21.15.22:0/770591497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbf01048a0 msgr2=0x7fbbf0104ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.431+0000 7fbbf719b640 1 --2- 172.21.15.22:0/770591497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbf01048a0 0x7fbbf0104ca0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009930 tx=0x7fbbe402a420 comp rx=0 tx=0).stop 2024-08-20T01:39:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.431+0000 7fbbf719b640 1 -- 172.21.15.22:0/770591497 shutdown_connections 2024-08-20T01:39:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.431+0000 7fbbf719b640 1 --2- 172.21.15.22:0/770591497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbf01063b0 0x7fbbf010cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.431+0000 7fbbf719b640 1 --2- 172.21.15.22:0/770591497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf01059f0 0x7fbbf0105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.431+0000 7fbbf719b640 1 --2- 172.21.15.22:0/770591497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbf01048a0 0x7fbbf0104ca0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.431+0000 7fbbf719b640 1 -- 172.21.15.22:0/770591497 >> 172.21.15.22:0/770591497 conn(0x7fbbf0100140 msgr2=0x7fbbf0102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.431+0000 7fbbf719b640 1 -- 172.21.15.22:0/770591497 shutdown_connections 2024-08-20T01:39:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.431+0000 7fbbf719b640 1 -- 172.21.15.22:0/770591497 wait complete. 2024-08-20T01:39:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.432+0000 7fbbf719b640 1 Processor -- start 2024-08-20T01:39:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.432+0000 7fbbf719b640 1 -- start start 2024-08-20T01:39:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.432+0000 7fbbf719b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbf01048a0 0x7fbbf019ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.432+0000 7fbbf719b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf01059f0 0x7fbbf019b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.432+0000 7fbbf719b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbf01063b0 0x7fbbf019bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.432+0000 7fbbf719b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf0110510 con 0x7fbbf01063b0 2024-08-20T01:39:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.432+0000 7fbbf719b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf0110390 con 0x7fbbf01048a0 2024-08-20T01:39:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.432+0000 7fbbf719b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf0110690 con 0x7fbbf01059f0 2024-08-20T01:39:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.432+0000 7fbbf5738640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbf01063b0 0x7fbbf019bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.432+0000 7fbbf5738640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbf01063b0 0x7fbbf019bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37436/0 (socket says 172.21.15.22:37436) 2024-08-20T01:39:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.432+0000 7fbbf4f37640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbf01048a0 0x7fbbf019ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.432+0000 7fbbf5738640 1 -- 172.21.15.22:0/2550065375 learned_addr learned my addr 172.21.15.22:0/2550065375 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.432+0000 7fbbeffff640 1 --2- 172.21.15.22:0/2550065375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf01059f0 0x7fbbf019b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.433+0000 7fbbf4f37640 1 -- 172.21.15.22:0/2550065375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf01059f0 msgr2=0x7fbbf019b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:00.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.433+0000 7fbbf4f37640 1 --2- 172.21.15.22:0/2550065375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf01059f0 0x7fbbf019b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.433+0000 7fbbf4f37640 1 -- 172.21.15.22:0/2550065375 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbf01063b0 msgr2=0x7fbbf019bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:00.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.433+0000 7fbbf4f37640 1 --2- 172.21.15.22:0/2550065375 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbf01063b0 0x7fbbf019bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.433+0000 7fbbf4f37640 1 -- 172.21.15.22:0/2550065375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf019c7d0 con 0x7fbbf01048a0 2024-08-20T01:39:00.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.433+0000 7fbbf4f37640 1 --2- 172.21.15.22:0/2550065375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbf01048a0 0x7fbbf019ac90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009230 tx=0x7fbbe40042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:00.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.435+0000 7fbbedffb640 1 -- 172.21.15.22:0/2550065375 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe403f030 con 0x7fbbf01048a0 2024-08-20T01:39:00.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.435+0000 7fbbedffb640 1 -- 172.21.15.22:0/2550065375 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbe4031910 con 0x7fbbf01048a0 2024-08-20T01:39:00.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.435+0000 7fbbedffb640 1 -- 172.21.15.22:0/2550065375 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4035070 con 0x7fbbf01048a0 2024-08-20T01:39:00.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.435+0000 7fbbf719b640 1 -- 172.21.15.22:0/2550065375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf019ca60 con 0x7fbbf01048a0 2024-08-20T01:39:00.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.435+0000 7fbbf719b640 1 -- 172.21.15.22:0/2550065375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf01a2fb0 con 0x7fbbf01048a0 2024-08-20T01:39:00.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.438+0000 7fbbfa063740 1 Processor -- start 2024-08-20T01:39:00.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.439+0000 7fbbfa063740 1 -- start start 2024-08-20T01:39:00.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.439+0000 7fbbfa063740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeb0e0 0x55c41fded4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:00.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.440+0000 7fbbf5738640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeb0e0 0x55c41fded4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:00.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.440+0000 7fbbf5738640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeb0e0 0x55c41fded4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:40604/0 (socket says 172.21.15.22:40604) 2024-08-20T01:39:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.439+0000 7fbbfa063740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 0x55c41fdefe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.440+0000 7fbbf5738640 1 -- 172.21.15.22:0/749366043 learned_addr learned my addr 172.21.15.22:0/749366043 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.440+0000 7fbbfa063740 1 --2- 172.21.15.22:0/749366043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 0x55c41fdf2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.440+0000 7fbbfa063740 1 -- 172.21.15.22:0/749366043 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c41fd55360 con 0x55c41fdeda10 2024-08-20T01:39:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.440+0000 7fbbfa063740 1 -- 172.21.15.22:0/749366043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c41fd44860 con 0x55c41fdf0450 2024-08-20T01:39:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.440+0000 7fbbfa063740 1 -- 172.21.15.22:0/749366043 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c41fd488a0 con 0x55c41fdeb0e0 2024-08-20T01:39:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.440+0000 7fbbedffb640 1 -- 172.21.15.22:0/2550065375 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbbe4042030 con 0x7fbbf01048a0 2024-08-20T01:39:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.440+0000 7fbbeffff640 1 --2- 172.21.15.22:0/749366043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 0x55c41fdf2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.440+0000 7fbbf4f37640 1 --2- 172.21.15.22:0/749366043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 0x55c41fdefe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.441+0000 7fbbf5738640 1 -- 172.21.15.22:0/749366043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 msgr2=0x55c41fdf2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:00.445 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.441+0000 7fbbf5738640 1 --2- 172.21.15.22:0/749366043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 0x55c41fdf2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.445 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.441+0000 7fbbf5738640 1 -- 172.21.15.22:0/749366043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 msgr2=0x55c41fdefe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:00.445 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.441+0000 7fbbf5738640 1 --2- 172.21.15.22:0/749366043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 0x55c41fdefe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.445 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.441+0000 7fbbf5738640 1 -- 172.21.15.22:0/749366043 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c41fcebe40 con 0x55c41fdeb0e0 2024-08-20T01:39:00.445 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.441+0000 7fbbeffff640 1 --2- 172.21.15.22:0/749366043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 0x55c41fdf2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:00.445 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.441+0000 7fbbf4f37640 1 --2- 172.21.15.22:0/749366043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 0x55c41fdefe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:39:00.445 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.441+0000 7fbbf5738640 1 --2- 172.21.15.22:0/749366043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeb0e0 0x55c41fded4d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80114c0 tx=0x7fbbe8011980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab9a09d2ed908d34 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:00.445 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.441+0000 7fbbedffb640 1 --2- 172.21.15.22:0/2550065375 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbbe00b3d20 0x7fbbe00b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:00.445 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.442+0000 7fbbdaffd640 1 -- 172.21.15.22:0/749366043 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8004b20 con 0x55c41fdeb0e0 2024-08-20T01:39:00.446 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.442+0000 7fbbedffb640 1 -- 172.21.15.22:0/2550065375 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fbbe4103fd0 con 0x7fbbf01048a0 2024-08-20T01:39:00.446 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.442+0000 7fbbdaffd640 1 -- 172.21.15.22:0/749366043 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbe8004cc0 con 0x55c41fdeb0e0 2024-08-20T01:39:00.446 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.442+0000 7fbbdaffd640 1 -- 172.21.15.22:0/749366043 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8005450 con 0x55c41fdeb0e0 2024-08-20T01:39:00.446 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.442+0000 7fbbf4f37640 1 --2- 172.21.15.22:0/2550065375 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbbe00b3d20 0x7fbbe00b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:00.446 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.443+0000 7fbbfa063740 1 -- 172.21.15.22:0/749366043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeb0e0 msgr2=0x55c41fded4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:00.446 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.443+0000 7fbbfa063740 1 --2- 172.21.15.22:0/749366043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeb0e0 0x55c41fded4d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80114c0 tx=0x7fbbe8011980 comp rx=0 tx=0).stop 2024-08-20T01:39:00.446 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.443+0000 7fbbf4f37640 1 --2- 172.21.15.22:0/2550065375 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbbe00b3d20 0x7fbbe00b61e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40caf20 tx=0x7fbbe4005e00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:00.446 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.443+0000 7fbbfa063740 1 -- 172.21.15.22:0/749366043 shutdown_connections 2024-08-20T01:39:00.446 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.443+0000 7fbbfa063740 1 --2- 172.21.15.22:0/749366043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 0x55c41fdf2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.446 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.443+0000 7fbbfa063740 1 --2- 172.21.15.22:0/749366043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 0x55c41fdefe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.446 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.443+0000 7fbbfa063740 1 --2- 172.21.15.22:0/749366043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeb0e0 0x55c41fded4d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.446 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.443+0000 7fbbfa063740 1 -- 172.21.15.22:0/749366043 >> 172.21.15.22:0/749366043 conn(0x55c41fde6230 msgr2=0x55c41fde6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:00.447 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.443+0000 7fbbfa063740 1 -- 172.21.15.22:0/749366043 shutdown_connections 2024-08-20T01:39:00.447 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.443+0000 7fbbfa063740 1 -- 172.21.15.22:0/749366043 wait complete. 2024-08-20T01:39:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.444+0000 7fbbfa063740 1 -- start start 2024-08-20T01:39:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.444+0000 7fbbfa063740 1 Processor -- start 2024-08-20T01:39:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.444+0000 7fbbfa063740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeb0e0 0x55c41fdf48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.445+0000 7fbbfa063740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeda10 0x55c41fdf4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.445+0000 7fbbfa063740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 0x55c41fdf5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.445+0000 7fbbfa063740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c41fc7dab0 con 0x55c41fdeb0e0 2024-08-20T01:39:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.445+0000 7fbbf5738640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeb0e0 0x55c41fdf48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.445+0000 7fbbfa063740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c41fccb780 con 0x55c41fdf0450 2024-08-20T01:39:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.445+0000 7fbbfa063740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c41fdf3430 con 0x55c41fdeda10 2024-08-20T01:39:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.445+0000 7fbbf5738640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeb0e0 0x55c41fdf48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37452/0 (socket says 172.21.15.22:37452) 2024-08-20T01:39:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.445+0000 7fbbf5738640 1 -- 172.21.15.22:0/3403773429 learned_addr learned my addr 172.21.15.22:0/3403773429 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.445+0000 7fbbfa063740 10 client.0 _ll_register_callbacks cb 0x55c41fa53a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.445+0000 7fbbf5738640 1 --2- 172.21.15.22:0/3403773429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 0x55c41fdf5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:00.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.445+0000 7fbbf5738640 1 -- 172.21.15.22:0/3403773429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeda10 msgr2=0x55c41fdf4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:00.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.445+0000 7fbbf5738640 1 --2- 172.21.15.22:0/3403773429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeda10 0x55c41fdf4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.445+0000 7fbbf5738640 1 -- 172.21.15.22:0/3403773429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 msgr2=0x55c41fdf5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:00.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.445+0000 7fbbf5738640 1 --2- 172.21.15.22:0/3403773429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 0x55c41fdf5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.445+0000 7fbbf5738640 1 -- 172.21.15.22:0/3403773429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c41faa7790 con 0x55c41fdeb0e0 2024-08-20T01:39:00.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.446+0000 7fbbf5738640 1 --2- 172.21.15.22:0/3403773429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeb0e0 0x55c41fdf48e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8011490 tx=0x7fbbe8005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a155a8a1780fd437 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:00.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.446+0000 7fbbcffff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:39:00.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.446+0000 7fbbcffff640 1 -- 172.21.15.22:0/3403773429 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe801d040 con 0x55c41fdeb0e0 2024-08-20T01:39:00.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.446+0000 7fbbfa063740 1 -- 172.21.15.22:0/3403773429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c41fcf3e00 con 0x55c41fdeb0e0 2024-08-20T01:39:00.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.446+0000 7fbbcffff640 1 -- 172.21.15.22:0/3403773429 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fbbe800fda0 con 0x55c41fdeb0e0 2024-08-20T01:39:00.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.447+0000 7fbbcffff640 1 -- 172.21.15.22:0/3403773429 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbbe8005190 con 0x55c41fdeb0e0 2024-08-20T01:39:00.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.447+0000 7fbbfa063740 10 client.16644 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:00.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.447+0000 7fbbfa063740 1 -- 172.21.15.22:0/3403773429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c41fb20620 con 0x55c41fdeb0e0 2024-08-20T01:39:00.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.447+0000 7fbbcffff640 1 -- 172.21.15.22:0/3403773429 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55c41fcf3e00 con 0x55c41fdeb0e0 2024-08-20T01:39:00.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.447+0000 7fbbcffff640 1 -- 172.21.15.22:0/3403773429 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fbbe80278c0 con 0x55c41fdeb0e0 2024-08-20T01:39:00.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.447+0000 7fbbfa063740 10 client.16644 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:00.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.447+0000 7fbbfa063740 10 client.16644 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:00.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.447+0000 7fbbfa063740 20 client.16644 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:00.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.447+0000 7fbbfa063740 1 --2- 172.21.15.22:0/3403773429 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55c41fdffec0 0x55c41fe02300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:00.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.447+0000 7fbbfa063740 4 client.16644 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:00.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.447+0000 7fbbfa063740 1 -- 172.21.15.22:0/3403773429 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c41fd572b0 con 0x55c41fdffec0 2024-08-20T01:39:00.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.448+0000 7fbbeffff640 1 --2- 172.21.15.22:0/3403773429 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55c41fdffec0 0x55c41fe02300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:00.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.449+0000 7fbbeffff640 1 --2- 172.21.15.22:0/3403773429 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55c41fdffec0 0x55c41fe02300 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35e1e160a9a0839c server_cookie=1aa105fe989d95ae in_seq=0 out_seq=0 2024-08-20T01:39:00.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.449+0000 7fbbcffff640 10 client.16644 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:00.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.451+0000 7fbbcffff640 1 -- 172.21.15.22:0/3403773429 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c41fd572b0 con 0x55c41fdffec0 2024-08-20T01:39:00.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.451+0000 7fbbcffff640 10 client.16644 handle_command_reply: tid=0 2024-08-20T01:39:00.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.451+0000 7fbbfa063740 1 client.16644 shutdown 2024-08-20T01:39:00.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.452+0000 7fbbfa063740 1 -- 172.21.15.22:0/3403773429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeb0e0 msgr2=0x55c41fdf48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:00.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.452+0000 7fbbfa063740 1 --2- 172.21.15.22:0/3403773429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeb0e0 0x55c41fdf48e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8011490 tx=0x7fbbe8005bd0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.452+0000 7fbbfa063740 1 -- 172.21.15.22:0/3403773429 shutdown_connections 2024-08-20T01:39:00.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.452+0000 7fbbfa063740 1 --2- 172.21.15.22:0/3403773429 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55c41fdffec0 0x55c41fe02300 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.452+0000 7fbbfa063740 1 --2- 172.21.15.22:0/3403773429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 0x55c41fdf5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.452+0000 7fbbcffff640 0 client.16644 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:00.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.452+0000 7fbbfa063740 1 --2- 172.21.15.22:0/3403773429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeda10 0x55c41fdf4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.452+0000 7fbbfa063740 1 --2- 172.21.15.22:0/3403773429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeb0e0 0x55c41fdf48e0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.452+0000 7fbbfa063740 1 -- 172.21.15.22:0/3403773429 >> 172.21.15.22:0/3403773429 conn(0x55c41fde6230 msgr2=0x55c41fddcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:00.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.452+0000 7fbbfa063740 1 -- 172.21.15.22:0/3403773429 shutdown_connections 2024-08-20T01:39:00.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.452+0000 7fbbfa063740 1 -- 172.21.15.22:0/3403773429 wait complete. 2024-08-20T01:39:00.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.452+0000 7fbbfa063740 20 client.16644 trim_cache size 0 max 16384 2024-08-20T01:39:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.474+0000 7fbbfa063740 1 Processor -- start 2024-08-20T01:39:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.474+0000 7fbbfa063740 1 -- start start 2024-08-20T01:39:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.474+0000 7fbbfa063740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeb0e0 0x55c41fddc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.474+0000 7fbbfa063740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 0x55c41fe06bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.474+0000 7fbbfa063740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 0x55c41fe07100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.474+0000 7fbbfa063740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf01aa4a0 con 0x55c41fdeda10 2024-08-20T01:39:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.474+0000 7fbbfa063740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf01a7cb0 con 0x55c41fdf0450 2024-08-20T01:39:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.474+0000 7fbbfa063740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf01a5b20 con 0x55c41fdeb0e0 2024-08-20T01:39:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.475+0000 7fbbeffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 0x55c41fe06bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.475+0000 7fbbeffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 0x55c41fe06bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37456/0 (socket says 172.21.15.22:37456) 2024-08-20T01:39:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.475+0000 7fbbeffff640 1 -- 172.21.15.22:0/2023756020 learned_addr learned my addr 172.21.15.22:0/2023756020 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.475+0000 7fbbeffff640 1 -- 172.21.15.22:0/2023756020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeb0e0 msgr2=0x55c41fddc9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:39:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.475+0000 7fbbeffff640 1 --2- 172.21.15.22:0/2023756020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeb0e0 0x55c41fddc9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.475+0000 7fbbeffff640 1 -- 172.21.15.22:0/2023756020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 msgr2=0x55c41fe07100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:39:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.475+0000 7fbbeffff640 1 --2- 172.21.15.22:0/2023756020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 0x55c41fe07100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.475+0000 7fbbeffff640 1 -- 172.21.15.22:0/2023756020 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c41fded840 con 0x55c41fdeda10 2024-08-20T01:39:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.476+0000 7fbbeffff640 1 --2- 172.21.15.22:0/2023756020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 0x55c41fe06bc0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009f20 tx=0x7fbbdc010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9b5d38a39e8625 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:00.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.476+0000 7fbbda7fc640 1 -- 172.21.15.22:0/2023756020 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc004220 con 0x55c41fdeda10 2024-08-20T01:39:00.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.476+0000 7fbbda7fc640 1 -- 172.21.15.22:0/2023756020 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbdc0043c0 con 0x55c41fdeda10 2024-08-20T01:39:00.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.476+0000 7fbbda7fc640 1 -- 172.21.15.22:0/2023756020 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc01d910 con 0x55c41fdeda10 2024-08-20T01:39:00.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.477+0000 7fbbfa063740 1 -- 172.21.15.22:0/2023756020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 msgr2=0x55c41fe06bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:00.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.477+0000 7fbbfa063740 1 --2- 172.21.15.22:0/2023756020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 0x55c41fe06bc0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009f20 tx=0x7fbbdc010800 comp rx=0 tx=0).stop 2024-08-20T01:39:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.479+0000 7fbbfa063740 1 -- 172.21.15.22:0/2023756020 shutdown_connections 2024-08-20T01:39:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.479+0000 7fbbfa063740 1 --2- 172.21.15.22:0/2023756020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 0x55c41fe07100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.479+0000 7fbbfa063740 1 --2- 172.21.15.22:0/2023756020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 0x55c41fe06bc0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.479+0000 7fbbfa063740 1 --2- 172.21.15.22:0/2023756020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeb0e0 0x55c41fddc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.479+0000 7fbbfa063740 1 -- 172.21.15.22:0/2023756020 >> 172.21.15.22:0/2023756020 conn(0x55c41fde6230 msgr2=0x55c41fddc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.480+0000 7fbbfa063740 1 -- 172.21.15.22:0/2023756020 shutdown_connections 2024-08-20T01:39:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.480+0000 7fbbfa063740 1 -- 172.21.15.22:0/2023756020 wait complete. 2024-08-20T01:39:00.483 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.480+0000 7fbbfa063740 1 -- start start 2024-08-20T01:39:00.483 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.480+0000 7fbbfa063740 1 Processor -- start 2024-08-20T01:39:00.483 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.481+0000 7fbbfa063740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeb0e0 0x55c41fdfc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:00.483 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.481+0000 7fbbfa063740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 0x55c41fdfb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.481+0000 7fbbfa063740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 0x55c41fdfb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.481+0000 7fbbfa063740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf01a6170 con 0x55c41fdeda10 2024-08-20T01:39:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.481+0000 7fbbfa063740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf01a75e0 con 0x55c41fdf0450 2024-08-20T01:39:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.481+0000 7fbbfa063740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf01a6840 con 0x55c41fdeb0e0 2024-08-20T01:39:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.481+0000 7fbbfa063740 10 client.0 _ll_register_callbacks cb 0x7fbbe800f930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.481+0000 7fbbeffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 0x55c41fdfb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.481+0000 7fbbeffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 0x55c41fdfb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37472/0 (socket says 172.21.15.22:37472) 2024-08-20T01:39:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.481+0000 7fbbeffff640 1 -- 172.21.15.22:0/2726063292 learned_addr learned my addr 172.21.15.22:0/2726063292 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.481+0000 7fbbf5738640 1 --2- 172.21.15.22:0/2726063292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeb0e0 0x55c41fdfc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.481+0000 7fbbf5738640 1 --2- 172.21.15.22:0/2726063292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 0x55c41fdfb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:00.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.482+0000 7fbbf5738640 1 -- 172.21.15.22:0/2726063292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 msgr2=0x55c41fdfb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:00.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.482+0000 7fbbf5738640 1 --2- 172.21.15.22:0/2726063292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 0x55c41fdfb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.482+0000 7fbbf5738640 1 -- 172.21.15.22:0/2726063292 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 msgr2=0x55c41fdfb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:00.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.482+0000 7fbbf5738640 1 --2- 172.21.15.22:0/2726063292 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 0x55c41fdfb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:00.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.482+0000 7fbbf5738640 1 -- 172.21.15.22:0/2726063292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c41fdf52f0 con 0x55c41fdeb0e0 2024-08-20T01:39:00.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.482+0000 7fbbeffff640 1 --2- 172.21.15.22:0/2726063292 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 0x55c41fdfb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:00.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.482+0000 7fbbf5738640 1 --2- 172.21.15.22:0/2726063292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeb0e0 0x55c41fdfc470 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8027d60 tx=0x7fbbe8011980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63987fabd36b587a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:00.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.482+0000 7fbbcffff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:39:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.482+0000 7fbbcffff640 1 -- 172.21.15.22:0/2726063292 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8025a00 con 0x55c41fdeb0e0 2024-08-20T01:39:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.483+0000 7fbbcffff640 1 -- 172.21.15.22:0/2726063292 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fbbe8025ba0 con 0x55c41fdeb0e0 2024-08-20T01:39:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.483+0000 7fbbfa063740 1 -- 172.21.15.22:0/2726063292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbdc0043c0 con 0x55c41fdeb0e0 2024-08-20T01:39:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.483+0000 7fbbcffff640 1 -- 172.21.15.22:0/2726063292 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbbe8025da0 con 0x55c41fdeb0e0 2024-08-20T01:39:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.483+0000 7fbbfa063740 10 client.26290 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.483+0000 7fbbfa063740 1 -- 172.21.15.22:0/2726063292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c41fddd3b0 con 0x55c41fdeb0e0 2024-08-20T01:39:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.484+0000 7fbbcffff640 1 -- 172.21.15.22:0/2726063292 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbe802c070 con 0x55c41fdeb0e0 2024-08-20T01:39:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.484+0000 7fbbcffff640 1 -- 172.21.15.22:0/2726063292 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fbbe8027810 con 0x55c41fdeb0e0 2024-08-20T01:39:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.484+0000 7fbbfa063740 10 client.26290 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.484+0000 7fbbfa063740 10 client.26290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.484+0000 7fbbfa063740 20 client.26290 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.484+0000 7fbbfa063740 1 --2- 172.21.15.22:0/2726063292 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55c41fdffec0 0x55c41fddfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.484+0000 7fbbfa063740 4 client.26290 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:39:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.484+0000 7fbbfa063740 1 -- 172.21.15.22:0/2726063292 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fbbdc0043c0 con 0x55c41fdffec0 2024-08-20T01:39:00.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.485+0000 7fbbeffff640 1 --2- 172.21.15.22:0/2726063292 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55c41fdffec0 0x55c41fddfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:00.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.486+0000 7fbbcffff640 10 client.26290 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:00.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:00.486+0000 7fbbeffff640 1 --2- 172.21.15.22:0/2726063292 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55c41fdffec0 0x55c41fddfd20 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77162f2bc68ee91e server_cookie=30493a3dedf944c0 in_seq=0 out_seq=0 2024-08-20T01:39:00.813 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:00 smithi022 ceph-mon[18709]: pgmap v582: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 333 op/s 2024-08-20T01:39:00.813 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:00 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/803088215' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:39:00.846 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:39:01.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:00 smithi134 ceph-mon[22511]: pgmap v582: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 333 op/s 2024-08-20T01:39:01.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:00 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/803088215' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:39:01.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:00 smithi077 ceph-mon[22251]: pgmap v582: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 333 op/s 2024-08-20T01:39:01.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:00 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/803088215' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:39:01.470 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:02.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.155+0000 7fcf52b7b640 1 -- 172.21.15.22:0/2159801151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf4c107b90 msgr2=0x7fcf4c10e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:02.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.155+0000 7fcf52b7b640 1 --2- 172.21.15.22:0/2159801151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf4c107b90 0x7fcf4c10e390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcf44009be0 tx=0x7fcf4402a6d0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.156+0000 7fcf52b7b640 1 -- 172.21.15.22:0/2159801151 shutdown_connections 2024-08-20T01:39:02.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.156+0000 7fcf52b7b640 1 --2- 172.21.15.22:0/2159801151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf4c107b90 0x7fcf4c10e390 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.156+0000 7fcf52b7b640 1 --2- 172.21.15.22:0/2159801151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf4c107210 0x7fcf4c107650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.156+0000 7fcf52b7b640 1 --2- 172.21.15.22:0/2159801151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf4c101800 0x7fcf4c101be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.156+0000 7fcf52b7b640 1 -- 172.21.15.22:0/2159801151 >> 172.21.15.22:0/2159801151 conn(0x7fcf4c0fd2d0 msgr2=0x7fcf4c0ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:02.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.162+0000 7fcf52b7b640 1 -- 172.21.15.22:0/2159801151 shutdown_connections 2024-08-20T01:39:02.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.162+0000 7fcf52b7b640 1 -- 172.21.15.22:0/2159801151 wait complete. 2024-08-20T01:39:02.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.162+0000 7fcf52b7b640 1 Processor -- start 2024-08-20T01:39:02.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.166+0000 7fcf52b7b640 1 -- start start 2024-08-20T01:39:02.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.166+0000 7fcf52b7b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf4c101800 0x7fcf4c111bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.166+0000 7fcf52b7b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf4c107210 0x7fcf4c112130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.166+0000 7fcf52b7b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf4c107b90 0x7fcf4c1174d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.166+0000 7fcf51b79640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf4c101800 0x7fcf4c111bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.166+0000 7fcf51b79640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf4c101800 0x7fcf4c111bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:45246/0 (socket says 172.21.15.22:45246) 2024-08-20T01:39:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.166+0000 7fcf52b7b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c110710 con 0x7fcf4c107210 2024-08-20T01:39:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.166+0000 7fcf52b7b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c110590 con 0x7fcf4c101800 2024-08-20T01:39:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.166+0000 7fcf52b7b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c110890 con 0x7fcf4c107b90 2024-08-20T01:39:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.166+0000 7fcf51b79640 1 -- 172.21.15.22:0/1259251741 learned_addr learned my addr 172.21.15.22:0/1259251741 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.167+0000 7fcf5237a640 1 --2- 172.21.15.22:0/1259251741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf4c107b90 0x7fcf4c1174d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.169+0000 7fcf51b79640 1 -- 172.21.15.22:0/1259251741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf4c107b90 msgr2=0x7fcf4c1174d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.169+0000 7fcf51b79640 1 --2- 172.21.15.22:0/1259251741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf4c107b90 0x7fcf4c1174d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.169+0000 7fcf51b79640 1 -- 172.21.15.22:0/1259251741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf4c107210 msgr2=0x7fcf4c112130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.169+0000 7fcf51b79640 1 --2- 172.21.15.22:0/1259251741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf4c107210 0x7fcf4c112130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.169+0000 7fcf51b79640 1 -- 172.21.15.22:0/1259251741 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf4c117c50 con 0x7fcf4c101800 2024-08-20T01:39:02.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.172+0000 7fcf51b79640 1 --2- 172.21.15.22:0/1259251741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf4c101800 0x7fcf4c111bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcf4801d980 tx=0x7fcf4801de40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:02.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.173+0000 7fcf42ffd640 1 -- 172.21.15.22:0/1259251741 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48014070 con 0x7fcf4c101800 2024-08-20T01:39:02.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.173+0000 7fcf52b7b640 1 -- 172.21.15.22:0/1259251741 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf4c117f40 con 0x7fcf4c101800 2024-08-20T01:39:02.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.174+0000 7fcf52b7b640 1 -- 172.21.15.22:0/1259251741 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf4c11a650 con 0x7fcf4c101800 2024-08-20T01:39:02.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.174+0000 7fcf42ffd640 1 -- 172.21.15.22:0/1259251741 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf4800f440 con 0x7fcf4c101800 2024-08-20T01:39:02.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.174+0000 7fcf42ffd640 1 -- 172.21.15.22:0/1259251741 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800d5a0 con 0x7fcf4c101800 2024-08-20T01:39:02.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.181+0000 7fcf561d6740 1 Processor -- start 2024-08-20T01:39:02.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.182+0000 7fcf561d6740 1 -- start start 2024-08-20T01:39:02.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.182+0000 7fcf561d6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558171743a30 0x558171743e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:02.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.182+0000 7fcf561d6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558171744350 0x55817174fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:02.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.182+0000 7fcf561d6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581717502e0 0x5581717526d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:02.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.182+0000 7fcf561d6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5581716ba930 con 0x558171743a30 2024-08-20T01:39:02.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.182+0000 7fcf561d6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5581716a9e30 con 0x558171744350 2024-08-20T01:39:02.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.182+0000 7fcf561d6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5581716ade70 con 0x5581717502e0 2024-08-20T01:39:02.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.182+0000 7fcf51378640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581717502e0 0x5581717526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:02.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.182+0000 7fcf51378640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581717502e0 0x5581717526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:40674/0 (socket says 172.21.15.22:40674) 2024-08-20T01:39:02.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.182+0000 7fcf51378640 1 -- 172.21.15.22:0/433286608 learned_addr learned my addr 172.21.15.22:0/433286608 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:02.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.183+0000 7fcf51b79640 1 --2- 172.21.15.22:0/433286608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558171744350 0x55817174fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:02.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.183+0000 7fcf42ffd640 1 -- 172.21.15.22:0/1259251741 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcf4800d740 con 0x7fcf4c101800 2024-08-20T01:39:02.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.183+0000 7fcf51378640 1 -- 172.21.15.22:0/433286608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558171744350 msgr2=0x55817174fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:02.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.183+0000 7fcf51378640 1 --2- 172.21.15.22:0/433286608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558171744350 0x55817174fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.183+0000 7fcf51378640 1 -- 172.21.15.22:0/433286608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558171743a30 msgr2=0x558171743e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:02.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.183+0000 7fcf51378640 1 --2- 172.21.15.22:0/433286608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558171743a30 0x558171743e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.183+0000 7fcf51378640 1 -- 172.21.15.22:0/433286608 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558171409650 con 0x5581717502e0 2024-08-20T01:39:02.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.183+0000 7fcf51378640 1 --2- 172.21.15.22:0/433286608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581717502e0 0x5581717526d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c02caa0 tx=0x7fcf3c02cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c04286eb9e5e212 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:02.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.185+0000 7fcf37fff640 1 -- 172.21.15.22:0/433286608 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c004020 con 0x5581717502e0 2024-08-20T01:39:02.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.185+0000 7fcf37fff640 1 -- 172.21.15.22:0/433286608 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf3c0041c0 con 0x5581717502e0 2024-08-20T01:39:02.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.185+0000 7fcf37fff640 1 -- 172.21.15.22:0/433286608 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c0316c0 con 0x5581717502e0 2024-08-20T01:39:02.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.186+0000 7fcf561d6740 1 -- 172.21.15.22:0/433286608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581717502e0 msgr2=0x5581717526d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:02.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.186+0000 7fcf561d6740 1 --2- 172.21.15.22:0/433286608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581717502e0 0x5581717526d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c02caa0 tx=0x7fcf3c02cf60 comp rx=0 tx=0).stop 2024-08-20T01:39:02.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.189+0000 7fcf561d6740 1 -- 172.21.15.22:0/433286608 shutdown_connections 2024-08-20T01:39:02.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.189+0000 7fcf561d6740 1 --2- 172.21.15.22:0/433286608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581717502e0 0x5581717526d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.189+0000 7fcf561d6740 1 --2- 172.21.15.22:0/433286608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558171744350 0x55817174fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.189+0000 7fcf561d6740 1 --2- 172.21.15.22:0/433286608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558171743a30 0x558171743e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.189+0000 7fcf561d6740 1 -- 172.21.15.22:0/433286608 >> 172.21.15.22:0/433286608 conn(0x558171741860 msgr2=0x558171742a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:02.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.189+0000 7fcf42ffd640 1 --2- 172.21.15.22:0/1259251741 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcf380b3ea0 0x7fcf380b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:02.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.190+0000 7fcf42ffd640 1 -- 172.21.15.22:0/1259251741 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fcf48105ad0 con 0x7fcf4c101800 2024-08-20T01:39:02.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.191+0000 7fcf51378640 1 --2- 172.21.15.22:0/1259251741 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcf380b3ea0 0x7fcf380b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:02.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.192+0000 7fcf51378640 1 --2- 172.21.15.22:0/1259251741 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcf380b3ea0 0x7fcf380b6360 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c02c830 tx=0x7fcf3c003d70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:02.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.194+0000 7fcf561d6740 1 -- 172.21.15.22:0/433286608 shutdown_connections 2024-08-20T01:39:02.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.194+0000 7fcf561d6740 1 -- 172.21.15.22:0/433286608 wait complete. 2024-08-20T01:39:02.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.195+0000 7fcf561d6740 1 -- start start 2024-08-20T01:39:02.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.195+0000 7fcf561d6740 1 Processor -- start 2024-08-20T01:39:02.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.195+0000 7fcf561d6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558171743a30 0x55817174d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:02.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.195+0000 7fcf561d6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558171744350 0x55817174d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:02.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.197+0000 7fcf561d6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5581717502e0 0x55817174dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:02.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.197+0000 7fcf561d6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55817150c700 con 0x558171743a30 2024-08-20T01:39:02.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.197+0000 7fcf561d6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558171630810 con 0x5581717502e0 2024-08-20T01:39:02.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.197+0000 7fcf561d6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558171752f90 con 0x558171744350 2024-08-20T01:39:02.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.197+0000 7fcf561d6740 10 client.0 _ll_register_callbacks cb 0x5581716a3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:02.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.197+0000 7fcf5237a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5581717502e0 0x55817174dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:02.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.197+0000 7fcf5237a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5581717502e0 0x55817174dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:45266/0 (socket says 172.21.15.22:45266) 2024-08-20T01:39:02.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.197+0000 7fcf5237a640 1 -- 172.21.15.22:0/515793713 learned_addr learned my addr 172.21.15.22:0/515793713 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:02.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.197+0000 7fcf51378640 1 --2- 172.21.15.22:0/515793713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558171744350 0x55817174d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:02.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.198+0000 7fcf51378640 1 -- 172.21.15.22:0/515793713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5581717502e0 msgr2=0x55817174dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:02.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.198+0000 7fcf51378640 1 --2- 172.21.15.22:0/515793713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5581717502e0 0x55817174dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.198+0000 7fcf51378640 1 -- 172.21.15.22:0/515793713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558171743a30 msgr2=0x55817174d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:02.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.198+0000 7fcf51378640 1 --2- 172.21.15.22:0/515793713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558171743a30 0x55817174d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.198+0000 7fcf51378640 1 -- 172.21.15.22:0/515793713 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55817175c3d0 con 0x558171744350 2024-08-20T01:39:02.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.198+0000 7fcf51378640 1 --2- 172.21.15.22:0/515793713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558171744350 0x55817174d7a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c02ca70 tx=0x7fcf3c005e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3188ae3142db7a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:02.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.198+0000 7fcf357fa640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:39:02.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.200+0000 7fcf357fa640 1 -- 172.21.15.22:0/515793713 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c003b90 con 0x558171744350 2024-08-20T01:39:02.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.200+0000 7fcf561d6740 1 -- 172.21.15.22:0/515793713 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558171659150 con 0x558171744350 2024-08-20T01:39:02.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.200+0000 7fcf357fa640 1 -- 172.21.15.22:0/515793713 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fcf3c031460 con 0x558171744350 2024-08-20T01:39:02.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.202+0000 7fcf357fa640 1 -- 172.21.15.22:0/515793713 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fcf3c0316a0 con 0x558171744350 2024-08-20T01:39:02.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.202+0000 7fcf561d6740 10 client.26302 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:02.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.202+0000 7fcf561d6740 1 -- 172.21.15.22:0/515793713 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55817175ed90 con 0x558171744350 2024-08-20T01:39:02.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.205+0000 7fcf357fa640 1 -- 172.21.15.22:0/515793713 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558171659150 con 0x558171744350 2024-08-20T01:39:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.205+0000 7fcf357fa640 1 -- 172.21.15.22:0/515793713 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fcf3c050070 con 0x558171744350 2024-08-20T01:39:02.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.206+0000 7fcf561d6740 10 client.26302 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:02.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.206+0000 7fcf561d6740 10 client.26302 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:39:02.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.206+0000 7fcf561d6740 20 client.26302 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:02.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.206+0000 7fcf561d6740 1 --2- 172.21.15.22:0/515793713 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5581717606f0 0x558171762b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:02.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.206+0000 7fcf561d6740 4 client.26302 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:02.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.206+0000 7fcf561d6740 1 -- 172.21.15.22:0/515793713 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581716bc880 con 0x5581717606f0 2024-08-20T01:39:02.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.206+0000 7fcf51b79640 1 --2- 172.21.15.22:0/515793713 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5581717606f0 0x558171762b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:02.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.207+0000 7fcf51b79640 1 --2- 172.21.15.22:0/515793713 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5581717606f0 0x558171762b70 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=714d8b8beed4b6ef server_cookie=4417fe9cf63b3cd4 in_seq=0 out_seq=0 2024-08-20T01:39:02.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.207+0000 7fcf357fa640 10 client.26302 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:39:02.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.208+0000 7fcf357fa640 1 -- 172.21.15.22:0/515793713 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5581716bc880 con 0x5581717606f0 2024-08-20T01:39:02.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.208+0000 7fcf357fa640 10 client.26302 handle_command_reply: tid=0 2024-08-20T01:39:02.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.208+0000 7fcf561d6740 1 client.26302 shutdown 2024-08-20T01:39:02.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.209+0000 7fcf561d6740 1 -- 172.21.15.22:0/515793713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558171744350 msgr2=0x55817174d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:02.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.209+0000 7fcf561d6740 1 --2- 172.21.15.22:0/515793713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558171744350 0x55817174d7a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c02ca70 tx=0x7fcf3c005e90 comp rx=0 tx=0).stop 2024-08-20T01:39:02.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.215+0000 7fcf561d6740 1 -- 172.21.15.22:0/515793713 shutdown_connections 2024-08-20T01:39:02.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.215+0000 7fcf561d6740 1 --2- 172.21.15.22:0/515793713 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5581717606f0 0x558171762b70 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.215+0000 7fcf561d6740 1 --2- 172.21.15.22:0/515793713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5581717502e0 0x55817174dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.215+0000 7fcf561d6740 1 --2- 172.21.15.22:0/515793713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558171744350 0x55817174d7a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.215+0000 7fcf561d6740 1 --2- 172.21.15.22:0/515793713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558171743a30 0x55817174d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.215+0000 7fcf357fa640 0 client.26302 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:39:02.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.215+0000 7fcf561d6740 1 -- 172.21.15.22:0/515793713 >> 172.21.15.22:0/515793713 conn(0x558171741860 msgr2=0x558171747400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:02.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.215+0000 7fcf561d6740 1 -- 172.21.15.22:0/515793713 shutdown_connections 2024-08-20T01:39:02.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.215+0000 7fcf561d6740 1 -- 172.21.15.22:0/515793713 wait complete. 2024-08-20T01:39:02.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.217+0000 7fcf561d6740 20 client.26302 trim_cache size 0 max 16384 2024-08-20T01:39:02.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.246+0000 7fcf561d6740 1 Processor -- start 2024-08-20T01:39:02.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.247+0000 7fcf561d6740 1 -- start start 2024-08-20T01:39:02.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.247+0000 7fcf561d6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558171743a30 0x5581717472f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:02.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.247+0000 7fcf561d6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558171744350 0x55817174d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:02.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.247+0000 7fcf561d6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5581717502e0 0x55817174dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:02.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.247+0000 7fcf561d6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcf30011050 con 0x558171744350 2024-08-20T01:39:02.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.247+0000 7fcf561d6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3000e860 con 0x5581717502e0 2024-08-20T01:39:02.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.247+0000 7fcf561d6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3000c6b0 con 0x558171743a30 2024-08-20T01:39:02.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.248+0000 7fcf51378640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558171744350 0x55817174d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:02.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.248+0000 7fcf51378640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558171744350 0x55817174d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37506/0 (socket says 172.21.15.22:37506) 2024-08-20T01:39:02.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.248+0000 7fcf51378640 1 -- 172.21.15.22:0/351984523 learned_addr learned my addr 172.21.15.22:0/351984523 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:02.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.248+0000 7fcf51b79640 1 --2- 172.21.15.22:0/351984523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558171743a30 0x5581717472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:02.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.248+0000 7fcf5237a640 1 --2- 172.21.15.22:0/351984523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5581717502e0 0x55817174dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:02.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.248+0000 7fcf51b79640 1 -- 172.21.15.22:0/351984523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5581717502e0 msgr2=0x55817174dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:02.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.248+0000 7fcf51b79640 1 --2- 172.21.15.22:0/351984523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5581717502e0 0x55817174dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.248+0000 7fcf51b79640 1 -- 172.21.15.22:0/351984523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558171744350 msgr2=0x55817174d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:02.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.248+0000 7fcf51b79640 1 --2- 172.21.15.22:0/351984523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558171744350 0x55817174d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.248+0000 7fcf51b79640 1 -- 172.21.15.22:0/351984523 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581717420e0 con 0x558171743a30 2024-08-20T01:39:02.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.248+0000 7fcf51378640 1 --2- 172.21.15.22:0/351984523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558171744350 0x55817174d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:02.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.252+0000 7fcf51b79640 1 --2- 172.21.15.22:0/351984523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558171743a30 0x5581717472f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcf48108fd0 tx=0x7fcf4801df70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1926826df9e11e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:02.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.258+0000 7fcf377fe640 1 -- 172.21.15.22:0/351984523 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800fcd0 con 0x558171743a30 2024-08-20T01:39:02.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.258+0000 7fcf377fe640 1 -- 172.21.15.22:0/351984523 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf480d5370 con 0x558171743a30 2024-08-20T01:39:02.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.258+0000 7fcf377fe640 1 -- 172.21.15.22:0/351984523 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf480d5a30 con 0x558171743a30 2024-08-20T01:39:02.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.260+0000 7fcf561d6740 1 -- 172.21.15.22:0/351984523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558171743a30 msgr2=0x5581717472f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:02.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.260+0000 7fcf561d6740 1 --2- 172.21.15.22:0/351984523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558171743a30 0x5581717472f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcf48108fd0 tx=0x7fcf4801df70 comp rx=0 tx=0).stop 2024-08-20T01:39:02.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.262+0000 7fcf561d6740 1 -- 172.21.15.22:0/351984523 shutdown_connections 2024-08-20T01:39:02.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.262+0000 7fcf561d6740 1 --2- 172.21.15.22:0/351984523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5581717502e0 0x55817174dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.262+0000 7fcf561d6740 1 --2- 172.21.15.22:0/351984523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558171744350 0x55817174d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.262+0000 7fcf561d6740 1 --2- 172.21.15.22:0/351984523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558171743a30 0x5581717472f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.262+0000 7fcf561d6740 1 -- 172.21.15.22:0/351984523 >> 172.21.15.22:0/351984523 conn(0x558171741860 msgr2=0x558171746be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:02.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.263+0000 7fcf561d6740 1 -- 172.21.15.22:0/351984523 shutdown_connections 2024-08-20T01:39:02.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.263+0000 7fcf561d6740 1 -- 172.21.15.22:0/351984523 wait complete. 2024-08-20T01:39:02.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.263+0000 7fcf561d6740 1 -- start start 2024-08-20T01:39:02.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.264+0000 7fcf561d6740 1 Processor -- start 2024-08-20T01:39:02.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.264+0000 7fcf561d6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558171743a30 0x558171758ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:02.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.264+0000 7fcf561d6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558171744350 0x558171753270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:02.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.264+0000 7fcf561d6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581717502e0 0x5581717538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:02.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.265+0000 7fcf561d6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3000cd20 con 0x558171744350 2024-08-20T01:39:02.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.265+0000 7fcf561d6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3000e190 con 0x558171743a30 2024-08-20T01:39:02.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.265+0000 7fcf561d6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3000d3f0 con 0x5581717502e0 2024-08-20T01:39:02.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.265+0000 7fcf5237a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581717502e0 0x5581717538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:02.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.265+0000 7fcf5237a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581717502e0 0x5581717538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:40712/0 (socket says 172.21.15.22:40712) 2024-08-20T01:39:02.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.265+0000 7fcf5237a640 1 -- 172.21.15.22:0/854418129 learned_addr learned my addr 172.21.15.22:0/854418129 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:02.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.265+0000 7fcf561d6740 10 client.0 _ll_register_callbacks cb 0x7fcf4810b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:02.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.266+0000 7fcf5237a640 1 -- 172.21.15.22:0/854418129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558171743a30 msgr2=0x558171758ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:02.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.266+0000 7fcf5237a640 1 --2- 172.21.15.22:0/854418129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558171743a30 0x558171758ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.266+0000 7fcf5237a640 1 -- 172.21.15.22:0/854418129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558171744350 msgr2=0x558171753270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:02.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.266+0000 7fcf5237a640 1 --2- 172.21.15.22:0/854418129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558171744350 0x558171753270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.266+0000 7fcf5237a640 1 -- 172.21.15.22:0/854418129 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581717422e0 con 0x5581717502e0 2024-08-20T01:39:02.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.267+0000 7fcf5237a640 1 --2- 172.21.15.22:0/854418129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581717502e0 0x5581717538f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcf440092f0 tx=0x7fcf44030cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=275bdeade38213f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:02.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.267+0000 7fcf357fa640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:39:02.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.269+0000 7fcf357fa640 1 -- 172.21.15.22:0/854418129 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44036040 con 0x5581717502e0 2024-08-20T01:39:02.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.269+0000 7fcf561d6740 1 -- 172.21.15.22:0/854418129 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5581716b8320 con 0x5581717502e0 2024-08-20T01:39:02.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.269+0000 7fcf357fa640 1 -- 172.21.15.22:0/854418129 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fcf440305a0 con 0x5581717502e0 2024-08-20T01:39:02.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.270+0000 7fcf357fa640 1 -- 172.21.15.22:0/854418129 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fcf440307a0 con 0x5581717502e0 2024-08-20T01:39:02.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.270+0000 7fcf561d6740 10 client.26308 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:02.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.270+0000 7fcf561d6740 1 -- 172.21.15.22:0/854418129 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5581717ca3b0 con 0x5581717502e0 2024-08-20T01:39:02.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.274+0000 7fcf357fa640 1 -- 172.21.15.22:0/854418129 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5581716b8320 con 0x5581717502e0 2024-08-20T01:39:02.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.274+0000 7fcf357fa640 1 -- 172.21.15.22:0/854418129 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fcf44004030 con 0x5581717502e0 2024-08-20T01:39:02.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.274+0000 7fcf561d6740 10 client.26308 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:02.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.274+0000 7fcf561d6740 10 client.26308 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:39:02.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.274+0000 7fcf561d6740 20 client.26308 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:02.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.274+0000 7fcf561d6740 1 --2- 172.21.15.22:0/854418129 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5581717caba0 0x5581717cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:02.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.274+0000 7fcf561d6740 4 client.26308 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:39:02.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.274+0000 7fcf561d6740 1 -- 172.21.15.22:0/854418129 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5581716b5a60 con 0x5581717caba0 2024-08-20T01:39:02.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.274+0000 7fcf51b79640 1 --2- 172.21.15.22:0/854418129 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5581717caba0 0x5581717cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:02.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.275+0000 7fcf51b79640 1 --2- 172.21.15.22:0/854418129 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5581717caba0 0x5581717cd040 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c8258c9611cec326 server_cookie=ae865dfb34f15bc3 in_seq=0 out_seq=0 2024-08-20T01:39:02.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.275+0000 7fcf357fa640 10 client.26308 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:39:02.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.275+0000 7fcf357fa640 1 -- 172.21.15.22:0/854418129 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5581716b5a60 con 0x5581717caba0 2024-08-20T01:39:02.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.275+0000 7fcf357fa640 10 client.26308 handle_command_reply: tid=0 2024-08-20T01:39:02.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.275+0000 7fcf561d6740 1 client.26308 shutdown 2024-08-20T01:39:02.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.280+0000 7fcf561d6740 1 -- 172.21.15.22:0/854418129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581717502e0 msgr2=0x5581717538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:02.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.280+0000 7fcf561d6740 1 --2- 172.21.15.22:0/854418129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581717502e0 0x5581717538f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcf440092f0 tx=0x7fcf44030cb0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.280+0000 7fcf561d6740 1 -- 172.21.15.22:0/854418129 shutdown_connections 2024-08-20T01:39:02.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.280+0000 7fcf561d6740 1 --2- 172.21.15.22:0/854418129 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x5581717caba0 0x5581717cd040 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.280+0000 7fcf561d6740 1 --2- 172.21.15.22:0/854418129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581717502e0 0x5581717538f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.280+0000 7fcf561d6740 1 --2- 172.21.15.22:0/854418129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558171744350 0x558171753270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.280+0000 7fcf561d6740 1 --2- 172.21.15.22:0/854418129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558171743a30 0x558171758ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.280+0000 7fcf561d6740 1 -- 172.21.15.22:0/854418129 >> 172.21.15.22:0/854418129 conn(0x558171741860 msgr2=0x55817174f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:02.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.281+0000 7fcf357fa640 0 client.26308 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:39:02.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.281+0000 7fcf561d6740 1 -- 172.21.15.22:0/854418129 shutdown_connections 2024-08-20T01:39:02.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.281+0000 7fcf561d6740 1 -- 172.21.15.22:0/854418129 wait complete. 2024-08-20T01:39:02.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.283+0000 7fcf561d6740 20 client.26308 trim_cache size 0 max 16384 2024-08-20T01:39:02.285 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:39:02.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.287+0000 7fcf52b7b640 1 -- 172.21.15.22:0/1259251741 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcf380b3ea0 msgr2=0x7fcf380b6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:02.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.287+0000 7fcf52b7b640 1 --2- 172.21.15.22:0/1259251741 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcf380b3ea0 0x7fcf380b6360 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c02c830 tx=0x7fcf3c003d70 comp rx=0 tx=0).stop 2024-08-20T01:39:02.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.287+0000 7fcf52b7b640 1 -- 172.21.15.22:0/1259251741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf4c101800 msgr2=0x7fcf4c111bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:02.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.287+0000 7fcf52b7b640 1 --2- 172.21.15.22:0/1259251741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf4c101800 0x7fcf4c111bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcf4801d980 tx=0x7fcf4801de40 comp rx=0 tx=0).stop 2024-08-20T01:39:02.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.287+0000 7fcf52b7b640 1 -- 172.21.15.22:0/1259251741 shutdown_connections 2024-08-20T01:39:02.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.287+0000 7fcf52b7b640 1 --2- 172.21.15.22:0/1259251741 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcf380b3ea0 0x7fcf380b6360 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.287+0000 7fcf52b7b640 1 --2- 172.21.15.22:0/1259251741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf4c107b90 0x7fcf4c1174d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.287+0000 7fcf52b7b640 1 --2- 172.21.15.22:0/1259251741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf4c107210 0x7fcf4c112130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.287+0000 7fcf52b7b640 1 --2- 172.21.15.22:0/1259251741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf4c101800 0x7fcf4c111bf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:02.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.287+0000 7fcf52b7b640 1 -- 172.21.15.22:0/1259251741 >> 172.21.15.22:0/1259251741 conn(0x7fcf4c0fd2d0 msgr2=0x7fcf4c1006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:02.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.288+0000 7fcf52b7b640 1 -- 172.21.15.22:0/1259251741 shutdown_connections 2024-08-20T01:39:02.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:02.288+0000 7fcf52b7b640 1 -- 172.21.15.22:0/1259251741 wait complete. 2024-08-20T01:39:02.920 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:39:02.945 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:02 smithi022 ceph-mon[18709]: pgmap v583: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 409 op/s 2024-08-20T01:39:03.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:02 smithi134 ceph-mon[22511]: pgmap v583: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 409 op/s 2024-08-20T01:39:03.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:02 smithi077 ceph-mon[22251]: pgmap v583: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 409 op/s 2024-08-20T01:39:03.234 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.384+0000 7fbbcffff640 1 -- 172.21.15.22:0/2726063292 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fbbdc0043c0 con 0x55c41fdffec0 2024-08-20T01:39:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.384+0000 7fbbcffff640 10 client.26290 handle_command_reply: tid=0 2024-08-20T01:39:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.384+0000 7fbbfa063740 1 client.26290 shutdown 2024-08-20T01:39:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.384+0000 7fbbfa063740 1 -- 172.21.15.22:0/2726063292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeb0e0 msgr2=0x55c41fdfc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.384+0000 7fbbfa063740 1 --2- 172.21.15.22:0/2726063292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeb0e0 0x55c41fdfc470 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8027d60 tx=0x7fbbe8011980 comp rx=0 tx=0).stop 2024-08-20T01:39:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.384+0000 7fbbfa063740 1 -- 172.21.15.22:0/2726063292 shutdown_connections 2024-08-20T01:39:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.385+0000 7fbbfa063740 1 --2- 172.21.15.22:0/2726063292 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55c41fdffec0 0x55c41fddfd20 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.385+0000 7fbbfa063740 1 --2- 172.21.15.22:0/2726063292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c41fdf0450 0x55c41fdfb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.385+0000 7fbbfa063740 1 --2- 172.21.15.22:0/2726063292 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c41fdeda10 0x55c41fdfb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.385+0000 7fbbfa063740 1 --2- 172.21.15.22:0/2726063292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c41fdeb0e0 0x55c41fdfc470 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.385+0000 7fbbfa063740 1 -- 172.21.15.22:0/2726063292 >> 172.21.15.22:0/2726063292 conn(0x55c41fde6230 msgr2=0x55c41fddcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.385+0000 7fbbcffff640 0 client.26290 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.385+0000 7fbbfa063740 1 -- 172.21.15.22:0/2726063292 shutdown_connections 2024-08-20T01:39:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.385+0000 7fbbfa063740 1 -- 172.21.15.22:0/2726063292 wait complete. 2024-08-20T01:39:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.385+0000 7fbbfa063740 20 client.26290 trim_cache size 0 max 16384 2024-08-20T01:39:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:39:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:39:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:39:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:39:03.389 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.386+0000 7fbbf719b640 1 -- 172.21.15.22:0/2550065375 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbbe00b3d20 msgr2=0x7fbbe00b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.386+0000 7fbbf719b640 1 --2- 172.21.15.22:0/2550065375 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbbe00b3d20 0x7fbbe00b61e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40caf20 tx=0x7fbbe4005e00 comp rx=0 tx=0).stop 2024-08-20T01:39:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.386+0000 7fbbf719b640 1 -- 172.21.15.22:0/2550065375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbf01048a0 msgr2=0x7fbbf019ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.386+0000 7fbbf719b640 1 --2- 172.21.15.22:0/2550065375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbf01048a0 0x7fbbf019ac90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009230 tx=0x7fbbe40042f0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.386+0000 7fbbf719b640 1 -- 172.21.15.22:0/2550065375 shutdown_connections 2024-08-20T01:39:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.386+0000 7fbbf719b640 1 --2- 172.21.15.22:0/2550065375 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbbe00b3d20 0x7fbbe00b61e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.386+0000 7fbbf719b640 1 --2- 172.21.15.22:0/2550065375 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbf01063b0 0x7fbbf019bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.386+0000 7fbbf719b640 1 --2- 172.21.15.22:0/2550065375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf01059f0 0x7fbbf019b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.386+0000 7fbbf719b640 1 --2- 172.21.15.22:0/2550065375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbf01048a0 0x7fbbf019ac90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.386+0000 7fbbf719b640 1 -- 172.21.15.22:0/2550065375 >> 172.21.15.22:0/2550065375 conn(0x7fbbf0100140 msgr2=0x7fbbf0108de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.387+0000 7fbbf719b640 1 -- 172.21.15.22:0/2550065375 shutdown_connections 2024-08-20T01:39:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:03.387+0000 7fbbf719b640 1 -- 172.21.15.22:0/2550065375 wait complete. 2024-08-20T01:39:03.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.743+0000 7fb0f4d04640 1 -- 172.21.15.22:0/3313429941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0f0102ad0 msgr2=0x7fb0f0102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:03.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.743+0000 7fb0f4d04640 1 --2- 172.21.15.22:0/3313429941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0f0102ad0 0x7fb0f0102eb0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0009900 tx=0x7fb0e002a410 comp rx=0 tx=0).stop 2024-08-20T01:39:03.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.743+0000 7fb0f4d04640 1 -- 172.21.15.22:0/3313429941 shutdown_connections 2024-08-20T01:39:03.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.743+0000 7fb0f4d04640 1 --2- 172.21.15.22:0/3313429941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0f0108e60 0x7fb0f010f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.743+0000 7fb0f4d04640 1 --2- 172.21.15.22:0/3313429941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f01084e0 0x7fb0f0108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.743+0000 7fb0f4d04640 1 --2- 172.21.15.22:0/3313429941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0f0102ad0 0x7fb0f0102eb0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.743+0000 7fb0f4d04640 1 -- 172.21.15.22:0/3313429941 >> 172.21.15.22:0/3313429941 conn(0x7fb0f00fe540 msgr2=0x7fb0f0100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.743+0000 7fb0f4d04640 1 -- 172.21.15.22:0/3313429941 shutdown_connections 2024-08-20T01:39:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.743+0000 7fb0f4d04640 1 -- 172.21.15.22:0/3313429941 wait complete. 2024-08-20T01:39:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.744+0000 7fb0f4d04640 1 Processor -- start 2024-08-20T01:39:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.744+0000 7fb0f4d04640 1 -- start start 2024-08-20T01:39:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.744+0000 7fb0f4d04640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0f0102ad0 0x7fb0f0199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.744+0000 7fb0f4d04640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f01084e0 0x7fb0f0199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.744+0000 7fb0f4d04640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0f0108e60 0x7fb0f019e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.744+0000 7fb0f4d04640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f0112ae0 con 0x7fb0f0108e60 2024-08-20T01:39:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.744+0000 7fb0f4d04640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f0112960 con 0x7fb0f01084e0 2024-08-20T01:39:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.744+0000 7fb0f4d04640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f0112c60 con 0x7fb0f0102ad0 2024-08-20T01:39:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.744+0000 7fb0eed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0f0108e60 0x7fb0f019e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.744+0000 7fb0ee59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0f0102ad0 0x7fb0f0199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.745+0000 7fb0ee59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0f0102ad0 0x7fb0f0199010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:40738/0 (socket says 172.21.15.22:40738) 2024-08-20T01:39:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.745+0000 7fb0ee59c640 1 -- 172.21.15.22:0/2351778835 learned_addr learned my addr 172.21.15.22:0/2351778835 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.745+0000 7fb0edd9b640 1 --2- 172.21.15.22:0/2351778835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f01084e0 0x7fb0f0199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.745+0000 7fb0eed9d640 1 -- 172.21.15.22:0/2351778835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0f0102ad0 msgr2=0x7fb0f0199010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.745+0000 7fb0eed9d640 1 --2- 172.21.15.22:0/2351778835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0f0102ad0 0x7fb0f0199010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.745+0000 7fb0eed9d640 1 -- 172.21.15.22:0/2351778835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f01084e0 msgr2=0x7fb0f0199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.745+0000 7fb0eed9d640 1 --2- 172.21.15.22:0/2351778835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f01084e0 0x7fb0f0199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.745+0000 7fb0eed9d640 1 -- 172.21.15.22:0/2351778835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f019f0c0 con 0x7fb0f0108e60 2024-08-20T01:39:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.745+0000 7fb0ee59c640 1 --2- 172.21.15.22:0/2351778835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0f0102ad0 0x7fb0f0199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.745+0000 7fb0edd9b640 1 --2- 172.21.15.22:0/2351778835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f01084e0 0x7fb0f0199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.745+0000 7fb0eed9d640 1 --2- 172.21.15.22:0/2351778835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0f0108e60 0x7fb0f019e8f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009fd0 tx=0x7fb0e800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.745+0000 7fb0df7fe640 1 -- 172.21.15.22:0/2351778835 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e800ce20 con 0x7fb0f0108e60 2024-08-20T01:39:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.745+0000 7fb0df7fe640 1 -- 172.21.15.22:0/2351778835 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0e8005020 con 0x7fb0f0108e60 2024-08-20T01:39:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.745+0000 7fb0f4d04640 1 -- 172.21.15.22:0/2351778835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f019f3b0 con 0x7fb0f0108e60 2024-08-20T01:39:03.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.745+0000 7fb0df7fe640 1 -- 172.21.15.22:0/2351778835 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8010690 con 0x7fb0f0108e60 2024-08-20T01:39:03.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.745+0000 7fb0f4d04640 1 -- 172.21.15.22:0/2351778835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f01a5a70 con 0x7fb0f0108e60 2024-08-20T01:39:03.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.748+0000 7fb0f70fd740 1 Processor -- start 2024-08-20T01:39:03.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.748+0000 7fb0df7fe640 1 -- 172.21.15.22:0/2351778835 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb0e80054d0 con 0x7fb0f0108e60 2024-08-20T01:39:03.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.748+0000 7fb0f70fd740 1 -- start start 2024-08-20T01:39:03.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.748+0000 7fb0f70fd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9a4880 0x55f27b9a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:03.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.748+0000 7fb0f70fd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 0x55f27b9b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:03.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.749+0000 7fb0f70fd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9b1130 0x55f27b9b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:03.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.749+0000 7fb0f70fd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f27b91b930 con 0x55f27b9a51a0 2024-08-20T01:39:03.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.749+0000 7fb0f70fd740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f27b90ae30 con 0x55f27b9a4880 2024-08-20T01:39:03.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.749+0000 7fb0f70fd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f27b90ee70 con 0x55f27b9b1130 2024-08-20T01:39:03.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.749+0000 7fb0ee59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 0x55f27b9b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:03.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.749+0000 7fb0ee59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 0x55f27b9b0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37564/0 (socket says 172.21.15.22:37564) 2024-08-20T01:39:03.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.749+0000 7fb0ee59c640 1 -- 172.21.15.22:0/1134670242 learned_addr learned my addr 172.21.15.22:0/1134670242 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:03.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.749+0000 7fb0edd9b640 1 --2- 172.21.15.22:0/1134670242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9b1130 0x55f27b9b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:03.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.749+0000 7fb0edd9b640 1 --2- 172.21.15.22:0/1134670242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9a4880 0x55f27b9a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:03.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.749+0000 7fb0ee59c640 1 -- 172.21.15.22:0/1134670242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9b1130 msgr2=0x55f27b9b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:03.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.749+0000 7fb0ee59c640 1 --2- 172.21.15.22:0/1134670242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9b1130 0x55f27b9b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.749+0000 7fb0ee59c640 1 -- 172.21.15.22:0/1134670242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9a4880 msgr2=0x55f27b9a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:03.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.749+0000 7fb0ee59c640 1 --2- 172.21.15.22:0/1134670242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9a4880 0x55f27b9a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.749+0000 7fb0ee59c640 1 -- 172.21.15.22:0/1134670242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f27b66a650 con 0x55f27b9a51a0 2024-08-20T01:39:03.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.749+0000 7fb0df7fe640 1 --2- 172.21.15.22:0/2351778835 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb0d80b3bd0 0x7fb0d80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:03.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.749+0000 7fb0ee59c640 1 --2- 172.21.15.22:0/1134670242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 0x55f27b9b0bf0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0009a20 tx=0x7fb0e0005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff17b88ee0505e22 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:03.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.749+0000 7fb0edd9b640 1 --2- 172.21.15.22:0/2351778835 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb0d80b3bd0 0x7fb0d80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:03.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.749+0000 7fb0df7fe640 1 -- 172.21.15.22:0/2351778835 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb0e80e42d0 con 0x7fb0f0108e60 2024-08-20T01:39:03.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.750+0000 7fb0dcff9640 1 -- 172.21.15.22:0/1134670242 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0035040 con 0x55f27b9a51a0 2024-08-20T01:39:03.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.750+0000 7fb0edd9b640 1 --2- 172.21.15.22:0/2351778835 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb0d80b3bd0 0x7fb0d80b6090 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55f27b9a4830 tx=0x7fb0e400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:03.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.750+0000 7fb0dcff9640 1 -- 172.21.15.22:0/1134670242 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0e0031850 con 0x55f27b9a51a0 2024-08-20T01:39:03.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.750+0000 7fb0dcff9640 1 -- 172.21.15.22:0/1134670242 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e00049c0 con 0x55f27b9a51a0 2024-08-20T01:39:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.751+0000 7fb0f70fd740 1 -- 172.21.15.22:0/1134670242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 msgr2=0x55f27b9b0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.751+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/1134670242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 0x55f27b9b0bf0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0009a20 tx=0x7fb0e0005be0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.751+0000 7fb0f70fd740 1 -- 172.21.15.22:0/1134670242 shutdown_connections 2024-08-20T01:39:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.751+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/1134670242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9b1130 0x55f27b9b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.751+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/1134670242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 0x55f27b9b0bf0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.751+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/1134670242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9a4880 0x55f27b9a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.751+0000 7fb0f70fd740 1 -- 172.21.15.22:0/1134670242 >> 172.21.15.22:0/1134670242 conn(0x55f27b9a26b0 msgr2=0x55f27b9a3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.751+0000 7fb0f70fd740 1 -- 172.21.15.22:0/1134670242 shutdown_connections 2024-08-20T01:39:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.751+0000 7fb0f70fd740 1 -- 172.21.15.22:0/1134670242 wait complete. 2024-08-20T01:39:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.751+0000 7fb0f70fd740 1 -- start start 2024-08-20T01:39:03.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.751+0000 7fb0f70fd740 1 Processor -- start 2024-08-20T01:39:03.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.751+0000 7fb0f70fd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9a4880 0x55f27b9ae080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:03.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.752+0000 7fb0f70fd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 0x55f27b9ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:03.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.752+0000 7fb0f70fd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9b1130 0x55f27b9aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:03.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.752+0000 7fb0f70fd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f27b76d700 con 0x55f27b9a51a0 2024-08-20T01:39:03.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.752+0000 7fb0f70fd740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f27b891810 con 0x55f27b9a4880 2024-08-20T01:39:03.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.752+0000 7fb0f70fd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f27b9b3d80 con 0x55f27b9b1130 2024-08-20T01:39:03.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.752+0000 7fb0f70fd740 10 client.0 _ll_register_callbacks cb 0x55f27b904700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:03.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.752+0000 7fb0edd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 0x55f27b9ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:03.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.752+0000 7fb0edd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 0x55f27b9ae5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37566/0 (socket says 172.21.15.22:37566) 2024-08-20T01:39:03.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.752+0000 7fb0ee59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9a4880 0x55f27b9ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:03.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.752+0000 7fb0edd9b640 1 -- 172.21.15.22:0/2128324713 learned_addr learned my addr 172.21.15.22:0/2128324713 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:03.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.752+0000 7fb0eed9d640 1 --2- 172.21.15.22:0/2128324713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9b1130 0x55f27b9aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:03.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.752+0000 7fb0edd9b640 1 -- 172.21.15.22:0/2128324713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9b1130 msgr2=0x55f27b9aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.752+0000 7fb0edd9b640 1 --2- 172.21.15.22:0/2128324713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9b1130 0x55f27b9aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.752+0000 7fb0edd9b640 1 -- 172.21.15.22:0/2128324713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9a4880 msgr2=0x55f27b9ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.752+0000 7fb0edd9b640 1 --2- 172.21.15.22:0/2128324713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9a4880 0x55f27b9ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.752+0000 7fb0edd9b640 1 -- 172.21.15.22:0/2128324713 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f27b9bd110 con 0x55f27b9a51a0 2024-08-20T01:39:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.752+0000 7fb0ee59c640 1 --2- 172.21.15.22:0/2128324713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9a4880 0x55f27b9ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.752+0000 7fb0edd9b640 1 --2- 172.21.15.22:0/2128324713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 0x55f27b9ae5c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4012f30 tx=0x7fb0e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b344f7539c81fdb6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.752+0000 7fb0d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:39:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.753+0000 7fb0d5ffb640 1 -- 172.21.15.22:0/2128324713 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4010cc0 con 0x55f27b9a51a0 2024-08-20T01:39:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.753+0000 7fb0f70fd740 1 -- 172.21.15.22:0/2128324713 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f27b8ba150 con 0x55f27b9a51a0 2024-08-20T01:39:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.753+0000 7fb0d5ffb640 1 -- 172.21.15.22:0/2128324713 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb0e401f480 con 0x55f27b9a51a0 2024-08-20T01:39:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.753+0000 7fb0d5ffb640 1 -- 172.21.15.22:0/2128324713 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb0e4010e60 con 0x55f27b9a51a0 2024-08-20T01:39:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.753+0000 7fb0f70fd740 10 client.16665 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.753+0000 7fb0f70fd740 1 -- 172.21.15.22:0/2128324713 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f27b9bfb20 con 0x55f27b9a51a0 2024-08-20T01:39:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.753+0000 7fb0d5ffb640 1 -- 172.21.15.22:0/2128324713 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f27b8ba150 con 0x55f27b9a51a0 2024-08-20T01:39:03.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.753+0000 7fb0d5ffb640 1 -- 172.21.15.22:0/2128324713 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fb0e4028070 con 0x55f27b9a51a0 2024-08-20T01:39:03.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.753+0000 7fb0f70fd740 10 client.16665 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:03.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.753+0000 7fb0f70fd740 10 client.16665 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:39:03.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.753+0000 7fb0f70fd740 20 client.16665 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:03.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.753+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/2128324713 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55f27b9c0fd0 0x55f27b9c3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:03.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.753+0000 7fb0f70fd740 4 client.16665 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:03.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.753+0000 7fb0f70fd740 1 -- 172.21.15.22:0/2128324713 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f27b91d880 con 0x55f27b9c0fd0 2024-08-20T01:39:03.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.754+0000 7fb0ee59c640 1 --2- 172.21.15.22:0/2128324713 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55f27b9c0fd0 0x55f27b9c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:03.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.754+0000 7fb0ee59c640 1 --2- 172.21.15.22:0/2128324713 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55f27b9c0fd0 0x55f27b9c3490 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1c09403556884e60 server_cookie=e9f4c2946055fe8b in_seq=0 out_seq=0 2024-08-20T01:39:03.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.754+0000 7fb0d5ffb640 10 client.16665 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:39:03.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.755+0000 7fb0d5ffb640 1 -- 172.21.15.22:0/2128324713 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f27b91d880 con 0x55f27b9c0fd0 2024-08-20T01:39:03.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.755+0000 7fb0d5ffb640 10 client.16665 handle_command_reply: tid=0 2024-08-20T01:39:03.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.755+0000 7fb0f70fd740 1 client.16665 shutdown 2024-08-20T01:39:03.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.755+0000 7fb0f70fd740 1 -- 172.21.15.22:0/2128324713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 msgr2=0x55f27b9ae5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:03.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.755+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/2128324713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 0x55f27b9ae5c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4012f30 tx=0x7fb0e4004730 comp rx=0 tx=0).stop 2024-08-20T01:39:03.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.755+0000 7fb0f70fd740 1 -- 172.21.15.22:0/2128324713 shutdown_connections 2024-08-20T01:39:03.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.755+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/2128324713 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55f27b9c0fd0 0x55f27b9c3490 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.755+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/2128324713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9b1130 0x55f27b9aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.755+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/2128324713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 0x55f27b9ae5c0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.755+0000 7fb0d5ffb640 0 client.16665 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:39:03.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.755+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/2128324713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9a4880 0x55f27b9ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.755+0000 7fb0f70fd740 1 -- 172.21.15.22:0/2128324713 >> 172.21.15.22:0/2128324713 conn(0x55f27b9a26b0 msgr2=0x55f27b9a8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:03.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.755+0000 7fb0f70fd740 1 -- 172.21.15.22:0/2128324713 shutdown_connections 2024-08-20T01:39:03.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.755+0000 7fb0f70fd740 1 -- 172.21.15.22:0/2128324713 wait complete. 2024-08-20T01:39:03.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.755+0000 7fb0f70fd740 20 client.16665 trim_cache size 0 max 16384 2024-08-20T01:39:03.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.768+0000 7fb0f70fd740 1 Processor -- start 2024-08-20T01:39:03.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.768+0000 7fb0f70fd740 1 -- start start 2024-08-20T01:39:03.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.768+0000 7fb0f70fd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9a4880 0x55f27b9ad930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:03.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.768+0000 7fb0f70fd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 0x55f27b99d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:03.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.768+0000 7fb0f70fd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9b1130 0x55f27b9b9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:03.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.768+0000 7fb0f70fd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f01b0bc0 con 0x55f27b9a51a0 2024-08-20T01:39:03.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.768+0000 7fb0f70fd740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f01ae3d0 con 0x55f27b9b1130 2024-08-20T01:39:03.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.768+0000 7fb0f70fd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f01ac220 con 0x55f27b9a4880 2024-08-20T01:39:03.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.768+0000 7fb0edd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 0x55f27b99d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:03.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.768+0000 7fb0edd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 0x55f27b99d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37580/0 (socket says 172.21.15.22:37580) 2024-08-20T01:39:03.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.768+0000 7fb0edd9b640 1 -- 172.21.15.22:0/4227073949 learned_addr learned my addr 172.21.15.22:0/4227073949 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:03.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.768+0000 7fb0ee59c640 1 --2- 172.21.15.22:0/4227073949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9a4880 0x55f27b9ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:03.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.769+0000 7fb0edd9b640 1 -- 172.21.15.22:0/4227073949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9a4880 msgr2=0x55f27b9ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:03.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.769+0000 7fb0edd9b640 1 --2- 172.21.15.22:0/4227073949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9a4880 0x55f27b9ad930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.769+0000 7fb0edd9b640 1 -- 172.21.15.22:0/4227073949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9b1130 msgr2=0x55f27b9b9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:03.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.769+0000 7fb0edd9b640 1 --2- 172.21.15.22:0/4227073949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9b1130 0x55f27b9b9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.769+0000 7fb0edd9b640 1 -- 172.21.15.22:0/4227073949 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f27b9a3130 con 0x55f27b9a51a0 2024-08-20T01:39:03.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.769+0000 7fb0edd9b640 1 --2- 172.21.15.22:0/4227073949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 0x55f27b99d1e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4000c00 tx=0x7fb0e400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1819daca360bf1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:03.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.769+0000 7fb0d7fff640 1 -- 172.21.15.22:0/4227073949 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4010cc0 con 0x55f27b9a51a0 2024-08-20T01:39:03.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.769+0000 7fb0d7fff640 1 -- 172.21.15.22:0/4227073949 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0e4034440 con 0x55f27b9a51a0 2024-08-20T01:39:03.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.769+0000 7fb0d7fff640 1 -- 172.21.15.22:0/4227073949 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4012ae0 con 0x55f27b9a51a0 2024-08-20T01:39:03.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.769+0000 7fb0f70fd740 1 -- 172.21.15.22:0/4227073949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 msgr2=0x55f27b99d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:03.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.769+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/4227073949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 0x55f27b99d1e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4000c00 tx=0x7fb0e400bca0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0f70fd740 1 -- 172.21.15.22:0/4227073949 shutdown_connections 2024-08-20T01:39:03.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/4227073949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9b1130 0x55f27b9b9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/4227073949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a51a0 0x55f27b99d1e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/4227073949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9a4880 0x55f27b9ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0f70fd740 1 -- 172.21.15.22:0/4227073949 >> 172.21.15.22:0/4227073949 conn(0x55f27b9a26b0 msgr2=0x55f27b9afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:03.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0f70fd740 1 -- 172.21.15.22:0/4227073949 shutdown_connections 2024-08-20T01:39:03.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0f70fd740 1 -- 172.21.15.22:0/4227073949 wait complete. 2024-08-20T01:39:03.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0f70fd740 1 -- start start 2024-08-20T01:39:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0f70fd740 1 Processor -- start 2024-08-20T01:39:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0f70fd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a4880 0x55f27b9ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0f70fd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9a51a0 0x55f27b9aba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0f70fd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9b1130 0x55f27b9c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0f70fd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f01ac890 con 0x55f27b9a4880 2024-08-20T01:39:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0f70fd740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f01add00 con 0x55f27b9b1130 2024-08-20T01:39:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0f70fd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f01acf60 con 0x55f27b9a51a0 2024-08-20T01:39:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0f70fd740 10 client.0 _ll_register_callbacks cb 0x7fb0e4012a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0ee59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a4880 0x55f27b9ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0edd9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9a51a0 0x55f27b9aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0ee59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a4880 0x55f27b9ab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37586/0 (socket says 172.21.15.22:37586) 2024-08-20T01:39:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.770+0000 7fb0ee59c640 1 -- 172.21.15.22:0/186168151 learned_addr learned my addr 172.21.15.22:0/186168151 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.771+0000 7fb0eed9d640 1 --2- 172.21.15.22:0/186168151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9b1130 0x55f27b9c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.771+0000 7fb0ee59c640 1 -- 172.21.15.22:0/186168151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9a51a0 msgr2=0x55f27b9aba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.771+0000 7fb0ee59c640 1 --2- 172.21.15.22:0/186168151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9a51a0 0x55f27b9aba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.771+0000 7fb0ee59c640 1 -- 172.21.15.22:0/186168151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9b1130 msgr2=0x55f27b9c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.771+0000 7fb0ee59c640 1 --2- 172.21.15.22:0/186168151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9b1130 0x55f27b9c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.771+0000 7fb0ee59c640 1 -- 172.21.15.22:0/186168151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f27b9c8b10 con 0x55f27b9a4880 2024-08-20T01:39:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.771+0000 7fb0edd9b640 1 --2- 172.21.15.22:0/186168151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9a51a0 0x55f27b9aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.771+0000 7fb0eed9d640 1 --2- 172.21.15.22:0/186168151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9b1130 0x55f27b9c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.771+0000 7fb0ee59c640 1 --2- 172.21.15.22:0/186168151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a4880 0x55f27b9ab4d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0005550 tx=0x7fb0e0005580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3383332f071e90b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.771+0000 7fb0d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:39:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.771+0000 7fb0d5ffb640 1 -- 172.21.15.22:0/186168151 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0035040 con 0x55f27b9a4880 2024-08-20T01:39:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.771+0000 7fb0d5ffb640 1 -- 172.21.15.22:0/186168151 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb0e0004250 con 0x55f27b9a4880 2024-08-20T01:39:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.771+0000 7fb0f70fd740 1 -- 172.21.15.22:0/186168151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0e4034440 con 0x55f27b9a4880 2024-08-20T01:39:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.771+0000 7fb0d5ffb640 1 -- 172.21.15.22:0/186168151 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb0e0061050 con 0x55f27b9a4880 2024-08-20T01:39:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.771+0000 7fb0f70fd740 10 client.16671 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.771+0000 7fb0f70fd740 1 -- 172.21.15.22:0/186168151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f27ba2f800 con 0x55f27b9a4880 2024-08-20T01:39:03.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.772+0000 7fb0d5ffb640 1 -- 172.21.15.22:0/186168151 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0e4034440 con 0x55f27b9a4880 2024-08-20T01:39:03.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.772+0000 7fb0d5ffb640 1 -- 172.21.15.22:0/186168151 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fb0e0050070 con 0x55f27b9a4880 2024-08-20T01:39:03.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.772+0000 7fb0f70fd740 10 client.16671 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:03.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.772+0000 7fb0f70fd740 10 client.16671 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:39:03.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.772+0000 7fb0f70fd740 20 client.16671 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:03.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.772+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/186168151 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55f27ba2fc50 0x55f27ba32040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:03.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.772+0000 7fb0f70fd740 4 client.16671 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:39:03.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.772+0000 7fb0f70fd740 1 -- 172.21.15.22:0/186168151 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f27b919320 con 0x55f27ba2fc50 2024-08-20T01:39:03.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.772+0000 7fb0edd9b640 1 --2- 172.21.15.22:0/186168151 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55f27ba2fc50 0x55f27ba32040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:03.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.772+0000 7fb0d5ffb640 10 client.16671 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:39:03.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.772+0000 7fb0edd9b640 1 --2- 172.21.15.22:0/186168151 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55f27ba2fc50 0x55f27ba32040 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7f96d39b0fe38892 server_cookie=9015b655c2971633 in_seq=0 out_seq=0 2024-08-20T01:39:03.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.773+0000 7fb0d5ffb640 1 -- 172.21.15.22:0/186168151 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f27b919320 con 0x55f27ba2fc50 2024-08-20T01:39:03.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.773+0000 7fb0d5ffb640 10 client.16671 handle_command_reply: tid=0 2024-08-20T01:39:03.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.773+0000 7fb0f70fd740 1 client.16671 shutdown 2024-08-20T01:39:03.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.773+0000 7fb0f70fd740 1 -- 172.21.15.22:0/186168151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a4880 msgr2=0x55f27b9ab4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:03.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.773+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/186168151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a4880 0x55f27b9ab4d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0005550 tx=0x7fb0e0005580 comp rx=0 tx=0).stop 2024-08-20T01:39:03.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.773+0000 7fb0f70fd740 1 -- 172.21.15.22:0/186168151 shutdown_connections 2024-08-20T01:39:03.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.773+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/186168151 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55f27ba2fc50 0x55f27ba32040 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.773+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/186168151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f27b9b1130 0x55f27b9c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.773+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/186168151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f27b9a51a0 0x55f27b9aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.773+0000 7fb0d5ffb640 0 client.16671 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:39:03.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.773+0000 7fb0f70fd740 1 --2- 172.21.15.22:0/186168151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f27b9a4880 0x55f27b9ab4d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.773+0000 7fb0f70fd740 1 -- 172.21.15.22:0/186168151 >> 172.21.15.22:0/186168151 conn(0x55f27b9a26b0 msgr2=0x55f27b9adff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:03.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.773+0000 7fb0f70fd740 1 -- 172.21.15.22:0/186168151 shutdown_connections 2024-08-20T01:39:03.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.773+0000 7fb0f70fd740 1 -- 172.21.15.22:0/186168151 wait complete. 2024-08-20T01:39:03.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.773+0000 7fb0f70fd740 20 client.16671 trim_cache size 0 max 16384 2024-08-20T01:39:03.781 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:39:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.774+0000 7fb0f4d04640 1 -- 172.21.15.22:0/2351778835 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb0d80b3bd0 msgr2=0x7fb0d80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.774+0000 7fb0f4d04640 1 --2- 172.21.15.22:0/2351778835 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb0d80b3bd0 0x7fb0d80b6090 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55f27b9a4830 tx=0x7fb0e400b410 comp rx=0 tx=0).stop 2024-08-20T01:39:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.774+0000 7fb0f4d04640 1 -- 172.21.15.22:0/2351778835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0f0108e60 msgr2=0x7fb0f019e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.774+0000 7fb0f4d04640 1 --2- 172.21.15.22:0/2351778835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0f0108e60 0x7fb0f019e8f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009fd0 tx=0x7fb0e800ef10 comp rx=0 tx=0).stop 2024-08-20T01:39:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.774+0000 7fb0f4d04640 1 -- 172.21.15.22:0/2351778835 shutdown_connections 2024-08-20T01:39:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.774+0000 7fb0f4d04640 1 --2- 172.21.15.22:0/2351778835 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb0d80b3bd0 0x7fb0d80b6090 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.774+0000 7fb0f4d04640 1 --2- 172.21.15.22:0/2351778835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0f0108e60 0x7fb0f019e8f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.774+0000 7fb0f4d04640 1 --2- 172.21.15.22:0/2351778835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f01084e0 0x7fb0f0199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.774+0000 7fb0f4d04640 1 --2- 172.21.15.22:0/2351778835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0f0102ad0 0x7fb0f0199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.774+0000 7fb0f4d04640 1 -- 172.21.15.22:0/2351778835 >> 172.21.15.22:0/2351778835 conn(0x7fb0f00fe540 msgr2=0x7fb0f0100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.774+0000 7fb0f4d04640 1 -- 172.21.15.22:0/2351778835 shutdown_connections 2024-08-20T01:39:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:03.774+0000 7fb0f4d04640 1 -- 172.21.15.22:0/2351778835 wait complete. 2024-08-20T01:39:04.585 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:39:04.883 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:05.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:04 smithi022 ceph-mon[18709]: pgmap v584: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 1.02k op/s 2024-08-20T01:39:05.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:04 smithi134 ceph-mon[22511]: pgmap v584: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 1.02k op/s 2024-08-20T01:39:05.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:04 smithi077 ceph-mon[22251]: pgmap v584: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 1.02k op/s 2024-08-20T01:39:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.361+0000 7fb056c45640 1 -- 172.21.15.22:0/3784663769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb05010ce20 msgr2=0x7fb05010f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.361+0000 7fb056c45640 1 --2- 172.21.15.22:0/3784663769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb05010ce20 0x7fb05010f290 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb048009900 tx=0x7fb04802a410 comp rx=0 tx=0).stop 2024-08-20T01:39:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.361+0000 7fb056c45640 1 -- 172.21.15.22:0/3784663769 shutdown_connections 2024-08-20T01:39:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.361+0000 7fb056c45640 1 --2- 172.21.15.22:0/3784663769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb05010ce20 0x7fb05010f290 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.361+0000 7fb056c45640 1 --2- 172.21.15.22:0/3784663769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb050104270 0x7fb05010c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.361+0000 7fb056c45640 1 --2- 172.21.15.22:0/3784663769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb050103870 0x7fb050103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.361+0000 7fb056c45640 1 -- 172.21.15.22:0/3784663769 >> 172.21.15.22:0/3784663769 conn(0x7fb0500fd440 msgr2=0x7fb0500ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.361+0000 7fb056c45640 1 -- 172.21.15.22:0/3784663769 shutdown_connections 2024-08-20T01:39:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.361+0000 7fb056c45640 1 -- 172.21.15.22:0/3784663769 wait complete. 2024-08-20T01:39:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.362+0000 7fb056c45640 1 Processor -- start 2024-08-20T01:39:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.362+0000 7fb056c45640 1 -- start start 2024-08-20T01:39:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.362+0000 7fb056c45640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb050103870 0x7fb05019b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.362+0000 7fb056c45640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb050104270 0x7fb05019b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.362+0000 7fb056c45640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb05010ce20 0x7fb0501a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.362+0000 7fb056c45640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb0501031a0 con 0x7fb050103870 2024-08-20T01:39:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.362+0000 7fb056c45640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb050103020 con 0x7fb050104270 2024-08-20T01:39:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.362+0000 7fb056c45640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb050103320 con 0x7fb05010ce20 2024-08-20T01:39:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.362+0000 7fb0549e1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb050103870 0x7fb05019b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.362+0000 7fb0549e1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb050103870 0x7fb05019b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37606/0 (socket says 172.21.15.22:37606) 2024-08-20T01:39:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.362+0000 7fb0549e1640 1 -- 172.21.15.22:0/517616518 learned_addr learned my addr 172.21.15.22:0/517616518 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.362+0000 7fb0551e2640 1 --2- 172.21.15.22:0/517616518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb05010ce20 0x7fb0501a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.363+0000 7fb04ffff640 1 --2- 172.21.15.22:0/517616518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb050104270 0x7fb05019b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.363+0000 7fb0549e1640 1 -- 172.21.15.22:0/517616518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb05010ce20 msgr2=0x7fb0501a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.363+0000 7fb0549e1640 1 --2- 172.21.15.22:0/517616518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb05010ce20 0x7fb0501a09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.363+0000 7fb0549e1640 1 -- 172.21.15.22:0/517616518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb050104270 msgr2=0x7fb05019b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.363+0000 7fb0549e1640 1 --2- 172.21.15.22:0/517616518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb050104270 0x7fb05019b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.363+0000 7fb0549e1640 1 -- 172.21.15.22:0/517616518 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0501a11c0 con 0x7fb050103870 2024-08-20T01:39:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.363+0000 7fb0551e2640 1 --2- 172.21.15.22:0/517616518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb05010ce20 0x7fb0501a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.363+0000 7fb0549e1640 1 --2- 172.21.15.22:0/517616518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb050103870 0x7fb05019b110 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb03800e9f0 tx=0x7fb03800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.363+0000 7fb04dffb640 1 -- 172.21.15.22:0/517616518 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03800cd80 con 0x7fb050103870 2024-08-20T01:39:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.363+0000 7fb04dffb640 1 -- 172.21.15.22:0/517616518 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0380054d0 con 0x7fb050103870 2024-08-20T01:39:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.363+0000 7fb056c45640 1 -- 172.21.15.22:0/517616518 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0501a14b0 con 0x7fb050103870 2024-08-20T01:39:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.363+0000 7fb04dffb640 1 -- 172.21.15.22:0/517616518 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb038010690 con 0x7fb050103870 2024-08-20T01:39:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.363+0000 7fb056c45640 1 -- 172.21.15.22:0/517616518 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0501a7b70 con 0x7fb050103870 2024-08-20T01:39:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.366+0000 7fb04dffb640 1 -- 172.21.15.22:0/517616518 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb038004e90 con 0x7fb050103870 2024-08-20T01:39:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.366+0000 7fb05903e740 1 Processor -- start 2024-08-20T01:39:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.366+0000 7fb05903e740 1 -- start start 2024-08-20T01:39:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.366+0000 7fb05903e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5d1880 0x564cad5d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.366+0000 7fb05903e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 0x564cad5ddbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.366+0000 7fb05903e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5de130 0x564cad5e0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.366+0000 7fb05903e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564cad548930 con 0x564cad5d21a0 2024-08-20T01:39:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.366+0000 7fb05903e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564cad537e30 con 0x564cad5de130 2024-08-20T01:39:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.366+0000 7fb05903e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564cad53be70 con 0x564cad5d1880 2024-08-20T01:39:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.367+0000 7fb0549e1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 0x564cad5ddbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.367+0000 7fb0551e2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5d1880 0x564cad5d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.367+0000 7fb0549e1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 0x564cad5ddbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37622/0 (socket says 172.21.15.22:37622) 2024-08-20T01:39:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.367+0000 7fb0549e1640 1 -- 172.21.15.22:0/1619075338 learned_addr learned my addr 172.21.15.22:0/1619075338 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.367+0000 7fb04ffff640 1 --2- 172.21.15.22:0/1619075338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5de130 0x564cad5e0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.367+0000 7fb04dffb640 1 --2- 172.21.15.22:0/517616518 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb03c0b3bd0 0x7fb03c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.367+0000 7fb0549e1640 1 -- 172.21.15.22:0/1619075338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5d1880 msgr2=0x564cad5d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.367+0000 7fb0549e1640 1 --2- 172.21.15.22:0/1619075338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5d1880 0x564cad5d1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.367+0000 7fb0549e1640 1 -- 172.21.15.22:0/1619075338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5de130 msgr2=0x564cad5e0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.367+0000 7fb0549e1640 1 --2- 172.21.15.22:0/1619075338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5de130 0x564cad5e0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.367+0000 7fb0549e1640 1 -- 172.21.15.22:0/1619075338 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cad297650 con 0x564cad5d21a0 2024-08-20T01:39:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.367+0000 7fb0551e2640 1 --2- 172.21.15.22:0/517616518 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb03c0b3bd0 0x7fb03c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.367+0000 7fb04dffb640 1 -- 172.21.15.22:0/517616518 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb0380e4010 con 0x7fb050103870 2024-08-20T01:39:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.367+0000 7fb0549e1640 1 --2- 172.21.15.22:0/1619075338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 0x564cad5ddbf0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb0380d6f20 tx=0x7fb0380dac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d43cb14c6b246f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.368+0000 7fb046ffd640 1 -- 172.21.15.22:0/1619075338 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0380aacf0 con 0x564cad5d21a0 2024-08-20T01:39:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.368+0000 7fb046ffd640 1 -- 172.21.15.22:0/1619075338 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0380aaa30 con 0x564cad5d21a0 2024-08-20T01:39:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.368+0000 7fb046ffd640 1 -- 172.21.15.22:0/1619075338 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb038005180 con 0x564cad5d21a0 2024-08-20T01:39:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.368+0000 7fb05903e740 1 -- 172.21.15.22:0/1619075338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 msgr2=0x564cad5ddbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.368+0000 7fb05903e740 1 --2- 172.21.15.22:0/1619075338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 0x564cad5ddbf0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb0380d6f20 tx=0x7fb0380dac00 comp rx=0 tx=0).stop 2024-08-20T01:39:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.368+0000 7fb0551e2640 1 --2- 172.21.15.22:0/517616518 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb03c0b3bd0 0x7fb03c0b6090 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb048006010 tx=0x7fb048009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.368+0000 7fb05903e740 1 -- 172.21.15.22:0/1619075338 shutdown_connections 2024-08-20T01:39:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.368+0000 7fb05903e740 1 --2- 172.21.15.22:0/1619075338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5de130 0x564cad5e0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.368+0000 7fb05903e740 1 --2- 172.21.15.22:0/1619075338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 0x564cad5ddbf0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.368+0000 7fb05903e740 1 --2- 172.21.15.22:0/1619075338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5d1880 0x564cad5d1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.368+0000 7fb05903e740 1 -- 172.21.15.22:0/1619075338 >> 172.21.15.22:0/1619075338 conn(0x564cad5cf6b0 msgr2=0x564cad5d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.368+0000 7fb05903e740 1 -- 172.21.15.22:0/1619075338 shutdown_connections 2024-08-20T01:39:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.368+0000 7fb05903e740 1 -- 172.21.15.22:0/1619075338 wait complete. 2024-08-20T01:39:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.369+0000 7fb05903e740 1 -- start start 2024-08-20T01:39:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.369+0000 7fb05903e740 1 Processor -- start 2024-08-20T01:39:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.369+0000 7fb05903e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5d1880 0x564cad5ddb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.369+0000 7fb05903e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 0x564cad5dafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.369+0000 7fb05903e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5de130 0x564cad5db770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.369+0000 7fb05903e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564cad39a700 con 0x564cad5d21a0 2024-08-20T01:39:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.369+0000 7fb05903e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564cad4be810 con 0x564cad5de130 2024-08-20T01:39:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.369+0000 7fb05903e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564cad5e0d80 con 0x564cad5d1880 2024-08-20T01:39:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.370+0000 7fb05903e740 10 client.0 _ll_register_callbacks cb 0x564cad531700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.370+0000 7fb04ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 0x564cad5dafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.370+0000 7fb04ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 0x564cad5dafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37634/0 (socket says 172.21.15.22:37634) 2024-08-20T01:39:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.370+0000 7fb04ffff640 1 -- 172.21.15.22:0/1823316306 learned_addr learned my addr 172.21.15.22:0/1823316306 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.370+0000 7fb0549e1640 1 --2- 172.21.15.22:0/1823316306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5d1880 0x564cad5ddb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.370+0000 7fb0551e2640 1 --2- 172.21.15.22:0/1823316306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5de130 0x564cad5db770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.370+0000 7fb04ffff640 1 -- 172.21.15.22:0/1823316306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5d1880 msgr2=0x564cad5ddb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.370+0000 7fb04ffff640 1 --2- 172.21.15.22:0/1823316306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5d1880 0x564cad5ddb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.370+0000 7fb04ffff640 1 -- 172.21.15.22:0/1823316306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5de130 msgr2=0x564cad5db770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.370+0000 7fb04ffff640 1 --2- 172.21.15.22:0/1823316306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5de130 0x564cad5db770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.370+0000 7fb04ffff640 1 -- 172.21.15.22:0/1823316306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cad5ea0e0 con 0x564cad5d21a0 2024-08-20T01:39:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.370+0000 7fb04ffff640 1 --2- 172.21.15.22:0/1823316306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 0x564cad5dafe0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb040004040 tx=0x7fb040004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab8b454bdabfca2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.370+0000 7fb02ffff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:39:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.370+0000 7fb02ffff640 1 -- 172.21.15.22:0/1823316306 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040004d20 con 0x564cad5d21a0 2024-08-20T01:39:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.370+0000 7fb02ffff640 1 -- 172.21.15.22:0/1823316306 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb0400139a0 con 0x564cad5d21a0 2024-08-20T01:39:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.370+0000 7fb05903e740 1 -- 172.21.15.22:0/1823316306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564cad4e7150 con 0x564cad5d21a0 2024-08-20T01:39:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.371+0000 7fb02ffff640 1 -- 172.21.15.22:0/1823316306 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb040013ba0 con 0x564cad5d21a0 2024-08-20T01:39:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.371+0000 7fb05903e740 10 client.16683 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.371+0000 7fb05903e740 1 -- 172.21.15.22:0/1823316306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564cad5ecaa0 con 0x564cad5d21a0 2024-08-20T01:39:05.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.371+0000 7fb02ffff640 1 -- 172.21.15.22:0/1823316306 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564cad4e7150 con 0x564cad5d21a0 2024-08-20T01:39:05.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.371+0000 7fb02ffff640 1 -- 172.21.15.22:0/1823316306 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fb04001a030 con 0x564cad5d21a0 2024-08-20T01:39:05.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.371+0000 7fb05903e740 10 client.16683 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:05.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.371+0000 7fb05903e740 10 client.16683 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:05.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.371+0000 7fb05903e740 20 client.16683 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:05.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.371+0000 7fb05903e740 1 --2- 172.21.15.22:0/1823316306 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564cad5edfd0 0x564cad5f0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.371+0000 7fb05903e740 4 client.16683 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:05.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.371+0000 7fb05903e740 1 -- 172.21.15.22:0/1823316306 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564cad54a880 con 0x564cad5edfd0 2024-08-20T01:39:05.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.371+0000 7fb0549e1640 1 --2- 172.21.15.22:0/1823316306 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564cad5edfd0 0x564cad5f0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.372+0000 7fb0549e1640 1 --2- 172.21.15.22:0/1823316306 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564cad5edfd0 0x564cad5f0410 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6578b40719054f5a server_cookie=c8b9e8f5a7f655d9 in_seq=0 out_seq=0 2024-08-20T01:39:05.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.372+0000 7fb02ffff640 10 client.16683 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:05.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.373+0000 7fb02ffff640 1 -- 172.21.15.22:0/1823316306 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564cad54a880 con 0x564cad5edfd0 2024-08-20T01:39:05.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.373+0000 7fb02ffff640 10 client.16683 handle_command_reply: tid=0 2024-08-20T01:39:05.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.373+0000 7fb05903e740 1 client.16683 shutdown 2024-08-20T01:39:05.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.373+0000 7fb05903e740 1 -- 172.21.15.22:0/1823316306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 msgr2=0x564cad5dafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:05.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.373+0000 7fb05903e740 1 --2- 172.21.15.22:0/1823316306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 0x564cad5dafe0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb040004040 tx=0x7fb040004500 comp rx=0 tx=0).stop 2024-08-20T01:39:05.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.373+0000 7fb05903e740 1 -- 172.21.15.22:0/1823316306 shutdown_connections 2024-08-20T01:39:05.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.373+0000 7fb05903e740 1 --2- 172.21.15.22:0/1823316306 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564cad5edfd0 0x564cad5f0410 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.373+0000 7fb05903e740 1 --2- 172.21.15.22:0/1823316306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5de130 0x564cad5db770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.373+0000 7fb02ffff640 0 client.16683 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:05.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.373+0000 7fb05903e740 1 --2- 172.21.15.22:0/1823316306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 0x564cad5dafe0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.373+0000 7fb05903e740 1 --2- 172.21.15.22:0/1823316306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5d1880 0x564cad5ddb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.373+0000 7fb05903e740 1 -- 172.21.15.22:0/1823316306 >> 172.21.15.22:0/1823316306 conn(0x564cad5cf6b0 msgr2=0x564cad5d5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:05.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.374+0000 7fb05903e740 1 -- 172.21.15.22:0/1823316306 shutdown_connections 2024-08-20T01:39:05.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.374+0000 7fb05903e740 1 -- 172.21.15.22:0/1823316306 wait complete. 2024-08-20T01:39:05.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.374+0000 7fb05903e740 20 client.16683 trim_cache size 0 max 16384 2024-08-20T01:39:05.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.387+0000 7fb05903e740 1 Processor -- start 2024-08-20T01:39:05.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.387+0000 7fb05903e740 1 -- start start 2024-08-20T01:39:05.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.387+0000 7fb05903e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d1880 0x564cad5dcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.387+0000 7fb05903e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5d21a0 0x564cad5da870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.387+0000 7fb05903e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5de130 0x564cad5dadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.387+0000 7fb05903e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb0501b2cc0 con 0x564cad5d1880 2024-08-20T01:39:05.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.387+0000 7fb05903e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0501b04d0 con 0x564cad5d21a0 2024-08-20T01:39:05.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.387+0000 7fb05903e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb0501ae320 con 0x564cad5de130 2024-08-20T01:39:05.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.387+0000 7fb0549e1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d1880 0x564cad5dcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.387+0000 7fb0549e1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d1880 0x564cad5dcd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37646/0 (socket says 172.21.15.22:37646) 2024-08-20T01:39:05.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.387+0000 7fb0549e1640 1 -- 172.21.15.22:0/1174521629 learned_addr learned my addr 172.21.15.22:0/1174521629 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:05.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.387+0000 7fb0551e2640 1 --2- 172.21.15.22:0/1174521629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5de130 0x564cad5dadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.387+0000 7fb04ffff640 1 --2- 172.21.15.22:0/1174521629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5d21a0 0x564cad5da870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.387+0000 7fb0549e1640 1 -- 172.21.15.22:0/1174521629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5de130 msgr2=0x564cad5dadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:05.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.387+0000 7fb0549e1640 1 --2- 172.21.15.22:0/1174521629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5de130 0x564cad5dadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.387+0000 7fb0549e1640 1 -- 172.21.15.22:0/1174521629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5d21a0 msgr2=0x564cad5da870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:05.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.387+0000 7fb0549e1640 1 --2- 172.21.15.22:0/1174521629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5d21a0 0x564cad5da870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.387+0000 7fb0549e1640 1 -- 172.21.15.22:0/1174521629 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cad5d0130 con 0x564cad5d1880 2024-08-20T01:39:05.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.387+0000 7fb04ffff640 1 --2- 172.21.15.22:0/1174521629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5d21a0 0x564cad5da870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:05.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.388+0000 7fb0549e1640 1 --2- 172.21.15.22:0/1174521629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d1880 0x564cad5dcd20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb0380e1b20 tx=0x7fb038009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280d94e5871f2739 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:05.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.388+0000 7fb0467fc640 1 -- 172.21.15.22:0/1174521629 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0380da070 con 0x564cad5d1880 2024-08-20T01:39:05.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.388+0000 7fb0467fc640 1 -- 172.21.15.22:0/1174521629 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0380aaa30 con 0x564cad5d1880 2024-08-20T01:39:05.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.388+0000 7fb0467fc640 1 -- 172.21.15.22:0/1174521629 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0380ab180 con 0x564cad5d1880 2024-08-20T01:39:05.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.388+0000 7fb05903e740 1 -- 172.21.15.22:0/1174521629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d1880 msgr2=0x564cad5dcd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:05.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.388+0000 7fb05903e740 1 --2- 172.21.15.22:0/1174521629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d1880 0x564cad5dcd20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb0380e1b20 tx=0x7fb038009310 comp rx=0 tx=0).stop 2024-08-20T01:39:05.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.388+0000 7fb05903e740 1 -- 172.21.15.22:0/1174521629 shutdown_connections 2024-08-20T01:39:05.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.388+0000 7fb05903e740 1 --2- 172.21.15.22:0/1174521629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5de130 0x564cad5dadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.388+0000 7fb05903e740 1 --2- 172.21.15.22:0/1174521629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5d21a0 0x564cad5da870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.388+0000 7fb05903e740 1 --2- 172.21.15.22:0/1174521629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d1880 0x564cad5dcd20 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.388+0000 7fb05903e740 1 -- 172.21.15.22:0/1174521629 >> 172.21.15.22:0/1174521629 conn(0x564cad5cf6b0 msgr2=0x564cad5dc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:05.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.389+0000 7fb05903e740 1 -- 172.21.15.22:0/1174521629 shutdown_connections 2024-08-20T01:39:05.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.389+0000 7fb05903e740 1 -- 172.21.15.22:0/1174521629 wait complete. 2024-08-20T01:39:05.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.389+0000 7fb05903e740 1 -- start start 2024-08-20T01:39:05.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.389+0000 7fb05903e740 1 Processor -- start 2024-08-20T01:39:05.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.389+0000 7fb05903e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5d1880 0x564cad5e17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.389+0000 7fb05903e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 0x564cad5e1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.389+0000 7fb05903e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5de130 0x564cad656ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.389+0000 7fb05903e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb0501ae990 con 0x564cad5d21a0 2024-08-20T01:39:05.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.389+0000 7fb05903e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0501afe00 con 0x564cad5d1880 2024-08-20T01:39:05.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.389+0000 7fb05903e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb0501af060 con 0x564cad5de130 2024-08-20T01:39:05.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.389+0000 7fb05903e740 10 client.0 _ll_register_callbacks cb 0x7fb040009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:05.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.389+0000 7fb04ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 0x564cad5e1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.390+0000 7fb04ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 0x564cad5e1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37658/0 (socket says 172.21.15.22:37658) 2024-08-20T01:39:05.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.390+0000 7fb04ffff640 1 -- 172.21.15.22:0/798753010 learned_addr learned my addr 172.21.15.22:0/798753010 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:05.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.390+0000 7fb0551e2640 1 --2- 172.21.15.22:0/798753010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5de130 0x564cad656ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.390+0000 7fb0549e1640 1 --2- 172.21.15.22:0/798753010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5d1880 0x564cad5e17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.390+0000 7fb04ffff640 1 -- 172.21.15.22:0/798753010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5de130 msgr2=0x564cad656ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:05.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.390+0000 7fb04ffff640 1 --2- 172.21.15.22:0/798753010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5de130 0x564cad656ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.390+0000 7fb04ffff640 1 -- 172.21.15.22:0/798753010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5d1880 msgr2=0x564cad5e17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:05.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.390+0000 7fb04ffff640 1 --2- 172.21.15.22:0/798753010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5d1880 0x564cad5e17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.390+0000 7fb04ffff640 1 -- 172.21.15.22:0/798753010 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cad657390 con 0x564cad5d21a0 2024-08-20T01:39:05.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.390+0000 7fb0549e1640 1 --2- 172.21.15.22:0/798753010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5d1880 0x564cad5e17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:39:05.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.390+0000 7fb04ffff640 1 --2- 172.21.15.22:0/798753010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 0x564cad5e1d50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb040000f80 tx=0x7fb040003d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b8878f00b7aefe server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:05.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.390+0000 7fb02ffff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:39:05.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.390+0000 7fb02ffff640 1 -- 172.21.15.22:0/798753010 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040013030 con 0x564cad5d21a0 2024-08-20T01:39:05.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.390+0000 7fb02ffff640 1 -- 172.21.15.22:0/798753010 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb0400131d0 con 0x564cad5d21a0 2024-08-20T01:39:05.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.390+0000 7fb05903e740 1 -- 172.21.15.22:0/798753010 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0380aaa30 con 0x564cad5d21a0 2024-08-20T01:39:05.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.390+0000 7fb02ffff640 1 -- 172.21.15.22:0/798753010 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb0400133d0 con 0x564cad5d21a0 2024-08-20T01:39:05.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.390+0000 7fb05903e740 10 client.16689 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:05.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.390+0000 7fb05903e740 1 -- 172.21.15.22:0/798753010 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564cad658690 con 0x564cad5d21a0 2024-08-20T01:39:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.391+0000 7fb02ffff640 1 -- 172.21.15.22:0/798753010 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0380aaa30 con 0x564cad5d21a0 2024-08-20T01:39:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.391+0000 7fb02ffff640 1 -- 172.21.15.22:0/798753010 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fb04001a040 con 0x564cad5d21a0 2024-08-20T01:39:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.391+0000 7fb05903e740 10 client.16689 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.391+0000 7fb05903e740 10 client.16689 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.391+0000 7fb05903e740 20 client.16689 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.391+0000 7fb05903e740 1 --2- 172.21.15.22:0/798753010 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564cad658e70 0x564cad65b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.391+0000 7fb05903e740 4 client.16689 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:39:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.391+0000 7fb05903e740 1 -- 172.21.15.22:0/798753010 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564cad546320 con 0x564cad658e70 2024-08-20T01:39:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.391+0000 7fb0549e1640 1 --2- 172.21.15.22:0/798753010 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564cad658e70 0x564cad65b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.391+0000 7fb02ffff640 10 client.16689 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.391+0000 7fb0549e1640 1 --2- 172.21.15.22:0/798753010 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564cad658e70 0x564cad65b290 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2973e89c4bc1a65 server_cookie=a0dbc1e7f3c2359b in_seq=0 out_seq=0 2024-08-20T01:39:05.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.393+0000 7fb02ffff640 1 -- 172.21.15.22:0/798753010 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564cad546320 con 0x564cad658e70 2024-08-20T01:39:05.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.393+0000 7fb02ffff640 10 client.16689 handle_command_reply: tid=0 2024-08-20T01:39:05.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.393+0000 7fb05903e740 1 client.16689 shutdown 2024-08-20T01:39:05.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.393+0000 7fb05903e740 1 -- 172.21.15.22:0/798753010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 msgr2=0x564cad5e1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:05.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.393+0000 7fb05903e740 1 --2- 172.21.15.22:0/798753010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 0x564cad5e1d50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb040000f80 tx=0x7fb040003d10 comp rx=0 tx=0).stop 2024-08-20T01:39:05.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.393+0000 7fb05903e740 1 -- 172.21.15.22:0/798753010 shutdown_connections 2024-08-20T01:39:05.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.393+0000 7fb05903e740 1 --2- 172.21.15.22:0/798753010 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x564cad658e70 0x564cad65b290 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.393+0000 7fb05903e740 1 --2- 172.21.15.22:0/798753010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564cad5de130 0x564cad656ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.393+0000 7fb05903e740 1 --2- 172.21.15.22:0/798753010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564cad5d21a0 0x564cad5e1d50 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.393+0000 7fb05903e740 1 --2- 172.21.15.22:0/798753010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564cad5d1880 0x564cad5e17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.393+0000 7fb05903e740 1 -- 172.21.15.22:0/798753010 >> 172.21.15.22:0/798753010 conn(0x564cad5cf6b0 msgr2=0x564cad5dce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:05.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.393+0000 7fb02ffff640 0 client.16689 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:05.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.393+0000 7fb05903e740 1 -- 172.21.15.22:0/798753010 shutdown_connections 2024-08-20T01:39:05.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.393+0000 7fb05903e740 1 -- 172.21.15.22:0/798753010 wait complete. 2024-08-20T01:39:05.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.393+0000 7fb05903e740 20 client.16689 trim_cache size 0 max 16384 2024-08-20T01:39:05.402 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:39:05.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.394+0000 7fb056c45640 1 -- 172.21.15.22:0/517616518 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb03c0b3bd0 msgr2=0x7fb03c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:05.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.394+0000 7fb056c45640 1 --2- 172.21.15.22:0/517616518 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb03c0b3bd0 0x7fb03c0b6090 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb048006010 tx=0x7fb048009260 comp rx=0 tx=0).stop 2024-08-20T01:39:05.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.394+0000 7fb056c45640 1 -- 172.21.15.22:0/517616518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb050103870 msgr2=0x7fb05019b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:05.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.394+0000 7fb056c45640 1 --2- 172.21.15.22:0/517616518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb050103870 0x7fb05019b110 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb03800e9f0 tx=0x7fb03800edf0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.394+0000 7fb056c45640 1 -- 172.21.15.22:0/517616518 shutdown_connections 2024-08-20T01:39:05.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.394+0000 7fb056c45640 1 --2- 172.21.15.22:0/517616518 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb03c0b3bd0 0x7fb03c0b6090 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.394+0000 7fb056c45640 1 --2- 172.21.15.22:0/517616518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb05010ce20 0x7fb0501a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.394+0000 7fb056c45640 1 --2- 172.21.15.22:0/517616518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb050104270 0x7fb05019b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.394+0000 7fb056c45640 1 --2- 172.21.15.22:0/517616518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb050103870 0x7fb05019b110 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.394+0000 7fb056c45640 1 -- 172.21.15.22:0/517616518 >> 172.21.15.22:0/517616518 conn(0x7fb0500fd440 msgr2=0x7fb0500fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:05.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.394+0000 7fb056c45640 1 -- 172.21.15.22:0/517616518 shutdown_connections 2024-08-20T01:39:05.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:05.394+0000 7fb056c45640 1 -- 172.21.15.22:0/517616518 wait complete. 2024-08-20T01:39:07.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:06 smithi134 ceph-mon[22511]: pgmap v585: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 991 op/s 2024-08-20T01:39:07.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:06 smithi077 ceph-mon[22251]: pgmap v585: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 991 op/s 2024-08-20T01:39:07.115 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:39:07.115 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:39:07.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:06 smithi022 ceph-mon[18709]: pgmap v585: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 991 op/s 2024-08-20T01:39:07.392 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:07.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.886+0000 7f408ea8b640 1 -- 172.21.15.22:0/1959084783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4088108e60 msgr2=0x7f408810f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:07.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.886+0000 7f408ea8b640 1 --2- 172.21.15.22:0/1959084783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4088108e60 0x7f408810f660 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f4080009ca0 tx=0x7f408002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.886+0000 7f408ea8b640 1 -- 172.21.15.22:0/1959084783 shutdown_connections 2024-08-20T01:39:07.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.886+0000 7f408ea8b640 1 --2- 172.21.15.22:0/1959084783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4088108e60 0x7f408810f660 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.886+0000 7f408ea8b640 1 --2- 172.21.15.22:0/1959084783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40881084e0 0x7f4088108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.886+0000 7f408ea8b640 1 --2- 172.21.15.22:0/1959084783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4088102ad0 0x7f4088102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.886+0000 7f408ea8b640 1 -- 172.21.15.22:0/1959084783 >> 172.21.15.22:0/1959084783 conn(0x7f40880fe540 msgr2=0x7f4088100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:07.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.886+0000 7f408ea8b640 1 -- 172.21.15.22:0/1959084783 shutdown_connections 2024-08-20T01:39:07.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.887+0000 7f408ea8b640 1 -- 172.21.15.22:0/1959084783 wait complete. 2024-08-20T01:39:07.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.887+0000 7f408ea8b640 1 Processor -- start 2024-08-20T01:39:07.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.887+0000 7f408ea8b640 1 -- start start 2024-08-20T01:39:07.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.887+0000 7f408ea8b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4088102ad0 0x7f4088198f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.887+0000 7f408ea8b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40881084e0 0x7f40881994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.887+0000 7f408ea8b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4088108e60 0x7f408819e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.887+0000 7f408ea8b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4088112b70 con 0x7f4088108e60 2024-08-20T01:39:07.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.887+0000 7f408ea8b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f40881129f0 con 0x7f4088102ad0 2024-08-20T01:39:07.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.887+0000 7f408ea8b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4088112cf0 con 0x7f40881084e0 2024-08-20T01:39:07.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.888+0000 7f408d028640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4088108e60 0x7f408819e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.888+0000 7f408d028640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4088108e60 0x7f408819e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37676/0 (socket says 172.21.15.22:37676) 2024-08-20T01:39:07.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.888+0000 7f408d028640 1 -- 172.21.15.22:0/2383811080 learned_addr learned my addr 172.21.15.22:0/2383811080 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:07.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.888+0000 7f4087fff640 1 --2- 172.21.15.22:0/2383811080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40881084e0 0x7f40881994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.888+0000 7f408c827640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4088102ad0 0x7f4088198f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.888+0000 7f408d028640 1 -- 172.21.15.22:0/2383811080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40881084e0 msgr2=0x7f40881994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:07.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.888+0000 7f408d028640 1 --2- 172.21.15.22:0/2383811080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40881084e0 0x7f40881994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.888+0000 7f408d028640 1 -- 172.21.15.22:0/2383811080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4088102ad0 msgr2=0x7f4088198f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:07.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.888+0000 7f408d028640 1 --2- 172.21.15.22:0/2383811080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4088102ad0 0x7f4088198f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.888+0000 7f408d028640 1 -- 172.21.15.22:0/2383811080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408819f010 con 0x7f4088108e60 2024-08-20T01:39:07.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.888+0000 7f408d028640 1 --2- 172.21.15.22:0/2383811080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4088108e60 0x7f408819e840 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f408002f540 tx=0x7f40800316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:07.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.888+0000 7f4085ffb640 1 -- 172.21.15.22:0/2383811080 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080003b70 con 0x7f4088108e60 2024-08-20T01:39:07.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.888+0000 7f408ea8b640 1 -- 172.21.15.22:0/2383811080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f408819f2a0 con 0x7f4088108e60 2024-08-20T01:39:07.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.888+0000 7f4085ffb640 1 -- 172.21.15.22:0/2383811080 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4080003d10 con 0x7f4088108e60 2024-08-20T01:39:07.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.888+0000 7f4085ffb640 1 -- 172.21.15.22:0/2383811080 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408002f990 con 0x7f4088108e60 2024-08-20T01:39:07.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.889+0000 7f408ea8b640 1 -- 172.21.15.22:0/2383811080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40881a59c0 con 0x7f4088108e60 2024-08-20T01:39:07.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.891+0000 7f4085ffb640 1 -- 172.21.15.22:0/2383811080 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f408002fb30 con 0x7f4088108e60 2024-08-20T01:39:07.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.891+0000 7f4090e84740 1 Processor -- start 2024-08-20T01:39:07.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.891+0000 7f4090e84740 1 -- start start 2024-08-20T01:39:07.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.891+0000 7f4090e84740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d5413b0 0x55a70d541790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.891+0000 7f4090e84740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d541cd0 0x55a70d54d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.891+0000 7f4090e84740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d54dc60 0x55a70d550050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.891+0000 7f4090e84740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a70d4b7940 con 0x55a70d54dc60 2024-08-20T01:39:07.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.891+0000 7f4090e84740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a70d4a6e40 con 0x55a70d541cd0 2024-08-20T01:39:07.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.891+0000 7f4090e84740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a70d4aae80 con 0x55a70d5413b0 2024-08-20T01:39:07.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.892+0000 7f4087fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d5413b0 0x55a70d541790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.892+0000 7f4087fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d5413b0 0x55a70d541790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:40826/0 (socket says 172.21.15.22:40826) 2024-08-20T01:39:07.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.892+0000 7f4087fff640 1 -- 172.21.15.22:0/2077244986 learned_addr learned my addr 172.21.15.22:0/2077244986 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:07.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.892+0000 7f4087fff640 1 --2- 172.21.15.22:0/2077244986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d54dc60 0x55a70d550050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.892+0000 7f408c827640 1 --2- 172.21.15.22:0/2077244986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d541cd0 0x55a70d54d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.892+0000 7f4087fff640 1 -- 172.21.15.22:0/2077244986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d541cd0 msgr2=0x55a70d54d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:07.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.892+0000 7f4087fff640 1 --2- 172.21.15.22:0/2077244986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d541cd0 0x55a70d54d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.892+0000 7f4087fff640 1 -- 172.21.15.22:0/2077244986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d54dc60 msgr2=0x55a70d550050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:07.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.892+0000 7f4087fff640 1 --2- 172.21.15.22:0/2077244986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d54dc60 0x55a70d550050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.892+0000 7f4087fff640 1 -- 172.21.15.22:0/2077244986 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a70d443520 con 0x55a70d5413b0 2024-08-20T01:39:07.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.892+0000 7f4085ffb640 1 --2- 172.21.15.22:0/2383811080 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f40780b3bd0 0x7f40780b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.892+0000 7f408c827640 1 --2- 172.21.15.22:0/2383811080 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f40780b3bd0 0x7f40780b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.892+0000 7f4087fff640 1 --2- 172.21.15.22:0/2077244986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d5413b0 0x55a70d541790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4074011820 tx=0x7f4074005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9a4f69873e20cc9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:07.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.892+0000 7f4085ffb640 1 -- 172.21.15.22:0/2383811080 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f4080104ff0 con 0x7f4088108e60 2024-08-20T01:39:07.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.892+0000 7f4072ffd640 1 -- 172.21.15.22:0/2077244986 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4074004030 con 0x55a70d5413b0 2024-08-20T01:39:07.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.893+0000 7f4072ffd640 1 -- 172.21.15.22:0/2077244986 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4074005020 con 0x55a70d5413b0 2024-08-20T01:39:07.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.893+0000 7f4072ffd640 1 -- 172.21.15.22:0/2077244986 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4074004d40 con 0x55a70d5413b0 2024-08-20T01:39:07.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.893+0000 7f4090e84740 1 -- 172.21.15.22:0/2077244986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d5413b0 msgr2=0x55a70d541790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:07.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.893+0000 7f408c827640 1 --2- 172.21.15.22:0/2383811080 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f40780b3bd0 0x7f40780b6090 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55a70d544530 tx=0x7f407c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:07.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.893+0000 7f4090e84740 1 --2- 172.21.15.22:0/2077244986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d5413b0 0x55a70d541790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4074011820 tx=0x7f4074005850 comp rx=0 tx=0).stop 2024-08-20T01:39:07.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.893+0000 7f4090e84740 1 -- 172.21.15.22:0/2077244986 shutdown_connections 2024-08-20T01:39:07.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.893+0000 7f4090e84740 1 --2- 172.21.15.22:0/2077244986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d54dc60 0x55a70d550050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.893+0000 7f4090e84740 1 --2- 172.21.15.22:0/2077244986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d541cd0 0x55a70d54d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.893+0000 7f4090e84740 1 --2- 172.21.15.22:0/2077244986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d5413b0 0x55a70d541790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.893+0000 7f4090e84740 1 -- 172.21.15.22:0/2077244986 >> 172.21.15.22:0/2077244986 conn(0x55a70d53f1e0 msgr2=0x55a70d540380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:07.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.893+0000 7f4090e84740 1 -- 172.21.15.22:0/2077244986 shutdown_connections 2024-08-20T01:39:07.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.893+0000 7f4090e84740 1 -- 172.21.15.22:0/2077244986 wait complete. 2024-08-20T01:39:07.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.894+0000 7f4090e84740 1 -- start start 2024-08-20T01:39:07.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.894+0000 7f4090e84740 1 Processor -- start 2024-08-20T01:39:07.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.894+0000 7f4090e84740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d5413b0 0x55a70d54ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.894+0000 7f4090e84740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d541cd0 0x55a70d54b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.894+0000 7f4090e84740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d54dc60 0x55a70d54b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.894+0000 7f4090e84740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a70d309890 con 0x55a70d541cd0 2024-08-20T01:39:07.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.894+0000 7f4090e84740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a70d42d700 con 0x55a70d5413b0 2024-08-20T01:39:07.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.894+0000 7f4090e84740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a70d5509b0 con 0x55a70d54dc60 2024-08-20T01:39:07.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.894+0000 7f4090e84740 10 client.0 _ll_register_callbacks cb 0x55a70d4a26f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:07.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.894+0000 7f4087fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d541cd0 0x55a70d54b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.894+0000 7f4087fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d541cd0 0x55a70d54b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37682/0 (socket says 172.21.15.22:37682) 2024-08-20T01:39:07.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.894+0000 7f4087fff640 1 -- 172.21.15.22:0/791334978 learned_addr learned my addr 172.21.15.22:0/791334978 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:07.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.894+0000 7f408d028640 1 --2- 172.21.15.22:0/791334978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d54dc60 0x55a70d54b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.894+0000 7f408c827640 1 --2- 172.21.15.22:0/791334978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d5413b0 0x55a70d54ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.895+0000 7f408d028640 1 -- 172.21.15.22:0/791334978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d5413b0 msgr2=0x55a70d54ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:07.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.895+0000 7f408d028640 1 --2- 172.21.15.22:0/791334978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d5413b0 0x55a70d54ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.895+0000 7f408d028640 1 -- 172.21.15.22:0/791334978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d541cd0 msgr2=0x55a70d54b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:07.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.895+0000 7f408d028640 1 --2- 172.21.15.22:0/791334978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d541cd0 0x55a70d54b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.895+0000 7f408d028640 1 -- 172.21.15.22:0/791334978 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a70d206930 con 0x55a70d54dc60 2024-08-20T01:39:07.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.895+0000 7f4087fff640 1 --2- 172.21.15.22:0/791334978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d541cd0 0x55a70d54b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:07.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.895+0000 7f408d028640 1 --2- 172.21.15.22:0/791334978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d54dc60 0x55a70d54b6e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4080102e20 tx=0x7f40800cb730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a2463a5ad831c74 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:07.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.895+0000 7f4067fff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:39:07.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.895+0000 7f4067fff640 1 -- 172.21.15.22:0/791334978 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40800d0500 con 0x55a70d54dc60 2024-08-20T01:39:07.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.895+0000 7f4067fff640 1 -- 172.21.15.22:0/791334978 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f40800c8190 con 0x55a70d54dc60 2024-08-20T01:39:07.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.895+0000 7f4090e84740 1 -- 172.21.15.22:0/791334978 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4074005020 con 0x55a70d54dc60 2024-08-20T01:39:07.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.895+0000 7f4067fff640 1 -- 172.21.15.22:0/791334978 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f40800d4fb0 con 0x55a70d54dc60 2024-08-20T01:39:07.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.895+0000 7f4090e84740 10 client.26356 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:07.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.895+0000 7f4090e84740 1 -- 172.21.15.22:0/791334978 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a70d55c5d0 con 0x55a70d54dc60 2024-08-20T01:39:07.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.895+0000 7f4067fff640 1 -- 172.21.15.22:0/791334978 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4074005020 con 0x55a70d54dc60 2024-08-20T01:39:07.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.896+0000 7f4067fff640 1 -- 172.21.15.22:0/791334978 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f40800d4b20 con 0x55a70d54dc60 2024-08-20T01:39:07.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.896+0000 7f4090e84740 10 client.26356 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:07.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.896+0000 7f4090e84740 10 client.26356 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:07.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.896+0000 7f4090e84740 20 client.26356 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.896+0000 7f4090e84740 1 --2- 172.21.15.22:0/791334978 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a70d55da80 0x55a70d55fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.896+0000 7f4090e84740 4 client.26356 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.896+0000 7f4090e84740 1 -- 172.21.15.22:0/791334978 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a70d4b9890 con 0x55a70d55da80 2024-08-20T01:39:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.896+0000 7f408c827640 1 --2- 172.21.15.22:0/791334978 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a70d55da80 0x55a70d55fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.896+0000 7f408c827640 1 --2- 172.21.15.22:0/791334978 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a70d55da80 0x55a70d55fea0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=360506612fb87765 server_cookie=a975bf733d03eb41 in_seq=0 out_seq=0 2024-08-20T01:39:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.896+0000 7f4067fff640 10 client.26356 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.897+0000 7f4067fff640 1 -- 172.21.15.22:0/791334978 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a70d4b9890 con 0x55a70d55da80 2024-08-20T01:39:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.897+0000 7f4067fff640 10 client.26356 handle_command_reply: tid=0 2024-08-20T01:39:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.897+0000 7f4090e84740 1 client.26356 shutdown 2024-08-20T01:39:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.897+0000 7f4090e84740 1 -- 172.21.15.22:0/791334978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d54dc60 msgr2=0x55a70d54b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.897+0000 7f4090e84740 1 --2- 172.21.15.22:0/791334978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d54dc60 0x55a70d54b6e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4080102e20 tx=0x7f40800cb730 comp rx=0 tx=0).stop 2024-08-20T01:39:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.897+0000 7f4090e84740 1 -- 172.21.15.22:0/791334978 shutdown_connections 2024-08-20T01:39:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.897+0000 7f4090e84740 1 --2- 172.21.15.22:0/791334978 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a70d55da80 0x55a70d55fea0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.897+0000 7f4090e84740 1 --2- 172.21.15.22:0/791334978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d54dc60 0x55a70d54b6e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.897+0000 7f4090e84740 1 --2- 172.21.15.22:0/791334978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d541cd0 0x55a70d54b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.897+0000 7f4090e84740 1 --2- 172.21.15.22:0/791334978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d5413b0 0x55a70d54ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.897+0000 7f4067fff640 0 client.26356 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:07.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.897+0000 7f4090e84740 1 -- 172.21.15.22:0/791334978 >> 172.21.15.22:0/791334978 conn(0x55a70d53f1e0 msgr2=0x55a70d544d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:07.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.897+0000 7f4090e84740 1 -- 172.21.15.22:0/791334978 shutdown_connections 2024-08-20T01:39:07.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.898+0000 7f4090e84740 1 -- 172.21.15.22:0/791334978 wait complete. 2024-08-20T01:39:07.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.898+0000 7f4090e84740 20 client.26356 trim_cache size 0 max 16384 2024-08-20T01:39:07.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.915+0000 7f4090e84740 1 Processor -- start 2024-08-20T01:39:07.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.915+0000 7f4090e84740 1 -- start start 2024-08-20T01:39:07.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.916+0000 7f4090e84740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d5413b0 0x55a70d54c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.916+0000 7f4090e84740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d541cd0 0x55a70d565790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.916+0000 7f4090e84740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d54dc60 0x55a70d565cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.916+0000 7f4090e84740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f40881b09b0 con 0x55a70d54dc60 2024-08-20T01:39:07.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.916+0000 7f4090e84740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f40881ae1c0 con 0x55a70d541cd0 2024-08-20T01:39:07.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.916+0000 7f4090e84740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f40881ac010 con 0x55a70d5413b0 2024-08-20T01:39:07.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.916+0000 7f408d028640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d54dc60 0x55a70d565cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.916+0000 7f408d028640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d54dc60 0x55a70d565cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37688/0 (socket says 172.21.15.22:37688) 2024-08-20T01:39:07.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.916+0000 7f408d028640 1 -- 172.21.15.22:0/4086416572 learned_addr learned my addr 172.21.15.22:0/4086416572 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:07.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.916+0000 7f408c827640 1 --2- 172.21.15.22:0/4086416572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d5413b0 0x55a70d54c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.916+0000 7f4087fff640 1 --2- 172.21.15.22:0/4086416572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d541cd0 0x55a70d565790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.916+0000 7f408d028640 1 -- 172.21.15.22:0/4086416572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d5413b0 msgr2=0x55a70d54c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:07.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.916+0000 7f408d028640 1 --2- 172.21.15.22:0/4086416572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d5413b0 0x55a70d54c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.916+0000 7f408d028640 1 -- 172.21.15.22:0/4086416572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d541cd0 msgr2=0x55a70d565790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:07.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.916+0000 7f408d028640 1 --2- 172.21.15.22:0/4086416572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d541cd0 0x55a70d565790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.916+0000 7f408d028640 1 -- 172.21.15.22:0/4086416572 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a70d560210 con 0x55a70d54dc60 2024-08-20T01:39:07.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.916+0000 7f408d028640 1 --2- 172.21.15.22:0/4086416572 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d54dc60 0x55a70d565cd0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4080004af0 tx=0x7f408002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae9ff3e4543907c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:07.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.916+0000 7f40727fc640 1 -- 172.21.15.22:0/4086416572 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40800cb850 con 0x55a70d54dc60 2024-08-20T01:39:07.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.917+0000 7f40727fc640 1 -- 172.21.15.22:0/4086416572 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4080036040 con 0x55a70d54dc60 2024-08-20T01:39:07.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.917+0000 7f40727fc640 1 -- 172.21.15.22:0/4086416572 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40800c8330 con 0x55a70d54dc60 2024-08-20T01:39:07.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.917+0000 7f4090e84740 1 -- 172.21.15.22:0/4086416572 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d54dc60 msgr2=0x55a70d565cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:07.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.917+0000 7f4090e84740 1 --2- 172.21.15.22:0/4086416572 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d54dc60 0x55a70d565cd0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4080004af0 tx=0x7f408002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.917+0000 7f4090e84740 1 -- 172.21.15.22:0/4086416572 shutdown_connections 2024-08-20T01:39:07.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.917+0000 7f4090e84740 1 --2- 172.21.15.22:0/4086416572 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d54dc60 0x55a70d565cd0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.917+0000 7f4090e84740 1 --2- 172.21.15.22:0/4086416572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d541cd0 0x55a70d565790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.917+0000 7f4090e84740 1 --2- 172.21.15.22:0/4086416572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d5413b0 0x55a70d54c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.917+0000 7f4090e84740 1 -- 172.21.15.22:0/4086416572 >> 172.21.15.22:0/4086416572 conn(0x55a70d53f1e0 msgr2=0x55a70d54c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:07.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.917+0000 7f4090e84740 1 -- 172.21.15.22:0/4086416572 shutdown_connections 2024-08-20T01:39:07.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.917+0000 7f4090e84740 1 -- 172.21.15.22:0/4086416572 wait complete. 2024-08-20T01:39:07.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.918+0000 7f4090e84740 1 -- start start 2024-08-20T01:39:07.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.918+0000 7f4090e84740 1 Processor -- start 2024-08-20T01:39:07.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.918+0000 7f4090e84740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d5413b0 0x55a70d556100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.918+0000 7f4090e84740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d541cd0 0x55a70d5515d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.918+0000 7f4090e84740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d54dc60 0x55a70d551b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.919+0000 7f4090e84740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f40881ac680 con 0x55a70d54dc60 2024-08-20T01:39:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.919+0000 7f4090e84740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f40881adaf0 con 0x55a70d541cd0 2024-08-20T01:39:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.919+0000 7f4090e84740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f40881acd50 con 0x55a70d5413b0 2024-08-20T01:39:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.919+0000 7f408c827640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d5413b0 0x55a70d556100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.919+0000 7f408c827640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d5413b0 0x55a70d556100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:40860/0 (socket says 172.21.15.22:40860) 2024-08-20T01:39:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.919+0000 7f4090e84740 10 client.0 _ll_register_callbacks cb 0x7f40800319a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.919+0000 7f408c827640 1 -- 172.21.15.22:0/2619813960 learned_addr learned my addr 172.21.15.22:0/2619813960 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.919+0000 7f4087fff640 1 --2- 172.21.15.22:0/2619813960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d541cd0 0x55a70d5515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.919+0000 7f408d028640 1 --2- 172.21.15.22:0/2619813960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d54dc60 0x55a70d551b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.919+0000 7f408c827640 1 -- 172.21.15.22:0/2619813960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d541cd0 msgr2=0x55a70d5515d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.919+0000 7f408c827640 1 --2- 172.21.15.22:0/2619813960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d541cd0 0x55a70d5515d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.919+0000 7f408c827640 1 -- 172.21.15.22:0/2619813960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d54dc60 msgr2=0x55a70d551b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.919+0000 7f408c827640 1 --2- 172.21.15.22:0/2619813960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d54dc60 0x55a70d551b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.919+0000 7f408c827640 1 -- 172.21.15.22:0/2619813960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a70d552150 con 0x55a70d5413b0 2024-08-20T01:39:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.919+0000 7f408c827640 1 --2- 172.21.15.22:0/2619813960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d5413b0 0x55a70d556100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55a70d560700 tx=0x7f407c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca74bc2ac20b83f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.919+0000 7f4067fff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:39:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.919+0000 7f4067fff640 1 -- 172.21.15.22:0/2619813960 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c0044d0 con 0x55a70d5413b0 2024-08-20T01:39:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.919+0000 7f4067fff640 1 -- 172.21.15.22:0/2619813960 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f407c003ac0 con 0x55a70d5413b0 2024-08-20T01:39:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.919+0000 7f4090e84740 1 -- 172.21.15.22:0/2619813960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4080036040 con 0x55a70d5413b0 2024-08-20T01:39:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.920+0000 7f4067fff640 1 -- 172.21.15.22:0/2619813960 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f407c003cc0 con 0x55a70d5413b0 2024-08-20T01:39:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.920+0000 7f4090e84740 10 client.26362 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.920+0000 7f4090e84740 1 -- 172.21.15.22:0/2619813960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a70d5c8680 con 0x55a70d5413b0 2024-08-20T01:39:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.920+0000 7f4067fff640 1 -- 172.21.15.22:0/2619813960 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4080036040 con 0x55a70d5413b0 2024-08-20T01:39:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.920+0000 7f4067fff640 1 -- 172.21.15.22:0/2619813960 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f407c004be0 con 0x55a70d5413b0 2024-08-20T01:39:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.920+0000 7f4090e84740 10 client.26362 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.920+0000 7f4090e84740 10 client.26362 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.920+0000 7f4090e84740 20 client.26362 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:07.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.920+0000 7f4090e84740 1 --2- 172.21.15.22:0/2619813960 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a70d5c8e90 0x55a70d5cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.920+0000 7f4090e84740 4 client.26362 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:39:07.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.920+0000 7f4090e84740 1 -- 172.21.15.22:0/2619813960 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a70d4b5330 con 0x55a70d5c8e90 2024-08-20T01:39:07.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.920+0000 7f4087fff640 1 --2- 172.21.15.22:0/2619813960 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a70d5c8e90 0x55a70d5cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.921+0000 7f4087fff640 1 --2- 172.21.15.22:0/2619813960 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a70d5c8e90 0x55a70d5cb2b0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86ad9739c29402c server_cookie=3f8fbaa4ec0f2731 in_seq=0 out_seq=0 2024-08-20T01:39:07.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.921+0000 7f4067fff640 10 client.26362 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:07.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.922+0000 7f4067fff640 1 -- 172.21.15.22:0/2619813960 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a70d4b5330 con 0x55a70d5c8e90 2024-08-20T01:39:07.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.922+0000 7f4067fff640 10 client.26362 handle_command_reply: tid=0 2024-08-20T01:39:07.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.922+0000 7f4090e84740 1 client.26362 shutdown 2024-08-20T01:39:07.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.922+0000 7f4090e84740 1 -- 172.21.15.22:0/2619813960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d5413b0 msgr2=0x55a70d556100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:07.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.922+0000 7f4090e84740 1 --2- 172.21.15.22:0/2619813960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d5413b0 0x55a70d556100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55a70d560700 tx=0x7f407c0046c0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.922+0000 7f4090e84740 1 -- 172.21.15.22:0/2619813960 shutdown_connections 2024-08-20T01:39:07.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.922+0000 7f4090e84740 1 --2- 172.21.15.22:0/2619813960 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a70d5c8e90 0x55a70d5cb2b0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.922+0000 7f4090e84740 1 --2- 172.21.15.22:0/2619813960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a70d54dc60 0x55a70d551b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.922+0000 7f4090e84740 1 --2- 172.21.15.22:0/2619813960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a70d541cd0 0x55a70d5515d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.922+0000 7f4067fff640 0 client.26362 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:07.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.922+0000 7f4090e84740 1 --2- 172.21.15.22:0/2619813960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a70d5413b0 0x55a70d556100 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.922+0000 7f4090e84740 1 -- 172.21.15.22:0/2619813960 >> 172.21.15.22:0/2619813960 conn(0x55a70d53f1e0 msgr2=0x55a70d544560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:07.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.922+0000 7f4090e84740 1 -- 172.21.15.22:0/2619813960 shutdown_connections 2024-08-20T01:39:07.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.922+0000 7f4090e84740 1 -- 172.21.15.22:0/2619813960 wait complete. 2024-08-20T01:39:07.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.922+0000 7f4090e84740 20 client.26362 trim_cache size 0 max 16384 2024-08-20T01:39:07.928 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:39:07.928 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-08-20T01:39:07.928 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "4a396039-849e-47f4-bad0-0f060e336a5e", 2024-08-20T01:39:07.928 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-08-20T01:39:07.928 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:39:07.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.923+0000 7f408ea8b640 1 -- 172.21.15.22:0/2383811080 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f40780b3bd0 msgr2=0x7f40780b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:07.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.923+0000 7f408ea8b640 1 --2- 172.21.15.22:0/2383811080 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f40780b3bd0 0x7f40780b6090 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55a70d544530 tx=0x7f407c005f90 comp rx=0 tx=0).stop 2024-08-20T01:39:07.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.923+0000 7f408ea8b640 1 -- 172.21.15.22:0/2383811080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4088108e60 msgr2=0x7f408819e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:07.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.923+0000 7f408ea8b640 1 --2- 172.21.15.22:0/2383811080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4088108e60 0x7f408819e840 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f408002f540 tx=0x7f40800316f0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.923+0000 7f408ea8b640 1 -- 172.21.15.22:0/2383811080 shutdown_connections 2024-08-20T01:39:07.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.923+0000 7f408ea8b640 1 --2- 172.21.15.22:0/2383811080 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f40780b3bd0 0x7f40780b6090 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.923+0000 7f408ea8b640 1 --2- 172.21.15.22:0/2383811080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4088108e60 0x7f408819e840 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.923+0000 7f408ea8b640 1 --2- 172.21.15.22:0/2383811080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40881084e0 0x7f40881994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.923+0000 7f408ea8b640 1 --2- 172.21.15.22:0/2383811080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4088102ad0 0x7f4088198f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.923+0000 7f408ea8b640 1 -- 172.21.15.22:0/2383811080 >> 172.21.15.22:0/2383811080 conn(0x7f40880fe540 msgr2=0x7f4088100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:07.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.923+0000 7f408ea8b640 1 -- 172.21.15.22:0/2383811080 shutdown_connections 2024-08-20T01:39:07.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:07.923+0000 7f408ea8b640 1 -- 172.21.15.22:0/2383811080 wait complete. 2024-08-20T01:39:08.730 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:39:08.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:08 smithi022 ceph-mon[18709]: pgmap v586: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 1.46k op/s 2024-08-20T01:39:08.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:08 smithi022 ceph-mon[18709]: scrub queued for path: / 2024-08-20T01:39:08.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:08 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:08.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:08 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:39:08.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:08 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:39:08.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:08 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:39:08.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:08 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:09.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:08 smithi134 ceph-mon[22511]: pgmap v586: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 1.46k op/s 2024-08-20T01:39:09.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:08 smithi134 ceph-mon[22511]: scrub queued for path: / 2024-08-20T01:39:09.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:08 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:09.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:08 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:39:09.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:08 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:39:09.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:08 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:39:09.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:08 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:09.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:08 smithi077 ceph-mon[22251]: pgmap v586: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 1.46k op/s 2024-08-20T01:39:09.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:08 smithi077 ceph-mon[22251]: scrub queued for path: / 2024-08-20T01:39:09.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:08 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:09.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:08 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:39:09.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:08 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:39:09.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:08 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:39:09.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:08 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:09.102 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:09.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.608+0000 7f383654f640 1 -- 172.21.15.22:0/2693477786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38301073a0 msgr2=0x7f38301077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:09.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.608+0000 7f383654f640 1 --2- 172.21.15.22:0/2693477786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38301073a0 0x7f38301077e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3824009900 tx=0x7f382402a410 comp rx=0 tx=0).stop 2024-08-20T01:39:09.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.608+0000 7f383654f640 1 -- 172.21.15.22:0/2693477786 shutdown_connections 2024-08-20T01:39:09.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.608+0000 7f383654f640 1 --2- 172.21.15.22:0/2693477786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3830107d20 0x7f383010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.608+0000 7f383654f640 1 --2- 172.21.15.22:0/2693477786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38301073a0 0x7f38301077e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.608+0000 7f383654f640 1 --2- 172.21.15.22:0/2693477786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3830101990 0x7f3830101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.608+0000 7f383654f640 1 -- 172.21.15.22:0/2693477786 >> 172.21.15.22:0/2693477786 conn(0x7f38300fd400 msgr2=0x7f38300ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:09.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.608+0000 7f383654f640 1 -- 172.21.15.22:0/2693477786 shutdown_connections 2024-08-20T01:39:09.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.608+0000 7f383654f640 1 -- 172.21.15.22:0/2693477786 wait complete. 2024-08-20T01:39:09.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.609+0000 7f383654f640 1 Processor -- start 2024-08-20T01:39:09.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.609+0000 7f383654f640 1 -- start start 2024-08-20T01:39:09.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.609+0000 7f383654f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3830101990 0x7f3830198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.609+0000 7f383654f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38301073a0 0x7f38301994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.609+0000 7f383654f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3830107d20 0x7f383019e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.609+0000 7f383654f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3830112b00 con 0x7f3830107d20 2024-08-20T01:39:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.609+0000 7f383654f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3830112980 con 0x7f38301073a0 2024-08-20T01:39:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.609+0000 7f383654f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3830112c80 con 0x7f3830101990 2024-08-20T01:39:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.609+0000 7f382ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3830101990 0x7f3830198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.609+0000 7f382f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38301073a0 0x7f38301994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.609+0000 7f3834aec640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3830107d20 0x7f383019e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.609+0000 7f382ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3830101990 0x7f3830198f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:37404/0 (socket says 172.21.15.22:37404) 2024-08-20T01:39:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.609+0000 7f382ffff640 1 -- 172.21.15.22:0/104966404 learned_addr learned my addr 172.21.15.22:0/104966404 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.610+0000 7f382f7fe640 1 -- 172.21.15.22:0/104966404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3830101990 msgr2=0x7f3830198f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.610+0000 7f382f7fe640 1 --2- 172.21.15.22:0/104966404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3830101990 0x7f3830198f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.610+0000 7f382f7fe640 1 -- 172.21.15.22:0/104966404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3830107d20 msgr2=0x7f383019e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.610+0000 7f382f7fe640 1 --2- 172.21.15.22:0/104966404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3830107d20 0x7f383019e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.610+0000 7f382f7fe640 1 -- 172.21.15.22:0/104966404 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383019f040 con 0x7f38301073a0 2024-08-20T01:39:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.610+0000 7f382f7fe640 1 --2- 172.21.15.22:0/104966404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38301073a0 0x7f38301994d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f382402a930 tx=0x7f3824031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.610+0000 7f382d7fa640 1 -- 172.21.15.22:0/104966404 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382403f030 con 0x7f38301073a0 2024-08-20T01:39:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.610+0000 7f382d7fa640 1 -- 172.21.15.22:0/104966404 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3824004490 con 0x7f38301073a0 2024-08-20T01:39:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.610+0000 7f382d7fa640 1 -- 172.21.15.22:0/104966404 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3824035070 con 0x7f38301073a0 2024-08-20T01:39:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.610+0000 7f383654f640 1 -- 172.21.15.22:0/104966404 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f383019f2d0 con 0x7f38301073a0 2024-08-20T01:39:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.610+0000 7f383654f640 1 -- 172.21.15.22:0/104966404 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38301a59f0 con 0x7f38301073a0 2024-08-20T01:39:09.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.613+0000 7f3838948740 1 Processor -- start 2024-08-20T01:39:09.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.613+0000 7f382d7fa640 1 -- 172.21.15.22:0/104966404 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3824042030 con 0x7f38301073a0 2024-08-20T01:39:09.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.613+0000 7f3838948740 1 -- start start 2024-08-20T01:39:09.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.613+0000 7f3838948740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984b830 0x55aac984bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.614+0000 7f3838948740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac984c150 0x55aac9857ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.614+0000 7f3838948740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac98580e0 0x55aac985a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.614+0000 7f3838948740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55aac97c28e0 con 0x55aac984c150 2024-08-20T01:39:09.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.614+0000 7f3838948740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55aac97b1de0 con 0x55aac98580e0 2024-08-20T01:39:09.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.614+0000 7f3838948740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55aac97b5e20 con 0x55aac984b830 2024-08-20T01:39:09.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.614+0000 7f3834aec640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984b830 0x55aac984bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.614+0000 7f382f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac98580e0 0x55aac985a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.614+0000 7f382ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac984c150 0x55aac9857ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.614+0000 7f382ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac984c150 0x55aac9857ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60444/0 (socket says 172.21.15.22:60444) 2024-08-20T01:39:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.614+0000 7f382ffff640 1 -- 172.21.15.22:0/742516638 learned_addr learned my addr 172.21.15.22:0/742516638 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.614+0000 7f382f7fe640 1 -- 172.21.15.22:0/742516638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984b830 msgr2=0x55aac984bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.614+0000 7f382f7fe640 1 --2- 172.21.15.22:0/742516638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984b830 0x55aac984bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.614+0000 7f382f7fe640 1 -- 172.21.15.22:0/742516638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac984c150 msgr2=0x55aac9857ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.614+0000 7f382f7fe640 1 --2- 172.21.15.22:0/742516638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac984c150 0x55aac9857ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.614+0000 7f382f7fe640 1 -- 172.21.15.22:0/742516638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aac9511650 con 0x55aac98580e0 2024-08-20T01:39:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.614+0000 7f382ffff640 1 --2- 172.21.15.22:0/742516638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac984c150 0x55aac9857ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.615+0000 7f382f7fe640 1 --2- 172.21.15.22:0/742516638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac98580e0 0x55aac985a4d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f38241018a0 tx=0x7f382410c0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bd28984c73b2da3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.615+0000 7f382d7fa640 1 --2- 172.21.15.22:0/104966404 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f38180b3c50 0x7f38180b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.615+0000 7f3834aec640 1 --2- 172.21.15.22:0/104966404 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f38180b3c50 0x7f38180b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.615+0000 7f38167fc640 1 -- 172.21.15.22:0/742516638 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38240c7420 con 0x55aac98580e0 2024-08-20T01:39:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.615+0000 7f38167fc640 1 -- 172.21.15.22:0/742516638 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3824111070 con 0x55aac98580e0 2024-08-20T01:39:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.615+0000 7f38167fc640 1 -- 172.21.15.22:0/742516638 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38240ca540 con 0x55aac98580e0 2024-08-20T01:39:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.615+0000 7f382d7fa640 1 -- 172.21.15.22:0/104966404 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f3824103e10 con 0x7f38301073a0 2024-08-20T01:39:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.616+0000 7f3838948740 1 -- 172.21.15.22:0/742516638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac98580e0 msgr2=0x55aac985a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.616+0000 7f3834aec640 1 --2- 172.21.15.22:0/104966404 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f38180b3c50 0x7f38180b6110 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3828005fd0 tx=0x7f3828015040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.616+0000 7f3838948740 1 --2- 172.21.15.22:0/742516638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac98580e0 0x55aac985a4d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f38241018a0 tx=0x7f382410c0e0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.616+0000 7f3838948740 1 -- 172.21.15.22:0/742516638 shutdown_connections 2024-08-20T01:39:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.616+0000 7f3838948740 1 --2- 172.21.15.22:0/742516638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac98580e0 0x55aac985a4d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.616+0000 7f3838948740 1 --2- 172.21.15.22:0/742516638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac984c150 0x55aac9857ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.616+0000 7f3838948740 1 --2- 172.21.15.22:0/742516638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984b830 0x55aac984bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.616+0000 7f3838948740 1 -- 172.21.15.22:0/742516638 >> 172.21.15.22:0/742516638 conn(0x55aac9849660 msgr2=0x55aac984a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:09.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.616+0000 7f3838948740 1 -- 172.21.15.22:0/742516638 shutdown_connections 2024-08-20T01:39:09.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.616+0000 7f3838948740 1 -- 172.21.15.22:0/742516638 wait complete. 2024-08-20T01:39:09.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.616+0000 7f3838948740 1 -- start start 2024-08-20T01:39:09.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.617+0000 7f3838948740 1 Processor -- start 2024-08-20T01:39:09.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.617+0000 7f3838948740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984b830 0x55aac9855040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.617+0000 7f3838948740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac984c150 0x55aac9855580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.617+0000 7f3838948740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac98580e0 0x55aac9855ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.617+0000 7f3838948740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55aac9614700 con 0x55aac984c150 2024-08-20T01:39:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.617+0000 7f3838948740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55aac97387c0 con 0x55aac98580e0 2024-08-20T01:39:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.617+0000 7f3838948740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55aac985ab50 con 0x55aac984b830 2024-08-20T01:39:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.617+0000 7f3838948740 10 client.0 _ll_register_callbacks cb 0x55aac97ab6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.617+0000 7f382f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac984c150 0x55aac9855580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.617+0000 7f382f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac984c150 0x55aac9855580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60452/0 (socket says 172.21.15.22:60452) 2024-08-20T01:39:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.617+0000 7f382ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984b830 0x55aac9855040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.617+0000 7f382f7fe640 1 -- 172.21.15.22:0/4155616293 learned_addr learned my addr 172.21.15.22:0/4155616293 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.617+0000 7f3834aec640 1 --2- 172.21.15.22:0/4155616293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac98580e0 0x55aac9855ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.618+0000 7f382f7fe640 1 -- 172.21.15.22:0/4155616293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984b830 msgr2=0x55aac9855040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.618+0000 7f382f7fe640 1 --2- 172.21.15.22:0/4155616293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984b830 0x55aac9855040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.618+0000 7f382f7fe640 1 -- 172.21.15.22:0/4155616293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac98580e0 msgr2=0x55aac9855ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:09.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.618+0000 7f382f7fe640 1 --2- 172.21.15.22:0/4155616293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac98580e0 0x55aac9855ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.618+0000 7f382f7fe640 1 -- 172.21.15.22:0/4155616293 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aac9863e10 con 0x55aac984c150 2024-08-20T01:39:09.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.618+0000 7f382f7fe640 1 --2- 172.21.15.22:0/4155616293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac984c150 0x55aac9855580 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3824031440 tx=0x7f382403b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa80d5ac369783cd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:09.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.618+0000 7f380f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:39:09.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.618+0000 7f380f7fe640 1 -- 172.21.15.22:0/4155616293 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3824049030 con 0x55aac984c150 2024-08-20T01:39:09.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.618+0000 7f380f7fe640 1 -- 172.21.15.22:0/4155616293 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f3824003d30 con 0x55aac984c150 2024-08-20T01:39:09.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.618+0000 7f3838948740 1 -- 172.21.15.22:0/4155616293 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aac9761100 con 0x55aac984c150 2024-08-20T01:39:09.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.619+0000 7f380f7fe640 1 -- 172.21.15.22:0/4155616293 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f38240ca720 con 0x55aac984c150 2024-08-20T01:39:09.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.619+0000 7f3838948740 10 client.16719 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:09.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.619+0000 7f3838948740 1 -- 172.21.15.22:0/4155616293 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55aac98667c0 con 0x55aac984c150 2024-08-20T01:39:09.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.619+0000 7f380f7fe640 1 -- 172.21.15.22:0/4155616293 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55aac9761100 con 0x55aac984c150 2024-08-20T01:39:09.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.619+0000 7f380f7fe640 1 -- 172.21.15.22:0/4155616293 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f38240c7060 con 0x55aac984c150 2024-08-20T01:39:09.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.619+0000 7f3838948740 10 client.16719 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.619+0000 7f3838948740 10 client.16719 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.619+0000 7f3838948740 20 client.16719 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.619+0000 7f3838948740 1 --2- 172.21.15.22:0/4155616293 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55aac9867b10 0x55aac9869f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.619+0000 7f3838948740 4 client.16719 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.619+0000 7f3838948740 1 -- 172.21.15.22:0/4155616293 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aac97c4830 con 0x55aac9867b10 2024-08-20T01:39:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.619+0000 7f382ffff640 1 --2- 172.21.15.22:0/4155616293 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55aac9867b10 0x55aac9869f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.620+0000 7f382ffff640 1 --2- 172.21.15.22:0/4155616293 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55aac9867b10 0x55aac9869f00 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b762227a3a057035 server_cookie=4eedc001f9fbde23 in_seq=0 out_seq=0 2024-08-20T01:39:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.620+0000 7f380f7fe640 10 client.16719 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.621+0000 7f380f7fe640 1 -- 172.21.15.22:0/4155616293 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aac97c4830 con 0x55aac9867b10 2024-08-20T01:39:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.621+0000 7f380f7fe640 10 client.16719 handle_command_reply: tid=0 2024-08-20T01:39:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.621+0000 7f3838948740 1 client.16719 shutdown 2024-08-20T01:39:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.622+0000 7f3838948740 1 -- 172.21.15.22:0/4155616293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac984c150 msgr2=0x55aac9855580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.622+0000 7f3838948740 1 --2- 172.21.15.22:0/4155616293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac984c150 0x55aac9855580 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3824031440 tx=0x7f382403b460 comp rx=0 tx=0).stop 2024-08-20T01:39:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.622+0000 7f3838948740 1 -- 172.21.15.22:0/4155616293 shutdown_connections 2024-08-20T01:39:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.622+0000 7f3838948740 1 --2- 172.21.15.22:0/4155616293 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55aac9867b10 0x55aac9869f00 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.622+0000 7f3838948740 1 --2- 172.21.15.22:0/4155616293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac98580e0 0x55aac9855ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.622+0000 7f3838948740 1 --2- 172.21.15.22:0/4155616293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac984c150 0x55aac9855580 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.622+0000 7f3838948740 1 --2- 172.21.15.22:0/4155616293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984b830 0x55aac9855040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.622+0000 7f3838948740 1 -- 172.21.15.22:0/4155616293 >> 172.21.15.22:0/4155616293 conn(0x55aac9849660 msgr2=0x55aac984f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.622+0000 7f380f7fe640 0 client.16719 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.622+0000 7f3838948740 1 -- 172.21.15.22:0/4155616293 shutdown_connections 2024-08-20T01:39:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.622+0000 7f3838948740 1 -- 172.21.15.22:0/4155616293 wait complete. 2024-08-20T01:39:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.623+0000 7f3838948740 20 client.16719 trim_cache size 0 max 16384 2024-08-20T01:39:09.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.644+0000 7f3838948740 1 Processor -- start 2024-08-20T01:39:09.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.644+0000 7f3838948740 1 -- start start 2024-08-20T01:39:09.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.644+0000 7f3838948740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac984b830 0x55aac986f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.644+0000 7f3838948740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984c150 0x55aac986fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.644+0000 7f3838948740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac98580e0 0x55aac9847f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.644+0000 7f3838948740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f38301ae950 con 0x55aac98580e0 2024-08-20T01:39:09.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.644+0000 7f3838948740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f38301ac160 con 0x55aac984b830 2024-08-20T01:39:09.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.644+0000 7f3838948740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f38301a9fb0 con 0x55aac984c150 2024-08-20T01:39:09.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.644+0000 7f3834aec640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac98580e0 0x55aac9847f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.644+0000 7f3834aec640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac98580e0 0x55aac9847f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60462/0 (socket says 172.21.15.22:60462) 2024-08-20T01:39:09.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.644+0000 7f382ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac984b830 0x55aac986f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.644+0000 7f3834aec640 1 -- 172.21.15.22:0/1507441935 learned_addr learned my addr 172.21.15.22:0/1507441935 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:09.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.645+0000 7f382f7fe640 1 --2- 172.21.15.22:0/1507441935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984c150 0x55aac986fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.645+0000 7f382ffff640 1 -- 172.21.15.22:0/1507441935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984c150 msgr2=0x55aac986fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:09.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.645+0000 7f382ffff640 1 --2- 172.21.15.22:0/1507441935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984c150 0x55aac986fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.645+0000 7f382ffff640 1 -- 172.21.15.22:0/1507441935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac98580e0 msgr2=0x55aac9847f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:09.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.645+0000 7f382ffff640 1 --2- 172.21.15.22:0/1507441935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac98580e0 0x55aac9847f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.645+0000 7f382ffff640 1 -- 172.21.15.22:0/1507441935 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aac984a0e0 con 0x55aac984b830 2024-08-20T01:39:09.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.645+0000 7f3834aec640 1 --2- 172.21.15.22:0/1507441935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac98580e0 0x55aac9847f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:09.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.645+0000 7f382ffff640 1 --2- 172.21.15.22:0/1507441935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac984b830 0x55aac986f780 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3820000c00 tx=0x7f3820005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d3b3f1004673353 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:09.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.645+0000 7f3815ffb640 1 -- 172.21.15.22:0/1507441935 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3820004050 con 0x55aac984b830 2024-08-20T01:39:09.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.645+0000 7f3815ffb640 1 -- 172.21.15.22:0/1507441935 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38200054d0 con 0x55aac984b830 2024-08-20T01:39:09.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.645+0000 7f3815ffb640 1 -- 172.21.15.22:0/1507441935 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3820004ba0 con 0x55aac984b830 2024-08-20T01:39:09.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.646+0000 7f3838948740 1 -- 172.21.15.22:0/1507441935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac984b830 msgr2=0x55aac986f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:09.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.646+0000 7f3838948740 1 --2- 172.21.15.22:0/1507441935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac984b830 0x55aac986f780 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3820000c00 tx=0x7f3820005f90 comp rx=0 tx=0).stop 2024-08-20T01:39:09.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.646+0000 7f3838948740 1 -- 172.21.15.22:0/1507441935 shutdown_connections 2024-08-20T01:39:09.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.646+0000 7f3838948740 1 --2- 172.21.15.22:0/1507441935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac98580e0 0x55aac9847f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.646+0000 7f3838948740 1 --2- 172.21.15.22:0/1507441935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984c150 0x55aac986fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.646+0000 7f3838948740 1 --2- 172.21.15.22:0/1507441935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac984b830 0x55aac986f780 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.646+0000 7f3838948740 1 -- 172.21.15.22:0/1507441935 >> 172.21.15.22:0/1507441935 conn(0x55aac9849660 msgr2=0x55aac98538c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:09.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.646+0000 7f3838948740 1 -- 172.21.15.22:0/1507441935 shutdown_connections 2024-08-20T01:39:09.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.646+0000 7f3838948740 1 -- 172.21.15.22:0/1507441935 wait complete. 2024-08-20T01:39:09.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.647+0000 7f3838948740 1 -- start start 2024-08-20T01:39:09.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.647+0000 7f3838948740 1 Processor -- start 2024-08-20T01:39:09.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.647+0000 7f3838948740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984b830 0x55aac985b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.647+0000 7f3838948740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac984c150 0x55aac985ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.647+0000 7f3838948740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac98580e0 0x55aac98d0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.647+0000 7f3838948740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f38301aa620 con 0x55aac98580e0 2024-08-20T01:39:09.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.647+0000 7f3838948740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f38301aba90 con 0x55aac984c150 2024-08-20T01:39:09.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.647+0000 7f3838948740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f38301aacf0 con 0x55aac984b830 2024-08-20T01:39:09.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.647+0000 7f382f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac984c150 0x55aac985ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.647+0000 7f3838948740 10 client.0 _ll_register_callbacks cb 0x7f3820009860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:09.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.647+0000 7f382ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984b830 0x55aac985b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.647+0000 7f382f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac984c150 0x55aac985ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:49746/0 (socket says 172.21.15.22:49746) 2024-08-20T01:39:09.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.647+0000 7f382f7fe640 1 -- 172.21.15.22:0/1675480848 learned_addr learned my addr 172.21.15.22:0/1675480848 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:09.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.648+0000 7f382f7fe640 1 -- 172.21.15.22:0/1675480848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984b830 msgr2=0x55aac985b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:09.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.648+0000 7f382f7fe640 1 --2- 172.21.15.22:0/1675480848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984b830 0x55aac985b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.648+0000 7f3834aec640 1 --2- 172.21.15.22:0/1675480848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac98580e0 0x55aac98d0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.648+0000 7f382f7fe640 1 -- 172.21.15.22:0/1675480848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac98580e0 msgr2=0x55aac98d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:09.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.648+0000 7f382f7fe640 1 --2- 172.21.15.22:0/1675480848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac98580e0 0x55aac98d0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.648+0000 7f382f7fe640 1 -- 172.21.15.22:0/1675480848 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aac98d0e30 con 0x55aac984c150 2024-08-20T01:39:09.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.648+0000 7f3834aec640 1 --2- 172.21.15.22:0/1675480848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac98580e0 0x55aac98d0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:39:09.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.648+0000 7f382f7fe640 1 --2- 172.21.15.22:0/1675480848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac984c150 0x55aac985ba90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f38240cf4e0 tx=0x7f38240cadd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0d5bc25fd139e28 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:09.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.648+0000 7f380f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:39:09.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.648+0000 7f380f7fe640 1 -- 172.21.15.22:0/1675480848 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3824049070 con 0x55aac984c150 2024-08-20T01:39:09.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.648+0000 7f380f7fe640 1 -- 172.21.15.22:0/1675480848 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f38240d3940 con 0x55aac984c150 2024-08-20T01:39:09.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.648+0000 7f3838948740 1 -- 172.21.15.22:0/1675480848 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38200054d0 con 0x55aac984c150 2024-08-20T01:39:09.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.649+0000 7f380f7fe640 1 -- 172.21.15.22:0/1675480848 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f38240ca910 con 0x55aac984c150 2024-08-20T01:39:09.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.649+0000 7f3838948740 10 client.26336 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:09.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.649+0000 7f3838948740 1 -- 172.21.15.22:0/1675480848 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55aac98d0e30 con 0x55aac984c150 2024-08-20T01:39:09.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.649+0000 7f380f7fe640 1 -- 172.21.15.22:0/1675480848 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38200054d0 con 0x55aac984c150 2024-08-20T01:39:09.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.649+0000 7f380f7fe640 1 -- 172.21.15.22:0/1675480848 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f38240cb030 con 0x55aac984c150 2024-08-20T01:39:09.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.649+0000 7f3838948740 10 client.26336 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:09.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.649+0000 7f3838948740 10 client.26336 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:09.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.649+0000 7f3838948740 20 client.26336 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:09.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.649+0000 7f3838948740 1 --2- 172.21.15.22:0/1675480848 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55aac98d2530 0x55aac98d4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.649+0000 7f3838948740 4 client.26336 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:39:09.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.649+0000 7f3838948740 1 -- 172.21.15.22:0/1675480848 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55aac97c02d0 con 0x55aac98d2530 2024-08-20T01:39:09.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.649+0000 7f382ffff640 1 --2- 172.21.15.22:0/1675480848 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55aac98d2530 0x55aac98d4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.650+0000 7f382ffff640 1 --2- 172.21.15.22:0/1675480848 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55aac98d2530 0x55aac98d4950 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5d9b20cd70d9b04 server_cookie=c3cf542fb205fd92 in_seq=0 out_seq=0 2024-08-20T01:39:09.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.650+0000 7f380f7fe640 10 client.26336 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:09.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.650+0000 7f380f7fe640 1 -- 172.21.15.22:0/1675480848 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x55aac97c02d0 con 0x55aac98d2530 2024-08-20T01:39:09.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.650+0000 7f380f7fe640 10 client.26336 handle_command_reply: tid=0 2024-08-20T01:39:09.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.651+0000 7f3838948740 1 client.26336 shutdown 2024-08-20T01:39:09.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.651+0000 7f3838948740 1 -- 172.21.15.22:0/1675480848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac984c150 msgr2=0x55aac985ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:09.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.651+0000 7f3838948740 1 --2- 172.21.15.22:0/1675480848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac984c150 0x55aac985ba90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f38240cf4e0 tx=0x7f38240cadd0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.651+0000 7f3838948740 1 -- 172.21.15.22:0/1675480848 shutdown_connections 2024-08-20T01:39:09.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.651+0000 7f3838948740 1 --2- 172.21.15.22:0/1675480848 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55aac98d2530 0x55aac98d4950 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.651+0000 7f380f7fe640 0 client.26336 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:09.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.651+0000 7f3838948740 1 --2- 172.21.15.22:0/1675480848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aac98580e0 0x55aac98d0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.651+0000 7f3838948740 1 --2- 172.21.15.22:0/1675480848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac984c150 0x55aac985ba90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.651+0000 7f3838948740 1 --2- 172.21.15.22:0/1675480848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55aac984b830 0x55aac985b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.651+0000 7f3838948740 1 -- 172.21.15.22:0/1675480848 >> 172.21.15.22:0/1675480848 conn(0x55aac9849660 msgr2=0x55aac9847f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:09.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.652+0000 7f3838948740 1 -- 172.21.15.22:0/1675480848 shutdown_connections 2024-08-20T01:39:09.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.652+0000 7f3838948740 1 -- 172.21.15.22:0/1675480848 wait complete. 2024-08-20T01:39:09.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.652+0000 7f3838948740 20 client.26336 trim_cache size 0 max 16384 2024-08-20T01:39:09.658 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:39:09.658 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "scrub active (32019 inodes in the stack)", 2024-08-20T01:39:09.658 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-08-20T01:39:09.658 INFO:teuthology.orchestra.run.smithi022.stdout: "4a396039-849e-47f4-bad0-0f060e336a5e": { 2024-08-20T01:39:09.658 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-08-20T01:39:09.658 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "4a396039-849e-47f4-bad0-0f060e336a5e", 2024-08-20T01:39:09.658 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-08-20T01:39:09.658 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:39:09.658 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:39:09.659 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:39:09.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.652+0000 7f383654f640 1 -- 172.21.15.22:0/104966404 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f38180b3c50 msgr2=0x7f38180b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:09.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.652+0000 7f383654f640 1 --2- 172.21.15.22:0/104966404 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f38180b3c50 0x7f38180b6110 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3828005fd0 tx=0x7f3828015040 comp rx=0 tx=0).stop 2024-08-20T01:39:09.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.652+0000 7f383654f640 1 -- 172.21.15.22:0/104966404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38301073a0 msgr2=0x7f38301994d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:09.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.652+0000 7f383654f640 1 --2- 172.21.15.22:0/104966404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38301073a0 0x7f38301994d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f382402a930 tx=0x7f3824031a20 comp rx=0 tx=0).stop 2024-08-20T01:39:09.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.653+0000 7f383654f640 1 -- 172.21.15.22:0/104966404 shutdown_connections 2024-08-20T01:39:09.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.653+0000 7f383654f640 1 --2- 172.21.15.22:0/104966404 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f38180b3c50 0x7f38180b6110 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.653+0000 7f383654f640 1 --2- 172.21.15.22:0/104966404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3830107d20 0x7f383019e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.653+0000 7f383654f640 1 --2- 172.21.15.22:0/104966404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38301073a0 0x7f38301994d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.653+0000 7f383654f640 1 --2- 172.21.15.22:0/104966404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3830101990 0x7f3830198f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.653+0000 7f383654f640 1 -- 172.21.15.22:0/104966404 >> 172.21.15.22:0/104966404 conn(0x7f38300fd400 msgr2=0x7f38300ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:09.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.653+0000 7f383654f640 1 -- 172.21.15.22:0/104966404 shutdown_connections 2024-08-20T01:39:09.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:09.653+0000 7f383654f640 1 -- 172.21.15.22:0/104966404 wait complete. 2024-08-20T01:39:10.382 INFO:tasks.cephfs.filesystem:scrub status for tag:4a396039-849e-47f4-bad0-0f060e336a5e - {'path': '/', 'tag': '4a396039-849e-47f4-bad0-0f060e336a5e', 'options': 'recursive,force'} 2024-08-20T01:39:11.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:10 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:11.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:10 smithi134 ceph-mon[22511]: pgmap v587: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 1.41k op/s 2024-08-20T01:39:11.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:10 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:11.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:10 smithi077 ceph-mon[22251]: pgmap v587: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 1.41k op/s 2024-08-20T01:39:11.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:10 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:11.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:10 smithi022 ceph-mon[18709]: pgmap v587: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 1.41k op/s 2024-08-20T01:39:13.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:12 smithi134 ceph-mon[22511]: pgmap v588: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 1.79k op/s 2024-08-20T01:39:13.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:12 smithi077 ceph-mon[22251]: pgmap v588: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 1.79k op/s 2024-08-20T01:39:13.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:12 smithi022 ceph-mon[18709]: pgmap v588: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 1.79k op/s 2024-08-20T01:39:15.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:14 smithi134 ceph-mon[22511]: pgmap v589: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.6 MiB/s wr, 3.85k op/s 2024-08-20T01:39:15.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:14 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:15.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:14 smithi077 ceph-mon[22251]: pgmap v589: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.6 MiB/s wr, 3.85k op/s 2024-08-20T01:39:15.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:14 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:15.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:14 smithi022 ceph-mon[18709]: pgmap v589: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.6 MiB/s wr, 3.85k op/s 2024-08-20T01:39:15.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:14 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.483+0000 7fb70759e640 1 -- 172.21.15.22:0/2023452707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7081024e0 msgr2=0x7fb708102960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.483+0000 7fb70759e640 1 --2- 172.21.15.22:0/2023452707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7081024e0 0x7fb708102960 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009930 tx=0x7fb6f002a420 comp rx=0 tx=0).stop 2024-08-20T01:39:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.483+0000 7fb70759e640 1 -- 172.21.15.22:0/2023452707 shutdown_connections 2024-08-20T01:39:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.483+0000 7fb70759e640 1 --2- 172.21.15.22:0/2023452707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb708102ea0 0x7fb708109820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.483+0000 7fb70759e640 1 --2- 172.21.15.22:0/2023452707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7081024e0 0x7fb708102960 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.483+0000 7fb70759e640 1 --2- 172.21.15.22:0/2023452707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb708101390 0x7fb708101790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.483+0000 7fb70759e640 1 -- 172.21.15.22:0/2023452707 >> 172.21.15.22:0/2023452707 conn(0x7fb7080fcc50 msgr2=0x7fb7080ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.483+0000 7fb70759e640 1 -- 172.21.15.22:0/2023452707 shutdown_connections 2024-08-20T01:39:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.483+0000 7fb70759e640 1 -- 172.21.15.22:0/2023452707 wait complete. 2024-08-20T01:39:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.484+0000 7fb70759e640 1 Processor -- start 2024-08-20T01:39:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.484+0000 7fb70759e640 1 -- start start 2024-08-20T01:39:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.484+0000 7fb70759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb708101390 0x7fb708105150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.484+0000 7fb70759e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7081024e0 0x7fb7081039b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.484+0000 7fb70759e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb708102ea0 0x7fb708103ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.484+0000 7fb70759e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb70810cfe0 con 0x7fb7081024e0 2024-08-20T01:39:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.484+0000 7fb70759e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb70810ce60 con 0x7fb708101390 2024-08-20T01:39:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.484+0000 7fb70759e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb70810d160 con 0x7fb708102ea0 2024-08-20T01:39:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.484+0000 7fb6fffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7081024e0 0x7fb7081039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.484+0000 7fb6fffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7081024e0 0x7fb7081039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60472/0 (socket says 172.21.15.22:60472) 2024-08-20T01:39:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.484+0000 7fb6fffff640 1 -- 172.21.15.22:0/2855959788 learned_addr learned my addr 172.21.15.22:0/2855959788 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.484+0000 7fb70659c640 1 --2- 172.21.15.22:0/2855959788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb708101390 0x7fb708105150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.484+0000 7fb706d9d640 1 --2- 172.21.15.22:0/2855959788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb708102ea0 0x7fb708103ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.485+0000 7fb6fffff640 1 -- 172.21.15.22:0/2855959788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb708102ea0 msgr2=0x7fb708103ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.485+0000 7fb6fffff640 1 --2- 172.21.15.22:0/2855959788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb708102ea0 0x7fb708103ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.485+0000 7fb6fffff640 1 -- 172.21.15.22:0/2855959788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb708101390 msgr2=0x7fb708105150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.485+0000 7fb6fffff640 1 --2- 172.21.15.22:0/2855959788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb708101390 0x7fb708105150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.485+0000 7fb6fffff640 1 -- 172.21.15.22:0/2855959788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb708104760 con 0x7fb7081024e0 2024-08-20T01:39:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.485+0000 7fb6fffff640 1 --2- 172.21.15.22:0/2855959788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7081024e0 0x7fb7081039b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009a50 tx=0x7fb6f00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.485+0000 7fb6ff7fe640 1 -- 172.21.15.22:0/2855959788 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f003f030 con 0x7fb7081024e0 2024-08-20T01:39:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.485+0000 7fb6ff7fe640 1 -- 172.21.15.22:0/2855959788 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6f0003cb0 con 0x7fb7081024e0 2024-08-20T01:39:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.485+0000 7fb70759e640 1 -- 172.21.15.22:0/2855959788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7081a2910 con 0x7fb7081024e0 2024-08-20T01:39:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.485+0000 7fb6ff7fe640 1 -- 172.21.15.22:0/2855959788 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0035070 con 0x7fb7081024e0 2024-08-20T01:39:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.485+0000 7fb70759e640 1 -- 172.21.15.22:0/2855959788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7081a2dd0 con 0x7fb7081024e0 2024-08-20T01:39:16.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb70f9f5740 1 Processor -- start 2024-08-20T01:39:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb70f9f5740 1 -- start start 2024-08-20T01:39:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb6ff7fe640 1 -- 172.21.15.22:0/2855959788 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb6f0042030 con 0x7fb7081024e0 2024-08-20T01:39:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb70f9f5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266171810 0x55a266173c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb70f9f5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 0x55a266176530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb70f9f5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266176b80 0x55a266179040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb70f9f5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a2660e4360 con 0x55a266174140 2024-08-20T01:39:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb70f9f5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a2660d3860 con 0x55a266176b80 2024-08-20T01:39:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb70f9f5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a2660d78a0 con 0x55a266171810 2024-08-20T01:39:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb70659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 0x55a266176530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb70659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 0x55a266176530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60478/0 (socket says 172.21.15.22:60478) 2024-08-20T01:39:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb706d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266171810 0x55a266173c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb70659c640 1 -- 172.21.15.22:0/1000354642 learned_addr learned my addr 172.21.15.22:0/1000354642 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb6fffff640 1 --2- 172.21.15.22:0/1000354642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266176b80 0x55a266179040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb706d9d640 1 -- 172.21.15.22:0/1000354642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266176b80 msgr2=0x55a266179040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb706d9d640 1 --2- 172.21.15.22:0/1000354642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266176b80 0x55a266179040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb706d9d640 1 -- 172.21.15.22:0/1000354642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 msgr2=0x55a266176530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb706d9d640 1 --2- 172.21.15.22:0/1000354642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 0x55a266176530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb706d9d640 1 -- 172.21.15.22:0/1000354642 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a26607ae40 con 0x55a266171810 2024-08-20T01:39:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.488+0000 7fb70659c640 1 --2- 172.21.15.22:0/1000354642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 0x55a266176530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.489+0000 7fb706d9d640 1 --2- 172.21.15.22:0/1000354642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266171810 0x55a266173c00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb700009f30 tx=0x7fb700010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71352118e94d1898 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.489+0000 7fb6ff7fe640 1 --2- 172.21.15.22:0/2855959788 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb6f40b3bd0 0x7fb6f40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.489+0000 7fb6fcff9640 1 -- 172.21.15.22:0/1000354642 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb700016070 con 0x55a266171810 2024-08-20T01:39:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.489+0000 7fb6fcff9640 1 -- 172.21.15.22:0/1000354642 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb700004d20 con 0x55a266171810 2024-08-20T01:39:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.489+0000 7fb6fcff9640 1 -- 172.21.15.22:0/1000354642 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7000127d0 con 0x55a266171810 2024-08-20T01:39:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.489+0000 7fb70659c640 1 --2- 172.21.15.22:0/2855959788 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb6f40b3bd0 0x7fb6f40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.489+0000 7fb6ff7fe640 1 -- 172.21.15.22:0/2855959788 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb6f0104590 con 0x7fb7081024e0 2024-08-20T01:39:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.490+0000 7fb70f9f5740 1 -- 172.21.15.22:0/1000354642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266171810 msgr2=0x55a266173c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.490+0000 7fb70659c640 1 --2- 172.21.15.22:0/2855959788 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb6f40b3bd0 0x7fb6f40b6090 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8005bc0 tx=0x7fb6f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.490+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/1000354642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266171810 0x55a266173c00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb700009f30 tx=0x7fb700010800 comp rx=0 tx=0).stop 2024-08-20T01:39:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.490+0000 7fb70f9f5740 1 -- 172.21.15.22:0/1000354642 shutdown_connections 2024-08-20T01:39:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.490+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/1000354642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266176b80 0x55a266179040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.490+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/1000354642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 0x55a266176530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.490+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/1000354642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266171810 0x55a266173c00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.490+0000 7fb70f9f5740 1 -- 172.21.15.22:0/1000354642 >> 172.21.15.22:0/1000354642 conn(0x55a26616c960 msgr2=0x55a26616d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.490+0000 7fb70f9f5740 1 -- 172.21.15.22:0/1000354642 shutdown_connections 2024-08-20T01:39:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.490+0000 7fb70f9f5740 1 -- 172.21.15.22:0/1000354642 wait complete. 2024-08-20T01:39:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.490+0000 7fb70f9f5740 1 -- start start 2024-08-20T01:39:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.490+0000 7fb70f9f5740 1 Processor -- start 2024-08-20T01:39:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.490+0000 7fb70f9f5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266171810 0x55a26617b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.490+0000 7fb70f9f5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 0x55a26617b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.490+0000 7fb70f9f5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266176b80 0x55a26617c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.490+0000 7fb70f9f5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a26600cab0 con 0x55a266174140 2024-08-20T01:39:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.490+0000 7fb70f9f5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a26605a780 con 0x55a266171810 2024-08-20T01:39:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.490+0000 7fb70f9f5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a266179b60 con 0x55a266176b80 2024-08-20T01:39:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.490+0000 7fb70f9f5740 10 client.0 _ll_register_callbacks cb 0x55a265de2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.491+0000 7fb6fffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 0x55a26617b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.491+0000 7fb6fffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 0x55a26617b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60488/0 (socket says 172.21.15.22:60488) 2024-08-20T01:39:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.491+0000 7fb706d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266176b80 0x55a26617c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.491+0000 7fb6fffff640 1 -- 172.21.15.22:0/2145835694 learned_addr learned my addr 172.21.15.22:0/2145835694 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.491+0000 7fb70659c640 1 --2- 172.21.15.22:0/2145835694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266171810 0x55a26617b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.491+0000 7fb6fffff640 1 -- 172.21.15.22:0/2145835694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266176b80 msgr2=0x55a26617c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.491+0000 7fb6fffff640 1 --2- 172.21.15.22:0/2145835694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266176b80 0x55a26617c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.491+0000 7fb6fffff640 1 -- 172.21.15.22:0/2145835694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266171810 msgr2=0x55a26617b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.491+0000 7fb6fffff640 1 --2- 172.21.15.22:0/2145835694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266171810 0x55a26617b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.491+0000 7fb6fffff640 1 -- 172.21.15.22:0/2145835694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a265e36790 con 0x55a266174140 2024-08-20T01:39:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.491+0000 7fb6fffff640 1 --2- 172.21.15.22:0/2145835694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 0x55a26617b700 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00c75d0 tx=0x7fb6f00c7410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28303f54ce5b3872 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.491+0000 7fb6edffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:39:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.491+0000 7fb6edffb640 1 -- 172.21.15.22:0/2145835694 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0049040 con 0x55a266174140 2024-08-20T01:39:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.491+0000 7fb6edffb640 1 -- 172.21.15.22:0/2145835694 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb6f00c77e0 con 0x55a266174140 2024-08-20T01:39:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.491+0000 7fb70f9f5740 1 -- 172.21.15.22:0/2145835694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a266082e00 con 0x55a266174140 2024-08-20T01:39:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.491+0000 7fb6edffb640 1 -- 172.21.15.22:0/2145835694 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb6f00cacc0 con 0x55a266174140 2024-08-20T01:39:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.491+0000 7fb70f9f5740 10 client.16734 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.491+0000 7fb70f9f5740 1 -- 172.21.15.22:0/2145835694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a265eaf620 con 0x55a266174140 2024-08-20T01:39:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.492+0000 7fb6edffb640 1 -- 172.21.15.22:0/2145835694 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a266082e00 con 0x55a266174140 2024-08-20T01:39:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.492+0000 7fb6edffb640 1 -- 172.21.15.22:0/2145835694 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fb6f00cb7b0 con 0x55a266174140 2024-08-20T01:39:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.492+0000 7fb70f9f5740 10 client.16734 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.492+0000 7fb70f9f5740 10 client.16734 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.492+0000 7fb70f9f5740 20 client.16734 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.492+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/2145835694 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a2661868f0 0x55a266188d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.492+0000 7fb70f9f5740 4 client.16734 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.492+0000 7fb70f9f5740 1 -- 172.21.15.22:0/2145835694 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2660e62b0 con 0x55a2661868f0 2024-08-20T01:39:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.492+0000 7fb70659c640 1 --2- 172.21.15.22:0/2145835694 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a2661868f0 0x55a266188d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.492+0000 7fb6edffb640 10 client.16734 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.492+0000 7fb70659c640 1 --2- 172.21.15.22:0/2145835694 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a2661868f0 0x55a266188d50 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5752734beed69823 server_cookie=7ccda07a4c90db2c in_seq=0 out_seq=0 2024-08-20T01:39:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.493+0000 7fb6edffb640 1 -- 172.21.15.22:0/2145835694 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a2660e62b0 con 0x55a2661868f0 2024-08-20T01:39:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.493+0000 7fb6edffb640 10 client.16734 handle_command_reply: tid=0 2024-08-20T01:39:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.493+0000 7fb70f9f5740 1 client.16734 shutdown 2024-08-20T01:39:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.493+0000 7fb70f9f5740 1 -- 172.21.15.22:0/2145835694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 msgr2=0x55a26617b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.493+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/2145835694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 0x55a26617b700 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00c75d0 tx=0x7fb6f00c7410 comp rx=0 tx=0).stop 2024-08-20T01:39:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.493+0000 7fb70f9f5740 1 -- 172.21.15.22:0/2145835694 shutdown_connections 2024-08-20T01:39:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.493+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/2145835694 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a2661868f0 0x55a266188d50 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.493+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/2145835694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266176b80 0x55a26617c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.493+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/2145835694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 0x55a26617b700 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.493+0000 7fb6edffb640 0 client.16734 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.493+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/2145835694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266171810 0x55a26617b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.493+0000 7fb70f9f5740 1 -- 172.21.15.22:0/2145835694 >> 172.21.15.22:0/2145835694 conn(0x55a26616c960 msgr2=0x55a26616ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.493+0000 7fb70f9f5740 1 -- 172.21.15.22:0/2145835694 shutdown_connections 2024-08-20T01:39:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.493+0000 7fb70f9f5740 1 -- 172.21.15.22:0/2145835694 wait complete. 2024-08-20T01:39:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.493+0000 7fb70f9f5740 20 client.16734 trim_cache size 0 max 16384 2024-08-20T01:39:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.508+0000 7fb70f9f5740 1 Processor -- start 2024-08-20T01:39:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.508+0000 7fb70f9f5740 1 -- start start 2024-08-20T01:39:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.508+0000 7fb70f9f5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266171810 0x55a2661677a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.508+0000 7fb70f9f5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266174140 0x55a266176f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.508+0000 7fb70f9f5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266176b80 0x55a2661774a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.508+0000 7fb70f9f5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb7081ae6e0 con 0x55a266176b80 2024-08-20T01:39:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.508+0000 7fb70f9f5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb7081abef0 con 0x55a266171810 2024-08-20T01:39:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.508+0000 7fb70f9f5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb7081a9d40 con 0x55a266174140 2024-08-20T01:39:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.508+0000 7fb706d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266176b80 0x55a2661774a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.508+0000 7fb706d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266176b80 0x55a2661774a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60500/0 (socket says 172.21.15.22:60500) 2024-08-20T01:39:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.508+0000 7fb706d9d640 1 -- 172.21.15.22:0/829829581 learned_addr learned my addr 172.21.15.22:0/829829581 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.508+0000 7fb6fffff640 1 --2- 172.21.15.22:0/829829581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266174140 0x55a266176f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.508+0000 7fb706d9d640 1 -- 172.21.15.22:0/829829581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266174140 msgr2=0x55a266176f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.508+0000 7fb706d9d640 1 --2- 172.21.15.22:0/829829581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266174140 0x55a266176f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.509+0000 7fb706d9d640 1 -- 172.21.15.22:0/829829581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266171810 msgr2=0x55a2661677a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.509+0000 7fb70659c640 1 --2- 172.21.15.22:0/829829581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266171810 0x55a2661677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.509+0000 7fb706d9d640 1 --2- 172.21.15.22:0/829829581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266171810 0x55a2661677a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.509+0000 7fb706d9d640 1 -- 172.21.15.22:0/829829581 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2661768a0 con 0x55a266176b80 2024-08-20T01:39:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.509+0000 7fb706d9d640 1 --2- 172.21.15.22:0/829829581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266176b80 0x55a2661774a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb700000f80 tx=0x7fb700009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fcfd982ee7b976 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.509+0000 7fb6effff640 1 -- 172.21.15.22:0/829829581 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb700016070 con 0x55a266176b80 2024-08-20T01:39:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.509+0000 7fb6effff640 1 -- 172.21.15.22:0/829829581 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb700003e20 con 0x55a266176b80 2024-08-20T01:39:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.509+0000 7fb6effff640 1 -- 172.21.15.22:0/829829581 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb700004660 con 0x55a266176b80 2024-08-20T01:39:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.509+0000 7fb70f9f5740 1 -- 172.21.15.22:0/829829581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266176b80 msgr2=0x55a2661774a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.509+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/829829581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266176b80 0x55a2661774a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb700000f80 tx=0x7fb700009840 comp rx=0 tx=0).stop 2024-08-20T01:39:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.509+0000 7fb70f9f5740 1 -- 172.21.15.22:0/829829581 shutdown_connections 2024-08-20T01:39:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.509+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/829829581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266176b80 0x55a2661774a0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.509+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/829829581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266174140 0x55a266176f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.509+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/829829581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266171810 0x55a2661677a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.509+0000 7fb70f9f5740 1 -- 172.21.15.22:0/829829581 >> 172.21.15.22:0/829829581 conn(0x55a26616c960 msgr2=0x55a266179f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.510+0000 7fb70f9f5740 1 -- 172.21.15.22:0/829829581 shutdown_connections 2024-08-20T01:39:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.510+0000 7fb70f9f5740 1 -- 172.21.15.22:0/829829581 wait complete. 2024-08-20T01:39:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.510+0000 7fb70f9f5740 1 -- start start 2024-08-20T01:39:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.510+0000 7fb70f9f5740 1 Processor -- start 2024-08-20T01:39:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.510+0000 7fb70f9f5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266171810 0x55a2661827a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.510+0000 7fb70f9f5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 0x55a266182e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.510+0000 7fb70f9f5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266176b80 0x55a266181630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.510+0000 7fb70f9f5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb7081aa3b0 con 0x55a266174140 2024-08-20T01:39:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.510+0000 7fb70f9f5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb7081ab820 con 0x55a266176b80 2024-08-20T01:39:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.510+0000 7fb70f9f5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb7081aaa80 con 0x55a266171810 2024-08-20T01:39:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.510+0000 7fb70f9f5740 10 client.0 _ll_register_callbacks cb 0x7fb6f0005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.510+0000 7fb6fffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 0x55a266182e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.510+0000 7fb6fffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 0x55a266182e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60516/0 (socket says 172.21.15.22:60516) 2024-08-20T01:39:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.510+0000 7fb6fffff640 1 -- 172.21.15.22:0/2925777257 learned_addr learned my addr 172.21.15.22:0/2925777257 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.510+0000 7fb70659c640 1 --2- 172.21.15.22:0/2925777257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266171810 0x55a2661827a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.510+0000 7fb706d9d640 1 --2- 172.21.15.22:0/2925777257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266176b80 0x55a266181630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.511+0000 7fb6fffff640 1 -- 172.21.15.22:0/2925777257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266171810 msgr2=0x55a2661827a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.511+0000 7fb6fffff640 1 --2- 172.21.15.22:0/2925777257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266171810 0x55a2661827a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.511+0000 7fb6fffff640 1 -- 172.21.15.22:0/2925777257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266176b80 msgr2=0x55a266181630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.511+0000 7fb6fffff640 1 --2- 172.21.15.22:0/2925777257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266176b80 0x55a266181630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.511+0000 7fb6fffff640 1 -- 172.21.15.22:0/2925777257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a266181e60 con 0x55a266174140 2024-08-20T01:39:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.511+0000 7fb6fffff640 1 --2- 172.21.15.22:0/2925777257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 0x55a266182e40 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00c87c0 tx=0x7fb6f00c7a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b68ada51d34e1a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.511+0000 7fb6edffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:39:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.511+0000 7fb6edffb640 1 -- 172.21.15.22:0/2925777257 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f00e9070 con 0x55a266174140 2024-08-20T01:39:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.511+0000 7fb6edffb640 1 -- 172.21.15.22:0/2925777257 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb6f00d42d0 con 0x55a266174140 2024-08-20T01:39:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.511+0000 7fb70f9f5740 1 -- 172.21.15.22:0/2925777257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb700003e20 con 0x55a266174140 2024-08-20T01:39:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.511+0000 7fb6edffb640 1 -- 172.21.15.22:0/2925777257 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb6f0049070 con 0x55a266174140 2024-08-20T01:39:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.511+0000 7fb70f9f5740 10 client.16740 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.511+0000 7fb70f9f5740 1 -- 172.21.15.22:0/2925777257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a266180cb0 con 0x55a266174140 2024-08-20T01:39:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.511+0000 7fb6edffb640 1 -- 172.21.15.22:0/2925777257 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb700003e20 con 0x55a266174140 2024-08-20T01:39:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.511+0000 7fb6edffb640 1 -- 172.21.15.22:0/2925777257 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fb6f00ec020 con 0x55a266174140 2024-08-20T01:39:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.511+0000 7fb70f9f5740 10 client.16740 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.511+0000 7fb70f9f5740 10 client.16740 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.511+0000 7fb70f9f5740 20 client.16740 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.511+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/2925777257 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a2661f1b50 0x55a2661f3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.512+0000 7fb70f9f5740 4 client.16740 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:39:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.512+0000 7fb70f9f5740 1 -- 172.21.15.22:0/2925777257 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a2660e1d50 con 0x55a2661f1b50 2024-08-20T01:39:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.512+0000 7fb70659c640 1 --2- 172.21.15.22:0/2925777257 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a2661f1b50 0x55a2661f3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.512+0000 7fb6edffb640 10 client.16740 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:16.512+0000 7fb70659c640 1 --2- 172.21.15.22:0/2925777257 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a2661f1b50 0x55a2661f3f70 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d8d37458e1b8eac server_cookie=a9c954d19a9c7468 in_seq=0 out_seq=0 2024-08-20T01:39:17.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:16 smithi134 ceph-mon[22511]: pgmap v590: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 3.26k op/s 2024-08-20T01:39:17.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:16 smithi077 ceph-mon[22251]: pgmap v590: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 3.26k op/s 2024-08-20T01:39:17.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:16 smithi022 ceph-mon[18709]: pgmap v590: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 3.26k op/s 2024-08-20T01:39:17.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.322+0000 7fb6edffb640 1 -- 172.21.15.22:0/2925777257 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a2660e1d50 con 0x55a2661f1b50 2024-08-20T01:39:17.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.322+0000 7fb6edffb640 10 client.16740 handle_command_reply: tid=0 2024-08-20T01:39:17.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.322+0000 7fb70f9f5740 1 client.16740 shutdown 2024-08-20T01:39:17.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.323+0000 7fb70f9f5740 1 -- 172.21.15.22:0/2925777257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 msgr2=0x55a266182e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:17.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.323+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/2925777257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 0x55a266182e40 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00c87c0 tx=0x7fb6f00c7a90 comp rx=0 tx=0).stop 2024-08-20T01:39:17.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.323+0000 7fb70f9f5740 1 -- 172.21.15.22:0/2925777257 shutdown_connections 2024-08-20T01:39:17.326 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.323+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/2925777257 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55a2661f1b50 0x55a2661f3f70 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:17.326 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.323+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/2925777257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a266176b80 0x55a266181630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:17.326 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.323+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/2925777257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a266174140 0x55a266182e40 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:17.326 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.323+0000 7fb70f9f5740 1 --2- 172.21.15.22:0/2925777257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a266171810 0x55a2661827a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:17.326 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.323+0000 7fb6edffb640 0 client.16740 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:17.326 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.323+0000 7fb70f9f5740 1 -- 172.21.15.22:0/2925777257 >> 172.21.15.22:0/2925777257 conn(0x55a26616c960 msgr2=0x55a26616b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:17.326 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.323+0000 7fb70f9f5740 1 -- 172.21.15.22:0/2925777257 shutdown_connections 2024-08-20T01:39:17.326 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.323+0000 7fb70f9f5740 1 -- 172.21.15.22:0/2925777257 wait complete. 2024-08-20T01:39:17.326 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.323+0000 7fb70f9f5740 20 client.16740 trim_cache size 0 max 16384 2024-08-20T01:39:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:39:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:39:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:39:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:39:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.323+0000 7fb70759e640 1 -- 172.21.15.22:0/2855959788 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb6f40b3bd0 msgr2=0x7fb6f40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.323+0000 7fb70759e640 1 --2- 172.21.15.22:0/2855959788 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb6f40b3bd0 0x7fb6f40b6090 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8005bc0 tx=0x7fb6f8005f90 comp rx=0 tx=0).stop 2024-08-20T01:39:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.323+0000 7fb70759e640 1 -- 172.21.15.22:0/2855959788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7081024e0 msgr2=0x7fb7081039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.323+0000 7fb70759e640 1 --2- 172.21.15.22:0/2855959788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7081024e0 0x7fb7081039b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009a50 tx=0x7fb6f00042f0 comp rx=0 tx=0).stop 2024-08-20T01:39:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.324+0000 7fb70759e640 1 -- 172.21.15.22:0/2855959788 shutdown_connections 2024-08-20T01:39:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.324+0000 7fb70759e640 1 --2- 172.21.15.22:0/2855959788 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb6f40b3bd0 0x7fb6f40b6090 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.324+0000 7fb70759e640 1 --2- 172.21.15.22:0/2855959788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb708102ea0 0x7fb708103ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.324+0000 7fb70759e640 1 --2- 172.21.15.22:0/2855959788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7081024e0 0x7fb7081039b0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.324+0000 7fb70759e640 1 --2- 172.21.15.22:0/2855959788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb708101390 0x7fb708105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.324+0000 7fb70759e640 1 -- 172.21.15.22:0/2855959788 >> 172.21.15.22:0/2855959788 conn(0x7fb7080fcc50 msgr2=0x7fb7080fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.324+0000 7fb70759e640 1 -- 172.21.15.22:0/2855959788 shutdown_connections 2024-08-20T01:39:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:17.324+0000 7fb70759e640 1 -- 172.21.15.22:0/2855959788 wait complete. 2024-08-20T01:39:19.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:18 smithi134 ceph-mon[22511]: pgmap v591: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 1.8 MiB/s wr, 4.25k op/s 2024-08-20T01:39:19.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:18 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:39:19.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:18 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:39:19.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:18 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:39:19.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:18 smithi077 ceph-mon[22251]: pgmap v591: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 1.8 MiB/s wr, 4.25k op/s 2024-08-20T01:39:19.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:18 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:39:19.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:18 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:39:19.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:18 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:39:19.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:18 smithi022 ceph-mon[18709]: pgmap v591: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 1.8 MiB/s wr, 4.25k op/s 2024-08-20T01:39:19.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:18 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:39:19.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:18 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:39:19.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:18 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:39:21.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:20 smithi134 ceph-mon[22511]: pgmap v592: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 1.6 MiB/s wr, 4.03k op/s 2024-08-20T01:39:21.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:20 smithi077 ceph-mon[22251]: pgmap v592: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 1.6 MiB/s wr, 4.03k op/s 2024-08-20T01:39:21.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:20 smithi022 ceph-mon[18709]: pgmap v592: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 1.6 MiB/s wr, 4.03k op/s 2024-08-20T01:39:23.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:22 smithi134 ceph-mon[22511]: pgmap v593: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.7 MiB/s wr, 4.06k op/s 2024-08-20T01:39:23.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:22 smithi077 ceph-mon[22251]: pgmap v593: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.7 MiB/s wr, 4.06k op/s 2024-08-20T01:39:23.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:22 smithi022 ceph-mon[18709]: pgmap v593: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.7 MiB/s wr, 4.06k op/s 2024-08-20T01:39:25.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:24 smithi134 ceph-mon[22511]: pgmap v594: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 1.5 MiB/s wr, 3.77k op/s 2024-08-20T01:39:25.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:24 smithi077 ceph-mon[22251]: pgmap v594: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 1.5 MiB/s wr, 3.77k op/s 2024-08-20T01:39:25.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:24 smithi022 ceph-mon[18709]: pgmap v594: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 1.5 MiB/s wr, 3.77k op/s 2024-08-20T01:39:27.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:26 smithi134 ceph-mon[22511]: pgmap v595: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 1.60k op/s 2024-08-20T01:39:27.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:26 smithi077 ceph-mon[22251]: pgmap v595: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 1.60k op/s 2024-08-20T01:39:27.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:26 smithi022 ceph-mon[18709]: pgmap v595: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 1.60k op/s 2024-08-20T01:39:29.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:28 smithi134 ceph-mon[22511]: pgmap v596: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.1 MiB/s wr, 1.61k op/s 2024-08-20T01:39:29.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:28 smithi077 ceph-mon[22251]: pgmap v596: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.1 MiB/s wr, 1.61k op/s 2024-08-20T01:39:29.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:28 smithi022 ceph-mon[18709]: pgmap v596: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.1 MiB/s wr, 1.61k op/s 2024-08-20T01:39:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.414+0000 7f215a3d9640 1 -- 172.21.15.22:0/1925787573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2154103070 msgr2=0x7f21541099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.414+0000 7f215a3d9640 1 --2- 172.21.15.22:0/1925787573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2154103070 0x7f21541099f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f214c009cd0 tx=0x7f214c02a8e0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.414+0000 7f215a3d9640 1 -- 172.21.15.22:0/1925787573 shutdown_connections 2024-08-20T01:39:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.414+0000 7f215a3d9640 1 --2- 172.21.15.22:0/1925787573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2154103070 0x7f21541099f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.414+0000 7f215a3d9640 1 --2- 172.21.15.22:0/1925787573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21541026b0 0x7f2154102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.414+0000 7f215a3d9640 1 --2- 172.21.15.22:0/1925787573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2154101560 0x7f2154101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.414+0000 7f215a3d9640 1 -- 172.21.15.22:0/1925787573 >> 172.21.15.22:0/1925787573 conn(0x7f21540fce40 msgr2=0x7f21540ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.414+0000 7f215a3d9640 1 -- 172.21.15.22:0/1925787573 shutdown_connections 2024-08-20T01:39:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.414+0000 7f215a3d9640 1 -- 172.21.15.22:0/1925787573 wait complete. 2024-08-20T01:39:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.415+0000 7f215a3d9640 1 Processor -- start 2024-08-20T01:39:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.415+0000 7f215a3d9640 1 -- start start 2024-08-20T01:39:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.415+0000 7f215a3d9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2154101560 0x7f2154105300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.415+0000 7f215a3d9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21541026b0 0x7f2154103b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.415+0000 7f215a3d9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2154103070 0x7f21541040a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.415+0000 7f215a3d9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f215410d1d0 con 0x7f2154103070 2024-08-20T01:39:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.415+0000 7f215a3d9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f215410d050 con 0x7f2154101560 2024-08-20T01:39:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.415+0000 7f215a3d9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f215410d350 con 0x7f21541026b0 2024-08-20T01:39:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.415+0000 7f2158976640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2154103070 0x7f21541040a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.415+0000 7f2153fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2154101560 0x7f2154105300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.415+0000 7f2153fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2154101560 0x7f2154105300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:52644/0 (socket says 172.21.15.22:52644) 2024-08-20T01:39:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.415+0000 7f2153fff640 1 -- 172.21.15.22:0/1713325733 learned_addr learned my addr 172.21.15.22:0/1713325733 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.415+0000 7f2158976640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2154103070 0x7f21541040a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35794/0 (socket says 172.21.15.22:35794) 2024-08-20T01:39:30.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.415+0000 7f21537fe640 1 --2- 172.21.15.22:0/1713325733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21541026b0 0x7f2154103b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:30.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.415+0000 7f2153fff640 1 -- 172.21.15.22:0/1713325733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21541026b0 msgr2=0x7f2154103b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:30.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.415+0000 7f2153fff640 1 --2- 172.21.15.22:0/1713325733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21541026b0 0x7f2154103b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.415+0000 7f2153fff640 1 -- 172.21.15.22:0/1713325733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2154103070 msgr2=0x7f21541040a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:30.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.415+0000 7f2153fff640 1 --2- 172.21.15.22:0/1713325733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2154103070 0x7f21541040a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.415+0000 7f2153fff640 1 -- 172.21.15.22:0/1713325733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2154104910 con 0x7f2154101560 2024-08-20T01:39:30.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.416+0000 7f2153fff640 1 --2- 172.21.15.22:0/1713325733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2154101560 0x7f2154105300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f214400c970 tx=0x7f214400ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:30.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.416+0000 7f21517fa640 1 -- 172.21.15.22:0/1713325733 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2144007bb0 con 0x7f2154101560 2024-08-20T01:39:30.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.416+0000 7f21517fa640 1 -- 172.21.15.22:0/1713325733 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2144007d50 con 0x7f2154101560 2024-08-20T01:39:30.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.416+0000 7f215a3d9640 1 -- 172.21.15.22:0/1713325733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21541a2b10 con 0x7f2154101560 2024-08-20T01:39:30.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.416+0000 7f21517fa640 1 -- 172.21.15.22:0/1713325733 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214400f450 con 0x7f2154101560 2024-08-20T01:39:30.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.416+0000 7f215a3d9640 1 -- 172.21.15.22:0/1713325733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21541a2fe0 con 0x7f2154101560 2024-08-20T01:39:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.418+0000 7f21517fa640 1 -- 172.21.15.22:0/1713325733 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2144004f20 con 0x7f2154101560 2024-08-20T01:39:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.418+0000 7f215d1c9740 1 Processor -- start 2024-08-20T01:39:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f215d1c9740 1 -- start start 2024-08-20T01:39:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f215d1c9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 0x55ff995e3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f215d1c9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e4200 0x55ff995e65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f215d1c9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e6c40 0x55ff995e9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f215d1c9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ff99554360 con 0x55ff995e18d0 2024-08-20T01:39:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f215d1c9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ff99543860 con 0x55ff995e6c40 2024-08-20T01:39:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f215d1c9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ff995478a0 con 0x55ff995e4200 2024-08-20T01:39:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f2158976640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 0x55ff995e3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f2158976640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 0x55ff995e3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35802/0 (socket says 172.21.15.22:35802) 2024-08-20T01:39:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f2158976640 1 -- 172.21.15.22:0/375812414 learned_addr learned my addr 172.21.15.22:0/375812414 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f21537fe640 1 --2- 172.21.15.22:0/375812414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e6c40 0x55ff995e9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f2153fff640 1 --2- 172.21.15.22:0/375812414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e4200 0x55ff995e65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f21517fa640 1 --2- 172.21.15.22:0/1713325733 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f213c0b3bd0 0x7f213c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f21537fe640 1 -- 172.21.15.22:0/375812414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e4200 msgr2=0x55ff995e65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f21537fe640 1 --2- 172.21.15.22:0/375812414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e4200 0x55ff995e65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f21537fe640 1 -- 172.21.15.22:0/375812414 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 msgr2=0x55ff995e3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f21537fe640 1 --2- 172.21.15.22:0/375812414 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 0x55ff995e3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f21537fe640 1 -- 172.21.15.22:0/375812414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff994eae40 con 0x55ff995e6c40 2024-08-20T01:39:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f2158976640 1 --2- 172.21.15.22:0/375812414 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 0x55ff995e3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f2158976640 1 --2- 172.21.15.22:0/1713325733 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f213c0b3bd0 0x7f213c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.419+0000 7f21517fa640 1 -- 172.21.15.22:0/1713325733 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f21440e3970 con 0x7f2154101560 2024-08-20T01:39:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.420+0000 7f21537fe640 1 --2- 172.21.15.22:0/375812414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e6c40 0x55ff995e9100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2148009b70 tx=0x7f21480117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8e2dc6968606d6c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.420+0000 7f213a7fc640 1 -- 172.21.15.22:0/375812414 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2148009e60 con 0x55ff995e6c40 2024-08-20T01:39:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.420+0000 7f213a7fc640 1 -- 172.21.15.22:0/375812414 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2148012900 con 0x55ff995e6c40 2024-08-20T01:39:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.420+0000 7f213a7fc640 1 -- 172.21.15.22:0/375812414 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214800f9c0 con 0x55ff995e6c40 2024-08-20T01:39:30.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.420+0000 7f215d1c9740 1 -- 172.21.15.22:0/375812414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e6c40 msgr2=0x55ff995e9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:30.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.420+0000 7f2158976640 1 --2- 172.21.15.22:0/1713325733 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f213c0b3bd0 0x7f213c0b6090 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f214c009cd0 tx=0x7f214c0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:30.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.420+0000 7f215d1c9740 1 --2- 172.21.15.22:0/375812414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e6c40 0x55ff995e9100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2148009b70 tx=0x7f21480117b0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.420+0000 7f215d1c9740 1 -- 172.21.15.22:0/375812414 shutdown_connections 2024-08-20T01:39:30.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.420+0000 7f215d1c9740 1 --2- 172.21.15.22:0/375812414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e6c40 0x55ff995e9100 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.420+0000 7f215d1c9740 1 --2- 172.21.15.22:0/375812414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e4200 0x55ff995e65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.420+0000 7f215d1c9740 1 --2- 172.21.15.22:0/375812414 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 0x55ff995e3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.420+0000 7f215d1c9740 1 -- 172.21.15.22:0/375812414 >> 172.21.15.22:0/375812414 conn(0x55ff995dca20 msgr2=0x55ff995dd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:30.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.420+0000 7f215d1c9740 1 -- 172.21.15.22:0/375812414 shutdown_connections 2024-08-20T01:39:30.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.420+0000 7f215d1c9740 1 -- 172.21.15.22:0/375812414 wait complete. 2024-08-20T01:39:30.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.421+0000 7f215d1c9740 1 -- start start 2024-08-20T01:39:30.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.421+0000 7f215d1c9740 1 Processor -- start 2024-08-20T01:39:30.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.421+0000 7f215d1c9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e18d0 0x55ff995eb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:30.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.421+0000 7f215d1c9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e4200 0x55ff995eb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:30.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.421+0000 7f215d1c9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e6c40 0x55ff995ec330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:30.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.421+0000 7f215d1c9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ff9947cab0 con 0x55ff995e4200 2024-08-20T01:39:30.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.421+0000 7f215d1c9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ff994ca780 con 0x55ff995e18d0 2024-08-20T01:39:30.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.421+0000 7f215d1c9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ff995e9c20 con 0x55ff995e6c40 2024-08-20T01:39:30.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.421+0000 7f215d1c9740 10 client.0 _ll_register_callbacks cb 0x55ff99252a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:30.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.421+0000 7f21537fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e4200 0x55ff995eb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:30.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.421+0000 7f21537fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e4200 0x55ff995eb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35818/0 (socket says 172.21.15.22:35818) 2024-08-20T01:39:30.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.421+0000 7f21537fe640 1 -- 172.21.15.22:0/1260333907 learned_addr learned my addr 172.21.15.22:0/1260333907 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:30.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.421+0000 7f2153fff640 1 --2- 172.21.15.22:0/1260333907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e18d0 0x55ff995eb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:30.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.422+0000 7f2158976640 1 --2- 172.21.15.22:0/1260333907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e6c40 0x55ff995ec330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:30.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.422+0000 7f2153fff640 1 -- 172.21.15.22:0/1260333907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e6c40 msgr2=0x55ff995ec330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:30.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.422+0000 7f2153fff640 1 --2- 172.21.15.22:0/1260333907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e6c40 0x55ff995ec330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.422+0000 7f2153fff640 1 -- 172.21.15.22:0/1260333907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e4200 msgr2=0x55ff995eb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:30.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.422+0000 7f2153fff640 1 --2- 172.21.15.22:0/1260333907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e4200 0x55ff995eb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.422+0000 7f2153fff640 1 -- 172.21.15.22:0/1260333907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff992a6790 con 0x55ff995e18d0 2024-08-20T01:39:30.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.422+0000 7f21537fe640 1 --2- 172.21.15.22:0/1260333907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e4200 0x55ff995eb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:30.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.422+0000 7f2153fff640 1 --2- 172.21.15.22:0/1260333907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e18d0 0x55ff995eb0c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f21440e1480 tx=0x7f21440a6120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e40fa6d96eeb01cb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:30.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.422+0000 7f21337fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:39:30.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.422+0000 7f21337fe640 1 -- 172.21.15.22:0/1260333907 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214401d040 con 0x55ff995e18d0 2024-08-20T01:39:30.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.422+0000 7f21337fe640 1 -- 172.21.15.22:0/1260333907 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f21440a9ae0 con 0x55ff995e18d0 2024-08-20T01:39:30.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.422+0000 7f215d1c9740 1 -- 172.21.15.22:0/1260333907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ff994f2e00 con 0x55ff995e18d0 2024-08-20T01:39:30.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.422+0000 7f21337fe640 1 -- 172.21.15.22:0/1260333907 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f21440a9ff0 con 0x55ff995e18d0 2024-08-20T01:39:30.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.422+0000 7f215d1c9740 10 client.26360 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:30.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.422+0000 7f215d1c9740 1 -- 172.21.15.22:0/1260333907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ff9931f620 con 0x55ff995e18d0 2024-08-20T01:39:30.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.422+0000 7f21337fe640 1 -- 172.21.15.22:0/1260333907 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ff994f2e00 con 0x55ff995e18d0 2024-08-20T01:39:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.423+0000 7f21337fe640 1 -- 172.21.15.22:0/1260333907 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f21440abbb0 con 0x55ff995e18d0 2024-08-20T01:39:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.423+0000 7f215d1c9740 10 client.26360 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.423+0000 7f215d1c9740 10 client.26360 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.423+0000 7f215d1c9740 20 client.26360 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.423+0000 7f215d1c9740 1 --2- 172.21.15.22:0/1260333907 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ff995f6a10 0x55ff995f8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.423+0000 7f215d1c9740 4 client.26360 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.423+0000 7f215d1c9740 1 -- 172.21.15.22:0/1260333907 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff995562b0 con 0x55ff995f6a10 2024-08-20T01:39:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.423+0000 7f21537fe640 1 --2- 172.21.15.22:0/1260333907 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ff995f6a10 0x55ff995f8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.424+0000 7f21337fe640 10 client.26360 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.424+0000 7f21537fe640 1 --2- 172.21.15.22:0/1260333907 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ff995f6a10 0x55ff995f8ea0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a7d200dcf93e1e0 server_cookie=25917db74f63a5bb in_seq=0 out_seq=0 2024-08-20T01:39:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.424+0000 7f21337fe640 1 -- 172.21.15.22:0/1260333907 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff995562b0 con 0x55ff995f6a10 2024-08-20T01:39:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.424+0000 7f21337fe640 10 client.26360 handle_command_reply: tid=0 2024-08-20T01:39:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.424+0000 7f215d1c9740 1 client.26360 shutdown 2024-08-20T01:39:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.425+0000 7f215d1c9740 1 -- 172.21.15.22:0/1260333907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e18d0 msgr2=0x55ff995eb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.425+0000 7f215d1c9740 1 --2- 172.21.15.22:0/1260333907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e18d0 0x55ff995eb0c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f21440e1480 tx=0x7f21440a6120 comp rx=0 tx=0).stop 2024-08-20T01:39:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.425+0000 7f215d1c9740 1 -- 172.21.15.22:0/1260333907 shutdown_connections 2024-08-20T01:39:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.425+0000 7f215d1c9740 1 --2- 172.21.15.22:0/1260333907 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ff995f6a10 0x55ff995f8ea0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.425+0000 7f215d1c9740 1 --2- 172.21.15.22:0/1260333907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e6c40 0x55ff995ec330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.425+0000 7f21337fe640 0 client.26360 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.425+0000 7f215d1c9740 1 --2- 172.21.15.22:0/1260333907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e4200 0x55ff995eb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.425+0000 7f215d1c9740 1 --2- 172.21.15.22:0/1260333907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e18d0 0x55ff995eb0c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.425+0000 7f215d1c9740 1 -- 172.21.15.22:0/1260333907 >> 172.21.15.22:0/1260333907 conn(0x55ff995dca20 msgr2=0x55ff995dbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.425+0000 7f215d1c9740 1 -- 172.21.15.22:0/1260333907 shutdown_connections 2024-08-20T01:39:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.425+0000 7f215d1c9740 1 -- 172.21.15.22:0/1260333907 wait complete. 2024-08-20T01:39:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.425+0000 7f215d1c9740 20 client.26360 trim_cache size 0 max 16384 2024-08-20T01:39:30.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.439+0000 7f215d1c9740 1 Processor -- start 2024-08-20T01:39:30.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.439+0000 7f215d1c9740 1 -- start start 2024-08-20T01:39:30.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.439+0000 7f215d1c9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 0x55ff995eae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:30.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.439+0000 7f215d1c9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e4200 0x55ff995f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:30.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.439+0000 7f215d1c9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e6c40 0x55ff995e8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:30.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.439+0000 7f215d1c9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f21541ae7e0 con 0x55ff995e18d0 2024-08-20T01:39:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.439+0000 7f215d1c9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f21541abff0 con 0x55ff995e6c40 2024-08-20T01:39:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.439+0000 7f215d1c9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f21541a9e40 con 0x55ff995e4200 2024-08-20T01:39:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.440+0000 7f2153fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 0x55ff995eae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.440+0000 7f2153fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 0x55ff995eae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35826/0 (socket says 172.21.15.22:35826) 2024-08-20T01:39:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.440+0000 7f2153fff640 1 -- 172.21.15.22:0/2826103143 learned_addr learned my addr 172.21.15.22:0/2826103143 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.440+0000 7f2158976640 1 --2- 172.21.15.22:0/2826103143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e6c40 0x55ff995e8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.440+0000 7f21537fe640 1 --2- 172.21.15.22:0/2826103143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e4200 0x55ff995f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.440+0000 7f2153fff640 1 -- 172.21.15.22:0/2826103143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e4200 msgr2=0x55ff995f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.440+0000 7f2153fff640 1 --2- 172.21.15.22:0/2826103143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e4200 0x55ff995f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.440+0000 7f2153fff640 1 -- 172.21.15.22:0/2826103143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e6c40 msgr2=0x55ff995e8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.440+0000 7f2153fff640 1 --2- 172.21.15.22:0/2826103143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e6c40 0x55ff995e8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.440+0000 7f2153fff640 1 -- 172.21.15.22:0/2826103143 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff995e4030 con 0x55ff995e18d0 2024-08-20T01:39:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.440+0000 7f2153fff640 1 --2- 172.21.15.22:0/2826103143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 0x55ff995eae30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f214400cfd0 tx=0x7f21440e3d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317a79de79c4cbde server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.440+0000 7f2139ffb640 1 -- 172.21.15.22:0/2826103143 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214401d070 con 0x55ff995e18d0 2024-08-20T01:39:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.440+0000 7f2139ffb640 1 -- 172.21.15.22:0/2826103143 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21440055f0 con 0x55ff995e18d0 2024-08-20T01:39:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.440+0000 7f2139ffb640 1 -- 172.21.15.22:0/2826103143 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21440aa390 con 0x55ff995e18d0 2024-08-20T01:39:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.441+0000 7f215d1c9740 1 -- 172.21.15.22:0/2826103143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 msgr2=0x55ff995eae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.441+0000 7f215d1c9740 1 --2- 172.21.15.22:0/2826103143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 0x55ff995eae30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f214400cfd0 tx=0x7f21440e3d00 comp rx=0 tx=0).stop 2024-08-20T01:39:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.441+0000 7f215d1c9740 1 -- 172.21.15.22:0/2826103143 shutdown_connections 2024-08-20T01:39:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.441+0000 7f215d1c9740 1 --2- 172.21.15.22:0/2826103143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e6c40 0x55ff995e8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.441+0000 7f215d1c9740 1 --2- 172.21.15.22:0/2826103143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e4200 0x55ff995f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.441+0000 7f215d1c9740 1 --2- 172.21.15.22:0/2826103143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 0x55ff995eae30 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.441+0000 7f215d1c9740 1 -- 172.21.15.22:0/2826103143 >> 172.21.15.22:0/2826103143 conn(0x55ff995dca20 msgr2=0x55ff995e0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.441+0000 7f215d1c9740 1 -- 172.21.15.22:0/2826103143 shutdown_connections 2024-08-20T01:39:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.441+0000 7f215d1c9740 1 -- 172.21.15.22:0/2826103143 wait complete. 2024-08-20T01:39:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.441+0000 7f215d1c9740 1 -- start start 2024-08-20T01:39:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.441+0000 7f215d1c9740 1 Processor -- start 2024-08-20T01:39:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f215d1c9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 0x55ff995f0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f215d1c9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e4200 0x55ff995f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f215d1c9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e6c40 0x55ff995f1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f215d1c9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f21541aa4b0 con 0x55ff995e18d0 2024-08-20T01:39:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f215d1c9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f21541ab920 con 0x55ff995e6c40 2024-08-20T01:39:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f215d1c9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f21541aab80 con 0x55ff995e4200 2024-08-20T01:39:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f215d1c9740 10 client.0 _ll_register_callbacks cb 0x7f21440058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f2153fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 0x55ff995f0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f2153fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 0x55ff995f0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35840/0 (socket says 172.21.15.22:35840) 2024-08-20T01:39:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f2153fff640 1 -- 172.21.15.22:0/1264505451 learned_addr learned my addr 172.21.15.22:0/1264505451 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f2158976640 1 --2- 172.21.15.22:0/1264505451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e6c40 0x55ff995f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f21537fe640 1 --2- 172.21.15.22:0/1264505451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e4200 0x55ff995f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f2153fff640 1 -- 172.21.15.22:0/1264505451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e4200 msgr2=0x55ff995f06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f2153fff640 1 --2- 172.21.15.22:0/1264505451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e4200 0x55ff995f06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f2153fff640 1 -- 172.21.15.22:0/1264505451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e6c40 msgr2=0x55ff995f1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f2153fff640 1 --2- 172.21.15.22:0/1264505451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e6c40 0x55ff995f1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f2153fff640 1 -- 172.21.15.22:0/1264505451 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff995ec6a0 con 0x55ff995e18d0 2024-08-20T01:39:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f2153fff640 1 --2- 172.21.15.22:0/1264505451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 0x55ff995f0020 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f21440a7af0 tx=0x7f2144005540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61521a1b251908e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f21337fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:39:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f21337fe640 1 -- 172.21.15.22:0/1264505451 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214401d070 con 0x55ff995e18d0 2024-08-20T01:39:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f21337fe640 1 -- 172.21.15.22:0/1264505451 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f21440cd0e0 con 0x55ff995e18d0 2024-08-20T01:39:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f215d1c9740 1 -- 172.21.15.22:0/1264505451 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ff99551d50 con 0x55ff995e18d0 2024-08-20T01:39:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f21337fe640 1 -- 172.21.15.22:0/1264505451 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f21440aa390 con 0x55ff995e18d0 2024-08-20T01:39:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f215d1c9740 10 client.16758 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.442+0000 7f215d1c9740 1 -- 172.21.15.22:0/1264505451 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ff995f2c60 con 0x55ff995e18d0 2024-08-20T01:39:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.443+0000 7f21337fe640 1 -- 172.21.15.22:0/1264505451 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ff99551d50 con 0x55ff995e18d0 2024-08-20T01:39:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.443+0000 7f21337fe640 1 -- 172.21.15.22:0/1264505451 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f21440a6280 con 0x55ff995e18d0 2024-08-20T01:39:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.443+0000 7f215d1c9740 10 client.16758 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.443+0000 7f215d1c9740 10 client.16758 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.443+0000 7f215d1c9740 20 client.16758 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.443+0000 7f215d1c9740 1 --2- 172.21.15.22:0/1264505451 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ff995f3490 0x55ff99663790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.443+0000 7f215d1c9740 4 client.16758 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:39:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.443+0000 7f215d1c9740 1 -- 172.21.15.22:0/1264505451 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ff9954f490 con 0x55ff995f3490 2024-08-20T01:39:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.443+0000 7f21537fe640 1 --2- 172.21.15.22:0/1264505451 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ff995f3490 0x55ff99663790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.444+0000 7f21537fe640 1 --2- 172.21.15.22:0/1264505451 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ff995f3490 0x55ff99663790 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61418db7287947e7 server_cookie=d3b637f87153c0fc in_seq=0 out_seq=0 2024-08-20T01:39:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.444+0000 7f21337fe640 10 client.16758 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.600+0000 7f21337fe640 1 -- 172.21.15.22:0/1264505451 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ff9954f490 con 0x55ff995f3490 2024-08-20T01:39:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.600+0000 7f21337fe640 10 client.16758 handle_command_reply: tid=0 2024-08-20T01:39:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.600+0000 7f215d1c9740 1 client.16758 shutdown 2024-08-20T01:39:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.600+0000 7f215d1c9740 1 -- 172.21.15.22:0/1264505451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 msgr2=0x55ff995f0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.600+0000 7f215d1c9740 1 --2- 172.21.15.22:0/1264505451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 0x55ff995f0020 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f21440a7af0 tx=0x7f2144005540 comp rx=0 tx=0).stop 2024-08-20T01:39:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.600+0000 7f215d1c9740 1 -- 172.21.15.22:0/1264505451 shutdown_connections 2024-08-20T01:39:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.600+0000 7f215d1c9740 1 --2- 172.21.15.22:0/1264505451 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ff995f3490 0x55ff99663790 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.600+0000 7f215d1c9740 1 --2- 172.21.15.22:0/1264505451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff995e6c40 0x55ff995f1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.600+0000 7f215d1c9740 1 --2- 172.21.15.22:0/1264505451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ff995e4200 0x55ff995f06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.600+0000 7f215d1c9740 1 --2- 172.21.15.22:0/1264505451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff995e18d0 0x55ff995f0020 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.600+0000 7f215d1c9740 1 -- 172.21.15.22:0/1264505451 >> 172.21.15.22:0/1264505451 conn(0x55ff995dca20 msgr2=0x55ff995e09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.600+0000 7f21337fe640 0 client.16758 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.601+0000 7f215d1c9740 1 -- 172.21.15.22:0/1264505451 shutdown_connections 2024-08-20T01:39:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.601+0000 7f215d1c9740 1 -- 172.21.15.22:0/1264505451 wait complete. 2024-08-20T01:39:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.601+0000 7f215d1c9740 20 client.16758 trim_cache size 0 max 16384 2024-08-20T01:39:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:39:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:39:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:39:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:39:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.601+0000 7f215a3d9640 1 -- 172.21.15.22:0/1713325733 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f213c0b3bd0 msgr2=0x7f213c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.601+0000 7f215a3d9640 1 --2- 172.21.15.22:0/1713325733 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f213c0b3bd0 0x7f213c0b6090 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f214c009cd0 tx=0x7f214c0095c0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.601+0000 7f215a3d9640 1 -- 172.21.15.22:0/1713325733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2154101560 msgr2=0x7f2154105300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.601+0000 7f215a3d9640 1 --2- 172.21.15.22:0/1713325733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2154101560 0x7f2154105300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f214400c970 tx=0x7f214400ce30 comp rx=0 tx=0).stop 2024-08-20T01:39:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.602+0000 7f215a3d9640 1 -- 172.21.15.22:0/1713325733 shutdown_connections 2024-08-20T01:39:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.602+0000 7f215a3d9640 1 --2- 172.21.15.22:0/1713325733 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f213c0b3bd0 0x7f213c0b6090 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.602+0000 7f215a3d9640 1 --2- 172.21.15.22:0/1713325733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2154103070 0x7f21541040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.602+0000 7f215a3d9640 1 --2- 172.21.15.22:0/1713325733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21541026b0 0x7f2154103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.602+0000 7f215a3d9640 1 --2- 172.21.15.22:0/1713325733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2154101560 0x7f2154105300 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.602+0000 7f215a3d9640 1 -- 172.21.15.22:0/1713325733 >> 172.21.15.22:0/1713325733 conn(0x7f21540fce40 msgr2=0x7f21540fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.602+0000 7f215a3d9640 1 -- 172.21.15.22:0/1713325733 shutdown_connections 2024-08-20T01:39:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:30.602+0000 7f215a3d9640 1 -- 172.21.15.22:0/1713325733 wait complete. 2024-08-20T01:39:31.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:30 smithi134 ceph-mon[22511]: pgmap v597: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 607 op/s 2024-08-20T01:39:31.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:30 smithi077 ceph-mon[22251]: pgmap v597: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 607 op/s 2024-08-20T01:39:31.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:30 smithi022 ceph-mon[18709]: pgmap v597: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 607 op/s 2024-08-20T01:39:33.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:32 smithi134 ceph-mon[22511]: pgmap v598: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 420 op/s 2024-08-20T01:39:33.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:32 smithi077 ceph-mon[22251]: pgmap v598: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 420 op/s 2024-08-20T01:39:33.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:32 smithi022 ceph-mon[18709]: pgmap v598: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 420 op/s 2024-08-20T01:39:35.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:34 smithi134 ceph-mon[22511]: pgmap v599: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 500 op/s 2024-08-20T01:39:35.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:34 smithi077 ceph-mon[22251]: pgmap v599: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 500 op/s 2024-08-20T01:39:35.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:34 smithi022 ceph-mon[18709]: pgmap v599: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 500 op/s 2024-08-20T01:39:37.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:36 smithi134 ceph-mon[22511]: pgmap v600: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 365 op/s 2024-08-20T01:39:37.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:36 smithi077 ceph-mon[22251]: pgmap v600: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 365 op/s 2024-08-20T01:39:37.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:36 smithi022 ceph-mon[18709]: pgmap v600: 97 pgs: 97 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 365 op/s 2024-08-20T01:39:39.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:38 smithi134 ceph-mon[22511]: pgmap v601: 97 pgs: 97 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 487 op/s 2024-08-20T01:39:39.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:38 smithi077 ceph-mon[22251]: pgmap v601: 97 pgs: 97 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 487 op/s 2024-08-20T01:39:39.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:38 smithi022 ceph-mon[18709]: pgmap v601: 97 pgs: 97 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 487 op/s 2024-08-20T01:39:40.383 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:39:40.658 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:41.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:40 smithi134 ceph-mon[22511]: pgmap v602: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 464 op/s 2024-08-20T01:39:41.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:40 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:39:41.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:40 smithi077 ceph-mon[22251]: pgmap v602: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 464 op/s 2024-08-20T01:39:41.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:40 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:39:41.095 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:40 smithi022 ceph-mon[18709]: pgmap v602: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 464 op/s 2024-08-20T01:39:41.095 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:40 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:39:41.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.185+0000 7fd877b6a640 1 -- 172.21.15.22:0/3522445943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd870108500 msgr2=0x7fd870108940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:41.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.185+0000 7fd877b6a640 1 --2- 172.21.15.22:0/3522445943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd870108500 0x7fd870108940 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd860009860 tx=0x7fd86002a340 comp rx=0 tx=0).stop 2024-08-20T01:39:41.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.185+0000 7fd877b6a640 1 -- 172.21.15.22:0/3522445943 shutdown_connections 2024-08-20T01:39:41.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.185+0000 7fd877b6a640 1 --2- 172.21.15.22:0/3522445943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd870108e80 0x7fd87010f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.185+0000 7fd877b6a640 1 --2- 172.21.15.22:0/3522445943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd870108500 0x7fd870108940 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.185+0000 7fd877b6a640 1 --2- 172.21.15.22:0/3522445943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd870102af0 0x7fd870102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.185+0000 7fd877b6a640 1 -- 172.21.15.22:0/3522445943 >> 172.21.15.22:0/3522445943 conn(0x7fd8700fe540 msgr2=0x7fd870100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:41.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.185+0000 7fd877b6a640 1 -- 172.21.15.22:0/3522445943 shutdown_connections 2024-08-20T01:39:41.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.185+0000 7fd877b6a640 1 -- 172.21.15.22:0/3522445943 wait complete. 2024-08-20T01:39:41.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.185+0000 7fd877b6a640 1 Processor -- start 2024-08-20T01:39:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.185+0000 7fd877b6a640 1 -- start start 2024-08-20T01:39:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.186+0000 7fd877b6a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd870102af0 0x7fd8700751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.186+0000 7fd877b6a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd870108500 0x7fd870075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.186+0000 7fd877b6a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd870108e80 0x7fd870075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.186+0000 7fd877b6a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd870112b40 con 0x7fd870102af0 2024-08-20T01:39:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.186+0000 7fd877b6a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd8701129c0 con 0x7fd870108500 2024-08-20T01:39:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.186+0000 7fd877b6a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd870112cc0 con 0x7fd870108e80 2024-08-20T01:39:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.186+0000 7fd875906640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd870102af0 0x7fd8700751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.186+0000 7fd875906640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd870102af0 0x7fd8700751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58854/0 (socket says 172.21.15.22:58854) 2024-08-20T01:39:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.186+0000 7fd875105640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd870108500 0x7fd870075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.186+0000 7fd875906640 1 -- 172.21.15.22:0/3560830513 learned_addr learned my addr 172.21.15.22:0/3560830513 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.186+0000 7fd876107640 1 --2- 172.21.15.22:0/3560830513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd870108e80 0x7fd870075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.186+0000 7fd875906640 1 -- 172.21.15.22:0/3560830513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd870108e80 msgr2=0x7fd870075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.186+0000 7fd875906640 1 --2- 172.21.15.22:0/3560830513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd870108e80 0x7fd870075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.186+0000 7fd875906640 1 -- 172.21.15.22:0/3560830513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd870108500 msgr2=0x7fd870075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:41.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.186+0000 7fd875906640 1 --2- 172.21.15.22:0/3560830513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd870108500 0x7fd870075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.186+0000 7fd875906640 1 -- 172.21.15.22:0/3560830513 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8701a7390 con 0x7fd870102af0 2024-08-20T01:39:41.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.187+0000 7fd875906640 1 --2- 172.21.15.22:0/3560830513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd870102af0 0x7fd8700751d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00ea60 tx=0x7fd86c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:41.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.187+0000 7fd866ffd640 1 -- 172.21.15.22:0/3560830513 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c00cde0 con 0x7fd870102af0 2024-08-20T01:39:41.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.187+0000 7fd866ffd640 1 -- 172.21.15.22:0/3560830513 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd86c0035f0 con 0x7fd870102af0 2024-08-20T01:39:41.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.187+0000 7fd866ffd640 1 -- 172.21.15.22:0/3560830513 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c010690 con 0x7fd870102af0 2024-08-20T01:39:41.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.187+0000 7fd877b6a640 1 -- 172.21.15.22:0/3560830513 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8701a7680 con 0x7fd870102af0 2024-08-20T01:39:41.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.187+0000 7fd877b6a640 1 -- 172.21.15.22:0/3560830513 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8701a7b40 con 0x7fd870102af0 2024-08-20T01:39:41.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.189+0000 7fd866ffd640 1 -- 172.21.15.22:0/3560830513 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd86c0037a0 con 0x7fd870102af0 2024-08-20T01:39:41.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.189+0000 7fd879f63740 1 Processor -- start 2024-08-20T01:39:41.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.190+0000 7fd879f63740 1 -- start start 2024-08-20T01:39:41.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.190+0000 7fd879f63740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f4830 0x55ca181f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:41.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.190+0000 7fd879f63740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca181f5150 0x55ca18200ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.190+0000 7fd879f63740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca182010e0 0x55ca182034d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.190+0000 7fd879f63740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ca1816b8e0 con 0x55ca181f5150 2024-08-20T01:39:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.190+0000 7fd879f63740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ca1815ade0 con 0x55ca181f4830 2024-08-20T01:39:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.190+0000 7fd879f63740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ca1815ee20 con 0x55ca182010e0 2024-08-20T01:39:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.190+0000 7fd876107640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f4830 0x55ca181f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.190+0000 7fd875906640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca181f5150 0x55ca18200ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.190+0000 7fd876107640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f4830 0x55ca181f4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:42912/0 (socket says 172.21.15.22:42912) 2024-08-20T01:39:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.190+0000 7fd876107640 1 -- 172.21.15.22:0/125581278 learned_addr learned my addr 172.21.15.22:0/125581278 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.190+0000 7fd875105640 1 --2- 172.21.15.22:0/125581278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca182010e0 0x55ca182034d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.191+0000 7fd876107640 1 -- 172.21.15.22:0/125581278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca182010e0 msgr2=0x55ca182034d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.191+0000 7fd876107640 1 --2- 172.21.15.22:0/125581278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca182010e0 0x55ca182034d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.191+0000 7fd876107640 1 -- 172.21.15.22:0/125581278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca181f5150 msgr2=0x55ca18200ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.191+0000 7fd876107640 1 --2- 172.21.15.22:0/125581278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca181f5150 0x55ca18200ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.191+0000 7fd876107640 1 -- 172.21.15.22:0/125581278 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca17eba650 con 0x55ca181f4830 2024-08-20T01:39:41.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.191+0000 7fd866ffd640 1 --2- 172.21.15.22:0/3560830513 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd85c0b3bd0 0x7fd85c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:41.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.191+0000 7fd876107640 1 --2- 172.21.15.22:0/125581278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f4830 0x55ca181f4c10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd868009f20 tx=0x7fd86800f890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0e85db34b21572a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:41.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.191+0000 7fd85bfff640 1 -- 172.21.15.22:0/125581278 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86801d070 con 0x55ca181f4830 2024-08-20T01:39:41.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.191+0000 7fd875906640 1 --2- 172.21.15.22:0/3560830513 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd85c0b3bd0 0x7fd85c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:41.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.191+0000 7fd866ffd640 1 -- 172.21.15.22:0/3560830513 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fd86c0e3fb0 con 0x7fd870102af0 2024-08-20T01:39:41.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.191+0000 7fd85bfff640 1 -- 172.21.15.22:0/125581278 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd86800daa0 con 0x55ca181f4830 2024-08-20T01:39:41.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.191+0000 7fd85bfff640 1 -- 172.21.15.22:0/125581278 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd868018b20 con 0x55ca181f4830 2024-08-20T01:39:41.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.192+0000 7fd879f63740 1 -- 172.21.15.22:0/125581278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f4830 msgr2=0x55ca181f4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:41.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.192+0000 7fd875906640 1 --2- 172.21.15.22:0/3560830513 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd85c0b3bd0 0x7fd85c0b6090 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd86c0e1de0 tx=0x7fd86c0e7a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:41.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.192+0000 7fd879f63740 1 --2- 172.21.15.22:0/125581278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f4830 0x55ca181f4c10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd868009f20 tx=0x7fd86800f890 comp rx=0 tx=0).stop 2024-08-20T01:39:41.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.192+0000 7fd879f63740 1 -- 172.21.15.22:0/125581278 shutdown_connections 2024-08-20T01:39:41.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.192+0000 7fd879f63740 1 --2- 172.21.15.22:0/125581278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca182010e0 0x55ca182034d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.192+0000 7fd879f63740 1 --2- 172.21.15.22:0/125581278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca181f5150 0x55ca18200ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.192+0000 7fd879f63740 1 --2- 172.21.15.22:0/125581278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f4830 0x55ca181f4c10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.192+0000 7fd879f63740 1 -- 172.21.15.22:0/125581278 >> 172.21.15.22:0/125581278 conn(0x55ca181f2660 msgr2=0x55ca181f3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:41.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.192+0000 7fd879f63740 1 -- 172.21.15.22:0/125581278 shutdown_connections 2024-08-20T01:39:41.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.192+0000 7fd879f63740 1 -- 172.21.15.22:0/125581278 wait complete. 2024-08-20T01:39:41.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.193+0000 7fd879f63740 1 -- start start 2024-08-20T01:39:41.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.193+0000 7fd879f63740 1 Processor -- start 2024-08-20T01:39:41.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.193+0000 7fd879f63740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca181f4830 0x55ca181fe060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:41.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.193+0000 7fd879f63740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f5150 0x55ca181fe5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:41.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.193+0000 7fd879f63740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca182010e0 0x55ca181feae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:41.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.193+0000 7fd879f63740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ca17fbd700 con 0x55ca182010e0 2024-08-20T01:39:41.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.193+0000 7fd879f63740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ca180e17c0 con 0x55ca181f5150 2024-08-20T01:39:41.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.193+0000 7fd879f63740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ca18203d90 con 0x55ca181f4830 2024-08-20T01:39:41.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.193+0000 7fd879f63740 10 client.0 _ll_register_callbacks cb 0x55ca181546b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:41.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.193+0000 7fd876107640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca181f4830 0x55ca181fe060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:41.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.194+0000 7fd875105640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f5150 0x55ca181fe5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:41.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.194+0000 7fd876107640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca181f4830 0x55ca181fe060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:58040/0 (socket says 172.21.15.22:58040) 2024-08-20T01:39:41.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.194+0000 7fd876107640 1 -- 172.21.15.22:0/530057869 learned_addr learned my addr 172.21.15.22:0/530057869 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:41.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.194+0000 7fd876107640 1 --2- 172.21.15.22:0/530057869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca182010e0 0x55ca181feae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:41.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.194+0000 7fd876107640 1 -- 172.21.15.22:0/530057869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f5150 msgr2=0x55ca181fe5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:41.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.194+0000 7fd876107640 1 --2- 172.21.15.22:0/530057869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f5150 0x55ca181fe5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.194+0000 7fd876107640 1 -- 172.21.15.22:0/530057869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca182010e0 msgr2=0x55ca181feae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:41.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.194+0000 7fd876107640 1 --2- 172.21.15.22:0/530057869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca182010e0 0x55ca181feae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.194+0000 7fd876107640 1 -- 172.21.15.22:0/530057869 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca1820d140 con 0x55ca181f4830 2024-08-20T01:39:41.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.194+0000 7fd875105640 1 --2- 172.21.15.22:0/530057869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f5150 0x55ca181fe5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:41.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.194+0000 7fd876107640 1 --2- 172.21.15.22:0/530057869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca181f4830 0x55ca181fe060 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd868000f80 tx=0x7fd868018780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=550fec043c61e4a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:41.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.194+0000 7fd8597fa640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:39:41.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.194+0000 7fd8597fa640 1 -- 172.21.15.22:0/530057869 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86802b060 con 0x55ca181f4830 2024-08-20T01:39:41.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.194+0000 7fd8597fa640 1 -- 172.21.15.22:0/530057869 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fd868004b00 con 0x55ca181f4830 2024-08-20T01:39:41.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.194+0000 7fd879f63740 1 -- 172.21.15.22:0/530057869 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ca1810a100 con 0x55ca181f4830 2024-08-20T01:39:41.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.195+0000 7fd8597fa640 1 -- 172.21.15.22:0/530057869 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd86801d040 con 0x55ca181f4830 2024-08-20T01:39:41.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.195+0000 7fd879f63740 10 client.26425 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:41.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.195+0000 7fd879f63740 1 -- 172.21.15.22:0/530057869 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ca1820fab0 con 0x55ca181f4830 2024-08-20T01:39:41.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.195+0000 7fd8597fa640 1 -- 172.21.15.22:0/530057869 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ca1810a100 con 0x55ca181f4830 2024-08-20T01:39:41.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.195+0000 7fd8597fa640 1 -- 172.21.15.22:0/530057869 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fd868023070 con 0x55ca181f4830 2024-08-20T01:39:41.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.195+0000 7fd879f63740 10 client.26425 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:41.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.195+0000 7fd879f63740 10 client.26425 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:41.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.195+0000 7fd879f63740 20 client.26425 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:41.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.195+0000 7fd879f63740 1 --2- 172.21.15.22:0/530057869 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ca182112d0 0x55ca18213710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:41.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.195+0000 7fd879f63740 4 client.26425 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:41.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.195+0000 7fd879f63740 1 -- 172.21.15.22:0/530057869 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca1816d830 con 0x55ca182112d0 2024-08-20T01:39:41.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.195+0000 7fd875105640 1 --2- 172.21.15.22:0/530057869 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ca182112d0 0x55ca18213710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:41.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.196+0000 7fd875105640 1 --2- 172.21.15.22:0/530057869 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ca182112d0 0x55ca18213710 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88fecc20fc1e3c9b server_cookie=5942be45f4aa3464 in_seq=0 out_seq=0 2024-08-20T01:39:41.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.196+0000 7fd8597fa640 10 client.26425 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:41.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.196+0000 7fd8597fa640 1 -- 172.21.15.22:0/530057869 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca1816d830 con 0x55ca182112d0 2024-08-20T01:39:41.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.196+0000 7fd8597fa640 10 client.26425 handle_command_reply: tid=0 2024-08-20T01:39:41.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.196+0000 7fd879f63740 1 client.26425 shutdown 2024-08-20T01:39:41.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.197+0000 7fd879f63740 1 -- 172.21.15.22:0/530057869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca181f4830 msgr2=0x55ca181fe060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:41.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.197+0000 7fd879f63740 1 --2- 172.21.15.22:0/530057869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca181f4830 0x55ca181fe060 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd868000f80 tx=0x7fd868018780 comp rx=0 tx=0).stop 2024-08-20T01:39:41.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.197+0000 7fd879f63740 1 -- 172.21.15.22:0/530057869 shutdown_connections 2024-08-20T01:39:41.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.197+0000 7fd879f63740 1 --2- 172.21.15.22:0/530057869 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ca182112d0 0x55ca18213710 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.197+0000 7fd879f63740 1 --2- 172.21.15.22:0/530057869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca182010e0 0x55ca181feae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.197+0000 7fd879f63740 1 --2- 172.21.15.22:0/530057869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f5150 0x55ca181fe5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.197+0000 7fd879f63740 1 --2- 172.21.15.22:0/530057869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca181f4830 0x55ca181fe060 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.197+0000 7fd879f63740 1 -- 172.21.15.22:0/530057869 >> 172.21.15.22:0/530057869 conn(0x55ca181f2660 msgr2=0x55ca181f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:41.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.197+0000 7fd8597fa640 0 client.26425 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:41.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.197+0000 7fd879f63740 1 -- 172.21.15.22:0/530057869 shutdown_connections 2024-08-20T01:39:41.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.197+0000 7fd879f63740 1 -- 172.21.15.22:0/530057869 wait complete. 2024-08-20T01:39:41.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.197+0000 7fd879f63740 20 client.26425 trim_cache size 0 max 16384 2024-08-20T01:39:41.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.214+0000 7fd879f63740 1 Processor -- start 2024-08-20T01:39:41.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.214+0000 7fd879f63740 1 -- start start 2024-08-20T01:39:41.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.215+0000 7fd879f63740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f4830 0x55ca181fe560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.215+0000 7fd879f63740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca181f5150 0x55ca181feaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.215+0000 7fd879f63740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca182010e0 0x55ca1820c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.215+0000 7fd879f63740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd8701b2dd0 con 0x55ca182010e0 2024-08-20T01:39:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.215+0000 7fd879f63740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd8701b05e0 con 0x55ca181f4830 2024-08-20T01:39:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.215+0000 7fd879f63740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd8701ae430 con 0x55ca181f5150 2024-08-20T01:39:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.215+0000 7fd875105640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca181f5150 0x55ca181feaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.215+0000 7fd875105640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca181f5150 0x55ca181feaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:58042/0 (socket says 172.21.15.22:58042) 2024-08-20T01:39:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.215+0000 7fd876107640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca182010e0 0x55ca1820c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.215+0000 7fd875105640 1 -- 172.21.15.22:0/760479338 learned_addr learned my addr 172.21.15.22:0/760479338 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.215+0000 7fd876107640 1 --2- 172.21.15.22:0/760479338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f4830 0x55ca181fe560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.215+0000 7fd875105640 1 -- 172.21.15.22:0/760479338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f4830 msgr2=0x55ca181fe560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.215+0000 7fd875105640 1 --2- 172.21.15.22:0/760479338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f4830 0x55ca181fe560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.215+0000 7fd875105640 1 -- 172.21.15.22:0/760479338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca182010e0 msgr2=0x55ca1820c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.215+0000 7fd875105640 1 --2- 172.21.15.22:0/760479338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca182010e0 0x55ca1820c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.215+0000 7fd875105640 1 -- 172.21.15.22:0/760479338 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca181f3340 con 0x55ca181f5150 2024-08-20T01:39:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.215+0000 7fd875105640 1 --2- 172.21.15.22:0/760479338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca181f5150 0x55ca181feaa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd86002a860 tx=0x7fd8600058d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25c0a4447dbf3353 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.216+0000 7fd85b7fe640 1 -- 172.21.15.22:0/760479338 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86004e070 con 0x55ca181f5150 2024-08-20T01:39:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.216+0000 7fd85b7fe640 1 -- 172.21.15.22:0/760479338 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd860030b50 con 0x55ca181f5150 2024-08-20T01:39:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.216+0000 7fd85b7fe640 1 -- 172.21.15.22:0/760479338 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd860037040 con 0x55ca181f5150 2024-08-20T01:39:41.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.216+0000 7fd879f63740 1 -- 172.21.15.22:0/760479338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca181f5150 msgr2=0x55ca181feaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:41.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.216+0000 7fd879f63740 1 --2- 172.21.15.22:0/760479338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca181f5150 0x55ca181feaa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd86002a860 tx=0x7fd8600058d0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.216+0000 7fd879f63740 1 -- 172.21.15.22:0/760479338 shutdown_connections 2024-08-20T01:39:41.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.216+0000 7fd879f63740 1 --2- 172.21.15.22:0/760479338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca182010e0 0x55ca1820c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.216+0000 7fd879f63740 1 --2- 172.21.15.22:0/760479338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca181f5150 0x55ca181feaa0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.216+0000 7fd879f63740 1 --2- 172.21.15.22:0/760479338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f4830 0x55ca181fe560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.216+0000 7fd879f63740 1 -- 172.21.15.22:0/760479338 >> 172.21.15.22:0/760479338 conn(0x55ca181f2660 msgr2=0x55ca1820bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:41.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.217+0000 7fd879f63740 1 -- 172.21.15.22:0/760479338 shutdown_connections 2024-08-20T01:39:41.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.217+0000 7fd879f63740 1 -- 172.21.15.22:0/760479338 wait complete. 2024-08-20T01:39:41.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.217+0000 7fd879f63740 1 -- start start 2024-08-20T01:39:41.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.217+0000 7fd879f63740 1 Processor -- start 2024-08-20T01:39:41.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.217+0000 7fd879f63740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f4830 0x55ca182045f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:41.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.217+0000 7fd879f63740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca181f5150 0x55ca18204b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:41.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.217+0000 7fd879f63740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca182010e0 0x55ca18279fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:41.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.218+0000 7fd879f63740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd8701aeaa0 con 0x55ca181f5150 2024-08-20T01:39:41.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.218+0000 7fd879f63740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd8701aff10 con 0x55ca181f4830 2024-08-20T01:39:41.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.218+0000 7fd879f63740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd8701af170 con 0x55ca182010e0 2024-08-20T01:39:41.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.218+0000 7fd879f63740 10 client.0 _ll_register_callbacks cb 0x7fd86801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:41.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.218+0000 7fd876107640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f4830 0x55ca182045f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:41.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.218+0000 7fd875105640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca181f5150 0x55ca18204b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:41.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.218+0000 7fd876107640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f4830 0x55ca182045f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:42938/0 (socket says 172.21.15.22:42938) 2024-08-20T01:39:41.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.218+0000 7fd876107640 1 -- 172.21.15.22:0/2983469800 learned_addr learned my addr 172.21.15.22:0/2983469800 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:41.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.218+0000 7fd876107640 1 --2- 172.21.15.22:0/2983469800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca182010e0 0x55ca18279fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:41.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.218+0000 7fd875105640 1 -- 172.21.15.22:0/2983469800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca182010e0 msgr2=0x55ca18279fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:41.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.218+0000 7fd875105640 1 --2- 172.21.15.22:0/2983469800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca182010e0 0x55ca18279fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.218+0000 7fd875105640 1 -- 172.21.15.22:0/2983469800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f4830 msgr2=0x55ca182045f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:41.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.218+0000 7fd875105640 1 --2- 172.21.15.22:0/2983469800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f4830 0x55ca182045f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.218+0000 7fd875105640 1 -- 172.21.15.22:0/2983469800 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca1827a5d0 con 0x55ca181f5150 2024-08-20T01:39:41.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.218+0000 7fd876107640 1 --2- 172.21.15.22:0/2983469800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f4830 0x55ca182045f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.218+0000 7fd875105640 1 --2- 172.21.15.22:0/2983469800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca181f5150 0x55ca18204b30 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd860005940 tx=0x7fd860030f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8648aec58273eae0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.218+0000 7fd8597fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:39:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.218+0000 7fd8597fa640 1 -- 172.21.15.22:0/2983469800 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86004e070 con 0x55ca181f5150 2024-08-20T01:39:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.219+0000 7fd8597fa640 1 -- 172.21.15.22:0/2983469800 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fd860030610 con 0x55ca181f5150 2024-08-20T01:39:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.219+0000 7fd879f63740 1 -- 172.21.15.22:0/2983469800 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd860030b50 con 0x55ca181f5150 2024-08-20T01:39:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.219+0000 7fd8597fa640 1 -- 172.21.15.22:0/2983469800 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd860037040 con 0x55ca181f5150 2024-08-20T01:39:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.219+0000 7fd879f63740 10 client.16776 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.219+0000 7fd879f63740 1 -- 172.21.15.22:0/2983469800 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ca1827b8e0 con 0x55ca181f5150 2024-08-20T01:39:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.219+0000 7fd8597fa640 1 -- 172.21.15.22:0/2983469800 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd860030b50 con 0x55ca181f5150 2024-08-20T01:39:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.219+0000 7fd8597fa640 1 -- 172.21.15.22:0/2983469800 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fd860003b40 con 0x55ca181f5150 2024-08-20T01:39:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.219+0000 7fd879f63740 10 client.16776 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.219+0000 7fd879f63740 10 client.16776 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.219+0000 7fd879f63740 20 client.16776 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.219+0000 7fd879f63740 1 --2- 172.21.15.22:0/2983469800 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ca1827bfc0 0x55ca1827e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.219+0000 7fd879f63740 4 client.16776 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:39:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.219+0000 7fd879f63740 1 -- 172.21.15.22:0/2983469800 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ca181692d0 con 0x55ca1827bfc0 2024-08-20T01:39:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.220+0000 7fd876107640 1 --2- 172.21.15.22:0/2983469800 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ca1827bfc0 0x55ca1827e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.220+0000 7fd8597fa640 10 client.16776 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.220+0000 7fd876107640 1 --2- 172.21.15.22:0/2983469800 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ca1827bfc0 0x55ca1827e3e0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66a6c42882971ebf server_cookie=a55cfb2e616eeff in_seq=0 out_seq=0 2024-08-20T01:39:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.220+0000 7fd8597fa640 1 -- 172.21.15.22:0/2983469800 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ca181692d0 con 0x55ca1827bfc0 2024-08-20T01:39:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.220+0000 7fd8597fa640 10 client.16776 handle_command_reply: tid=0 2024-08-20T01:39:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.220+0000 7fd879f63740 1 client.16776 shutdown 2024-08-20T01:39:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.220+0000 7fd879f63740 1 -- 172.21.15.22:0/2983469800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca181f5150 msgr2=0x55ca18204b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.220+0000 7fd879f63740 1 --2- 172.21.15.22:0/2983469800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca181f5150 0x55ca18204b30 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd860005940 tx=0x7fd860030f10 comp rx=0 tx=0).stop 2024-08-20T01:39:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.220+0000 7fd879f63740 1 -- 172.21.15.22:0/2983469800 shutdown_connections 2024-08-20T01:39:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.220+0000 7fd879f63740 1 --2- 172.21.15.22:0/2983469800 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ca1827bfc0 0x55ca1827e3e0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.220+0000 7fd879f63740 1 --2- 172.21.15.22:0/2983469800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca182010e0 0x55ca18279fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.220+0000 7fd879f63740 1 --2- 172.21.15.22:0/2983469800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca181f5150 0x55ca18204b30 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.220+0000 7fd8597fa640 0 client.16776 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:41.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.220+0000 7fd879f63740 1 --2- 172.21.15.22:0/2983469800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca181f4830 0x55ca182045f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.220+0000 7fd879f63740 1 -- 172.21.15.22:0/2983469800 >> 172.21.15.22:0/2983469800 conn(0x55ca181f2660 msgr2=0x55ca1820c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:41.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.221+0000 7fd879f63740 1 -- 172.21.15.22:0/2983469800 shutdown_connections 2024-08-20T01:39:41.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.221+0000 7fd879f63740 1 -- 172.21.15.22:0/2983469800 wait complete. 2024-08-20T01:39:41.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.221+0000 7fd879f63740 20 client.16776 trim_cache size 0 max 16384 2024-08-20T01:39:41.228 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:39:41.228 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-08-20T01:39:41.228 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-08-20T01:39:41.228 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:39:41.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.221+0000 7fd877b6a640 1 -- 172.21.15.22:0/3560830513 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd85c0b3bd0 msgr2=0x7fd85c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:41.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.221+0000 7fd877b6a640 1 --2- 172.21.15.22:0/3560830513 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd85c0b3bd0 0x7fd85c0b6090 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd86c0e1de0 tx=0x7fd86c0e7a90 comp rx=0 tx=0).stop 2024-08-20T01:39:41.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.221+0000 7fd877b6a640 1 -- 172.21.15.22:0/3560830513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd870102af0 msgr2=0x7fd8700751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:41.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.221+0000 7fd877b6a640 1 --2- 172.21.15.22:0/3560830513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd870102af0 0x7fd8700751d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00ea60 tx=0x7fd86c00ef20 comp rx=0 tx=0).stop 2024-08-20T01:39:41.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.222+0000 7fd877b6a640 1 -- 172.21.15.22:0/3560830513 shutdown_connections 2024-08-20T01:39:41.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.222+0000 7fd877b6a640 1 --2- 172.21.15.22:0/3560830513 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd85c0b3bd0 0x7fd85c0b6090 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.222+0000 7fd877b6a640 1 --2- 172.21.15.22:0/3560830513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd870108e80 0x7fd870075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.222+0000 7fd877b6a640 1 --2- 172.21.15.22:0/3560830513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd870108500 0x7fd870075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.222+0000 7fd877b6a640 1 --2- 172.21.15.22:0/3560830513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd870102af0 0x7fd8700751d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:41.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.222+0000 7fd877b6a640 1 -- 172.21.15.22:0/3560830513 >> 172.21.15.22:0/3560830513 conn(0x7fd8700fe540 msgr2=0x7fd870100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:41.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.222+0000 7fd877b6a640 1 -- 172.21.15.22:0/3560830513 shutdown_connections 2024-08-20T01:39:41.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:41.222+0000 7fd877b6a640 1 -- 172.21.15.22:0/3560830513 wait complete. 2024-08-20T01:39:41.992 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:41 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:39:41.992 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:41 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:39:41.992 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:41 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:39:42.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:41 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:39:42.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:41 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:39:42.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:41 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:39:42.036 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:39:42.037 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:39:42.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:41 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:39:42.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:41 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:39:42.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:41 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:39:42.306 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.772+0000 7efc8010e640 1 -- 172.21.15.22:0/3043664402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc78104270 msgr2=0x7efc7810c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.772+0000 7efc8010e640 1 --2- 172.21.15.22:0/3043664402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc78104270 0x7efc7810c850 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7efc68009900 tx=0x7efc6802a410 comp rx=0 tx=0).stop 2024-08-20T01:39:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.772+0000 7efc8010e640 1 -- 172.21.15.22:0/3043664402 shutdown_connections 2024-08-20T01:39:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.772+0000 7efc8010e640 1 --2- 172.21.15.22:0/3043664402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc7810ce20 0x7efc7810f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.772+0000 7efc8010e640 1 --2- 172.21.15.22:0/3043664402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc78104270 0x7efc7810c850 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.772+0000 7efc8010e640 1 --2- 172.21.15.22:0/3043664402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc78103870 0x7efc78103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.772+0000 7efc8010e640 1 -- 172.21.15.22:0/3043664402 >> 172.21.15.22:0/3043664402 conn(0x7efc780fd400 msgr2=0x7efc780ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.772+0000 7efc8010e640 1 -- 172.21.15.22:0/3043664402 shutdown_connections 2024-08-20T01:39:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.772+0000 7efc8010e640 1 -- 172.21.15.22:0/3043664402 wait complete. 2024-08-20T01:39:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.773+0000 7efc8010e640 1 Processor -- start 2024-08-20T01:39:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.773+0000 7efc8010e640 1 -- start start 2024-08-20T01:39:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.773+0000 7efc8010e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc78103870 0x7efc781016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.773+0000 7efc8010e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc78104270 0x7efc78101c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.773+0000 7efc8010e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc7810ce20 0x7efc78102170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.773+0000 7efc8010e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efc78112a60 con 0x7efc78103870 2024-08-20T01:39:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.773+0000 7efc8010e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efc781128e0 con 0x7efc7810ce20 2024-08-20T01:39:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.773+0000 7efc8010e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efc78112be0 con 0x7efc78104270 2024-08-20T01:39:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.773+0000 7efc7deaa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc78103870 0x7efc781016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.773+0000 7efc7deaa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc78103870 0x7efc781016f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58896/0 (socket says 172.21.15.22:58896) 2024-08-20T01:39:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.773+0000 7efc7deaa640 1 -- 172.21.15.22:0/154175362 learned_addr learned my addr 172.21.15.22:0/154175362 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.773+0000 7efc7d6a9640 1 --2- 172.21.15.22:0/154175362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc78104270 0x7efc78101c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.773+0000 7efc7e6ab640 1 --2- 172.21.15.22:0/154175362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc7810ce20 0x7efc78102170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.774+0000 7efc7deaa640 1 -- 172.21.15.22:0/154175362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc78104270 msgr2=0x7efc78101c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.774+0000 7efc7deaa640 1 --2- 172.21.15.22:0/154175362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc78104270 0x7efc78101c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.774+0000 7efc7deaa640 1 -- 172.21.15.22:0/154175362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc7810ce20 msgr2=0x7efc78102170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.774+0000 7efc7deaa640 1 --2- 172.21.15.22:0/154175362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc7810ce20 0x7efc78102170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.774+0000 7efc7deaa640 1 -- 172.21.15.22:0/154175362 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc781a7370 con 0x7efc78103870 2024-08-20T01:39:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.774+0000 7efc7deaa640 1 --2- 172.21.15.22:0/154175362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc78103870 0x7efc781016f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7efc7400e9f0 tx=0x7efc7400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.774+0000 7efc6effd640 1 -- 172.21.15.22:0/154175362 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7400cd80 con 0x7efc78103870 2024-08-20T01:39:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.774+0000 7efc8010e640 1 -- 172.21.15.22:0/154175362 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc781a7660 con 0x7efc78103870 2024-08-20T01:39:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.774+0000 7efc6effd640 1 -- 172.21.15.22:0/154175362 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc740054d0 con 0x7efc78103870 2024-08-20T01:39:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.774+0000 7efc6effd640 1 -- 172.21.15.22:0/154175362 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc74010690 con 0x7efc78103870 2024-08-20T01:39:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.774+0000 7efc8010e640 1 -- 172.21.15.22:0/154175362 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc781a7b20 con 0x7efc78103870 2024-08-20T01:39:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.775+0000 7efc8010e640 1 -- 172.21.15.22:0/154175362 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc78103c50 con 0x7efc78103870 2024-08-20T01:39:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.776+0000 7efc6effd640 1 -- 172.21.15.22:0/154175362 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7efc74004e30 con 0x7efc78103870 2024-08-20T01:39:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.777+0000 7efc6effd640 1 --2- 172.21.15.22:0/154175362 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efc640b3bd0 0x7efc640b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.777+0000 7efc7d6a9640 1 --2- 172.21.15.22:0/154175362 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efc640b3bd0 0x7efc640b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.777+0000 7efc6effd640 1 -- 172.21.15.22:0/154175362 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7efc740e4270 con 0x7efc78103870 2024-08-20T01:39:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.778+0000 7efc7d6a9640 1 --2- 172.21.15.22:0/154175362 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efc640b3bd0 0x7efc640b6090 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efc68031440 tx=0x7efc68005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:42.780+0000 7efc6effd640 1 -- 172.21.15.22:0/154175362 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7efc74055e20 con 0x7efc78103870 2024-08-20T01:39:43.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:43.009+0000 7efc8010e640 1 -- 172.21.15.22:0/154175362 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc781029f0 con 0x7efc78103870 2024-08-20T01:39:43.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:42 smithi022 ceph-mon[18709]: pgmap v603: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 502 op/s 2024-08-20T01:39:43.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:43.010+0000 7efc6effd640 1 -- 172.21.15.22:0/154175362 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11915 (secure 0 0 0) 0x7efc781029f0 con 0x7efc78103870 2024-08-20T01:39:43.013 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:39:43.014 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":31,"btime":"2024-08-20T01:36:38:097249+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:36:37.446760+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24586,24575,24565]},"id":1}]} 2024-08-20T01:39:43.014 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 31 2024-08-20T01:39:43.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:42 smithi134 ceph-mon[22511]: pgmap v603: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 502 op/s 2024-08-20T01:39:43.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:43.014+0000 7efc8010e640 1 -- 172.21.15.22:0/154175362 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efc640b3bd0 msgr2=0x7efc640b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:43.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:43.014+0000 7efc8010e640 1 --2- 172.21.15.22:0/154175362 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efc640b3bd0 0x7efc640b6090 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efc68031440 tx=0x7efc68005b50 comp rx=0 tx=0).stop 2024-08-20T01:39:43.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:43.014+0000 7efc8010e640 1 -- 172.21.15.22:0/154175362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc78103870 msgr2=0x7efc781016f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:43.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:43.014+0000 7efc8010e640 1 --2- 172.21.15.22:0/154175362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc78103870 0x7efc781016f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7efc7400e9f0 tx=0x7efc7400edf0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:43.014+0000 7efc8010e640 1 -- 172.21.15.22:0/154175362 shutdown_connections 2024-08-20T01:39:43.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:43.014+0000 7efc8010e640 1 --2- 172.21.15.22:0/154175362 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efc640b3bd0 0x7efc640b6090 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:43.014+0000 7efc8010e640 1 --2- 172.21.15.22:0/154175362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc7810ce20 0x7efc78102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:43.014+0000 7efc8010e640 1 --2- 172.21.15.22:0/154175362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc78104270 0x7efc78101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:43.014+0000 7efc8010e640 1 --2- 172.21.15.22:0/154175362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc78103870 0x7efc781016f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:43.014+0000 7efc8010e640 1 -- 172.21.15.22:0/154175362 >> 172.21.15.22:0/154175362 conn(0x7efc780fd400 msgr2=0x7efc780fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:43.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:43.015+0000 7efc8010e640 1 -- 172.21.15.22:0/154175362 shutdown_connections 2024-08-20T01:39:43.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:43.015+0000 7efc8010e640 1 -- 172.21.15.22:0/154175362 wait complete. 2024-08-20T01:39:43.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:42 smithi077 ceph-mon[22251]: pgmap v603: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 502 op/s 2024-08-20T01:39:43.690 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:39:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.694+0000 7fa6d2a5f640 1 -- 172.21.15.22:0/3404802725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6cc104170 msgr2=0x7fa6cc10aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.694+0000 7fa6d2a5f640 1 --2- 172.21.15.22:0/3404802725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6cc104170 0x7fa6cc10aaf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009be0 tx=0x7fa6c402a6c0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.694+0000 7fa6d2a5f640 1 -- 172.21.15.22:0/3404802725 shutdown_connections 2024-08-20T01:39:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.694+0000 7fa6d2a5f640 1 --2- 172.21.15.22:0/3404802725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6cc104170 0x7fa6cc10aaf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.694+0000 7fa6d2a5f640 1 --2- 172.21.15.22:0/3404802725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6cc1037b0 0x7fa6cc103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.694+0000 7fa6d2a5f640 1 --2- 172.21.15.22:0/3404802725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6cc102660 0x7fa6cc102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.694+0000 7fa6d2a5f640 1 -- 172.21.15.22:0/3404802725 >> 172.21.15.22:0/3404802725 conn(0x7fa6cc0fdf20 msgr2=0x7fa6cc100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.694+0000 7fa6d2a5f640 1 -- 172.21.15.22:0/3404802725 shutdown_connections 2024-08-20T01:39:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.694+0000 7fa6d2a5f640 1 -- 172.21.15.22:0/3404802725 wait complete. 2024-08-20T01:39:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.695+0000 7fa6d2a5f640 1 Processor -- start 2024-08-20T01:39:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.695+0000 7fa6d2a5f640 1 -- start start 2024-08-20T01:39:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.695+0000 7fa6d2a5f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6cc102660 0x7fa6cc198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.695+0000 7fa6d2a5f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6cc1037b0 0x7fa6cc1990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.695+0000 7fa6d2a5f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6cc104170 0x7fa6cc199cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.695+0000 7fa6d2a5f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc10e2d0 con 0x7fa6cc104170 2024-08-20T01:39:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.695+0000 7fa6d2a5f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc10e150 con 0x7fa6cc1037b0 2024-08-20T01:39:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.695+0000 7fa6d2a5f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc10e450 con 0x7fa6cc102660 2024-08-20T01:39:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.695+0000 7fa6d0ffc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6cc104170 0x7fa6cc199cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.695+0000 7fa6d0ffc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6cc104170 0x7fa6cc199cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58914/0 (socket says 172.21.15.22:58914) 2024-08-20T01:39:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.695+0000 7fa6d0ffc640 1 -- 172.21.15.22:0/1589496851 learned_addr learned my addr 172.21.15.22:0/1589496851 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.695+0000 7fa6c37fe640 1 --2- 172.21.15.22:0/1589496851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6cc1037b0 0x7fa6cc1990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.695+0000 7fa6cbfff640 1 --2- 172.21.15.22:0/1589496851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6cc102660 0x7fa6cc198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.696+0000 7fa6d0ffc640 1 -- 172.21.15.22:0/1589496851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6cc102660 msgr2=0x7fa6cc198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:43.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.696+0000 7fa6d0ffc640 1 --2- 172.21.15.22:0/1589496851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6cc102660 0x7fa6cc198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.696+0000 7fa6d0ffc640 1 -- 172.21.15.22:0/1589496851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6cc1037b0 msgr2=0x7fa6cc1990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:43.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.696+0000 7fa6d0ffc640 1 --2- 172.21.15.22:0/1589496851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6cc1037b0 0x7fa6cc1990a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.696+0000 7fa6d0ffc640 1 -- 172.21.15.22:0/1589496851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6cc19a590 con 0x7fa6cc104170 2024-08-20T01:39:43.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.696+0000 7fa6c37fe640 1 --2- 172.21.15.22:0/1589496851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6cc1037b0 0x7fa6cc1990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:43.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.696+0000 7fa6d0ffc640 1 --2- 172.21.15.22:0/1589496851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6cc104170 0x7fa6cc199cd0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4034040 tx=0x7fa6c4030e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:43.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.696+0000 7fa6c9ffb640 1 -- 172.21.15.22:0/1589496851 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4041020 con 0x7fa6cc104170 2024-08-20T01:39:43.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.696+0000 7fa6c9ffb640 1 -- 172.21.15.22:0/1589496851 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6c40318f0 con 0x7fa6cc104170 2024-08-20T01:39:43.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.696+0000 7fa6d2a5f640 1 -- 172.21.15.22:0/1589496851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6cc19a820 con 0x7fa6cc104170 2024-08-20T01:39:43.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.696+0000 7fa6c9ffb640 1 -- 172.21.15.22:0/1589496851 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4036040 con 0x7fa6cc104170 2024-08-20T01:39:43.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.696+0000 7fa6d2a5f640 1 -- 172.21.15.22:0/1589496851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6cc19ab30 con 0x7fa6cc104170 2024-08-20T01:39:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.699+0000 7fa6d584c740 1 Processor -- start 2024-08-20T01:39:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.700+0000 7fa6c9ffb640 1 -- 172.21.15.22:0/1589496851 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa6c4044020 con 0x7fa6cc104170 2024-08-20T01:39:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.700+0000 7fa6d584c740 1 -- start start 2024-08-20T01:39:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.700+0000 7fa6d584c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1bccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.700+0000 7fa6d584c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1bd200 0x55d2ab1bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.700+0000 7fa6d584c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1bfc40 0x55d2ab1c2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.700+0000 7fa6d584c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d2ab12d360 con 0x55d2ab1ba8d0 2024-08-20T01:39:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.700+0000 7fa6d584c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d2ab11c860 con 0x55d2ab1bfc40 2024-08-20T01:39:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.700+0000 7fa6d584c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d2ab1208a0 con 0x55d2ab1bd200 2024-08-20T01:39:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.700+0000 7fa6c37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1bccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.700+0000 7fa6c37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1bccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58924/0 (socket says 172.21.15.22:58924) 2024-08-20T01:39:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.700+0000 7fa6c37fe640 1 -- 172.21.15.22:0/1046368036 learned_addr learned my addr 172.21.15.22:0/1046368036 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.700+0000 7fa6cbfff640 1 --2- 172.21.15.22:0/1046368036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1bd200 0x55d2ab1bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.700+0000 7fa6c37fe640 1 --2- 172.21.15.22:0/1046368036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1bfc40 0x55d2ab1c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.701+0000 7fa6c37fe640 1 -- 172.21.15.22:0/1046368036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1bd200 msgr2=0x55d2ab1bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.701+0000 7fa6c37fe640 1 --2- 172.21.15.22:0/1046368036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1bd200 0x55d2ab1bf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.701+0000 7fa6c37fe640 1 -- 172.21.15.22:0/1046368036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1bfc40 msgr2=0x55d2ab1c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.701+0000 7fa6c37fe640 1 --2- 172.21.15.22:0/1046368036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1bfc40 0x55d2ab1c2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.701+0000 7fa6c37fe640 1 -- 172.21.15.22:0/1046368036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2ab0c3e40 con 0x55d2ab1ba8d0 2024-08-20T01:39:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.701+0000 7fa6c9ffb640 1 --2- 172.21.15.22:0/1589496851 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa6b80b3bd0 0x7fa6b80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.701+0000 7fa6cbfff640 1 --2- 172.21.15.22:0/1046368036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1bd200 0x55d2ab1bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.701+0000 7fa6cbfff640 1 --2- 172.21.15.22:0/1589496851 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa6b80b3bd0 0x7fa6b80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.701+0000 7fa6c9ffb640 1 -- 172.21.15.22:0/1589496851 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fa6c4104a40 con 0x7fa6cc104170 2024-08-20T01:39:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.701+0000 7fa6c37fe640 1 --2- 172.21.15.22:0/1046368036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1bccc0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4013c40 tx=0x7fa6b40095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d583d3fa2d97e16a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.701+0000 7fa6c27fc640 1 -- 172.21.15.22:0/1046368036 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4013d30 con 0x55d2ab1ba8d0 2024-08-20T01:39:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.701+0000 7fa6c27fc640 1 -- 172.21.15.22:0/1046368036 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6b4013170 con 0x55d2ab1ba8d0 2024-08-20T01:39:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.701+0000 7fa6c27fc640 1 -- 172.21.15.22:0/1046368036 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4003960 con 0x55d2ab1ba8d0 2024-08-20T01:39:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.702+0000 7fa6d584c740 1 -- 172.21.15.22:0/1046368036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1ba8d0 msgr2=0x55d2ab1bccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.702+0000 7fa6d584c740 1 --2- 172.21.15.22:0/1046368036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1bccc0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4013c40 tx=0x7fa6b40095e0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.702+0000 7fa6cbfff640 1 --2- 172.21.15.22:0/1589496851 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa6b80b3bd0 0x7fa6b80b6090 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc005fd0 tx=0x7fa6bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.702+0000 7fa6d584c740 1 -- 172.21.15.22:0/1046368036 shutdown_connections 2024-08-20T01:39:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.702+0000 7fa6d584c740 1 --2- 172.21.15.22:0/1046368036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1bfc40 0x55d2ab1c2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.702+0000 7fa6d584c740 1 --2- 172.21.15.22:0/1046368036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1bd200 0x55d2ab1bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.702+0000 7fa6d584c740 1 --2- 172.21.15.22:0/1046368036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1bccc0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.702+0000 7fa6d584c740 1 -- 172.21.15.22:0/1046368036 >> 172.21.15.22:0/1046368036 conn(0x55d2ab1b5a20 msgr2=0x55d2ab1b67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.702+0000 7fa6d584c740 1 -- 172.21.15.22:0/1046368036 shutdown_connections 2024-08-20T01:39:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.702+0000 7fa6d584c740 1 -- 172.21.15.22:0/1046368036 wait complete. 2024-08-20T01:39:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.702+0000 7fa6d584c740 1 -- start start 2024-08-20T01:39:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.703+0000 7fa6d584c740 1 Processor -- start 2024-08-20T01:39:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.703+0000 7fa6d584c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.703+0000 7fa6d584c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1bd200 0x55d2ab1c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.703+0000 7fa6d584c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1bfc40 0x55d2ab1c5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.703+0000 7fa6d584c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d2ab055ab0 con 0x55d2ab1bfc40 2024-08-20T01:39:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.703+0000 7fa6d584c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d2ab0a3780 con 0x55d2ab1bd200 2024-08-20T01:39:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.703+0000 7fa6d584c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d2ab1c2c10 con 0x55d2ab1ba8d0 2024-08-20T01:39:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.703+0000 7fa6d584c740 10 client.0 _ll_register_callbacks cb 0x55d2aae2ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.703+0000 7fa6c37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1bd200 0x55d2ab1c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.703+0000 7fa6d0ffc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1bfc40 0x55d2ab1c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.703+0000 7fa6cbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.703+0000 7fa6c37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1bd200 0x55d2ab1c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:42976/0 (socket says 172.21.15.22:42976) 2024-08-20T01:39:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.703+0000 7fa6c37fe640 1 -- 172.21.15.22:0/2621559585 learned_addr learned my addr 172.21.15.22:0/2621559585 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.703+0000 7fa6c37fe640 1 -- 172.21.15.22:0/2621559585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1ba8d0 msgr2=0x55d2ab1c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.703+0000 7fa6c37fe640 1 --2- 172.21.15.22:0/2621559585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.703+0000 7fa6c37fe640 1 -- 172.21.15.22:0/2621559585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1bfc40 msgr2=0x55d2ab1c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.703+0000 7fa6c37fe640 1 --2- 172.21.15.22:0/2621559585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1bfc40 0x55d2ab1c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.703+0000 7fa6c37fe640 1 -- 172.21.15.22:0/2621559585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2aae7f790 con 0x55d2ab1bd200 2024-08-20T01:39:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.704+0000 7fa6c37fe640 1 --2- 172.21.15.22:0/2621559585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1bd200 0x55d2ab1c4760 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4010010 tx=0x7fa6b4015fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a4278193aad3777 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.704+0000 7fa6ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:39:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.704+0000 7fa6ab7fe640 1 -- 172.21.15.22:0/2621559585 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4004230 con 0x55d2ab1bd200 2024-08-20T01:39:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.704+0000 7fa6ab7fe640 1 -- 172.21.15.22:0/2621559585 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fa6b40043d0 con 0x55d2ab1bd200 2024-08-20T01:39:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.704+0000 7fa6d584c740 1 -- 172.21.15.22:0/2621559585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d2ab0cbe00 con 0x55d2ab1bd200 2024-08-20T01:39:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.704+0000 7fa6ab7fe640 1 -- 172.21.15.22:0/2621559585 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa6b4003660 con 0x55d2ab1bd200 2024-08-20T01:39:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.704+0000 7fa6d584c740 10 client.26402 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.704+0000 7fa6d584c740 1 -- 172.21.15.22:0/2621559585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d2aaef8620 con 0x55d2ab1bd200 2024-08-20T01:39:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.704+0000 7fa6ab7fe640 1 -- 172.21.15.22:0/2621559585 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d2ab0cbe00 con 0x55d2ab1bd200 2024-08-20T01:39:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.705+0000 7fa6ab7fe640 1 -- 172.21.15.22:0/2621559585 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fa6b4020650 con 0x55d2ab1bd200 2024-08-20T01:39:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.705+0000 7fa6d584c740 10 client.26402 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.705+0000 7fa6d584c740 10 client.26402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.705+0000 7fa6d584c740 20 client.26402 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.705+0000 7fa6d584c740 1 --2- 172.21.15.22:0/2621559585 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d2ab1cf760 0x55d2ab1d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.705+0000 7fa6d584c740 4 client.26402 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.705+0000 7fa6d584c740 1 -- 172.21.15.22:0/2621559585 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2ab12f2b0 con 0x55d2ab1cf760 2024-08-20T01:39:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.705+0000 7fa6cbfff640 1 --2- 172.21.15.22:0/2621559585 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d2ab1cf760 0x55d2ab1d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.705+0000 7fa6ab7fe640 10 client.26402 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.705+0000 7fa6cbfff640 1 --2- 172.21.15.22:0/2621559585 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d2ab1cf760 0x55d2ab1d1b80 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97c6de6f2351c1f6 server_cookie=3b69599015499583 in_seq=0 out_seq=0 2024-08-20T01:39:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.706+0000 7fa6ab7fe640 1 -- 172.21.15.22:0/2621559585 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d2ab12f2b0 con 0x55d2ab1cf760 2024-08-20T01:39:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.706+0000 7fa6ab7fe640 10 client.26402 handle_command_reply: tid=0 2024-08-20T01:39:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.706+0000 7fa6d584c740 1 client.26402 shutdown 2024-08-20T01:39:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.706+0000 7fa6d584c740 1 -- 172.21.15.22:0/2621559585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1bd200 msgr2=0x55d2ab1c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.706+0000 7fa6d584c740 1 --2- 172.21.15.22:0/2621559585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1bd200 0x55d2ab1c4760 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4010010 tx=0x7fa6b4015fe0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.706+0000 7fa6d584c740 1 -- 172.21.15.22:0/2621559585 shutdown_connections 2024-08-20T01:39:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.706+0000 7fa6d584c740 1 --2- 172.21.15.22:0/2621559585 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d2ab1cf760 0x55d2ab1d1b80 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.706+0000 7fa6d584c740 1 --2- 172.21.15.22:0/2621559585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1bfc40 0x55d2ab1c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.706+0000 7fa6ab7fe640 0 client.26402 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.706+0000 7fa6d584c740 1 --2- 172.21.15.22:0/2621559585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1bd200 0x55d2ab1c4760 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.706+0000 7fa6d584c740 1 --2- 172.21.15.22:0/2621559585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.706+0000 7fa6d584c740 1 -- 172.21.15.22:0/2621559585 >> 172.21.15.22:0/2621559585 conn(0x55d2ab1b5a20 msgr2=0x55d2ab1b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.706+0000 7fa6d584c740 1 -- 172.21.15.22:0/2621559585 shutdown_connections 2024-08-20T01:39:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.706+0000 7fa6d584c740 1 -- 172.21.15.22:0/2621559585 wait complete. 2024-08-20T01:39:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.706+0000 7fa6d584c740 20 client.26402 trim_cache size 0 max 16384 2024-08-20T01:39:43.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.728+0000 7fa6d584c740 1 Processor -- start 2024-08-20T01:39:43.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.728+0000 7fa6d584c740 1 -- start start 2024-08-20T01:39:43.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.728+0000 7fa6d584c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:43.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.728+0000 7fa6d584c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1bd200 0x55d2ab1c3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:43.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.728+0000 7fa6d584c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1bfc40 0x55d2ab1c3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.728+0000 7fa6d584c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc1ac660 con 0x55d2ab1bfc40 2024-08-20T01:39:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.728+0000 7fa6d584c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc1a9e70 con 0x55d2ab1ba8d0 2024-08-20T01:39:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.728+0000 7fa6d584c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc1a7cc0 con 0x55d2ab1bd200 2024-08-20T01:39:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.728+0000 7fa6cbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.728+0000 7fa6cbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1c47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:42982/0 (socket says 172.21.15.22:42982) 2024-08-20T01:39:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.728+0000 7fa6c37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1bd200 0x55d2ab1c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.728+0000 7fa6cbfff640 1 -- 172.21.15.22:0/3314260412 learned_addr learned my addr 172.21.15.22:0/3314260412 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.728+0000 7fa6d0ffc640 1 --2- 172.21.15.22:0/3314260412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1bfc40 0x55d2ab1c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.729+0000 7fa6c37fe640 1 -- 172.21.15.22:0/3314260412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1ba8d0 msgr2=0x55d2ab1c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.729+0000 7fa6c37fe640 1 --2- 172.21.15.22:0/3314260412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.729+0000 7fa6c37fe640 1 -- 172.21.15.22:0/3314260412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1bfc40 msgr2=0x55d2ab1c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.729+0000 7fa6c37fe640 1 --2- 172.21.15.22:0/3314260412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1bfc40 0x55d2ab1c3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.729+0000 7fa6c37fe640 1 -- 172.21.15.22:0/3314260412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2ab1bd030 con 0x55d2ab1bd200 2024-08-20T01:39:43.734 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.729+0000 7fa6cbfff640 1 --2- 172.21.15.22:0/3314260412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:43.734 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.729+0000 7fa6c37fe640 1 --2- 172.21.15.22:0/3314260412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1bd200 0x55d2ab1c3010 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4020aa0 tx=0x7fa6b4013480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39e86eb0add550dd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:43.734 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.729+0000 7fa6c1ffb640 1 -- 172.21.15.22:0/3314260412 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4009c40 con 0x55d2ab1bd200 2024-08-20T01:39:43.734 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.729+0000 7fa6c1ffb640 1 -- 172.21.15.22:0/3314260412 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6b4038030 con 0x55d2ab1bd200 2024-08-20T01:39:43.734 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.729+0000 7fa6c1ffb640 1 -- 172.21.15.22:0/3314260412 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b40044a0 con 0x55d2ab1bd200 2024-08-20T01:39:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.730+0000 7fa6d584c740 1 -- 172.21.15.22:0/3314260412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1bd200 msgr2=0x55d2ab1c3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.730+0000 7fa6d584c740 1 --2- 172.21.15.22:0/3314260412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1bd200 0x55d2ab1c3010 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4020aa0 tx=0x7fa6b4013480 comp rx=0 tx=0).stop 2024-08-20T01:39:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.730+0000 7fa6d584c740 1 -- 172.21.15.22:0/3314260412 shutdown_connections 2024-08-20T01:39:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.730+0000 7fa6d584c740 1 --2- 172.21.15.22:0/3314260412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1bfc40 0x55d2ab1c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.730+0000 7fa6d584c740 1 --2- 172.21.15.22:0/3314260412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1bd200 0x55d2ab1c3010 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.730+0000 7fa6d584c740 1 --2- 172.21.15.22:0/3314260412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.730+0000 7fa6d584c740 1 -- 172.21.15.22:0/3314260412 >> 172.21.15.22:0/3314260412 conn(0x55d2ab1b5a20 msgr2=0x55d2ab1c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.730+0000 7fa6d584c740 1 -- 172.21.15.22:0/3314260412 shutdown_connections 2024-08-20T01:39:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.730+0000 7fa6d584c740 1 -- 172.21.15.22:0/3314260412 wait complete. 2024-08-20T01:39:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.730+0000 7fa6d584c740 1 -- start start 2024-08-20T01:39:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6d584c740 1 Processor -- start 2024-08-20T01:39:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6d584c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6d584c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1bd200 0x55d2ab1c9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6d584c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1bfc40 0x55d2ab1c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6d584c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc1a8330 con 0x55d2ab1bd200 2024-08-20T01:39:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6d584c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc1a97a0 con 0x55d2ab1bfc40 2024-08-20T01:39:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6d584c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc1a8a00 con 0x55d2ab1ba8d0 2024-08-20T01:39:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6d584c740 10 client.0 _ll_register_callbacks cb 0x7fa6b4013700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6cbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6c37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1bd200 0x55d2ab1c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6d0ffc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1bfc40 0x55d2ab1c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6cbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:58124/0 (socket says 172.21.15.22:58124) 2024-08-20T01:39:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6cbfff640 1 -- 172.21.15.22:0/768409193 learned_addr learned my addr 172.21.15.22:0/768409193 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6c37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1bd200 0x55d2ab1c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58946/0 (socket says 172.21.15.22:58946) 2024-08-20T01:39:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6d0ffc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1bfc40 0x55d2ab1c9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:42994/0 (socket says 172.21.15.22:42994) 2024-08-20T01:39:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6cbfff640 1 -- 172.21.15.22:0/768409193 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1bfc40 msgr2=0x55d2ab1c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6cbfff640 1 --2- 172.21.15.22:0/768409193 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1bfc40 0x55d2ab1c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6cbfff640 1 -- 172.21.15.22:0/768409193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1bd200 msgr2=0x55d2ab1c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6cbfff640 1 --2- 172.21.15.22:0/768409193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1bd200 0x55d2ab1c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6cbfff640 1 -- 172.21.15.22:0/768409193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2ab1ca620 con 0x55d2ab1ba8d0 2024-08-20T01:39:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.731+0000 7fa6c37fe640 1 --2- 172.21.15.22:0/768409193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1bd200 0x55d2ab1c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.732+0000 7fa6cbfff640 1 --2- 172.21.15.22:0/768409193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1c8bd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc004390 tx=0x7fa6bc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac264e1e5d0eee17 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.732+0000 7fa6ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:39:43.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.733+0000 7fa6ab7fe640 1 -- 172.21.15.22:0/768409193 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc02aac0 con 0x55d2ab1ba8d0 2024-08-20T01:39:43.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.733+0000 7fa6ab7fe640 1 -- 172.21.15.22:0/768409193 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fa6bc02ac60 con 0x55d2ab1ba8d0 2024-08-20T01:39:43.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.733+0000 7fa6d584c740 1 -- 172.21.15.22:0/768409193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6b4038030 con 0x55d2ab1ba8d0 2024-08-20T01:39:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.738+0000 7fa6ab7fe640 1 -- 172.21.15.22:0/768409193 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa6bc01e420 con 0x55d2ab1ba8d0 2024-08-20T01:39:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.738+0000 7fa6d584c740 10 client.26455 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.738+0000 7fa6d584c740 1 -- 172.21.15.22:0/768409193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d2ab1cba00 con 0x55d2ab1ba8d0 2024-08-20T01:39:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.738+0000 7fa6ab7fe640 1 -- 172.21.15.22:0/768409193 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6b4038030 con 0x55d2ab1ba8d0 2024-08-20T01:39:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.739+0000 7fa6ab7fe640 1 -- 172.21.15.22:0/768409193 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fa6bc011710 con 0x55d2ab1ba8d0 2024-08-20T01:39:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.739+0000 7fa6d584c740 10 client.26455 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.739+0000 7fa6d584c740 10 client.26455 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.739+0000 7fa6d584c740 20 client.26455 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.739+0000 7fa6d584c740 1 --2- 172.21.15.22:0/768409193 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d2ab23a490 0x55d2ab23c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.739+0000 7fa6d584c740 4 client.26455 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:39:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.739+0000 7fa6d584c740 1 -- 172.21.15.22:0/768409193 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d2ab12ad50 con 0x55d2ab23a490 2024-08-20T01:39:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.739+0000 7fa6c37fe640 1 --2- 172.21.15.22:0/768409193 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d2ab23a490 0x55d2ab23c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.739+0000 7fa6ab7fe640 10 client.26455 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.739+0000 7fa6c37fe640 1 --2- 172.21.15.22:0/768409193 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d2ab23a490 0x55d2ab23c8b0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88b40122209f1198 server_cookie=2861725a09afc8bc in_seq=0 out_seq=0 2024-08-20T01:39:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.756+0000 7fa6ab7fe640 1 -- 172.21.15.22:0/768409193 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d2ab12ad50 con 0x55d2ab23a490 2024-08-20T01:39:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.756+0000 7fa6ab7fe640 10 client.26455 handle_command_reply: tid=0 2024-08-20T01:39:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.756+0000 7fa6d584c740 1 client.26455 shutdown 2024-08-20T01:39:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.756+0000 7fa6d584c740 1 -- 172.21.15.22:0/768409193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1ba8d0 msgr2=0x55d2ab1c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.756+0000 7fa6d584c740 1 --2- 172.21.15.22:0/768409193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1c8bd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc004390 tx=0x7fa6bc0046c0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.756+0000 7fa6d584c740 1 -- 172.21.15.22:0/768409193 shutdown_connections 2024-08-20T01:39:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.756+0000 7fa6d584c740 1 --2- 172.21.15.22:0/768409193 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d2ab23a490 0x55d2ab23c8b0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.756+0000 7fa6d584c740 1 --2- 172.21.15.22:0/768409193 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2ab1bfc40 0x55d2ab1c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.756+0000 7fa6d584c740 1 --2- 172.21.15.22:0/768409193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d2ab1bd200 0x55d2ab1c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.756+0000 7fa6ab7fe640 0 client.26455 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.756+0000 7fa6d584c740 1 --2- 172.21.15.22:0/768409193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d2ab1ba8d0 0x55d2ab1c8bd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.756+0000 7fa6d584c740 1 -- 172.21.15.22:0/768409193 >> 172.21.15.22:0/768409193 conn(0x55d2ab1b5a20 msgr2=0x55d2ab1c3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.756+0000 7fa6d584c740 1 -- 172.21.15.22:0/768409193 shutdown_connections 2024-08-20T01:39:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.756+0000 7fa6d584c740 1 -- 172.21.15.22:0/768409193 wait complete. 2024-08-20T01:39:43.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.756+0000 7fa6d584c740 20 client.26455 trim_cache size 0 max 16384 2024-08-20T01:39:43.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:39:43.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:39:43.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:39:43.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:39:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.757+0000 7fa6d2a5f640 1 -- 172.21.15.22:0/1589496851 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa6b80b3bd0 msgr2=0x7fa6b80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.757+0000 7fa6d2a5f640 1 --2- 172.21.15.22:0/1589496851 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa6b80b3bd0 0x7fa6b80b6090 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc005fd0 tx=0x7fa6bc00b390 comp rx=0 tx=0).stop 2024-08-20T01:39:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.757+0000 7fa6d2a5f640 1 -- 172.21.15.22:0/1589496851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6cc104170 msgr2=0x7fa6cc199cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.757+0000 7fa6d2a5f640 1 --2- 172.21.15.22:0/1589496851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6cc104170 0x7fa6cc199cd0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4034040 tx=0x7fa6c4030e50 comp rx=0 tx=0).stop 2024-08-20T01:39:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.757+0000 7fa6d2a5f640 1 -- 172.21.15.22:0/1589496851 shutdown_connections 2024-08-20T01:39:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.757+0000 7fa6d2a5f640 1 --2- 172.21.15.22:0/1589496851 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa6b80b3bd0 0x7fa6b80b6090 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.757+0000 7fa6d2a5f640 1 --2- 172.21.15.22:0/1589496851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6cc104170 0x7fa6cc199cd0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.757+0000 7fa6d2a5f640 1 --2- 172.21.15.22:0/1589496851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6cc1037b0 0x7fa6cc1990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.757+0000 7fa6d2a5f640 1 --2- 172.21.15.22:0/1589496851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6cc102660 0x7fa6cc198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.757+0000 7fa6d2a5f640 1 -- 172.21.15.22:0/1589496851 >> 172.21.15.22:0/1589496851 conn(0x7fa6cc0fdf20 msgr2=0x7fa6cc106b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.757+0000 7fa6d2a5f640 1 -- 172.21.15.22:0/1589496851 shutdown_connections 2024-08-20T01:39:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:43.757+0000 7fa6d2a5f640 1 -- 172.21.15.22:0/1589496851 wait complete. 2024-08-20T01:39:44.002 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:44.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:43 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/154175362' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:39:44.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:43 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/154175362' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:39:44.119 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:43 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/154175362' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:39:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.525+0000 7f8d235c7640 1 -- 172.21.15.22:0/2690521005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d1c10ce00 msgr2=0x7f8d1c10f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.525+0000 7f8d235c7640 1 --2- 172.21.15.22:0/2690521005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d1c10ce00 0x7f8d1c10f260 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f8d14009ca0 tx=0x7f8d1402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.525+0000 7f8d235c7640 1 -- 172.21.15.22:0/2690521005 shutdown_connections 2024-08-20T01:39:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.525+0000 7f8d235c7640 1 --2- 172.21.15.22:0/2690521005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d1c10ce00 0x7f8d1c10f260 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.525+0000 7f8d235c7640 1 --2- 172.21.15.22:0/2690521005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d1c1042c0 0x7f8d1c10c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.525+0000 7f8d235c7640 1 --2- 172.21.15.22:0/2690521005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d1c1039a0 0x7f8d1c103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.525+0000 7f8d235c7640 1 -- 172.21.15.22:0/2690521005 >> 172.21.15.22:0/2690521005 conn(0x7f8d1c0fd400 msgr2=0x7f8d1c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.525+0000 7f8d235c7640 1 -- 172.21.15.22:0/2690521005 shutdown_connections 2024-08-20T01:39:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.525+0000 7f8d235c7640 1 -- 172.21.15.22:0/2690521005 wait complete. 2024-08-20T01:39:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.526+0000 7f8d235c7640 1 Processor -- start 2024-08-20T01:39:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.526+0000 7f8d235c7640 1 -- start start 2024-08-20T01:39:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.526+0000 7f8d235c7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d1c1039a0 0x7f8d1c101650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.526+0000 7f8d235c7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d1c1042c0 0x7f8d1c101b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.526+0000 7f8d235c7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d1c10ce00 0x7f8d1c1020d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.526+0000 7f8d235c7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c112a70 con 0x7f8d1c10ce00 2024-08-20T01:39:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.526+0000 7f8d235c7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c1128f0 con 0x7f8d1c1039a0 2024-08-20T01:39:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.526+0000 7f8d235c7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c112bf0 con 0x7f8d1c1042c0 2024-08-20T01:39:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.526+0000 7f8d20b62640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d1c1042c0 0x7f8d1c101b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.526+0000 7f8d21b64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d1c10ce00 0x7f8d1c1020d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.526+0000 7f8d20b62640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d1c1042c0 0x7f8d1c101b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:58150/0 (socket says 172.21.15.22:58150) 2024-08-20T01:39:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.526+0000 7f8d20b62640 1 -- 172.21.15.22:0/643120644 learned_addr learned my addr 172.21.15.22:0/643120644 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.526+0000 7f8d21b64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d1c10ce00 0x7f8d1c1020d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58962/0 (socket says 172.21.15.22:58962) 2024-08-20T01:39:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.526+0000 7f8d21363640 1 --2- 172.21.15.22:0/643120644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d1c1039a0 0x7f8d1c101650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.527+0000 7f8d20b62640 1 -- 172.21.15.22:0/643120644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d1c1039a0 msgr2=0x7f8d1c101650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.527+0000 7f8d20b62640 1 --2- 172.21.15.22:0/643120644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d1c1039a0 0x7f8d1c101650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.527+0000 7f8d20b62640 1 -- 172.21.15.22:0/643120644 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d1c10ce00 msgr2=0x7f8d1c1020d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.527+0000 7f8d20b62640 1 --2- 172.21.15.22:0/643120644 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d1c10ce00 0x7f8d1c1020d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.527+0000 7f8d20b62640 1 -- 172.21.15.22:0/643120644 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d1c1a73a0 con 0x7f8d1c1042c0 2024-08-20T01:39:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.527+0000 7f8d21363640 1 --2- 172.21.15.22:0/643120644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d1c1039a0 0x7f8d1c101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.527+0000 7f8d20b62640 1 --2- 172.21.15.22:0/643120644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d1c1042c0 0x7f8d1c101b90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00e9c0 tx=0x7f8d0c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.527+0000 7f8d127fc640 1 -- 172.21.15.22:0/643120644 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c00ccc0 con 0x7f8d1c1042c0 2024-08-20T01:39:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.527+0000 7f8d235c7640 1 -- 172.21.15.22:0/643120644 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d1c1a7690 con 0x7f8d1c1042c0 2024-08-20T01:39:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.527+0000 7f8d127fc640 1 -- 172.21.15.22:0/643120644 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d0c0035f0 con 0x7f8d1c1042c0 2024-08-20T01:39:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.527+0000 7f8d127fc640 1 -- 172.21.15.22:0/643120644 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c00ce60 con 0x7f8d1c1042c0 2024-08-20T01:39:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.527+0000 7f8d235c7640 1 -- 172.21.15.22:0/643120644 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d1c1a7bd0 con 0x7f8d1c1042c0 2024-08-20T01:39:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.531+0000 7f8d259c0740 1 Processor -- start 2024-08-20T01:39:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.531+0000 7f8d127fc640 1 -- 172.21.15.22:0/643120644 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8d0c004000 con 0x7f8d1c1042c0 2024-08-20T01:39:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.531+0000 7f8d259c0740 1 -- start start 2024-08-20T01:39:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.531+0000 7f8d259c0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929378880 0x55b929378c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.531+0000 7f8d259c0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9293791a0 0x55b929384bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.531+0000 7f8d259c0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b929385130 0x55b929387520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.531+0000 7f8d259c0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b9292ef930 con 0x55b929378880 2024-08-20T01:39:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.531+0000 7f8d259c0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b9292dee30 con 0x55b929385130 2024-08-20T01:39:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.531+0000 7f8d259c0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b9292e2e70 con 0x55b9293791a0 2024-08-20T01:39:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.531+0000 7f8d21b64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929378880 0x55b929378c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.531+0000 7f8d21b64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929378880 0x55b929378c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58966/0 (socket says 172.21.15.22:58966) 2024-08-20T01:39:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.531+0000 7f8d21b64640 1 -- 172.21.15.22:0/2297193953 learned_addr learned my addr 172.21.15.22:0/2297193953 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.531+0000 7f8d21363640 1 --2- 172.21.15.22:0/2297193953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9293791a0 0x55b929384bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.531+0000 7f8d20b62640 1 --2- 172.21.15.22:0/2297193953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b929385130 0x55b929387520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.531+0000 7f8d21b64640 1 -- 172.21.15.22:0/2297193953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9293791a0 msgr2=0x55b929384bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.531+0000 7f8d21b64640 1 --2- 172.21.15.22:0/2297193953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9293791a0 0x55b929384bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.531+0000 7f8d21b64640 1 -- 172.21.15.22:0/2297193953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b929385130 msgr2=0x55b929387520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.531+0000 7f8d21b64640 1 --2- 172.21.15.22:0/2297193953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b929385130 0x55b929387520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.531+0000 7f8d21b64640 1 -- 172.21.15.22:0/2297193953 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b92903e650 con 0x55b929378880 2024-08-20T01:39:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.532+0000 7f8d21363640 1 --2- 172.21.15.22:0/2297193953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9293791a0 0x55b929384bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.532+0000 7f8d21b64640 1 --2- 172.21.15.22:0/2297193953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929378880 0x55b929378c60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f8d14009430 tx=0x7f8d14005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9862d8f4a19a7dad server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.532+0000 7f8d127fc640 1 --2- 172.21.15.22:0/643120644 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d080b3bd0 0x7f8d080b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.532+0000 7f8d21363640 1 --2- 172.21.15.22:0/643120644 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d080b3bd0 0x7f8d080b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.532+0000 7f8d127fc640 1 -- 172.21.15.22:0/643120644 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f8d0c0e3fe0 con 0x7f8d1c1042c0 2024-08-20T01:39:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.532+0000 7f8d077fe640 1 -- 172.21.15.22:0/2297193953 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14031cf0 con 0x55b929378880 2024-08-20T01:39:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.532+0000 7f8d077fe640 1 -- 172.21.15.22:0/2297193953 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d14036070 con 0x55b929378880 2024-08-20T01:39:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.532+0000 7f8d077fe640 1 -- 172.21.15.22:0/2297193953 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d140042a0 con 0x55b929378880 2024-08-20T01:39:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.533+0000 7f8d259c0740 1 -- 172.21.15.22:0/2297193953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929378880 msgr2=0x55b929378c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.533+0000 7f8d259c0740 1 --2- 172.21.15.22:0/2297193953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929378880 0x55b929378c60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f8d14009430 tx=0x7f8d14005ef0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.533+0000 7f8d21363640 1 --2- 172.21.15.22:0/643120644 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d080b3bd0 0x7f8d080b6090 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x55b92937ba00 tx=0x7f8d18005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.533+0000 7f8d259c0740 1 -- 172.21.15.22:0/2297193953 shutdown_connections 2024-08-20T01:39:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.533+0000 7f8d259c0740 1 --2- 172.21.15.22:0/2297193953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b929385130 0x55b929387520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.533+0000 7f8d259c0740 1 --2- 172.21.15.22:0/2297193953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9293791a0 0x55b929384bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.533+0000 7f8d259c0740 1 --2- 172.21.15.22:0/2297193953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929378880 0x55b929378c60 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.533+0000 7f8d259c0740 1 -- 172.21.15.22:0/2297193953 >> 172.21.15.22:0/2297193953 conn(0x55b9293766b0 msgr2=0x55b929377850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.533+0000 7f8d259c0740 1 -- 172.21.15.22:0/2297193953 shutdown_connections 2024-08-20T01:39:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.533+0000 7f8d259c0740 1 -- 172.21.15.22:0/2297193953 wait complete. 2024-08-20T01:39:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.533+0000 7f8d259c0740 1 -- start start 2024-08-20T01:39:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.533+0000 7f8d259c0740 1 Processor -- start 2024-08-20T01:39:44.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.534+0000 7f8d259c0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b929378880 0x55b929382130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:44.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.534+0000 7f8d259c0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9293791a0 0x55b929382670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:44.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.534+0000 7f8d259c0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929385130 0x55b929382bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:44.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.534+0000 7f8d259c0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b929141700 con 0x55b929385130 2024-08-20T01:39:44.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.534+0000 7f8d259c0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b929265810 con 0x55b929378880 2024-08-20T01:39:44.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.534+0000 7f8d259c0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b929387c00 con 0x55b9293791a0 2024-08-20T01:39:44.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.534+0000 7f8d259c0740 10 client.0 _ll_register_callbacks cb 0x55b9292d8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:44.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.534+0000 7f8d21b64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929385130 0x55b929382bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:44.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.534+0000 7f8d21363640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b929378880 0x55b929382130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:44.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.534+0000 7f8d21b64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929385130 0x55b929382bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58974/0 (socket says 172.21.15.22:58974) 2024-08-20T01:39:44.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.534+0000 7f8d21b64640 1 -- 172.21.15.22:0/3054951196 learned_addr learned my addr 172.21.15.22:0/3054951196 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:44.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.534+0000 7f8d20b62640 1 --2- 172.21.15.22:0/3054951196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9293791a0 0x55b929382670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:44.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.534+0000 7f8d21363640 1 -- 172.21.15.22:0/3054951196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9293791a0 msgr2=0x55b929382670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:44.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.534+0000 7f8d21363640 1 --2- 172.21.15.22:0/3054951196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9293791a0 0x55b929382670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.534+0000 7f8d21363640 1 -- 172.21.15.22:0/3054951196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929385130 msgr2=0x55b929382bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:44.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.534+0000 7f8d21363640 1 --2- 172.21.15.22:0/3054951196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929385130 0x55b929382bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.534+0000 7f8d21363640 1 -- 172.21.15.22:0/3054951196 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b929391030 con 0x55b929378880 2024-08-20T01:39:44.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.534+0000 7f8d21b64640 1 --2- 172.21.15.22:0/3054951196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929385130 0x55b929382bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:44.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.534+0000 7f8d20b62640 1 --2- 172.21.15.22:0/3054951196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9293791a0 0x55b929382670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:44.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.535+0000 7f8d21363640 1 --2- 172.21.15.22:0/3054951196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b929378880 0x55b929382130 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8d180042b0 tx=0x7f8d18004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71b78c01cbb53b78 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:44.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.535+0000 7f8d04ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:39:44.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.535+0000 7f8d04ff9640 1 -- 172.21.15.22:0/3054951196 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18029470 con 0x55b929378880 2024-08-20T01:39:44.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.535+0000 7f8d259c0740 1 -- 172.21.15.22:0/3054951196 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b92928e150 con 0x55b929378880 2024-08-20T01:39:44.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.535+0000 7f8d04ff9640 1 -- 172.21.15.22:0/3054951196 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f8d18029610 con 0x55b929378880 2024-08-20T01:39:44.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.535+0000 7f8d04ff9640 1 -- 172.21.15.22:0/3054951196 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8d18029810 con 0x55b929378880 2024-08-20T01:39:44.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.535+0000 7f8d259c0740 10 client.26420 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:44.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.535+0000 7f8d259c0740 1 -- 172.21.15.22:0/3054951196 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b929393a70 con 0x55b929378880 2024-08-20T01:39:44.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.535+0000 7f8d04ff9640 1 -- 172.21.15.22:0/3054951196 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b92928e150 con 0x55b929378880 2024-08-20T01:39:44.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.536+0000 7f8d04ff9640 1 -- 172.21.15.22:0/3054951196 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f8d1801c030 con 0x55b929378880 2024-08-20T01:39:44.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.536+0000 7f8d259c0740 10 client.26420 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:44.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.536+0000 7f8d259c0740 10 client.26420 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:39:44.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.536+0000 7f8d259c0740 20 client.26420 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:44.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.536+0000 7f8d259c0740 1 --2- 172.21.15.22:0/3054951196 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55b929394e80 0x55b9293972c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:44.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.536+0000 7f8d259c0740 4 client.26420 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:44.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.536+0000 7f8d259c0740 1 -- 172.21.15.22:0/3054951196 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9292f1880 con 0x55b929394e80 2024-08-20T01:39:44.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.536+0000 7f8d20b62640 1 --2- 172.21.15.22:0/3054951196 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55b929394e80 0x55b9293972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:44.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.536+0000 7f8d20b62640 1 --2- 172.21.15.22:0/3054951196 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55b929394e80 0x55b9293972c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a6a51471a530b56f server_cookie=4c35376bc2bf5c57 in_seq=0 out_seq=0 2024-08-20T01:39:44.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.536+0000 7f8d04ff9640 10 client.26420 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:39:44.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.537+0000 7f8d04ff9640 1 -- 172.21.15.22:0/3054951196 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9292f1880 con 0x55b929394e80 2024-08-20T01:39:44.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.537+0000 7f8d04ff9640 10 client.26420 handle_command_reply: tid=0 2024-08-20T01:39:44.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.537+0000 7f8d259c0740 1 client.26420 shutdown 2024-08-20T01:39:44.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.537+0000 7f8d259c0740 1 -- 172.21.15.22:0/3054951196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b929378880 msgr2=0x55b929382130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:44.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.537+0000 7f8d259c0740 1 --2- 172.21.15.22:0/3054951196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b929378880 0x55b929382130 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8d180042b0 tx=0x7f8d18004730 comp rx=0 tx=0).stop 2024-08-20T01:39:44.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.537+0000 7f8d259c0740 1 -- 172.21.15.22:0/3054951196 shutdown_connections 2024-08-20T01:39:44.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.537+0000 7f8d259c0740 1 --2- 172.21.15.22:0/3054951196 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55b929394e80 0x55b9293972c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.537+0000 7f8d259c0740 1 --2- 172.21.15.22:0/3054951196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929385130 0x55b929382bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.537+0000 7f8d259c0740 1 --2- 172.21.15.22:0/3054951196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9293791a0 0x55b929382670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.537+0000 7f8d04ff9640 0 client.26420 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:39:44.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.537+0000 7f8d259c0740 1 --2- 172.21.15.22:0/3054951196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b929378880 0x55b929382130 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.537+0000 7f8d259c0740 1 -- 172.21.15.22:0/3054951196 >> 172.21.15.22:0/3054951196 conn(0x55b9293766b0 msgr2=0x55b92937c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:44.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.537+0000 7f8d259c0740 1 -- 172.21.15.22:0/3054951196 shutdown_connections 2024-08-20T01:39:44.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.537+0000 7f8d259c0740 1 -- 172.21.15.22:0/3054951196 wait complete. 2024-08-20T01:39:44.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.537+0000 7f8d259c0740 20 client.26420 trim_cache size 0 max 16384 2024-08-20T01:39:44.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.550+0000 7f8d259c0740 1 Processor -- start 2024-08-20T01:39:44.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.550+0000 7f8d259c0740 1 -- start start 2024-08-20T01:39:44.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.551+0000 7f8d259c0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b929378880 0x55b9293819c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:44.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.551+0000 7f8d259c0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9293791a0 0x55b92939cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:44.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.551+0000 7f8d259c0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929385130 0x55b92939d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:44.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.551+0000 7f8d259c0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c1b71a0 con 0x55b929385130 2024-08-20T01:39:44.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.551+0000 7f8d259c0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c1b49b0 con 0x55b9293791a0 2024-08-20T01:39:44.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.551+0000 7f8d259c0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c1b2820 con 0x55b929378880 2024-08-20T01:39:44.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.551+0000 7f8d21b64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929385130 0x55b92939d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:44.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.551+0000 7f8d21b64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929385130 0x55b92939d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58982/0 (socket says 172.21.15.22:58982) 2024-08-20T01:39:44.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.551+0000 7f8d20b62640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9293791a0 0x55b92939cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:44.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.551+0000 7f8d21b64640 1 -- 172.21.15.22:0/3696379457 learned_addr learned my addr 172.21.15.22:0/3696379457 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:44.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.551+0000 7f8d21363640 1 --2- 172.21.15.22:0/3696379457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b929378880 0x55b9293819c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:44.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.551+0000 7f8d20b62640 1 -- 172.21.15.22:0/3696379457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b929378880 msgr2=0x55b9293819c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:44.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.551+0000 7f8d20b62640 1 --2- 172.21.15.22:0/3696379457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b929378880 0x55b9293819c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.551+0000 7f8d20b62640 1 -- 172.21.15.22:0/3696379457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929385130 msgr2=0x55b92939d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:44.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.551+0000 7f8d20b62640 1 --2- 172.21.15.22:0/3696379457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929385130 0x55b92939d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.551+0000 7f8d20b62640 1 -- 172.21.15.22:0/3696379457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b929377130 con 0x55b9293791a0 2024-08-20T01:39:44.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.551+0000 7f8d20b62640 1 --2- 172.21.15.22:0/3696379457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9293791a0 0x55b92939cb90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55b929378830 tx=0x7f8d0c003e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bda213d2c10183b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:44.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.552+0000 7f8d06ffd640 1 -- 172.21.15.22:0/3696379457 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0aa600 con 0x55b9293791a0 2024-08-20T01:39:44.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.552+0000 7f8d06ffd640 1 -- 172.21.15.22:0/3696379457 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d0c0aa9a0 con 0x55b9293791a0 2024-08-20T01:39:44.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.552+0000 7f8d06ffd640 1 -- 172.21.15.22:0/3696379457 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0e1b50 con 0x55b9293791a0 2024-08-20T01:39:44.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.552+0000 7f8d259c0740 1 -- 172.21.15.22:0/3696379457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9293791a0 msgr2=0x55b92939cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:44.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.552+0000 7f8d259c0740 1 --2- 172.21.15.22:0/3696379457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9293791a0 0x55b92939cb90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55b929378830 tx=0x7f8d0c003e20 comp rx=0 tx=0).stop 2024-08-20T01:39:44.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.552+0000 7f8d259c0740 1 -- 172.21.15.22:0/3696379457 shutdown_connections 2024-08-20T01:39:44.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.552+0000 7f8d259c0740 1 --2- 172.21.15.22:0/3696379457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929385130 0x55b92939d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.552+0000 7f8d259c0740 1 --2- 172.21.15.22:0/3696379457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9293791a0 0x55b92939cb90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.552+0000 7f8d259c0740 1 --2- 172.21.15.22:0/3696379457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b929378880 0x55b9293819c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.552+0000 7f8d259c0740 1 -- 172.21.15.22:0/3696379457 >> 172.21.15.22:0/3696379457 conn(0x55b9293766b0 msgr2=0x55b929383f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.552+0000 7f8d259c0740 1 -- 172.21.15.22:0/3696379457 shutdown_connections 2024-08-20T01:39:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.552+0000 7f8d259c0740 1 -- 172.21.15.22:0/3696379457 wait complete. 2024-08-20T01:39:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.553+0000 7f8d259c0740 1 -- start start 2024-08-20T01:39:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.553+0000 7f8d259c0740 1 Processor -- start 2024-08-20T01:39:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.553+0000 7f8d259c0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929378880 0x55b929387e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.553+0000 7f8d259c0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9293791a0 0x55b929388390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.553+0000 7f8d259c0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b929385130 0x55b9293888d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.553+0000 7f8d259c0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c1b2e70 con 0x55b929378880 2024-08-20T01:39:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.553+0000 7f8d259c0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c1b42e0 con 0x55b929385130 2024-08-20T01:39:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.553+0000 7f8d259c0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c1b3540 con 0x55b9293791a0 2024-08-20T01:39:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.553+0000 7f8d259c0740 10 client.0 _ll_register_callbacks cb 0x7f8d18009bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.553+0000 7f8d21b64640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b929385130 0x55b9293888d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.553+0000 7f8d20b62640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9293791a0 0x55b929388390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.553+0000 7f8d21363640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929378880 0x55b929387e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.553+0000 7f8d21b64640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b929385130 0x55b9293888d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:43050/0 (socket says 172.21.15.22:43050) 2024-08-20T01:39:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.553+0000 7f8d20b62640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9293791a0 0x55b929388390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:58208/0 (socket says 172.21.15.22:58208) 2024-08-20T01:39:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.553+0000 7f8d21b64640 1 -- 172.21.15.22:0/2732350209 learned_addr learned my addr 172.21.15.22:0/2732350209 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.554+0000 7f8d21363640 1 -- 172.21.15.22:0/2732350209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9293791a0 msgr2=0x55b929388390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.554+0000 7f8d21363640 1 --2- 172.21.15.22:0/2732350209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9293791a0 0x55b929388390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.554+0000 7f8d21363640 1 -- 172.21.15.22:0/2732350209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b929385130 msgr2=0x55b9293888d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.554+0000 7f8d21363640 1 --2- 172.21.15.22:0/2732350209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b929385130 0x55b9293888d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.554+0000 7f8d21363640 1 -- 172.21.15.22:0/2732350209 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b929378260 con 0x55b929378880 2024-08-20T01:39:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.554+0000 7f8d21b64640 1 --2- 172.21.15.22:0/2732350209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b929385130 0x55b9293888d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.554+0000 7f8d21363640 1 --2- 172.21.15.22:0/2732350209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929378880 0x55b929387e50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8d18020bf0 tx=0x7f8d180040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e43572e5515b84a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.554+0000 7f8d04ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:39:44.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.554+0000 7f8d04ff9640 1 -- 172.21.15.22:0/2732350209 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18041060 con 0x55b929378880 2024-08-20T01:39:44.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.554+0000 7f8d04ff9640 1 -- 172.21.15.22:0/2732350209 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f8d18029bc0 con 0x55b929378880 2024-08-20T01:39:44.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.554+0000 7f8d259c0740 1 -- 172.21.15.22:0/2732350209 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d0c0aa9a0 con 0x55b929378880 2024-08-20T01:39:44.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.554+0000 7f8d04ff9640 1 -- 172.21.15.22:0/2732350209 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8d18029dc0 con 0x55b929378880 2024-08-20T01:39:44.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.554+0000 7f8d259c0740 10 client.16818 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:44.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.554+0000 7f8d259c0740 1 -- 172.21.15.22:0/2732350209 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b9293fece0 con 0x55b929378880 2024-08-20T01:39:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.555+0000 7f8d04ff9640 1 -- 172.21.15.22:0/2732350209 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d0c0aa9a0 con 0x55b929378880 2024-08-20T01:39:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.555+0000 7f8d04ff9640 1 -- 172.21.15.22:0/2732350209 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f8d1801c070 con 0x55b929378880 2024-08-20T01:39:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.555+0000 7f8d259c0740 10 client.16818 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.555+0000 7f8d259c0740 10 client.16818 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:39:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.555+0000 7f8d259c0740 20 client.16818 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.555+0000 7f8d259c0740 1 --2- 172.21.15.22:0/2732350209 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55b9293ff4f0 0x55b929401910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.555+0000 7f8d259c0740 4 client.16818 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:39:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.555+0000 7f8d259c0740 1 -- 172.21.15.22:0/2732350209 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b9292ed320 con 0x55b9293ff4f0 2024-08-20T01:39:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.555+0000 7f8d20b62640 1 --2- 172.21.15.22:0/2732350209 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55b9293ff4f0 0x55b929401910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.555+0000 7f8d20b62640 1 --2- 172.21.15.22:0/2732350209 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55b9293ff4f0 0x55b929401910 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9391766817a5d4f9 server_cookie=3355261b691f9a0 in_seq=0 out_seq=0 2024-08-20T01:39:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.555+0000 7f8d04ff9640 10 client.16818 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:39:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.556+0000 7f8d04ff9640 1 -- 172.21.15.22:0/2732350209 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b9292ed320 con 0x55b9293ff4f0 2024-08-20T01:39:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.556+0000 7f8d04ff9640 10 client.16818 handle_command_reply: tid=0 2024-08-20T01:39:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.556+0000 7f8d259c0740 1 client.16818 shutdown 2024-08-20T01:39:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.556+0000 7f8d259c0740 1 -- 172.21.15.22:0/2732350209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929378880 msgr2=0x55b929387e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.556+0000 7f8d259c0740 1 --2- 172.21.15.22:0/2732350209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929378880 0x55b929387e50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8d18020bf0 tx=0x7f8d180040c0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.556+0000 7f8d259c0740 1 -- 172.21.15.22:0/2732350209 shutdown_connections 2024-08-20T01:39:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.556+0000 7f8d259c0740 1 --2- 172.21.15.22:0/2732350209 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55b9293ff4f0 0x55b929401910 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.556+0000 7f8d259c0740 1 --2- 172.21.15.22:0/2732350209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b929385130 0x55b9293888d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.556+0000 7f8d259c0740 1 --2- 172.21.15.22:0/2732350209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9293791a0 0x55b929388390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.556+0000 7f8d259c0740 1 --2- 172.21.15.22:0/2732350209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b929378880 0x55b929387e50 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.556+0000 7f8d259c0740 1 -- 172.21.15.22:0/2732350209 >> 172.21.15.22:0/2732350209 conn(0x55b9293766b0 msgr2=0x55b929374f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:44.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.556+0000 7f8d04ff9640 0 client.16818 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:39:44.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.556+0000 7f8d259c0740 1 -- 172.21.15.22:0/2732350209 shutdown_connections 2024-08-20T01:39:44.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.556+0000 7f8d259c0740 1 -- 172.21.15.22:0/2732350209 wait complete. 2024-08-20T01:39:44.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.556+0000 7f8d259c0740 20 client.16818 trim_cache size 0 max 16384 2024-08-20T01:39:44.566 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:39:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.557+0000 7f8d235c7640 1 -- 172.21.15.22:0/643120644 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d080b3bd0 msgr2=0x7f8d080b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.557+0000 7f8d235c7640 1 --2- 172.21.15.22:0/643120644 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d080b3bd0 0x7f8d080b6090 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x55b92937ba00 tx=0x7f8d18005f90 comp rx=0 tx=0).stop 2024-08-20T01:39:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.557+0000 7f8d235c7640 1 -- 172.21.15.22:0/643120644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d1c1042c0 msgr2=0x7f8d1c101b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.557+0000 7f8d235c7640 1 --2- 172.21.15.22:0/643120644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d1c1042c0 0x7f8d1c101b90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00e9c0 tx=0x7f8d0c00ee80 comp rx=0 tx=0).stop 2024-08-20T01:39:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.557+0000 7f8d235c7640 1 -- 172.21.15.22:0/643120644 shutdown_connections 2024-08-20T01:39:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.557+0000 7f8d235c7640 1 --2- 172.21.15.22:0/643120644 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f8d080b3bd0 0x7f8d080b6090 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.557+0000 7f8d235c7640 1 --2- 172.21.15.22:0/643120644 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d1c10ce00 0x7f8d1c1020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.557+0000 7f8d235c7640 1 --2- 172.21.15.22:0/643120644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d1c1042c0 0x7f8d1c101b90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.557+0000 7f8d235c7640 1 --2- 172.21.15.22:0/643120644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d1c1039a0 0x7f8d1c101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:44.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.557+0000 7f8d235c7640 1 -- 172.21.15.22:0/643120644 >> 172.21.15.22:0/643120644 conn(0x7f8d1c0fd400 msgr2=0x7f8d1c0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:44.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.557+0000 7f8d235c7640 1 -- 172.21.15.22:0/643120644 shutdown_connections 2024-08-20T01:39:44.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:44.557+0000 7f8d235c7640 1 -- 172.21.15.22:0/643120644 wait complete. 2024-08-20T01:39:45.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:44 smithi134 ceph-mon[22511]: pgmap v604: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 614 op/s 2024-08-20T01:39:45.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:44 smithi077 ceph-mon[22251]: pgmap v604: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 614 op/s 2024-08-20T01:39:45.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:44 smithi022 ceph-mon[18709]: pgmap v604: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 614 op/s 2024-08-20T01:39:45.227 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:39:45.528 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.152+0000 7f0d0fb2d640 1 -- 172.21.15.22:0/4117069078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d081073e0 msgr2=0x7f0d08107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.152+0000 7f0d0fb2d640 1 --2- 172.21.15.22:0/4117069078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d081073e0 0x7f0d08107820 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009900 tx=0x7f0cf802a410 comp rx=0 tx=0).stop 2024-08-20T01:39:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.152+0000 7f0d0fb2d640 1 -- 172.21.15.22:0/4117069078 shutdown_connections 2024-08-20T01:39:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.152+0000 7f0d0fb2d640 1 --2- 172.21.15.22:0/4117069078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d08107d60 0x7f0d0810e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.152+0000 7f0d0fb2d640 1 --2- 172.21.15.22:0/4117069078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d081073e0 0x7f0d08107820 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.152+0000 7f0d0fb2d640 1 --2- 172.21.15.22:0/4117069078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d081019d0 0x7f0d08101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.152+0000 7f0d0fb2d640 1 -- 172.21.15.22:0/4117069078 >> 172.21.15.22:0/4117069078 conn(0x7f0d080fd440 msgr2=0x7f0d080ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.152+0000 7f0d0fb2d640 1 -- 172.21.15.22:0/4117069078 shutdown_connections 2024-08-20T01:39:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.152+0000 7f0d0fb2d640 1 -- 172.21.15.22:0/4117069078 wait complete. 2024-08-20T01:39:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.152+0000 7f0d0fb2d640 1 Processor -- start 2024-08-20T01:39:46.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.152+0000 7f0d0fb2d640 1 -- start start 2024-08-20T01:39:46.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0d0fb2d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d081019d0 0x7f0d08199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:46.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0d0fb2d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d081073e0 0x7f0d081995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:46.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0d0fb2d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d08107d60 0x7f0d0819e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:46.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0d0fb2d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0d08111a20 con 0x7f0d081019d0 2024-08-20T01:39:46.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0d0fb2d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0d081118a0 con 0x7f0d081073e0 2024-08-20T01:39:46.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0d0fb2d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d08111ba0 con 0x7f0d08107d60 2024-08-20T01:39:46.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0d0d8c9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d081019d0 0x7f0d08199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:46.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0d0d8c9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d081019d0 0x7f0d08199070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59020/0 (socket says 172.21.15.22:59020) 2024-08-20T01:39:46.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0d0d8c9640 1 -- 172.21.15.22:0/245102014 learned_addr learned my addr 172.21.15.22:0/245102014 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:46.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0d0d0c8640 1 --2- 172.21.15.22:0/245102014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d081073e0 0x7f0d081995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:46.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0d0e0ca640 1 --2- 172.21.15.22:0/245102014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d08107d60 0x7f0d0819e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:46.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0d0d8c9640 1 -- 172.21.15.22:0/245102014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d08107d60 msgr2=0x7f0d0819e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0d0d8c9640 1 --2- 172.21.15.22:0/245102014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d08107d60 0x7f0d0819e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0d0d8c9640 1 -- 172.21.15.22:0/245102014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d081073e0 msgr2=0x7f0d081995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0d0d8c9640 1 --2- 172.21.15.22:0/245102014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d081073e0 0x7f0d081995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0d0d8c9640 1 -- 172.21.15.22:0/245102014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0819f120 con 0x7f0d081019d0 2024-08-20T01:39:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0d0d8c9640 1 --2- 172.21.15.22:0/245102014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d081019d0 0x7f0d08199070 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400e9f0 tx=0x7f0d0400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0cfeffd640 1 -- 172.21.15.22:0/245102014 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0400cd80 con 0x7f0d081019d0 2024-08-20T01:39:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0d0fb2d640 1 -- 172.21.15.22:0/245102014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d0819f410 con 0x7f0d081019d0 2024-08-20T01:39:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0cfeffd640 1 -- 172.21.15.22:0/245102014 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d040054d0 con 0x7f0d081019d0 2024-08-20T01:39:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.153+0000 7f0cfeffd640 1 -- 172.21.15.22:0/245102014 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d04010690 con 0x7f0d081019d0 2024-08-20T01:39:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.154+0000 7f0d0fb2d640 1 -- 172.21.15.22:0/245102014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d081a5ad0 con 0x7f0d081019d0 2024-08-20T01:39:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.156+0000 7f0d11f26740 1 Processor -- start 2024-08-20T01:39:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.156+0000 7f0cfeffd640 1 -- 172.21.15.22:0/245102014 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0d04004e90 con 0x7f0d081019d0 2024-08-20T01:39:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.156+0000 7f0d11f26740 1 -- start start 2024-08-20T01:39:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.156+0000 7f0d11f26740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0af880 0x55638c0afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:46.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.156+0000 7f0d11f26740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0b01a0 0x55638c0c0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:46.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.156+0000 7f0d11f26740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0c0540 0x55638c0c2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:46.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.156+0000 7f0d11f26740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55638c026930 con 0x55638c0b01a0 2024-08-20T01:39:46.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.156+0000 7f0d11f26740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55638c015e30 con 0x55638c0af880 2024-08-20T01:39:46.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.156+0000 7f0d11f26740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55638c019e70 con 0x55638c0c0540 2024-08-20T01:39:46.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.157+0000 7f0d0e0ca640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0af880 0x55638c0afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:46.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.157+0000 7f0d0d8c9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0b01a0 0x55638c0c0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:46.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.157+0000 7f0d0e0ca640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0af880 0x55638c0afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:43076/0 (socket says 172.21.15.22:43076) 2024-08-20T01:39:46.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.157+0000 7f0d0e0ca640 1 -- 172.21.15.22:0/1724123171 learned_addr learned my addr 172.21.15.22:0/1724123171 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:46.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.157+0000 7f0d0d0c8640 1 --2- 172.21.15.22:0/1724123171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0c0540 0x55638c0c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:46.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.157+0000 7f0d0e0ca640 1 -- 172.21.15.22:0/1724123171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0c0540 msgr2=0x55638c0c2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:46.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.157+0000 7f0d0e0ca640 1 --2- 172.21.15.22:0/1724123171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0c0540 0x55638c0c2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.157+0000 7f0d0e0ca640 1 -- 172.21.15.22:0/1724123171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0b01a0 msgr2=0x55638c0c0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:46.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.157+0000 7f0d0e0ca640 1 --2- 172.21.15.22:0/1724123171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0b01a0 0x55638c0c0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.157+0000 7f0d0e0ca640 1 -- 172.21.15.22:0/1724123171 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55638bd75650 con 0x55638c0af880 2024-08-20T01:39:46.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.157+0000 7f0cfeffd640 1 --2- 172.21.15.22:0/245102014 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0cf40b3bd0 0x7f0cf40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:46.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.157+0000 7f0d0d8c9640 1 --2- 172.21.15.22:0/245102014 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0cf40b3bd0 0x7f0cf40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:46.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.157+0000 7f0d0e0ca640 1 --2- 172.21.15.22:0/1724123171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0af880 0x55638c0afc60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009f40 tx=0x7f0d00010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3446f572ec1d852a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:46.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.157+0000 7f0cfeffd640 1 -- 172.21.15.22:0/245102014 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f0d040e4020 con 0x7f0d081019d0 2024-08-20T01:39:46.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.157+0000 7f0cf3fff640 1 -- 172.21.15.22:0/1724123171 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d00003b70 con 0x55638c0af880 2024-08-20T01:39:46.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.158+0000 7f0cf3fff640 1 -- 172.21.15.22:0/1724123171 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d00003d10 con 0x55638c0af880 2024-08-20T01:39:46.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.158+0000 7f0cf3fff640 1 -- 172.21.15.22:0/1724123171 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d00011a00 con 0x55638c0af880 2024-08-20T01:39:46.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.158+0000 7f0d11f26740 1 -- 172.21.15.22:0/1724123171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0af880 msgr2=0x55638c0afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:46.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.158+0000 7f0d11f26740 1 --2- 172.21.15.22:0/1724123171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0af880 0x55638c0afc60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009f40 tx=0x7f0d00010860 comp rx=0 tx=0).stop 2024-08-20T01:39:46.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.158+0000 7f0d0d8c9640 1 --2- 172.21.15.22:0/245102014 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0cf40b3bd0 0x7f0cf40b6090 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0d040aacd0 tx=0x7f0d040e7b90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:46.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.158+0000 7f0d11f26740 1 -- 172.21.15.22:0/1724123171 shutdown_connections 2024-08-20T01:39:46.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.158+0000 7f0d11f26740 1 --2- 172.21.15.22:0/1724123171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0c0540 0x55638c0c2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.158+0000 7f0d11f26740 1 --2- 172.21.15.22:0/1724123171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0b01a0 0x55638c0c0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.158+0000 7f0d11f26740 1 --2- 172.21.15.22:0/1724123171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0af880 0x55638c0afc60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.158+0000 7f0d11f26740 1 -- 172.21.15.22:0/1724123171 >> 172.21.15.22:0/1724123171 conn(0x55638c0ad6b0 msgr2=0x55638c0ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:46.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.158+0000 7f0d11f26740 1 -- 172.21.15.22:0/1724123171 shutdown_connections 2024-08-20T01:39:46.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.158+0000 7f0d11f26740 1 -- 172.21.15.22:0/1724123171 wait complete. 2024-08-20T01:39:46.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.159+0000 7f0d11f26740 1 -- start start 2024-08-20T01:39:46.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.159+0000 7f0d11f26740 1 Processor -- start 2024-08-20T01:39:46.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.159+0000 7f0d11f26740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0af880 0x55638c0bfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:46.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.159+0000 7f0d11f26740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0b01a0 0x55638c0bd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:46.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.159+0000 7f0d11f26740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0c0540 0x55638c0bdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:46.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.159+0000 7f0d11f26740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55638be78700 con 0x55638c0b01a0 2024-08-20T01:39:46.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.159+0000 7f0d11f26740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55638bf9c810 con 0x55638c0af880 2024-08-20T01:39:46.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.159+0000 7f0d11f26740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55638c0c31f0 con 0x55638c0c0540 2024-08-20T01:39:46.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.160+0000 7f0d11f26740 10 client.0 _ll_register_callbacks cb 0x55638c00f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:46.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.160+0000 7f0d0e0ca640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0af880 0x55638c0bfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.160+0000 7f0d0e0ca640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0af880 0x55638c0bfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:43082/0 (socket says 172.21.15.22:43082) 2024-08-20T01:39:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.160+0000 7f0d0d0c8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0b01a0 0x55638c0bd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.160+0000 7f0d0e0ca640 1 -- 172.21.15.22:0/3326243569 learned_addr learned my addr 172.21.15.22:0/3326243569 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.160+0000 7f0d0e0ca640 1 --2- 172.21.15.22:0/3326243569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0c0540 0x55638c0bdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.160+0000 7f0d0e0ca640 1 -- 172.21.15.22:0/3326243569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0c0540 msgr2=0x55638c0bdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.160+0000 7f0d0e0ca640 1 --2- 172.21.15.22:0/3326243569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0c0540 0x55638c0bdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.160+0000 7f0d0e0ca640 1 -- 172.21.15.22:0/3326243569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0b01a0 msgr2=0x55638c0bd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.160+0000 7f0d0e0ca640 1 --2- 172.21.15.22:0/3326243569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0b01a0 0x55638c0bd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.160+0000 7f0d0e0ca640 1 -- 172.21.15.22:0/3326243569 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55638c0cc550 con 0x55638c0af880 2024-08-20T01:39:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.160+0000 7f0d0d0c8640 1 --2- 172.21.15.22:0/3326243569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0b01a0 0x55638c0bd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.160+0000 7f0d0e0ca640 1 --2- 172.21.15.22:0/3326243569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0af880 0x55638c0bfff0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0d00003e00 tx=0x7f0d00013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e41884927af1060 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.160+0000 7f0cf17fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:39:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.160+0000 7f0cf17fa640 1 -- 172.21.15.22:0/3326243569 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d00003e60 con 0x55638c0af880 2024-08-20T01:39:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.160+0000 7f0cf17fa640 1 -- 172.21.15.22:0/3326243569 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f0d00004470 con 0x55638c0af880 2024-08-20T01:39:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.160+0000 7f0d11f26740 1 -- 172.21.15.22:0/3326243569 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55638bfc5150 con 0x55638c0af880 2024-08-20T01:39:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.161+0000 7f0cf17fa640 1 -- 172.21.15.22:0/3326243569 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0d00004670 con 0x55638c0af880 2024-08-20T01:39:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.161+0000 7f0d11f26740 10 client.26438 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.161+0000 7f0d11f26740 1 -- 172.21.15.22:0/3326243569 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55638c0cef00 con 0x55638c0af880 2024-08-20T01:39:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.161+0000 7f0cf17fa640 1 -- 172.21.15.22:0/3326243569 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55638bfc5150 con 0x55638c0af880 2024-08-20T01:39:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.161+0000 7f0cf17fa640 1 -- 172.21.15.22:0/3326243569 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f0d00029040 con 0x55638c0af880 2024-08-20T01:39:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.161+0000 7f0d11f26740 10 client.26438 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.161+0000 7f0d11f26740 10 client.26438 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:39:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.161+0000 7f0d11f26740 20 client.26438 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.161+0000 7f0d11f26740 1 --2- 172.21.15.22:0/3326243569 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55638c0d02b0 0x55638c0d26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.161+0000 7f0d11f26740 4 client.26438 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.161+0000 7f0d11f26740 1 -- 172.21.15.22:0/3326243569 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55638c028880 con 0x55638c0d02b0 2024-08-20T01:39:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.161+0000 7f0d0d0c8640 1 --2- 172.21.15.22:0/3326243569 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55638c0d02b0 0x55638c0d26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.162+0000 7f0d0d0c8640 1 --2- 172.21.15.22:0/3326243569 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55638c0d02b0 0x55638c0d26a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9d175f83dea494d6 server_cookie=cfc53e36fddd8682 in_seq=0 out_seq=0 2024-08-20T01:39:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.162+0000 7f0cf17fa640 10 client.26438 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:39:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.163+0000 7f0cf17fa640 1 -- 172.21.15.22:0/3326243569 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55638c028880 con 0x55638c0d02b0 2024-08-20T01:39:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.163+0000 7f0cf17fa640 10 client.26438 handle_command_reply: tid=0 2024-08-20T01:39:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.163+0000 7f0d11f26740 1 client.26438 shutdown 2024-08-20T01:39:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.163+0000 7f0d11f26740 1 -- 172.21.15.22:0/3326243569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0af880 msgr2=0x55638c0bfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.163+0000 7f0d11f26740 1 --2- 172.21.15.22:0/3326243569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0af880 0x55638c0bfff0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0d00003e00 tx=0x7f0d00013040 comp rx=0 tx=0).stop 2024-08-20T01:39:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.164+0000 7f0d11f26740 1 -- 172.21.15.22:0/3326243569 shutdown_connections 2024-08-20T01:39:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.164+0000 7f0d11f26740 1 --2- 172.21.15.22:0/3326243569 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55638c0d02b0 0x55638c0d26a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.164+0000 7f0d11f26740 1 --2- 172.21.15.22:0/3326243569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0c0540 0x55638c0bdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.164+0000 7f0d11f26740 1 --2- 172.21.15.22:0/3326243569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0b01a0 0x55638c0bd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.164+0000 7f0d11f26740 1 --2- 172.21.15.22:0/3326243569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0af880 0x55638c0bfff0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.164+0000 7f0cf17fa640 0 client.26438 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:39:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.164+0000 7f0d11f26740 1 -- 172.21.15.22:0/3326243569 >> 172.21.15.22:0/3326243569 conn(0x55638c0ad6b0 msgr2=0x55638c0b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.164+0000 7f0d11f26740 1 -- 172.21.15.22:0/3326243569 shutdown_connections 2024-08-20T01:39:46.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.164+0000 7f0d11f26740 1 -- 172.21.15.22:0/3326243569 wait complete. 2024-08-20T01:39:46.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.164+0000 7f0d11f26740 20 client.26438 trim_cache size 0 max 16384 2024-08-20T01:39:46.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.182+0000 7f0d11f26740 1 Processor -- start 2024-08-20T01:39:46.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.182+0000 7f0d11f26740 1 -- start start 2024-08-20T01:39:46.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.182+0000 7f0d11f26740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0af880 0x55638c0bafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:46.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.182+0000 7f0d11f26740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0b01a0 0x55638c0c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:46.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.182+0000 7f0d11f26740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0c0540 0x55638c0bc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:46.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.182+0000 7f0d11f26740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0d081ae970 con 0x55638c0af880 2024-08-20T01:39:46.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.182+0000 7f0d11f26740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0d081ac180 con 0x55638c0c0540 2024-08-20T01:39:46.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.182+0000 7f0d11f26740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d081a9fd0 con 0x55638c0b01a0 2024-08-20T01:39:46.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.182+0000 7f0d0e0ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0af880 0x55638c0bafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:46.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.182+0000 7f0d0e0ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0af880 0x55638c0bafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59048/0 (socket says 172.21.15.22:59048) 2024-08-20T01:39:46.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.182+0000 7f0d0e0ca640 1 -- 172.21.15.22:0/1258722573 learned_addr learned my addr 172.21.15.22:0/1258722573 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:46.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.182+0000 7f0d0d0c8640 1 --2- 172.21.15.22:0/1258722573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0b01a0 0x55638c0c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:46.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.182+0000 7f0d0e0ca640 1 --2- 172.21.15.22:0/1258722573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0c0540 0x55638c0bc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:46.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.182+0000 7f0d0d0c8640 1 -- 172.21.15.22:0/1258722573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0c0540 msgr2=0x55638c0bc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:46.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.182+0000 7f0d0d0c8640 1 --2- 172.21.15.22:0/1258722573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0c0540 0x55638c0bc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.182+0000 7f0d0d0c8640 1 -- 172.21.15.22:0/1258722573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0af880 msgr2=0x55638c0bafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:46.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.182+0000 7f0d0d0c8640 1 --2- 172.21.15.22:0/1258722573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0af880 0x55638c0bafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.182+0000 7f0d0d0c8640 1 -- 172.21.15.22:0/1258722573 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55638c0a8830 con 0x55638c0b01a0 2024-08-20T01:39:46.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.182+0000 7f0d0e0ca640 1 --2- 172.21.15.22:0/1258722573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0af880 0x55638c0bafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:46.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.183+0000 7f0d0d0c8640 1 --2- 172.21.15.22:0/1258722573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0b01a0 0x55638c0c24f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009230 tx=0x7f0cf8005db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=532e8b58dcc42ea6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:46.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.183+0000 7f0cf37fe640 1 -- 172.21.15.22:0/1258722573 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf804b070 con 0x55638c0b01a0 2024-08-20T01:39:46.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.183+0000 7f0cf37fe640 1 -- 172.21.15.22:0/1258722573 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cf8004380 con 0x55638c0b01a0 2024-08-20T01:39:46.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.183+0000 7f0cf37fe640 1 -- 172.21.15.22:0/1258722573 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8035040 con 0x55638c0b01a0 2024-08-20T01:39:46.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.183+0000 7f0d11f26740 1 -- 172.21.15.22:0/1258722573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0b01a0 msgr2=0x55638c0c24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:46.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.183+0000 7f0d11f26740 1 --2- 172.21.15.22:0/1258722573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0b01a0 0x55638c0c24f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009230 tx=0x7f0cf8005db0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.183+0000 7f0d11f26740 1 -- 172.21.15.22:0/1258722573 shutdown_connections 2024-08-20T01:39:46.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.184+0000 7f0d11f26740 1 --2- 172.21.15.22:0/1258722573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0c0540 0x55638c0bc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.184+0000 7f0d11f26740 1 --2- 172.21.15.22:0/1258722573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0b01a0 0x55638c0c24f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.184+0000 7f0d11f26740 1 --2- 172.21.15.22:0/1258722573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0af880 0x55638c0bafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.184+0000 7f0d11f26740 1 -- 172.21.15.22:0/1258722573 >> 172.21.15.22:0/1258722573 conn(0x55638c0ad6b0 msgr2=0x55638c0bf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:46.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.184+0000 7f0d11f26740 1 -- 172.21.15.22:0/1258722573 shutdown_connections 2024-08-20T01:39:46.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.184+0000 7f0d11f26740 1 -- 172.21.15.22:0/1258722573 wait complete. 2024-08-20T01:39:46.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.184+0000 7f0d11f26740 1 -- start start 2024-08-20T01:39:46.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.184+0000 7f0d11f26740 1 Processor -- start 2024-08-20T01:39:46.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.184+0000 7f0d11f26740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0af880 0x55638c0c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:46.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0d11f26740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0b01a0 0x55638c0c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:46.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0d11f26740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0c0540 0x55638c0d6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:46.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0d11f26740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0d081aa640 con 0x55638c0b01a0 2024-08-20T01:39:46.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0d11f26740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0d081abab0 con 0x55638c0c0540 2024-08-20T01:39:46.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0d11f26740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d081aad10 con 0x55638c0af880 2024-08-20T01:39:46.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0d11f26740 10 client.0 _ll_register_callbacks cb 0x7f0d040e7a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:46.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0d0d0c8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0b01a0 0x55638c0c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:46.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0d0e0ca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0af880 0x55638c0c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:46.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0d0d0c8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0b01a0 0x55638c0c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59054/0 (socket says 172.21.15.22:59054) 2024-08-20T01:39:46.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0d0d0c8640 1 -- 172.21.15.22:0/1653074964 learned_addr learned my addr 172.21.15.22:0/1653074964 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:46.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0d0e0ca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0af880 0x55638c0c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:58264/0 (socket says 172.21.15.22:58264) 2024-08-20T01:39:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0d0e0ca640 1 --2- 172.21.15.22:0/1653074964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0c0540 0x55638c0d6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0d0d0c8640 1 -- 172.21.15.22:0/1653074964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0af880 msgr2=0x55638c0c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0d0d0c8640 1 --2- 172.21.15.22:0/1653074964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0af880 0x55638c0c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0d0d0c8640 1 -- 172.21.15.22:0/1653074964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0c0540 msgr2=0x55638c0d6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0d0d0c8640 1 --2- 172.21.15.22:0/1653074964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0c0540 0x55638c0d6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0d0d0c8640 1 -- 172.21.15.22:0/1653074964 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55638c0c90e0 con 0x55638c0b01a0 2024-08-20T01:39:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0d0d0c8640 1 --2- 172.21.15.22:0/1653074964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0b01a0 0x55638c0c89f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0cf802a450 tx=0x7f0cf8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2960ffee9901b42f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0cf17fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:39:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0cf17fa640 1 -- 172.21.15.22:0/1653074964 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8053020 con 0x55638c0b01a0 2024-08-20T01:39:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0cf17fa640 1 -- 172.21.15.22:0/1653074964 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f0cf80035f0 con 0x55638c0b01a0 2024-08-20T01:39:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.185+0000 7f0d11f26740 1 -- 172.21.15.22:0/1653074964 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cf8004380 con 0x55638c0b01a0 2024-08-20T01:39:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.186+0000 7f0cf17fa640 1 -- 172.21.15.22:0/1653074964 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0cf8035050 con 0x55638c0b01a0 2024-08-20T01:39:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.186+0000 7f0d11f26740 10 client.16836 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.186+0000 7f0d11f26740 1 -- 172.21.15.22:0/1653074964 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55638c13a450 con 0x55638c0b01a0 2024-08-20T01:39:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.186+0000 7f0cf17fa640 1 -- 172.21.15.22:0/1653074964 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cf8004380 con 0x55638c0b01a0 2024-08-20T01:39:46.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.186+0000 7f0cf17fa640 1 -- 172.21.15.22:0/1653074964 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f0cf804e070 con 0x55638c0b01a0 2024-08-20T01:39:46.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.186+0000 7f0d11f26740 10 client.16836 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:46.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.186+0000 7f0d11f26740 10 client.16836 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:39:46.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.186+0000 7f0d11f26740 20 client.16836 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:46.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.186+0000 7f0d11f26740 1 --2- 172.21.15.22:0/1653074964 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55638c13ac90 0x55638c13d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:46.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.186+0000 7f0d11f26740 4 client.16836 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:39:46.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.186+0000 7f0d11f26740 1 -- 172.21.15.22:0/1653074964 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55638c024320 con 0x55638c13ac90 2024-08-20T01:39:46.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.186+0000 7f0d0e0ca640 1 --2- 172.21.15.22:0/1653074964 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55638c13ac90 0x55638c13d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:46.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.187+0000 7f0d0e0ca640 1 --2- 172.21.15.22:0/1653074964 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55638c13ac90 0x55638c13d0b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d2e8fdb7b131a65f server_cookie=fde42412a26bfd0f in_seq=0 out_seq=0 2024-08-20T01:39:46.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.187+0000 7f0cf17fa640 10 client.16836 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:39:46.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.188+0000 7f0cf17fa640 1 -- 172.21.15.22:0/1653074964 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55638c024320 con 0x55638c13ac90 2024-08-20T01:39:46.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.188+0000 7f0cf17fa640 10 client.16836 handle_command_reply: tid=0 2024-08-20T01:39:46.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.188+0000 7f0d11f26740 1 client.16836 shutdown 2024-08-20T01:39:46.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.188+0000 7f0d11f26740 1 -- 172.21.15.22:0/1653074964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0b01a0 msgr2=0x55638c0c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:46.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.188+0000 7f0d11f26740 1 --2- 172.21.15.22:0/1653074964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0b01a0 0x55638c0c89f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0cf802a450 tx=0x7f0cf8005fd0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.188+0000 7f0d11f26740 1 -- 172.21.15.22:0/1653074964 shutdown_connections 2024-08-20T01:39:46.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.188+0000 7f0d11f26740 1 --2- 172.21.15.22:0/1653074964 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x55638c13ac90 0x55638c13d0b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.188+0000 7f0d11f26740 1 --2- 172.21.15.22:0/1653074964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55638c0c0540 0x55638c0d6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.188+0000 7f0d11f26740 1 --2- 172.21.15.22:0/1653074964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638c0b01a0 0x55638c0c89f0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.188+0000 7f0d11f26740 1 --2- 172.21.15.22:0/1653074964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55638c0af880 0x55638c0c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.188+0000 7f0cf17fa640 0 client.16836 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:39:46.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.188+0000 7f0d11f26740 1 -- 172.21.15.22:0/1653074964 >> 172.21.15.22:0/1653074964 conn(0x55638c0ad6b0 msgr2=0x55638c0ae390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:46.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.188+0000 7f0d11f26740 1 -- 172.21.15.22:0/1653074964 shutdown_connections 2024-08-20T01:39:46.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.188+0000 7f0d11f26740 1 -- 172.21.15.22:0/1653074964 wait complete. 2024-08-20T01:39:46.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.188+0000 7f0d11f26740 20 client.16836 trim_cache size 0 max 16384 2024-08-20T01:39:46.196 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:39:46.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.189+0000 7f0d0fb2d640 1 -- 172.21.15.22:0/245102014 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0cf40b3bd0 msgr2=0x7f0cf40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:46.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.189+0000 7f0d0fb2d640 1 --2- 172.21.15.22:0/245102014 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0cf40b3bd0 0x7f0cf40b6090 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0d040aacd0 tx=0x7f0d040e7b90 comp rx=0 tx=0).stop 2024-08-20T01:39:46.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.189+0000 7f0d0fb2d640 1 -- 172.21.15.22:0/245102014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d081019d0 msgr2=0x7f0d08199070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:46.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.189+0000 7f0d0fb2d640 1 --2- 172.21.15.22:0/245102014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d081019d0 0x7f0d08199070 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400e9f0 tx=0x7f0d0400edf0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.189+0000 7f0d0fb2d640 1 -- 172.21.15.22:0/245102014 shutdown_connections 2024-08-20T01:39:46.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.189+0000 7f0d0fb2d640 1 --2- 172.21.15.22:0/245102014 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0cf40b3bd0 0x7f0cf40b6090 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.189+0000 7f0d0fb2d640 1 --2- 172.21.15.22:0/245102014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d08107d60 0x7f0d0819e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.189+0000 7f0d0fb2d640 1 --2- 172.21.15.22:0/245102014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d081073e0 0x7f0d081995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.189+0000 7f0d0fb2d640 1 --2- 172.21.15.22:0/245102014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d081019d0 0x7f0d08199070 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.189+0000 7f0d0fb2d640 1 -- 172.21.15.22:0/245102014 >> 172.21.15.22:0/245102014 conn(0x7f0d080fd440 msgr2=0x7f0d0806b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.189+0000 7f0d0fb2d640 1 -- 172.21.15.22:0/245102014 shutdown_connections 2024-08-20T01:39:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:46.189+0000 7f0d0fb2d640 1 -- 172.21.15.22:0/245102014 wait complete. 2024-08-20T01:39:46.867 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:39:47.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:46 smithi134 ceph-mon[22511]: pgmap v605: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 458 op/s 2024-08-20T01:39:47.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:46 smithi077 ceph-mon[22251]: pgmap v605: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 458 op/s 2024-08-20T01:39:47.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:46 smithi022 ceph-mon[18709]: pgmap v605: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 458 op/s 2024-08-20T01:39:47.203 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:47.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.890+0000 7fc21af8d640 1 -- 172.21.15.22:0/1064859377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc214107d60 msgr2=0x7fc21410e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:47.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.890+0000 7fc21af8d640 1 --2- 172.21.15.22:0/1064859377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc214107d60 0x7fc21410e560 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009ca0 tx=0x7fc20c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.890+0000 7fc21af8d640 1 -- 172.21.15.22:0/1064859377 shutdown_connections 2024-08-20T01:39:47.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.890+0000 7fc21af8d640 1 --2- 172.21.15.22:0/1064859377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc214107d60 0x7fc21410e560 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.890+0000 7fc21af8d640 1 --2- 172.21.15.22:0/1064859377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2141073e0 0x7fc214107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.890+0000 7fc21af8d640 1 --2- 172.21.15.22:0/1064859377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2141019d0 0x7fc214101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.890+0000 7fc21af8d640 1 -- 172.21.15.22:0/1064859377 >> 172.21.15.22:0/1064859377 conn(0x7fc2140fd440 msgr2=0x7fc2140ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:47.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.890+0000 7fc21af8d640 1 -- 172.21.15.22:0/1064859377 shutdown_connections 2024-08-20T01:39:47.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.890+0000 7fc21af8d640 1 -- 172.21.15.22:0/1064859377 wait complete. 2024-08-20T01:39:47.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.890+0000 7fc21af8d640 1 Processor -- start 2024-08-20T01:39:47.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.891+0000 7fc21af8d640 1 -- start start 2024-08-20T01:39:47.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.891+0000 7fc21af8d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2141019d0 0x7fc214198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:47.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.891+0000 7fc21af8d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2141073e0 0x7fc214199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:47.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.891+0000 7fc21af8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc214107d60 0x7fc21419e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:47.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.891+0000 7fc21af8d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc214112b40 con 0x7fc2141019d0 2024-08-20T01:39:47.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.891+0000 7fc21af8d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc2141129c0 con 0x7fc2141073e0 2024-08-20T01:39:47.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.891+0000 7fc21af8d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc214112cc0 con 0x7fc214107d60 2024-08-20T01:39:47.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.891+0000 7fc218d29640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2141019d0 0x7fc214198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:47.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.891+0000 7fc218d29640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2141019d0 0x7fc214198f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59068/0 (socket says 172.21.15.22:59068) 2024-08-20T01:39:47.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.891+0000 7fc218d29640 1 -- 172.21.15.22:0/3697598498 learned_addr learned my addr 172.21.15.22:0/3697598498 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:47.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.891+0000 7fc213fff640 1 --2- 172.21.15.22:0/3697598498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2141073e0 0x7fc214199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:47.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.891+0000 7fc21952a640 1 --2- 172.21.15.22:0/3697598498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc214107d60 0x7fc21419e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:47.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.891+0000 7fc218d29640 1 -- 172.21.15.22:0/3697598498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc214107d60 msgr2=0x7fc21419e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:47.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.891+0000 7fc218d29640 1 --2- 172.21.15.22:0/3697598498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc214107d60 0x7fc21419e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.891+0000 7fc218d29640 1 -- 172.21.15.22:0/3697598498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2141073e0 msgr2=0x7fc214199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:47.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.891+0000 7fc218d29640 1 --2- 172.21.15.22:0/3697598498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2141073e0 0x7fc214199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.891+0000 7fc218d29640 1 -- 172.21.15.22:0/3697598498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21419f000 con 0x7fc2141019d0 2024-08-20T01:39:47.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.891+0000 7fc218d29640 1 --2- 172.21.15.22:0/3697598498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2141019d0 0x7fc214198f50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc20800e9f0 tx=0x7fc20800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:47.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.892+0000 7fc211ffb640 1 -- 172.21.15.22:0/3697598498 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20800cd80 con 0x7fc2141019d0 2024-08-20T01:39:47.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.892+0000 7fc211ffb640 1 -- 172.21.15.22:0/3697598498 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2080108e0 con 0x7fc2141019d0 2024-08-20T01:39:47.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.892+0000 7fc211ffb640 1 -- 172.21.15.22:0/3697598498 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc208018980 con 0x7fc2141019d0 2024-08-20T01:39:47.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.892+0000 7fc21af8d640 1 -- 172.21.15.22:0/3697598498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21419f2f0 con 0x7fc2141019d0 2024-08-20T01:39:47.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.892+0000 7fc21af8d640 1 -- 172.21.15.22:0/3697598498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2141a59b0 con 0x7fc2141019d0 2024-08-20T01:39:47.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.894+0000 7fc21d386740 1 Processor -- start 2024-08-20T01:39:47.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.894+0000 7fc211ffb640 1 -- 172.21.15.22:0/3697598498 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc208010430 con 0x7fc2141019d0 2024-08-20T01:39:47.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.895+0000 7fc21d386740 1 -- start start 2024-08-20T01:39:47.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.895+0000 7fc21d386740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c79a880 0x56058c79ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:47.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.895+0000 7fc21d386740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c79b1a0 0x56058c7a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:47.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.895+0000 7fc21d386740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c7a7130 0x56058c7a9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:47.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.895+0000 7fc21d386740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56058c711930 con 0x56058c79b1a0 2024-08-20T01:39:47.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.895+0000 7fc21d386740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56058c700e30 con 0x56058c7a7130 2024-08-20T01:39:47.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.895+0000 7fc21d386740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56058c704e70 con 0x56058c79a880 2024-08-20T01:39:47.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.895+0000 7fc218d29640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c79b1a0 0x56058c7a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:47.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.895+0000 7fc218d29640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c79b1a0 0x56058c7a6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59072/0 (socket says 172.21.15.22:59072) 2024-08-20T01:39:47.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.895+0000 7fc218d29640 1 -- 172.21.15.22:0/1913337209 learned_addr learned my addr 172.21.15.22:0/1913337209 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:47.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.895+0000 7fc21952a640 1 --2- 172.21.15.22:0/1913337209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c79a880 0x56058c79ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:47.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.895+0000 7fc213fff640 1 --2- 172.21.15.22:0/1913337209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c7a7130 0x56058c7a9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:47.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.895+0000 7fc213fff640 1 -- 172.21.15.22:0/1913337209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c79a880 msgr2=0x56058c79ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:47.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.895+0000 7fc213fff640 1 --2- 172.21.15.22:0/1913337209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c79a880 0x56058c79ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.895+0000 7fc213fff640 1 -- 172.21.15.22:0/1913337209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c79b1a0 msgr2=0x56058c7a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:47.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.895+0000 7fc213fff640 1 --2- 172.21.15.22:0/1913337209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c79b1a0 0x56058c7a6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.895+0000 7fc213fff640 1 -- 172.21.15.22:0/1913337209 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56058c460650 con 0x56058c7a7130 2024-08-20T01:39:47.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.896+0000 7fc211ffb640 1 --2- 172.21.15.22:0/3697598498 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc2040b3bd0 0x7fc2040b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:47.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.896+0000 7fc213fff640 1 --2- 172.21.15.22:0/1913337209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c7a7130 0x56058c7a9520 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc200005d00 tx=0x7fc2000107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d39cd3f86c18e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.896+0000 7fc21952a640 1 --2- 172.21.15.22:0/3697598498 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc2040b3bd0 0x7fc2040b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.896+0000 7fc211ffb640 1 -- 172.21.15.22:0/3697598498 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fc2080e3fa0 con 0x7fc2141019d0 2024-08-20T01:39:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.896+0000 7fc1feffd640 1 -- 172.21.15.22:0/1913337209 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20001c480 con 0x56058c7a7130 2024-08-20T01:39:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.896+0000 7fc1feffd640 1 -- 172.21.15.22:0/1913337209 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc20001cad0 con 0x56058c7a7130 2024-08-20T01:39:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.896+0000 7fc1feffd640 1 -- 172.21.15.22:0/1913337209 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200011bb0 con 0x56058c7a7130 2024-08-20T01:39:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.897+0000 7fc21d386740 1 -- 172.21.15.22:0/1913337209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c7a7130 msgr2=0x56058c7a9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.897+0000 7fc21952a640 1 --2- 172.21.15.22:0/3697598498 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc2040b3bd0 0x7fc2040b6090 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc20c006010 tx=0x7fc20c0099a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.897+0000 7fc21d386740 1 --2- 172.21.15.22:0/1913337209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c7a7130 0x56058c7a9520 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc200005d00 tx=0x7fc2000107a0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.897+0000 7fc21d386740 1 -- 172.21.15.22:0/1913337209 shutdown_connections 2024-08-20T01:39:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.897+0000 7fc21d386740 1 --2- 172.21.15.22:0/1913337209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c7a7130 0x56058c7a9520 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.897+0000 7fc21d386740 1 --2- 172.21.15.22:0/1913337209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c79b1a0 0x56058c7a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.897+0000 7fc21d386740 1 --2- 172.21.15.22:0/1913337209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c79a880 0x56058c79ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.897+0000 7fc21d386740 1 -- 172.21.15.22:0/1913337209 >> 172.21.15.22:0/1913337209 conn(0x56058c7986b0 msgr2=0x56058c799850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:47.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.897+0000 7fc21d386740 1 -- 172.21.15.22:0/1913337209 shutdown_connections 2024-08-20T01:39:47.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.897+0000 7fc21d386740 1 -- 172.21.15.22:0/1913337209 wait complete. 2024-08-20T01:39:47.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.897+0000 7fc21d386740 1 -- start start 2024-08-20T01:39:47.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.897+0000 7fc21d386740 1 Processor -- start 2024-08-20T01:39:47.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc21d386740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c79a880 0x56058c7a40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:47.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc21d386740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c79b1a0 0x56058c7a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:47.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc21d386740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c7a7130 0x56058c7a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:47.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc21d386740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56058c563700 con 0x56058c7a7130 2024-08-20T01:39:47.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc21d386740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56058c687810 con 0x56058c79a880 2024-08-20T01:39:47.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc21d386740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56058c7a9de0 con 0x56058c79b1a0 2024-08-20T01:39:47.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc21d386740 10 client.0 _ll_register_callbacks cb 0x56058c6fa700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:47.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc21952a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c7a7130 0x56058c7a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:47.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc21952a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c7a7130 0x56058c7a4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59076/0 (socket says 172.21.15.22:59076) 2024-08-20T01:39:47.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc218d29640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c79a880 0x56058c7a40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc21952a640 1 -- 172.21.15.22:0/1542188339 learned_addr learned my addr 172.21.15.22:0/1542188339 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc213fff640 1 --2- 172.21.15.22:0/1542188339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c79b1a0 0x56058c7a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc218d29640 1 -- 172.21.15.22:0/1542188339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c79b1a0 msgr2=0x56058c7a45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc218d29640 1 --2- 172.21.15.22:0/1542188339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c79b1a0 0x56058c7a45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc218d29640 1 -- 172.21.15.22:0/1542188339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c7a7130 msgr2=0x56058c7a4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc218d29640 1 --2- 172.21.15.22:0/1542188339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c7a7130 0x56058c7a4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc218d29640 1 -- 172.21.15.22:0/1542188339 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56058c7b3160 con 0x56058c79a880 2024-08-20T01:39:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc21952a640 1 --2- 172.21.15.22:0/1542188339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c7a7130 0x56058c7a4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc218d29640 1 --2- 172.21.15.22:0/1542188339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c79a880 0x56058c7a40a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc2080aae90 tx=0x7fc2080a6dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a90eb8cb66d489a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc1f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:39:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc1f3fff640 1 -- 172.21.15.22:0/1542188339 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2080aa670 con 0x56058c79a880 2024-08-20T01:39:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.898+0000 7fc1f3fff640 1 -- 172.21.15.22:0/1542188339 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fc2080e7b50 con 0x56058c79a880 2024-08-20T01:39:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.899+0000 7fc21d386740 1 -- 172.21.15.22:0/1542188339 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56058c6b0150 con 0x56058c79a880 2024-08-20T01:39:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.899+0000 7fc1f3fff640 1 -- 172.21.15.22:0/1542188339 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc208010720 con 0x56058c79a880 2024-08-20T01:39:47.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.899+0000 7fc21d386740 10 client.26456 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:47.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.899+0000 7fc21d386740 1 -- 172.21.15.22:0/1542188339 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56058c7b5b10 con 0x56058c79a880 2024-08-20T01:39:47.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.899+0000 7fc1f3fff640 1 -- 172.21.15.22:0/1542188339 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56058c6b0150 con 0x56058c79a880 2024-08-20T01:39:47.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.899+0000 7fc1f3fff640 1 -- 172.21.15.22:0/1542188339 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fc208018b20 con 0x56058c79a880 2024-08-20T01:39:47.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.899+0000 7fc21d386740 10 client.26456 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:47.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.899+0000 7fc21d386740 10 client.26456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:47.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.899+0000 7fc21d386740 20 client.26456 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:47.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.899+0000 7fc21d386740 1 --2- 172.21.15.22:0/1542188339 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56058c7b7070 0x56058c7b94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:47.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.899+0000 7fc21d386740 4 client.26456 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:47.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.899+0000 7fc21d386740 1 -- 172.21.15.22:0/1542188339 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56058c713880 con 0x56058c7b7070 2024-08-20T01:39:47.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.899+0000 7fc213fff640 1 --2- 172.21.15.22:0/1542188339 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56058c7b7070 0x56058c7b94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:47.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.900+0000 7fc1f3fff640 10 client.26456 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:47.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.900+0000 7fc213fff640 1 --2- 172.21.15.22:0/1542188339 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56058c7b7070 0x56058c7b94a0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69842dbda39ee5c1 server_cookie=b0ff1abb346e2dcc in_seq=0 out_seq=0 2024-08-20T01:39:47.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.900+0000 7fc1f3fff640 1 -- 172.21.15.22:0/1542188339 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56058c713880 con 0x56058c7b7070 2024-08-20T01:39:47.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.900+0000 7fc1f3fff640 10 client.26456 handle_command_reply: tid=0 2024-08-20T01:39:47.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.900+0000 7fc21d386740 1 client.26456 shutdown 2024-08-20T01:39:47.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.901+0000 7fc21d386740 1 -- 172.21.15.22:0/1542188339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c79a880 msgr2=0x56058c7a40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:47.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.901+0000 7fc21d386740 1 --2- 172.21.15.22:0/1542188339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c79a880 0x56058c7a40a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc2080aae90 tx=0x7fc2080a6dc0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.901+0000 7fc21d386740 1 -- 172.21.15.22:0/1542188339 shutdown_connections 2024-08-20T01:39:47.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.901+0000 7fc21d386740 1 --2- 172.21.15.22:0/1542188339 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56058c7b7070 0x56058c7b94a0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.901+0000 7fc21d386740 1 --2- 172.21.15.22:0/1542188339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c7a7130 0x56058c7a4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.901+0000 7fc21d386740 1 --2- 172.21.15.22:0/1542188339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c79b1a0 0x56058c7a45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.901+0000 7fc1f3fff640 0 client.26456 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:47.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.901+0000 7fc21d386740 1 --2- 172.21.15.22:0/1542188339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c79a880 0x56058c7a40a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.901+0000 7fc21d386740 1 -- 172.21.15.22:0/1542188339 >> 172.21.15.22:0/1542188339 conn(0x56058c7986b0 msgr2=0x56058c79e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:47.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.901+0000 7fc21d386740 1 -- 172.21.15.22:0/1542188339 shutdown_connections 2024-08-20T01:39:47.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.901+0000 7fc21d386740 1 -- 172.21.15.22:0/1542188339 wait complete. 2024-08-20T01:39:47.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.901+0000 7fc21d386740 20 client.26456 trim_cache size 0 max 16384 2024-08-20T01:39:47.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.914+0000 7fc21d386740 1 Processor -- start 2024-08-20T01:39:47.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.914+0000 7fc21d386740 1 -- start start 2024-08-20T01:39:47.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.914+0000 7fc21d386740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c79a880 0x56058c7a3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:47.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.914+0000 7fc21d386740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c79b1a0 0x56058c79e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:47.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.914+0000 7fc21d386740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c7a7130 0x56058c7bedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:47.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.914+0000 7fc21d386740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc2141b0b30 con 0x56058c79a880 2024-08-20T01:39:47.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.914+0000 7fc21d386740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc2141ae340 con 0x56058c79b1a0 2024-08-20T01:39:47.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.914+0000 7fc21d386740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc2141ac190 con 0x56058c7a7130 2024-08-20T01:39:47.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.914+0000 7fc218d29640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c79a880 0x56058c7a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:47.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.914+0000 7fc218d29640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c79a880 0x56058c7a3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59080/0 (socket says 172.21.15.22:59080) 2024-08-20T01:39:47.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.914+0000 7fc218d29640 1 -- 172.21.15.22:0/4021715975 learned_addr learned my addr 172.21.15.22:0/4021715975 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:47.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.914+0000 7fc213fff640 1 --2- 172.21.15.22:0/4021715975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c79b1a0 0x56058c79e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:47.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.914+0000 7fc21952a640 1 --2- 172.21.15.22:0/4021715975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c7a7130 0x56058c7bedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:47.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.915+0000 7fc213fff640 1 -- 172.21.15.22:0/4021715975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c7a7130 msgr2=0x56058c7bedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:47.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.915+0000 7fc213fff640 1 --2- 172.21.15.22:0/4021715975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c7a7130 0x56058c7bedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.915+0000 7fc213fff640 1 -- 172.21.15.22:0/4021715975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c79a880 msgr2=0x56058c7a3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:47.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.915+0000 7fc213fff640 1 --2- 172.21.15.22:0/4021715975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c79a880 0x56058c7a3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.915+0000 7fc213fff640 1 -- 172.21.15.22:0/4021715975 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56058c799130 con 0x56058c79b1a0 2024-08-20T01:39:47.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.915+0000 7fc218d29640 1 --2- 172.21.15.22:0/4021715975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c79a880 0x56058c7a3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:47.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.915+0000 7fc213fff640 1 --2- 172.21.15.22:0/4021715975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c79b1a0 0x56058c79e920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc200005fd0 tx=0x7fc200011790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27d3ce8ce5ec87e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:47.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.915+0000 7fc1fe7fc640 1 -- 172.21.15.22:0/4021715975 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200004020 con 0x56058c79b1a0 2024-08-20T01:39:47.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.915+0000 7fc1fe7fc640 1 -- 172.21.15.22:0/4021715975 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2000054f0 con 0x56058c79b1a0 2024-08-20T01:39:47.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.915+0000 7fc1fe7fc640 1 -- 172.21.15.22:0/4021715975 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200011a60 con 0x56058c79b1a0 2024-08-20T01:39:47.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.916+0000 7fc21d386740 1 -- 172.21.15.22:0/4021715975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c79b1a0 msgr2=0x56058c79e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:47.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.916+0000 7fc21d386740 1 --2- 172.21.15.22:0/4021715975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c79b1a0 0x56058c79e920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc200005fd0 tx=0x7fc200011790 comp rx=0 tx=0).stop 2024-08-20T01:39:47.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.916+0000 7fc21d386740 1 -- 172.21.15.22:0/4021715975 shutdown_connections 2024-08-20T01:39:47.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.916+0000 7fc21d386740 1 --2- 172.21.15.22:0/4021715975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c7a7130 0x56058c7bedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.916+0000 7fc21d386740 1 --2- 172.21.15.22:0/4021715975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c79b1a0 0x56058c79e920 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.916+0000 7fc21d386740 1 --2- 172.21.15.22:0/4021715975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c79a880 0x56058c7a3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.916+0000 7fc21d386740 1 -- 172.21.15.22:0/4021715975 >> 172.21.15.22:0/4021715975 conn(0x56058c7986b0 msgr2=0x56058c7a5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:47.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.916+0000 7fc21d386740 1 -- 172.21.15.22:0/4021715975 shutdown_connections 2024-08-20T01:39:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.916+0000 7fc21d386740 1 -- 172.21.15.22:0/4021715975 wait complete. 2024-08-20T01:39:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.916+0000 7fc21d386740 1 -- start start 2024-08-20T01:39:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.916+0000 7fc21d386740 1 Processor -- start 2024-08-20T01:39:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.917+0000 7fc21d386740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c79a880 0x56058c7abd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.917+0000 7fc21d386740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c79b1a0 0x56058c7ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.917+0000 7fc21d386740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c7a7130 0x56058c819d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.917+0000 7fc21d386740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc2141ac800 con 0x56058c7a7130 2024-08-20T01:39:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.917+0000 7fc21d386740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc2141adc70 con 0x56058c79b1a0 2024-08-20T01:39:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.917+0000 7fc21d386740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc2141aced0 con 0x56058c79a880 2024-08-20T01:39:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.917+0000 7fc21d386740 10 client.0 _ll_register_callbacks cb 0x7fc2080e76d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.917+0000 7fc218d29640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c79a880 0x56058c7abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.917+0000 7fc218d29640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c79a880 0x56058c7abd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:58296/0 (socket says 172.21.15.22:58296) 2024-08-20T01:39:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.917+0000 7fc213fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c79b1a0 0x56058c7ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:47.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.917+0000 7fc218d29640 1 -- 172.21.15.22:0/3769110081 learned_addr learned my addr 172.21.15.22:0/3769110081 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:47.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.917+0000 7fc21952a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c7a7130 0x56058c819d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:47.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.917+0000 7fc218d29640 1 -- 172.21.15.22:0/3769110081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c79b1a0 msgr2=0x56058c7ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:47.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.917+0000 7fc218d29640 1 --2- 172.21.15.22:0/3769110081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c79b1a0 0x56058c7ac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.917+0000 7fc218d29640 1 -- 172.21.15.22:0/3769110081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c7a7130 msgr2=0x56058c819d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:47.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.917+0000 7fc218d29640 1 --2- 172.21.15.22:0/3769110081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c7a7130 0x56058c819d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.917+0000 7fc218d29640 1 -- 172.21.15.22:0/3769110081 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56058c81a450 con 0x56058c79a880 2024-08-20T01:39:47.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.917+0000 7fc213fff640 1 --2- 172.21.15.22:0/3769110081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c79b1a0 0x56058c7ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:47.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.918+0000 7fc218d29640 1 --2- 172.21.15.22:0/3769110081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c79a880 0x56058c7abd70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc2080a6f80 tx=0x7fc2080e7320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db30fa28ec2ebc2d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:47.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.918+0000 7fc1f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:39:47.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.918+0000 7fc1f3fff640 1 -- 172.21.15.22:0/3769110081 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2080aacd0 con 0x56058c79a880 2024-08-20T01:39:47.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.918+0000 7fc1f3fff640 1 -- 172.21.15.22:0/3769110081 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fc2080a74f0 con 0x56058c79a880 2024-08-20T01:39:47.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.918+0000 7fc21d386740 1 -- 172.21.15.22:0/3769110081 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2000054f0 con 0x56058c79a880 2024-08-20T01:39:47.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.918+0000 7fc1f3fff640 1 -- 172.21.15.22:0/3769110081 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc2080aaa10 con 0x56058c79a880 2024-08-20T01:39:47.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.918+0000 7fc21d386740 10 client.26509 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:47.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.918+0000 7fc21d386740 1 -- 172.21.15.22:0/3769110081 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56058c821810 con 0x56058c79a880 2024-08-20T01:39:47.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.918+0000 7fc1f3fff640 1 -- 172.21.15.22:0/3769110081 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2000054f0 con 0x56058c79a880 2024-08-20T01:39:47.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.918+0000 7fc1f3fff640 1 -- 172.21.15.22:0/3769110081 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fc2080a9bd0 con 0x56058c79a880 2024-08-20T01:39:47.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.918+0000 7fc21d386740 10 client.26509 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:47.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.918+0000 7fc21d386740 10 client.26509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:47.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.918+0000 7fc21d386740 20 client.26509 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:47.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.918+0000 7fc21d386740 1 --2- 172.21.15.22:0/3769110081 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56058c821f90 0x56058c8243b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:47.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.918+0000 7fc21d386740 4 client.26509 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:39:47.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.918+0000 7fc21d386740 1 -- 172.21.15.22:0/3769110081 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56058c70f320 con 0x56058c821f90 2024-08-20T01:39:47.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.919+0000 7fc213fff640 1 --2- 172.21.15.22:0/3769110081 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56058c821f90 0x56058c8243b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:47.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.919+0000 7fc213fff640 1 --2- 172.21.15.22:0/3769110081 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56058c821f90 0x56058c8243b0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4214b6f3b3cf4c1 server_cookie=727c4faf34b75343 in_seq=0 out_seq=0 2024-08-20T01:39:47.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.919+0000 7fc1f3fff640 10 client.26509 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:47.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.919+0000 7fc1f3fff640 1 -- 172.21.15.22:0/3769110081 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56058c70f320 con 0x56058c821f90 2024-08-20T01:39:47.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.919+0000 7fc1f3fff640 10 client.26509 handle_command_reply: tid=0 2024-08-20T01:39:47.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.919+0000 7fc21d386740 1 client.26509 shutdown 2024-08-20T01:39:47.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.919+0000 7fc21d386740 1 -- 172.21.15.22:0/3769110081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c79a880 msgr2=0x56058c7abd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:47.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.919+0000 7fc21d386740 1 --2- 172.21.15.22:0/3769110081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c79a880 0x56058c7abd70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc2080a6f80 tx=0x7fc2080e7320 comp rx=0 tx=0).stop 2024-08-20T01:39:47.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.919+0000 7fc21d386740 1 -- 172.21.15.22:0/3769110081 shutdown_connections 2024-08-20T01:39:47.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.919+0000 7fc21d386740 1 --2- 172.21.15.22:0/3769110081 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56058c821f90 0x56058c8243b0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.919+0000 7fc21d386740 1 --2- 172.21.15.22:0/3769110081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56058c7a7130 0x56058c819d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.919+0000 7fc21d386740 1 --2- 172.21.15.22:0/3769110081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058c79b1a0 0x56058c7ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.919+0000 7fc21d386740 1 --2- 172.21.15.22:0/3769110081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56058c79a880 0x56058c7abd70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.919+0000 7fc21d386740 1 -- 172.21.15.22:0/3769110081 >> 172.21.15.22:0/3769110081 conn(0x56058c7986b0 msgr2=0x56058c7a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:47.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.919+0000 7fc1f3fff640 0 client.26509 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:47.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.919+0000 7fc21d386740 1 -- 172.21.15.22:0/3769110081 shutdown_connections 2024-08-20T01:39:47.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.920+0000 7fc21d386740 1 -- 172.21.15.22:0/3769110081 wait complete. 2024-08-20T01:39:47.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.920+0000 7fc21d386740 20 client.26509 trim_cache size 0 max 16384 2024-08-20T01:39:47.930 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:39:47.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.920+0000 7fc21af8d640 1 -- 172.21.15.22:0/3697598498 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc2040b3bd0 msgr2=0x7fc2040b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:47.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.920+0000 7fc21af8d640 1 --2- 172.21.15.22:0/3697598498 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc2040b3bd0 0x7fc2040b6090 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc20c006010 tx=0x7fc20c0099a0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.920+0000 7fc21af8d640 1 -- 172.21.15.22:0/3697598498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2141019d0 msgr2=0x7fc214198f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:47.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.920+0000 7fc21af8d640 1 --2- 172.21.15.22:0/3697598498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2141019d0 0x7fc214198f50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc20800e9f0 tx=0x7fc20800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.920+0000 7fc21af8d640 1 -- 172.21.15.22:0/3697598498 shutdown_connections 2024-08-20T01:39:47.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.920+0000 7fc21af8d640 1 --2- 172.21.15.22:0/3697598498 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fc2040b3bd0 0x7fc2040b6090 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.920+0000 7fc21af8d640 1 --2- 172.21.15.22:0/3697598498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc214107d60 0x7fc21419e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.920+0000 7fc21af8d640 1 --2- 172.21.15.22:0/3697598498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2141073e0 0x7fc214199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.920+0000 7fc21af8d640 1 --2- 172.21.15.22:0/3697598498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2141019d0 0x7fc214198f50 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:47.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.920+0000 7fc21af8d640 1 -- 172.21.15.22:0/3697598498 >> 172.21.15.22:0/3697598498 conn(0x7fc2140fd440 msgr2=0x7fc2140ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:47.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.920+0000 7fc21af8d640 1 -- 172.21.15.22:0/3697598498 shutdown_connections 2024-08-20T01:39:47.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:47.920+0000 7fc21af8d640 1 -- 172.21.15.22:0/3697598498 wait complete. 2024-08-20T01:39:48.888 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:48 smithi022 ceph-mon[18709]: pgmap v606: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 568 op/s 2024-08-20T01:39:49.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:48 smithi134 ceph-mon[22511]: pgmap v606: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 568 op/s 2024-08-20T01:39:49.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:48 smithi077 ceph-mon[22251]: pgmap v606: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 568 op/s 2024-08-20T01:39:49.525 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:39:49.525 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:39:49.804 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:50.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.501+0000 7fadfc36e640 1 -- 172.21.15.22:0/566485249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf410ce00 msgr2=0x7fadf410f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:50.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.501+0000 7fadfc36e640 1 --2- 172.21.15.22:0/566485249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf410ce00 0x7fadf410f260 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fadec009900 tx=0x7fadec02a410 comp rx=0 tx=0).stop 2024-08-20T01:39:50.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.502+0000 7fadfc36e640 1 -- 172.21.15.22:0/566485249 shutdown_connections 2024-08-20T01:39:50.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.502+0000 7fadfc36e640 1 --2- 172.21.15.22:0/566485249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf410ce00 0x7fadf410f260 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.502+0000 7fadfc36e640 1 --2- 172.21.15.22:0/566485249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadf41042c0 0x7fadf410c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.502+0000 7fadfc36e640 1 --2- 172.21.15.22:0/566485249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadf41039a0 0x7fadf4103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.502+0000 7fadfc36e640 1 -- 172.21.15.22:0/566485249 >> 172.21.15.22:0/566485249 conn(0x7fadf40fd400 msgr2=0x7fadf40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:50.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.502+0000 7fadfc36e640 1 -- 172.21.15.22:0/566485249 shutdown_connections 2024-08-20T01:39:50.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.502+0000 7fadfc36e640 1 -- 172.21.15.22:0/566485249 wait complete. 2024-08-20T01:39:50.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.502+0000 7fadfc36e640 1 Processor -- start 2024-08-20T01:39:50.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.502+0000 7fadfc36e640 1 -- start start 2024-08-20T01:39:50.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.502+0000 7fadfc36e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadf41039a0 0x7fadf419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:50.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.502+0000 7fadfc36e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadf41042c0 0x7fadf419b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:50.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.502+0000 7fadfc36e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf410ce00 0x7fadf41a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:50.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.502+0000 7fadfc36e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fadf4101f40 con 0x7fadf410ce00 2024-08-20T01:39:50.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadfc36e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fadf4101dc0 con 0x7fadf41042c0 2024-08-20T01:39:50.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadfc36e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fadf41020c0 con 0x7fadf41039a0 2024-08-20T01:39:50.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadfa90b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf410ce00 0x7fadf41a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:50.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadfa90b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf410ce00 0x7fadf41a0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45448/0 (socket says 172.21.15.22:45448) 2024-08-20T01:39:50.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadfa90b640 1 -- 172.21.15.22:0/1472601429 learned_addr learned my addr 172.21.15.22:0/1472601429 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:50.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadf9909640 1 --2- 172.21.15.22:0/1472601429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadf41042c0 0x7fadf419b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:50.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadfa10a640 1 --2- 172.21.15.22:0/1472601429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadf41039a0 0x7fadf419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:50.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadfa90b640 1 -- 172.21.15.22:0/1472601429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadf41039a0 msgr2=0x7fadf419b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:50.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadfa90b640 1 --2- 172.21.15.22:0/1472601429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadf41039a0 0x7fadf419b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadfa90b640 1 -- 172.21.15.22:0/1472601429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadf41042c0 msgr2=0x7fadf419b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:50.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadfa90b640 1 --2- 172.21.15.22:0/1472601429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadf41042c0 0x7fadf419b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadfa90b640 1 -- 172.21.15.22:0/1472601429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf41a1270 con 0x7fadf410ce00 2024-08-20T01:39:50.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadfa10a640 1 --2- 172.21.15.22:0/1472601429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadf41039a0 0x7fadf419b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:50.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadf9909640 1 --2- 172.21.15.22:0/1472601429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadf41042c0 0x7fadf419b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:50.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadfa90b640 1 --2- 172.21.15.22:0/1472601429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf410ce00 0x7fadf41a0aa0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fadec004770 tx=0x7fadec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:50.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadf37fe640 1 -- 172.21.15.22:0/1472601429 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec03f030 con 0x7fadf410ce00 2024-08-20T01:39:50.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadf37fe640 1 -- 172.21.15.22:0/1472601429 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadec003aa0 con 0x7fadf410ce00 2024-08-20T01:39:50.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadfc36e640 1 -- 172.21.15.22:0/1472601429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf41a1500 con 0x7fadf410ce00 2024-08-20T01:39:50.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadf37fe640 1 -- 172.21.15.22:0/1472601429 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec035070 con 0x7fadf410ce00 2024-08-20T01:39:50.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.503+0000 7fadfc36e640 1 -- 172.21.15.22:0/1472601429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf41a7c20 con 0x7fadf410ce00 2024-08-20T01:39:50.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.506+0000 7fadfe767740 1 Processor -- start 2024-08-20T01:39:50.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.506+0000 7fadf37fe640 1 -- 172.21.15.22:0/1472601429 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fadec042030 con 0x7fadf410ce00 2024-08-20T01:39:50.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.506+0000 7fadfe767740 1 -- start start 2024-08-20T01:39:50.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.506+0000 7fadfe767740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28a53b0 0x55fbe28a5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:50.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.507+0000 7fadfe767740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a5cd0 0x55fbe28b1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:50.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.507+0000 7fadfe767740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28b1c60 0x55fbe28b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:50.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.507+0000 7fadfe767740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fbe281b940 con 0x55fbe28a5cd0 2024-08-20T01:39:50.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.507+0000 7fadfe767740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fbe280ae40 con 0x55fbe28a53b0 2024-08-20T01:39:50.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.507+0000 7fadfe767740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fbe280ee80 con 0x55fbe28b1c60 2024-08-20T01:39:50.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.507+0000 7fadf9909640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28a53b0 0x55fbe28a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:50.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.507+0000 7fadfa10a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a5cd0 0x55fbe28b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:50.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.507+0000 7fadf9909640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28a53b0 0x55fbe28a5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:59094/0 (socket says 172.21.15.22:59094) 2024-08-20T01:39:50.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.507+0000 7fadf9909640 1 -- 172.21.15.22:0/3093938216 learned_addr learned my addr 172.21.15.22:0/3093938216 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:50.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.507+0000 7fadf9909640 1 --2- 172.21.15.22:0/3093938216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28b1c60 0x55fbe28b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:50.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.507+0000 7fadf9909640 1 -- 172.21.15.22:0/3093938216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28b1c60 msgr2=0x55fbe28b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:50.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.507+0000 7fadf9909640 1 --2- 172.21.15.22:0/3093938216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28b1c60 0x55fbe28b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.507+0000 7fadf9909640 1 -- 172.21.15.22:0/3093938216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a5cd0 msgr2=0x55fbe28b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:50.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.507+0000 7fadf9909640 1 --2- 172.21.15.22:0/3093938216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a5cd0 0x55fbe28b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.507+0000 7fadf9909640 1 -- 172.21.15.22:0/3093938216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbe27a7520 con 0x55fbe28a53b0 2024-08-20T01:39:50.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.507+0000 7fadfa10a640 1 --2- 172.21.15.22:0/3093938216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a5cd0 0x55fbe28b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:50.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.507+0000 7fadf37fe640 1 --2- 172.21.15.22:0/1472601429 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faddc0b3bd0 0x7faddc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:50.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.507+0000 7fadf9909640 1 --2- 172.21.15.22:0/3093938216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28a53b0 0x55fbe28a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fade8013810 tx=0x7fade800a990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16aba73f64342fc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:50.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.508+0000 7fadfa10a640 1 --2- 172.21.15.22:0/1472601429 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faddc0b3bd0 0x7faddc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:50.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.508+0000 7fadf37fe640 1 -- 172.21.15.22:0/1472601429 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fadec103f20 con 0x7fadf410ce00 2024-08-20T01:39:50.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.508+0000 7fadf0de6640 1 -- 172.21.15.22:0/3093938216 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade800dad0 con 0x55fbe28a53b0 2024-08-20T01:39:50.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.508+0000 7fadf0de6640 1 -- 172.21.15.22:0/3093938216 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fade8013e50 con 0x55fbe28a53b0 2024-08-20T01:39:50.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.508+0000 7fadf0de6640 1 -- 172.21.15.22:0/3093938216 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade8004b00 con 0x55fbe28a53b0 2024-08-20T01:39:50.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.508+0000 7fadfe767740 1 -- 172.21.15.22:0/3093938216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28a53b0 msgr2=0x55fbe28a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:50.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.508+0000 7fadfa10a640 1 --2- 172.21.15.22:0/1472601429 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faddc0b3bd0 0x7faddc0b6090 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55fbe28a8530 tx=0x7fade4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:50.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.508+0000 7fadfe767740 1 --2- 172.21.15.22:0/3093938216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28a53b0 0x55fbe28a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fade8013810 tx=0x7fade800a990 comp rx=0 tx=0).stop 2024-08-20T01:39:50.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.508+0000 7fadfe767740 1 -- 172.21.15.22:0/3093938216 shutdown_connections 2024-08-20T01:39:50.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.509+0000 7fadfe767740 1 --2- 172.21.15.22:0/3093938216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28b1c60 0x55fbe28b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.509+0000 7fadfe767740 1 --2- 172.21.15.22:0/3093938216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a5cd0 0x55fbe28b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.509+0000 7fadfe767740 1 --2- 172.21.15.22:0/3093938216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28a53b0 0x55fbe28a5790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.509+0000 7fadfe767740 1 -- 172.21.15.22:0/3093938216 >> 172.21.15.22:0/3093938216 conn(0x55fbe28a31e0 msgr2=0x55fbe28a4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:50.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.509+0000 7fadfe767740 1 -- 172.21.15.22:0/3093938216 shutdown_connections 2024-08-20T01:39:50.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.509+0000 7fadfe767740 1 -- 172.21.15.22:0/3093938216 wait complete. 2024-08-20T01:39:50.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.509+0000 7fadfe767740 1 -- start start 2024-08-20T01:39:50.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.509+0000 7fadfe767740 1 Processor -- start 2024-08-20T01:39:50.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.509+0000 7fadfe767740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28a53b0 0x55fbe28aec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:50.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.509+0000 7fadfe767740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28a5cd0 0x55fbe28af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:50.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.509+0000 7fadfe767740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28b1c60 0x55fbe28af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:50.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.509+0000 7fadfe767740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fbe266d890 con 0x55fbe28b1c60 2024-08-20T01:39:50.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.509+0000 7fadfe767740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fbe2791700 con 0x55fbe28a53b0 2024-08-20T01:39:50.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.509+0000 7fadfe767740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fbe28b49b0 con 0x55fbe28a5cd0 2024-08-20T01:39:50.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.509+0000 7fadfe767740 10 client.0 _ll_register_callbacks cb 0x55fbe28066f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:50.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.510+0000 7fadfa90b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28b1c60 0x55fbe28af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:50.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.510+0000 7fadfa10a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28a53b0 0x55fbe28aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:50.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.510+0000 7fadf9909640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28a5cd0 0x55fbe28af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:50.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.510+0000 7fadfa10a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28a53b0 0x55fbe28aec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:59110/0 (socket says 172.21.15.22:59110) 2024-08-20T01:39:50.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.510+0000 7fadfa10a640 1 -- 172.21.15.22:0/2139222475 learned_addr learned my addr 172.21.15.22:0/2139222475 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:50.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.510+0000 7fadfa10a640 1 -- 172.21.15.22:0/2139222475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28a5cd0 msgr2=0x55fbe28af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:50.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.510+0000 7fadfa10a640 1 --2- 172.21.15.22:0/2139222475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28a5cd0 0x55fbe28af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.510+0000 7fadfa10a640 1 -- 172.21.15.22:0/2139222475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28b1c60 msgr2=0x55fbe28af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:50.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.510+0000 7fadfa10a640 1 --2- 172.21.15.22:0/2139222475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28b1c60 0x55fbe28af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.510+0000 7fadfa10a640 1 -- 172.21.15.22:0/2139222475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbe256a930 con 0x55fbe28a53b0 2024-08-20T01:39:50.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.510+0000 7fadfa90b640 1 --2- 172.21.15.22:0/2139222475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28b1c60 0x55fbe28af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:50.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.510+0000 7fadf9909640 1 --2- 172.21.15.22:0/2139222475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28a5cd0 0x55fbe28af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:50.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.510+0000 7fadfa10a640 1 --2- 172.21.15.22:0/2139222475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28a53b0 0x55fbe28aec60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fade401f9e0 tx=0x7fade4004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d76af241fee5bde server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:50.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.510+0000 7fadd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:39:50.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.510+0000 7fadd9ffb640 1 -- 172.21.15.22:0/2139222475 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4011940 con 0x55fbe28a53b0 2024-08-20T01:39:50.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.510+0000 7fadd9ffb640 1 -- 172.21.15.22:0/2139222475 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fade4017030 con 0x55fbe28a53b0 2024-08-20T01:39:50.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.510+0000 7fadfe767740 1 -- 172.21.15.22:0/2139222475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fade8013e50 con 0x55fbe28a53b0 2024-08-20T01:39:50.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.511+0000 7fadd9ffb640 1 -- 172.21.15.22:0/2139222475 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fade4011ae0 con 0x55fbe28a53b0 2024-08-20T01:39:50.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.511+0000 7fadfe767740 10 client.26474 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:50.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.511+0000 7fadfe767740 1 -- 172.21.15.22:0/2139222475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55fbe28c0630 con 0x55fbe28a53b0 2024-08-20T01:39:50.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.511+0000 7fadd9ffb640 1 -- 172.21.15.22:0/2139222475 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fade8013e50 con 0x55fbe28a53b0 2024-08-20T01:39:50.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.511+0000 7fadd9ffb640 1 -- 172.21.15.22:0/2139222475 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fade401c3f0 con 0x55fbe28a53b0 2024-08-20T01:39:50.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.511+0000 7fadfe767740 10 client.26474 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:50.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.511+0000 7fadfe767740 10 client.26474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:50.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.511+0000 7fadfe767740 20 client.26474 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:50.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.511+0000 7fadfe767740 1 --2- 172.21.15.22:0/2139222475 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fbe28c1b90 0x55fbe28c4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:50.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.511+0000 7fadfe767740 4 client.26474 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:50.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.511+0000 7fadfe767740 1 -- 172.21.15.22:0/2139222475 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbe281d890 con 0x55fbe28c1b90 2024-08-20T01:39:50.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.511+0000 7fadf9909640 1 --2- 172.21.15.22:0/2139222475 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fbe28c1b90 0x55fbe28c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:50.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.512+0000 7fadf9909640 1 --2- 172.21.15.22:0/2139222475 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fbe28c1b90 0x55fbe28c4000 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12fded60eddf962c server_cookie=a4105cad4c2a067c in_seq=0 out_seq=0 2024-08-20T01:39:50.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.512+0000 7fadd9ffb640 10 client.26474 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:50.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.512+0000 7fadd9ffb640 1 -- 172.21.15.22:0/2139222475 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fbe281d890 con 0x55fbe28c1b90 2024-08-20T01:39:50.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.512+0000 7fadd9ffb640 10 client.26474 handle_command_reply: tid=0 2024-08-20T01:39:50.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.512+0000 7fadfe767740 1 client.26474 shutdown 2024-08-20T01:39:50.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.513+0000 7fadfe767740 1 -- 172.21.15.22:0/2139222475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28a53b0 msgr2=0x55fbe28aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:50.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.513+0000 7fadfe767740 1 --2- 172.21.15.22:0/2139222475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28a53b0 0x55fbe28aec60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fade401f9e0 tx=0x7fade4004ab0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.513+0000 7fadfe767740 1 -- 172.21.15.22:0/2139222475 shutdown_connections 2024-08-20T01:39:50.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.513+0000 7fadfe767740 1 --2- 172.21.15.22:0/2139222475 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fbe28c1b90 0x55fbe28c4000 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.513+0000 7fadfe767740 1 --2- 172.21.15.22:0/2139222475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28b1c60 0x55fbe28af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.513+0000 7fadfe767740 1 --2- 172.21.15.22:0/2139222475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28a5cd0 0x55fbe28af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.513+0000 7fadfe767740 1 --2- 172.21.15.22:0/2139222475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28a53b0 0x55fbe28aec60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.513+0000 7fadfe767740 1 -- 172.21.15.22:0/2139222475 >> 172.21.15.22:0/2139222475 conn(0x55fbe28a31e0 msgr2=0x55fbe28a8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:50.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.513+0000 7fadd9ffb640 0 client.26474 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:50.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.513+0000 7fadfe767740 1 -- 172.21.15.22:0/2139222475 shutdown_connections 2024-08-20T01:39:50.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.513+0000 7fadfe767740 1 -- 172.21.15.22:0/2139222475 wait complete. 2024-08-20T01:39:50.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.513+0000 7fadfe767740 20 client.26474 trim_cache size 0 max 16384 2024-08-20T01:39:50.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.532+0000 7fadfe767740 1 Processor -- start 2024-08-20T01:39:50.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.532+0000 7fadfe767740 1 -- start start 2024-08-20T01:39:50.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.532+0000 7fadfe767740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a53b0 0x55fbe28a9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:50.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.532+0000 7fadfe767740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28a5cd0 0x55fbe28af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:50.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.532+0000 7fadfe767740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28b1c60 0x55fbe28c9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:50.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.532+0000 7fadfe767740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fadf41b2da0 con 0x55fbe28a53b0 2024-08-20T01:39:50.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.532+0000 7fadfe767740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fadf41b05b0 con 0x55fbe28b1c60 2024-08-20T01:39:50.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.532+0000 7fadfe767740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fadf41ae400 con 0x55fbe28a5cd0 2024-08-20T01:39:50.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.532+0000 7fadfa10a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a53b0 0x55fbe28a9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:50.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.532+0000 7fadfa10a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a53b0 0x55fbe28a9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45474/0 (socket says 172.21.15.22:45474) 2024-08-20T01:39:50.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.532+0000 7fadfa10a640 1 -- 172.21.15.22:0/2437719462 learned_addr learned my addr 172.21.15.22:0/2437719462 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:50.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.532+0000 7fadf9909640 1 --2- 172.21.15.22:0/2437719462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28a5cd0 0x55fbe28af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:50.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.533+0000 7fadfa90b640 1 --2- 172.21.15.22:0/2437719462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28b1c60 0x55fbe28c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:50.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.533+0000 7fadfa10a640 1 -- 172.21.15.22:0/2437719462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28a5cd0 msgr2=0x55fbe28af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:50.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.533+0000 7fadfa10a640 1 --2- 172.21.15.22:0/2437719462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28a5cd0 0x55fbe28af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.533+0000 7fadfa10a640 1 -- 172.21.15.22:0/2437719462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28b1c60 msgr2=0x55fbe28c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:50.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.533+0000 7fadfa10a640 1 --2- 172.21.15.22:0/2437719462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28b1c60 0x55fbe28c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.533+0000 7fadfa10a640 1 -- 172.21.15.22:0/2437719462 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbe28a49f0 con 0x55fbe28a53b0 2024-08-20T01:39:50.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.533+0000 7fadfa10a640 1 --2- 172.21.15.22:0/2437719462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a53b0 0x55fbe28a9570 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fade4009c40 tx=0x7fade40049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ab98602a96f5c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:50.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.533+0000 7faddbfff640 1 -- 172.21.15.22:0/2437719462 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4036070 con 0x55fbe28a53b0 2024-08-20T01:39:50.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.533+0000 7faddbfff640 1 -- 172.21.15.22:0/2437719462 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fade4011c80 con 0x55fbe28a53b0 2024-08-20T01:39:50.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.533+0000 7faddbfff640 1 -- 172.21.15.22:0/2437719462 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade403bb70 con 0x55fbe28a53b0 2024-08-20T01:39:50.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.534+0000 7fadfe767740 1 -- 172.21.15.22:0/2437719462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a53b0 msgr2=0x55fbe28a9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:50.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.534+0000 7fadfe767740 1 --2- 172.21.15.22:0/2437719462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a53b0 0x55fbe28a9570 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fade4009c40 tx=0x7fade40049c0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.534+0000 7fadfe767740 1 -- 172.21.15.22:0/2437719462 shutdown_connections 2024-08-20T01:39:50.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.534+0000 7fadfe767740 1 --2- 172.21.15.22:0/2437719462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28b1c60 0x55fbe28c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.534+0000 7fadfe767740 1 --2- 172.21.15.22:0/2437719462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28a5cd0 0x55fbe28af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.534+0000 7fadfe767740 1 --2- 172.21.15.22:0/2437719462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a53b0 0x55fbe28a9570 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.534+0000 7fadfe767740 1 -- 172.21.15.22:0/2437719462 >> 172.21.15.22:0/2437719462 conn(0x55fbe28a31e0 msgr2=0x55fbe28aebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:50.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.534+0000 7fadfe767740 1 -- 172.21.15.22:0/2437719462 shutdown_connections 2024-08-20T01:39:50.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.534+0000 7fadfe767740 1 -- 172.21.15.22:0/2437719462 wait complete. 2024-08-20T01:39:50.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.534+0000 7fadfe767740 1 -- start start 2024-08-20T01:39:50.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.534+0000 7fadfe767740 1 Processor -- start 2024-08-20T01:39:50.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.534+0000 7fadfe767740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a53b0 0x55fbe28b9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:50.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadfe767740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28a5cd0 0x55fbe28ba390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:50.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadfe767740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28b1c60 0x55fbe28ab450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:50.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadfe767740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fadf41aea70 con 0x55fbe28a53b0 2024-08-20T01:39:50.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadfe767740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fadf41afee0 con 0x55fbe28b1c60 2024-08-20T01:39:50.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadfe767740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fadf41af140 con 0x55fbe28a5cd0 2024-08-20T01:39:50.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadfe767740 10 client.0 _ll_register_callbacks cb 0x7fade4009b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:50.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadfa10a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a53b0 0x55fbe28b9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:50.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadfa10a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a53b0 0x55fbe28b9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45482/0 (socket says 172.21.15.22:45482) 2024-08-20T01:39:50.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadfa10a640 1 -- 172.21.15.22:0/464663506 learned_addr learned my addr 172.21.15.22:0/464663506 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:50.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadfa90b640 1 --2- 172.21.15.22:0/464663506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28b1c60 0x55fbe28ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:50.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadf9909640 1 --2- 172.21.15.22:0/464663506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28a5cd0 0x55fbe28ba390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:50.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadfa10a640 1 -- 172.21.15.22:0/464663506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28a5cd0 msgr2=0x55fbe28ba390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:50.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadfa10a640 1 --2- 172.21.15.22:0/464663506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28a5cd0 0x55fbe28ba390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadfa10a640 1 -- 172.21.15.22:0/464663506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28b1c60 msgr2=0x55fbe28ab450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:50.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadfa10a640 1 --2- 172.21.15.22:0/464663506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28b1c60 0x55fbe28ab450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadfa10a640 1 -- 172.21.15.22:0/464663506 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbe28a5b00 con 0x55fbe28a53b0 2024-08-20T01:39:50.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadfa90b640 1 --2- 172.21.15.22:0/464663506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28b1c60 0x55fbe28ab450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:50.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadfa10a640 1 --2- 172.21.15.22:0/464663506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a53b0 0x55fbe28b9e50 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fade401f9e0 tx=0x7fade401c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d067a02ac4edb3b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:50.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:39:50.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadd9ffb640 1 -- 172.21.15.22:0/464663506 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade403f020 con 0x55fbe28a53b0 2024-08-20T01:39:50.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.535+0000 7fadd9ffb640 1 -- 172.21.15.22:0/464663506 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fade4004ab0 con 0x55fbe28a53b0 2024-08-20T01:39:50.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.536+0000 7fadfe767740 1 -- 172.21.15.22:0/464663506 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fade4011c80 con 0x55fbe28a53b0 2024-08-20T01:39:50.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.536+0000 7fadd9ffb640 1 -- 172.21.15.22:0/464663506 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fade4036040 con 0x55fbe28a53b0 2024-08-20T01:39:50.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.536+0000 7fadfe767740 10 client.16872 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:50.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.536+0000 7fadfe767740 1 -- 172.21.15.22:0/464663506 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55fbe292c200 con 0x55fbe28a53b0 2024-08-20T01:39:50.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.536+0000 7fadd9ffb640 1 -- 172.21.15.22:0/464663506 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fade4011c80 con 0x55fbe28a53b0 2024-08-20T01:39:50.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.536+0000 7fadd9ffb640 1 -- 172.21.15.22:0/464663506 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fade403b460 con 0x55fbe28a53b0 2024-08-20T01:39:50.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.536+0000 7fadfe767740 10 client.16872 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:50.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.536+0000 7fadfe767740 10 client.16872 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:50.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.536+0000 7fadfe767740 20 client.16872 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:50.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.536+0000 7fadfe767740 1 --2- 172.21.15.22:0/464663506 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fbe292c910 0x55fbe292ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:50.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.536+0000 7fadfe767740 4 client.16872 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:39:50.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.536+0000 7fadfe767740 1 -- 172.21.15.22:0/464663506 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fbe2819330 con 0x55fbe292c910 2024-08-20T01:39:50.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.536+0000 7fadf9909640 1 --2- 172.21.15.22:0/464663506 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fbe292c910 0x55fbe292ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:50.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.537+0000 7fadd9ffb640 10 client.16872 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:50.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.537+0000 7fadf9909640 1 --2- 172.21.15.22:0/464663506 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fbe292c910 0x55fbe292ed30 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f87d378e67a3cbb7 server_cookie=2ea4307e00473190 in_seq=0 out_seq=0 2024-08-20T01:39:50.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.538+0000 7fadd9ffb640 1 -- 172.21.15.22:0/464663506 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fbe2819330 con 0x55fbe292c910 2024-08-20T01:39:50.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.538+0000 7fadd9ffb640 10 client.16872 handle_command_reply: tid=0 2024-08-20T01:39:50.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.538+0000 7fadfe767740 1 client.16872 shutdown 2024-08-20T01:39:50.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.538+0000 7fadfe767740 1 -- 172.21.15.22:0/464663506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a53b0 msgr2=0x55fbe28b9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:50.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.538+0000 7fadfe767740 1 --2- 172.21.15.22:0/464663506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a53b0 0x55fbe28b9e50 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fade401f9e0 tx=0x7fade401c6a0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.538+0000 7fadfe767740 1 -- 172.21.15.22:0/464663506 shutdown_connections 2024-08-20T01:39:50.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.538+0000 7fadfe767740 1 --2- 172.21.15.22:0/464663506 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55fbe292c910 0x55fbe292ed30 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.538+0000 7fadfe767740 1 --2- 172.21.15.22:0/464663506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe28b1c60 0x55fbe28ab450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.538+0000 7fadfe767740 1 --2- 172.21.15.22:0/464663506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbe28a5cd0 0x55fbe28ba390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.538+0000 7fadd9ffb640 0 client.16872 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:50.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.538+0000 7fadfe767740 1 --2- 172.21.15.22:0/464663506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbe28a53b0 0x55fbe28b9e50 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.538+0000 7fadfe767740 1 -- 172.21.15.22:0/464663506 >> 172.21.15.22:0/464663506 conn(0x55fbe28a31e0 msgr2=0x55fbe28af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:50.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.538+0000 7fadfe767740 1 -- 172.21.15.22:0/464663506 shutdown_connections 2024-08-20T01:39:50.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.538+0000 7fadfe767740 1 -- 172.21.15.22:0/464663506 wait complete. 2024-08-20T01:39:50.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.538+0000 7fadfe767740 20 client.16872 trim_cache size 0 max 16384 2024-08-20T01:39:50.546 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:39:50.546 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-08-20T01:39:50.546 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "95ed0eb6-8b60-4850-8e42-65ae77280ff5", 2024-08-20T01:39:50.546 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-08-20T01:39:50.547 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:39:50.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.539+0000 7fadfc36e640 1 -- 172.21.15.22:0/1472601429 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faddc0b3bd0 msgr2=0x7faddc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:50.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.539+0000 7fadfc36e640 1 --2- 172.21.15.22:0/1472601429 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faddc0b3bd0 0x7faddc0b6090 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55fbe28a8530 tx=0x7fade4009500 comp rx=0 tx=0).stop 2024-08-20T01:39:50.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.539+0000 7fadfc36e640 1 -- 172.21.15.22:0/1472601429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf410ce00 msgr2=0x7fadf41a0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:50.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.539+0000 7fadfc36e640 1 --2- 172.21.15.22:0/1472601429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf410ce00 0x7fadf41a0aa0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fadec004770 tx=0x7fadec004270 comp rx=0 tx=0).stop 2024-08-20T01:39:50.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.539+0000 7fadfc36e640 1 -- 172.21.15.22:0/1472601429 shutdown_connections 2024-08-20T01:39:50.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.539+0000 7fadfc36e640 1 --2- 172.21.15.22:0/1472601429 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faddc0b3bd0 0x7faddc0b6090 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.539+0000 7fadfc36e640 1 --2- 172.21.15.22:0/1472601429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf410ce00 0x7fadf41a0aa0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.539+0000 7fadfc36e640 1 --2- 172.21.15.22:0/1472601429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadf41042c0 0x7fadf419b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.539+0000 7fadfc36e640 1 --2- 172.21.15.22:0/1472601429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadf41039a0 0x7fadf419b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:50.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.539+0000 7fadfc36e640 1 -- 172.21.15.22:0/1472601429 >> 172.21.15.22:0/1472601429 conn(0x7fadf40fd400 msgr2=0x7fadf410f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:50.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.539+0000 7fadfc36e640 1 -- 172.21.15.22:0/1472601429 shutdown_connections 2024-08-20T01:39:50.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:50.539+0000 7fadfc36e640 1 -- 172.21.15.22:0/1472601429 wait complete. 2024-08-20T01:39:50.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:50 smithi022 ceph-mon[18709]: pgmap v607: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 508 op/s 2024-08-20T01:39:50.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:50 smithi022 ceph-mon[18709]: scrub queued for path: / 2024-08-20T01:39:50.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:50 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:50.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:50 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:39:51.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:50 smithi134 ceph-mon[22511]: pgmap v607: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 508 op/s 2024-08-20T01:39:51.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:50 smithi134 ceph-mon[22511]: scrub queued for path: / 2024-08-20T01:39:51.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:50 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:51.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:50 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:39:51.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:50 smithi077 ceph-mon[22251]: pgmap v607: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 508 op/s 2024-08-20T01:39:51.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:50 smithi077 ceph-mon[22251]: scrub queued for path: / 2024-08-20T01:39:51.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:50 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:51.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:50 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:39:51.464 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:39:51.733 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:52.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:51 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:39:52.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:51 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:39:52.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:51 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:52.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:51 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:39:52.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:51 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:52.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:51 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:39:52.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:51 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:52.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:51 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:39:52.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:51 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:52.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:51 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:39:52.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:51 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:39:52.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:51 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:52.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:51 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:39:52.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:51 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:52.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:51 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:39:52.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:51 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:52.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:51 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:39:52.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:51 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:52.076 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:51 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:39:52.076 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:51 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:39:52.076 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:51 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:52.076 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:51 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:39:52.076 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:51 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:52.076 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:51 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:39:52.076 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:51 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:52.076 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:51 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:39:52.076 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:51 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:52.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.467+0000 7f19e98cd640 1 -- 172.21.15.22:0/1711519221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19e41073a0 msgr2=0x7f19e41077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:52.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.467+0000 7f19e98cd640 1 --2- 172.21.15.22:0/1711519221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19e41073a0 0x7f19e41077e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f19d8009900 tx=0x7f19d802a400 comp rx=0 tx=0).stop 2024-08-20T01:39:52.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.470+0000 7f19e98cd640 1 -- 172.21.15.22:0/1711519221 shutdown_connections 2024-08-20T01:39:52.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.470+0000 7f19e98cd640 1 --2- 172.21.15.22:0/1711519221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e4107d20 0x7f19e410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.470+0000 7f19e98cd640 1 --2- 172.21.15.22:0/1711519221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19e41073a0 0x7f19e41077e0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.470+0000 7f19e98cd640 1 --2- 172.21.15.22:0/1711519221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19e4101990 0x7f19e4101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.470+0000 7f19e98cd640 1 -- 172.21.15.22:0/1711519221 >> 172.21.15.22:0/1711519221 conn(0x7f19e40fd400 msgr2=0x7f19e40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:52.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.472+0000 7f19e98cd640 1 -- 172.21.15.22:0/1711519221 shutdown_connections 2024-08-20T01:39:52.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.472+0000 7f19e98cd640 1 -- 172.21.15.22:0/1711519221 wait complete. 2024-08-20T01:39:52.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.474+0000 7f19e98cd640 1 Processor -- start 2024-08-20T01:39:52.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.474+0000 7f19e98cd640 1 -- start start 2024-08-20T01:39:52.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.474+0000 7f19e98cd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19e4101990 0x7f19e4197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:52.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.475+0000 7f19e98cd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19e41073a0 0x7f19e4198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:52.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.475+0000 7f19e98cd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e4107d20 0x7f19e419d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.475+0000 7f19e98cd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f19e41119c0 con 0x7f19e41073a0 2024-08-20T01:39:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.475+0000 7f19e98cd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f19e4111840 con 0x7f19e4101990 2024-08-20T01:39:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.475+0000 7f19e98cd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f19e4111b40 con 0x7f19e4107d20 2024-08-20T01:39:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.475+0000 7f19e37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e4107d20 0x7f19e419d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.475+0000 7f19e27fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19e41073a0 0x7f19e4198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.475+0000 7f19e27fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19e41073a0 0x7f19e4198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45490/0 (socket says 172.21.15.22:45490) 2024-08-20T01:39:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.475+0000 7f19e37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e4107d20 0x7f19e419d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:39162/0 (socket says 172.21.15.22:39162) 2024-08-20T01:39:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.475+0000 7f19e27fc640 1 -- 172.21.15.22:0/2487836960 learned_addr learned my addr 172.21.15.22:0/2487836960 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.475+0000 7f19e2ffd640 1 --2- 172.21.15.22:0/2487836960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19e4101990 0x7f19e4197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.476+0000 7f19e37fe640 1 -- 172.21.15.22:0/2487836960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19e4101990 msgr2=0x7f19e4197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.476+0000 7f19e37fe640 1 --2- 172.21.15.22:0/2487836960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19e4101990 0x7f19e4197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.476+0000 7f19e37fe640 1 -- 172.21.15.22:0/2487836960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19e41073a0 msgr2=0x7f19e4198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.476+0000 7f19e37fe640 1 --2- 172.21.15.22:0/2487836960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19e41073a0 0x7f19e4198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.476+0000 7f19e37fe640 1 -- 172.21.15.22:0/2487836960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e419dfc0 con 0x7f19e4107d20 2024-08-20T01:39:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.476+0000 7f19e37fe640 1 --2- 172.21.15.22:0/2487836960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e4107d20 0x7f19e419d7f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00ca30 tx=0x7f19dc00cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.477+0000 7f19e88cb640 1 -- 172.21.15.22:0/2487836960 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc007d90 con 0x7f19e4107d20 2024-08-20T01:39:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.477+0000 7f19e98cd640 1 -- 172.21.15.22:0/2487836960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e419e2b0 con 0x7f19e4107d20 2024-08-20T01:39:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.477+0000 7f19e98cd640 1 -- 172.21.15.22:0/2487836960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e406a7b0 con 0x7f19e4107d20 2024-08-20T01:39:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.477+0000 7f19e88cb640 1 -- 172.21.15.22:0/2487836960 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19dc011750 con 0x7f19e4107d20 2024-08-20T01:39:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.477+0000 7f19e88cb640 1 -- 172.21.15.22:0/2487836960 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc0054f0 con 0x7f19e4107d20 2024-08-20T01:39:52.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.481+0000 7f19ebcc6740 1 Processor -- start 2024-08-20T01:39:52.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.481+0000 7f19ebcc6740 1 -- start start 2024-08-20T01:39:52.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.481+0000 7f19ebcc6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbac26e0 0x55cefbac2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:52.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.481+0000 7f19ebcc6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbac3000 0x55cefbad7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:52.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.481+0000 7f19ebcc6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbad77c0 0x55cefbad9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:52.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.481+0000 7f19ebcc6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cefba398e0 con 0x55cefbac3000 2024-08-20T01:39:52.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.481+0000 7f19ebcc6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cefba28de0 con 0x55cefbad77c0 2024-08-20T01:39:52.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.481+0000 7f19ebcc6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cefba2ce20 con 0x55cefbac26e0 2024-08-20T01:39:52.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.481+0000 7f19e88cb640 1 -- 172.21.15.22:0/2487836960 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f19dc005690 con 0x7f19e4107d20 2024-08-20T01:39:52.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.482+0000 7f19e27fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbac26e0 0x55cefbac2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:52.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.482+0000 7f19e27fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbac26e0 0x55cefbac2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:39178/0 (socket says 172.21.15.22:39178) 2024-08-20T01:39:52.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.482+0000 7f19e27fc640 1 -- 172.21.15.22:0/290316819 learned_addr learned my addr 172.21.15.22:0/290316819 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:52.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.482+0000 7f19e27fc640 1 --2- 172.21.15.22:0/290316819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbad77c0 0x55cefbad9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:52.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.482+0000 7f19e2ffd640 1 --2- 172.21.15.22:0/290316819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbac3000 0x55cefbad7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:52.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.482+0000 7f19e2ffd640 1 -- 172.21.15.22:0/290316819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbac26e0 msgr2=0x55cefbac2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:52.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.482+0000 7f19e2ffd640 1 --2- 172.21.15.22:0/290316819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbac26e0 0x55cefbac2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.482+0000 7f19e2ffd640 1 -- 172.21.15.22:0/290316819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbad77c0 msgr2=0x55cefbad9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:52.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.482+0000 7f19e2ffd640 1 --2- 172.21.15.22:0/290316819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbad77c0 0x55cefbad9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.482+0000 7f19e2ffd640 1 -- 172.21.15.22:0/290316819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cefb788650 con 0x55cefbac3000 2024-08-20T01:39:52.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.483+0000 7f19e2ffd640 1 --2- 172.21.15.22:0/290316819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbac3000 0x55cefbad7280 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009c20 tx=0x7f19d4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7403fd3d13bf29e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:52.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.483+0000 7f19e88cb640 1 --2- 172.21.15.22:0/2487836960 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f19cc0b3cd0 0x7f19cc0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:52.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.484+0000 7f19e27fc640 1 --2- 172.21.15.22:0/2487836960 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f19cc0b3cd0 0x7f19cc0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:52.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.484+0000 7f19e88cb640 1 -- 172.21.15.22:0/2487836960 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f19dc0e3870 con 0x7f19e4107d20 2024-08-20T01:39:52.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.485+0000 7f19c9ffb640 1 -- 172.21.15.22:0/290316819 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d4009dd0 con 0x55cefbac3000 2024-08-20T01:39:52.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.485+0000 7f19c9ffb640 1 -- 172.21.15.22:0/290316819 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19d4005020 con 0x55cefbac3000 2024-08-20T01:39:52.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.485+0000 7f19c9ffb640 1 -- 172.21.15.22:0/290316819 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d4004b40 con 0x55cefbac3000 2024-08-20T01:39:52.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.486+0000 7f19ebcc6740 1 -- 172.21.15.22:0/290316819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbac3000 msgr2=0x55cefbad7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:52.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.486+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/290316819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbac3000 0x55cefbad7280 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009c20 tx=0x7f19d4011810 comp rx=0 tx=0).stop 2024-08-20T01:39:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.486+0000 7f19ebcc6740 1 -- 172.21.15.22:0/290316819 shutdown_connections 2024-08-20T01:39:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.486+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/290316819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbad77c0 0x55cefbad9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.486+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/290316819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbac3000 0x55cefbad7280 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.486+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/290316819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbac26e0 0x55cefbac2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.486+0000 7f19ebcc6740 1 -- 172.21.15.22:0/290316819 >> 172.21.15.22:0/290316819 conn(0x55cefbac0450 msgr2=0x55cefbac0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:52.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.489+0000 7f19ebcc6740 1 -- 172.21.15.22:0/290316819 shutdown_connections 2024-08-20T01:39:52.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.489+0000 7f19e27fc640 1 --2- 172.21.15.22:0/2487836960 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f19cc0b3cd0 0x7f19cc0b6190 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x55cefbac4730 tx=0x7f19d8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:52.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.489+0000 7f19ebcc6740 1 -- 172.21.15.22:0/290316819 wait complete. 2024-08-20T01:39:52.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.489+0000 7f19ebcc6740 1 -- start start 2024-08-20T01:39:52.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.490+0000 7f19ebcc6740 1 Processor -- start 2024-08-20T01:39:52.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.490+0000 7f19ebcc6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbac26e0 0x55cefbad4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:52.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.490+0000 7f19ebcc6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbac3000 0x55cefbad4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.490+0000 7f19e2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbac26e0 0x55cefbad4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.491+0000 7f19e2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbac26e0 0x55cefbad4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:59154/0 (socket says 172.21.15.22:59154) 2024-08-20T01:39:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.491+0000 7f19e2ffd640 1 -- 172.21.15.22:0/2756125233 learned_addr learned my addr 172.21.15.22:0/2756125233 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.491+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/2756125233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbad77c0 0x55cefbad51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.491+0000 7f19ebcc6740 1 -- 172.21.15.22:0/2756125233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cefb88b700 con 0x55cefbac3000 2024-08-20T01:39:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.491+0000 7f19ebcc6740 1 -- 172.21.15.22:0/2756125233 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cefb9af7c0 con 0x55cefbac26e0 2024-08-20T01:39:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.491+0000 7f19ebcc6740 1 -- 172.21.15.22:0/2756125233 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cefbada420 con 0x55cefbad77c0 2024-08-20T01:39:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.491+0000 7f19e37fe640 1 --2- 172.21.15.22:0/2756125233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbad77c0 0x55cefbad51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.491+0000 7f19ebcc6740 10 client.0 _ll_register_callbacks cb 0x55cefba226b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.491+0000 7f19e37fe640 1 -- 172.21.15.22:0/2756125233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbac26e0 msgr2=0x55cefbad4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.491+0000 7f19e37fe640 1 --2- 172.21.15.22:0/2756125233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbac26e0 0x55cefbad4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.491+0000 7f19e37fe640 1 -- 172.21.15.22:0/2756125233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbac3000 msgr2=0x55cefbad4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.491+0000 7f19e37fe640 1 --2- 172.21.15.22:0/2756125233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbac3000 0x55cefbad4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.491+0000 7f19e37fe640 1 -- 172.21.15.22:0/2756125233 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cefbacdaf0 con 0x55cefbad77c0 2024-08-20T01:39:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.492+0000 7f19e37fe640 1 --2- 172.21.15.22:0/2756125233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbad77c0 0x55cefbad51a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f19dc0e12d0 tx=0x7f19dc0af8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ecf187601632e04 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.493+0000 7f19c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:39:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.493+0000 7f19c2ffd640 1 -- 172.21.15.22:0/2756125233 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc0b4260 con 0x55cefbad77c0 2024-08-20T01:39:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.493+0000 7f19c2ffd640 1 -- 172.21.15.22:0/2756125233 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f19dc0113b0 con 0x55cefbad77c0 2024-08-20T01:39:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.493+0000 7f19ebcc6740 1 -- 172.21.15.22:0/2756125233 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cefb9d8100 con 0x55cefbad77c0 2024-08-20T01:39:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.493+0000 7f19c2ffd640 1 -- 172.21.15.22:0/2756125233 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f19dc0115b0 con 0x55cefbad77c0 2024-08-20T01:39:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.494+0000 7f19ebcc6740 10 client.26533 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.494+0000 7f19ebcc6740 1 -- 172.21.15.22:0/2756125233 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cefbaee9e0 con 0x55cefbad77c0 2024-08-20T01:39:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.495+0000 7f19c2ffd640 1 -- 172.21.15.22:0/2756125233 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55cefb9d8100 con 0x55cefbad77c0 2024-08-20T01:39:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.496+0000 7f19c2ffd640 1 -- 172.21.15.22:0/2756125233 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f19dc0970c0 con 0x55cefbad77c0 2024-08-20T01:39:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.496+0000 7f19ebcc6740 10 client.26533 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.496+0000 7f19ebcc6740 10 client.26533 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.496+0000 7f19ebcc6740 20 client.26533 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.496+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/2756125233 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55cefbaf0390 0x55cefbaf2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:52.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.496+0000 7f19ebcc6740 4 client.26533 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:52.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.497+0000 7f19ebcc6740 1 -- 172.21.15.22:0/2756125233 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cefba3b830 con 0x55cefbaf0390 2024-08-20T01:39:52.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.497+0000 7f19e2ffd640 1 --2- 172.21.15.22:0/2756125233 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55cefbaf0390 0x55cefbaf2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:52.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.498+0000 7f19e2ffd640 1 --2- 172.21.15.22:0/2756125233 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55cefbaf0390 0x55cefbaf2850 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43aa027b8e6b3634 server_cookie=87c981bb5da487e1 in_seq=0 out_seq=0 2024-08-20T01:39:52.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.498+0000 7f19c2ffd640 10 client.26533 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:52.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.499+0000 7f19c2ffd640 1 -- 172.21.15.22:0/2756125233 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cefba3b830 con 0x55cefbaf0390 2024-08-20T01:39:52.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.499+0000 7f19c2ffd640 10 client.26533 handle_command_reply: tid=0 2024-08-20T01:39:52.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.499+0000 7f19ebcc6740 1 client.26533 shutdown 2024-08-20T01:39:52.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.501+0000 7f19ebcc6740 1 -- 172.21.15.22:0/2756125233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbad77c0 msgr2=0x55cefbad51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:52.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.501+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/2756125233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbad77c0 0x55cefbad51a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f19dc0e12d0 tx=0x7f19dc0af8b0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.502+0000 7f19ebcc6740 1 -- 172.21.15.22:0/2756125233 shutdown_connections 2024-08-20T01:39:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.502+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/2756125233 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55cefbaf0390 0x55cefbaf2850 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.502+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/2756125233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbad77c0 0x55cefbad51a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.502+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/2756125233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbac3000 0x55cefbad4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.502+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/2756125233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbac26e0 0x55cefbad4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.502+0000 7f19ebcc6740 1 -- 172.21.15.22:0/2756125233 >> 172.21.15.22:0/2756125233 conn(0x55cefbac0450 msgr2=0x55cefbac1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:52.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.502+0000 7f19c2ffd640 0 client.26533 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:52.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.503+0000 7f19ebcc6740 1 -- 172.21.15.22:0/2756125233 shutdown_connections 2024-08-20T01:39:52.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.503+0000 7f19ebcc6740 1 -- 172.21.15.22:0/2756125233 wait complete. 2024-08-20T01:39:52.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.504+0000 7f19ebcc6740 20 client.26533 trim_cache size 0 max 16384 2024-08-20T01:39:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.539+0000 7f19ebcc6740 1 Processor -- start 2024-08-20T01:39:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.539+0000 7f19ebcc6740 1 -- start start 2024-08-20T01:39:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.540+0000 7f19ebcc6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbac26e0 0x55cefbad2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.540+0000 7f19ebcc6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbac3000 0x55cefbad3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.540+0000 7f19ebcc6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbad77c0 0x55cefbaf8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.540+0000 7f19ebcc6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f19d0010e60 con 0x55cefbad77c0 2024-08-20T01:39:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.540+0000 7f19ebcc6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f19d000e670 con 0x55cefbac26e0 2024-08-20T01:39:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.540+0000 7f19ebcc6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f19d000c570 con 0x55cefbac3000 2024-08-20T01:39:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.540+0000 7f19e27fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbac3000 0x55cefbad3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.540+0000 7f19e27fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbac3000 0x55cefbad3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:39196/0 (socket says 172.21.15.22:39196) 2024-08-20T01:39:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.540+0000 7f19e2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbac26e0 0x55cefbad2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.540+0000 7f19e27fc640 1 -- 172.21.15.22:0/766106614 learned_addr learned my addr 172.21.15.22:0/766106614 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.540+0000 7f19e37fe640 1 --2- 172.21.15.22:0/766106614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbad77c0 0x55cefbaf8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.540+0000 7f19e27fc640 1 -- 172.21.15.22:0/766106614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbac26e0 msgr2=0x55cefbad2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.540+0000 7f19e27fc640 1 --2- 172.21.15.22:0/766106614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbac26e0 0x55cefbad2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.540+0000 7f19e27fc640 1 -- 172.21.15.22:0/766106614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbad77c0 msgr2=0x55cefbaf8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.540+0000 7f19e27fc640 1 --2- 172.21.15.22:0/766106614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbad77c0 0x55cefbaf8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.540+0000 7f19e27fc640 1 -- 172.21.15.22:0/766106614 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cefbad2c40 con 0x55cefbac3000 2024-08-20T01:39:52.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.541+0000 7f19e27fc640 1 --2- 172.21.15.22:0/766106614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbac3000 0x55cefbad3500 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f19d80098d0 tx=0x7f19d8005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24650a0b395930cf server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:52.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.541+0000 7f19c97fa640 1 -- 172.21.15.22:0/766106614 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d8035040 con 0x55cefbac3000 2024-08-20T01:39:52.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.541+0000 7f19c97fa640 1 -- 172.21.15.22:0/766106614 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19d8003bb0 con 0x55cefbac3000 2024-08-20T01:39:52.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.541+0000 7f19c97fa640 1 -- 172.21.15.22:0/766106614 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d80486b0 con 0x55cefbac3000 2024-08-20T01:39:52.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.542+0000 7f19ebcc6740 1 -- 172.21.15.22:0/766106614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbac3000 msgr2=0x55cefbad3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:52.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.542+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/766106614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbac3000 0x55cefbad3500 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f19d80098d0 tx=0x7f19d8005a20 comp rx=0 tx=0).stop 2024-08-20T01:39:52.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.542+0000 7f19ebcc6740 1 -- 172.21.15.22:0/766106614 shutdown_connections 2024-08-20T01:39:52.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.542+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/766106614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbad77c0 0x55cefbaf8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.542+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/766106614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbac3000 0x55cefbad3500 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.542+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/766106614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbac26e0 0x55cefbad2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.542+0000 7f19ebcc6740 1 -- 172.21.15.22:0/766106614 >> 172.21.15.22:0/766106614 conn(0x55cefbac0450 msgr2=0x55cefbabf360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:52.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.542+0000 7f19ebcc6740 1 -- 172.21.15.22:0/766106614 shutdown_connections 2024-08-20T01:39:52.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.542+0000 7f19ebcc6740 1 -- 172.21.15.22:0/766106614 wait complete. 2024-08-20T01:39:52.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.543+0000 7f19ebcc6740 1 -- start start 2024-08-20T01:39:52.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.543+0000 7f19ebcc6740 1 Processor -- start 2024-08-20T01:39:52.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.544+0000 7f19ebcc6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbac26e0 0x55cefbacaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:52.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.544+0000 7f19ebcc6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbac3000 0x55cefbacaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:52.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.544+0000 7f19e2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbac26e0 0x55cefbacaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:52.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.544+0000 7f19e2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbac26e0 0x55cefbacaa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45532/0 (socket says 172.21.15.22:45532) 2024-08-20T01:39:52.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.544+0000 7f19e27fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbac3000 0x55cefbacaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:52.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.544+0000 7f19e27fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbac3000 0x55cefbacaf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:39210/0 (socket says 172.21.15.22:39210) 2024-08-20T01:39:52.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.544+0000 7f19ebcc6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbad77c0 0x55cefbad0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:52.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.544+0000 7f19e2ffd640 1 -- 172.21.15.22:0/325581353 learned_addr learned my addr 172.21.15.22:0/325581353 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:52.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.544+0000 7f19e37fe640 1 --2- 172.21.15.22:0/325581353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbad77c0 0x55cefbad0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:52.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.544+0000 7f19ebcc6740 1 -- 172.21.15.22:0/325581353 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f19d000cb30 con 0x55cefbac26e0 2024-08-20T01:39:52.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.544+0000 7f19ebcc6740 1 -- 172.21.15.22:0/325581353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f19d000dfa0 con 0x55cefbad77c0 2024-08-20T01:39:52.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.544+0000 7f19ebcc6740 1 -- 172.21.15.22:0/325581353 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f19d000d200 con 0x55cefbac3000 2024-08-20T01:39:52.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.545+0000 7f19e2ffd640 1 -- 172.21.15.22:0/325581353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbac3000 msgr2=0x55cefbacaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:52.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.545+0000 7f19e2ffd640 1 --2- 172.21.15.22:0/325581353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbac3000 0x55cefbacaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.545+0000 7f19e2ffd640 1 -- 172.21.15.22:0/325581353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbad77c0 msgr2=0x55cefbad0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:52.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.545+0000 7f19e2ffd640 1 --2- 172.21.15.22:0/325581353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbad77c0 0x55cefbad0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.545+0000 7f19e2ffd640 1 -- 172.21.15.22:0/325581353 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cefbad1070 con 0x55cefbac26e0 2024-08-20T01:39:52.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.545+0000 7f19ebcc6740 10 client.0 _ll_register_callbacks cb 0x7f19dc0abb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:52.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.545+0000 7f19ebcc6740 1 -- 172.21.15.22:0/325581353 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19d8003bb0 con 0x55cefbac26e0 2024-08-20T01:39:52.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.545+0000 7f19e2ffd640 1 --2- 172.21.15.22:0/325581353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbac26e0 0x55cefbacaa40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f19d400a010 tx=0x7f19d4005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00af8bae0770d5b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:52.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.546+0000 7f19c2ffd640 10 client.16887 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:39:52.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.546+0000 7f19c2ffd640 1 -- 172.21.15.22:0/325581353 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d4030020 con 0x55cefbac26e0 2024-08-20T01:39:52.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.546+0000 7f19c2ffd640 1 -- 172.21.15.22:0/325581353 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f19d4005500 con 0x55cefbac26e0 2024-08-20T01:39:52.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.546+0000 7f19c2ffd640 1 -- 172.21.15.22:0/325581353 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f19d40045f0 con 0x55cefbac26e0 2024-08-20T01:39:52.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.546+0000 7f19ebcc6740 10 client.16887 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:52.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.546+0000 7f19ebcc6740 1 -- 172.21.15.22:0/325581353 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55cefbad2230 con 0x55cefbac26e0 2024-08-20T01:39:52.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.547+0000 7f19c2ffd640 1 -- 172.21.15.22:0/325581353 <== mon.0 v2:172.21.15.22:3300/0 4 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f19d4004790 con 0x55cefbac26e0 2024-08-20T01:39:52.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.547+0000 7f19ebcc6740 10 client.16887 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:52.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.547+0000 7f19ebcc6740 10 client.16887 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:52.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.547+0000 7f19ebcc6740 20 client.16887 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:52.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.547+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/325581353 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55cefbb5a0f0 0x55cefbb5c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:52.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.547+0000 7f19ebcc6740 4 client.16887 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:39:52.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.547+0000 7f19ebcc6740 1 -- 172.21.15.22:0/325581353 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cefba372d0 con 0x55cefbb5a0f0 2024-08-20T01:39:52.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.547+0000 7f19e27fc640 1 --2- 172.21.15.22:0/325581353 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55cefbb5a0f0 0x55cefbb5c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:52.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.548+0000 7f19e27fc640 1 --2- 172.21.15.22:0/325581353 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55cefbb5a0f0 0x55cefbb5c4e0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dbe1e7fc2926c4a server_cookie=d2c27337ed2e5edd in_seq=0 out_seq=0 2024-08-20T01:39:52.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.548+0000 7f19c2ffd640 10 client.16887 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:52.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.548+0000 7f19c2ffd640 1 -- 172.21.15.22:0/325581353 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x55cefba372d0 con 0x55cefbb5a0f0 2024-08-20T01:39:52.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.548+0000 7f19c2ffd640 10 client.16887 handle_command_reply: tid=0 2024-08-20T01:39:52.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.548+0000 7f19ebcc6740 1 client.16887 shutdown 2024-08-20T01:39:52.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.548+0000 7f19ebcc6740 1 -- 172.21.15.22:0/325581353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbac26e0 msgr2=0x55cefbacaa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:52.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.548+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/325581353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbac26e0 0x55cefbacaa40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f19d400a010 tx=0x7f19d4005c50 comp rx=0 tx=0).stop 2024-08-20T01:39:52.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.548+0000 7f19ebcc6740 1 -- 172.21.15.22:0/325581353 shutdown_connections 2024-08-20T01:39:52.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.548+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/325581353 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55cefbb5a0f0 0x55cefbb5c4e0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.548+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/325581353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefbad77c0 0x55cefbad0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.548+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/325581353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cefbac3000 0x55cefbacaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.548+0000 7f19ebcc6740 1 --2- 172.21.15.22:0/325581353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cefbac26e0 0x55cefbacaa40 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.548+0000 7f19ebcc6740 1 -- 172.21.15.22:0/325581353 >> 172.21.15.22:0/325581353 conn(0x55cefbac0450 msgr2=0x55cefbad2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:52.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.549+0000 7f19c2ffd640 0 client.16887 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:52.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.549+0000 7f19ebcc6740 1 -- 172.21.15.22:0/325581353 shutdown_connections 2024-08-20T01:39:52.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.549+0000 7f19ebcc6740 1 -- 172.21.15.22:0/325581353 wait complete. 2024-08-20T01:39:52.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.549+0000 7f19ebcc6740 20 client.16887 trim_cache size 0 max 16384 2024-08-20T01:39:52.555 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:39:52.555 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "scrub active (25635 inodes in the stack)", 2024-08-20T01:39:52.556 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-08-20T01:39:52.556 INFO:teuthology.orchestra.run.smithi022.stdout: "95ed0eb6-8b60-4850-8e42-65ae77280ff5": { 2024-08-20T01:39:52.556 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-08-20T01:39:52.556 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "95ed0eb6-8b60-4850-8e42-65ae77280ff5", 2024-08-20T01:39:52.556 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-08-20T01:39:52.556 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:39:52.556 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:39:52.556 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:39:52.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.549+0000 7f19e98cd640 1 -- 172.21.15.22:0/2487836960 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f19cc0b3cd0 msgr2=0x7f19cc0b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:52.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.550+0000 7f19e98cd640 1 --2- 172.21.15.22:0/2487836960 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f19cc0b3cd0 0x7f19cc0b6190 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x55cefbac4730 tx=0x7f19d8009260 comp rx=0 tx=0).stop 2024-08-20T01:39:52.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.550+0000 7f19e98cd640 1 -- 172.21.15.22:0/2487836960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e4107d20 msgr2=0x7f19e419d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:52.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.550+0000 7f19e98cd640 1 --2- 172.21.15.22:0/2487836960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e4107d20 0x7f19e419d7f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00ca30 tx=0x7f19dc00cef0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.550+0000 7f19e98cd640 1 -- 172.21.15.22:0/2487836960 shutdown_connections 2024-08-20T01:39:52.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.550+0000 7f19e98cd640 1 --2- 172.21.15.22:0/2487836960 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f19cc0b3cd0 0x7f19cc0b6190 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.550+0000 7f19e98cd640 1 --2- 172.21.15.22:0/2487836960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e4107d20 0x7f19e419d7f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.550+0000 7f19e98cd640 1 --2- 172.21.15.22:0/2487836960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19e41073a0 0x7f19e4198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.550+0000 7f19e98cd640 1 --2- 172.21.15.22:0/2487836960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19e4101990 0x7f19e4197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:52.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.550+0000 7f19e98cd640 1 -- 172.21.15.22:0/2487836960 >> 172.21.15.22:0/2487836960 conn(0x7f19e40fd400 msgr2=0x7f19e40ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:52.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.551+0000 7f19e98cd640 1 -- 172.21.15.22:0/2487836960 shutdown_connections 2024-08-20T01:39:52.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:39:52.551+0000 7f19e98cd640 1 -- 172.21.15.22:0/2487836960 wait complete. 2024-08-20T01:39:53.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:52 smithi134 ceph-mon[22511]: pgmap v608: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 546 op/s 2024-08-20T01:39:53.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:52 smithi077 ceph-mon[22251]: pgmap v608: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 546 op/s 2024-08-20T01:39:53.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:52 smithi022 ceph-mon[18709]: pgmap v608: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 546 op/s 2024-08-20T01:39:53.336 INFO:tasks.cephfs.filesystem:scrub status for tag:95ed0eb6-8b60-4850-8e42-65ae77280ff5 - {'path': '/', 'tag': '95ed0eb6-8b60-4850-8e42-65ae77280ff5', 'options': 'recursive,force'} 2024-08-20T01:39:55.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:54 smithi134 ceph-mon[22511]: pgmap v609: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 1.18k op/s 2024-08-20T01:39:55.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:54 smithi077 ceph-mon[22251]: pgmap v609: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 1.18k op/s 2024-08-20T01:39:55.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:54 smithi022 ceph-mon[18709]: pgmap v609: 97 pgs: 97 active+clean; 1.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 1.18k op/s 2024-08-20T01:39:56.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:55 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:56.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:55 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:56.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:55 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.855+0000 7f5300060640 1 -- 172.21.15.22:0/3967102891 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52f81037d0 msgr2=0x7f52f8103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.855+0000 7f5300060640 1 --2- 172.21.15.22:0/3967102891 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52f81037d0 0x7f52f8103c50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009cd0 tx=0x7f52f402a8e0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.855+0000 7f5300060640 1 -- 172.21.15.22:0/3967102891 shutdown_connections 2024-08-20T01:39:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.855+0000 7f5300060640 1 --2- 172.21.15.22:0/3967102891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52f8104190 0x7f52f810ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.855+0000 7f5300060640 1 --2- 172.21.15.22:0/3967102891 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52f81037d0 0x7f52f8103c50 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.855+0000 7f5300060640 1 --2- 172.21.15.22:0/3967102891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52f8102680 0x7f52f8102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.855+0000 7f5300060640 1 -- 172.21.15.22:0/3967102891 >> 172.21.15.22:0/3967102891 conn(0x7f52f80fdf40 msgr2=0x7f52f8100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.855+0000 7f5300060640 1 -- 172.21.15.22:0/3967102891 shutdown_connections 2024-08-20T01:39:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.855+0000 7f5300060640 1 -- 172.21.15.22:0/3967102891 wait complete. 2024-08-20T01:39:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.856+0000 7f5300060640 1 Processor -- start 2024-08-20T01:39:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.856+0000 7f5300060640 1 -- start start 2024-08-20T01:39:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.856+0000 7f5300060640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52f8102680 0x7f52f8198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.856+0000 7f5300060640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52f81037d0 0x7f52f81990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.856+0000 7f5300060640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52f8104190 0x7f52f8199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.856+0000 7f5300060640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f52f810e340 con 0x7f52f8102680 2024-08-20T01:39:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.856+0000 7f5300060640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52f810e1c0 con 0x7f52f81037d0 2024-08-20T01:39:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.856+0000 7f5300060640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52f810e4c0 con 0x7f52f8104190 2024-08-20T01:39:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.856+0000 7f52fddfc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52f8102680 0x7f52f8198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.856+0000 7f52fddfc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52f8102680 0x7f52f8198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45554/0 (socket says 172.21.15.22:45554) 2024-08-20T01:39:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.856+0000 7f52fe5fd640 1 --2- 172.21.15.22:0/1816052902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52f8104190 0x7f52f8199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.856+0000 7f52fddfc640 1 -- 172.21.15.22:0/1816052902 learned_addr learned my addr 172.21.15.22:0/1816052902 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.856+0000 7f52fd5fb640 1 --2- 172.21.15.22:0/1816052902 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52f81037d0 0x7f52f81990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.856+0000 7f52fe5fd640 1 -- 172.21.15.22:0/1816052902 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52f81037d0 msgr2=0x7f52f81990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.856+0000 7f52fe5fd640 1 --2- 172.21.15.22:0/1816052902 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52f81037d0 0x7f52f81990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.856+0000 7f52fe5fd640 1 -- 172.21.15.22:0/1816052902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52f8102680 msgr2=0x7f52f8198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.856+0000 7f52fe5fd640 1 --2- 172.21.15.22:0/1816052902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52f8102680 0x7f52f8198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.856+0000 7f52fe5fd640 1 -- 172.21.15.22:0/1816052902 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f819a5e0 con 0x7f52f8104190 2024-08-20T01:39:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.856+0000 7f52fddfc640 1 --2- 172.21.15.22:0/1816052902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52f8102680 0x7f52f8198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.857+0000 7f52fe5fd640 1 --2- 172.21.15.22:0/1816052902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52f8104190 0x7f52f8199d20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f52f000e970 tx=0x7f52f000ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.857+0000 7f52eaffd640 1 -- 172.21.15.22:0/1816052902 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f000ccc0 con 0x7f52f8104190 2024-08-20T01:39:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.857+0000 7f5300060640 1 -- 172.21.15.22:0/1816052902 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f819a8d0 con 0x7f52f8104190 2024-08-20T01:39:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.857+0000 7f52eaffd640 1 -- 172.21.15.22:0/1816052902 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52f0005020 con 0x7f52f8104190 2024-08-20T01:39:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.857+0000 7f52eaffd640 1 -- 172.21.15.22:0/1816052902 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f0004a00 con 0x7f52f8104190 2024-08-20T01:39:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.857+0000 7f5300060640 1 -- 172.21.15.22:0/1816052902 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f81a0fa0 con 0x7f52f8104190 2024-08-20T01:39:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.859+0000 7f52eaffd640 1 -- 172.21.15.22:0/1816052902 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f52f0004ba0 con 0x7f52f8104190 2024-08-20T01:39:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.859+0000 7f5302e5a740 1 Processor -- start 2024-08-20T01:39:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.860+0000 7f5302e5a740 1 -- start start 2024-08-20T01:39:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.860+0000 7f5302e5a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 0x55b9d45faa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.860+0000 7f5302e5a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 0x55b9d45fd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.860+0000 7f5302e5a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d45ffe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.860+0000 7f5302e5a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b9d456b360 con 0x55b9d45fd9a0 2024-08-20T01:39:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.860+0000 7f5302e5a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b9d455a860 con 0x55b9d45faf60 2024-08-20T01:39:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.860+0000 7f5302e5a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b9d455e8a0 con 0x55b9d45f8630 2024-08-20T01:39:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.860+0000 7f52fd5fb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d45ffe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.860+0000 7f52fddfc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 0x55b9d45fd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.860+0000 7f52fd5fb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d45ffe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45568/0 (socket says 172.21.15.22:45568) 2024-08-20T01:39:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.860+0000 7f52fd5fb640 1 -- 172.21.15.22:0/2222693328 learned_addr learned my addr 172.21.15.22:0/2222693328 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.860+0000 7f52fddfc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 0x55b9d45fd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:59216/0 (socket says 172.21.15.22:59216) 2024-08-20T01:39:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.860+0000 7f52fd5fb640 1 --2- 172.21.15.22:0/2222693328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 0x55b9d45faa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.860+0000 7f52fddfc640 1 -- 172.21.15.22:0/2222693328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 msgr2=0x55b9d45faa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.860+0000 7f52fddfc640 1 --2- 172.21.15.22:0/2222693328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 0x55b9d45faa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.860+0000 7f52fddfc640 1 -- 172.21.15.22:0/2222693328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 msgr2=0x55b9d45ffe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.860+0000 7f52fddfc640 1 --2- 172.21.15.22:0/2222693328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d45ffe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.860+0000 7f52fddfc640 1 -- 172.21.15.22:0/2222693328 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9d4501e40 con 0x55b9d45faf60 2024-08-20T01:39:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.861+0000 7f52eaffd640 1 --2- 172.21.15.22:0/1816052902 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f52e40b3bd0 0x7f52e40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.861+0000 7f52fddfc640 1 --2- 172.21.15.22:0/2222693328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 0x55b9d45fd350 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0114f0 tx=0x7f52ec0119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e7270d7bcd43bdb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.861+0000 7f52fd5fb640 1 --2- 172.21.15.22:0/1816052902 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f52e40b3bd0 0x7f52e40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.861+0000 7f52e3fff640 1 -- 172.21.15.22:0/2222693328 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec01e070 con 0x55b9d45faf60 2024-08-20T01:39:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.861+0000 7f52e3fff640 1 -- 172.21.15.22:0/2222693328 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52ec0035f0 con 0x55b9d45faf60 2024-08-20T01:39:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.861+0000 7f52e3fff640 1 -- 172.21.15.22:0/2222693328 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00f7a0 con 0x55b9d45faf60 2024-08-20T01:39:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.861+0000 7f52eaffd640 1 -- 172.21.15.22:0/1816052902 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f52f00e3b70 con 0x7f52f8104190 2024-08-20T01:39:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.862+0000 7f5302e5a740 1 -- 172.21.15.22:0/2222693328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 msgr2=0x55b9d45fd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.862+0000 7f5302e5a740 1 --2- 172.21.15.22:0/2222693328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 0x55b9d45fd350 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0114f0 tx=0x7f52ec0119b0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.862+0000 7f52fd5fb640 1 --2- 172.21.15.22:0/1816052902 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f52e40b3bd0 0x7f52e40b6090 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009ca0 tx=0x7f52f40093d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.862+0000 7f5302e5a740 1 -- 172.21.15.22:0/2222693328 shutdown_connections 2024-08-20T01:39:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.862+0000 7f5302e5a740 1 --2- 172.21.15.22:0/2222693328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d45ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.862+0000 7f5302e5a740 1 --2- 172.21.15.22:0/2222693328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 0x55b9d45fd350 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.862+0000 7f5302e5a740 1 --2- 172.21.15.22:0/2222693328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 0x55b9d45faa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.862+0000 7f5302e5a740 1 -- 172.21.15.22:0/2222693328 >> 172.21.15.22:0/2222693328 conn(0x55b9d45f3730 msgr2=0x55b9d45f4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.862+0000 7f5302e5a740 1 -- 172.21.15.22:0/2222693328 shutdown_connections 2024-08-20T01:39:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.862+0000 7f5302e5a740 1 -- 172.21.15.22:0/2222693328 wait complete. 2024-08-20T01:39:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.862+0000 7f5302e5a740 1 -- start start 2024-08-20T01:39:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.862+0000 7f5302e5a740 1 Processor -- start 2024-08-20T01:39:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f5302e5a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 0x55b9d4601dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f5302e5a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 0x55b9d4602460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f5302e5a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d4603030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f5302e5a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b9d4493ab0 con 0x55b9d45fd9a0 2024-08-20T01:39:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f5302e5a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b9d44e1780 con 0x55b9d45faf60 2024-08-20T01:39:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f5302e5a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b9d4600980 con 0x55b9d45f8630 2024-08-20T01:39:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f5302e5a740 10 client.0 _ll_register_callbacks cb 0x55b9d4269a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f52fe5fd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d4603030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f52fe5fd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d4603030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45584/0 (socket says 172.21.15.22:45584) 2024-08-20T01:39:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f52fe5fd640 1 -- 172.21.15.22:0/3814826663 learned_addr learned my addr 172.21.15.22:0/3814826663 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f52fd5fb640 1 --2- 172.21.15.22:0/3814826663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 0x55b9d4602460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f52fddfc640 1 --2- 172.21.15.22:0/3814826663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 0x55b9d4601dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f52fe5fd640 1 -- 172.21.15.22:0/3814826663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 msgr2=0x55b9d4601dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f52fe5fd640 1 --2- 172.21.15.22:0/3814826663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 0x55b9d4601dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f52fe5fd640 1 -- 172.21.15.22:0/3814826663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 msgr2=0x55b9d4602460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f52fe5fd640 1 --2- 172.21.15.22:0/3814826663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 0x55b9d4602460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f52fe5fd640 1 -- 172.21.15.22:0/3814826663 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9d42bd790 con 0x55b9d45fd9a0 2024-08-20T01:39:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f52fddfc640 1 --2- 172.21.15.22:0/3814826663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 0x55b9d4601dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f52fd5fb640 1 --2- 172.21.15.22:0/3814826663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 0x55b9d4602460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f52fe5fd640 1 --2- 172.21.15.22:0/3814826663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d4603030 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f52f00a6b00 tx=0x7f52f00a6210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75294883fe39231 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.863+0000 7f52e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:39:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.864+0000 7f52e17fa640 1 -- 172.21.15.22:0/3814826663 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f001c070 con 0x55b9d45fd9a0 2024-08-20T01:39:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.864+0000 7f52e17fa640 1 -- 172.21.15.22:0/3814826663 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f52f00054f0 con 0x55b9d45fd9a0 2024-08-20T01:39:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.864+0000 7f5302e5a740 1 -- 172.21.15.22:0/3814826663 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b9d4509e00 con 0x55b9d45fd9a0 2024-08-20T01:39:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.864+0000 7f52e17fa640 1 -- 172.21.15.22:0/3814826663 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f52f00aaa80 con 0x55b9d45fd9a0 2024-08-20T01:39:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.864+0000 7f5302e5a740 10 client.16899 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.864+0000 7f5302e5a740 1 -- 172.21.15.22:0/3814826663 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b9d4336620 con 0x55b9d45fd9a0 2024-08-20T01:39:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.864+0000 7f52e17fa640 1 -- 172.21.15.22:0/3814826663 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b9d4509e00 con 0x55b9d45fd9a0 2024-08-20T01:39:56.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.864+0000 7f52e17fa640 1 -- 172.21.15.22:0/3814826663 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f52f00b36a0 con 0x55b9d45fd9a0 2024-08-20T01:39:56.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.864+0000 7f5302e5a740 10 client.16899 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:56.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.864+0000 7f5302e5a740 10 client.16899 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:56.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.864+0000 7f5302e5a740 20 client.16899 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:56.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.864+0000 7f5302e5a740 1 --2- 172.21.15.22:0/3814826663 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55b9d460d600 0x55b9d460fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:56.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.864+0000 7f5302e5a740 4 client.16899 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:56.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.864+0000 7f5302e5a740 1 -- 172.21.15.22:0/3814826663 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9d456d2b0 con 0x55b9d460d600 2024-08-20T01:39:56.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.865+0000 7f52fddfc640 1 --2- 172.21.15.22:0/3814826663 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55b9d460d600 0x55b9d460fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:56.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.865+0000 7f52e17fa640 10 client.16899 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:56.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.865+0000 7f52fddfc640 1 --2- 172.21.15.22:0/3814826663 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55b9d460d600 0x55b9d460fa90 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d15841932d1494b7 server_cookie=ba1549c5aeea714d in_seq=0 out_seq=0 2024-08-20T01:39:56.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.866+0000 7f52e17fa640 1 -- 172.21.15.22:0/3814826663 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9d456d2b0 con 0x55b9d460d600 2024-08-20T01:39:56.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.866+0000 7f52e17fa640 10 client.16899 handle_command_reply: tid=0 2024-08-20T01:39:56.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.866+0000 7f5302e5a740 1 client.16899 shutdown 2024-08-20T01:39:56.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.866+0000 7f5302e5a740 1 -- 172.21.15.22:0/3814826663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 msgr2=0x55b9d4603030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:56.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.866+0000 7f5302e5a740 1 --2- 172.21.15.22:0/3814826663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d4603030 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f52f00a6b00 tx=0x7f52f00a6210 comp rx=0 tx=0).stop 2024-08-20T01:39:56.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.866+0000 7f5302e5a740 1 -- 172.21.15.22:0/3814826663 shutdown_connections 2024-08-20T01:39:56.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.866+0000 7f5302e5a740 1 --2- 172.21.15.22:0/3814826663 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55b9d460d600 0x55b9d460fa90 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.866+0000 7f5302e5a740 1 --2- 172.21.15.22:0/3814826663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d4603030 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.866+0000 7f5302e5a740 1 --2- 172.21.15.22:0/3814826663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 0x55b9d4602460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.866+0000 7f52e17fa640 0 client.16899 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:56.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.866+0000 7f5302e5a740 1 --2- 172.21.15.22:0/3814826663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 0x55b9d4601dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.866+0000 7f5302e5a740 1 -- 172.21.15.22:0/3814826663 >> 172.21.15.22:0/3814826663 conn(0x55b9d45f3730 msgr2=0x55b9d45f2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:56.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.866+0000 7f5302e5a740 1 -- 172.21.15.22:0/3814826663 shutdown_connections 2024-08-20T01:39:56.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.866+0000 7f5302e5a740 1 -- 172.21.15.22:0/3814826663 wait complete. 2024-08-20T01:39:56.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.866+0000 7f5302e5a740 20 client.16899 trim_cache size 0 max 16384 2024-08-20T01:39:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f5302e5a740 1 Processor -- start 2024-08-20T01:39:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f5302e5a740 1 -- start start 2024-08-20T01:39:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f5302e5a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 0x55b9d4600f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f5302e5a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 0x55b9d45fdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f5302e5a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d45fe2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f5302e5a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f52f81ac6d0 con 0x55b9d45fd9a0 2024-08-20T01:39:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f5302e5a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52f81a9ee0 con 0x55b9d45faf60 2024-08-20T01:39:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f5302e5a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52f81a7d30 con 0x55b9d45f8630 2024-08-20T01:39:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f52fe5fd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d45fe2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f52fddfc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 0x55b9d4600f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f52fe5fd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d45fe2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45594/0 (socket says 172.21.15.22:45594) 2024-08-20T01:39:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f52fe5fd640 1 -- 172.21.15.22:0/3703621790 learned_addr learned my addr 172.21.15.22:0/3703621790 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f52fd5fb640 1 --2- 172.21.15.22:0/3703621790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 0x55b9d45fdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f52fe5fd640 1 -- 172.21.15.22:0/3703621790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 msgr2=0x55b9d4600f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f52fe5fd640 1 --2- 172.21.15.22:0/3703621790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 0x55b9d4600f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f52fe5fd640 1 -- 172.21.15.22:0/3703621790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 msgr2=0x55b9d45fdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f52fe5fd640 1 --2- 172.21.15.22:0/3703621790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 0x55b9d45fdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f52fe5fd640 1 -- 172.21.15.22:0/3703621790 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9d45fd6c0 con 0x55b9d45fd9a0 2024-08-20T01:39:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f52fddfc640 1 --2- 172.21.15.22:0/3703621790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 0x55b9d4600f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.882+0000 7f52fe5fd640 1 --2- 172.21.15.22:0/3703621790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d45fe2c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f52f000e940 tx=0x7f52f00a6340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c729478bb18e2c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.883+0000 7f52e37fe640 1 -- 172.21.15.22:0/3703621790 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f001c070 con 0x55b9d45fd9a0 2024-08-20T01:39:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.883+0000 7f52e37fe640 1 -- 172.21.15.22:0/3703621790 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52f00aa590 con 0x55b9d45fd9a0 2024-08-20T01:39:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.883+0000 7f52e37fe640 1 -- 172.21.15.22:0/3703621790 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f0005600 con 0x55b9d45fd9a0 2024-08-20T01:39:56.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.883+0000 7f5302e5a740 1 -- 172.21.15.22:0/3703621790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 msgr2=0x55b9d45fe2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:56.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.883+0000 7f5302e5a740 1 --2- 172.21.15.22:0/3703621790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d45fe2c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f52f000e940 tx=0x7f52f00a6340 comp rx=0 tx=0).stop 2024-08-20T01:39:56.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.883+0000 7f5302e5a740 1 -- 172.21.15.22:0/3703621790 shutdown_connections 2024-08-20T01:39:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.883+0000 7f5302e5a740 1 --2- 172.21.15.22:0/3703621790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d45fe2c0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.883+0000 7f5302e5a740 1 --2- 172.21.15.22:0/3703621790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 0x55b9d45fdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.883+0000 7f5302e5a740 1 --2- 172.21.15.22:0/3703621790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 0x55b9d4600f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.883+0000 7f5302e5a740 1 -- 172.21.15.22:0/3703621790 >> 172.21.15.22:0/3703621790 conn(0x55b9d45f3730 msgr2=0x55b9d45f3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.883+0000 7f5302e5a740 1 -- 172.21.15.22:0/3703621790 shutdown_connections 2024-08-20T01:39:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.883+0000 7f5302e5a740 1 -- 172.21.15.22:0/3703621790 wait complete. 2024-08-20T01:39:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.884+0000 7f5302e5a740 1 -- start start 2024-08-20T01:39:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.884+0000 7f5302e5a740 1 Processor -- start 2024-08-20T01:39:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.884+0000 7f5302e5a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 0x55b9d4606950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.884+0000 7f5302e5a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 0x55b9d4606ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.884+0000 7f5302e5a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d46079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.884+0000 7f5302e5a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f52f81a83a0 con 0x55b9d45fd9a0 2024-08-20T01:39:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.884+0000 7f5302e5a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52f81a9810 con 0x55b9d45faf60 2024-08-20T01:39:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.884+0000 7f5302e5a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52f81a8a70 con 0x55b9d45f8630 2024-08-20T01:39:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.884+0000 7f5302e5a740 10 client.0 _ll_register_callbacks cb 0x7f52f0004e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.884+0000 7f52fe5fd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d46079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.884+0000 7f52fddfc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 0x55b9d4606950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.884+0000 7f52fe5fd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d46079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45610/0 (socket says 172.21.15.22:45610) 2024-08-20T01:39:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.884+0000 7f52fd5fb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 0x55b9d4606ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.884+0000 7f52fe5fd640 1 -- 172.21.15.22:0/1309615304 learned_addr learned my addr 172.21.15.22:0/1309615304 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:39:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.885+0000 7f52fe5fd640 1 -- 172.21.15.22:0/1309615304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 msgr2=0x55b9d4606950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.885+0000 7f52fe5fd640 1 --2- 172.21.15.22:0/1309615304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 0x55b9d4606950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.885+0000 7f52fe5fd640 1 -- 172.21.15.22:0/1309615304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 msgr2=0x55b9d4606ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.885+0000 7f52fe5fd640 1 --2- 172.21.15.22:0/1309615304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 0x55b9d4606ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.885+0000 7f52fe5fd640 1 -- 172.21.15.22:0/1309615304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9d4608220 con 0x55b9d45fd9a0 2024-08-20T01:39:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.885+0000 7f52fddfc640 1 --2- 172.21.15.22:0/1309615304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 0x55b9d4606950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.885+0000 7f52fe5fd640 1 --2- 172.21.15.22:0/1309615304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d46079f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f52f00aac40 tx=0x7f52f0009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4582c3a581eb8c3d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.885+0000 7f52e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:39:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.885+0000 7f52e17fa640 1 -- 172.21.15.22:0/1309615304 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f001c070 con 0x55b9d45fd9a0 2024-08-20T01:39:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.885+0000 7f52e17fa640 1 -- 172.21.15.22:0/1309615304 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f52f00a9ef0 con 0x55b9d45fd9a0 2024-08-20T01:39:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.885+0000 7f5302e5a740 1 -- 172.21.15.22:0/1309615304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52f00aa590 con 0x55b9d45fd9a0 2024-08-20T01:39:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.885+0000 7f52e17fa640 1 -- 172.21.15.22:0/1309615304 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f52f00af080 con 0x55b9d45fd9a0 2024-08-20T01:39:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.885+0000 7f5302e5a740 10 client.16905 fetch_fsmap learned FSMap version 31 2024-08-20T01:39:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.885+0000 7f5302e5a740 1 -- 172.21.15.22:0/1309615304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b9d4608220 con 0x55b9d45fd9a0 2024-08-20T01:39:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.885+0000 7f52e17fa640 1 -- 172.21.15.22:0/1309615304 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52f00aa590 con 0x55b9d45fd9a0 2024-08-20T01:39:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.885+0000 7f52e17fa640 1 -- 172.21.15.22:0/1309615304 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f52f00a98c0 con 0x55b9d45fd9a0 2024-08-20T01:39:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.886+0000 7f5302e5a740 10 client.16905 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:39:56.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.886+0000 7f5302e5a740 10 client.16905 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:39:56.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.886+0000 7f5302e5a740 20 client.16905 populate_metadata read hostname 'smithi022' 2024-08-20T01:39:56.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.886+0000 7f5302e5a740 1 --2- 172.21.15.22:0/1309615304 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55b9d4609b00 0x55b9d467a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:56.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.886+0000 7f5302e5a740 4 client.16905 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:39:56.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.886+0000 7f5302e5a740 1 -- 172.21.15.22:0/1309615304 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b9d4568d50 con 0x55b9d4609b00 2024-08-20T01:39:56.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.886+0000 7f52fddfc640 1 --2- 172.21.15.22:0/1309615304 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55b9d4609b00 0x55b9d467a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:56.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.886+0000 7f52fddfc640 1 --2- 172.21.15.22:0/1309615304 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55b9d4609b00 0x55b9d467a380 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fa119ae94b868df server_cookie=d5a0414341bbd3a1 in_seq=0 out_seq=0 2024-08-20T01:39:56.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.886+0000 7f52e17fa640 10 client.16905 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.941+0000 7f52e17fa640 1 -- 172.21.15.22:0/1309615304 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b9d4568d50 con 0x55b9d4609b00 2024-08-20T01:39:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.941+0000 7f52e17fa640 10 client.16905 handle_command_reply: tid=0 2024-08-20T01:39:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.941+0000 7f5302e5a740 1 client.16905 shutdown 2024-08-20T01:39:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.941+0000 7f5302e5a740 1 -- 172.21.15.22:0/1309615304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 msgr2=0x55b9d46079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.941+0000 7f5302e5a740 1 --2- 172.21.15.22:0/1309615304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d46079f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f52f00aac40 tx=0x7f52f0009620 comp rx=0 tx=0).stop 2024-08-20T01:39:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.941+0000 7f5302e5a740 1 -- 172.21.15.22:0/1309615304 shutdown_connections 2024-08-20T01:39:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.941+0000 7f5302e5a740 1 --2- 172.21.15.22:0/1309615304 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55b9d4609b00 0x55b9d467a380 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.941+0000 7f5302e5a740 1 --2- 172.21.15.22:0/1309615304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9d45fd9a0 0x55b9d46079f0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.941+0000 7f5302e5a740 1 --2- 172.21.15.22:0/1309615304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b9d45faf60 0x55b9d4606ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.941+0000 7f52e17fa640 0 client.16905 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:39:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.941+0000 7f5302e5a740 1 --2- 172.21.15.22:0/1309615304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9d45f8630 0x55b9d4606950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.941+0000 7f5302e5a740 1 -- 172.21.15.22:0/1309615304 >> 172.21.15.22:0/1309615304 conn(0x55b9d45f3730 msgr2=0x55b9d45f2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.941+0000 7f5302e5a740 1 -- 172.21.15.22:0/1309615304 shutdown_connections 2024-08-20T01:39:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.941+0000 7f5302e5a740 1 -- 172.21.15.22:0/1309615304 wait complete. 2024-08-20T01:39:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.941+0000 7f5302e5a740 20 client.16905 trim_cache size 0 max 16384 2024-08-20T01:39:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:39:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:39:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:39:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:39:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.942+0000 7f5300060640 1 -- 172.21.15.22:0/1816052902 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f52e40b3bd0 msgr2=0x7f52e40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.942+0000 7f5300060640 1 --2- 172.21.15.22:0/1816052902 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f52e40b3bd0 0x7f52e40b6090 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009ca0 tx=0x7f52f40093d0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.942+0000 7f5300060640 1 -- 172.21.15.22:0/1816052902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52f8104190 msgr2=0x7f52f8199d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.942+0000 7f5300060640 1 --2- 172.21.15.22:0/1816052902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52f8104190 0x7f52f8199d20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f52f000e970 tx=0x7f52f000ee30 comp rx=0 tx=0).stop 2024-08-20T01:39:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.942+0000 7f5300060640 1 -- 172.21.15.22:0/1816052902 shutdown_connections 2024-08-20T01:39:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.942+0000 7f5300060640 1 --2- 172.21.15.22:0/1816052902 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f52e40b3bd0 0x7f52e40b6090 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.942+0000 7f5300060640 1 --2- 172.21.15.22:0/1816052902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52f8104190 0x7f52f8199d20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.942+0000 7f5300060640 1 --2- 172.21.15.22:0/1816052902 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52f81037d0 0x7f52f81990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.942+0000 7f5300060640 1 --2- 172.21.15.22:0/1816052902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52f8102680 0x7f52f8198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.942+0000 7f5300060640 1 -- 172.21.15.22:0/1816052902 >> 172.21.15.22:0/1816052902 conn(0x7f52f80fdf40 msgr2=0x7f52f8106b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.942+0000 7f5300060640 1 -- 172.21.15.22:0/1816052902 shutdown_connections 2024-08-20T01:39:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:39:56.942+0000 7f5300060640 1 -- 172.21.15.22:0/1816052902 wait complete. 2024-08-20T01:39:57.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:56 smithi134 ceph-mon[22511]: pgmap v610: 97 pgs: 97 active+clean; 1.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 1.16k op/s 2024-08-20T01:39:57.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:56 smithi077 ceph-mon[22251]: pgmap v610: 97 pgs: 97 active+clean; 1.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 1.16k op/s 2024-08-20T01:39:57.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:56 smithi022 ceph-mon[18709]: pgmap v610: 97 pgs: 97 active+clean; 1.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 1.16k op/s 2024-08-20T01:39:58.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:57 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:58.064 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:57 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:58.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:57 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:59.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:39:58 smithi134 ceph-mon[22511]: pgmap v611: 97 pgs: 97 active+clean; 1.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 2.7 MiB/s wr, 2.96k op/s 2024-08-20T01:39:59.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:39:58 smithi077 ceph-mon[22251]: pgmap v611: 97 pgs: 97 active+clean; 1.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 2.7 MiB/s wr, 2.96k op/s 2024-08-20T01:39:59.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:39:58 smithi022 ceph-mon[18709]: pgmap v611: 97 pgs: 97 active+clean; 1.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 2.7 MiB/s wr, 2.96k op/s 2024-08-20T01:40:01.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:00 smithi077 ceph-mon[22251]: pgmap v612: 97 pgs: 97 active+clean; 1.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.7 MiB/s wr, 3.43k op/s 2024-08-20T01:40:01.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:00 smithi077 ceph-mon[22251]: overall HEALTH_OK 2024-08-20T01:40:01.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:00 smithi022 ceph-mon[18709]: pgmap v612: 97 pgs: 97 active+clean; 1.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.7 MiB/s wr, 3.43k op/s 2024-08-20T01:40:01.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:00 smithi022 ceph-mon[18709]: overall HEALTH_OK 2024-08-20T01:40:01.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:00 smithi134 ceph-mon[22511]: pgmap v612: 97 pgs: 97 active+clean; 1.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.7 MiB/s wr, 3.43k op/s 2024-08-20T01:40:01.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:00 smithi134 ceph-mon[22511]: overall HEALTH_OK 2024-08-20T01:40:02.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:02 smithi022 ceph-mon[18709]: pgmap v613: 97 pgs: 97 active+clean; 1.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 2.5 MiB/s wr, 3.45k op/s 2024-08-20T01:40:03.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:02 smithi077 ceph-mon[22251]: pgmap v613: 97 pgs: 97 active+clean; 1.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 2.5 MiB/s wr, 3.45k op/s 2024-08-20T01:40:03.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:02 smithi134 ceph-mon[22511]: pgmap v613: 97 pgs: 97 active+clean; 1.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 2.5 MiB/s wr, 3.45k op/s 2024-08-20T01:40:04.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:03 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:40:04.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:03 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:40:04.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:03 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:40:04.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:03 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:40:04.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:03 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:40:04.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:03 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:40:04.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:03 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:40:04.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:03 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:40:04.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:03 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:40:05.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:04 smithi077 ceph-mon[22251]: pgmap v614: 97 pgs: 97 active+clean; 1.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.4 MiB/s wr, 3.46k op/s 2024-08-20T01:40:05.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:04 smithi022 ceph-mon[18709]: pgmap v614: 97 pgs: 97 active+clean; 1.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.4 MiB/s wr, 3.46k op/s 2024-08-20T01:40:05.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:04 smithi134 ceph-mon[22511]: pgmap v614: 97 pgs: 97 active+clean; 1.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.4 MiB/s wr, 3.46k op/s 2024-08-20T01:40:07.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:06 smithi077 ceph-mon[22251]: pgmap v615: 97 pgs: 97 active+clean; 1.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.7 MiB/s wr, 2.78k op/s 2024-08-20T01:40:07.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:06 smithi022 ceph-mon[18709]: pgmap v615: 97 pgs: 97 active+clean; 1.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.7 MiB/s wr, 2.78k op/s 2024-08-20T01:40:07.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:06 smithi134 ceph-mon[22511]: pgmap v615: 97 pgs: 97 active+clean; 1.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.7 MiB/s wr, 2.78k op/s 2024-08-20T01:40:09.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:08 smithi077 ceph-mon[22251]: pgmap v616: 97 pgs: 97 active+clean; 1.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.2 MiB/s wr, 2.74k op/s 2024-08-20T01:40:09.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:08 smithi022 ceph-mon[18709]: pgmap v616: 97 pgs: 97 active+clean; 1.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.2 MiB/s wr, 2.74k op/s 2024-08-20T01:40:09.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:08 smithi134 ceph-mon[22511]: pgmap v616: 97 pgs: 97 active+clean; 1.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.2 MiB/s wr, 2.74k op/s 2024-08-20T01:40:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.031+0000 7fa3da3eb640 1 -- 172.21.15.22:0/1686341141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3d4101560 msgr2=0x7fa3d4101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.031+0000 7fa3da3eb640 1 --2- 172.21.15.22:0/1686341141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3d4101560 0x7fa3d4101960 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4009930 tx=0x7fa3c402a420 comp rx=0 tx=0).stop 2024-08-20T01:40:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.031+0000 7fa3da3eb640 1 -- 172.21.15.22:0/1686341141 shutdown_connections 2024-08-20T01:40:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.031+0000 7fa3da3eb640 1 --2- 172.21.15.22:0/1686341141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3d4103070 0x7fa3d41099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.031+0000 7fa3da3eb640 1 --2- 172.21.15.22:0/1686341141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3d41026b0 0x7fa3d4102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.031+0000 7fa3da3eb640 1 --2- 172.21.15.22:0/1686341141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3d4101560 0x7fa3d4101960 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.031+0000 7fa3da3eb640 1 -- 172.21.15.22:0/1686341141 >> 172.21.15.22:0/1686341141 conn(0x7fa3d40fce40 msgr2=0x7fa3d40ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:10.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.031+0000 7fa3da3eb640 1 -- 172.21.15.22:0/1686341141 shutdown_connections 2024-08-20T01:40:10.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.031+0000 7fa3da3eb640 1 -- 172.21.15.22:0/1686341141 wait complete. 2024-08-20T01:40:10.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.031+0000 7fa3da3eb640 1 Processor -- start 2024-08-20T01:40:10.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.031+0000 7fa3da3eb640 1 -- start start 2024-08-20T01:40:10.036 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.032+0000 7fa3da3eb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3d4101560 0x7fa3d406ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:10.036 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.032+0000 7fa3da3eb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3d41026b0 0x7fa3d419d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:10.036 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.032+0000 7fa3da3eb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3d4103070 0x7fa3d419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:10.036 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.032+0000 7fa3da3eb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d410d1e0 con 0x7fa3d4101560 2024-08-20T01:40:10.036 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.032+0000 7fa3da3eb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d410d060 con 0x7fa3d41026b0 2024-08-20T01:40:10.036 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.032+0000 7fa3da3eb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d410d360 con 0x7fa3d4103070 2024-08-20T01:40:10.036 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.032+0000 7fa3d3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3d4101560 0x7fa3d406ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:10.036 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.032+0000 7fa3d3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3d4101560 0x7fa3d406ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47448/0 (socket says 172.21.15.22:47448) 2024-08-20T01:40:10.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.032+0000 7fa3d3fff640 1 -- 172.21.15.22:0/1379571469 learned_addr learned my addr 172.21.15.22:0/1379571469 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:10.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.032+0000 7fa3d37fe640 1 --2- 172.21.15.22:0/1379571469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3d41026b0 0x7fa3d419d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:10.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.032+0000 7fa3d8988640 1 --2- 172.21.15.22:0/1379571469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3d4103070 0x7fa3d419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:10.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.032+0000 7fa3d3fff640 1 -- 172.21.15.22:0/1379571469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3d4103070 msgr2=0x7fa3d419fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:10.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.032+0000 7fa3d3fff640 1 --2- 172.21.15.22:0/1379571469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3d4103070 0x7fa3d419fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.032+0000 7fa3d3fff640 1 -- 172.21.15.22:0/1379571469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3d41026b0 msgr2=0x7fa3d419d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:10.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.032+0000 7fa3d3fff640 1 --2- 172.21.15.22:0/1379571469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3d41026b0 0x7fa3d419d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.032+0000 7fa3d3fff640 1 -- 172.21.15.22:0/1379571469 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d41a06a0 con 0x7fa3d4101560 2024-08-20T01:40:10.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.032+0000 7fa3d37fe640 1 --2- 172.21.15.22:0/1379571469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3d41026b0 0x7fa3d419d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:10.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.032+0000 7fa3d3fff640 1 --2- 172.21.15.22:0/1379571469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3d4101560 0x7fa3d406ae80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4009a50 tx=0x7fa3c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:10.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.033+0000 7fa3d17fa640 1 -- 172.21.15.22:0/1379571469 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c403f030 con 0x7fa3d4101560 2024-08-20T01:40:10.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.033+0000 7fa3da3eb640 1 -- 172.21.15.22:0/1379571469 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d41a0930 con 0x7fa3d4101560 2024-08-20T01:40:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.033+0000 7fa3d17fa640 1 -- 172.21.15.22:0/1379571469 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3c4003cb0 con 0x7fa3d4101560 2024-08-20T01:40:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.033+0000 7fa3d17fa640 1 -- 172.21.15.22:0/1379571469 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4035070 con 0x7fa3d4101560 2024-08-20T01:40:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.033+0000 7fa3da3eb640 1 -- 172.21.15.22:0/1379571469 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d41a0e70 con 0x7fa3d4101560 2024-08-20T01:40:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3dd1dd740 1 Processor -- start 2024-08-20T01:40:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3dd1dd740 1 -- start start 2024-08-20T01:40:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3dd1dd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d2630 0x562a467d4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3dd1dd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d4f60 0x562a467d7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3dd1dd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d79a0 0x562a467d9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3dd1dd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562a46745360 con 0x562a467d79a0 2024-08-20T01:40:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3dd1dd740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562a46734860 con 0x562a467d4f60 2024-08-20T01:40:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3dd1dd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562a467388a0 con 0x562a467d2630 2024-08-20T01:40:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3d37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d79a0 0x562a467d9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3d37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d79a0 0x562a467d9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47452/0 (socket says 172.21.15.22:47452) 2024-08-20T01:40:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3d37fe640 1 -- 172.21.15.22:0/3136980683 learned_addr learned my addr 172.21.15.22:0/3136980683 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3d17fa640 1 -- 172.21.15.22:0/1379571469 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa3c4042030 con 0x7fa3d4101560 2024-08-20T01:40:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3d8988640 1 --2- 172.21.15.22:0/3136980683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d2630 0x562a467d4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3d3fff640 1 --2- 172.21.15.22:0/3136980683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d4f60 0x562a467d7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3d37fe640 1 -- 172.21.15.22:0/3136980683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d2630 msgr2=0x562a467d4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3d37fe640 1 --2- 172.21.15.22:0/3136980683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d2630 0x562a467d4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3d37fe640 1 -- 172.21.15.22:0/3136980683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d4f60 msgr2=0x562a467d7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3d37fe640 1 --2- 172.21.15.22:0/3136980683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d4f60 0x562a467d7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3d37fe640 1 -- 172.21.15.22:0/3136980683 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a466dbe40 con 0x562a467d79a0 2024-08-20T01:40:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.036+0000 7fa3d3fff640 1 --2- 172.21.15.22:0/3136980683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d4f60 0x562a467d7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.037+0000 7fa3d37fe640 1 --2- 172.21.15.22:0/3136980683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d79a0 0x562a467d9e60 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80104d0 tx=0x7fa3c8010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f5109654594a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.037+0000 7fa3ba7fc640 1 -- 172.21.15.22:0/3136980683 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8011760 con 0x562a467d79a0 2024-08-20T01:40:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.037+0000 7fa3ba7fc640 1 -- 172.21.15.22:0/3136980683 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3c8011db0 con 0x562a467d79a0 2024-08-20T01:40:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.037+0000 7fa3ba7fc640 1 -- 172.21.15.22:0/3136980683 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c801ce10 con 0x562a467d79a0 2024-08-20T01:40:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.037+0000 7fa3d17fa640 1 --2- 172.21.15.22:0/1379571469 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa3bc0b3bd0 0x7fa3bc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.037+0000 7fa3d8988640 1 --2- 172.21.15.22:0/1379571469 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa3bc0b3bd0 0x7fa3bc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.037+0000 7fa3d17fa640 1 -- 172.21.15.22:0/1379571469 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fa3c4104640 con 0x7fa3d4101560 2024-08-20T01:40:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.038+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/3136980683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d79a0 msgr2=0x562a467d9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.038+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/3136980683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d79a0 0x562a467d9e60 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80104d0 tx=0x7fa3c8010990 comp rx=0 tx=0).stop 2024-08-20T01:40:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.038+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/3136980683 shutdown_connections 2024-08-20T01:40:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.038+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/3136980683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d79a0 0x562a467d9e60 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.038+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/3136980683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d4f60 0x562a467d7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.038+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/3136980683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d2630 0x562a467d4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.038+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/3136980683 >> 172.21.15.22:0/3136980683 conn(0x562a467cd730 msgr2=0x562a467ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.038+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/3136980683 shutdown_connections 2024-08-20T01:40:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.038+0000 7fa3d8988640 1 --2- 172.21.15.22:0/1379571469 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa3bc0b3bd0 0x7fa3bc0b6090 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc005fd0 tx=0x7fa3cc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.038+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/3136980683 wait complete. 2024-08-20T01:40:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.038+0000 7fa3dd1dd740 1 -- start start 2024-08-20T01:40:10.049 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.038+0000 7fa3dd1dd740 1 Processor -- start 2024-08-20T01:40:10.049 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.038+0000 7fa3dd1dd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 0x562a467dbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:10.049 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.038+0000 7fa3dd1dd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d4f60 0x562a467dc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:10.049 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3dd1dd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d79a0 0x562a467dd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:10.049 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3dd1dd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562a4666dab0 con 0x562a467d2630 2024-08-20T01:40:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3dd1dd740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562a466bb780 con 0x562a467d4f60 2024-08-20T01:40:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3dd1dd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562a467da980 con 0x562a467d79a0 2024-08-20T01:40:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3dd1dd740 10 client.0 _ll_register_callbacks cb 0x562a46443a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3d3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 0x562a467dbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3d3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 0x562a467dbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47456/0 (socket says 172.21.15.22:47456) 2024-08-20T01:40:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3d3fff640 1 -- 172.21.15.22:0/2804057862 learned_addr learned my addr 172.21.15.22:0/2804057862 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3d37fe640 1 --2- 172.21.15.22:0/2804057862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d4f60 0x562a467dc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3d8988640 1 --2- 172.21.15.22:0/2804057862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d79a0 0x562a467dd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3d3fff640 1 -- 172.21.15.22:0/2804057862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d79a0 msgr2=0x562a467dd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3d3fff640 1 --2- 172.21.15.22:0/2804057862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d79a0 0x562a467dd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3d3fff640 1 -- 172.21.15.22:0/2804057862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d4f60 msgr2=0x562a467dc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3d3fff640 1 --2- 172.21.15.22:0/2804057862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d4f60 0x562a467dc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3d3fff640 1 -- 172.21.15.22:0/2804057862 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a46497790 con 0x562a467d2630 2024-08-20T01:40:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3d8988640 1 --2- 172.21.15.22:0/2804057862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d79a0 0x562a467dd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3d3fff640 1 --2- 172.21.15.22:0/2804057862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 0x562a467dbeb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40c75d0 tx=0x7fa3c40cad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f7bc4fe6fb1411 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:40:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3b37fe640 1 -- 172.21.15.22:0/2804057862 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4049040 con 0x562a467d2630 2024-08-20T01:40:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3b37fe640 1 -- 172.21.15.22:0/2804057862 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fa3c40c77e0 con 0x562a467d2630 2024-08-20T01:40:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2804057862 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562a466e3e00 con 0x562a467d2630 2024-08-20T01:40:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3b37fe640 1 -- 172.21.15.22:0/2804057862 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa3c4004460 con 0x562a467d2630 2024-08-20T01:40:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3dd1dd740 10 client.16917 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.039+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2804057862 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562a46510620 con 0x562a467d2630 2024-08-20T01:40:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.040+0000 7fa3b37fe640 1 -- 172.21.15.22:0/2804057862 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562a466e3e00 con 0x562a467d2630 2024-08-20T01:40:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.040+0000 7fa3b37fe640 1 -- 172.21.15.22:0/2804057862 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fa3c40cb7b0 con 0x562a467d2630 2024-08-20T01:40:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.040+0000 7fa3dd1dd740 10 client.16917 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.040+0000 7fa3dd1dd740 10 client.16917 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:40:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.040+0000 7fa3dd1dd740 20 client.16917 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.040+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/2804057862 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562a467e75e0 0x562a467e9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.040+0000 7fa3dd1dd740 4 client.16917 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.040+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2804057862 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a467472b0 con 0x562a467e75e0 2024-08-20T01:40:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.040+0000 7fa3d37fe640 1 --2- 172.21.15.22:0/2804057862 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562a467e75e0 0x562a467e9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.041+0000 7fa3b37fe640 10 client.16917 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.041+0000 7fa3d37fe640 1 --2- 172.21.15.22:0/2804057862 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562a467e75e0 0x562a467e9a80 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16ca2fbd0cdfdca9 server_cookie=bcf248fd1965a0c8 in_seq=0 out_seq=0 2024-08-20T01:40:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.041+0000 7fa3b37fe640 1 -- 172.21.15.22:0/2804057862 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562a467472b0 con 0x562a467e75e0 2024-08-20T01:40:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.041+0000 7fa3b37fe640 10 client.16917 handle_command_reply: tid=0 2024-08-20T01:40:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.041+0000 7fa3dd1dd740 1 client.16917 shutdown 2024-08-20T01:40:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.042+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2804057862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 msgr2=0x562a467dbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.042+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/2804057862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 0x562a467dbeb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40c75d0 tx=0x7fa3c40cad80 comp rx=0 tx=0).stop 2024-08-20T01:40:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.042+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2804057862 shutdown_connections 2024-08-20T01:40:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.042+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/2804057862 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562a467e75e0 0x562a467e9a80 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.042+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/2804057862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d79a0 0x562a467dd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.042+0000 7fa3b37fe640 0 client.16917 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.042+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/2804057862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d4f60 0x562a467dc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.042+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/2804057862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 0x562a467dbeb0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.042+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2804057862 >> 172.21.15.22:0/2804057862 conn(0x562a467cd730 msgr2=0x562a467cc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.042+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2804057862 shutdown_connections 2024-08-20T01:40:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.042+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2804057862 wait complete. 2024-08-20T01:40:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.042+0000 7fa3dd1dd740 20 client.16917 trim_cache size 0 max 16384 2024-08-20T01:40:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.056+0000 7fa3dd1dd740 1 Processor -- start 2024-08-20T01:40:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.056+0000 7fa3dd1dd740 1 -- start start 2024-08-20T01:40:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3dd1dd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 0x562a467dbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3dd1dd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d4f60 0x562a467dad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3dd1dd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d79a0 0x562a467db2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3dd1dd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d41ac660 con 0x562a467d2630 2024-08-20T01:40:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3dd1dd740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d41a9e70 con 0x562a467d4f60 2024-08-20T01:40:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3dd1dd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d41a7cc0 con 0x562a467d79a0 2024-08-20T01:40:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3d3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 0x562a467dbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3d3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 0x562a467dbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47458/0 (socket says 172.21.15.22:47458) 2024-08-20T01:40:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3d3fff640 1 -- 172.21.15.22:0/2154377183 learned_addr learned my addr 172.21.15.22:0/2154377183 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3d37fe640 1 --2- 172.21.15.22:0/2154377183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d4f60 0x562a467dad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3d8988640 1 --2- 172.21.15.22:0/2154377183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d79a0 0x562a467db2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3d3fff640 1 -- 172.21.15.22:0/2154377183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d79a0 msgr2=0x562a467db2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3d3fff640 1 --2- 172.21.15.22:0/2154377183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d79a0 0x562a467db2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3d3fff640 1 -- 172.21.15.22:0/2154377183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d4f60 msgr2=0x562a467dad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3d3fff640 1 --2- 172.21.15.22:0/2154377183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d4f60 0x562a467dad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3d3fff640 1 -- 172.21.15.22:0/2154377183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a467db9b0 con 0x562a467d2630 2024-08-20T01:40:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3d8988640 1 --2- 172.21.15.22:0/2154377183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d79a0 0x562a467db2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3d37fe640 1 --2- 172.21.15.22:0/2154377183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d4f60 0x562a467dad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3d3fff640 1 --2- 172.21.15.22:0/2154377183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 0x562a467dbc20 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40cb250 tx=0x7fa3c402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470c3f604df9c139 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3b9ffb640 1 -- 172.21.15.22:0/2154377183 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4049070 con 0x562a467d2630 2024-08-20T01:40:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3b9ffb640 1 -- 172.21.15.22:0/2154377183 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3c40cb550 con 0x562a467d2630 2024-08-20T01:40:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.057+0000 7fa3b9ffb640 1 -- 172.21.15.22:0/2154377183 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c403bb90 con 0x562a467d2630 2024-08-20T01:40:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.058+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2154377183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 msgr2=0x562a467dbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.058+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/2154377183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 0x562a467dbc20 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40cb250 tx=0x7fa3c402a420 comp rx=0 tx=0).stop 2024-08-20T01:40:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.058+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2154377183 shutdown_connections 2024-08-20T01:40:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.058+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/2154377183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d79a0 0x562a467db2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.058+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/2154377183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d4f60 0x562a467dad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.058+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/2154377183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 0x562a467dbc20 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.058+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2154377183 >> 172.21.15.22:0/2154377183 conn(0x562a467cd730 msgr2=0x562a467d9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.058+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2154377183 shutdown_connections 2024-08-20T01:40:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.058+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2154377183 wait complete. 2024-08-20T01:40:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.058+0000 7fa3dd1dd740 1 -- start start 2024-08-20T01:40:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.059+0000 7fa3dd1dd740 1 Processor -- start 2024-08-20T01:40:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.059+0000 7fa3dd1dd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 0x562a467d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.059+0000 7fa3dd1dd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d4f60 0x562a467d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.059+0000 7fa3dd1dd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d79a0 0x562a4684e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.059+0000 7fa3dd1dd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d41a8330 con 0x562a467d2630 2024-08-20T01:40:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.059+0000 7fa3dd1dd740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d41a97a0 con 0x562a467d79a0 2024-08-20T01:40:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.059+0000 7fa3dd1dd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d41a8a00 con 0x562a467d4f60 2024-08-20T01:40:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.059+0000 7fa3dd1dd740 10 client.0 _ll_register_callbacks cb 0x7fa3c4009290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.059+0000 7fa3d3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 0x562a467d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.059+0000 7fa3d3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 0x562a467d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47468/0 (socket says 172.21.15.22:47468) 2024-08-20T01:40:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.059+0000 7fa3d3fff640 1 -- 172.21.15.22:0/2627504433 learned_addr learned my addr 172.21.15.22:0/2627504433 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.059+0000 7fa3d8988640 1 --2- 172.21.15.22:0/2627504433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d79a0 0x562a4684e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.059+0000 7fa3d37fe640 1 --2- 172.21.15.22:0/2627504433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d4f60 0x562a467d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.059+0000 7fa3d3fff640 1 -- 172.21.15.22:0/2627504433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d4f60 msgr2=0x562a467d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.059+0000 7fa3d3fff640 1 --2- 172.21.15.22:0/2627504433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d4f60 0x562a467d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.059+0000 7fa3d3fff640 1 -- 172.21.15.22:0/2627504433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d79a0 msgr2=0x562a4684e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.059+0000 7fa3d3fff640 1 --2- 172.21.15.22:0/2627504433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d79a0 0x562a4684e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.059+0000 7fa3d3fff640 1 -- 172.21.15.22:0/2627504433 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a467d2420 con 0x562a467d2630 2024-08-20T01:40:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.060+0000 7fa3d3fff640 1 --2- 172.21.15.22:0/2627504433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 0x562a467d04b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4005ec0 tx=0x7fa3c4005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b365746ac5e92d23 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.060+0000 7fa3b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:40:10.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.060+0000 7fa3b37fe640 1 -- 172.21.15.22:0/2627504433 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4049070 con 0x562a467d2630 2024-08-20T01:40:10.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.060+0000 7fa3b37fe640 1 -- 172.21.15.22:0/2627504433 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fa3c4003a10 con 0x562a467d2630 2024-08-20T01:40:10.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.060+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2627504433 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3c40cb550 con 0x562a467d2630 2024-08-20T01:40:10.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.060+0000 7fa3b37fe640 1 -- 172.21.15.22:0/2627504433 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa3c40cbc50 con 0x562a467d2630 2024-08-20T01:40:10.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.060+0000 7fa3dd1dd740 10 client.16923 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:10.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.060+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2627504433 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562a467ea100 con 0x562a467d2630 2024-08-20T01:40:10.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.060+0000 7fa3b37fe640 1 -- 172.21.15.22:0/2627504433 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3c40cb550 con 0x562a467d2630 2024-08-20T01:40:10.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.060+0000 7fa3b37fe640 1 -- 172.21.15.22:0/2627504433 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fa3c40c6f50 con 0x562a467d2630 2024-08-20T01:40:10.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.060+0000 7fa3dd1dd740 10 client.16923 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:10.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.060+0000 7fa3dd1dd740 10 client.16923 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:40:10.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.060+0000 7fa3dd1dd740 20 client.16923 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:10.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.060+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/2627504433 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562a468562c0 0x562a468586e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:10.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.060+0000 7fa3dd1dd740 4 client.16923 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:40:10.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.060+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2627504433 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562a46742d50 con 0x562a468562c0 2024-08-20T01:40:10.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.060+0000 7fa3d37fe640 1 --2- 172.21.15.22:0/2627504433 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562a468562c0 0x562a468586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:10.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.061+0000 7fa3d37fe640 1 --2- 172.21.15.22:0/2627504433 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562a468562c0 0x562a468586e0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b24a145371d9c7f server_cookie=e92cbfa7cd05de3b in_seq=0 out_seq=0 2024-08-20T01:40:10.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.061+0000 7fa3b37fe640 10 client.16923 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:10.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.075+0000 7fa3b37fe640 1 -- 172.21.15.22:0/2627504433 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562a46742d50 con 0x562a468562c0 2024-08-20T01:40:10.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.075+0000 7fa3b37fe640 10 client.16923 handle_command_reply: tid=0 2024-08-20T01:40:10.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.075+0000 7fa3dd1dd740 1 client.16923 shutdown 2024-08-20T01:40:10.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.076+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2627504433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 msgr2=0x562a467d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:10.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.076+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/2627504433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 0x562a467d04b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4005ec0 tx=0x7fa3c4005b50 comp rx=0 tx=0).stop 2024-08-20T01:40:10.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.076+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2627504433 shutdown_connections 2024-08-20T01:40:10.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.076+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/2627504433 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562a468562c0 0x562a468586e0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.076+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/2627504433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a467d79a0 0x562a4684e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.076+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/2627504433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a467d4f60 0x562a467d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.076+0000 7fa3dd1dd740 1 --2- 172.21.15.22:0/2627504433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a467d2630 0x562a467d04b0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.076+0000 7fa3b37fe640 0 client.16923 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:10.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.076+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2627504433 >> 172.21.15.22:0/2627504433 conn(0x562a467cd730 msgr2=0x562a467d17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:10.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.076+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2627504433 shutdown_connections 2024-08-20T01:40:10.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.076+0000 7fa3dd1dd740 1 -- 172.21.15.22:0/2627504433 wait complete. 2024-08-20T01:40:10.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.076+0000 7fa3dd1dd740 20 client.16923 trim_cache size 0 max 16384 2024-08-20T01:40:10.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:40:10.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:40:10.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:40:10.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:40:10.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.076+0000 7fa3da3eb640 1 -- 172.21.15.22:0/1379571469 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa3bc0b3bd0 msgr2=0x7fa3bc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:10.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.076+0000 7fa3da3eb640 1 --2- 172.21.15.22:0/1379571469 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa3bc0b3bd0 0x7fa3bc0b6090 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc005fd0 tx=0x7fa3cc009500 comp rx=0 tx=0).stop 2024-08-20T01:40:10.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.076+0000 7fa3da3eb640 1 -- 172.21.15.22:0/1379571469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3d4101560 msgr2=0x7fa3d406ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:10.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.076+0000 7fa3da3eb640 1 --2- 172.21.15.22:0/1379571469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3d4101560 0x7fa3d406ae80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4009a50 tx=0x7fa3c40042f0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.077+0000 7fa3da3eb640 1 -- 172.21.15.22:0/1379571469 shutdown_connections 2024-08-20T01:40:10.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.077+0000 7fa3da3eb640 1 --2- 172.21.15.22:0/1379571469 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa3bc0b3bd0 0x7fa3bc0b6090 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.077+0000 7fa3da3eb640 1 --2- 172.21.15.22:0/1379571469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3d4103070 0x7fa3d419fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.077+0000 7fa3da3eb640 1 --2- 172.21.15.22:0/1379571469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3d41026b0 0x7fa3d419d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.077+0000 7fa3da3eb640 1 --2- 172.21.15.22:0/1379571469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3d4101560 0x7fa3d406ae80 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:10.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.077+0000 7fa3da3eb640 1 -- 172.21.15.22:0/1379571469 >> 172.21.15.22:0/1379571469 conn(0x7fa3d40fce40 msgr2=0x7fa3d4105aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:10.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.077+0000 7fa3da3eb640 1 -- 172.21.15.22:0/1379571469 shutdown_connections 2024-08-20T01:40:10.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:10.077+0000 7fa3da3eb640 1 -- 172.21.15.22:0/1379571469 wait complete. 2024-08-20T01:40:11.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:10 smithi077 ceph-mon[22251]: pgmap v617: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 1.00k op/s 2024-08-20T01:40:11.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:10 smithi022 ceph-mon[18709]: pgmap v617: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 1.00k op/s 2024-08-20T01:40:11.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:10 smithi134 ceph-mon[22511]: pgmap v617: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 1.00k op/s 2024-08-20T01:40:13.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:12 smithi077 ceph-mon[22251]: pgmap v618: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 460 op/s 2024-08-20T01:40:13.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:12 smithi022 ceph-mon[18709]: pgmap v618: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 460 op/s 2024-08-20T01:40:13.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:12 smithi134 ceph-mon[22511]: pgmap v618: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 460 op/s 2024-08-20T01:40:15.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:14 smithi077 ceph-mon[22251]: pgmap v619: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 472 op/s 2024-08-20T01:40:15.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:14 smithi022 ceph-mon[18709]: pgmap v619: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 472 op/s 2024-08-20T01:40:15.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:14 smithi134 ceph-mon[22511]: pgmap v619: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 472 op/s 2024-08-20T01:40:17.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:16 smithi077 ceph-mon[22251]: pgmap v620: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 386 op/s 2024-08-20T01:40:17.068 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:16 smithi134 ceph-mon[22511]: pgmap v620: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 386 op/s 2024-08-20T01:40:17.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:16 smithi022 ceph-mon[18709]: pgmap v620: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 386 op/s 2024-08-20T01:40:19.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:18 smithi077 ceph-mon[22251]: pgmap v621: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 467 op/s 2024-08-20T01:40:19.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:18 smithi022 ceph-mon[18709]: pgmap v621: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 467 op/s 2024-08-20T01:40:19.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:18 smithi134 ceph-mon[22511]: pgmap v621: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 467 op/s 2024-08-20T01:40:21.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:20 smithi077 ceph-mon[22251]: pgmap v622: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 399 op/s 2024-08-20T01:40:21.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:20 smithi022 ceph-mon[18709]: pgmap v622: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 399 op/s 2024-08-20T01:40:21.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:20 smithi134 ceph-mon[22511]: pgmap v622: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 399 op/s 2024-08-20T01:40:23.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:22 smithi077 ceph-mon[22251]: pgmap v623: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 389 op/s 2024-08-20T01:40:23.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:22 smithi022 ceph-mon[18709]: pgmap v623: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 389 op/s 2024-08-20T01:40:23.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.195+0000 7f5a62060640 1 -- 172.21.15.22:0/3128091983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a5c1037b0 msgr2=0x7f5a5c103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:23.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.195+0000 7f5a62060640 1 --2- 172.21.15.22:0/3128091983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a5c1037b0 0x7f5a5c103c30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009900 tx=0x7f5a5002a410 comp rx=0 tx=0).stop 2024-08-20T01:40:23.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.195+0000 7f5a62060640 1 -- 172.21.15.22:0/3128091983 shutdown_connections 2024-08-20T01:40:23.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.195+0000 7f5a62060640 1 --2- 172.21.15.22:0/3128091983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a5c104170 0x7f5a5c10aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.195+0000 7f5a62060640 1 --2- 172.21.15.22:0/3128091983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a5c1037b0 0x7f5a5c103c30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.195+0000 7f5a62060640 1 --2- 172.21.15.22:0/3128091983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c102660 0x7f5a5c102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.195+0000 7f5a62060640 1 -- 172.21.15.22:0/3128091983 >> 172.21.15.22:0/3128091983 conn(0x7f5a5c0fdf20 msgr2=0x7f5a5c100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:23.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.195+0000 7f5a62060640 1 -- 172.21.15.22:0/3128091983 shutdown_connections 2024-08-20T01:40:23.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.195+0000 7f5a62060640 1 -- 172.21.15.22:0/3128091983 wait complete. 2024-08-20T01:40:23.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.196+0000 7f5a62060640 1 Processor -- start 2024-08-20T01:40:23.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.196+0000 7f5a62060640 1 -- start start 2024-08-20T01:40:23.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.196+0000 7f5a62060640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a5c102660 0x7f5a5c076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:23.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.196+0000 7f5a62060640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a5c1037b0 0x7f5a5c075270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:23.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.196+0000 7f5a62060640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c104170 0x7f5a5c0757b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:23.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.196+0000 7f5a62060640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c10e2b0 con 0x7f5a5c102660 2024-08-20T01:40:23.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.196+0000 7f5a62060640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c10e130 con 0x7f5a5c1037b0 2024-08-20T01:40:23.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.196+0000 7f5a62060640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c10e430 con 0x7f5a5c104170 2024-08-20T01:40:23.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.197+0000 7f5a5b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a5c102660 0x7f5a5c076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:23.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.197+0000 7f5a5affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a5c1037b0 0x7f5a5c075270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.197+0000 7f5a5b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a5c102660 0x7f5a5c076a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40450/0 (socket says 172.21.15.22:40450) 2024-08-20T01:40:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.197+0000 7f5a5b7fe640 1 -- 172.21.15.22:0/2441223920 learned_addr learned my addr 172.21.15.22:0/2441223920 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.197+0000 7f5a5affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a5c1037b0 0x7f5a5c075270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:44800/0 (socket says 172.21.15.22:44800) 2024-08-20T01:40:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.197+0000 7f5a5bfff640 1 --2- 172.21.15.22:0/2441223920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c104170 0x7f5a5c0757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.197+0000 7f5a5b7fe640 1 -- 172.21.15.22:0/2441223920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c104170 msgr2=0x7f5a5c0757b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.197+0000 7f5a5b7fe640 1 --2- 172.21.15.22:0/2441223920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c104170 0x7f5a5c0757b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.197+0000 7f5a5b7fe640 1 -- 172.21.15.22:0/2441223920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a5c1037b0 msgr2=0x7f5a5c075270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.197+0000 7f5a5b7fe640 1 --2- 172.21.15.22:0/2441223920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a5c1037b0 0x7f5a5c075270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.197+0000 7f5a5b7fe640 1 -- 172.21.15.22:0/2441223920 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5c076020 con 0x7f5a5c102660 2024-08-20T01:40:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.197+0000 7f5a5bfff640 1 --2- 172.21.15.22:0/2441223920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c104170 0x7f5a5c0757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.197+0000 7f5a5b7fe640 1 --2- 172.21.15.22:0/2441223920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a5c102660 0x7f5a5c076a10 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00d950 tx=0x7f5a4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.198+0000 7f5a58ff9640 1 -- 172.21.15.22:0/2441223920 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c017070 con 0x7f5a5c102660 2024-08-20T01:40:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.198+0000 7f5a58ff9640 1 -- 172.21.15.22:0/2441223920 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a4c009c30 con 0x7f5a5c102660 2024-08-20T01:40:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.198+0000 7f5a58ff9640 1 -- 172.21.15.22:0/2441223920 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c00f620 con 0x7f5a5c102660 2024-08-20T01:40:23.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.199+0000 7f5a62060640 1 -- 172.21.15.22:0/2441223920 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a5c1a2b50 con 0x7f5a5c102660 2024-08-20T01:40:23.202 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.199+0000 7f5a62060640 1 -- 172.21.15.22:0/2441223920 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a5c1a2f60 con 0x7f5a5c102660 2024-08-20T01:40:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.202+0000 7f5a58ff9640 1 -- 172.21.15.22:0/2441223920 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5a4c010460 con 0x7f5a5c102660 2024-08-20T01:40:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.206+0000 7f5a64e5c740 1 Processor -- start 2024-08-20T01:40:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.206+0000 7f5a64e5c740 1 -- start start 2024-08-20T01:40:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.206+0000 7f5a58ff9640 1 --2- 172.21.15.22:0/2441223920 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5a440b3cd0 0x7f5a440b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.206+0000 7f5a64e5c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7ab8d0 0x5585cc7adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.206+0000 7f5a64e5c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7ae200 0x5585cc7b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.206+0000 7f5a64e5c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7b0c40 0x5585cc7b3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.206+0000 7f5a64e5c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5585cc71e360 con 0x5585cc7ab8d0 2024-08-20T01:40:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.206+0000 7f5a64e5c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5585cc70d860 con 0x5585cc7b0c40 2024-08-20T01:40:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.206+0000 7f5a64e5c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5585cc7118a0 con 0x5585cc7ae200 2024-08-20T01:40:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.206+0000 7f5a58ff9640 1 -- 172.21.15.22:0/2441223920 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f5a4c0e3600 con 0x7f5a5c102660 2024-08-20T01:40:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.207+0000 7f5a5b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7ab8d0 0x5585cc7adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.207+0000 7f5a5bfff640 1 --2- 172.21.15.22:0/2441223920 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5a440b3cd0 0x7f5a440b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.207+0000 7f5a5b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7ab8d0 0x5585cc7adcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40466/0 (socket says 172.21.15.22:40466) 2024-08-20T01:40:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.207+0000 7f5a5b7fe640 1 -- 172.21.15.22:0/1434358603 learned_addr learned my addr 172.21.15.22:0/1434358603 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.207+0000 7f5a5b7fe640 1 -- 172.21.15.22:0/1434358603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7ae200 msgr2=0x5585cc7b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.207+0000 7f5a5b7fe640 1 --2- 172.21.15.22:0/1434358603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7ae200 0x5585cc7b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.207+0000 7f5a5b7fe640 1 -- 172.21.15.22:0/1434358603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7b0c40 msgr2=0x5585cc7b3100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:40:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.207+0000 7f5a5b7fe640 1 --2- 172.21.15.22:0/1434358603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7b0c40 0x5585cc7b3100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.207+0000 7f5a5b7fe640 1 -- 172.21.15.22:0/1434358603 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585cc6b4e40 con 0x5585cc7ab8d0 2024-08-20T01:40:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.207+0000 7f5a5b7fe640 1 --2- 172.21.15.22:0/1434358603 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7ab8d0 0x5585cc7adcc0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00dfe0 tx=0x7f5a4c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23492bc5248d1d70 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.208+0000 7f5a5bfff640 1 --2- 172.21.15.22:0/2441223920 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5a440b3cd0 0x7f5a440b6190 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5a54005fd0 tx=0x7f5a54009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.208+0000 7f5a41ffb640 1 -- 172.21.15.22:0/1434358603 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c0aa4b0 con 0x5585cc7ab8d0 2024-08-20T01:40:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.208+0000 7f5a41ffb640 1 -- 172.21.15.22:0/1434358603 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a4c0aeab0 con 0x5585cc7ab8d0 2024-08-20T01:40:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.209+0000 7f5a64e5c740 1 -- 172.21.15.22:0/1434358603 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7ab8d0 msgr2=0x5585cc7adcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.209+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/1434358603 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7ab8d0 0x5585cc7adcc0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00dfe0 tx=0x7f5a4c005880 comp rx=0 tx=0).stop 2024-08-20T01:40:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.210+0000 7f5a64e5c740 1 -- 172.21.15.22:0/1434358603 shutdown_connections 2024-08-20T01:40:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.210+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/1434358603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7b0c40 0x5585cc7b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.210+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/1434358603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7ae200 0x5585cc7b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.210+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/1434358603 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7ab8d0 0x5585cc7adcc0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.210+0000 7f5a64e5c740 1 -- 172.21.15.22:0/1434358603 >> 172.21.15.22:0/1434358603 conn(0x5585cc7a6a20 msgr2=0x5585cc7a77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.210+0000 7f5a64e5c740 1 -- 172.21.15.22:0/1434358603 shutdown_connections 2024-08-20T01:40:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.210+0000 7f5a64e5c740 1 -- 172.21.15.22:0/1434358603 wait complete. 2024-08-20T01:40:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.211+0000 7f5a64e5c740 1 -- start start 2024-08-20T01:40:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.211+0000 7f5a64e5c740 1 Processor -- start 2024-08-20T01:40:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.211+0000 7f5a64e5c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7ab8d0 0x5585cc7b5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.212+0000 7f5a64e5c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7ae200 0x5585cc7b5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.212+0000 7f5a5b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7ab8d0 0x5585cc7b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.212+0000 7f5a5b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7ab8d0 0x5585cc7b5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:35786/0 (socket says 172.21.15.22:35786) 2024-08-20T01:40:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.212+0000 7f5a5b7fe640 1 -- 172.21.15.22:0/158474626 learned_addr learned my addr 172.21.15.22:0/158474626 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.212+0000 7f5a5affd640 1 --2- 172.21.15.22:0/158474626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7ae200 0x5585cc7b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.212+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/158474626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7b0c40 0x5585cc7b6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.212+0000 7f5a64e5c740 1 -- 172.21.15.22:0/158474626 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5585cc646ab0 con 0x5585cc7b0c40 2024-08-20T01:40:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.212+0000 7f5a64e5c740 1 -- 172.21.15.22:0/158474626 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5585cc694780 con 0x5585cc7ae200 2024-08-20T01:40:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.212+0000 7f5a64e5c740 1 -- 172.21.15.22:0/158474626 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5585cc7b3bc0 con 0x5585cc7ab8d0 2024-08-20T01:40:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.212+0000 7f5a5bfff640 1 --2- 172.21.15.22:0/158474626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7b0c40 0x5585cc7b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.213+0000 7f5a64e5c740 10 client.0 _ll_register_callbacks cb 0x5585cc41ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.213+0000 7f5a5affd640 1 -- 172.21.15.22:0/158474626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7ab8d0 msgr2=0x5585cc7b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.213+0000 7f5a5affd640 1 --2- 172.21.15.22:0/158474626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7ab8d0 0x5585cc7b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.213+0000 7f5a5affd640 1 -- 172.21.15.22:0/158474626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7b0c40 msgr2=0x5585cc7b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.213+0000 7f5a5affd640 1 --2- 172.21.15.22:0/158474626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7b0c40 0x5585cc7b6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.213+0000 7f5a5affd640 1 -- 172.21.15.22:0/158474626 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585cc470790 con 0x5585cc7ae200 2024-08-20T01:40:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.214+0000 7f5a5affd640 1 --2- 172.21.15.22:0/158474626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7ae200 0x5585cc7b5730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5a50005ab0 tx=0x7f5a50031760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf1d54c5e0df382c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.214+0000 7f5a3affd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:40:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.214+0000 7f5a3affd640 1 -- 172.21.15.22:0/158474626 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50035030 con 0x5585cc7ae200 2024-08-20T01:40:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.214+0000 7f5a3affd640 1 -- 172.21.15.22:0/158474626 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f5a50004040 con 0x5585cc7ae200 2024-08-20T01:40:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.214+0000 7f5a64e5c740 1 -- 172.21.15.22:0/158474626 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5585cc6bce00 con 0x5585cc7ae200 2024-08-20T01:40:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.215+0000 7f5a3affd640 1 -- 172.21.15.22:0/158474626 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5a50004240 con 0x5585cc7ae200 2024-08-20T01:40:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.215+0000 7f5a64e5c740 10 client.26540 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.215+0000 7f5a64e5c740 1 -- 172.21.15.22:0/158474626 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5585cc4e9620 con 0x5585cc7ae200 2024-08-20T01:40:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.215+0000 7f5a3affd640 1 -- 172.21.15.22:0/158474626 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5585cc6bce00 con 0x5585cc7ae200 2024-08-20T01:40:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.215+0000 7f5a3affd640 1 -- 172.21.15.22:0/158474626 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f5a50045470 con 0x5585cc7ae200 2024-08-20T01:40:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.215+0000 7f5a64e5c740 10 client.26540 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.215+0000 7f5a64e5c740 10 client.26540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:40:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.215+0000 7f5a64e5c740 20 client.26540 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.216+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/158474626 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5585cc7c0950 0x5585cc7c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:23.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.216+0000 7f5a64e5c740 4 client.26540 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:23.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.216+0000 7f5a64e5c740 1 -- 172.21.15.22:0/158474626 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585cc7202b0 con 0x5585cc7c0950 2024-08-20T01:40:23.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.216+0000 7f5a5b7fe640 1 --2- 172.21.15.22:0/158474626 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5585cc7c0950 0x5585cc7c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:23.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.217+0000 7f5a5b7fe640 1 --2- 172.21.15.22:0/158474626 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5585cc7c0950 0x5585cc7c2d60 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16ceb4005ddca2b1 server_cookie=4c91de3f46e5d059 in_seq=0 out_seq=0 2024-08-20T01:40:23.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.217+0000 7f5a3affd640 10 client.26540 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.219+0000 7f5a3affd640 1 -- 172.21.15.22:0/158474626 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5585cc7202b0 con 0x5585cc7c0950 2024-08-20T01:40:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.220+0000 7f5a3affd640 10 client.26540 handle_command_reply: tid=0 2024-08-20T01:40:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.220+0000 7f5a64e5c740 1 client.26540 shutdown 2024-08-20T01:40:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.220+0000 7f5a64e5c740 1 -- 172.21.15.22:0/158474626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7ae200 msgr2=0x5585cc7b5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.220+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/158474626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7ae200 0x5585cc7b5730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5a50005ab0 tx=0x7f5a50031760 comp rx=0 tx=0).stop 2024-08-20T01:40:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.220+0000 7f5a64e5c740 1 -- 172.21.15.22:0/158474626 shutdown_connections 2024-08-20T01:40:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.220+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/158474626 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5585cc7c0950 0x5585cc7c2d60 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.220+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/158474626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7b0c40 0x5585cc7b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.220+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/158474626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7ae200 0x5585cc7b5730 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.220+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/158474626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7ab8d0 0x5585cc7b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.220+0000 7f5a64e5c740 1 -- 172.21.15.22:0/158474626 >> 172.21.15.22:0/158474626 conn(0x5585cc7a6a20 msgr2=0x5585cc7a5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.220+0000 7f5a3affd640 0 client.26540 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.220+0000 7f5a64e5c740 1 -- 172.21.15.22:0/158474626 shutdown_connections 2024-08-20T01:40:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.220+0000 7f5a64e5c740 1 -- 172.21.15.22:0/158474626 wait complete. 2024-08-20T01:40:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.220+0000 7f5a64e5c740 20 client.26540 trim_cache size 0 max 16384 2024-08-20T01:40:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.235+0000 7f5a64e5c740 1 Processor -- start 2024-08-20T01:40:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.235+0000 7f5a64e5c740 1 -- start start 2024-08-20T01:40:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.236+0000 7f5a64e5c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7ab8d0 0x5585cc7b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.236+0000 7f5a64e5c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7ae200 0x5585cc7b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.236+0000 7f5a64e5c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7b0c40 0x5585cc7a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.236+0000 7f5a64e5c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c1ae9e0 con 0x5585cc7ab8d0 2024-08-20T01:40:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.236+0000 7f5a64e5c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c1ac1f0 con 0x5585cc7ae200 2024-08-20T01:40:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.236+0000 7f5a64e5c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c1aa040 con 0x5585cc7b0c40 2024-08-20T01:40:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.236+0000 7f5a5b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7ab8d0 0x5585cc7b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.236+0000 7f5a5b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7ab8d0 0x5585cc7b25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40492/0 (socket says 172.21.15.22:40492) 2024-08-20T01:40:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.236+0000 7f5a5b7fe640 1 -- 172.21.15.22:0/346130327 learned_addr learned my addr 172.21.15.22:0/346130327 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.236+0000 7f5a5bfff640 1 --2- 172.21.15.22:0/346130327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7b0c40 0x5585cc7a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.236+0000 7f5a5affd640 1 --2- 172.21.15.22:0/346130327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7ae200 0x5585cc7b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.236+0000 7f5a5affd640 1 -- 172.21.15.22:0/346130327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7b0c40 msgr2=0x5585cc7a52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.236+0000 7f5a5affd640 1 --2- 172.21.15.22:0/346130327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7b0c40 0x5585cc7a52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.236+0000 7f5a5affd640 1 -- 172.21.15.22:0/346130327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7ab8d0 msgr2=0x5585cc7b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.236+0000 7f5a5affd640 1 --2- 172.21.15.22:0/346130327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7ab8d0 0x5585cc7b25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.236+0000 7f5a5affd640 1 -- 172.21.15.22:0/346130327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585cc7b0960 con 0x5585cc7ae200 2024-08-20T01:40:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.236+0000 7f5a5affd640 1 --2- 172.21.15.22:0/346130327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7ae200 0x5585cc7b2af0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5a5002a930 tx=0x7f5a50001e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71c8566be823fc2d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.236+0000 7f5a417fa640 1 -- 172.21.15.22:0/346130327 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50035070 con 0x5585cc7ae200 2024-08-20T01:40:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.236+0000 7f5a417fa640 1 -- 172.21.15.22:0/346130327 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a5004b030 con 0x5585cc7ae200 2024-08-20T01:40:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.237+0000 7f5a417fa640 1 -- 172.21.15.22:0/346130327 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50003aa0 con 0x5585cc7ae200 2024-08-20T01:40:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.237+0000 7f5a64e5c740 1 -- 172.21.15.22:0/346130327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7ae200 msgr2=0x5585cc7b2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.237+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/346130327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7ae200 0x5585cc7b2af0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5a5002a930 tx=0x7f5a50001e50 comp rx=0 tx=0).stop 2024-08-20T01:40:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.237+0000 7f5a64e5c740 1 -- 172.21.15.22:0/346130327 shutdown_connections 2024-08-20T01:40:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.237+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/346130327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7b0c40 0x5585cc7a52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.237+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/346130327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7ae200 0x5585cc7b2af0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.237+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/346130327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7ab8d0 0x5585cc7b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.237+0000 7f5a64e5c740 1 -- 172.21.15.22:0/346130327 >> 172.21.15.22:0/346130327 conn(0x5585cc7a6a20 msgr2=0x5585cc7aae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.237+0000 7f5a64e5c740 1 -- 172.21.15.22:0/346130327 shutdown_connections 2024-08-20T01:40:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.237+0000 7f5a64e5c740 1 -- 172.21.15.22:0/346130327 wait complete. 2024-08-20T01:40:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a64e5c740 1 -- start start 2024-08-20T01:40:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a64e5c740 1 Processor -- start 2024-08-20T01:40:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a64e5c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7ab8d0 0x5585cc7bc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a64e5c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7ae200 0x5585cc7bce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a64e5c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7b0c40 0x5585cc7bb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a64e5c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c1aa6b0 con 0x5585cc7ab8d0 2024-08-20T01:40:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a64e5c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c1abb20 con 0x5585cc7b0c40 2024-08-20T01:40:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a64e5c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c1aad80 con 0x5585cc7ae200 2024-08-20T01:40:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a64e5c740 10 client.0 _ll_register_callbacks cb 0x7f5a50009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a5b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7ab8d0 0x5585cc7bc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a5affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7ae200 0x5585cc7bce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a5b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7ab8d0 0x5585cc7bc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40498/0 (socket says 172.21.15.22:40498) 2024-08-20T01:40:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a5b7fe640 1 -- 172.21.15.22:0/3073989752 learned_addr learned my addr 172.21.15.22:0/3073989752 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a5affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7ae200 0x5585cc7bce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:35794/0 (socket says 172.21.15.22:35794) 2024-08-20T01:40:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a5bfff640 1 --2- 172.21.15.22:0/3073989752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7b0c40 0x5585cc7bb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a5affd640 1 -- 172.21.15.22:0/3073989752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7b0c40 msgr2=0x5585cc7bb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a5affd640 1 --2- 172.21.15.22:0/3073989752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7b0c40 0x5585cc7bb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a5affd640 1 -- 172.21.15.22:0/3073989752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7ab8d0 msgr2=0x5585cc7bc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a5affd640 1 --2- 172.21.15.22:0/3073989752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7ab8d0 0x5585cc7bc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.238+0000 7f5a5affd640 1 -- 172.21.15.22:0/3073989752 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585cc7ae030 con 0x5585cc7ae200 2024-08-20T01:40:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.239+0000 7f5a5affd640 1 --2- 172.21.15.22:0/3073989752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7ae200 0x5585cc7bce30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5a5002a450 tx=0x7f5a50000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ece6577ad95cffb1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.239+0000 7f5a3affd640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:40:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.239+0000 7f5a3affd640 1 -- 172.21.15.22:0/3073989752 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50035050 con 0x5585cc7ae200 2024-08-20T01:40:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.239+0000 7f5a3affd640 1 -- 172.21.15.22:0/3073989752 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f5a50058470 con 0x5585cc7ae200 2024-08-20T01:40:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.239+0000 7f5a64e5c740 1 -- 172.21.15.22:0/3073989752 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a5004b030 con 0x5585cc7ae200 2024-08-20T01:40:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.239+0000 7f5a3affd640 1 -- 172.21.15.22:0/3073989752 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5a50045470 con 0x5585cc7ae200 2024-08-20T01:40:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.239+0000 7f5a64e5c740 10 client.26584 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.239+0000 7f5a64e5c740 1 -- 172.21.15.22:0/3073989752 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5585cc7baa50 con 0x5585cc7ae200 2024-08-20T01:40:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.239+0000 7f5a3affd640 1 -- 172.21.15.22:0/3073989752 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a5004b030 con 0x5585cc7ae200 2024-08-20T01:40:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.239+0000 7f5a3affd640 1 -- 172.21.15.22:0/3073989752 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f5a500607b0 con 0x5585cc7ae200 2024-08-20T01:40:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.239+0000 7f5a64e5c740 10 client.26584 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.239+0000 7f5a64e5c740 10 client.26584 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:40:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.239+0000 7f5a64e5c740 20 client.26584 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.239+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/3073989752 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5585cc82ba90 0x5585cc82deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.239+0000 7f5a64e5c740 4 client.26584 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:40:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.239+0000 7f5a64e5c740 1 -- 172.21.15.22:0/3073989752 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5585cc71bd50 con 0x5585cc82ba90 2024-08-20T01:40:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.240+0000 7f5a5b7fe640 1 --2- 172.21.15.22:0/3073989752 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5585cc82ba90 0x5585cc82deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.240+0000 7f5a5b7fe640 1 --2- 172.21.15.22:0/3073989752 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5585cc82ba90 0x5585cc82deb0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d96810631891663 server_cookie=234b57bac1ac72e9 in_seq=0 out_seq=0 2024-08-20T01:40:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.240+0000 7f5a3affd640 10 client.26584 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:23.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:22 smithi134 ceph-mon[22511]: pgmap v623: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 389 op/s 2024-08-20T01:40:23.337 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:40:23.604 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:40:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.962+0000 7f5a3affd640 1 -- 172.21.15.22:0/3073989752 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5585cc71bd50 con 0x5585cc82ba90 2024-08-20T01:40:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.962+0000 7f5a3affd640 10 client.26584 handle_command_reply: tid=0 2024-08-20T01:40:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.962+0000 7f5a64e5c740 1 client.26584 shutdown 2024-08-20T01:40:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.962+0000 7f5a64e5c740 1 -- 172.21.15.22:0/3073989752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7ae200 msgr2=0x5585cc7bce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.962+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/3073989752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7ae200 0x5585cc7bce30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5a5002a450 tx=0x7f5a50000bc0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.962+0000 7f5a64e5c740 1 -- 172.21.15.22:0/3073989752 shutdown_connections 2024-08-20T01:40:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.962+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/3073989752 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5585cc82ba90 0x5585cc82deb0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.963+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/3073989752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5585cc7b0c40 0x5585cc7bb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.963+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/3073989752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5585cc7ae200 0x5585cc7bce30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.963+0000 7f5a64e5c740 1 --2- 172.21.15.22:0/3073989752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5585cc7ab8d0 0x5585cc7bc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.963+0000 7f5a64e5c740 1 -- 172.21.15.22:0/3073989752 >> 172.21.15.22:0/3073989752 conn(0x5585cc7a6a20 msgr2=0x5585cc7aaa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.963+0000 7f5a3affd640 0 client.26584 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.963+0000 7f5a64e5c740 1 -- 172.21.15.22:0/3073989752 shutdown_connections 2024-08-20T01:40:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.963+0000 7f5a64e5c740 1 -- 172.21.15.22:0/3073989752 wait complete. 2024-08-20T01:40:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.963+0000 7f5a64e5c740 20 client.26584 trim_cache size 0 max 16384 2024-08-20T01:40:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:40:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:40:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:40:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:40:23.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.964+0000 7f5a62060640 1 -- 172.21.15.22:0/2441223920 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5a440b3cd0 msgr2=0x7f5a440b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:23.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.964+0000 7f5a62060640 1 --2- 172.21.15.22:0/2441223920 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5a440b3cd0 0x7f5a440b6190 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5a54005fd0 tx=0x7f5a54009500 comp rx=0 tx=0).stop 2024-08-20T01:40:23.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.964+0000 7f5a62060640 1 -- 172.21.15.22:0/2441223920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a5c102660 msgr2=0x7f5a5c076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:23.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.964+0000 7f5a62060640 1 --2- 172.21.15.22:0/2441223920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a5c102660 0x7f5a5c076a10 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00d950 tx=0x7f5a4c00de10 comp rx=0 tx=0).stop 2024-08-20T01:40:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.964+0000 7f5a62060640 1 -- 172.21.15.22:0/2441223920 shutdown_connections 2024-08-20T01:40:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.964+0000 7f5a62060640 1 --2- 172.21.15.22:0/2441223920 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f5a440b3cd0 0x7f5a440b6190 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.964+0000 7f5a62060640 1 --2- 172.21.15.22:0/2441223920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c104170 0x7f5a5c0757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.964+0000 7f5a62060640 1 --2- 172.21.15.22:0/2441223920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a5c1037b0 0x7f5a5c075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.964+0000 7f5a62060640 1 --2- 172.21.15.22:0/2441223920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a5c102660 0x7f5a5c076a10 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.964+0000 7f5a62060640 1 -- 172.21.15.22:0/2441223920 >> 172.21.15.22:0/2441223920 conn(0x7f5a5c0fdf20 msgr2=0x7f5a5c106ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.964+0000 7f5a62060640 1 -- 172.21.15.22:0/2441223920 shutdown_connections 2024-08-20T01:40:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:23.964+0000 7f5a62060640 1 -- 172.21.15.22:0/2441223920 wait complete. 2024-08-20T01:40:24.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.385+0000 7fa53eae3640 1 -- 172.21.15.22:0/470854249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa538103890 msgr2=0x7fa538103c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:24.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.385+0000 7fa53eae3640 1 --2- 172.21.15.22:0/470854249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa538103890 0x7fa538103c70 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009900 tx=0x7fa52c02a410 comp rx=0 tx=0).stop 2024-08-20T01:40:24.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.385+0000 7fa53eae3640 1 -- 172.21.15.22:0/470854249 shutdown_connections 2024-08-20T01:40:24.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.385+0000 7fa53eae3640 1 --2- 172.21.15.22:0/470854249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa53810ce40 0x7fa53810f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.385+0000 7fa53eae3640 1 --2- 172.21.15.22:0/470854249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa538104290 0x7fa53810c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.385+0000 7fa53eae3640 1 --2- 172.21.15.22:0/470854249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa538103890 0x7fa538103c70 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.385+0000 7fa53eae3640 1 -- 172.21.15.22:0/470854249 >> 172.21.15.22:0/470854249 conn(0x7fa5380fd400 msgr2=0x7fa5380ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.385+0000 7fa53eae3640 1 -- 172.21.15.22:0/470854249 shutdown_connections 2024-08-20T01:40:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.385+0000 7fa53eae3640 1 -- 172.21.15.22:0/470854249 wait complete. 2024-08-20T01:40:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.386+0000 7fa53eae3640 1 Processor -- start 2024-08-20T01:40:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.386+0000 7fa53eae3640 1 -- start start 2024-08-20T01:40:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.386+0000 7fa53eae3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa538103890 0x7fa538101710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.386+0000 7fa53eae3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa538104290 0x7fa538101c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.386+0000 7fa53eae3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa53810ce40 0x7fa538102190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.386+0000 7fa53eae3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa538112a80 con 0x7fa538103890 2024-08-20T01:40:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.386+0000 7fa53eae3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa538112900 con 0x7fa53810ce40 2024-08-20T01:40:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.386+0000 7fa53eae3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa538112c00 con 0x7fa538104290 2024-08-20T01:40:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.386+0000 7fa53c87f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa538103890 0x7fa538101710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:24.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.386+0000 7fa53c87f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa538103890 0x7fa538101710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40514/0 (socket says 172.21.15.22:40514) 2024-08-20T01:40:24.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.386+0000 7fa53c87f640 1 -- 172.21.15.22:0/404726732 learned_addr learned my addr 172.21.15.22:0/404726732 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:24.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.386+0000 7fa537fff640 1 --2- 172.21.15.22:0/404726732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa538104290 0x7fa538101c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:24.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.386+0000 7fa53d080640 1 --2- 172.21.15.22:0/404726732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa53810ce40 0x7fa538102190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:24.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.386+0000 7fa53c87f640 1 -- 172.21.15.22:0/404726732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa538104290 msgr2=0x7fa538101c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:24.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.386+0000 7fa53c87f640 1 --2- 172.21.15.22:0/404726732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa538104290 0x7fa538101c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.386+0000 7fa53c87f640 1 -- 172.21.15.22:0/404726732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa53810ce40 msgr2=0x7fa538102190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:24.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.386+0000 7fa53c87f640 1 --2- 172.21.15.22:0/404726732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa53810ce40 0x7fa538102190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.386+0000 7fa53c87f640 1 -- 172.21.15.22:0/404726732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5381a73d0 con 0x7fa538103890 2024-08-20T01:40:24.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.386+0000 7fa537fff640 1 --2- 172.21.15.22:0/404726732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa538104290 0x7fa538101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:24.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.387+0000 7fa53c87f640 1 --2- 172.21.15.22:0/404726732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa538103890 0x7fa538101710 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa52c005940 tx=0x7fa52c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:24.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.387+0000 7fa535ffb640 1 -- 172.21.15.22:0/404726732 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c03f030 con 0x7fa538103890 2024-08-20T01:40:24.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.387+0000 7fa53eae3640 1 -- 172.21.15.22:0/404726732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5381a7660 con 0x7fa538103890 2024-08-20T01:40:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.387+0000 7fa535ffb640 1 -- 172.21.15.22:0/404726732 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa52c003aa0 con 0x7fa538103890 2024-08-20T01:40:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.387+0000 7fa535ffb640 1 -- 172.21.15.22:0/404726732 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c035070 con 0x7fa538103890 2024-08-20T01:40:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.387+0000 7fa53eae3640 1 -- 172.21.15.22:0/404726732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5381a7b40 con 0x7fa538103890 2024-08-20T01:40:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.390+0000 7fa535ffb640 1 -- 172.21.15.22:0/404726732 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa52c042030 con 0x7fa538103890 2024-08-20T01:40:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.390+0000 7fa540edc740 1 Processor -- start 2024-08-20T01:40:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.390+0000 7fa540edc740 1 -- start start 2024-08-20T01:40:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.390+0000 7fa540edc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b3830 0x558af09b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.390+0000 7fa540edc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09b4150 0x558af09bfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.390+0000 7fa540edc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09c00e0 0x558af09c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.391+0000 7fa540edc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558af092a8e0 con 0x558af09b3830 2024-08-20T01:40:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.391+0000 7fa540edc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558af0919de0 con 0x558af09c00e0 2024-08-20T01:40:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.391+0000 7fa540edc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558af091de20 con 0x558af09b4150 2024-08-20T01:40:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.391+0000 7fa53d080640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b3830 0x558af09b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.391+0000 7fa53c87f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09b4150 0x558af09bfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.391+0000 7fa53d080640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b3830 0x558af09b3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40520/0 (socket says 172.21.15.22:40520) 2024-08-20T01:40:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.391+0000 7fa53d080640 1 -- 172.21.15.22:0/1045707428 learned_addr learned my addr 172.21.15.22:0/1045707428 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.391+0000 7fa537fff640 1 --2- 172.21.15.22:0/1045707428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09c00e0 0x558af09c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.391+0000 7fa53d080640 1 -- 172.21.15.22:0/1045707428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09b4150 msgr2=0x558af09bfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.391+0000 7fa53d080640 1 --2- 172.21.15.22:0/1045707428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09b4150 0x558af09bfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.391+0000 7fa53d080640 1 -- 172.21.15.22:0/1045707428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09c00e0 msgr2=0x558af09c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.391+0000 7fa53d080640 1 --2- 172.21.15.22:0/1045707428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09c00e0 0x558af09c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.391+0000 7fa53d080640 1 -- 172.21.15.22:0/1045707428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af0679650 con 0x558af09b3830 2024-08-20T01:40:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.391+0000 7fa535ffb640 1 --2- 172.21.15.22:0/404726732 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa5280b3bd0 0x7fa5280b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.391+0000 7fa53c87f640 1 --2- 172.21.15.22:0/404726732 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa5280b3bd0 0x7fa5280b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.391+0000 7fa53d080640 1 --2- 172.21.15.22:0/1045707428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b3830 0x558af09b3c10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa53000ae90 tx=0x7fa53000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58cbe706022a3b6a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.391+0000 7fa535ffb640 1 -- 172.21.15.22:0/404726732 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fa52c104080 con 0x7fa538103890 2024-08-20T01:40:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.392+0000 7fa522ffd640 1 -- 172.21.15.22:0/1045707428 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530004d20 con 0x558af09b3830 2024-08-20T01:40:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.392+0000 7fa522ffd640 1 -- 172.21.15.22:0/1045707428 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa530003e20 con 0x558af09b3830 2024-08-20T01:40:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.392+0000 7fa522ffd640 1 -- 172.21.15.22:0/1045707428 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5300108a0 con 0x558af09b3830 2024-08-20T01:40:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.392+0000 7fa53c87f640 1 --2- 172.21.15.22:0/404726732 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa5280b3bd0 0x7fa5280b6090 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa52c0c7060 tx=0x7fa52c107cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.393+0000 7fa540edc740 1 -- 172.21.15.22:0/1045707428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b3830 msgr2=0x558af09b3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.393+0000 7fa540edc740 1 --2- 172.21.15.22:0/1045707428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b3830 0x558af09b3c10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa53000ae90 tx=0x7fa53000f790 comp rx=0 tx=0).stop 2024-08-20T01:40:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.393+0000 7fa540edc740 1 -- 172.21.15.22:0/1045707428 shutdown_connections 2024-08-20T01:40:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.393+0000 7fa540edc740 1 --2- 172.21.15.22:0/1045707428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09c00e0 0x558af09c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.393+0000 7fa540edc740 1 --2- 172.21.15.22:0/1045707428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09b4150 0x558af09bfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.393+0000 7fa540edc740 1 --2- 172.21.15.22:0/1045707428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b3830 0x558af09b3c10 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.393+0000 7fa540edc740 1 -- 172.21.15.22:0/1045707428 >> 172.21.15.22:0/1045707428 conn(0x558af09b1660 msgr2=0x558af09b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.393+0000 7fa540edc740 1 -- 172.21.15.22:0/1045707428 shutdown_connections 2024-08-20T01:40:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.393+0000 7fa540edc740 1 -- 172.21.15.22:0/1045707428 wait complete. 2024-08-20T01:40:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.393+0000 7fa540edc740 1 -- start start 2024-08-20T01:40:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.393+0000 7fa540edc740 1 Processor -- start 2024-08-20T01:40:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.394+0000 7fa540edc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b3830 0x558af09bd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.394+0000 7fa540edc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09b4150 0x558af09bd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.394+0000 7fa540edc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09c00e0 0x558af09bdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.394+0000 7fa540edc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558af077c700 con 0x558af09b3830 2024-08-20T01:40:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.394+0000 7fa540edc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558af08a07c0 con 0x558af09b4150 2024-08-20T01:40:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.394+0000 7fa540edc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558af09c2d90 con 0x558af09c00e0 2024-08-20T01:40:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.394+0000 7fa540edc740 10 client.0 _ll_register_callbacks cb 0x558af09136b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.394+0000 7fa53d080640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b3830 0x558af09bd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.394+0000 7fa53d080640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b3830 0x558af09bd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40528/0 (socket says 172.21.15.22:40528) 2024-08-20T01:40:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.394+0000 7fa53d080640 1 -- 172.21.15.22:0/4117216085 learned_addr learned my addr 172.21.15.22:0/4117216085 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.394+0000 7fa537fff640 1 --2- 172.21.15.22:0/4117216085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09b4150 0x558af09bd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.394+0000 7fa53d080640 1 --2- 172.21.15.22:0/4117216085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09c00e0 0x558af09bdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:24.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.394+0000 7fa53d080640 1 -- 172.21.15.22:0/4117216085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09c00e0 msgr2=0x558af09bdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:24.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.394+0000 7fa53d080640 1 --2- 172.21.15.22:0/4117216085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09c00e0 0x558af09bdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.394+0000 7fa53d080640 1 -- 172.21.15.22:0/4117216085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09b4150 msgr2=0x558af09bd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:24.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.394+0000 7fa53d080640 1 --2- 172.21.15.22:0/4117216085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09b4150 0x558af09bd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.394+0000 7fa53d080640 1 -- 172.21.15.22:0/4117216085 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558af09cc170 con 0x558af09b3830 2024-08-20T01:40:24.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.394+0000 7fa537fff640 1 --2- 172.21.15.22:0/4117216085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09b4150 0x558af09bd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:24.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.395+0000 7fa53d080640 1 --2- 172.21.15.22:0/4117216085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b3830 0x558af09bd080 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa530004550 tx=0x7fa5300046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7254afa4660eed server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:24.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.395+0000 7fa517fff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:40:24.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.395+0000 7fa517fff640 1 -- 172.21.15.22:0/4117216085 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530003b70 con 0x558af09b3830 2024-08-20T01:40:24.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.395+0000 7fa517fff640 1 -- 172.21.15.22:0/4117216085 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fa530003d10 con 0x558af09b3830 2024-08-20T01:40:24.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.395+0000 7fa540edc740 1 -- 172.21.15.22:0/4117216085 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558af08c9100 con 0x558af09b3830 2024-08-20T01:40:24.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.395+0000 7fa517fff640 1 -- 172.21.15.22:0/4117216085 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa530003f10 con 0x558af09b3830 2024-08-20T01:40:24.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.395+0000 7fa540edc740 10 client.16953 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:24.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.395+0000 7fa540edc740 1 -- 172.21.15.22:0/4117216085 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558af09ceb20 con 0x558af09b3830 2024-08-20T01:40:24.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.395+0000 7fa517fff640 1 -- 172.21.15.22:0/4117216085 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558af08c9100 con 0x558af09b3830 2024-08-20T01:40:24.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.395+0000 7fa517fff640 1 -- 172.21.15.22:0/4117216085 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fa530031c20 con 0x558af09b3830 2024-08-20T01:40:24.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.396+0000 7fa540edc740 10 client.16953 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:24.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.396+0000 7fa540edc740 10 client.16953 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:40:24.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.396+0000 7fa540edc740 20 client.16953 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:24.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.396+0000 7fa540edc740 1 --2- 172.21.15.22:0/4117216085 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558af09cfed0 0x558af09d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:24.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.396+0000 7fa540edc740 4 client.16953 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:24.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.396+0000 7fa540edc740 1 -- 172.21.15.22:0/4117216085 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558af092c830 con 0x558af09cfed0 2024-08-20T01:40:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.396+0000 7fa537fff640 1 --2- 172.21.15.22:0/4117216085 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558af09cfed0 0x558af09d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.396+0000 7fa537fff640 1 --2- 172.21.15.22:0/4117216085 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558af09cfed0 0x558af09d22c0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a76c937ef503c2c server_cookie=ab82ff179c698069 in_seq=0 out_seq=0 2024-08-20T01:40:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.396+0000 7fa517fff640 10 client.16953 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.398+0000 7fa517fff640 1 -- 172.21.15.22:0/4117216085 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558af092c830 con 0x558af09cfed0 2024-08-20T01:40:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.398+0000 7fa517fff640 10 client.16953 handle_command_reply: tid=0 2024-08-20T01:40:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.398+0000 7fa540edc740 1 client.16953 shutdown 2024-08-20T01:40:24.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.398+0000 7fa540edc740 1 -- 172.21.15.22:0/4117216085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b3830 msgr2=0x558af09bd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:24.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.398+0000 7fa540edc740 1 --2- 172.21.15.22:0/4117216085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b3830 0x558af09bd080 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa530004550 tx=0x7fa5300046f0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.398+0000 7fa540edc740 1 -- 172.21.15.22:0/4117216085 shutdown_connections 2024-08-20T01:40:24.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.398+0000 7fa540edc740 1 --2- 172.21.15.22:0/4117216085 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558af09cfed0 0x558af09d22c0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.398+0000 7fa540edc740 1 --2- 172.21.15.22:0/4117216085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09c00e0 0x558af09bdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.398+0000 7fa540edc740 1 --2- 172.21.15.22:0/4117216085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09b4150 0x558af09bd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.398+0000 7fa517fff640 0 client.16953 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:24.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.398+0000 7fa540edc740 1 --2- 172.21.15.22:0/4117216085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b3830 0x558af09bd080 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.398+0000 7fa540edc740 1 -- 172.21.15.22:0/4117216085 >> 172.21.15.22:0/4117216085 conn(0x558af09b1660 msgr2=0x558af09b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:24.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.398+0000 7fa540edc740 1 -- 172.21.15.22:0/4117216085 shutdown_connections 2024-08-20T01:40:24.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.398+0000 7fa540edc740 1 -- 172.21.15.22:0/4117216085 wait complete. 2024-08-20T01:40:24.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.398+0000 7fa540edc740 20 client.16953 trim_cache size 0 max 16384 2024-08-20T01:40:24.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.416+0000 7fa540edc740 1 Processor -- start 2024-08-20T01:40:24.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.416+0000 7fa540edc740 1 -- start start 2024-08-20T01:40:24.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.416+0000 7fa540edc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09b3830 0x558af09bc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:24.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.416+0000 7fa540edc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b4150 0x558af09d7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:24.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.416+0000 7fa540edc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09c00e0 0x558af09d7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:24.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.416+0000 7fa540edc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa5381b2d60 con 0x558af09b4150 2024-08-20T01:40:24.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.416+0000 7fa540edc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa5381b0570 con 0x558af09b3830 2024-08-20T01:40:24.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.416+0000 7fa540edc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa5381ae3c0 con 0x558af09c00e0 2024-08-20T01:40:24.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.416+0000 7fa537fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b4150 0x558af09d7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:24.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.416+0000 7fa537fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b4150 0x558af09d7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40542/0 (socket says 172.21.15.22:40542) 2024-08-20T01:40:24.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.416+0000 7fa537fff640 1 -- 172.21.15.22:0/2499157836 learned_addr learned my addr 172.21.15.22:0/2499157836 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:24.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.416+0000 7fa53d080640 1 --2- 172.21.15.22:0/2499157836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09c00e0 0x558af09d7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:24.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.416+0000 7fa53d080640 1 --2- 172.21.15.22:0/2499157836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09b3830 0x558af09bc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:24.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.416+0000 7fa537fff640 1 -- 172.21.15.22:0/2499157836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09c00e0 msgr2=0x558af09d7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:24.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.416+0000 7fa537fff640 1 --2- 172.21.15.22:0/2499157836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09c00e0 0x558af09d7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.416+0000 7fa537fff640 1 -- 172.21.15.22:0/2499157836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09b3830 msgr2=0x558af09bc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:24.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.416+0000 7fa537fff640 1 --2- 172.21.15.22:0/2499157836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09b3830 0x558af09bc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.416+0000 7fa537fff640 1 -- 172.21.15.22:0/2499157836 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af09b3f80 con 0x558af09b4150 2024-08-20T01:40:24.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.416+0000 7fa53d080640 1 --2- 172.21.15.22:0/2499157836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09b3830 0x558af09bc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:24.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.417+0000 7fa537fff640 1 --2- 172.21.15.22:0/2499157836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b4150 0x558af09d7950 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa524004700 tx=0x7fa524005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5704744deecee867 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:24.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.417+0000 7fa5227fc640 1 -- 172.21.15.22:0/2499157836 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5240120d0 con 0x558af09b4150 2024-08-20T01:40:24.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.417+0000 7fa5227fc640 1 -- 172.21.15.22:0/2499157836 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa524012270 con 0x558af09b4150 2024-08-20T01:40:24.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.417+0000 7fa5227fc640 1 -- 172.21.15.22:0/2499157836 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524003d80 con 0x558af09b4150 2024-08-20T01:40:24.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.417+0000 7fa540edc740 1 -- 172.21.15.22:0/2499157836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b4150 msgr2=0x558af09d7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:24.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.417+0000 7fa540edc740 1 --2- 172.21.15.22:0/2499157836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b4150 0x558af09d7950 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa524004700 tx=0x7fa524005f90 comp rx=0 tx=0).stop 2024-08-20T01:40:24.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.418+0000 7fa540edc740 1 -- 172.21.15.22:0/2499157836 shutdown_connections 2024-08-20T01:40:24.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.418+0000 7fa540edc740 1 --2- 172.21.15.22:0/2499157836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09c00e0 0x558af09d7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.418+0000 7fa540edc740 1 --2- 172.21.15.22:0/2499157836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b4150 0x558af09d7950 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.418+0000 7fa540edc740 1 --2- 172.21.15.22:0/2499157836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09b3830 0x558af09bc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.418+0000 7fa540edc740 1 -- 172.21.15.22:0/2499157836 >> 172.21.15.22:0/2499157836 conn(0x558af09b1660 msgr2=0x558af09beed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:24.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.418+0000 7fa540edc740 1 -- 172.21.15.22:0/2499157836 shutdown_connections 2024-08-20T01:40:24.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.418+0000 7fa540edc740 1 -- 172.21.15.22:0/2499157836 wait complete. 2024-08-20T01:40:24.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.418+0000 7fa540edc740 1 -- start start 2024-08-20T01:40:24.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.418+0000 7fa540edc740 1 Processor -- start 2024-08-20T01:40:24.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa540edc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09b3830 0x558af09c3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:24.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa540edc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b4150 0x558af09c3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:24.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa540edc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09c00e0 0x558af0a38910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:24.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa540edc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa5381aea30 con 0x558af09b4150 2024-08-20T01:40:24.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa540edc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa5381afea0 con 0x558af09c00e0 2024-08-20T01:40:24.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa540edc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa5381af100 con 0x558af09b3830 2024-08-20T01:40:24.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa540edc740 10 client.0 _ll_register_callbacks cb 0x7fa524009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:24.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa53d080640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09b3830 0x558af09c3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:24.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa537fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b4150 0x558af09c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:24.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa537fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b4150 0x558af09c3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40556/0 (socket says 172.21.15.22:40556) 2024-08-20T01:40:24.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa537fff640 1 -- 172.21.15.22:0/807048772 learned_addr learned my addr 172.21.15.22:0/807048772 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:24.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa53d080640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09b3830 0x558af09c3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:35842/0 (socket says 172.21.15.22:35842) 2024-08-20T01:40:24.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa53d080640 1 --2- 172.21.15.22:0/807048772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09c00e0 0x558af0a38910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:24.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa537fff640 1 -- 172.21.15.22:0/807048772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09b3830 msgr2=0x558af09c3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:24.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa537fff640 1 --2- 172.21.15.22:0/807048772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09b3830 0x558af09c3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa537fff640 1 -- 172.21.15.22:0/807048772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09c00e0 msgr2=0x558af0a38910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:24.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa537fff640 1 --2- 172.21.15.22:0/807048772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09c00e0 0x558af0a38910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa537fff640 1 -- 172.21.15.22:0/807048772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558af0a38e50 con 0x558af09b4150 2024-08-20T01:40:24.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa53d080640 1 --2- 172.21.15.22:0/807048772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09b3830 0x558af09c3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:24.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa537fff640 1 --2- 172.21.15.22:0/807048772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b4150 0x558af09c3940 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa524012970 tx=0x7fa524012760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6524ea46208f3a3a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:24.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.419+0000 7fa517fff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:40:24.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.420+0000 7fa517fff640 1 -- 172.21.15.22:0/807048772 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524012a20 con 0x558af09b4150 2024-08-20T01:40:24.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.420+0000 7fa517fff640 1 -- 172.21.15.22:0/807048772 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fa524004050 con 0x558af09b4150 2024-08-20T01:40:24.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.420+0000 7fa540edc740 1 -- 172.21.15.22:0/807048772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa524012270 con 0x558af09b4150 2024-08-20T01:40:24.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.420+0000 7fa517fff640 1 -- 172.21.15.22:0/807048772 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa524004250 con 0x558af09b4150 2024-08-20T01:40:24.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.420+0000 7fa540edc740 10 client.16959 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:24.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.420+0000 7fa540edc740 1 -- 172.21.15.22:0/807048772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558af0a39f20 con 0x558af09b4150 2024-08-20T01:40:24.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.420+0000 7fa517fff640 1 -- 172.21.15.22:0/807048772 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa524012270 con 0x558af09b4150 2024-08-20T01:40:24.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.420+0000 7fa517fff640 1 -- 172.21.15.22:0/807048772 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fa52403d440 con 0x558af09b4150 2024-08-20T01:40:24.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.420+0000 7fa540edc740 10 client.16959 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:24.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.420+0000 7fa540edc740 10 client.16959 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:40:24.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.420+0000 7fa540edc740 20 client.16959 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:24.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.420+0000 7fa540edc740 1 --2- 172.21.15.22:0/807048772 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558af0a3a670 0x558af0a3ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:24.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.420+0000 7fa540edc740 4 client.16959 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:40:24.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.420+0000 7fa540edc740 1 -- 172.21.15.22:0/807048772 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558af09282d0 con 0x558af0a3a670 2024-08-20T01:40:24.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.421+0000 7fa53d080640 1 --2- 172.21.15.22:0/807048772 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558af0a3a670 0x558af0a3ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:24.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.421+0000 7fa53d080640 1 --2- 172.21.15.22:0/807048772 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558af0a3a670 0x558af0a3ca90 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=799455ff8ce45f4f server_cookie=fa85e9fff177771c in_seq=0 out_seq=0 2024-08-20T01:40:24.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.421+0000 7fa517fff640 10 client.16959 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:24.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.423+0000 7fa517fff640 1 -- 172.21.15.22:0/807048772 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558af09282d0 con 0x558af0a3a670 2024-08-20T01:40:24.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.423+0000 7fa517fff640 10 client.16959 handle_command_reply: tid=0 2024-08-20T01:40:24.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.423+0000 7fa540edc740 1 client.16959 shutdown 2024-08-20T01:40:24.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.423+0000 7fa540edc740 1 -- 172.21.15.22:0/807048772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b4150 msgr2=0x558af09c3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:24.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.423+0000 7fa540edc740 1 --2- 172.21.15.22:0/807048772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b4150 0x558af09c3940 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa524012970 tx=0x7fa524012760 comp rx=0 tx=0).stop 2024-08-20T01:40:24.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.423+0000 7fa540edc740 1 -- 172.21.15.22:0/807048772 shutdown_connections 2024-08-20T01:40:24.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.423+0000 7fa540edc740 1 --2- 172.21.15.22:0/807048772 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x558af0a3a670 0x558af0a3ca90 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.423+0000 7fa540edc740 1 --2- 172.21.15.22:0/807048772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558af09c00e0 0x558af0a38910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.423+0000 7fa540edc740 1 --2- 172.21.15.22:0/807048772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558af09b4150 0x558af09c3940 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.423+0000 7fa540edc740 1 --2- 172.21.15.22:0/807048772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558af09b3830 0x558af09c3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.423+0000 7fa540edc740 1 -- 172.21.15.22:0/807048772 >> 172.21.15.22:0/807048772 conn(0x558af09b1660 msgr2=0x558af09b69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:24.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.423+0000 7fa517fff640 0 client.16959 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:24.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.423+0000 7fa540edc740 1 -- 172.21.15.22:0/807048772 shutdown_connections 2024-08-20T01:40:24.518 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:40:24.518 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-08-20T01:40:24.518 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-08-20T01:40:24.518 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:40:24.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.423+0000 7fa540edc740 1 -- 172.21.15.22:0/807048772 wait complete. 2024-08-20T01:40:24.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.423+0000 7fa540edc740 20 client.16959 trim_cache size 0 max 16384 2024-08-20T01:40:24.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.424+0000 7fa53eae3640 1 -- 172.21.15.22:0/404726732 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa5280b3bd0 msgr2=0x7fa5280b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:24.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.424+0000 7fa53eae3640 1 --2- 172.21.15.22:0/404726732 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa5280b3bd0 0x7fa5280b6090 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa52c0c7060 tx=0x7fa52c107cd0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.424+0000 7fa53eae3640 1 -- 172.21.15.22:0/404726732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa538103890 msgr2=0x7fa538101710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:24.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.424+0000 7fa53eae3640 1 --2- 172.21.15.22:0/404726732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa538103890 0x7fa538101710 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa52c005940 tx=0x7fa52c004270 comp rx=0 tx=0).stop 2024-08-20T01:40:24.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.424+0000 7fa53eae3640 1 -- 172.21.15.22:0/404726732 shutdown_connections 2024-08-20T01:40:24.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.424+0000 7fa53eae3640 1 --2- 172.21.15.22:0/404726732 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fa5280b3bd0 0x7fa5280b6090 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.424+0000 7fa53eae3640 1 --2- 172.21.15.22:0/404726732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa53810ce40 0x7fa538102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.424+0000 7fa53eae3640 1 --2- 172.21.15.22:0/404726732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa538104290 0x7fa538101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.424+0000 7fa53eae3640 1 --2- 172.21.15.22:0/404726732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa538103890 0x7fa538101710 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:24.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.424+0000 7fa53eae3640 1 -- 172.21.15.22:0/404726732 >> 172.21.15.22:0/404726732 conn(0x7fa5380fd400 msgr2=0x7fa5380fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:24.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.424+0000 7fa53eae3640 1 -- 172.21.15.22:0/404726732 shutdown_connections 2024-08-20T01:40:24.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:24.424+0000 7fa53eae3640 1 -- 172.21.15.22:0/404726732 wait complete. 2024-08-20T01:40:24.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:24 smithi022 ceph-mon[18709]: pgmap v624: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 432 op/s 2024-08-20T01:40:25.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:24 smithi077 ceph-mon[22251]: pgmap v624: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 432 op/s 2024-08-20T01:40:25.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:24 smithi134 ceph-mon[22511]: pgmap v624: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 432 op/s 2024-08-20T01:40:25.337 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:40:25.337 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:40:25.611 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:40:26.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.269+0000 7f05c8264640 1 -- 172.21.15.22:0/1357992565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c010ce00 msgr2=0x7f05c010f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:26.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.269+0000 7f05c8264640 1 --2- 172.21.15.22:0/1357992565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c010ce00 0x7f05c010f260 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f05b8009be0 tx=0x7f05b802a6c0 comp rx=0 tx=0).stop 2024-08-20T01:40:26.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.269+0000 7f05c8264640 1 -- 172.21.15.22:0/1357992565 shutdown_connections 2024-08-20T01:40:26.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.269+0000 7f05c8264640 1 --2- 172.21.15.22:0/1357992565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c010ce00 0x7f05c010f260 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:26.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.269+0000 7f05c8264640 1 --2- 172.21.15.22:0/1357992565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05c01042c0 0x7f05c010c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:26.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.269+0000 7f05c8264640 1 --2- 172.21.15.22:0/1357992565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05c01039a0 0x7f05c0103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:26.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.269+0000 7f05c8264640 1 -- 172.21.15.22:0/1357992565 >> 172.21.15.22:0/1357992565 conn(0x7f05c00fd400 msgr2=0x7f05c00ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:26.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.269+0000 7f05c8264640 1 -- 172.21.15.22:0/1357992565 shutdown_connections 2024-08-20T01:40:26.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.269+0000 7f05c8264640 1 -- 172.21.15.22:0/1357992565 wait complete. 2024-08-20T01:40:26.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.270+0000 7f05c8264640 1 Processor -- start 2024-08-20T01:40:26.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.270+0000 7f05c8264640 1 -- start start 2024-08-20T01:40:26.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.270+0000 7f05c8264640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05c01039a0 0x7f05c0198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:26.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.270+0000 7f05c8264640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c01042c0 0x7f05c01994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:26.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.270+0000 7f05c8264640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05c010ce00 0x7f05c019e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:26.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.270+0000 7f05c8264640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f05c0112a70 con 0x7f05c01042c0 2024-08-20T01:40:26.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.270+0000 7f05c8264640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f05c01128f0 con 0x7f05c010ce00 2024-08-20T01:40:26.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.270+0000 7f05c8264640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f05c0112bf0 con 0x7f05c01039a0 2024-08-20T01:40:26.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.270+0000 7f05c57ff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c01042c0 0x7f05c01994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:26.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.270+0000 7f05c57ff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c01042c0 0x7f05c01994c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40584/0 (socket says 172.21.15.22:40584) 2024-08-20T01:40:26.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.270+0000 7f05c57ff640 1 -- 172.21.15.22:0/2847664996 learned_addr learned my addr 172.21.15.22:0/2847664996 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:26.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.270+0000 7f05c6000640 1 --2- 172.21.15.22:0/2847664996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05c01039a0 0x7f05c0198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:26.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.270+0000 7f05c6801640 1 --2- 172.21.15.22:0/2847664996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05c010ce00 0x7f05c019e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:26.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.270+0000 7f05c57ff640 1 -- 172.21.15.22:0/2847664996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05c01039a0 msgr2=0x7f05c0198f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:26.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.270+0000 7f05c57ff640 1 --2- 172.21.15.22:0/2847664996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05c01039a0 0x7f05c0198f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:26.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.270+0000 7f05c57ff640 1 -- 172.21.15.22:0/2847664996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05c010ce00 msgr2=0x7f05c019e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:26.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.270+0000 7f05c57ff640 1 --2- 172.21.15.22:0/2847664996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05c010ce00 0x7f05c019e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:26.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.270+0000 7f05c57ff640 1 -- 172.21.15.22:0/2847664996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c019f030 con 0x7f05c01042c0 2024-08-20T01:40:26.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.271+0000 7f05c57ff640 1 --2- 172.21.15.22:0/2847664996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c01042c0 0x7f05c01994c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f05b000e9c0 tx=0x7f05b000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:26.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.271+0000 7f05b6ffd640 1 -- 172.21.15.22:0/2847664996 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b000cd80 con 0x7f05c01042c0 2024-08-20T01:40:26.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.271+0000 7f05c8264640 1 -- 172.21.15.22:0/2847664996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c019f320 con 0x7f05c01042c0 2024-08-20T01:40:26.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.271+0000 7f05b6ffd640 1 -- 172.21.15.22:0/2847664996 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05b00108e0 con 0x7f05c01042c0 2024-08-20T01:40:26.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.271+0000 7f05b6ffd640 1 -- 172.21.15.22:0/2847664996 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b00187d0 con 0x7f05c01042c0 2024-08-20T01:40:26.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.271+0000 7f05c8264640 1 -- 172.21.15.22:0/2847664996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c01a59e0 con 0x7f05c01042c0 2024-08-20T01:40:26.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.272+0000 7f05c8264640 1 -- 172.21.15.22:0/2847664996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05c0103d80 con 0x7f05c01042c0 2024-08-20T01:40:26.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.274+0000 7f05b6ffd640 1 -- 172.21.15.22:0/2847664996 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f05b001f020 con 0x7f05c01042c0 2024-08-20T01:40:26.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.274+0000 7f05b6ffd640 1 --2- 172.21.15.22:0/2847664996 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f05ac0b3bd0 0x7f05ac0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:26.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.274+0000 7f05b6ffd640 1 -- 172.21.15.22:0/2847664996 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f05b00e41c0 con 0x7f05c01042c0 2024-08-20T01:40:26.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.274+0000 7f05c6000640 1 --2- 172.21.15.22:0/2847664996 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f05ac0b3bd0 0x7f05ac0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:26.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.275+0000 7f05c6000640 1 --2- 172.21.15.22:0/2847664996 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f05ac0b3bd0 0x7f05ac0b6090 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f05bc00bbe0 tx=0x7f05bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:26.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.277+0000 7f05b6ffd640 1 -- 172.21.15.22:0/2847664996 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f05b00ab7d0 con 0x7f05c01042c0 2024-08-20T01:40:26.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.501+0000 7f05c8264640 1 -- 172.21.15.22:0/2847664996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05c002e340 con 0x7f05c01042c0 2024-08-20T01:40:26.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.501+0000 7f05b6ffd640 1 -- 172.21.15.22:0/2847664996 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11915 (secure 0 0 0) 0x7f05b00ab0d0 con 0x7f05c01042c0 2024-08-20T01:40:26.503 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:40:26.504 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":31,"btime":"2024-08-20T01:36:38:097249+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:36:37.446760+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/3018668202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3018668202},{"type":"v1","addr":"172.21.15.134:6835","nonce":3018668202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24586,24575,24565]},"id":1}]} 2024-08-20T01:40:26.504 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 31 2024-08-20T01:40:26.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.504+0000 7f05c8264640 1 -- 172.21.15.22:0/2847664996 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f05ac0b3bd0 msgr2=0x7f05ac0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:26.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.504+0000 7f05c8264640 1 --2- 172.21.15.22:0/2847664996 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f05ac0b3bd0 0x7f05ac0b6090 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f05bc00bbe0 tx=0x7f05bc00b390 comp rx=0 tx=0).stop 2024-08-20T01:40:26.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.504+0000 7f05c8264640 1 -- 172.21.15.22:0/2847664996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c01042c0 msgr2=0x7f05c01994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:26.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.504+0000 7f05c8264640 1 --2- 172.21.15.22:0/2847664996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c01042c0 0x7f05c01994c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f05b000e9c0 tx=0x7f05b000ee80 comp rx=0 tx=0).stop 2024-08-20T01:40:26.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.504+0000 7f05c8264640 1 -- 172.21.15.22:0/2847664996 shutdown_connections 2024-08-20T01:40:26.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.504+0000 7f05c8264640 1 --2- 172.21.15.22:0/2847664996 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f05ac0b3bd0 0x7f05ac0b6090 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:26.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.504+0000 7f05c8264640 1 --2- 172.21.15.22:0/2847664996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05c010ce00 0x7f05c019e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:26.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.504+0000 7f05c8264640 1 --2- 172.21.15.22:0/2847664996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c01042c0 0x7f05c01994c0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:26.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.504+0000 7f05c8264640 1 --2- 172.21.15.22:0/2847664996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05c01039a0 0x7f05c0198f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:26.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.504+0000 7f05c8264640 1 -- 172.21.15.22:0/2847664996 >> 172.21.15.22:0/2847664996 conn(0x7f05c00fd400 msgr2=0x7f05c00fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:26.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.504+0000 7f05c8264640 1 -- 172.21.15.22:0/2847664996 shutdown_connections 2024-08-20T01:40:26.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:26.504+0000 7f05c8264640 1 -- 172.21.15.22:0/2847664996 wait complete. 2024-08-20T01:40:27.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:26 smithi077 ceph-mon[22251]: pgmap v625: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 363 op/s 2024-08-20T01:40:27.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:26 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2847664996' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:40:27.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:26 smithi022 ceph-mon[18709]: pgmap v625: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 363 op/s 2024-08-20T01:40:27.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:26 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2847664996' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:40:27.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:26 smithi134 ceph-mon[22511]: pgmap v625: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 363 op/s 2024-08-20T01:40:27.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:26 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2847664996' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:40:27.500 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:40:27.764 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:40:28.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.293+0000 7ff9dd707640 1 -- 172.21.15.22:0/123288054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d8107d20 msgr2=0x7ff9d810e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:28.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.293+0000 7ff9dd707640 1 --2- 172.21.15.22:0/123288054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d8107d20 0x7ff9d810e520 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009ca0 tx=0x7ff9d002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.293+0000 7ff9dd707640 1 -- 172.21.15.22:0/123288054 shutdown_connections 2024-08-20T01:40:28.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.294+0000 7ff9dd707640 1 --2- 172.21.15.22:0/123288054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d8107d20 0x7ff9d810e520 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.294+0000 7ff9dd707640 1 --2- 172.21.15.22:0/123288054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d81073a0 0x7ff9d81077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.294+0000 7ff9dd707640 1 --2- 172.21.15.22:0/123288054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9d8101990 0x7ff9d8101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.294+0000 7ff9dd707640 1 -- 172.21.15.22:0/123288054 >> 172.21.15.22:0/123288054 conn(0x7ff9d80fd400 msgr2=0x7ff9d80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:28.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.294+0000 7ff9dd707640 1 -- 172.21.15.22:0/123288054 shutdown_connections 2024-08-20T01:40:28.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.294+0000 7ff9dd707640 1 -- 172.21.15.22:0/123288054 wait complete. 2024-08-20T01:40:28.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.294+0000 7ff9dd707640 1 Processor -- start 2024-08-20T01:40:28.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.294+0000 7ff9dd707640 1 -- start start 2024-08-20T01:40:28.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.295+0000 7ff9dd707640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d8101990 0x7ff9d8199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:28.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.295+0000 7ff9dd707640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9d81073a0 0x7ff9d819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:28.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.295+0000 7ff9dd707640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d8107d20 0x7ff9d819a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:28.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.295+0000 7ff9dd707640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81119e0 con 0x7ff9d8107d20 2024-08-20T01:40:28.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.295+0000 7ff9dd707640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d8111860 con 0x7ff9d81073a0 2024-08-20T01:40:28.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.295+0000 7ff9dd707640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d8111b60 con 0x7ff9d8101990 2024-08-20T01:40:28.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.295+0000 7ff9d67fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9d81073a0 0x7ff9d819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:28.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.295+0000 7ff9d6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d8101990 0x7ff9d8199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:28.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.295+0000 7ff9d67fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9d81073a0 0x7ff9d819a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:44940/0 (socket says 172.21.15.22:44940) 2024-08-20T01:40:28.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.295+0000 7ff9d67fc640 1 -- 172.21.15.22:0/2693498583 learned_addr learned my addr 172.21.15.22:0/2693498583 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:28.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.295+0000 7ff9d77fe640 1 --2- 172.21.15.22:0/2693498583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d8107d20 0x7ff9d819a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:28.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.295+0000 7ff9d6ffd640 1 -- 172.21.15.22:0/2693498583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9d81073a0 msgr2=0x7ff9d819a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:28.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.295+0000 7ff9d6ffd640 1 --2- 172.21.15.22:0/2693498583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9d81073a0 0x7ff9d819a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.295+0000 7ff9d6ffd640 1 -- 172.21.15.22:0/2693498583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d8107d20 msgr2=0x7ff9d819a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:28.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.295+0000 7ff9d6ffd640 1 --2- 172.21.15.22:0/2693498583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d8107d20 0x7ff9d819a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.295+0000 7ff9d6ffd640 1 -- 172.21.15.22:0/2693498583 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d81a5140 con 0x7ff9d8101990 2024-08-20T01:40:28.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.295+0000 7ff9d77fe640 1 --2- 172.21.15.22:0/2693498583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d8107d20 0x7ff9d819a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:28.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.296+0000 7ff9d6ffd640 1 --2- 172.21.15.22:0/2693498583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d8101990 0x7ff9d8199d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800c970 tx=0x7ff9c800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:28.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.296+0000 7ff9bffff640 1 -- 172.21.15.22:0/2693498583 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8007bb0 con 0x7ff9d8101990 2024-08-20T01:40:28.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.296+0000 7ff9dd707640 1 -- 172.21.15.22:0/2693498583 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d81a5430 con 0x7ff9d8101990 2024-08-20T01:40:28.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.296+0000 7ff9bffff640 1 -- 172.21.15.22:0/2693498583 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9c8007d50 con 0x7ff9d8101990 2024-08-20T01:40:28.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.296+0000 7ff9bffff640 1 -- 172.21.15.22:0/2693498583 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8004df0 con 0x7ff9d8101990 2024-08-20T01:40:28.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.296+0000 7ff9dd707640 1 -- 172.21.15.22:0/2693498583 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d81a59c0 con 0x7ff9d8101990 2024-08-20T01:40:28.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9dfb00740 1 Processor -- start 2024-08-20T01:40:28.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9dfb00740 1 -- start start 2024-08-20T01:40:28.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9bffff640 1 -- 172.21.15.22:0/2693498583 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff9c8005000 con 0x7ff9d8101990 2024-08-20T01:40:28.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9dfb00740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a91d880 0x56411a91dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:28.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9dfb00740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a929bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:28.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9dfb00740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56411a92a130 0x56411a92c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:28.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9dfb00740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56411a894930 con 0x56411a91e1a0 2024-08-20T01:40:28.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9dfb00740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56411a883e30 con 0x56411a91d880 2024-08-20T01:40:28.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9dfb00740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56411a887e70 con 0x56411a92a130 2024-08-20T01:40:28.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9d6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a929bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:28.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9d6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a929bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40614/0 (socket says 172.21.15.22:40614) 2024-08-20T01:40:28.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9d6ffd640 1 -- 172.21.15.22:0/2856186452 learned_addr learned my addr 172.21.15.22:0/2856186452 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:28.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9d67fc640 1 --2- 172.21.15.22:0/2856186452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56411a92a130 0x56411a92c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:28.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9d77fe640 1 --2- 172.21.15.22:0/2856186452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a91d880 0x56411a91dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:28.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9d6ffd640 1 -- 172.21.15.22:0/2856186452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56411a92a130 msgr2=0x56411a92c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:28.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9d6ffd640 1 --2- 172.21.15.22:0/2856186452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56411a92a130 0x56411a92c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9d6ffd640 1 -- 172.21.15.22:0/2856186452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a91d880 msgr2=0x56411a91dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:28.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9d6ffd640 1 --2- 172.21.15.22:0/2856186452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a91d880 0x56411a91dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9d6ffd640 1 -- 172.21.15.22:0/2856186452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411a5e3650 con 0x56411a91e1a0 2024-08-20T01:40:28.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.299+0000 7ff9d77fe640 1 --2- 172.21.15.22:0/2856186452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a91d880 0x56411a91dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:28.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.300+0000 7ff9bffff640 1 --2- 172.21.15.22:0/2693498583 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff9c00b3c50 0x7ff9c00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:28.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.300+0000 7ff9d6ffd640 1 --2- 172.21.15.22:0/2856186452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a929bf0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80e7d20 tx=0x7ff9c80e7e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a619b7bc2c7707e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:28.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.300+0000 7ff9d77fe640 1 --2- 172.21.15.22:0/2693498583 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff9c00b3c50 0x7ff9c00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:28.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.300+0000 7ff9bffff640 1 -- 172.21.15.22:0/2693498583 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ff9c80e3b80 con 0x7ff9d8101990 2024-08-20T01:40:28.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.300+0000 7ff9bd7fa640 1 -- 172.21.15.22:0/2856186452 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c80a69e0 con 0x56411a91e1a0 2024-08-20T01:40:28.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.300+0000 7ff9bd7fa640 1 -- 172.21.15.22:0/2856186452 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9c80046c0 con 0x56411a91e1a0 2024-08-20T01:40:28.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.300+0000 7ff9bd7fa640 1 -- 172.21.15.22:0/2856186452 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c80a69e0 con 0x56411a91e1a0 2024-08-20T01:40:28.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.301+0000 7ff9dfb00740 1 -- 172.21.15.22:0/2856186452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 msgr2=0x56411a929bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:28.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.301+0000 7ff9d77fe640 1 --2- 172.21.15.22:0/2693498583 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff9c00b3c50 0x7ff9c00b6110 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0033040 tx=0x7ff9d0005fa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:28.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.301+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/2856186452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a929bf0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80e7d20 tx=0x7ff9c80e7e10 comp rx=0 tx=0).stop 2024-08-20T01:40:28.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.301+0000 7ff9dfb00740 1 -- 172.21.15.22:0/2856186452 shutdown_connections 2024-08-20T01:40:28.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.301+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/2856186452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56411a92a130 0x56411a92c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.301+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/2856186452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a929bf0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.301+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/2856186452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a91d880 0x56411a91dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.301+0000 7ff9dfb00740 1 -- 172.21.15.22:0/2856186452 >> 172.21.15.22:0/2856186452 conn(0x56411a91b6b0 msgr2=0x56411a91c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:28.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.301+0000 7ff9dfb00740 1 -- 172.21.15.22:0/2856186452 shutdown_connections 2024-08-20T01:40:28.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.301+0000 7ff9dfb00740 1 -- 172.21.15.22:0/2856186452 wait complete. 2024-08-20T01:40:28.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.301+0000 7ff9dfb00740 1 -- start start 2024-08-20T01:40:28.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.302+0000 7ff9dfb00740 1 Processor -- start 2024-08-20T01:40:28.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.302+0000 7ff9dfb00740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56411a91d880 0x56411a927080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:28.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.302+0000 7ff9dfb00740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a9275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:28.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.302+0000 7ff9dfb00740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a92a130 0x56411a927b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:28.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.302+0000 7ff9dfb00740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56411a6e6700 con 0x56411a91e1a0 2024-08-20T01:40:28.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.302+0000 7ff9dfb00740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56411a80a810 con 0x56411a92a130 2024-08-20T01:40:28.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.302+0000 7ff9dfb00740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56411a92cde0 con 0x56411a91d880 2024-08-20T01:40:28.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.302+0000 7ff9dfb00740 10 client.0 _ll_register_callbacks cb 0x56411a87d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:28.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.302+0000 7ff9d67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a9275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:28.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.302+0000 7ff9d67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a9275c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40618/0 (socket says 172.21.15.22:40618) 2024-08-20T01:40:28.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.302+0000 7ff9d67fc640 1 -- 172.21.15.22:0/3820194908 learned_addr learned my addr 172.21.15.22:0/3820194908 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:28.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.302+0000 7ff9d6ffd640 1 --2- 172.21.15.22:0/3820194908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56411a91d880 0x56411a927080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:28.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.302+0000 7ff9d77fe640 1 --2- 172.21.15.22:0/3820194908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a92a130 0x56411a927b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:28.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.302+0000 7ff9d67fc640 1 -- 172.21.15.22:0/3820194908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56411a91d880 msgr2=0x56411a927080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:28.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.302+0000 7ff9d67fc640 1 --2- 172.21.15.22:0/3820194908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56411a91d880 0x56411a927080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.302+0000 7ff9d67fc640 1 -- 172.21.15.22:0/3820194908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a92a130 msgr2=0x56411a927b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:28.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.302+0000 7ff9d67fc640 1 --2- 172.21.15.22:0/3820194908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a92a130 0x56411a927b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.302+0000 7ff9d67fc640 1 -- 172.21.15.22:0/3820194908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56411a936140 con 0x56411a91e1a0 2024-08-20T01:40:28.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.302+0000 7ff9d77fe640 1 --2- 172.21.15.22:0/3820194908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a92a130 0x56411a927b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:28.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.303+0000 7ff9d67fc640 1 --2- 172.21.15.22:0/3820194908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a9275c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00ba90 tx=0x7ff9cc00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab51548323c433c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:28.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.303+0000 7ff9baff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:40:28.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.303+0000 7ff9baff5640 1 -- 172.21.15.22:0/3820194908 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc003e50 con 0x56411a91e1a0 2024-08-20T01:40:28.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.303+0000 7ff9dfb00740 1 -- 172.21.15.22:0/3820194908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56411a833150 con 0x56411a91e1a0 2024-08-20T01:40:28.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.303+0000 7ff9baff5640 1 -- 172.21.15.22:0/3820194908 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ff9cc011440 con 0x56411a91e1a0 2024-08-20T01:40:28.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.303+0000 7ff9baff5640 1 -- 172.21.15.22:0/3820194908 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff9cc011640 con 0x56411a91e1a0 2024-08-20T01:40:28.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.303+0000 7ff9dfb00740 10 client.16977 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:28.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.303+0000 7ff9dfb00740 1 -- 172.21.15.22:0/3820194908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56411a938ba0 con 0x56411a91e1a0 2024-08-20T01:40:28.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.303+0000 7ff9baff5640 1 -- 172.21.15.22:0/3820194908 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56411a833150 con 0x56411a91e1a0 2024-08-20T01:40:28.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.303+0000 7ff9baff5640 1 -- 172.21.15.22:0/3820194908 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7ff9cc01b9f0 con 0x56411a91e1a0 2024-08-20T01:40:28.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.303+0000 7ff9dfb00740 10 client.16977 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:28.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.303+0000 7ff9dfb00740 10 client.16977 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:40:28.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.303+0000 7ff9dfb00740 20 client.16977 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:28.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.303+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/3820194908 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x56411a93a430 0x56411a93c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:28.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.303+0000 7ff9dfb00740 4 client.16977 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:28.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.303+0000 7ff9dfb00740 1 -- 172.21.15.22:0/3820194908 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56411a896880 con 0x56411a93a430 2024-08-20T01:40:28.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.304+0000 7ff9d6ffd640 1 --2- 172.21.15.22:0/3820194908 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x56411a93a430 0x56411a93c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:28.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.304+0000 7ff9baff5640 10 client.16977 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:40:28.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.304+0000 7ff9d6ffd640 1 --2- 172.21.15.22:0/3820194908 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x56411a93a430 0x56411a93c890 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=47c8eef892625fc server_cookie=720745692ea0888f in_seq=0 out_seq=0 2024-08-20T01:40:28.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.305+0000 7ff9baff5640 1 -- 172.21.15.22:0/3820194908 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56411a896880 con 0x56411a93a430 2024-08-20T01:40:28.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.305+0000 7ff9baff5640 10 client.16977 handle_command_reply: tid=0 2024-08-20T01:40:28.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.305+0000 7ff9dfb00740 1 client.16977 shutdown 2024-08-20T01:40:28.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.305+0000 7ff9dfb00740 1 -- 172.21.15.22:0/3820194908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 msgr2=0x56411a9275c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:28.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.305+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/3820194908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a9275c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00ba90 tx=0x7ff9cc00bf50 comp rx=0 tx=0).stop 2024-08-20T01:40:28.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.305+0000 7ff9dfb00740 1 -- 172.21.15.22:0/3820194908 shutdown_connections 2024-08-20T01:40:28.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.305+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/3820194908 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x56411a93a430 0x56411a93c890 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.305+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/3820194908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a92a130 0x56411a927b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.305+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/3820194908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a9275c0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.305+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/3820194908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56411a91d880 0x56411a927080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.305+0000 7ff9dfb00740 1 -- 172.21.15.22:0/3820194908 >> 172.21.15.22:0/3820194908 conn(0x56411a91b6b0 msgr2=0x56411a921250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:28.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.305+0000 7ff9baff5640 0 client.16977 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:40:28.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.305+0000 7ff9dfb00740 1 -- 172.21.15.22:0/3820194908 shutdown_connections 2024-08-20T01:40:28.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.305+0000 7ff9dfb00740 1 -- 172.21.15.22:0/3820194908 wait complete. 2024-08-20T01:40:28.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.305+0000 7ff9dfb00740 20 client.16977 trim_cache size 0 max 16384 2024-08-20T01:40:28.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.319+0000 7ff9dfb00740 1 Processor -- start 2024-08-20T01:40:28.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.319+0000 7ff9dfb00740 1 -- start start 2024-08-20T01:40:28.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.319+0000 7ff9dfb00740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56411a91d880 0x56411a921980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:28.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.319+0000 7ff9dfb00740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a927580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:28.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.319+0000 7ff9dfb00740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a92a130 0x56411a927ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:28.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.319+0000 7ff9dfb00740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81b0c20 con 0x56411a91e1a0 2024-08-20T01:40:28.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.319+0000 7ff9dfb00740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81ae430 con 0x56411a92a130 2024-08-20T01:40:28.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.319+0000 7ff9dfb00740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81ac280 con 0x56411a91d880 2024-08-20T01:40:28.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.319+0000 7ff9d67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a927580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:28.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.319+0000 7ff9d67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a927580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40624/0 (socket says 172.21.15.22:40624) 2024-08-20T01:40:28.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.319+0000 7ff9d67fc640 1 -- 172.21.15.22:0/467035098 learned_addr learned my addr 172.21.15.22:0/467035098 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:28.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.319+0000 7ff9d77fe640 1 --2- 172.21.15.22:0/467035098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a92a130 0x56411a927ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:28.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.319+0000 7ff9d67fc640 1 -- 172.21.15.22:0/467035098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56411a91d880 msgr2=0x56411a921980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:28.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.319+0000 7ff9d67fc640 1 --2- 172.21.15.22:0/467035098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56411a91d880 0x56411a921980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.319+0000 7ff9d67fc640 1 -- 172.21.15.22:0/467035098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a92a130 msgr2=0x56411a927ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:28.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.319+0000 7ff9d67fc640 1 --2- 172.21.15.22:0/467035098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a92a130 0x56411a927ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.319+0000 7ff9d67fc640 1 -- 172.21.15.22:0/467035098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411a91dfd0 con 0x56411a91e1a0 2024-08-20T01:40:28.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.319+0000 7ff9d77fe640 1 --2- 172.21.15.22:0/467035098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a92a130 0x56411a927ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:28.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.319+0000 7ff9d67fc640 1 --2- 172.21.15.22:0/467035098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a927580 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc003a70 tx=0x7ff9cc004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e31f6960ba10e1a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:28.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.320+0000 7ff9bcff9640 1 -- 172.21.15.22:0/467035098 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc02b040 con 0x56411a91e1a0 2024-08-20T01:40:28.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.320+0000 7ff9bcff9640 1 -- 172.21.15.22:0/467035098 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9cc021030 con 0x56411a91e1a0 2024-08-20T01:40:28.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.320+0000 7ff9bcff9640 1 -- 172.21.15.22:0/467035098 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc01b680 con 0x56411a91e1a0 2024-08-20T01:40:28.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.320+0000 7ff9dfb00740 1 -- 172.21.15.22:0/467035098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 msgr2=0x56411a927580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:28.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.320+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/467035098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a927580 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc003a70 tx=0x7ff9cc004430 comp rx=0 tx=0).stop 2024-08-20T01:40:28.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.320+0000 7ff9dfb00740 1 -- 172.21.15.22:0/467035098 shutdown_connections 2024-08-20T01:40:28.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.320+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/467035098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a92a130 0x56411a927ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.320+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/467035098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a927580 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.320+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/467035098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56411a91d880 0x56411a921980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.320+0000 7ff9dfb00740 1 -- 172.21.15.22:0/467035098 >> 172.21.15.22:0/467035098 conn(0x56411a91b6b0 msgr2=0x56411a928ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:28.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.320+0000 7ff9dfb00740 1 -- 172.21.15.22:0/467035098 shutdown_connections 2024-08-20T01:40:28.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.320+0000 7ff9dfb00740 1 -- 172.21.15.22:0/467035098 wait complete. 2024-08-20T01:40:28.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.321+0000 7ff9dfb00740 1 -- start start 2024-08-20T01:40:28.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.321+0000 7ff9dfb00740 1 Processor -- start 2024-08-20T01:40:28.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.321+0000 7ff9dfb00740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a91d880 0x56411a92e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.321+0000 7ff9dfb00740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a92ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.321+0000 7ff9dfb00740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56411a92a130 0x56411a92f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.321+0000 7ff9dfb00740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81ac8f0 con 0x56411a91e1a0 2024-08-20T01:40:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.321+0000 7ff9dfb00740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81add60 con 0x56411a91d880 2024-08-20T01:40:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.321+0000 7ff9dfb00740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81acfc0 con 0x56411a92a130 2024-08-20T01:40:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.321+0000 7ff9dfb00740 10 client.0 _ll_register_callbacks cb 0x7ff9cc004110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.321+0000 7ff9d67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a92ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.321+0000 7ff9d6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a91d880 0x56411a92e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.321+0000 7ff9d67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a92ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40630/0 (socket says 172.21.15.22:40630) 2024-08-20T01:40:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.321+0000 7ff9d67fc640 1 -- 172.21.15.22:0/358730683 learned_addr learned my addr 172.21.15.22:0/358730683 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.321+0000 7ff9d67fc640 1 -- 172.21.15.22:0/358730683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56411a92a130 msgr2=0x56411a92f100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:40:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.321+0000 7ff9d67fc640 1 --2- 172.21.15.22:0/358730683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56411a92a130 0x56411a92f100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.321+0000 7ff9d67fc640 1 -- 172.21.15.22:0/358730683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a91d880 msgr2=0x56411a92e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.321+0000 7ff9d67fc640 1 --2- 172.21.15.22:0/358730683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a91d880 0x56411a92e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.321+0000 7ff9d67fc640 1 -- 172.21.15.22:0/358730683 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56411a9a33c0 con 0x56411a91e1a0 2024-08-20T01:40:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.322+0000 7ff9d67fc640 1 --2- 172.21.15.22:0/358730683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a92ebc0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc000c00 tx=0x7ff9cc011550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a30ebee7ae197bc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.322+0000 7ff9baff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:40:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.322+0000 7ff9baff5640 1 -- 172.21.15.22:0/358730683 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc02b070 con 0x56411a91e1a0 2024-08-20T01:40:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.322+0000 7ff9baff5640 1 -- 172.21.15.22:0/358730683 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7ff9cc00b4a0 con 0x56411a91e1a0 2024-08-20T01:40:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.322+0000 7ff9dfb00740 1 -- 172.21.15.22:0/358730683 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9cc021030 con 0x56411a91e1a0 2024-08-20T01:40:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.322+0000 7ff9baff5640 1 -- 172.21.15.22:0/358730683 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff9cc0117e0 con 0x56411a91e1a0 2024-08-20T01:40:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.322+0000 7ff9dfb00740 10 client.16983 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.322+0000 7ff9dfb00740 1 -- 172.21.15.22:0/358730683 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56411a9a46a0 con 0x56411a91e1a0 2024-08-20T01:40:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.322+0000 7ff9baff5640 1 -- 172.21.15.22:0/358730683 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9cc021030 con 0x56411a91e1a0 2024-08-20T01:40:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.322+0000 7ff9baff5640 1 -- 172.21.15.22:0/358730683 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7ff9cc031440 con 0x56411a91e1a0 2024-08-20T01:40:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.322+0000 7ff9dfb00740 10 client.16983 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.322+0000 7ff9dfb00740 10 client.16983 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:40:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.323+0000 7ff9dfb00740 20 client.16983 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:28.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.323+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/358730683 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x56411a9a4dc0 0x56411a9a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:28.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.323+0000 7ff9dfb00740 4 client.16983 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:40:28.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.323+0000 7ff9dfb00740 1 -- 172.21.15.22:0/358730683 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56411a892320 con 0x56411a9a4dc0 2024-08-20T01:40:28.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.324+0000 7ff9d6ffd640 1 --2- 172.21.15.22:0/358730683 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x56411a9a4dc0 0x56411a9a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:28.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.325+0000 7ff9d6ffd640 1 --2- 172.21.15.22:0/358730683 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x56411a9a4dc0 0x56411a9a71e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eda3883ee001651b server_cookie=50cfa68e9e426a2e in_seq=0 out_seq=0 2024-08-20T01:40:28.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.325+0000 7ff9baff5640 10 client.16983 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:40:28.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.325+0000 7ff9baff5640 1 -- 172.21.15.22:0/358730683 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56411a892320 con 0x56411a9a4dc0 2024-08-20T01:40:28.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.325+0000 7ff9baff5640 10 client.16983 handle_command_reply: tid=0 2024-08-20T01:40:28.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.325+0000 7ff9dfb00740 1 client.16983 shutdown 2024-08-20T01:40:28.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.325+0000 7ff9dfb00740 1 -- 172.21.15.22:0/358730683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 msgr2=0x56411a92ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:28.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.325+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/358730683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a92ebc0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc000c00 tx=0x7ff9cc011550 comp rx=0 tx=0).stop 2024-08-20T01:40:28.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.325+0000 7ff9dfb00740 1 -- 172.21.15.22:0/358730683 shutdown_connections 2024-08-20T01:40:28.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.325+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/358730683 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x56411a9a4dc0 0x56411a9a71e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.325+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/358730683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56411a92a130 0x56411a92f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.325+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/358730683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56411a91e1a0 0x56411a92ebc0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.325+0000 7ff9dfb00740 1 --2- 172.21.15.22:0/358730683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56411a91d880 0x56411a92e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.325+0000 7ff9dfb00740 1 -- 172.21.15.22:0/358730683 >> 172.21.15.22:0/358730683 conn(0x56411a91b6b0 msgr2=0x56411a934ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:28.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.325+0000 7ff9baff5640 0 client.16983 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:40:28.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.325+0000 7ff9dfb00740 1 -- 172.21.15.22:0/358730683 shutdown_connections 2024-08-20T01:40:28.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.325+0000 7ff9dfb00740 1 -- 172.21.15.22:0/358730683 wait complete. 2024-08-20T01:40:28.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.325+0000 7ff9dfb00740 20 client.16983 trim_cache size 0 max 16384 2024-08-20T01:40:28.332 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:40:28.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.326+0000 7ff9dd707640 1 -- 172.21.15.22:0/2693498583 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff9c00b3c50 msgr2=0x7ff9c00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:28.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.326+0000 7ff9dd707640 1 --2- 172.21.15.22:0/2693498583 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff9c00b3c50 0x7ff9c00b6110 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0033040 tx=0x7ff9d0005fa0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.326+0000 7ff9dd707640 1 -- 172.21.15.22:0/2693498583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d8101990 msgr2=0x7ff9d8199d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:28.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.326+0000 7ff9dd707640 1 --2- 172.21.15.22:0/2693498583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d8101990 0x7ff9d8199d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800c970 tx=0x7ff9c800ce30 comp rx=0 tx=0).stop 2024-08-20T01:40:28.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.326+0000 7ff9dd707640 1 -- 172.21.15.22:0/2693498583 shutdown_connections 2024-08-20T01:40:28.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.326+0000 7ff9dd707640 1 --2- 172.21.15.22:0/2693498583 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7ff9c00b3c50 0x7ff9c00b6110 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.326+0000 7ff9dd707640 1 --2- 172.21.15.22:0/2693498583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d8107d20 0x7ff9d819a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.326+0000 7ff9dd707640 1 --2- 172.21.15.22:0/2693498583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9d81073a0 0x7ff9d819a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.326+0000 7ff9dd707640 1 --2- 172.21.15.22:0/2693498583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d8101990 0x7ff9d8199d40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:28.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.326+0000 7ff9dd707640 1 -- 172.21.15.22:0/2693498583 >> 172.21.15.22:0/2693498583 conn(0x7ff9d80fd400 msgr2=0x7ff9d80ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:28.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.326+0000 7ff9dd707640 1 -- 172.21.15.22:0/2693498583 shutdown_connections 2024-08-20T01:40:28.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:28.326+0000 7ff9dd707640 1 -- 172.21.15.22:0/2693498583 wait complete. 2024-08-20T01:40:29.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:28 smithi077 ceph-mon[22251]: pgmap v626: 97 pgs: 97 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 485 op/s 2024-08-20T01:40:29.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:28 smithi022 ceph-mon[18709]: pgmap v626: 97 pgs: 97 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 485 op/s 2024-08-20T01:40:29.188 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:40:29.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:28 smithi134 ceph-mon[22511]: pgmap v626: 97 pgs: 97 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 485 op/s 2024-08-20T01:40:29.447 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:40:30.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.069+0000 7f18dc3d5640 1 -- 172.21.15.22:0/445831562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d41039a0 msgr2=0x7f18d4103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:30.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.069+0000 7f18dc3d5640 1 --2- 172.21.15.22:0/445831562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d41039a0 0x7f18d4103d80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009900 tx=0x7f18d002a410 comp rx=0 tx=0).stop 2024-08-20T01:40:30.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.069+0000 7f18dc3d5640 1 -- 172.21.15.22:0/445831562 shutdown_connections 2024-08-20T01:40:30.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.069+0000 7f18dc3d5640 1 --2- 172.21.15.22:0/445831562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18d410ce00 0x7f18d410f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.069+0000 7f18dc3d5640 1 --2- 172.21.15.22:0/445831562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18d41042c0 0x7f18d410c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.069+0000 7f18dc3d5640 1 --2- 172.21.15.22:0/445831562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d41039a0 0x7f18d4103d80 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.069+0000 7f18dc3d5640 1 -- 172.21.15.22:0/445831562 >> 172.21.15.22:0/445831562 conn(0x7f18d40fd400 msgr2=0x7f18d40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:30.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.069+0000 7f18dc3d5640 1 -- 172.21.15.22:0/445831562 shutdown_connections 2024-08-20T01:40:30.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.069+0000 7f18dc3d5640 1 -- 172.21.15.22:0/445831562 wait complete. 2024-08-20T01:40:30.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.070+0000 7f18dc3d5640 1 Processor -- start 2024-08-20T01:40:30.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.070+0000 7f18dc3d5640 1 -- start start 2024-08-20T01:40:30.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.070+0000 7f18dc3d5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d41039a0 0x7f18d4198f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:30.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.070+0000 7f18dc3d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18d41042c0 0x7f18d41994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:30.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.070+0000 7f18dc3d5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18d410ce00 0x7f18d419e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:30.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.070+0000 7f18dc3d5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f18d4112a70 con 0x7f18d41039a0 2024-08-20T01:40:30.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.070+0000 7f18dc3d5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f18d41128f0 con 0x7f18d41042c0 2024-08-20T01:40:30.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.070+0000 7f18dc3d5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f18d4112bf0 con 0x7f18d410ce00 2024-08-20T01:40:30.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.070+0000 7f18da171640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d41039a0 0x7f18d4198f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:30.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.070+0000 7f18d9970640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18d41042c0 0x7f18d41994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:30.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.070+0000 7f18da171640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d41039a0 0x7f18d4198f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56504/0 (socket says 172.21.15.22:56504) 2024-08-20T01:40:30.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.070+0000 7f18d9970640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18d41042c0 0x7f18d41994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:50892/0 (socket says 172.21.15.22:50892) 2024-08-20T01:40:30.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.070+0000 7f18da171640 1 -- 172.21.15.22:0/3303934284 learned_addr learned my addr 172.21.15.22:0/3303934284 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:30.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.070+0000 7f18da972640 1 --2- 172.21.15.22:0/3303934284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18d410ce00 0x7f18d419e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:30.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.071+0000 7f18d9970640 1 -- 172.21.15.22:0/3303934284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18d410ce00 msgr2=0x7f18d419e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:30.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.071+0000 7f18d9970640 1 --2- 172.21.15.22:0/3303934284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18d410ce00 0x7f18d419e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.071+0000 7f18d9970640 1 -- 172.21.15.22:0/3303934284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d41039a0 msgr2=0x7f18d4198f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:30.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.071+0000 7f18d9970640 1 --2- 172.21.15.22:0/3303934284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d41039a0 0x7f18d4198f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.071+0000 7f18d9970640 1 -- 172.21.15.22:0/3303934284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d419f010 con 0x7f18d41042c0 2024-08-20T01:40:30.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.071+0000 7f18d9970640 1 --2- 172.21.15.22:0/3303934284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18d41042c0 0x7f18d41994a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f18c400e9c0 tx=0x7f18c400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:30.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.071+0000 7f18cb7fe640 1 -- 172.21.15.22:0/3303934284 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c400ccc0 con 0x7f18d41042c0 2024-08-20T01:40:30.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.071+0000 7f18dc3d5640 1 -- 172.21.15.22:0/3303934284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18d419f300 con 0x7f18d41042c0 2024-08-20T01:40:30.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.071+0000 7f18cb7fe640 1 -- 172.21.15.22:0/3303934284 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18c40108e0 con 0x7f18d41042c0 2024-08-20T01:40:30.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.071+0000 7f18cb7fe640 1 -- 172.21.15.22:0/3303934284 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c4018780 con 0x7f18d41042c0 2024-08-20T01:40:30.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.071+0000 7f18dc3d5640 1 -- 172.21.15.22:0/3303934284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18d41a5b90 con 0x7f18d41042c0 2024-08-20T01:40:30.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.074+0000 7f18de7ce740 1 Processor -- start 2024-08-20T01:40:30.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.074+0000 7f18de7ce740 1 -- start start 2024-08-20T01:40:30.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.075+0000 7f18de7ce740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca58880 0x564a3ca58c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:30.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.075+0000 7f18de7ce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca591a0 0x564a3ca69000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:30.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.075+0000 7f18de7ce740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca69540 0x564a3ca6b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:30.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.075+0000 7f18de7ce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564a3c9cf930 con 0x564a3ca591a0 2024-08-20T01:40:30.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.075+0000 7f18de7ce740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564a3c9bee30 con 0x564a3ca58880 2024-08-20T01:40:30.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.075+0000 7f18de7ce740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564a3c9c2e70 con 0x564a3ca69540 2024-08-20T01:40:30.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.075+0000 7f18cb7fe640 1 -- 172.21.15.22:0/3303934284 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f18c401f020 con 0x7f18d41042c0 2024-08-20T01:40:30.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.075+0000 7f18da972640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca58880 0x564a3ca58c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:30.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.075+0000 7f18da171640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca591a0 0x564a3ca69000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:30.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.075+0000 7f18da972640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca58880 0x564a3ca58c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:50900/0 (socket says 172.21.15.22:50900) 2024-08-20T01:40:30.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.075+0000 7f18da972640 1 -- 172.21.15.22:0/1331390426 learned_addr learned my addr 172.21.15.22:0/1331390426 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:30.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.075+0000 7f18d9970640 1 --2- 172.21.15.22:0/1331390426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca69540 0x564a3ca6b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:30.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.075+0000 7f18da972640 1 -- 172.21.15.22:0/1331390426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca69540 msgr2=0x564a3ca6b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:30.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.075+0000 7f18da972640 1 --2- 172.21.15.22:0/1331390426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca69540 0x564a3ca6b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.075+0000 7f18da972640 1 -- 172.21.15.22:0/1331390426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca591a0 msgr2=0x564a3ca69000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:30.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.075+0000 7f18da972640 1 --2- 172.21.15.22:0/1331390426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca591a0 0x564a3ca69000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.075+0000 7f18da972640 1 -- 172.21.15.22:0/1331390426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a3c71e650 con 0x564a3ca58880 2024-08-20T01:40:30.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.076+0000 7f18da972640 1 --2- 172.21.15.22:0/1331390426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca58880 0x564a3ca58c60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009fd0 tx=0x7f18cc0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1549432d248dc97e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:30.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.076+0000 7f18c8de6640 1 -- 172.21.15.22:0/1331390426 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18cc004d20 con 0x564a3ca58880 2024-08-20T01:40:30.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.076+0000 7f18c8de6640 1 -- 172.21.15.22:0/1331390426 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18cc004050 con 0x564a3ca58880 2024-08-20T01:40:30.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.076+0000 7f18c8de6640 1 -- 172.21.15.22:0/1331390426 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18cc005280 con 0x564a3ca58880 2024-08-20T01:40:30.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.076+0000 7f18cb7fe640 1 --2- 172.21.15.22:0/3303934284 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18c00b3c50 0x7f18c00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:30.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.076+0000 7f18da171640 1 --2- 172.21.15.22:0/3303934284 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18c00b3c50 0x7f18c00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:30.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.076+0000 7f18cb7fe640 1 -- 172.21.15.22:0/3303934284 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f18c40e3ad0 con 0x7f18d41042c0 2024-08-20T01:40:30.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.077+0000 7f18de7ce740 1 -- 172.21.15.22:0/1331390426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca58880 msgr2=0x564a3ca58c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:30.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.077+0000 7f18de7ce740 1 --2- 172.21.15.22:0/1331390426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca58880 0x564a3ca58c60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009fd0 tx=0x7f18cc0118d0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.077+0000 7f18da171640 1 --2- 172.21.15.22:0/3303934284 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18c00b3c50 0x7f18c00b6110 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f18d0031440 tx=0x7f18d00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:30.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.077+0000 7f18de7ce740 1 -- 172.21.15.22:0/1331390426 shutdown_connections 2024-08-20T01:40:30.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.077+0000 7f18de7ce740 1 --2- 172.21.15.22:0/1331390426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca69540 0x564a3ca6b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.077+0000 7f18de7ce740 1 --2- 172.21.15.22:0/1331390426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca591a0 0x564a3ca69000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.077+0000 7f18de7ce740 1 --2- 172.21.15.22:0/1331390426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca58880 0x564a3ca58c60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.077+0000 7f18de7ce740 1 -- 172.21.15.22:0/1331390426 >> 172.21.15.22:0/1331390426 conn(0x564a3ca566b0 msgr2=0x564a3ca57850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.077+0000 7f18de7ce740 1 -- 172.21.15.22:0/1331390426 shutdown_connections 2024-08-20T01:40:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.077+0000 7f18de7ce740 1 -- 172.21.15.22:0/1331390426 wait complete. 2024-08-20T01:40:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.077+0000 7f18de7ce740 1 -- start start 2024-08-20T01:40:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.077+0000 7f18de7ce740 1 Processor -- start 2024-08-20T01:40:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.077+0000 7f18de7ce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca58880 0x564a3ca664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18de7ce740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca591a0 0x564a3ca66a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18de7ce740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca69540 0x564a3ca66f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18de7ce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564a3c821700 con 0x564a3ca58880 2024-08-20T01:40:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18de7ce740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564a3c945810 con 0x564a3ca591a0 2024-08-20T01:40:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18de7ce740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564a3ca6c1f0 con 0x564a3ca69540 2024-08-20T01:40:30.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18de7ce740 10 client.0 _ll_register_callbacks cb 0x564a3c9b8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18da171640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca58880 0x564a3ca664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18da171640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca58880 0x564a3ca664d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56518/0 (socket says 172.21.15.22:56518) 2024-08-20T01:40:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18da171640 1 -- 172.21.15.22:0/2778633172 learned_addr learned my addr 172.21.15.22:0/2778633172 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18da972640 1 --2- 172.21.15.22:0/2778633172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca69540 0x564a3ca66f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18d9970640 1 --2- 172.21.15.22:0/2778633172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca591a0 0x564a3ca66a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18da171640 1 -- 172.21.15.22:0/2778633172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca69540 msgr2=0x564a3ca66f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18da171640 1 --2- 172.21.15.22:0/2778633172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca69540 0x564a3ca66f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18da171640 1 -- 172.21.15.22:0/2778633172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca591a0 msgr2=0x564a3ca66a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18da171640 1 --2- 172.21.15.22:0/2778633172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca591a0 0x564a3ca66a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18da171640 1 -- 172.21.15.22:0/2778633172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a3ca755a0 con 0x564a3ca58880 2024-08-20T01:40:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18da171640 1 --2- 172.21.15.22:0/2778633172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca58880 0x564a3ca664d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009a20 tx=0x7f18d0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=765eae2faa82ab8a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:40:30.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18bdffb640 1 -- 172.21.15.22:0/2778633172 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d004d030 con 0x564a3ca58880 2024-08-20T01:40:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18bdffb640 1 -- 172.21.15.22:0/2778633172 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f18d0004310 con 0x564a3ca58880 2024-08-20T01:40:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.078+0000 7f18de7ce740 1 -- 172.21.15.22:0/2778633172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564a3c96e150 con 0x564a3ca58880 2024-08-20T01:40:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.079+0000 7f18bdffb640 1 -- 172.21.15.22:0/2778633172 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f18d0035040 con 0x564a3ca58880 2024-08-20T01:40:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.079+0000 7f18de7ce740 10 client.16995 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.079+0000 7f18de7ce740 1 -- 172.21.15.22:0/2778633172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564a3ca77f50 con 0x564a3ca58880 2024-08-20T01:40:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.079+0000 7f18bdffb640 1 -- 172.21.15.22:0/2778633172 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564a3c96e150 con 0x564a3ca58880 2024-08-20T01:40:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.079+0000 7f18bdffb640 1 -- 172.21.15.22:0/2778633172 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f18d003d610 con 0x564a3ca58880 2024-08-20T01:40:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.079+0000 7f18de7ce740 10 client.16995 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.079+0000 7f18de7ce740 10 client.16995 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:40:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.079+0000 7f18de7ce740 20 client.16995 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.079+0000 7f18de7ce740 1 --2- 172.21.15.22:0/2778633172 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x564a3ca794b0 0x564a3ca7b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.079+0000 7f18de7ce740 4 client.16995 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.079+0000 7f18de7ce740 1 -- 172.21.15.22:0/2778633172 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a3c9d1880 con 0x564a3ca794b0 2024-08-20T01:40:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.079+0000 7f18d9970640 1 --2- 172.21.15.22:0/2778633172 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x564a3ca794b0 0x564a3ca7b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.080+0000 7f18d9970640 1 --2- 172.21.15.22:0/2778633172 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x564a3ca794b0 0x564a3ca7b900 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f442bd43c2284e58 server_cookie=3bfdfcdb4fd02ac9 in_seq=0 out_seq=0 2024-08-20T01:40:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.080+0000 7f18bdffb640 10 client.16995 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:40:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.080+0000 7f18bdffb640 1 -- 172.21.15.22:0/2778633172 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564a3c9d1880 con 0x564a3ca794b0 2024-08-20T01:40:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.080+0000 7f18bdffb640 10 client.16995 handle_command_reply: tid=0 2024-08-20T01:40:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.080+0000 7f18de7ce740 1 client.16995 shutdown 2024-08-20T01:40:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.081+0000 7f18de7ce740 1 -- 172.21.15.22:0/2778633172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca58880 msgr2=0x564a3ca664d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.081+0000 7f18de7ce740 1 --2- 172.21.15.22:0/2778633172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca58880 0x564a3ca664d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009a20 tx=0x7f18d0009260 comp rx=0 tx=0).stop 2024-08-20T01:40:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.081+0000 7f18de7ce740 1 -- 172.21.15.22:0/2778633172 shutdown_connections 2024-08-20T01:40:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.081+0000 7f18de7ce740 1 --2- 172.21.15.22:0/2778633172 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x564a3ca794b0 0x564a3ca7b900 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.081+0000 7f18de7ce740 1 --2- 172.21.15.22:0/2778633172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca69540 0x564a3ca66f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.081+0000 7f18de7ce740 1 --2- 172.21.15.22:0/2778633172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca591a0 0x564a3ca66a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.081+0000 7f18bdffb640 0 client.16995 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:40:30.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.081+0000 7f18de7ce740 1 --2- 172.21.15.22:0/2778633172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca58880 0x564a3ca664d0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.081+0000 7f18de7ce740 1 -- 172.21.15.22:0/2778633172 >> 172.21.15.22:0/2778633172 conn(0x564a3ca566b0 msgr2=0x564a3ca5c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:30.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.081+0000 7f18de7ce740 1 -- 172.21.15.22:0/2778633172 shutdown_connections 2024-08-20T01:40:30.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.081+0000 7f18de7ce740 1 -- 172.21.15.22:0/2778633172 wait complete. 2024-08-20T01:40:30.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.081+0000 7f18de7ce740 20 client.16995 trim_cache size 0 max 16384 2024-08-20T01:40:30.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.095+0000 7f18de7ce740 1 Processor -- start 2024-08-20T01:40:30.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.095+0000 7f18de7ce740 1 -- start start 2024-08-20T01:40:30.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.095+0000 7f18de7ce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca58880 0x564a3ca57ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:30.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.095+0000 7f18de7ce740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca591a0 0x564a3ca63fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.095+0000 7f18de7ce740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca69540 0x564a3ca54f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.095+0000 7f18de7ce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f18d41ae990 con 0x564a3ca58880 2024-08-20T01:40:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.095+0000 7f18de7ce740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f18d41ac1a0 con 0x564a3ca69540 2024-08-20T01:40:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.095+0000 7f18de7ce740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f18d41a9ff0 con 0x564a3ca591a0 2024-08-20T01:40:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.095+0000 7f18da171640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca58880 0x564a3ca57ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.095+0000 7f18da171640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca58880 0x564a3ca57ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56522/0 (socket says 172.21.15.22:56522) 2024-08-20T01:40:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.095+0000 7f18d9970640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca591a0 0x564a3ca63fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.095+0000 7f18da171640 1 -- 172.21.15.22:0/1984384869 learned_addr learned my addr 172.21.15.22:0/1984384869 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.095+0000 7f18da972640 1 --2- 172.21.15.22:0/1984384869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca69540 0x564a3ca54f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.095+0000 7f18da171640 1 -- 172.21.15.22:0/1984384869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca591a0 msgr2=0x564a3ca63fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.095+0000 7f18da171640 1 --2- 172.21.15.22:0/1984384869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca591a0 0x564a3ca63fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.095+0000 7f18da171640 1 -- 172.21.15.22:0/1984384869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca69540 msgr2=0x564a3ca54f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.095+0000 7f18da171640 1 --2- 172.21.15.22:0/1984384869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca69540 0x564a3ca54f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.095+0000 7f18da171640 1 -- 172.21.15.22:0/1984384869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a3ca5e9e0 con 0x564a3ca58880 2024-08-20T01:40:30.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.095+0000 7f18d9970640 1 --2- 172.21.15.22:0/1984384869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca591a0 0x564a3ca63fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:30.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.096+0000 7f18da171640 1 --2- 172.21.15.22:0/1984384869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca58880 0x564a3ca57ef0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f18d003da60 tx=0x7f18d0031930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20988845f9d39952 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.096+0000 7f18bffff640 1 -- 172.21.15.22:0/1984384869 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d004d040 con 0x564a3ca58880 2024-08-20T01:40:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.096+0000 7f18bffff640 1 -- 172.21.15.22:0/1984384869 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18d0004310 con 0x564a3ca58880 2024-08-20T01:40:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.096+0000 7f18bffff640 1 -- 172.21.15.22:0/1984384869 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d0003cb0 con 0x564a3ca58880 2024-08-20T01:40:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.097+0000 7f18de7ce740 1 -- 172.21.15.22:0/1984384869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca58880 msgr2=0x564a3ca57ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.097+0000 7f18de7ce740 1 --2- 172.21.15.22:0/1984384869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca58880 0x564a3ca57ef0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f18d003da60 tx=0x7f18d0031930 comp rx=0 tx=0).stop 2024-08-20T01:40:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.097+0000 7f18de7ce740 1 -- 172.21.15.22:0/1984384869 shutdown_connections 2024-08-20T01:40:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.097+0000 7f18de7ce740 1 --2- 172.21.15.22:0/1984384869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca69540 0x564a3ca54f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.097+0000 7f18de7ce740 1 --2- 172.21.15.22:0/1984384869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca591a0 0x564a3ca63fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.097+0000 7f18de7ce740 1 --2- 172.21.15.22:0/1984384869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca58880 0x564a3ca57ef0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.097+0000 7f18de7ce740 1 -- 172.21.15.22:0/1984384869 >> 172.21.15.22:0/1984384869 conn(0x564a3ca566b0 msgr2=0x564a3ca577e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.097+0000 7f18de7ce740 1 -- 172.21.15.22:0/1984384869 shutdown_connections 2024-08-20T01:40:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.097+0000 7f18de7ce740 1 -- 172.21.15.22:0/1984384869 wait complete. 2024-08-20T01:40:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.097+0000 7f18de7ce740 1 -- start start 2024-08-20T01:40:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.097+0000 7f18de7ce740 1 Processor -- start 2024-08-20T01:40:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.097+0000 7f18de7ce740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca58880 0x564a3ca5b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.097+0000 7f18de7ce740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca591a0 0x564a3ca81210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.097+0000 7f18de7ce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca69540 0x564a3ca81870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.097+0000 7f18de7ce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f18d41aa660 con 0x564a3ca69540 2024-08-20T01:40:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.097+0000 7f18de7ce740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f18d41abad0 con 0x564a3ca58880 2024-08-20T01:40:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.097+0000 7f18de7ce740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f18d41aad30 con 0x564a3ca591a0 2024-08-20T01:40:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.097+0000 7f18de7ce740 10 client.0 _ll_register_callbacks cb 0x7f18d0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.098+0000 7f18d9970640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca591a0 0x564a3ca81210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.098+0000 7f18da972640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca69540 0x564a3ca81870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.098+0000 7f18d9970640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca591a0 0x564a3ca81210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:42040/0 (socket says 172.21.15.22:42040) 2024-08-20T01:40:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.098+0000 7f18d9970640 1 -- 172.21.15.22:0/3840738339 learned_addr learned my addr 172.21.15.22:0/3840738339 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.098+0000 7f18da171640 1 --2- 172.21.15.22:0/3840738339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca58880 0x564a3ca5b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.098+0000 7f18d9970640 1 -- 172.21.15.22:0/3840738339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca58880 msgr2=0x564a3ca5b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.098+0000 7f18d9970640 1 --2- 172.21.15.22:0/3840738339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca58880 0x564a3ca5b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.098+0000 7f18d9970640 1 -- 172.21.15.22:0/3840738339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca69540 msgr2=0x564a3ca81870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.098+0000 7f18d9970640 1 --2- 172.21.15.22:0/3840738339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca69540 0x564a3ca81870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.098+0000 7f18d9970640 1 -- 172.21.15.22:0/3840738339 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a3ca71500 con 0x564a3ca591a0 2024-08-20T01:40:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.098+0000 7f18d9970640 1 --2- 172.21.15.22:0/3840738339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca591a0 0x564a3ca81210 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f18c40aa6e0 tx=0x7f18c40e1460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1e970c962347a6e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.098+0000 7f18bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:40:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.098+0000 7f18bdffb640 1 -- 172.21.15.22:0/3840738339 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c40a6170 con 0x564a3ca591a0 2024-08-20T01:40:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.098+0000 7f18de7ce740 1 -- 172.21.15.22:0/3840738339 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18d0004310 con 0x564a3ca591a0 2024-08-20T01:40:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.098+0000 7f18bdffb640 1 -- 172.21.15.22:0/3840738339 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f18c40e16a0 con 0x564a3ca591a0 2024-08-20T01:40:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.098+0000 7f18bdffb640 1 -- 172.21.15.22:0/3840738339 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f18c40b33d0 con 0x564a3ca591a0 2024-08-20T01:40:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.098+0000 7f18de7ce740 10 client.26638 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.098+0000 7f18de7ce740 1 -- 172.21.15.22:0/3840738339 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564a3ca59de0 con 0x564a3ca591a0 2024-08-20T01:40:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.099+0000 7f18bdffb640 1 -- 172.21.15.22:0/3840738339 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18d0004310 con 0x564a3ca591a0 2024-08-20T01:40:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.099+0000 7f18bdffb640 1 -- 172.21.15.22:0/3840738339 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f18c40a6c70 con 0x564a3ca591a0 2024-08-20T01:40:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.099+0000 7f18de7ce740 10 client.26638 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.099+0000 7f18de7ce740 10 client.26638 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:40:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.099+0000 7f18de7ce740 20 client.26638 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.099+0000 7f18de7ce740 1 --2- 172.21.15.22:0/3840738339 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x564a3cae41e0 0x564a3cae65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.099+0000 7f18de7ce740 4 client.26638 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:40:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.099+0000 7f18de7ce740 1 -- 172.21.15.22:0/3840738339 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564a3c9cd320 con 0x564a3cae41e0 2024-08-20T01:40:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.099+0000 7f18da171640 1 --2- 172.21.15.22:0/3840738339 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x564a3cae41e0 0x564a3cae65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.099+0000 7f18bdffb640 10 client.26638 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:40:30.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.099+0000 7f18da171640 1 --2- 172.21.15.22:0/3840738339 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x564a3cae41e0 0x564a3cae65d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e052ff6ad0b50c85 server_cookie=5ee6c308048321e7 in_seq=0 out_seq=0 2024-08-20T01:40:30.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.100+0000 7f18bdffb640 1 -- 172.21.15.22:0/3840738339 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564a3c9cd320 con 0x564a3cae41e0 2024-08-20T01:40:30.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.100+0000 7f18bdffb640 10 client.26638 handle_command_reply: tid=0 2024-08-20T01:40:30.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.100+0000 7f18de7ce740 1 client.26638 shutdown 2024-08-20T01:40:30.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.100+0000 7f18de7ce740 1 -- 172.21.15.22:0/3840738339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca591a0 msgr2=0x564a3ca81210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:30.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.100+0000 7f18de7ce740 1 --2- 172.21.15.22:0/3840738339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca591a0 0x564a3ca81210 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f18c40aa6e0 tx=0x7f18c40e1460 comp rx=0 tx=0).stop 2024-08-20T01:40:30.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.100+0000 7f18de7ce740 1 -- 172.21.15.22:0/3840738339 shutdown_connections 2024-08-20T01:40:30.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.100+0000 7f18de7ce740 1 --2- 172.21.15.22:0/3840738339 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x564a3cae41e0 0x564a3cae65d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.100+0000 7f18de7ce740 1 --2- 172.21.15.22:0/3840738339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564a3ca69540 0x564a3ca81870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.100+0000 7f18de7ce740 1 --2- 172.21.15.22:0/3840738339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564a3ca591a0 0x564a3ca81210 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.100+0000 7f18bdffb640 0 client.26638 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:40:30.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.100+0000 7f18de7ce740 1 --2- 172.21.15.22:0/3840738339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a3ca58880 0x564a3ca5b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.100+0000 7f18de7ce740 1 -- 172.21.15.22:0/3840738339 >> 172.21.15.22:0/3840738339 conn(0x564a3ca566b0 msgr2=0x564a3ca5d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:30.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.100+0000 7f18de7ce740 1 -- 172.21.15.22:0/3840738339 shutdown_connections 2024-08-20T01:40:30.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.100+0000 7f18de7ce740 1 -- 172.21.15.22:0/3840738339 wait complete. 2024-08-20T01:40:30.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.100+0000 7f18de7ce740 20 client.26638 trim_cache size 0 max 16384 2024-08-20T01:40:30.107 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:40:30.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.101+0000 7f18dc3d5640 1 -- 172.21.15.22:0/3303934284 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18c00b3c50 msgr2=0x7f18c00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:30.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.101+0000 7f18dc3d5640 1 --2- 172.21.15.22:0/3303934284 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18c00b3c50 0x7f18c00b6110 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f18d0031440 tx=0x7f18d00058d0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.101+0000 7f18dc3d5640 1 -- 172.21.15.22:0/3303934284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18d41042c0 msgr2=0x7f18d41994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:30.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.101+0000 7f18dc3d5640 1 --2- 172.21.15.22:0/3303934284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18d41042c0 0x7f18d41994a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f18c400e9c0 tx=0x7f18c400ee80 comp rx=0 tx=0).stop 2024-08-20T01:40:30.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.101+0000 7f18dc3d5640 1 -- 172.21.15.22:0/3303934284 shutdown_connections 2024-08-20T01:40:30.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.101+0000 7f18dc3d5640 1 --2- 172.21.15.22:0/3303934284 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f18c00b3c50 0x7f18c00b6110 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.101+0000 7f18dc3d5640 1 --2- 172.21.15.22:0/3303934284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18d410ce00 0x7f18d419e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.101+0000 7f18dc3d5640 1 --2- 172.21.15.22:0/3303934284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18d41042c0 0x7f18d41994a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.101+0000 7f18dc3d5640 1 --2- 172.21.15.22:0/3303934284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d41039a0 0x7f18d4198f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:30.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.101+0000 7f18dc3d5640 1 -- 172.21.15.22:0/3303934284 >> 172.21.15.22:0/3303934284 conn(0x7f18d40fd400 msgr2=0x7f18d40fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:30.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.101+0000 7f18dc3d5640 1 -- 172.21.15.22:0/3303934284 shutdown_connections 2024-08-20T01:40:30.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:30.101+0000 7f18dc3d5640 1 -- 172.21.15.22:0/3303934284 wait complete. 2024-08-20T01:40:30.779 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:40:31.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:30 smithi077 ceph-mon[22251]: pgmap v627: 97 pgs: 97 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 435 op/s 2024-08-20T01:40:31.089 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:40:31.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:30 smithi022 ceph-mon[18709]: pgmap v627: 97 pgs: 97 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 435 op/s 2024-08-20T01:40:31.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:30 smithi134 ceph-mon[22511]: pgmap v627: 97 pgs: 97 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 435 op/s 2024-08-20T01:40:31.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.621+0000 7fbc047d3640 1 -- 172.21.15.22:0/1554101304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbfc1073e0 msgr2=0x7fbbfc107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:31.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.621+0000 7fbc047d3640 1 --2- 172.21.15.22:0/1554101304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbfc1073e0 0x7fbbfc107820 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009900 tx=0x7fbbec02a410 comp rx=0 tx=0).stop 2024-08-20T01:40:31.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.621+0000 7fbc047d3640 1 -- 172.21.15.22:0/1554101304 shutdown_connections 2024-08-20T01:40:31.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.621+0000 7fbc047d3640 1 --2- 172.21.15.22:0/1554101304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbfc107d60 0x7fbbfc10e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.621+0000 7fbc047d3640 1 --2- 172.21.15.22:0/1554101304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbfc1073e0 0x7fbbfc107820 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.621+0000 7fbc047d3640 1 --2- 172.21.15.22:0/1554101304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbfc1019d0 0x7fbbfc101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.621+0000 7fbc047d3640 1 -- 172.21.15.22:0/1554101304 >> 172.21.15.22:0/1554101304 conn(0x7fbbfc0fd440 msgr2=0x7fbbfc0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:31.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.621+0000 7fbc047d3640 1 -- 172.21.15.22:0/1554101304 shutdown_connections 2024-08-20T01:40:31.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.621+0000 7fbc047d3640 1 -- 172.21.15.22:0/1554101304 wait complete. 2024-08-20T01:40:31.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.622+0000 7fbc047d3640 1 Processor -- start 2024-08-20T01:40:31.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.622+0000 7fbc047d3640 1 -- start start 2024-08-20T01:40:31.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.622+0000 7fbc047d3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbfc1019d0 0x7fbbfc10e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:31.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.622+0000 7fbc047d3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbfc1073e0 0x7fbbfc10c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:31.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.623+0000 7fbc047d3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbfc107d60 0x7fbbfc10cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:31.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.623+0000 7fbc047d3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc111a20 con 0x7fbbfc107d60 2024-08-20T01:40:31.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.623+0000 7fbc047d3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc1118a0 con 0x7fbbfc1019d0 2024-08-20T01:40:31.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.623+0000 7fbc047d3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc111ba0 con 0x7fbbfc1073e0 2024-08-20T01:40:31.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.623+0000 7fbc02d70640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbfc107d60 0x7fbbfc10cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:31.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.623+0000 7fbc01d6e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbfc1073e0 0x7fbbfc10c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:31.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.623+0000 7fbc02d70640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbfc107d60 0x7fbbfc10cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56560/0 (socket says 172.21.15.22:56560) 2024-08-20T01:40:31.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.623+0000 7fbc01d6e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbfc1073e0 0x7fbbfc10c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:42046/0 (socket says 172.21.15.22:42046) 2024-08-20T01:40:31.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.623+0000 7fbc02d70640 1 -- 172.21.15.22:0/4196541186 learned_addr learned my addr 172.21.15.22:0/4196541186 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:31.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.623+0000 7fbc0256f640 1 --2- 172.21.15.22:0/4196541186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbfc1019d0 0x7fbbfc10e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:31.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.623+0000 7fbc02d70640 1 -- 172.21.15.22:0/4196541186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbfc1073e0 msgr2=0x7fbbfc10c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:31.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.623+0000 7fbc02d70640 1 --2- 172.21.15.22:0/4196541186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbfc1073e0 0x7fbbfc10c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.623+0000 7fbc02d70640 1 -- 172.21.15.22:0/4196541186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbfc1019d0 msgr2=0x7fbbfc10e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:31.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.623+0000 7fbc02d70640 1 --2- 172.21.15.22:0/4196541186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbfc1019d0 0x7fbbfc10e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.623+0000 7fbc02d70640 1 -- 172.21.15.22:0/4196541186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbfc1ab920 con 0x7fbbfc107d60 2024-08-20T01:40:31.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.623+0000 7fbc02d70640 1 --2- 172.21.15.22:0/4196541186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbfc107d60 0x7fbbfc10cb40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400eb10 tx=0x7fbbf400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:31.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.623+0000 7fbbf37fe640 1 -- 172.21.15.22:0/4196541186 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4004b20 con 0x7fbbfc107d60 2024-08-20T01:40:31.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.623+0000 7fbbf37fe640 1 -- 172.21.15.22:0/4196541186 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbf4004cc0 con 0x7fbbfc107d60 2024-08-20T01:40:31.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.623+0000 7fbc047d3640 1 -- 172.21.15.22:0/4196541186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbfc1abaf0 con 0x7fbbfc107d60 2024-08-20T01:40:31.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.624+0000 7fbbf37fe640 1 -- 172.21.15.22:0/4196541186 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4010670 con 0x7fbbfc107d60 2024-08-20T01:40:31.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.624+0000 7fbc047d3640 1 -- 172.21.15.22:0/4196541186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbfc1abfa0 con 0x7fbbfc107d60 2024-08-20T01:40:31.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.627+0000 7fbbf37fe640 1 -- 172.21.15.22:0/4196541186 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbbf4005020 con 0x7fbbfc107d60 2024-08-20T01:40:31.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.627+0000 7fbc06bcc740 1 Processor -- start 2024-08-20T01:40:31.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.628+0000 7fbc06bcc740 1 -- start start 2024-08-20T01:40:31.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.628+0000 7fbc06bcc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7ef9880 0x5639e7ef9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:31.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.628+0000 7fbc06bcc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7efa1a0 0x5639e7f05bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:31.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.628+0000 7fbc06bcc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7f06130 0x5639e7f08520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:31.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.628+0000 7fbc06bcc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5639e7e70930 con 0x5639e7efa1a0 2024-08-20T01:40:31.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.628+0000 7fbc06bcc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5639e7e5fe30 con 0x5639e7ef9880 2024-08-20T01:40:31.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.628+0000 7fbc06bcc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5639e7e63e70 con 0x5639e7f06130 2024-08-20T01:40:31.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.629+0000 7fbc0256f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7efa1a0 0x5639e7f05bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.629+0000 7fbc0256f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7efa1a0 0x5639e7f05bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56572/0 (socket says 172.21.15.22:56572) 2024-08-20T01:40:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.629+0000 7fbc0256f640 1 -- 172.21.15.22:0/3988009210 learned_addr learned my addr 172.21.15.22:0/3988009210 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.630+0000 7fbc01d6e640 1 --2- 172.21.15.22:0/3988009210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7ef9880 0x5639e7ef9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.630+0000 7fbc01d6e640 1 --2- 172.21.15.22:0/3988009210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7f06130 0x5639e7f08520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.630+0000 7fbc0256f640 1 -- 172.21.15.22:0/3988009210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7f06130 msgr2=0x5639e7f08520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.630+0000 7fbc0256f640 1 --2- 172.21.15.22:0/3988009210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7f06130 0x5639e7f08520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.630+0000 7fbc0256f640 1 -- 172.21.15.22:0/3988009210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7ef9880 msgr2=0x5639e7ef9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.630+0000 7fbc0256f640 1 --2- 172.21.15.22:0/3988009210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7ef9880 0x5639e7ef9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.630+0000 7fbc0256f640 1 -- 172.21.15.22:0/3988009210 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639e7bbf650 con 0x5639e7efa1a0 2024-08-20T01:40:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.631+0000 7fbc0256f640 1 --2- 172.21.15.22:0/3988009210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7efa1a0 0x5639e7f05bf0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009cc0 tx=0x7fbbf80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad39d9acad5b33a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.631+0000 7fbbf0ff9640 1 -- 172.21.15.22:0/3988009210 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf801b470 con 0x5639e7efa1a0 2024-08-20T01:40:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.631+0000 7fbbf0ff9640 1 -- 172.21.15.22:0/3988009210 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbf8016070 con 0x5639e7efa1a0 2024-08-20T01:40:31.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.631+0000 7fbbf0ff9640 1 -- 172.21.15.22:0/3988009210 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8012910 con 0x5639e7efa1a0 2024-08-20T01:40:31.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.631+0000 7fbbf37fe640 1 --2- 172.21.15.22:0/4196541186 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbbe80b3c50 0x7fbbe80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:31.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.631+0000 7fbbf37fe640 1 -- 172.21.15.22:0/4196541186 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fbbf40e4260 con 0x7fbbfc107d60 2024-08-20T01:40:31.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.632+0000 7fbc06bcc740 1 -- 172.21.15.22:0/3988009210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7efa1a0 msgr2=0x5639e7f05bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:31.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.632+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/3988009210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7efa1a0 0x5639e7f05bf0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009cc0 tx=0x7fbbf80117b0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.632+0000 7fbc06bcc740 1 -- 172.21.15.22:0/3988009210 shutdown_connections 2024-08-20T01:40:31.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.632+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/3988009210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7f06130 0x5639e7f08520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.632+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/3988009210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7efa1a0 0x5639e7f05bf0 secure :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009cc0 tx=0x7fbbf80117b0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.632+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/3988009210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7ef9880 0x5639e7ef9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.632+0000 7fbc06bcc740 1 -- 172.21.15.22:0/3988009210 >> 172.21.15.22:0/3988009210 conn(0x5639e7ef76b0 msgr2=0x5639e7ef8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:31.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.633+0000 7fbc01d6e640 1 --2- 172.21.15.22:0/4196541186 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbbe80b3c50 0x7fbbe80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:31.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.633+0000 7fbc06bcc740 1 -- 172.21.15.22:0/3988009210 shutdown_connections 2024-08-20T01:40:31.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.633+0000 7fbc06bcc740 1 -- 172.21.15.22:0/3988009210 wait complete. 2024-08-20T01:40:31.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.634+0000 7fbc01d6e640 1 --2- 172.21.15.22:0/4196541186 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbbe80b3c50 0x7fbbe80b6110 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbbec031440 tx=0x7fbbec005bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:31.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.634+0000 7fbc06bcc740 1 -- start start 2024-08-20T01:40:31.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.634+0000 7fbc06bcc740 1 Processor -- start 2024-08-20T01:40:31.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.634+0000 7fbc06bcc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7ef9880 0x5639e7f03340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:31.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.634+0000 7fbc06bcc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7f06130 0x5639e7f03880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:31.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.634+0000 7fbc06bcc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7f03dc0 0x5639e7f23120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:31.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.634+0000 7fbc06bcc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5639e7cc2700 con 0x5639e7f06130 2024-08-20T01:40:31.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.634+0000 7fbc06bcc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5639e7de6810 con 0x5639e7ef9880 2024-08-20T01:40:31.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.635+0000 7fbc06bcc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5639e7f19df0 con 0x5639e7f03dc0 2024-08-20T01:40:31.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.635+0000 7fbc01d6e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7f06130 0x5639e7f03880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:31.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.635+0000 7fbc0256f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7ef9880 0x5639e7f03340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:31.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.635+0000 7fbc01d6e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7f06130 0x5639e7f03880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56582/0 (socket says 172.21.15.22:56582) 2024-08-20T01:40:31.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.635+0000 7fbc01d6e640 1 -- 172.21.15.22:0/4185713579 learned_addr learned my addr 172.21.15.22:0/4185713579 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:31.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.635+0000 7fbc0256f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7ef9880 0x5639e7f03340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:50982/0 (socket says 172.21.15.22:50982) 2024-08-20T01:40:31.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.635+0000 7fbc06bcc740 10 client.0 _ll_register_callbacks cb 0x5639e7e59700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:31.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.635+0000 7fbc02d70640 1 --2- 172.21.15.22:0/4185713579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7f03dc0 0x5639e7f23120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:31.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.635+0000 7fbc01d6e640 1 -- 172.21.15.22:0/4185713579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7f03dc0 msgr2=0x5639e7f23120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:31.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.635+0000 7fbc01d6e640 1 --2- 172.21.15.22:0/4185713579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7f03dc0 0x5639e7f23120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.635+0000 7fbc01d6e640 1 -- 172.21.15.22:0/4185713579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7ef9880 msgr2=0x5639e7f03340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:31.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.635+0000 7fbc01d6e640 1 --2- 172.21.15.22:0/4185713579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7ef9880 0x5639e7f03340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.635+0000 7fbc01d6e640 1 -- 172.21.15.22:0/4185713579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639e7f23810 con 0x5639e7f06130 2024-08-20T01:40:31.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.635+0000 7fbc01d6e640 1 --2- 172.21.15.22:0/4185713579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7f06130 0x5639e7f03880 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fbbec033000 tx=0x7fbbec005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30142d37b8f92d28 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:31.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.635+0000 7fbbe5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:40:31.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.636+0000 7fbbe5ffb640 1 -- 172.21.15.22:0/4185713579 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec047040 con 0x5639e7f06130 2024-08-20T01:40:31.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.636+0000 7fbbe5ffb640 1 -- 172.21.15.22:0/4185713579 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fbbec004300 con 0x5639e7f06130 2024-08-20T01:40:31.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.636+0000 7fbc06bcc740 1 -- 172.21.15.22:0/4185713579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5639e7e0f150 con 0x5639e7f06130 2024-08-20T01:40:31.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.636+0000 7fbbe5ffb640 1 -- 172.21.15.22:0/4185713579 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbbec005020 con 0x5639e7f06130 2024-08-20T01:40:31.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.636+0000 7fbc06bcc740 10 client.17013 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:31.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.636+0000 7fbc06bcc740 1 -- 172.21.15.22:0/4185713579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5639e7f261a0 con 0x5639e7f06130 2024-08-20T01:40:31.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.636+0000 7fbbe5ffb640 1 -- 172.21.15.22:0/4185713579 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5639e7e0f150 con 0x5639e7f06130 2024-08-20T01:40:31.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.636+0000 7fbbe5ffb640 1 -- 172.21.15.22:0/4185713579 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fbbec04a070 con 0x5639e7f06130 2024-08-20T01:40:31.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.636+0000 7fbc06bcc740 10 client.17013 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:31.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.636+0000 7fbc06bcc740 10 client.17013 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:40:31.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.636+0000 7fbc06bcc740 20 client.17013 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:31.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.636+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/4185713579 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5639e7f27700 0x5639e7f29b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:31.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.636+0000 7fbc06bcc740 4 client.17013 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:31.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.636+0000 7fbc06bcc740 1 -- 172.21.15.22:0/4185713579 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639e7e72880 con 0x5639e7f27700 2024-08-20T01:40:31.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.637+0000 7fbc0256f640 1 --2- 172.21.15.22:0/4185713579 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5639e7f27700 0x5639e7f29b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:31.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.637+0000 7fbc0256f640 1 --2- 172.21.15.22:0/4185713579 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5639e7f27700 0x5639e7f29b90 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e45a89cdd6b3ba45 server_cookie=2bf97deee190647e in_seq=0 out_seq=0 2024-08-20T01:40:31.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.637+0000 7fbbe5ffb640 10 client.17013 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:31.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.638+0000 7fbbe5ffb640 1 -- 172.21.15.22:0/4185713579 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5639e7e72880 con 0x5639e7f27700 2024-08-20T01:40:31.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.638+0000 7fbbe5ffb640 10 client.17013 handle_command_reply: tid=0 2024-08-20T01:40:31.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.638+0000 7fbc06bcc740 1 client.17013 shutdown 2024-08-20T01:40:31.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.638+0000 7fbc06bcc740 1 -- 172.21.15.22:0/4185713579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7f06130 msgr2=0x5639e7f03880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:31.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.638+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/4185713579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7f06130 0x5639e7f03880 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fbbec033000 tx=0x7fbbec005b50 comp rx=0 tx=0).stop 2024-08-20T01:40:31.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.638+0000 7fbc06bcc740 1 -- 172.21.15.22:0/4185713579 shutdown_connections 2024-08-20T01:40:31.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.638+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/4185713579 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5639e7f27700 0x5639e7f29b90 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.638+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/4185713579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7f03dc0 0x5639e7f23120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.638+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/4185713579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7f06130 0x5639e7f03880 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.638+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/4185713579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7ef9880 0x5639e7f03340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.638+0000 7fbc06bcc740 1 -- 172.21.15.22:0/4185713579 >> 172.21.15.22:0/4185713579 conn(0x5639e7ef76b0 msgr2=0x5639e7efd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:31.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.638+0000 7fbbe5ffb640 0 client.17013 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:31.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.638+0000 7fbc06bcc740 1 -- 172.21.15.22:0/4185713579 shutdown_connections 2024-08-20T01:40:31.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.639+0000 7fbc06bcc740 1 -- 172.21.15.22:0/4185713579 wait complete. 2024-08-20T01:40:31.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.639+0000 7fbc06bcc740 20 client.17013 trim_cache size 0 max 16384 2024-08-20T01:40:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc06bcc740 1 Processor -- start 2024-08-20T01:40:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc06bcc740 1 -- start start 2024-08-20T01:40:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc06bcc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7ef9880 0x5639e7f22f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc06bcc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7f03dc0 0x5639e7f05080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc06bcc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7f023e0 0x5639e7f2f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc06bcc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc1ae120 con 0x5639e7f023e0 2024-08-20T01:40:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc06bcc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc1ae850 con 0x5639e7f03dc0 2024-08-20T01:40:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc06bcc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc074ee0 con 0x5639e7ef9880 2024-08-20T01:40:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc02d70640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7f023e0 0x5639e7f2f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc0256f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7ef9880 0x5639e7f22f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc02d70640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7f023e0 0x5639e7f2f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56590/0 (socket says 172.21.15.22:56590) 2024-08-20T01:40:31.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc02d70640 1 -- 172.21.15.22:0/401973326 learned_addr learned my addr 172.21.15.22:0/401973326 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:31.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc01d6e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7f03dc0 0x5639e7f05080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:31.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc01d6e640 1 -- 172.21.15.22:0/401973326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7ef9880 msgr2=0x5639e7f22f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:31.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc01d6e640 1 --2- 172.21.15.22:0/401973326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7ef9880 0x5639e7f22f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc01d6e640 1 -- 172.21.15.22:0/401973326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7f023e0 msgr2=0x5639e7f2f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:31.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc01d6e640 1 --2- 172.21.15.22:0/401973326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7f023e0 0x5639e7f2f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc01d6e640 1 -- 172.21.15.22:0/401973326 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639e7ef5af0 con 0x5639e7f03dc0 2024-08-20T01:40:31.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc0256f640 1 --2- 172.21.15.22:0/401973326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7ef9880 0x5639e7f22f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:31.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.652+0000 7fbc02d70640 1 --2- 172.21.15.22:0/401973326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7f023e0 0x5639e7f2f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:31.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.653+0000 7fbc01d6e640 1 --2- 172.21.15.22:0/401973326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7f03dc0 0x5639e7f05080 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbbec042000 tx=0x7fbbec02a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=861f6e23da7455e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:31.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.653+0000 7fbbe7fff640 1 -- 172.21.15.22:0/401973326 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec004750 con 0x5639e7f03dc0 2024-08-20T01:40:31.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.653+0000 7fbbe7fff640 1 -- 172.21.15.22:0/401973326 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbec043070 con 0x5639e7f03dc0 2024-08-20T01:40:31.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.653+0000 7fbbe7fff640 1 -- 172.21.15.22:0/401973326 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0035f0 con 0x5639e7f03dc0 2024-08-20T01:40:31.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.653+0000 7fbc06bcc740 1 -- 172.21.15.22:0/401973326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7f03dc0 msgr2=0x5639e7f05080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:31.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.653+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/401973326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7f03dc0 0x5639e7f05080 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbbec042000 tx=0x7fbbec02a410 comp rx=0 tx=0).stop 2024-08-20T01:40:31.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.653+0000 7fbc06bcc740 1 -- 172.21.15.22:0/401973326 shutdown_connections 2024-08-20T01:40:31.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.653+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/401973326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7f023e0 0x5639e7f2f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.653+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/401973326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7f03dc0 0x5639e7f05080 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.653+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/401973326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7ef9880 0x5639e7f22f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.653+0000 7fbc06bcc740 1 -- 172.21.15.22:0/401973326 >> 172.21.15.22:0/401973326 conn(0x5639e7ef76b0 msgr2=0x5639e7f04970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:31.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.653+0000 7fbc06bcc740 1 -- 172.21.15.22:0/401973326 shutdown_connections 2024-08-20T01:40:31.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.654+0000 7fbc06bcc740 1 -- 172.21.15.22:0/401973326 wait complete. 2024-08-20T01:40:31.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.654+0000 7fbc06bcc740 1 -- start start 2024-08-20T01:40:31.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.654+0000 7fbc06bcc740 1 Processor -- start 2024-08-20T01:40:31.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.654+0000 7fbc06bcc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7ef9880 0x5639e7f1f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:31.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.654+0000 7fbc06bcc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7f023e0 0x5639e7f1f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:31.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.654+0000 7fbc06bcc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7f03dc0 0x5639e7f1aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:31.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.654+0000 7fbc06bcc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc0733a0 con 0x5639e7ef9880 2024-08-20T01:40:31.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.654+0000 7fbc06bcc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc074810 con 0x5639e7f03dc0 2024-08-20T01:40:31.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.654+0000 7fbc06bcc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc073a70 con 0x5639e7f023e0 2024-08-20T01:40:31.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.654+0000 7fbc06bcc740 10 client.0 _ll_register_callbacks cb 0x7fbbec041070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:31.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.654+0000 7fbc0256f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7ef9880 0x5639e7f1f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:31.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.654+0000 7fbc0256f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7ef9880 0x5639e7f1f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56606/0 (socket says 172.21.15.22:56606) 2024-08-20T01:40:31.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.654+0000 7fbc0256f640 1 -- 172.21.15.22:0/4139413503 learned_addr learned my addr 172.21.15.22:0/4139413503 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:31.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.654+0000 7fbc01d6e640 1 --2- 172.21.15.22:0/4139413503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7f023e0 0x5639e7f1f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:31.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.654+0000 7fbc02d70640 1 --2- 172.21.15.22:0/4139413503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7f03dc0 0x5639e7f1aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:31.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.655+0000 7fbc0256f640 1 -- 172.21.15.22:0/4139413503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7f023e0 msgr2=0x5639e7f1f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:31.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.655+0000 7fbc0256f640 1 --2- 172.21.15.22:0/4139413503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7f023e0 0x5639e7f1f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.655+0000 7fbc0256f640 1 -- 172.21.15.22:0/4139413503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7f03dc0 msgr2=0x5639e7f1aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:31.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.655+0000 7fbc0256f640 1 --2- 172.21.15.22:0/4139413503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7f03dc0 0x5639e7f1aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.655+0000 7fbc0256f640 1 -- 172.21.15.22:0/4139413503 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639e7f1b320 con 0x5639e7ef9880 2024-08-20T01:40:31.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.655+0000 7fbc02d70640 1 --2- 172.21.15.22:0/4139413503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7f03dc0 0x5639e7f1aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:31.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.655+0000 7fbc0256f640 1 --2- 172.21.15.22:0/4139413503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7ef9880 0x5639e7f1f3d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009bb0 tx=0x7fbbf8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33677c04d0612079 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:31.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.655+0000 7fbbe5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:40:31.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.655+0000 7fbbe5ffb640 1 -- 172.21.15.22:0/4139413503 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8035060 con 0x5639e7ef9880 2024-08-20T01:40:31.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.655+0000 7fbbe5ffb640 1 -- 172.21.15.22:0/4139413503 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fbbf80054d0 con 0x5639e7ef9880 2024-08-20T01:40:31.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.655+0000 7fbc06bcc740 1 -- 172.21.15.22:0/4139413503 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbec043070 con 0x5639e7ef9880 2024-08-20T01:40:31.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.655+0000 7fbbe5ffb640 1 -- 172.21.15.22:0/4139413503 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbbf80056d0 con 0x5639e7ef9880 2024-08-20T01:40:31.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.655+0000 7fbc06bcc740 10 client.17019 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:31.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.655+0000 7fbc06bcc740 1 -- 172.21.15.22:0/4139413503 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5639e7f92180 con 0x5639e7ef9880 2024-08-20T01:40:31.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.655+0000 7fbbe5ffb640 1 -- 172.21.15.22:0/4139413503 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbec043070 con 0x5639e7ef9880 2024-08-20T01:40:31.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.656+0000 7fbbe5ffb640 1 -- 172.21.15.22:0/4139413503 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fbbf802f070 con 0x5639e7ef9880 2024-08-20T01:40:31.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.656+0000 7fbc06bcc740 10 client.17019 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:31.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.656+0000 7fbc06bcc740 10 client.17019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:40:31.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.656+0000 7fbc06bcc740 20 client.17019 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:31.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.656+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/4139413503 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5639e7f92680 0x5639e7f94aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:31.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.656+0000 7fbc06bcc740 4 client.17019 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:40:31.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.656+0000 7fbc06bcc740 1 -- 172.21.15.22:0/4139413503 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5639e7e6e320 con 0x5639e7f92680 2024-08-20T01:40:31.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.656+0000 7fbc01d6e640 1 --2- 172.21.15.22:0/4139413503 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5639e7f92680 0x5639e7f94aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:31.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.656+0000 7fbc01d6e640 1 --2- 172.21.15.22:0/4139413503 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5639e7f92680 0x5639e7f94aa0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebfec661172cbf3f server_cookie=e016234e1a7ad68a in_seq=0 out_seq=0 2024-08-20T01:40:31.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.656+0000 7fbbe5ffb640 10 client.17019 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:31.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.658+0000 7fbbe5ffb640 1 -- 172.21.15.22:0/4139413503 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5639e7e6e320 con 0x5639e7f92680 2024-08-20T01:40:31.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.658+0000 7fbbe5ffb640 10 client.17019 handle_command_reply: tid=0 2024-08-20T01:40:31.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.658+0000 7fbc06bcc740 1 client.17019 shutdown 2024-08-20T01:40:31.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.658+0000 7fbc06bcc740 1 -- 172.21.15.22:0/4139413503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7ef9880 msgr2=0x5639e7f1f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:31.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.658+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/4139413503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7ef9880 0x5639e7f1f3d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009bb0 tx=0x7fbbf8009f90 comp rx=0 tx=0).stop 2024-08-20T01:40:31.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.658+0000 7fbc06bcc740 1 -- 172.21.15.22:0/4139413503 shutdown_connections 2024-08-20T01:40:31.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.658+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/4139413503 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5639e7f92680 0x5639e7f94aa0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.658+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/4139413503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639e7f03dc0 0x5639e7f1aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.658+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/4139413503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5639e7f023e0 0x5639e7f1f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.658+0000 7fbbe5ffb640 0 client.17019 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:31.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.658+0000 7fbc06bcc740 1 --2- 172.21.15.22:0/4139413503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639e7ef9880 0x5639e7f1f3d0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.658+0000 7fbc06bcc740 1 -- 172.21.15.22:0/4139413503 >> 172.21.15.22:0/4139413503 conn(0x5639e7ef76b0 msgr2=0x5639e7f05190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:31.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.658+0000 7fbc06bcc740 1 -- 172.21.15.22:0/4139413503 shutdown_connections 2024-08-20T01:40:31.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.658+0000 7fbc06bcc740 1 -- 172.21.15.22:0/4139413503 wait complete. 2024-08-20T01:40:31.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.658+0000 7fbc06bcc740 20 client.17019 trim_cache size 0 max 16384 2024-08-20T01:40:31.665 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:40:31.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.659+0000 7fbc047d3640 1 -- 172.21.15.22:0/4196541186 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbbe80b3c50 msgr2=0x7fbbe80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:31.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.659+0000 7fbc047d3640 1 --2- 172.21.15.22:0/4196541186 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbbe80b3c50 0x7fbbe80b6110 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbbec031440 tx=0x7fbbec005bc0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.659+0000 7fbc047d3640 1 -- 172.21.15.22:0/4196541186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbfc107d60 msgr2=0x7fbbfc10cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:31.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.659+0000 7fbc047d3640 1 --2- 172.21.15.22:0/4196541186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbfc107d60 0x7fbbfc10cb40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400eb10 tx=0x7fbbf400c2d0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.659+0000 7fbc047d3640 1 -- 172.21.15.22:0/4196541186 shutdown_connections 2024-08-20T01:40:31.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.659+0000 7fbc047d3640 1 --2- 172.21.15.22:0/4196541186 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fbbe80b3c50 0x7fbbe80b6110 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.659+0000 7fbc047d3640 1 --2- 172.21.15.22:0/4196541186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbfc107d60 0x7fbbfc10cb40 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.659+0000 7fbc047d3640 1 --2- 172.21.15.22:0/4196541186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbfc1073e0 0x7fbbfc10c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.659+0000 7fbc047d3640 1 --2- 172.21.15.22:0/4196541186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbfc1019d0 0x7fbbfc10e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:31.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.659+0000 7fbc047d3640 1 -- 172.21.15.22:0/4196541186 >> 172.21.15.22:0/4196541186 conn(0x7fbbfc0fd440 msgr2=0x7fbbfc06b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:31.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.659+0000 7fbc047d3640 1 -- 172.21.15.22:0/4196541186 shutdown_connections 2024-08-20T01:40:31.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:31.659+0000 7fbc047d3640 1 -- 172.21.15.22:0/4196541186 wait complete. 2024-08-20T01:40:33.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:32 smithi022 ceph-mon[18709]: pgmap v628: 97 pgs: 97 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 422 op/s 2024-08-20T01:40:33.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:32 smithi134 ceph-mon[22511]: pgmap v628: 97 pgs: 97 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 422 op/s 2024-08-20T01:40:33.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:32 smithi077 ceph-mon[22251]: pgmap v628: 97 pgs: 97 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 422 op/s 2024-08-20T01:40:33.380 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:40:33.381 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:40:33.647 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:40:34.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.194+0000 7f262adf9640 1 -- 172.21.15.22:0/2845335635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26241084c0 msgr2=0x7f2624108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:34.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.194+0000 7f262adf9640 1 --2- 172.21.15.22:0/2845335635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26241084c0 0x7f2624108900 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2610009900 tx=0x7f261002a410 comp rx=0 tx=0).stop 2024-08-20T01:40:34.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.194+0000 7f262adf9640 1 -- 172.21.15.22:0/2845335635 shutdown_connections 2024-08-20T01:40:34.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.194+0000 7f262adf9640 1 --2- 172.21.15.22:0/2845335635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2624108e40 0x7f262410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.194+0000 7f262adf9640 1 --2- 172.21.15.22:0/2845335635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26241084c0 0x7f2624108900 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.194+0000 7f262adf9640 1 --2- 172.21.15.22:0/2845335635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2624102ab0 0x7f2624102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.194+0000 7f262adf9640 1 -- 172.21.15.22:0/2845335635 >> 172.21.15.22:0/2845335635 conn(0x7f26240fe500 msgr2=0x7f2624100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:34.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.194+0000 7f262adf9640 1 -- 172.21.15.22:0/2845335635 shutdown_connections 2024-08-20T01:40:34.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.194+0000 7f262adf9640 1 -- 172.21.15.22:0/2845335635 wait complete. 2024-08-20T01:40:34.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.194+0000 7f262adf9640 1 Processor -- start 2024-08-20T01:40:34.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.195+0000 7f262adf9640 1 -- start start 2024-08-20T01:40:34.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.195+0000 7f262adf9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2624102ab0 0x7f2624199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:34.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.195+0000 7f262adf9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26241084c0 0x7f2624199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:34.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.195+0000 7f262adf9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2624108e40 0x7f262419e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:34.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.195+0000 7f262adf9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2624112ac0 con 0x7f2624108e40 2024-08-20T01:40:34.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.195+0000 7f262adf9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2624112940 con 0x7f26241084c0 2024-08-20T01:40:34.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.195+0000 7f262adf9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2624112c40 con 0x7f2624102ab0 2024-08-20T01:40:34.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.195+0000 7f2628b95640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2624102ab0 0x7f2624199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:34.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.195+0000 7f2629396640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2624108e40 0x7f262419e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:34.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.195+0000 7f2628b95640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2624102ab0 0x7f2624199020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:42110/0 (socket says 172.21.15.22:42110) 2024-08-20T01:40:34.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.195+0000 7f2628b95640 1 -- 172.21.15.22:0/1987551787 learned_addr learned my addr 172.21.15.22:0/1987551787 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:34.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.195+0000 7f2623fff640 1 --2- 172.21.15.22:0/1987551787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26241084c0 0x7f2624199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:34.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.195+0000 7f2628b95640 1 -- 172.21.15.22:0/1987551787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26241084c0 msgr2=0x7f2624199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:34.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.195+0000 7f2628b95640 1 --2- 172.21.15.22:0/1987551787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26241084c0 0x7f2624199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.195+0000 7f2628b95640 1 -- 172.21.15.22:0/1987551787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2624108e40 msgr2=0x7f262419e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:34.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.195+0000 7f2628b95640 1 --2- 172.21.15.22:0/1987551787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2624108e40 0x7f262419e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.195+0000 7f2628b95640 1 -- 172.21.15.22:0/1987551787 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f262419f0d0 con 0x7f2624102ab0 2024-08-20T01:40:34.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.195+0000 7f2629396640 1 --2- 172.21.15.22:0/1987551787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2624108e40 0x7f262419e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:34.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.196+0000 7f2628b95640 1 --2- 172.21.15.22:0/1987551787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2624102ab0 0x7f2624199020 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f261800e9f0 tx=0x7f261800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:34.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.196+0000 7f2621ffb640 1 -- 172.21.15.22:0/1987551787 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261800cd80 con 0x7f2624102ab0 2024-08-20T01:40:34.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.196+0000 7f262adf9640 1 -- 172.21.15.22:0/1987551787 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f262419f3c0 con 0x7f2624102ab0 2024-08-20T01:40:34.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.196+0000 7f2621ffb640 1 -- 172.21.15.22:0/1987551787 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26180108e0 con 0x7f2624102ab0 2024-08-20T01:40:34.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.196+0000 7f2621ffb640 1 -- 172.21.15.22:0/1987551787 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2618018980 con 0x7f2624102ab0 2024-08-20T01:40:34.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.196+0000 7f262adf9640 1 -- 172.21.15.22:0/1987551787 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26241a5c50 con 0x7f2624102ab0 2024-08-20T01:40:34.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.198+0000 7f262d1f2740 1 Processor -- start 2024-08-20T01:40:34.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.198+0000 7f262d1f2740 1 -- start start 2024-08-20T01:40:34.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.199+0000 7f2621ffb640 1 -- 172.21.15.22:0/1987551787 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2618010430 con 0x7f2624102ab0 2024-08-20T01:40:34.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.199+0000 7f262d1f2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c13b0 0x56102c0c1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:34.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.199+0000 7f262d1f2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0c1cd0 0x56102c0d1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:34.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.199+0000 7f262d1f2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0d2070 0x56102c0d4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:34.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.199+0000 7f262d1f2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56102c037940 con 0x56102c0c13b0 2024-08-20T01:40:34.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.199+0000 7f262d1f2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56102c026e40 con 0x56102c0c1cd0 2024-08-20T01:40:34.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.199+0000 7f262d1f2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56102c02ae80 con 0x56102c0d2070 2024-08-20T01:40:34.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.199+0000 7f2629396640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c13b0 0x56102c0c1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:34.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.199+0000 7f2623fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0d2070 0x56102c0d4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:34.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.199+0000 7f2629396640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c13b0 0x56102c0c1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56622/0 (socket says 172.21.15.22:56622) 2024-08-20T01:40:34.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.199+0000 7f2629396640 1 -- 172.21.15.22:0/1046756625 learned_addr learned my addr 172.21.15.22:0/1046756625 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:34.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.199+0000 7f2623fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0d2070 0x56102c0d4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:42118/0 (socket says 172.21.15.22:42118) 2024-08-20T01:40:34.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.199+0000 7f2628b95640 1 --2- 172.21.15.22:0/1046756625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0c1cd0 0x56102c0d1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:34.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.199+0000 7f2623fff640 1 -- 172.21.15.22:0/1046756625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0c1cd0 msgr2=0x56102c0d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:34.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.199+0000 7f2623fff640 1 --2- 172.21.15.22:0/1046756625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0c1cd0 0x56102c0d1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.199+0000 7f2623fff640 1 -- 172.21.15.22:0/1046756625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c13b0 msgr2=0x56102c0c1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:34.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.199+0000 7f2623fff640 1 --2- 172.21.15.22:0/1046756625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c13b0 0x56102c0c1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.199+0000 7f2623fff640 1 -- 172.21.15.22:0/1046756625 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56102bfc3520 con 0x56102c0d2070 2024-08-20T01:40:34.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.200+0000 7f2623fff640 1 --2- 172.21.15.22:0/1046756625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0d2070 0x56102c0d4460 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2610009230 tx=0x7f2610032b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9278969a0c16fb2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:34.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.200+0000 7f2621ffb640 1 --2- 172.21.15.22:0/1987551787 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f26140b3bd0 0x7f26140b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:34.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.200+0000 7f260effd640 1 -- 172.21.15.22:0/1046756625 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610040070 con 0x56102c0d2070 2024-08-20T01:40:34.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.200+0000 7f260effd640 1 -- 172.21.15.22:0/1046756625 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2610004030 con 0x56102c0d2070 2024-08-20T01:40:34.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.200+0000 7f260effd640 1 -- 172.21.15.22:0/1046756625 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610035040 con 0x56102c0d2070 2024-08-20T01:40:34.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.200+0000 7f2629396640 1 --2- 172.21.15.22:0/1987551787 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f26140b3bd0 0x7f26140b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:34.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.200+0000 7f2621ffb640 1 -- 172.21.15.22:0/1987551787 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f26180e3f40 con 0x7f2624102ab0 2024-08-20T01:40:34.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.201+0000 7f262d1f2740 1 -- 172.21.15.22:0/1046756625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0d2070 msgr2=0x56102c0d4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:34.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.201+0000 7f262d1f2740 1 --2- 172.21.15.22:0/1046756625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0d2070 0x56102c0d4460 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2610009230 tx=0x7f2610032b20 comp rx=0 tx=0).stop 2024-08-20T01:40:34.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.201+0000 7f2629396640 1 --2- 172.21.15.22:0/1987551787 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f26140b3bd0 0x7f26140b6090 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f261c009fd0 tx=0x7f261c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:34.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.201+0000 7f262d1f2740 1 -- 172.21.15.22:0/1046756625 shutdown_connections 2024-08-20T01:40:34.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.201+0000 7f262d1f2740 1 --2- 172.21.15.22:0/1046756625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0d2070 0x56102c0d4460 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.201+0000 7f262d1f2740 1 --2- 172.21.15.22:0/1046756625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0c1cd0 0x56102c0d1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.201+0000 7f262d1f2740 1 --2- 172.21.15.22:0/1046756625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c13b0 0x56102c0c1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.201+0000 7f262d1f2740 1 -- 172.21.15.22:0/1046756625 >> 172.21.15.22:0/1046756625 conn(0x56102c0bf1e0 msgr2=0x56102c0c0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:34.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.201+0000 7f262d1f2740 1 -- 172.21.15.22:0/1046756625 shutdown_connections 2024-08-20T01:40:34.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.201+0000 7f262d1f2740 1 -- 172.21.15.22:0/1046756625 wait complete. 2024-08-20T01:40:34.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.202+0000 7f262d1f2740 1 -- start start 2024-08-20T01:40:34.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.202+0000 7f262d1f2740 1 Processor -- start 2024-08-20T01:40:34.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.202+0000 7f262d1f2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0c13b0 0x56102c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:34.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.202+0000 7f262d1f2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c1cd0 0x56102c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:34.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.202+0000 7f262d1f2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0d2070 0x56102c0cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:34.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.202+0000 7f262d1f2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56102be89890 con 0x56102c0c1cd0 2024-08-20T01:40:34.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.202+0000 7f262d1f2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56102bfad700 con 0x56102c0d2070 2024-08-20T01:40:34.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.202+0000 7f262d1f2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56102c0d4d60 con 0x56102c0c13b0 2024-08-20T01:40:34.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.202+0000 7f262d1f2740 10 client.0 _ll_register_callbacks cb 0x56102c0226f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:34.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.202+0000 7f2628b95640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0c13b0 0x56102c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.203+0000 7f2623fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c1cd0 0x56102c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.203+0000 7f2628b95640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0c13b0 0x56102c0cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:42122/0 (socket says 172.21.15.22:42122) 2024-08-20T01:40:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.203+0000 7f2623fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c1cd0 0x56102c0cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56638/0 (socket says 172.21.15.22:56638) 2024-08-20T01:40:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.203+0000 7f2628b95640 1 -- 172.21.15.22:0/675246310 learned_addr learned my addr 172.21.15.22:0/675246310 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.203+0000 7f2629396640 1 --2- 172.21.15.22:0/675246310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0d2070 0x56102c0cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.203+0000 7f2628b95640 1 -- 172.21.15.22:0/675246310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0d2070 msgr2=0x56102c0cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.203+0000 7f2628b95640 1 --2- 172.21.15.22:0/675246310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0d2070 0x56102c0cfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.203+0000 7f2628b95640 1 -- 172.21.15.22:0/675246310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c1cd0 msgr2=0x56102c0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.203+0000 7f2628b95640 1 --2- 172.21.15.22:0/675246310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c1cd0 0x56102c0cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.203+0000 7f2628b95640 1 -- 172.21.15.22:0/675246310 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56102bd86930 con 0x56102c0c13b0 2024-08-20T01:40:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.203+0000 7f2623fff640 1 --2- 172.21.15.22:0/675246310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c1cd0 0x56102c0cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.203+0000 7f2628b95640 1 --2- 172.21.15.22:0/675246310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0c13b0 0x56102c0cefa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f261800c6a0 tx=0x7f26180e7610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5a0322479fafa23 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.203+0000 7f2603fff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:40:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.203+0000 7f2603fff640 1 -- 172.21.15.22:0/675246310 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2618010720 con 0x56102c0c13b0 2024-08-20T01:40:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.203+0000 7f2603fff640 1 -- 172.21.15.22:0/675246310 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f26180e6110 con 0x56102c0c13b0 2024-08-20T01:40:34.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.203+0000 7f262d1f2740 1 -- 172.21.15.22:0/675246310 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2610004030 con 0x56102c0c13b0 2024-08-20T01:40:34.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.203+0000 7f2603fff640 1 -- 172.21.15.22:0/675246310 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f26180af250 con 0x56102c0c13b0 2024-08-20T01:40:34.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.204+0000 7f262d1f2740 10 client.26668 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:34.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.204+0000 7f262d1f2740 1 -- 172.21.15.22:0/675246310 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56102c0e0880 con 0x56102c0c13b0 2024-08-20T01:40:34.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.204+0000 7f2603fff640 1 -- 172.21.15.22:0/675246310 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26180ad020 con 0x56102c0c13b0 2024-08-20T01:40:34.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.204+0000 7f2603fff640 1 -- 172.21.15.22:0/675246310 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f26180b3a70 con 0x56102c0c13b0 2024-08-20T01:40:34.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.204+0000 7f262d1f2740 10 client.26668 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:34.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.204+0000 7f262d1f2740 10 client.26668 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:40:34.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.204+0000 7f262d1f2740 20 client.26668 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:34.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.204+0000 7f262d1f2740 1 --2- 172.21.15.22:0/675246310 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56102c0e1d90 0x56102c0e4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:34.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.204+0000 7f262d1f2740 4 client.26668 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:34.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.204+0000 7f262d1f2740 1 -- 172.21.15.22:0/675246310 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56102c039890 con 0x56102c0e1d90 2024-08-20T01:40:34.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.204+0000 7f2623fff640 1 --2- 172.21.15.22:0/675246310 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56102c0e1d90 0x56102c0e4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.205+0000 7f2603fff640 10 client.26668 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.205+0000 7f2623fff640 1 --2- 172.21.15.22:0/675246310 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56102c0e1d90 0x56102c0e4230 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e985518f39498201 server_cookie=4c82b48500299286 in_seq=0 out_seq=0 2024-08-20T01:40:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.206+0000 7f2603fff640 1 -- 172.21.15.22:0/675246310 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56102c039890 con 0x56102c0e1d90 2024-08-20T01:40:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.206+0000 7f2603fff640 10 client.26668 handle_command_reply: tid=0 2024-08-20T01:40:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.206+0000 7f262d1f2740 1 client.26668 shutdown 2024-08-20T01:40:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.206+0000 7f262d1f2740 1 -- 172.21.15.22:0/675246310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0c13b0 msgr2=0x56102c0cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.206+0000 7f262d1f2740 1 --2- 172.21.15.22:0/675246310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0c13b0 0x56102c0cefa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f261800c6a0 tx=0x7f26180e7610 comp rx=0 tx=0).stop 2024-08-20T01:40:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.206+0000 7f262d1f2740 1 -- 172.21.15.22:0/675246310 shutdown_connections 2024-08-20T01:40:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.206+0000 7f262d1f2740 1 --2- 172.21.15.22:0/675246310 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56102c0e1d90 0x56102c0e4230 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.206+0000 7f262d1f2740 1 --2- 172.21.15.22:0/675246310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0d2070 0x56102c0cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.206+0000 7f2603fff640 0 client.26668 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.206+0000 7f262d1f2740 1 --2- 172.21.15.22:0/675246310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c1cd0 0x56102c0cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.206+0000 7f262d1f2740 1 --2- 172.21.15.22:0/675246310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0c13b0 0x56102c0cefa0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.206+0000 7f262d1f2740 1 -- 172.21.15.22:0/675246310 >> 172.21.15.22:0/675246310 conn(0x56102c0bf1e0 msgr2=0x56102c0c4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.206+0000 7f262d1f2740 1 -- 172.21.15.22:0/675246310 shutdown_connections 2024-08-20T01:40:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.206+0000 7f262d1f2740 1 -- 172.21.15.22:0/675246310 wait complete. 2024-08-20T01:40:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.207+0000 7f262d1f2740 20 client.26668 trim_cache size 0 max 16384 2024-08-20T01:40:34.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.225+0000 7f262d1f2740 1 Processor -- start 2024-08-20T01:40:34.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.225+0000 7f262d1f2740 1 -- start start 2024-08-20T01:40:34.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.225+0000 7f262d1f2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0c13b0 0x56102c0ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:34.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.225+0000 7f262d1f2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0c1cd0 0x56102c0c08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:34.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.225+0000 7f262d1f2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0d2070 0x56102c0cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:34.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.225+0000 7f262d1f2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f26241ae9c0 con 0x56102c0d2070 2024-08-20T01:40:34.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.225+0000 7f262d1f2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f26241ac1d0 con 0x56102c0c1cd0 2024-08-20T01:40:34.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.225+0000 7f262d1f2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f26241aa020 con 0x56102c0c13b0 2024-08-20T01:40:34.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.225+0000 7f2629396640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0d2070 0x56102c0cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:34.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.225+0000 7f2629396640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0d2070 0x56102c0cf620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56654/0 (socket says 172.21.15.22:56654) 2024-08-20T01:40:34.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.225+0000 7f2629396640 1 -- 172.21.15.22:0/1778351369 learned_addr learned my addr 172.21.15.22:0/1778351369 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:34.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.225+0000 7f2628b95640 1 --2- 172.21.15.22:0/1778351369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0c13b0 0x56102c0ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:34.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.225+0000 7f2623fff640 1 --2- 172.21.15.22:0/1778351369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0c1cd0 0x56102c0c08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:34.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.226+0000 7f2629396640 1 -- 172.21.15.22:0/1778351369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0c13b0 msgr2=0x56102c0ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:34.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.226+0000 7f2629396640 1 --2- 172.21.15.22:0/1778351369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0c13b0 0x56102c0ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.226+0000 7f2629396640 1 -- 172.21.15.22:0/1778351369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0c1cd0 msgr2=0x56102c0c08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:34.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.226+0000 7f2629396640 1 --2- 172.21.15.22:0/1778351369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0c1cd0 0x56102c0c08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.226+0000 7f2629396640 1 -- 172.21.15.22:0/1778351369 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56102c0cd4a0 con 0x56102c0d2070 2024-08-20T01:40:34.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.226+0000 7f2629396640 1 --2- 172.21.15.22:0/1778351369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0d2070 0x56102c0cf620 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f261c012520 tx=0x7f261c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62640fa2a4ee59a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:34.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.226+0000 7f260e7fc640 1 -- 172.21.15.22:0/1778351369 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c0119c0 con 0x56102c0d2070 2024-08-20T01:40:34.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.226+0000 7f260e7fc640 1 -- 172.21.15.22:0/1778351369 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f261c003e20 con 0x56102c0d2070 2024-08-20T01:40:34.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.226+0000 7f260e7fc640 1 -- 172.21.15.22:0/1778351369 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c004620 con 0x56102c0d2070 2024-08-20T01:40:34.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.227+0000 7f262d1f2740 1 -- 172.21.15.22:0/1778351369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0d2070 msgr2=0x56102c0cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:34.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.227+0000 7f262d1f2740 1 --2- 172.21.15.22:0/1778351369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0d2070 0x56102c0cf620 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f261c012520 tx=0x7f261c01a000 comp rx=0 tx=0).stop 2024-08-20T01:40:34.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.227+0000 7f262d1f2740 1 -- 172.21.15.22:0/1778351369 shutdown_connections 2024-08-20T01:40:34.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.227+0000 7f262d1f2740 1 --2- 172.21.15.22:0/1778351369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0d2070 0x56102c0cf620 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.227+0000 7f262d1f2740 1 --2- 172.21.15.22:0/1778351369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0c1cd0 0x56102c0c08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.227+0000 7f262d1f2740 1 --2- 172.21.15.22:0/1778351369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0c13b0 0x56102c0ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.227+0000 7f262d1f2740 1 -- 172.21.15.22:0/1778351369 >> 172.21.15.22:0/1778351369 conn(0x56102c0bf1e0 msgr2=0x56102c0cef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:34.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.227+0000 7f262d1f2740 1 -- 172.21.15.22:0/1778351369 shutdown_connections 2024-08-20T01:40:34.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.227+0000 7f262d1f2740 1 -- 172.21.15.22:0/1778351369 wait complete. 2024-08-20T01:40:34.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.227+0000 7f262d1f2740 1 -- start start 2024-08-20T01:40:34.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.227+0000 7f262d1f2740 1 Processor -- start 2024-08-20T01:40:34.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f262d1f2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c13b0 0x56102c0d9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:34.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f262d1f2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0c1cd0 0x56102c0da530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:34.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f262d1f2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0d2070 0x56102c0d6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:34.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f262d1f2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f26241aa690 con 0x56102c0c13b0 2024-08-20T01:40:34.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f262d1f2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f26241abb00 con 0x56102c0c1cd0 2024-08-20T01:40:34.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f262d1f2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f26241aad60 con 0x56102c0d2070 2024-08-20T01:40:34.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f262d1f2740 10 client.0 _ll_register_callbacks cb 0x7f26180e7710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:34.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f2628b95640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c13b0 0x56102c0d9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:34.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f2628b95640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c13b0 0x56102c0d9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56658/0 (socket says 172.21.15.22:56658) 2024-08-20T01:40:34.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f2628b95640 1 -- 172.21.15.22:0/3517605663 learned_addr learned my addr 172.21.15.22:0/3517605663 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:34.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f2629396640 1 --2- 172.21.15.22:0/3517605663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0d2070 0x56102c0d6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:34.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f2623fff640 1 --2- 172.21.15.22:0/3517605663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0c1cd0 0x56102c0da530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:34.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f2628b95640 1 -- 172.21.15.22:0/3517605663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0d2070 msgr2=0x56102c0d6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:34.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f2628b95640 1 --2- 172.21.15.22:0/3517605663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0d2070 0x56102c0d6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f2628b95640 1 -- 172.21.15.22:0/3517605663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0c1cd0 msgr2=0x56102c0da530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:34.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f2628b95640 1 --2- 172.21.15.22:0/3517605663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0c1cd0 0x56102c0da530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f2628b95640 1 -- 172.21.15.22:0/3517605663 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56102c0d7580 con 0x56102c0c13b0 2024-08-20T01:40:34.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f2628b95640 1 --2- 172.21.15.22:0/3517605663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c13b0 0x56102c0d9ff0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f261800e9c0 tx=0x7f26180e7680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9f073c7aaeddb5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:34.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f2603fff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:40:34.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.228+0000 7f2603fff640 1 -- 172.21.15.22:0/3517605663 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26180a6dc0 con 0x56102c0c13b0 2024-08-20T01:40:34.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.229+0000 7f262d1f2740 1 -- 172.21.15.22:0/3517605663 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f261c003e20 con 0x56102c0c13b0 2024-08-20T01:40:34.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.229+0000 7f2603fff640 1 -- 172.21.15.22:0/3517605663 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f26180a74f0 con 0x56102c0c13b0 2024-08-20T01:40:34.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.229+0000 7f2603fff640 1 -- 172.21.15.22:0/3517605663 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f26180aa850 con 0x56102c0c13b0 2024-08-20T01:40:34.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.229+0000 7f262d1f2740 10 client.17037 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:34.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.229+0000 7f262d1f2740 1 -- 172.21.15.22:0/3517605663 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56102c14d3c0 con 0x56102c0c13b0 2024-08-20T01:40:34.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.229+0000 7f2603fff640 1 -- 172.21.15.22:0/3517605663 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f261c003e20 con 0x56102c0c13b0 2024-08-20T01:40:34.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.229+0000 7f2603fff640 1 -- 172.21.15.22:0/3517605663 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f2618018b20 con 0x56102c0c13b0 2024-08-20T01:40:34.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.229+0000 7f262d1f2740 10 client.17037 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:34.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.229+0000 7f262d1f2740 10 client.17037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:40:34.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.229+0000 7f262d1f2740 20 client.17037 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:34.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.229+0000 7f262d1f2740 1 --2- 172.21.15.22:0/3517605663 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56102c14dbf0 0x56102c150010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:34.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.229+0000 7f262d1f2740 4 client.17037 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:40:34.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.229+0000 7f262d1f2740 1 -- 172.21.15.22:0/3517605663 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56102c035330 con 0x56102c14dbf0 2024-08-20T01:40:34.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.229+0000 7f2623fff640 1 --2- 172.21.15.22:0/3517605663 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56102c14dbf0 0x56102c150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:34.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.230+0000 7f2603fff640 10 client.17037 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:34.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.230+0000 7f2623fff640 1 --2- 172.21.15.22:0/3517605663 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56102c14dbf0 0x56102c150010 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d23cdc39ea4cbee8 server_cookie=12668c034b4a980a in_seq=0 out_seq=0 2024-08-20T01:40:34.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.240+0000 7f2603fff640 1 -- 172.21.15.22:0/3517605663 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56102c035330 con 0x56102c14dbf0 2024-08-20T01:40:34.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.240+0000 7f2603fff640 10 client.17037 handle_command_reply: tid=0 2024-08-20T01:40:34.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.241+0000 7f262d1f2740 1 client.17037 shutdown 2024-08-20T01:40:34.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.241+0000 7f262d1f2740 1 -- 172.21.15.22:0/3517605663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c13b0 msgr2=0x56102c0d9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:34.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.241+0000 7f262d1f2740 1 --2- 172.21.15.22:0/3517605663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c13b0 0x56102c0d9ff0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f261800e9c0 tx=0x7f26180e7680 comp rx=0 tx=0).stop 2024-08-20T01:40:34.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.241+0000 7f262d1f2740 1 -- 172.21.15.22:0/3517605663 shutdown_connections 2024-08-20T01:40:34.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.241+0000 7f262d1f2740 1 --2- 172.21.15.22:0/3517605663 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56102c14dbf0 0x56102c150010 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.241+0000 7f262d1f2740 1 --2- 172.21.15.22:0/3517605663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56102c0d2070 0x56102c0d6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.241+0000 7f262d1f2740 1 --2- 172.21.15.22:0/3517605663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56102c0c1cd0 0x56102c0da530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.241+0000 7f2603fff640 0 client.17037 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:34.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.241+0000 7f262d1f2740 1 --2- 172.21.15.22:0/3517605663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56102c0c13b0 0x56102c0d9ff0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.241+0000 7f262d1f2740 1 -- 172.21.15.22:0/3517605663 >> 172.21.15.22:0/3517605663 conn(0x56102c0bf1e0 msgr2=0x56102c0d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:34.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.241+0000 7f262d1f2740 1 -- 172.21.15.22:0/3517605663 shutdown_connections 2024-08-20T01:40:34.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.241+0000 7f262d1f2740 1 -- 172.21.15.22:0/3517605663 wait complete. 2024-08-20T01:40:34.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.241+0000 7f262d1f2740 20 client.17037 trim_cache size 0 max 16384 2024-08-20T01:40:34.244 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:40:34.245 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-08-20T01:40:34.245 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "f6894cae-035b-4390-bab1-73fc709601d5", 2024-08-20T01:40:34.245 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-08-20T01:40:34.245 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:40:34.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.242+0000 7f262adf9640 1 -- 172.21.15.22:0/1987551787 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f26140b3bd0 msgr2=0x7f26140b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:34.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.242+0000 7f262adf9640 1 --2- 172.21.15.22:0/1987551787 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f26140b3bd0 0x7f26140b6090 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f261c009fd0 tx=0x7f261c009500 comp rx=0 tx=0).stop 2024-08-20T01:40:34.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.242+0000 7f262adf9640 1 -- 172.21.15.22:0/1987551787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2624102ab0 msgr2=0x7f2624199020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:34.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.242+0000 7f262adf9640 1 --2- 172.21.15.22:0/1987551787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2624102ab0 0x7f2624199020 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f261800e9f0 tx=0x7f261800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.242+0000 7f262adf9640 1 -- 172.21.15.22:0/1987551787 shutdown_connections 2024-08-20T01:40:34.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.242+0000 7f262adf9640 1 --2- 172.21.15.22:0/1987551787 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f26140b3bd0 0x7f26140b6090 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.242+0000 7f262adf9640 1 --2- 172.21.15.22:0/1987551787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2624108e40 0x7f262419e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.242+0000 7f262adf9640 1 --2- 172.21.15.22:0/1987551787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26241084c0 0x7f2624199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.242+0000 7f262adf9640 1 --2- 172.21.15.22:0/1987551787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2624102ab0 0x7f2624199020 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:34.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.242+0000 7f262adf9640 1 -- 172.21.15.22:0/1987551787 >> 172.21.15.22:0/1987551787 conn(0x7f26240fe500 msgr2=0x7f26241008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:34.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.242+0000 7f262adf9640 1 -- 172.21.15.22:0/1987551787 shutdown_connections 2024-08-20T01:40:34.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:34.242+0000 7f262adf9640 1 -- 172.21.15.22:0/1987551787 wait complete. 2024-08-20T01:40:35.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:34 smithi022 ceph-mon[18709]: pgmap v629: 97 pgs: 97 active+clean; 1009 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 447 op/s 2024-08-20T01:40:35.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:34 smithi022 ceph-mon[18709]: scrub queued for path: / 2024-08-20T01:40:35.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:34 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:35.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:34 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:40:35.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:34 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:40:35.208 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:40:35.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:34 smithi134 ceph-mon[22511]: pgmap v629: 97 pgs: 97 active+clean; 1009 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 447 op/s 2024-08-20T01:40:35.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:34 smithi134 ceph-mon[22511]: scrub queued for path: / 2024-08-20T01:40:35.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:34 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:35.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:34 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:40:35.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:34 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:40:35.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:34 smithi077 ceph-mon[22251]: pgmap v629: 97 pgs: 97 active+clean; 1009 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 447 op/s 2024-08-20T01:40:35.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:34 smithi077 ceph-mon[22251]: scrub queued for path: / 2024-08-20T01:40:35.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:34 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:35.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:34 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:40:35.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:34 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:40:35.543 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:40:35.968 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:35 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:40:35.968 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:35 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:36.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.067+0000 7f3f808dc640 1 -- 172.21.15.22:0/76164083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f7c108e20 msgr2=0x7f3f7c10f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:36.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.067+0000 7f3f808dc640 1 --2- 172.21.15.22:0/76164083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f7c108e20 0x7f3f7c10f620 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f3f74009ca0 tx=0x7f3f7402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.067+0000 7f3f808dc640 1 -- 172.21.15.22:0/76164083 shutdown_connections 2024-08-20T01:40:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.067+0000 7f3f808dc640 1 --2- 172.21.15.22:0/76164083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f7c108e20 0x7f3f7c10f620 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.067+0000 7f3f808dc640 1 --2- 172.21.15.22:0/76164083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f7c1084a0 0x7f3f7c1088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.067+0000 7f3f808dc640 1 --2- 172.21.15.22:0/76164083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f7c102a90 0x7f3f7c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.067+0000 7f3f808dc640 1 -- 172.21.15.22:0/76164083 >> 172.21.15.22:0/76164083 conn(0x7f3f7c0fe540 msgr2=0x7f3f7c100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.067+0000 7f3f808dc640 1 -- 172.21.15.22:0/76164083 shutdown_connections 2024-08-20T01:40:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.067+0000 7f3f808dc640 1 -- 172.21.15.22:0/76164083 wait complete. 2024-08-20T01:40:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.068+0000 7f3f808dc640 1 Processor -- start 2024-08-20T01:40:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.068+0000 7f3f808dc640 1 -- start start 2024-08-20T01:40:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.069+0000 7f3f808dc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f7c102a90 0x7f3f7c0751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.069+0000 7f3f808dc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f7c1084a0 0x7f3f7c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.069+0000 7f3f808dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f7c108e20 0x7f3f7c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.069+0000 7f3f808dc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c112ae0 con 0x7f3f7c108e20 2024-08-20T01:40:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.069+0000 7f3f808dc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c112960 con 0x7f3f7c102a90 2024-08-20T01:40:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.069+0000 7f3f808dc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c112c60 con 0x7f3f7c1084a0 2024-08-20T01:40:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.069+0000 7f3f79d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f7c1084a0 0x7f3f7c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.069+0000 7f3f79d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f7c1084a0 0x7f3f7c075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:42170/0 (socket says 172.21.15.22:42170) 2024-08-20T01:40:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.069+0000 7f3f79d9b640 1 -- 172.21.15.22:0/1925068214 learned_addr learned my addr 172.21.15.22:0/1925068214 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.069+0000 7f3f7a59c640 1 --2- 172.21.15.22:0/1925068214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f7c102a90 0x7f3f7c0751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.069+0000 7f3f7ad9d640 1 --2- 172.21.15.22:0/1925068214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f7c108e20 0x7f3f7c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.069+0000 7f3f7ad9d640 1 -- 172.21.15.22:0/1925068214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f7c1084a0 msgr2=0x7f3f7c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.069+0000 7f3f7ad9d640 1 --2- 172.21.15.22:0/1925068214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f7c1084a0 0x7f3f7c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.069+0000 7f3f7ad9d640 1 -- 172.21.15.22:0/1925068214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f7c102a90 msgr2=0x7f3f7c0751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.069+0000 7f3f7ad9d640 1 --2- 172.21.15.22:0/1925068214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f7c102a90 0x7f3f7c0751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.069+0000 7f3f7ad9d640 1 -- 172.21.15.22:0/1925068214 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7c1a7310 con 0x7f3f7c108e20 2024-08-20T01:40:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.070+0000 7f3f7ad9d640 1 --2- 172.21.15.22:0/1925068214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f7c108e20 0x7f3f7c075c50 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3f7402ade0 tx=0x7f3f74031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.070+0000 7f3f6b7fe640 1 -- 172.21.15.22:0/1925068214 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f74003b70 con 0x7f3f7c108e20 2024-08-20T01:40:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.070+0000 7f3f6b7fe640 1 -- 172.21.15.22:0/1925068214 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f74031910 con 0x7f3f7c108e20 2024-08-20T01:40:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.070+0000 7f3f808dc640 1 -- 172.21.15.22:0/1925068214 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f7c1a75a0 con 0x7f3f7c108e20 2024-08-20T01:40:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.070+0000 7f3f808dc640 1 -- 172.21.15.22:0/1925068214 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f7c1a7b30 con 0x7f3f7c108e20 2024-08-20T01:40:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.070+0000 7f3f6b7fe640 1 -- 172.21.15.22:0/1925068214 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7402f950 con 0x7f3f7c108e20 2024-08-20T01:40:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.073+0000 7f3f82cd5740 1 Processor -- start 2024-08-20T01:40:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.074+0000 7f3f6b7fe640 1 -- 172.21.15.22:0/1925068214 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3f7402faf0 con 0x7f3f7c108e20 2024-08-20T01:40:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.074+0000 7f3f82cd5740 1 -- start start 2024-08-20T01:40:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.074+0000 7f3f82cd5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a0b830 0x55ee69a0bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.074+0000 7f3f82cd5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a0c150 0x55ee69a17ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.074+0000 7f3f82cd5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a180e0 0x55ee69a1a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.074+0000 7f3f82cd5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ee699828e0 con 0x55ee69a0c150 2024-08-20T01:40:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.074+0000 7f3f82cd5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ee69971de0 con 0x55ee69a0b830 2024-08-20T01:40:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.074+0000 7f3f82cd5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ee69975e20 con 0x55ee69a180e0 2024-08-20T01:40:36.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.075+0000 7f3f7a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a0c150 0x55ee69a17ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:36.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.075+0000 7f3f79d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a0b830 0x55ee69a0bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:36.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.075+0000 7f3f79d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a0b830 0x55ee69a0bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:51102/0 (socket says 172.21.15.22:51102) 2024-08-20T01:40:36.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.075+0000 7f3f79d9b640 1 -- 172.21.15.22:0/4291555794 learned_addr learned my addr 172.21.15.22:0/4291555794 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:36.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.075+0000 7f3f79d9b640 1 --2- 172.21.15.22:0/4291555794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a180e0 0x55ee69a1a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.075+0000 7f3f79d9b640 1 -- 172.21.15.22:0/4291555794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a180e0 msgr2=0x55ee69a1a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.075+0000 7f3f79d9b640 1 --2- 172.21.15.22:0/4291555794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a180e0 0x55ee69a1a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.075+0000 7f3f79d9b640 1 -- 172.21.15.22:0/4291555794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a0c150 msgr2=0x55ee69a17ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.075+0000 7f3f79d9b640 1 --2- 172.21.15.22:0/4291555794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a0c150 0x55ee69a17ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.075+0000 7f3f79d9b640 1 -- 172.21.15.22:0/4291555794 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee696d1650 con 0x55ee69a0b830 2024-08-20T01:40:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.075+0000 7f3f6b7fe640 1 --2- 172.21.15.22:0/1925068214 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3f640b3c50 0x7f3f640b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.075+0000 7f3f79d9b640 1 --2- 172.21.15.22:0/4291555794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a0b830 0x55ee69a0bc10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3f700118d0 tx=0x7f3f70004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=986754b46e39418c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.075+0000 7f3f7a59c640 1 --2- 172.21.15.22:0/1925068214 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3f640b3c50 0x7f3f640b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.075+0000 7f3f68ff9640 1 -- 172.21.15.22:0/4291555794 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f70005020 con 0x55ee69a0b830 2024-08-20T01:40:36.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.075+0000 7f3f6b7fe640 1 -- 172.21.15.22:0/1925068214 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f3f74104e30 con 0x7f3f7c108e20 2024-08-20T01:40:36.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.075+0000 7f3f68ff9640 1 -- 172.21.15.22:0/4291555794 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f700047a0 con 0x55ee69a0b830 2024-08-20T01:40:36.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.076+0000 7f3f68ff9640 1 -- 172.21.15.22:0/4291555794 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7000fa20 con 0x55ee69a0b830 2024-08-20T01:40:36.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.076+0000 7f3f82cd5740 1 -- 172.21.15.22:0/4291555794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a0b830 msgr2=0x55ee69a0bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:36.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.076+0000 7f3f7a59c640 1 --2- 172.21.15.22:0/1925068214 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3f640b3c50 0x7f3f640b6110 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x55ee69a0e9b0 tx=0x7f3f6c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:36.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.076+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/4291555794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a0b830 0x55ee69a0bc10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3f700118d0 tx=0x7f3f70004730 comp rx=0 tx=0).stop 2024-08-20T01:40:36.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.077+0000 7f3f82cd5740 1 -- 172.21.15.22:0/4291555794 shutdown_connections 2024-08-20T01:40:36.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.077+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/4291555794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a180e0 0x55ee69a1a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.077+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/4291555794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a0c150 0x55ee69a17ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.077+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/4291555794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a0b830 0x55ee69a0bc10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.077+0000 7f3f82cd5740 1 -- 172.21.15.22:0/4291555794 >> 172.21.15.22:0/4291555794 conn(0x55ee69a09660 msgr2=0x55ee69a0a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:36.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.077+0000 7f3f82cd5740 1 -- 172.21.15.22:0/4291555794 shutdown_connections 2024-08-20T01:40:36.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.077+0000 7f3f82cd5740 1 -- 172.21.15.22:0/4291555794 wait complete. 2024-08-20T01:40:36.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.077+0000 7f3f82cd5740 1 -- start start 2024-08-20T01:40:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.077+0000 7f3f82cd5740 1 Processor -- start 2024-08-20T01:40:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.078+0000 7f3f82cd5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a0b830 0x55ee69a15000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.078+0000 7f3f82cd5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a0c150 0x55ee69a15540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.078+0000 7f3f82cd5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a180e0 0x55ee69a15a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.078+0000 7f3f82cd5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ee697d4700 con 0x55ee69a0c150 2024-08-20T01:40:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.078+0000 7f3f82cd5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ee698f87c0 con 0x55ee69a180e0 2024-08-20T01:40:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.078+0000 7f3f82cd5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ee69a1ad90 con 0x55ee69a0b830 2024-08-20T01:40:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.078+0000 7f3f7a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a0b830 0x55ee69a15000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.078+0000 7f3f7a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a0b830 0x55ee69a15000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:42196/0 (socket says 172.21.15.22:42196) 2024-08-20T01:40:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.078+0000 7f3f7a59c640 1 -- 172.21.15.22:0/855748767 learned_addr learned my addr 172.21.15.22:0/855748767 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.078+0000 7f3f7ad9d640 1 --2- 172.21.15.22:0/855748767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a180e0 0x55ee69a15a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:36.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.078+0000 7f3f79d9b640 1 --2- 172.21.15.22:0/855748767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a0c150 0x55ee69a15540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:36.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.078+0000 7f3f82cd5740 10 client.0 _ll_register_callbacks cb 0x55ee6996b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:36.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.079+0000 7f3f7a59c640 1 -- 172.21.15.22:0/855748767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a180e0 msgr2=0x55ee69a15a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:36.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.079+0000 7f3f7a59c640 1 --2- 172.21.15.22:0/855748767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a180e0 0x55ee69a15a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.079+0000 7f3f7a59c640 1 -- 172.21.15.22:0/855748767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a0c150 msgr2=0x55ee69a15540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:36.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.079+0000 7f3f7a59c640 1 --2- 172.21.15.22:0/855748767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a0c150 0x55ee69a15540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.079+0000 7f3f7a59c640 1 -- 172.21.15.22:0/855748767 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee69a240f0 con 0x55ee69a0b830 2024-08-20T01:40:36.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.079+0000 7f3f61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:40:36.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.079+0000 7f3f7a59c640 1 --2- 172.21.15.22:0/855748767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a0b830 0x55ee69a15000 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009730 tx=0x7f3f6c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88651e94abe32be0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:36.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.080+0000 7f3f61ffb640 1 -- 172.21.15.22:0/855748767 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c01f640 con 0x55ee69a0b830 2024-08-20T01:40:36.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.080+0000 7f3f82cd5740 1 -- 172.21.15.22:0/855748767 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ee69921100 con 0x55ee69a0b830 2024-08-20T01:40:36.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.080+0000 7f3f61ffb640 1 -- 172.21.15.22:0/855748767 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f3f6c01f7e0 con 0x55ee69a0b830 2024-08-20T01:40:36.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.080+0000 7f3f61ffb640 1 -- 172.21.15.22:0/855748767 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3f6c01f9e0 con 0x55ee69a0b830 2024-08-20T01:40:36.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.080+0000 7f3f82cd5740 10 client.26686 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:36.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.080+0000 7f3f82cd5740 1 -- 172.21.15.22:0/855748767 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ee69a26ac0 con 0x55ee69a0b830 2024-08-20T01:40:36.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.080+0000 7f3f61ffb640 1 -- 172.21.15.22:0/855748767 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ee69921100 con 0x55ee69a0b830 2024-08-20T01:40:36.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.081+0000 7f3f61ffb640 1 -- 172.21.15.22:0/855748767 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f3f6c027070 con 0x55ee69a0b830 2024-08-20T01:40:36.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.081+0000 7f3f82cd5740 10 client.26686 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:36.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.081+0000 7f3f82cd5740 10 client.26686 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:40:36.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.081+0000 7f3f82cd5740 20 client.26686 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:36.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.081+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/855748767 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ee69a27fc0 0x55ee69a2a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:36.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.081+0000 7f3f82cd5740 4 client.26686 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:36.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.081+0000 7f3f82cd5740 1 -- 172.21.15.22:0/855748767 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee69984830 con 0x55ee69a27fc0 2024-08-20T01:40:36.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.081+0000 7f3f79d9b640 1 --2- 172.21.15.22:0/855748767 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ee69a27fc0 0x55ee69a2a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:36.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.082+0000 7f3f79d9b640 1 --2- 172.21.15.22:0/855748767 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ee69a27fc0 0x55ee69a2a480 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc8da3981bab743f server_cookie=a3c2afd6f6448e51 in_seq=0 out_seq=0 2024-08-20T01:40:36.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.082+0000 7f3f61ffb640 10 client.26686 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:36.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.084+0000 7f3f61ffb640 1 -- 172.21.15.22:0/855748767 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee69984830 con 0x55ee69a27fc0 2024-08-20T01:40:36.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.084+0000 7f3f61ffb640 10 client.26686 handle_command_reply: tid=0 2024-08-20T01:40:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.084+0000 7f3f82cd5740 1 client.26686 shutdown 2024-08-20T01:40:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.084+0000 7f3f82cd5740 1 -- 172.21.15.22:0/855748767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a0b830 msgr2=0x55ee69a15000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.084+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/855748767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a0b830 0x55ee69a15000 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009730 tx=0x7f3f6c004730 comp rx=0 tx=0).stop 2024-08-20T01:40:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.084+0000 7f3f82cd5740 1 -- 172.21.15.22:0/855748767 shutdown_connections 2024-08-20T01:40:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.084+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/855748767 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ee69a27fc0 0x55ee69a2a480 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.084+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/855748767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a180e0 0x55ee69a15a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.084+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/855748767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a0c150 0x55ee69a15540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.084+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/855748767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a0b830 0x55ee69a15000 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.084+0000 7f3f82cd5740 1 -- 172.21.15.22:0/855748767 >> 172.21.15.22:0/855748767 conn(0x55ee69a09660 msgr2=0x55ee69a0f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.084+0000 7f3f61ffb640 0 client.26686 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.084+0000 7f3f82cd5740 1 -- 172.21.15.22:0/855748767 shutdown_connections 2024-08-20T01:40:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.084+0000 7f3f82cd5740 1 -- 172.21.15.22:0/855748767 wait complete. 2024-08-20T01:40:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.084+0000 7f3f82cd5740 20 client.26686 trim_cache size 0 max 16384 2024-08-20T01:40:36.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.106+0000 7f3f82cd5740 1 Processor -- start 2024-08-20T01:40:36.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.106+0000 7f3f82cd5740 1 -- start start 2024-08-20T01:40:36.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.107+0000 7f3f82cd5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a0c150 0x55ee69a0f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:36.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.107+0000 7f3f82cd5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a180e0 0x55ee69a0abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:36.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.107+0000 7f3f82cd5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a2fd50 0x55ee69a30170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:36.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.107+0000 7f3f82cd5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c1b2cd0 con 0x55ee69a180e0 2024-08-20T01:40:36.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.107+0000 7f3f82cd5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c1b04e0 con 0x55ee69a0c150 2024-08-20T01:40:36.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.107+0000 7f3f82cd5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c1ae330 con 0x55ee69a2fd50 2024-08-20T01:40:36.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.107+0000 7f3f79d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a180e0 0x55ee69a0abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:36.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.107+0000 7f3f79d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a180e0 0x55ee69a0abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56702/0 (socket says 172.21.15.22:56702) 2024-08-20T01:40:36.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.107+0000 7f3f79d9b640 1 -- 172.21.15.22:0/4260968833 learned_addr learned my addr 172.21.15.22:0/4260968833 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:36.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.107+0000 7f3f7a59c640 1 --2- 172.21.15.22:0/4260968833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a0c150 0x55ee69a0f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:36.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.107+0000 7f3f7ad9d640 1 --2- 172.21.15.22:0/4260968833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a2fd50 0x55ee69a30170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:36.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.107+0000 7f3f79d9b640 1 -- 172.21.15.22:0/4260968833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a2fd50 msgr2=0x55ee69a30170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:36.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.107+0000 7f3f79d9b640 1 --2- 172.21.15.22:0/4260968833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a2fd50 0x55ee69a30170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.107+0000 7f3f79d9b640 1 -- 172.21.15.22:0/4260968833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a0c150 msgr2=0x55ee69a0f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:36.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.107+0000 7f3f79d9b640 1 --2- 172.21.15.22:0/4260968833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a0c150 0x55ee69a0f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.107+0000 7f3f79d9b640 1 -- 172.21.15.22:0/4260968833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee69a0a0e0 con 0x55ee69a180e0 2024-08-20T01:40:36.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.108+0000 7f3f79d9b640 1 --2- 172.21.15.22:0/4260968833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a180e0 0x55ee69a0abe0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f3f700118a0 tx=0x7f3f70009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a7374b43a197d0e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:36.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.108+0000 7f3f63fff640 1 -- 172.21.15.22:0/4260968833 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f70004440 con 0x55ee69a180e0 2024-08-20T01:40:36.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.108+0000 7f3f63fff640 1 -- 172.21.15.22:0/4260968833 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f70005bf0 con 0x55ee69a180e0 2024-08-20T01:40:36.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.108+0000 7f3f63fff640 1 -- 172.21.15.22:0/4260968833 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f70004b20 con 0x55ee69a180e0 2024-08-20T01:40:36.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.110+0000 7f3f82cd5740 1 -- 172.21.15.22:0/4260968833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a180e0 msgr2=0x55ee69a0abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:36.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.110+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/4260968833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a180e0 0x55ee69a0abe0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f3f700118a0 tx=0x7f3f70009e80 comp rx=0 tx=0).stop 2024-08-20T01:40:36.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.110+0000 7f3f82cd5740 1 -- 172.21.15.22:0/4260968833 shutdown_connections 2024-08-20T01:40:36.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.110+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/4260968833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a2fd50 0x55ee69a30170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.110+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/4260968833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a180e0 0x55ee69a0abe0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.110+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/4260968833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a0c150 0x55ee69a0f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.110+0000 7f3f82cd5740 1 -- 172.21.15.22:0/4260968833 >> 172.21.15.22:0/4260968833 conn(0x55ee69a09660 msgr2=0x55ee69a140a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:36.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.110+0000 7f3f82cd5740 1 -- 172.21.15.22:0/4260968833 shutdown_connections 2024-08-20T01:40:36.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.110+0000 7f3f82cd5740 1 -- 172.21.15.22:0/4260968833 wait complete. 2024-08-20T01:40:36.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.111+0000 7f3f82cd5740 1 -- start start 2024-08-20T01:40:36.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.111+0000 7f3f82cd5740 1 Processor -- start 2024-08-20T01:40:36.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.111+0000 7f3f82cd5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a0c150 0x55ee69a1b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:36.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.111+0000 7f3f82cd5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a180e0 0x55ee69a1bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:36.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.111+0000 7f3f82cd5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a2fd50 0x55ee69a8ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:36.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.112+0000 7f3f79d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a180e0 0x55ee69a1bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:36.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.112+0000 7f3f7ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a2fd50 0x55ee69a8ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:36.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.112+0000 7f3f7ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a2fd50 0x55ee69a8ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56714/0 (socket says 172.21.15.22:56714) 2024-08-20T01:40:36.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.112+0000 7f3f79d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a180e0 0x55ee69a1bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:42206/0 (socket says 172.21.15.22:42206) 2024-08-20T01:40:36.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.112+0000 7f3f7ad9d640 1 -- 172.21.15.22:0/1883594744 learned_addr learned my addr 172.21.15.22:0/1883594744 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:36.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.112+0000 7f3f82cd5740 1 -- 172.21.15.22:0/1883594744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c1ae9a0 con 0x55ee69a2fd50 2024-08-20T01:40:36.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.112+0000 7f3f82cd5740 1 -- 172.21.15.22:0/1883594744 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c1afe10 con 0x55ee69a0c150 2024-08-20T01:40:36.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.112+0000 7f3f82cd5740 1 -- 172.21.15.22:0/1883594744 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c1af070 con 0x55ee69a180e0 2024-08-20T01:40:36.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.112+0000 7f3f7a59c640 1 --2- 172.21.15.22:0/1883594744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a0c150 0x55ee69a1b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:36.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.112+0000 7f3f82cd5740 10 client.0 _ll_register_callbacks cb 0x7f3f6c009ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:36.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.112+0000 7f3f7a59c640 1 -- 172.21.15.22:0/1883594744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a180e0 msgr2=0x55ee69a1bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:36.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.112+0000 7f3f7a59c640 1 --2- 172.21.15.22:0/1883594744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a180e0 0x55ee69a1bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.112+0000 7f3f7a59c640 1 -- 172.21.15.22:0/1883594744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a2fd50 msgr2=0x55ee69a8ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:36.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.112+0000 7f3f7a59c640 1 --2- 172.21.15.22:0/1883594744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a2fd50 0x55ee69a8ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.112+0000 7f3f7a59c640 1 -- 172.21.15.22:0/1883594744 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee69a8b520 con 0x55ee69a0c150 2024-08-20T01:40:36.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.113+0000 7f3f79d9b640 1 --2- 172.21.15.22:0/1883594744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a180e0 0x55ee69a1bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:36.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.113+0000 7f3f7a59c640 1 --2- 172.21.15.22:0/1883594744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a0c150 0x55ee69a1b9a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009700 tx=0x7f3f6c003fc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b39333ec3c21cd41 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:36.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.113+0000 7f3f61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:40:36.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.113+0000 7f3f61ffb640 1 -- 172.21.15.22:0/1883594744 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c01fd90 con 0x55ee69a0c150 2024-08-20T01:40:36.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.113+0000 7f3f82cd5740 1 -- 172.21.15.22:0/1883594744 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ee699802d0 con 0x55ee69a0c150 2024-08-20T01:40:36.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.113+0000 7f3f61ffb640 1 -- 172.21.15.22:0/1883594744 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7f3f6c02f030 con 0x55ee69a0c150 2024-08-20T01:40:36.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.113+0000 7f3f61ffb640 1 -- 172.21.15.22:0/1883594744 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3f6c043050 con 0x55ee69a0c150 2024-08-20T01:40:36.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.113+0000 7f3f82cd5740 10 client.26651 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:36.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.113+0000 7f3f82cd5740 1 -- 172.21.15.22:0/1883594744 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ee69a92990 con 0x55ee69a0c150 2024-08-20T01:40:36.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.114+0000 7f3f61ffb640 1 -- 172.21.15.22:0/1883594744 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ee699802d0 con 0x55ee69a0c150 2024-08-20T01:40:36.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.114+0000 7f3f61ffb640 1 -- 172.21.15.22:0/1883594744 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f3f6c027070 con 0x55ee69a0c150 2024-08-20T01:40:36.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.114+0000 7f3f82cd5740 10 client.26651 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:36.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.114+0000 7f3f82cd5740 10 client.26651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:40:36.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.114+0000 7f3f82cd5740 20 client.26651 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:36.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.114+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/1883594744 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ee69a93160 0x55ee69a95580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:36.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.114+0000 7f3f82cd5740 4 client.26651 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:40:36.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.114+0000 7f3f82cd5740 1 -- 172.21.15.22:0/1883594744 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ee6997da10 con 0x55ee69a93160 2024-08-20T01:40:36.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.115+0000 7f3f79d9b640 1 --2- 172.21.15.22:0/1883594744 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ee69a93160 0x55ee69a95580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:36.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.115+0000 7f3f79d9b640 1 --2- 172.21.15.22:0/1883594744 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ee69a93160 0x55ee69a95580 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c150239663636223 server_cookie=2f783601bc6314ec in_seq=0 out_seq=0 2024-08-20T01:40:36.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.115+0000 7f3f61ffb640 10 client.26651 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:36.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.116+0000 7f3f61ffb640 1 -- 172.21.15.22:0/1883594744 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x55ee6997da10 con 0x55ee69a93160 2024-08-20T01:40:36.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.116+0000 7f3f61ffb640 10 client.26651 handle_command_reply: tid=0 2024-08-20T01:40:36.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.116+0000 7f3f82cd5740 1 client.26651 shutdown 2024-08-20T01:40:36.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.116+0000 7f3f82cd5740 1 -- 172.21.15.22:0/1883594744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a0c150 msgr2=0x55ee69a1b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:36.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.116+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/1883594744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a0c150 0x55ee69a1b9a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009700 tx=0x7f3f6c003fc0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.116+0000 7f3f82cd5740 1 -- 172.21.15.22:0/1883594744 shutdown_connections 2024-08-20T01:40:36.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.116+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/1883594744 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ee69a93160 0x55ee69a95580 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.116+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/1883594744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee69a2fd50 0x55ee69a8ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.116+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/1883594744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee69a180e0 0x55ee69a1bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.116+0000 7f3f82cd5740 1 --2- 172.21.15.22:0/1883594744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ee69a0c150 0x55ee69a1b9a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.116+0000 7f3f82cd5740 1 -- 172.21.15.22:0/1883594744 >> 172.21.15.22:0/1883594744 conn(0x55ee69a09660 msgr2=0x55ee69a140a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:36.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.117+0000 7f3f61ffb640 0 client.26651 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:36.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.117+0000 7f3f82cd5740 1 -- 172.21.15.22:0/1883594744 shutdown_connections 2024-08-20T01:40:36.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.117+0000 7f3f82cd5740 1 -- 172.21.15.22:0/1883594744 wait complete. 2024-08-20T01:40:36.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.117+0000 7f3f82cd5740 20 client.26651 trim_cache size 0 max 16384 2024-08-20T01:40:36.121 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:40:36.122 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "scrub active (1512 inodes in the stack)", 2024-08-20T01:40:36.122 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-08-20T01:40:36.122 INFO:teuthology.orchestra.run.smithi022.stdout: "f6894cae-035b-4390-bab1-73fc709601d5": { 2024-08-20T01:40:36.122 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-08-20T01:40:36.122 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "f6894cae-035b-4390-bab1-73fc709601d5", 2024-08-20T01:40:36.122 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-08-20T01:40:36.122 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:40:36.122 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:40:36.122 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:40:36.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.117+0000 7f3f808dc640 1 -- 172.21.15.22:0/1925068214 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3f640b3c50 msgr2=0x7f3f640b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:36.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.117+0000 7f3f808dc640 1 --2- 172.21.15.22:0/1925068214 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3f640b3c50 0x7f3f640b6110 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x55ee69a0e9b0 tx=0x7f3f6c005f90 comp rx=0 tx=0).stop 2024-08-20T01:40:36.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.118+0000 7f3f808dc640 1 -- 172.21.15.22:0/1925068214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f7c108e20 msgr2=0x7f3f7c075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:36.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.118+0000 7f3f808dc640 1 --2- 172.21.15.22:0/1925068214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f7c108e20 0x7f3f7c075c50 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3f7402ade0 tx=0x7f3f74031660 comp rx=0 tx=0).stop 2024-08-20T01:40:36.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.118+0000 7f3f808dc640 1 -- 172.21.15.22:0/1925068214 shutdown_connections 2024-08-20T01:40:36.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.118+0000 7f3f808dc640 1 --2- 172.21.15.22:0/1925068214 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3f640b3c50 0x7f3f640b6110 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.118+0000 7f3f808dc640 1 --2- 172.21.15.22:0/1925068214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f7c108e20 0x7f3f7c075c50 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.118+0000 7f3f808dc640 1 --2- 172.21.15.22:0/1925068214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f7c1084a0 0x7f3f7c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.118+0000 7f3f808dc640 1 --2- 172.21.15.22:0/1925068214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f7c102a90 0x7f3f7c0751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:36.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.118+0000 7f3f808dc640 1 -- 172.21.15.22:0/1925068214 >> 172.21.15.22:0/1925068214 conn(0x7f3f7c0fe540 msgr2=0x7f3f7c0fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:36.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.118+0000 7f3f808dc640 1 -- 172.21.15.22:0/1925068214 shutdown_connections 2024-08-20T01:40:36.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:40:36.118+0000 7f3f808dc640 1 -- 172.21.15.22:0/1925068214 wait complete. 2024-08-20T01:40:36.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:35 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:40:36.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:35 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:36.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:35 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:40:36.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:35 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:36.950 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:36 smithi022 ceph-mon[18709]: pgmap v630: 97 pgs: 97 active+clean; 1008 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 398 op/s 2024-08-20T01:40:36.979 INFO:tasks.cephfs.filesystem:scrub status for tag:f6894cae-035b-4390-bab1-73fc709601d5 - {'path': '/', 'tag': 'f6894cae-035b-4390-bab1-73fc709601d5', 'options': 'recursive,force'} 2024-08-20T01:40:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.081+0000 7fb0d0ece640 1 -- 172.21.15.22:0/3532493535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0cc1026b0 msgr2=0x7fb0cc102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.081+0000 7fb0d0ece640 1 --2- 172.21.15.22:0/3532493535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0cc1026b0 0x7fb0cc102b30 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009890 tx=0x7fb0c002a370 comp rx=0 tx=0).stop 2024-08-20T01:40:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.081+0000 7fb0d0ece640 1 -- 172.21.15.22:0/3532493535 shutdown_connections 2024-08-20T01:40:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.081+0000 7fb0d0ece640 1 --2- 172.21.15.22:0/3532493535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0cc103070 0x7fb0cc1099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.081+0000 7fb0d0ece640 1 --2- 172.21.15.22:0/3532493535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0cc1026b0 0x7fb0cc102b30 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.081+0000 7fb0d0ece640 1 --2- 172.21.15.22:0/3532493535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0cc101560 0x7fb0cc101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.082+0000 7fb0d0ece640 1 -- 172.21.15.22:0/3532493535 >> 172.21.15.22:0/3532493535 conn(0x7fb0cc0fce40 msgr2=0x7fb0cc0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.082+0000 7fb0d0ece640 1 -- 172.21.15.22:0/3532493535 shutdown_connections 2024-08-20T01:40:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.082+0000 7fb0d0ece640 1 -- 172.21.15.22:0/3532493535 wait complete. 2024-08-20T01:40:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.083+0000 7fb0d0ece640 1 Processor -- start 2024-08-20T01:40:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.083+0000 7fb0d0ece640 1 -- start start 2024-08-20T01:40:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.084+0000 7fb0d0ece640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0cc101560 0x7fb0cc196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:37.086 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.084+0000 7fb0d0ece640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0cc1026b0 0x7fb0cc196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.084+0000 7fb0d0ece640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0cc103070 0x7fb0cc197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.084+0000 7fb0ca59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0cc101560 0x7fb0cc196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.084+0000 7fb0c9d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0cc1026b0 0x7fb0cc196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.084+0000 7fb0c9d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0cc1026b0 0x7fb0cc196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:42226/0 (socket says 172.21.15.22:42226) 2024-08-20T01:40:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.084+0000 7fb0ca59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0cc101560 0x7fb0cc196870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:51140/0 (socket says 172.21.15.22:51140) 2024-08-20T01:40:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.084+0000 7fb0cad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0cc103070 0x7fb0cc197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.084+0000 7fb0cad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0cc103070 0x7fb0cc197af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56730/0 (socket says 172.21.15.22:56730) 2024-08-20T01:40:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.084+0000 7fb0c9d9b640 1 -- 172.21.15.22:0/472438225 learned_addr learned my addr 172.21.15.22:0/472438225 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.084+0000 7fb0d0ece640 1 -- 172.21.15.22:0/472438225 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc10c0b0 con 0x7fb0cc103070 2024-08-20T01:40:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.084+0000 7fb0d0ece640 1 -- 172.21.15.22:0/472438225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc10bf30 con 0x7fb0cc101560 2024-08-20T01:40:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.084+0000 7fb0d0ece640 1 -- 172.21.15.22:0/472438225 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc10c230 con 0x7fb0cc1026b0 2024-08-20T01:40:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.085+0000 7fb0c9d9b640 1 -- 172.21.15.22:0/472438225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0cc101560 msgr2=0x7fb0cc196870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.085+0000 7fb0c9d9b640 1 --2- 172.21.15.22:0/472438225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0cc101560 0x7fb0cc196870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.085+0000 7fb0c9d9b640 1 -- 172.21.15.22:0/472438225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0cc103070 msgr2=0x7fb0cc197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.085+0000 7fb0c9d9b640 1 --2- 172.21.15.22:0/472438225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0cc103070 0x7fb0cc197af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.085+0000 7fb0c9d9b640 1 -- 172.21.15.22:0/472438225 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0cc1983b0 con 0x7fb0cc1026b0 2024-08-20T01:40:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.085+0000 7fb0ca59c640 1 --2- 172.21.15.22:0/472438225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0cc101560 0x7fb0cc196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.085+0000 7fb0c9d9b640 1 --2- 172.21.15.22:0/472438225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0cc1026b0 0x7fb0cc196ec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0030490 tx=0x7fb0c0030d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.086+0000 7fb0bb7fe640 1 -- 172.21.15.22:0/472438225 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0040020 con 0x7fb0cc1026b0 2024-08-20T01:40:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.086+0000 7fb0bb7fe640 1 -- 172.21.15.22:0/472438225 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0c0038040 con 0x7fb0cc1026b0 2024-08-20T01:40:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.086+0000 7fb0d0ece640 1 -- 172.21.15.22:0/472438225 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0cc198640 con 0x7fb0cc1026b0 2024-08-20T01:40:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.086+0000 7fb0bb7fe640 1 -- 172.21.15.22:0/472438225 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0037070 con 0x7fb0cc1026b0 2024-08-20T01:40:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.087+0000 7fb0d0ece640 1 -- 172.21.15.22:0/472438225 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0cc19ed70 con 0x7fb0cc1026b0 2024-08-20T01:40:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.091+0000 7fb0d3cc1740 1 Processor -- start 2024-08-20T01:40:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.091+0000 7fb0d3cc1740 1 -- start start 2024-08-20T01:40:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.091+0000 7fb0d3cc1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec5125f0e0 0x55ec512614d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.091+0000 7fb0d3cc1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec51261a10 0x55ec51263e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.091+0000 7fb0d3cc1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51264450 0x55ec51266910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.091+0000 7fb0d3cc1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ec511c9360 con 0x55ec51261a10 2024-08-20T01:40:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.091+0000 7fb0d3cc1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ec511b8860 con 0x55ec51264450 2024-08-20T01:40:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.091+0000 7fb0d3cc1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ec511bc8a0 con 0x55ec5125f0e0 2024-08-20T01:40:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.092+0000 7fb0ca59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec51261a10 0x55ec51263e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.092+0000 7fb0bb7fe640 1 -- 172.21.15.22:0/472438225 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb0c0043020 con 0x7fb0cc1026b0 2024-08-20T01:40:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.092+0000 7fb0ca59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec51261a10 0x55ec51263e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56744/0 (socket says 172.21.15.22:56744) 2024-08-20T01:40:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.092+0000 7fb0ca59c640 1 -- 172.21.15.22:0/3756540908 learned_addr learned my addr 172.21.15.22:0/3756540908 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.092+0000 7fb0cad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec5125f0e0 0x55ec512614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.092+0000 7fb0c9d9b640 1 --2- 172.21.15.22:0/3756540908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51264450 0x55ec51266910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.093+0000 7fb0ca59c640 1 -- 172.21.15.22:0/3756540908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec5125f0e0 msgr2=0x55ec512614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.093+0000 7fb0ca59c640 1 --2- 172.21.15.22:0/3756540908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec5125f0e0 0x55ec512614d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.093+0000 7fb0ca59c640 1 -- 172.21.15.22:0/3756540908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51264450 msgr2=0x55ec51266910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.093+0000 7fb0ca59c640 1 --2- 172.21.15.22:0/3756540908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51264450 0x55ec51266910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.093+0000 7fb0ca59c640 1 -- 172.21.15.22:0/3756540908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec5115fe40 con 0x55ec51261a10 2024-08-20T01:40:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.093+0000 7fb0ca59c640 1 --2- 172.21.15.22:0/3756540908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec51261a10 0x55ec51263e00 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc011510 tx=0x7fb0bc0119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb0980d66dd3b56 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.094+0000 7fb0b8ff9640 1 -- 172.21.15.22:0/3756540908 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc004020 con 0x55ec51261a10 2024-08-20T01:40:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.094+0000 7fb0bb7fe640 1 --2- 172.21.15.22:0/472438225 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb0b40b3da0 0x7fb0b40b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.094+0000 7fb0b8ff9640 1 -- 172.21.15.22:0/3756540908 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0bc0041c0 con 0x55ec51261a10 2024-08-20T01:40:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.094+0000 7fb0b8ff9640 1 -- 172.21.15.22:0/3756540908 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc00f890 con 0x55ec51261a10 2024-08-20T01:40:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.094+0000 7fb0cad9d640 1 --2- 172.21.15.22:0/472438225 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb0b40b3da0 0x7fb0b40b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.094+0000 7fb0bb7fe640 1 -- 172.21.15.22:0/472438225 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb0c0103d40 con 0x7fb0cc1026b0 2024-08-20T01:40:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.095+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/3756540908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec51261a10 msgr2=0x55ec51263e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.095+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/3756540908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec51261a10 0x55ec51263e00 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc011510 tx=0x7fb0bc0119d0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.095+0000 7fb0cad9d640 1 --2- 172.21.15.22:0/472438225 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb0b40b3da0 0x7fb0b40b6260 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc1975f0 tx=0x7fb0c4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.095+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/3756540908 shutdown_connections 2024-08-20T01:40:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.095+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/3756540908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51264450 0x55ec51266910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.095+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/3756540908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec51261a10 0x55ec51263e00 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.095+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/3756540908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec5125f0e0 0x55ec512614d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.095+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/3756540908 >> 172.21.15.22:0/3756540908 conn(0x55ec5125a230 msgr2=0x55ec5125afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.096+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/3756540908 shutdown_connections 2024-08-20T01:40:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.096+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/3756540908 wait complete. 2024-08-20T01:40:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.097+0000 7fb0d3cc1740 1 -- start start 2024-08-20T01:40:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.097+0000 7fb0d3cc1740 1 Processor -- start 2024-08-20T01:40:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.097+0000 7fb0d3cc1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec5125f0e0 0x55ec51268900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.097+0000 7fb0d3cc1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 0x55ec51268fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.097+0000 7fb0d3cc1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec51264450 0x55ec51269b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.097+0000 7fb0d3cc1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ec510f1ab0 con 0x55ec51264450 2024-08-20T01:40:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.097+0000 7fb0d3cc1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ec5113f780 con 0x55ec51261a10 2024-08-20T01:40:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.097+0000 7fb0d3cc1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ec51267480 con 0x55ec5125f0e0 2024-08-20T01:40:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.097+0000 7fb0d3cc1740 10 client.0 _ll_register_callbacks cb 0x55ec50ec7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.098+0000 7fb0c9d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 0x55ec51268fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.098+0000 7fb0c9d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 0x55ec51268fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:51162/0 (socket says 172.21.15.22:51162) 2024-08-20T01:40:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.098+0000 7fb0cad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec51264450 0x55ec51269b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.098+0000 7fb0c9d9b640 1 -- 172.21.15.22:0/3949062276 learned_addr learned my addr 172.21.15.22:0/3949062276 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.098+0000 7fb0ca59c640 1 --2- 172.21.15.22:0/3949062276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec5125f0e0 0x55ec51268900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.098+0000 7fb0c9d9b640 1 -- 172.21.15.22:0/3949062276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec5125f0e0 msgr2=0x55ec51268900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.098+0000 7fb0c9d9b640 1 --2- 172.21.15.22:0/3949062276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec5125f0e0 0x55ec51268900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.098+0000 7fb0c9d9b640 1 -- 172.21.15.22:0/3949062276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec51264450 msgr2=0x55ec51269b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.098+0000 7fb0c9d9b640 1 --2- 172.21.15.22:0/3949062276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec51264450 0x55ec51269b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.098+0000 7fb0c9d9b640 1 -- 172.21.15.22:0/3949062276 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec50f1b790 con 0x55ec51261a10 2024-08-20T01:40:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.098+0000 7fb0c9d9b640 1 --2- 172.21.15.22:0/3949062276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 0x55ec51268fa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0035040 tx=0x7fb0c0030f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faaf6f85bccba203 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.099+0000 7fb0b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:40:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.099+0000 7fb0b1ffb640 1 -- 172.21.15.22:0/3949062276 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0105070 con 0x55ec51261a10 2024-08-20T01:40:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.099+0000 7fb0b1ffb640 1 -- 172.21.15.22:0/3949062276 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb0c00d3810 con 0x55ec51261a10 2024-08-20T01:40:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.099+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/3949062276 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ec51167e00 con 0x55ec51261a10 2024-08-20T01:40:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.099+0000 7fb0b1ffb640 1 -- 172.21.15.22:0/3949062276 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb0c00c6ab0 con 0x55ec51261a10 2024-08-20T01:40:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.099+0000 7fb0d3cc1740 10 client.26663 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.099+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/3949062276 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ec50f94620 con 0x55ec51261a10 2024-08-20T01:40:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.100+0000 7fb0b1ffb640 1 -- 172.21.15.22:0/3949062276 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ec51167e00 con 0x55ec51261a10 2024-08-20T01:40:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.100+0000 7fb0b1ffb640 1 -- 172.21.15.22:0/3949062276 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fb0c00c6560 con 0x55ec51261a10 2024-08-20T01:40:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.100+0000 7fb0d3cc1740 10 client.26663 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.100+0000 7fb0d3cc1740 10 client.26663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:40:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.100+0000 7fb0d3cc1740 20 client.26663 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.100+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/3949062276 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ec512741f0 0x55ec51276630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.100+0000 7fb0d3cc1740 4 client.26663 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.101+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/3949062276 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec511cb2b0 con 0x55ec512741f0 2024-08-20T01:40:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.101+0000 7fb0ca59c640 1 --2- 172.21.15.22:0/3949062276 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ec512741f0 0x55ec51276630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.101+0000 7fb0b1ffb640 10 client.26663 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.101+0000 7fb0ca59c640 1 --2- 172.21.15.22:0/3949062276 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ec512741f0 0x55ec51276630 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3395f4f7a5b42e41 server_cookie=30d73c9642393c67 in_seq=0 out_seq=0 2024-08-20T01:40:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.104+0000 7fb0b1ffb640 1 -- 172.21.15.22:0/3949062276 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec511cb2b0 con 0x55ec512741f0 2024-08-20T01:40:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.104+0000 7fb0b1ffb640 10 client.26663 handle_command_reply: tid=0 2024-08-20T01:40:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.104+0000 7fb0d3cc1740 1 client.26663 shutdown 2024-08-20T01:40:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.104+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/3949062276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 msgr2=0x55ec51268fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.104+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/3949062276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 0x55ec51268fa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0035040 tx=0x7fb0c0030f80 comp rx=0 tx=0).stop 2024-08-20T01:40:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.104+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/3949062276 shutdown_connections 2024-08-20T01:40:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.104+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/3949062276 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ec512741f0 0x55ec51276630 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.104+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/3949062276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec51264450 0x55ec51269b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.104+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/3949062276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 0x55ec51268fa0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.104+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/3949062276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec5125f0e0 0x55ec51268900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.104+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/3949062276 >> 172.21.15.22:0/3949062276 conn(0x55ec5125a230 msgr2=0x55ec51250ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.104+0000 7fb0b1ffb640 0 client.26663 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.104+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/3949062276 shutdown_connections 2024-08-20T01:40:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.104+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/3949062276 wait complete. 2024-08-20T01:40:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.104+0000 7fb0d3cc1740 20 client.26663 trim_cache size 0 max 16384 2024-08-20T01:40:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.120+0000 7fb0d3cc1740 1 Processor -- start 2024-08-20T01:40:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.120+0000 7fb0d3cc1740 1 -- start start 2024-08-20T01:40:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.120+0000 7fb0d3cc1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec5125f0e0 0x55ec5124c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.120+0000 7fb0d3cc1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 0x55ec5125aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.120+0000 7fb0d3cc1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec51264450 0x55ec5125afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.120+0000 7fb0d3cc1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc1aa4b0 con 0x55ec5125f0e0 2024-08-20T01:40:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.120+0000 7fb0d3cc1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc1a7cc0 con 0x55ec51261a10 2024-08-20T01:40:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.120+0000 7fb0d3cc1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc1a5b10 con 0x55ec51264450 2024-08-20T01:40:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.120+0000 7fb0ca59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec5125f0e0 0x55ec5124c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.121+0000 7fb0ca59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec5125f0e0 0x55ec5124c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56760/0 (socket says 172.21.15.22:56760) 2024-08-20T01:40:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.121+0000 7fb0ca59c640 1 -- 172.21.15.22:0/195746149 learned_addr learned my addr 172.21.15.22:0/195746149 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.121+0000 7fb0c9d9b640 1 --2- 172.21.15.22:0/195746149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 0x55ec5125aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.121+0000 7fb0cad9d640 1 --2- 172.21.15.22:0/195746149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec51264450 0x55ec5125afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.121+0000 7fb0c9d9b640 1 -- 172.21.15.22:0/195746149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec51264450 msgr2=0x55ec5125afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.121+0000 7fb0c9d9b640 1 --2- 172.21.15.22:0/195746149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec51264450 0x55ec5125afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.121+0000 7fb0c9d9b640 1 -- 172.21.15.22:0/195746149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec5125f0e0 msgr2=0x55ec5124c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.121+0000 7fb0c9d9b640 1 --2- 172.21.15.22:0/195746149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec5125f0e0 0x55ec5124c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.121+0000 7fb0c9d9b640 1 -- 172.21.15.22:0/195746149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec51269e70 con 0x55ec51261a10 2024-08-20T01:40:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.121+0000 7fb0ca59c640 1 --2- 172.21.15.22:0/195746149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec5125f0e0 0x55ec5124c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.121+0000 7fb0c9d9b640 1 --2- 172.21.15.22:0/195746149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 0x55ec5125aa90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00c7190 tx=0x7fb0c00cf120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9434bd11d40140c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.121+0000 7fb0b3fff640 1 -- 172.21.15.22:0/195746149 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c00ea070 con 0x55ec51261a10 2024-08-20T01:40:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.122+0000 7fb0b3fff640 1 -- 172.21.15.22:0/195746149 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0c00328f0 con 0x55ec51261a10 2024-08-20T01:40:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.122+0000 7fb0b3fff640 1 -- 172.21.15.22:0/195746149 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c00c6380 con 0x55ec51261a10 2024-08-20T01:40:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.122+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/195746149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 msgr2=0x55ec5125aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.123+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/195746149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 0x55ec5125aa90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00c7190 tx=0x7fb0c00cf120 comp rx=0 tx=0).stop 2024-08-20T01:40:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.123+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/195746149 shutdown_connections 2024-08-20T01:40:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.123+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/195746149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec51264450 0x55ec5125afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.123+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/195746149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 0x55ec5125aa90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.123+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/195746149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec5125f0e0 0x55ec5124c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.123+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/195746149 >> 172.21.15.22:0/195746149 conn(0x55ec5125a230 msgr2=0x55ec51265dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.123+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/195746149 shutdown_connections 2024-08-20T01:40:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.123+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/195746149 wait complete. 2024-08-20T01:40:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.123+0000 7fb0d3cc1740 1 -- start start 2024-08-20T01:40:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.123+0000 7fb0d3cc1740 1 Processor -- start 2024-08-20T01:40:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.123+0000 7fb0d3cc1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec5125f0e0 0x55ec5126d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.123+0000 7fb0d3cc1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 0x55ec5126dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.123+0000 7fb0d3cc1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec51264450 0x55ec5126e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0d3cc1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc1a6180 con 0x55ec5125f0e0 2024-08-20T01:40:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0d3cc1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc1a75f0 con 0x55ec51261a10 2024-08-20T01:40:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0d3cc1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc1a6850 con 0x55ec51264450 2024-08-20T01:40:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0d3cc1740 10 client.0 _ll_register_callbacks cb 0x7fb0c00057a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0ca59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec5125f0e0 0x55ec5126d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0c9d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 0x55ec5126dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0c9d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 0x55ec5126dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:51176/0 (socket says 172.21.15.22:51176) 2024-08-20T01:40:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0c9d9b640 1 -- 172.21.15.22:0/918111033 learned_addr learned my addr 172.21.15.22:0/918111033 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0ca59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec5125f0e0 0x55ec5126d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56774/0 (socket says 172.21.15.22:56774) 2024-08-20T01:40:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0cad9d640 1 --2- 172.21.15.22:0/918111033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec51264450 0x55ec5126e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0c9d9b640 1 -- 172.21.15.22:0/918111033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec51264450 msgr2=0x55ec5126e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0c9d9b640 1 --2- 172.21.15.22:0/918111033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec51264450 0x55ec5126e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0c9d9b640 1 -- 172.21.15.22:0/918111033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec5125f0e0 msgr2=0x55ec5126d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0c9d9b640 1 --2- 172.21.15.22:0/918111033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec5125f0e0 0x55ec5126d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0c9d9b640 1 -- 172.21.15.22:0/918111033 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec5126f0e0 con 0x55ec51261a10 2024-08-20T01:40:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0c9d9b640 1 --2- 172.21.15.22:0/918111033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 0x55ec5126dda0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0005d60 tx=0x7fb0c0030f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28d17dcaffedead9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:40:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0b1ffb640 1 -- 172.21.15.22:0/918111033 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c00ea070 con 0x55ec51261a10 2024-08-20T01:40:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0b1ffb640 1 -- 172.21.15.22:0/918111033 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fb0c00c71e0 con 0x55ec51261a10 2024-08-20T01:40:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.124+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/918111033 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0c00328f0 con 0x55ec51261a10 2024-08-20T01:40:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.125+0000 7fb0b1ffb640 1 -- 172.21.15.22:0/918111033 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb0c00ca360 con 0x55ec51261a10 2024-08-20T01:40:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.125+0000 7fb0d3cc1740 10 client.26669 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.125+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/918111033 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ec5126f0e0 con 0x55ec51261a10 2024-08-20T01:40:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.125+0000 7fb0b1ffb640 1 -- 172.21.15.22:0/918111033 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0c00328f0 con 0x55ec51261a10 2024-08-20T01:40:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.125+0000 7fb0b1ffb640 1 -- 172.21.15.22:0/918111033 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fb0c0004000 con 0x55ec51261a10 2024-08-20T01:40:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.125+0000 7fb0d3cc1740 10 client.26669 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.125+0000 7fb0d3cc1740 10 client.26669 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:40:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.125+0000 7fb0d3cc1740 20 client.26669 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.125+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/918111033 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ec512deed0 0x55ec512e12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.125+0000 7fb0d3cc1740 4 client.26669 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:40:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.125+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/918111033 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ec511c6d50 con 0x55ec512deed0 2024-08-20T01:40:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.125+0000 7fb0ca59c640 1 --2- 172.21.15.22:0/918111033 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ec512deed0 0x55ec512e12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.125+0000 7fb0b1ffb640 10 client.26669 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.125+0000 7fb0ca59c640 1 --2- 172.21.15.22:0/918111033 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ec512deed0 0x55ec512e12c0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f5fa22ce1a4469e server_cookie=885c298593e5a881 in_seq=0 out_seq=0 2024-08-20T01:40:37.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:36 smithi134 ceph-mon[22511]: pgmap v630: 97 pgs: 97 active+clean; 1008 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 398 op/s 2024-08-20T01:40:37.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:36 smithi077 ceph-mon[22251]: pgmap v630: 97 pgs: 97 active+clean; 1008 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 398 op/s 2024-08-20T01:40:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.582+0000 7fb0b1ffb640 1 -- 172.21.15.22:0/918111033 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ec511c6d50 con 0x55ec512deed0 2024-08-20T01:40:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.582+0000 7fb0b1ffb640 10 client.26669 handle_command_reply: tid=0 2024-08-20T01:40:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.582+0000 7fb0d3cc1740 1 client.26669 shutdown 2024-08-20T01:40:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.582+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/918111033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 msgr2=0x55ec5126dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.582+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/918111033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 0x55ec5126dda0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0005d60 tx=0x7fb0c0030f80 comp rx=0 tx=0).stop 2024-08-20T01:40:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.582+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/918111033 shutdown_connections 2024-08-20T01:40:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.582+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/918111033 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55ec512deed0 0x55ec512e12c0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.582+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/918111033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec51264450 0x55ec5126e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.582+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/918111033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ec51261a10 0x55ec5126dda0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.582+0000 7fb0b1ffb640 0 client.26669 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:37.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.582+0000 7fb0d3cc1740 1 --2- 172.21.15.22:0/918111033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ec5125f0e0 0x55ec5126d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.582+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/918111033 >> 172.21.15.22:0/918111033 conn(0x55ec5125a230 msgr2=0x55ec5125aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:37.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.582+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/918111033 shutdown_connections 2024-08-20T01:40:37.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.582+0000 7fb0d3cc1740 1 -- 172.21.15.22:0/918111033 wait complete. 2024-08-20T01:40:37.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.582+0000 7fb0d3cc1740 20 client.26669 trim_cache size 0 max 16384 2024-08-20T01:40:37.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:40:37.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:40:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:40:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:40:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.583+0000 7fb0d0ece640 1 -- 172.21.15.22:0/472438225 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb0b40b3da0 msgr2=0x7fb0b40b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.583+0000 7fb0d0ece640 1 --2- 172.21.15.22:0/472438225 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb0b40b3da0 0x7fb0b40b6260 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc1975f0 tx=0x7fb0c4009500 comp rx=0 tx=0).stop 2024-08-20T01:40:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.583+0000 7fb0d0ece640 1 -- 172.21.15.22:0/472438225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0cc1026b0 msgr2=0x7fb0cc196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.583+0000 7fb0d0ece640 1 --2- 172.21.15.22:0/472438225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0cc1026b0 0x7fb0cc196ec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0030490 tx=0x7fb0c0030d60 comp rx=0 tx=0).stop 2024-08-20T01:40:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.583+0000 7fb0d0ece640 1 -- 172.21.15.22:0/472438225 shutdown_connections 2024-08-20T01:40:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.583+0000 7fb0d0ece640 1 --2- 172.21.15.22:0/472438225 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb0b40b3da0 0x7fb0b40b6260 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.583+0000 7fb0d0ece640 1 --2- 172.21.15.22:0/472438225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0cc103070 0x7fb0cc197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.583+0000 7fb0d0ece640 1 --2- 172.21.15.22:0/472438225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0cc1026b0 0x7fb0cc196ec0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.583+0000 7fb0d0ece640 1 --2- 172.21.15.22:0/472438225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0cc101560 0x7fb0cc196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.583+0000 7fb0d0ece640 1 -- 172.21.15.22:0/472438225 >> 172.21.15.22:0/472438225 conn(0x7fb0cc0fce40 msgr2=0x7fb0cc105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.583+0000 7fb0d0ece640 1 -- 172.21.15.22:0/472438225 shutdown_connections 2024-08-20T01:40:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:37.583+0000 7fb0d0ece640 1 -- 172.21.15.22:0/472438225 wait complete. 2024-08-20T01:40:38.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:37 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:38.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:37 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:38.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:37 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:38.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:37 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:38.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:37 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:38.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:37 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:39.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:38 smithi022 ceph-mon[18709]: pgmap v631: 97 pgs: 97 active+clean; 989 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.4 MiB/s wr, 1.56k op/s 2024-08-20T01:40:39.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:38 smithi134 ceph-mon[22511]: pgmap v631: 97 pgs: 97 active+clean; 989 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.4 MiB/s wr, 1.56k op/s 2024-08-20T01:40:39.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:38 smithi077 ceph-mon[22251]: pgmap v631: 97 pgs: 97 active+clean; 989 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.4 MiB/s wr, 1.56k op/s 2024-08-20T01:40:41.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:40 smithi022 ceph-mon[18709]: pgmap v632: 97 pgs: 97 active+clean; 982 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.1 MiB/s wr, 2.16k op/s 2024-08-20T01:40:41.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:40 smithi134 ceph-mon[22511]: pgmap v632: 97 pgs: 97 active+clean; 982 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.1 MiB/s wr, 2.16k op/s 2024-08-20T01:40:41.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:40 smithi077 ceph-mon[22251]: pgmap v632: 97 pgs: 97 active+clean; 982 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.1 MiB/s wr, 2.16k op/s 2024-08-20T01:40:42.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:41 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:40:42.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:41 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:40:42.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:41 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:40:43.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:42 smithi022 ceph-mon[18709]: pgmap v633: 97 pgs: 97 active+clean; 964 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.7 MiB/s wr, 2.36k op/s 2024-08-20T01:40:43.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:42 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:40:43.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:42 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:40:43.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:42 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:40:43.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:42 smithi134 ceph-mon[22511]: pgmap v633: 97 pgs: 97 active+clean; 964 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.7 MiB/s wr, 2.36k op/s 2024-08-20T01:40:43.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:42 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:40:43.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:42 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:40:43.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:42 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:40:43.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:42 smithi077 ceph-mon[22251]: pgmap v633: 97 pgs: 97 active+clean; 964 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.7 MiB/s wr, 2.36k op/s 2024-08-20T01:40:43.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:42 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:40:43.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:42 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:40:43.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:42 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:40:45.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:44 smithi022 ceph-mon[18709]: pgmap v634: 97 pgs: 97 active+clean; 946 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 2.50k op/s 2024-08-20T01:40:45.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:44 smithi134 ceph-mon[22511]: pgmap v634: 97 pgs: 97 active+clean; 946 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 2.50k op/s 2024-08-20T01:40:45.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:44 smithi077 ceph-mon[22251]: pgmap v634: 97 pgs: 97 active+clean; 946 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 2.50k op/s 2024-08-20T01:40:47.117 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:46 smithi077 ceph-mon[22251]: pgmap v635: 97 pgs: 97 active+clean; 941 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 2.45k op/s 2024-08-20T01:40:47.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:46 smithi022 ceph-mon[18709]: pgmap v635: 97 pgs: 97 active+clean; 941 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 2.45k op/s 2024-08-20T01:40:47.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:46 smithi134 ceph-mon[22511]: pgmap v635: 97 pgs: 97 active+clean; 941 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 2.45k op/s 2024-08-20T01:40:49.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:48 smithi022 ceph-mon[18709]: pgmap v636: 97 pgs: 97 active+clean; 928 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.8 MiB/s wr, 2.51k op/s 2024-08-20T01:40:49.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:48 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:40:49.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:48 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:40:49.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:48 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:40:49.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:48 smithi134 ceph-mon[22511]: pgmap v636: 97 pgs: 97 active+clean; 928 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.8 MiB/s wr, 2.51k op/s 2024-08-20T01:40:49.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:48 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:40:49.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:48 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:40:49.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:48 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:40:49.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:48 smithi077 ceph-mon[22251]: pgmap v636: 97 pgs: 97 active+clean; 928 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.8 MiB/s wr, 2.51k op/s 2024-08-20T01:40:49.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:48 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:40:49.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:48 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:40:49.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:48 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:40:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.722+0000 7fd5ded88640 1 -- 172.21.15.22:0/1608142398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5d8103070 msgr2=0x7fd5d81099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:50.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.722+0000 7fd5ded88640 1 --2- 172.21.15.22:0/1608142398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5d8103070 0x7fd5d81099f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009c10 tx=0x7fd5d002a6f0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.723+0000 7fd5ded88640 1 -- 172.21.15.22:0/1608142398 shutdown_connections 2024-08-20T01:40:50.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.723+0000 7fd5ded88640 1 --2- 172.21.15.22:0/1608142398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5d8103070 0x7fd5d81099f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.723+0000 7fd5ded88640 1 --2- 172.21.15.22:0/1608142398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d81026b0 0x7fd5d8102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.723+0000 7fd5ded88640 1 --2- 172.21.15.22:0/1608142398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5d8101560 0x7fd5d8101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.723+0000 7fd5ded88640 1 -- 172.21.15.22:0/1608142398 >> 172.21.15.22:0/1608142398 conn(0x7fd5d80fce40 msgr2=0x7fd5d80ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:50.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.723+0000 7fd5ded88640 1 -- 172.21.15.22:0/1608142398 shutdown_connections 2024-08-20T01:40:50.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.723+0000 7fd5ded88640 1 -- 172.21.15.22:0/1608142398 wait complete. 2024-08-20T01:40:50.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.724+0000 7fd5ded88640 1 Processor -- start 2024-08-20T01:40:50.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.724+0000 7fd5ded88640 1 -- start start 2024-08-20T01:40:50.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.725+0000 7fd5ded88640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5d8101560 0x7fd5d8196630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:50.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.725+0000 7fd5ded88640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d81026b0 0x7fd5d8196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:50.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.725+0000 7fd5ded88640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5d8103070 0x7fd5d81978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.725+0000 7fd5dcb24640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5d8101560 0x7fd5d8196630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.725+0000 7fd5ded88640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d810c0f0 con 0x7fd5d8103070 2024-08-20T01:40:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.725+0000 7fd5ded88640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d810bf70 con 0x7fd5d8101560 2024-08-20T01:40:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.725+0000 7fd5ded88640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d810c270 con 0x7fd5d81026b0 2024-08-20T01:40:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.725+0000 7fd5dcb24640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5d8101560 0x7fd5d8196630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:44882/0 (socket says 172.21.15.22:44882) 2024-08-20T01:40:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.725+0000 7fd5dcb24640 1 -- 172.21.15.22:0/949624852 learned_addr learned my addr 172.21.15.22:0/949624852 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.725+0000 7fd5dd325640 1 --2- 172.21.15.22:0/949624852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5d8103070 0x7fd5d81978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.725+0000 7fd5d7fff640 1 --2- 172.21.15.22:0/949624852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d81026b0 0x7fd5d8196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.726+0000 7fd5dd325640 1 -- 172.21.15.22:0/949624852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d81026b0 msgr2=0x7fd5d8196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.726+0000 7fd5dd325640 1 --2- 172.21.15.22:0/949624852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d81026b0 0x7fd5d8196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.726+0000 7fd5dd325640 1 -- 172.21.15.22:0/949624852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5d8101560 msgr2=0x7fd5d8196630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.726+0000 7fd5dd325640 1 --2- 172.21.15.22:0/949624852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5d8101560 0x7fd5d8196630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.726+0000 7fd5dd325640 1 -- 172.21.15.22:0/949624852 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d8198170 con 0x7fd5d8103070 2024-08-20T01:40:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.726+0000 7fd5dd325640 1 --2- 172.21.15.22:0/949624852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5d8103070 0x7fd5d81978b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0034040 tx=0x7fd5d0003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.726+0000 7fd5d5ffb640 1 -- 172.21.15.22:0/949624852 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0036040 con 0x7fd5d8103070 2024-08-20T01:40:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.726+0000 7fd5ded88640 1 -- 172.21.15.22:0/949624852 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d8198400 con 0x7fd5d8103070 2024-08-20T01:40:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.726+0000 7fd5d5ffb640 1 -- 172.21.15.22:0/949624852 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5d00318f0 con 0x7fd5d8103070 2024-08-20T01:40:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.726+0000 7fd5d5ffb640 1 -- 172.21.15.22:0/949624852 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0004040 con 0x7fd5d8103070 2024-08-20T01:40:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.727+0000 7fd5ded88640 1 -- 172.21.15.22:0/949624852 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d819eb30 con 0x7fd5d8103070 2024-08-20T01:40:50.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.731+0000 7fd5d5ffb640 1 -- 172.21.15.22:0/949624852 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd5d003c670 con 0x7fd5d8103070 2024-08-20T01:40:50.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.731+0000 7fd5e1c52740 1 Processor -- start 2024-08-20T01:40:50.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.731+0000 7fd5e1c52740 1 -- start start 2024-08-20T01:40:50.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.732+0000 7fd5e1c52740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f43d8e0 0x55754f43fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:50.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.732+0000 7fd5e1c52740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f440210 0x55754f442600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:50.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.732+0000 7fd5e1c52740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f442c50 0x55754f445110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:50.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.732+0000 7fd5e1c52740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55754f39f360 con 0x55754f43d8e0 2024-08-20T01:40:50.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.732+0000 7fd5e1c52740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55754f38e860 con 0x55754f440210 2024-08-20T01:40:50.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.732+0000 7fd5e1c52740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55754f3928a0 con 0x55754f442c50 2024-08-20T01:40:50.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.732+0000 7fd5dcb24640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f440210 0x55754f442600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:50.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.732+0000 7fd5dcb24640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f440210 0x55754f442600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:44886/0 (socket says 172.21.15.22:44886) 2024-08-20T01:40:50.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.732+0000 7fd5dcb24640 1 -- 172.21.15.22:0/3703600954 learned_addr learned my addr 172.21.15.22:0/3703600954 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:50.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.733+0000 7fd5dcb24640 1 -- 172.21.15.22:0/3703600954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f442c50 msgr2=0x55754f445110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:40:50.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.733+0000 7fd5dcb24640 1 --2- 172.21.15.22:0/3703600954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f442c50 0x55754f445110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.733+0000 7fd5dcb24640 1 -- 172.21.15.22:0/3703600954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f43d8e0 msgr2=0x55754f43fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:50.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.733+0000 7fd5dcb24640 1 --2- 172.21.15.22:0/3703600954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f43d8e0 0x55754f43fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.733+0000 7fd5dcb24640 1 -- 172.21.15.22:0/3703600954 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55754f335e40 con 0x55754f440210 2024-08-20T01:40:50.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.733+0000 7fd5dcb24640 1 --2- 172.21.15.22:0/3703600954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f440210 0x55754f442600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800dce0 tx=0x7fd5c8009830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d24390b75a9bf5e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:50.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.734+0000 7fd5beffd640 1 -- 172.21.15.22:0/3703600954 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c800ddd0 con 0x55754f440210 2024-08-20T01:40:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.734+0000 7fd5beffd640 1 -- 172.21.15.22:0/3703600954 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5c803a920 con 0x55754f440210 2024-08-20T01:40:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.734+0000 7fd5d5ffb640 1 --2- 172.21.15.22:0/949624852 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd5c00b3cd0 0x7fd5c00b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.734+0000 7fd5d5ffb640 1 -- 172.21.15.22:0/949624852 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fd5d0108640 con 0x7fd5d8103070 2024-08-20T01:40:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.735+0000 7fd5e1c52740 1 -- 172.21.15.22:0/3703600954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f440210 msgr2=0x55754f442600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.735+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/3703600954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f440210 0x55754f442600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800dce0 tx=0x7fd5c8009830 comp rx=0 tx=0).stop 2024-08-20T01:40:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.735+0000 7fd5e1c52740 1 -- 172.21.15.22:0/3703600954 shutdown_connections 2024-08-20T01:40:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.735+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/3703600954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f442c50 0x55754f445110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.735+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/3703600954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f440210 0x55754f442600 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.735+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/3703600954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f43d8e0 0x55754f43fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.735+0000 7fd5e1c52740 1 -- 172.21.15.22:0/3703600954 >> 172.21.15.22:0/3703600954 conn(0x55754f427a20 msgr2=0x55754f4287b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:50.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.737+0000 7fd5e1c52740 1 -- 172.21.15.22:0/3703600954 shutdown_connections 2024-08-20T01:40:50.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.738+0000 7fd5d7fff640 1 --2- 172.21.15.22:0/949624852 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd5c00b3cd0 0x7fd5c00b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:50.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.738+0000 7fd5e1c52740 1 -- 172.21.15.22:0/3703600954 wait complete. 2024-08-20T01:40:50.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.738+0000 7fd5e1c52740 1 -- start start 2024-08-20T01:40:50.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.738+0000 7fd5e1c52740 1 Processor -- start 2024-08-20T01:40:50.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.739+0000 7fd5e1c52740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f440210 0x55754f436a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:50.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.739+0000 7fd5e1c52740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f437010 0x55754f43ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:50.744 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.739+0000 7fd5e1c52740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f43d230 0x55754f437c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:50.744 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.739+0000 7fd5e1c52740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55754f2c7ab0 con 0x55754f43d230 2024-08-20T01:40:50.744 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.739+0000 7fd5e1c52740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55754f315780 con 0x55754f440210 2024-08-20T01:40:50.744 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.739+0000 7fd5e1c52740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55754f42cb60 con 0x55754f437010 2024-08-20T01:40:50.744 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.739+0000 7fd5e1c52740 10 client.0 _ll_register_callbacks cb 0x55754f09da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:50.744 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.740+0000 7fd5d7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f437010 0x55754f43ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:50.744 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.740+0000 7fd5d7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f437010 0x55754f43ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:59256/0 (socket says 172.21.15.22:59256) 2024-08-20T01:40:50.744 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.740+0000 7fd5d7fff640 1 -- 172.21.15.22:0/1025458927 learned_addr learned my addr 172.21.15.22:0/1025458927 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:50.744 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.740+0000 7fd5d7fff640 1 --2- 172.21.15.22:0/949624852 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd5c00b3cd0 0x7fd5c00b6190 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x55754f428f40 tx=0x7fd5cc009f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:50.744 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.740+0000 7fd5d7fff640 1 -- 172.21.15.22:0/1025458927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f440210 msgr2=0x55754f436a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:40:50.744 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.740+0000 7fd5d7fff640 1 --2- 172.21.15.22:0/1025458927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f440210 0x55754f436a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.744 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.740+0000 7fd5d7fff640 1 -- 172.21.15.22:0/1025458927 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f43d230 msgr2=0x55754f437c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:50.745 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.741+0000 7fd5d7fff640 1 --2- 172.21.15.22:0/1025458927 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f43d230 0x55754f437c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.745 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.741+0000 7fd5d7fff640 1 -- 172.21.15.22:0/1025458927 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55754f0f1790 con 0x55754f437010 2024-08-20T01:40:50.745 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.741+0000 7fd5d7fff640 1 --2- 172.21.15.22:0/1025458927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f437010 0x55754f43ccf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc011f90 tx=0x7fd5cc018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca40ee7d30d24715 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:50.745 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.741+0000 7fd5b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-08-20T01:40:50.746 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.742+0000 7fd5b7fff640 1 -- 172.21.15.22:0/1025458927 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc01e920 con 0x55754f437010 2024-08-20T01:40:50.746 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.742+0000 7fd5e1c52740 1 -- 172.21.15.22:0/1025458927 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55754f33de00 con 0x55754f437010 2024-08-20T01:40:50.746 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.742+0000 7fd5b7fff640 1 -- 172.21.15.22:0/1025458927 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fd5cc01eac0 con 0x55754f437010 2024-08-20T01:40:50.746 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.743+0000 7fd5b7fff640 1 -- 172.21.15.22:0/1025458927 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd5cc01ed00 con 0x55754f437010 2024-08-20T01:40:50.746 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.744+0000 7fd5e1c52740 10 client.26716 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:50.746 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.744+0000 7fd5e1c52740 1 -- 172.21.15.22:0/1025458927 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55754f16a620 con 0x55754f437010 2024-08-20T01:40:50.749 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.747+0000 7fd5b7fff640 1 -- 172.21.15.22:0/1025458927 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55754f33de00 con 0x55754f437010 2024-08-20T01:40:50.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.748+0000 7fd5b7fff640 1 -- 172.21.15.22:0/1025458927 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fd5cc0263d0 con 0x55754f437010 2024-08-20T01:40:50.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.748+0000 7fd5e1c52740 10 client.26716 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:50.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.748+0000 7fd5e1c52740 10 client.26716 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:40:50.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.748+0000 7fd5e1c52740 20 client.26716 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:50.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.748+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/1025458927 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55754f4326e0 0x55754f434b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:50.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.748+0000 7fd5e1c52740 4 client.26716 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:50.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.748+0000 7fd5e1c52740 1 -- 172.21.15.22:0/1025458927 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55754f3a12b0 con 0x55754f4326e0 2024-08-20T01:40:50.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.749+0000 7fd5dcb24640 1 --2- 172.21.15.22:0/1025458927 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55754f4326e0 0x55754f434b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:50.754 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.751+0000 7fd5dcb24640 1 --2- 172.21.15.22:0/1025458927 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55754f4326e0 0x55754f434b80 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67a167158c697f42 server_cookie=b9ff0c2946f58c79 in_seq=0 out_seq=0 2024-08-20T01:40:50.754 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.752+0000 7fd5b7fff640 10 client.26716 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.753+0000 7fd5b7fff640 1 -- 172.21.15.22:0/1025458927 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55754f3a12b0 con 0x55754f4326e0 2024-08-20T01:40:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.753+0000 7fd5b7fff640 10 client.26716 handle_command_reply: tid=0 2024-08-20T01:40:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.753+0000 7fd5e1c52740 1 client.26716 shutdown 2024-08-20T01:40:50.758 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.754+0000 7fd5e1c52740 1 -- 172.21.15.22:0/1025458927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f437010 msgr2=0x55754f43ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:50.759 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.754+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/1025458927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f437010 0x55754f43ccf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc011f90 tx=0x7fd5cc018000 comp rx=0 tx=0).stop 2024-08-20T01:40:50.759 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.755+0000 7fd5e1c52740 1 -- 172.21.15.22:0/1025458927 shutdown_connections 2024-08-20T01:40:50.759 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.755+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/1025458927 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55754f4326e0 0x55754f434b80 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.759 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.755+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/1025458927 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f43d230 0x55754f437c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.759 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.755+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/1025458927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f437010 0x55754f43ccf0 secure :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc011f90 tx=0x7fd5cc018000 comp rx=0 tx=0).stop 2024-08-20T01:40:50.759 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.755+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/1025458927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f440210 0x55754f436a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.759 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.755+0000 7fd5e1c52740 1 -- 172.21.15.22:0/1025458927 >> 172.21.15.22:0/1025458927 conn(0x55754f427a20 msgr2=0x55754f426ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:50.759 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.755+0000 7fd5b7fff640 0 client.26716 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:50.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.758+0000 7fd5e1c52740 1 -- 172.21.15.22:0/1025458927 shutdown_connections 2024-08-20T01:40:50.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.759+0000 7fd5e1c52740 1 -- 172.21.15.22:0/1025458927 wait complete. 2024-08-20T01:40:50.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.760+0000 7fd5e1c52740 20 client.26716 trim_cache size 0 max 16384 2024-08-20T01:40:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.789+0000 7fd5e1c52740 1 Processor -- start 2024-08-20T01:40:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.790+0000 7fd5e1c52740 1 -- start start 2024-08-20T01:40:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.790+0000 7fd5e1c52740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f43d230 0x55754f435460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.790+0000 7fd5e1c52740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f440210 0x55754f437c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.790+0000 7fd5e1c52740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f4359a0 0x55754f4381a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.790+0000 7fd5e1c52740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d81a1cb0 con 0x55754f440210 2024-08-20T01:40:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.790+0000 7fd5e1c52740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d819f4c0 con 0x55754f43d230 2024-08-20T01:40:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.790+0000 7fd5e1c52740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d80736c0 con 0x55754f4359a0 2024-08-20T01:40:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.790+0000 7fd5d7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f440210 0x55754f437c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.790+0000 7fd5dcb24640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f43d230 0x55754f435460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.790+0000 7fd5d7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f440210 0x55754f437c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55682/0 (socket says 172.21.15.22:55682) 2024-08-20T01:40:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.790+0000 7fd5dcb24640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f43d230 0x55754f435460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:44914/0 (socket says 172.21.15.22:44914) 2024-08-20T01:40:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.790+0000 7fd5d7fff640 1 -- 172.21.15.22:0/3434960709 learned_addr learned my addr 172.21.15.22:0/3434960709 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.790+0000 7fd5dd325640 1 --2- 172.21.15.22:0/3434960709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f4359a0 0x55754f4381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.791+0000 7fd5dcb24640 1 -- 172.21.15.22:0/3434960709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f4359a0 msgr2=0x55754f4381a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.791+0000 7fd5dcb24640 1 --2- 172.21.15.22:0/3434960709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f4359a0 0x55754f4381a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.791+0000 7fd5dcb24640 1 -- 172.21.15.22:0/3434960709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f440210 msgr2=0x55754f437c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.791+0000 7fd5dcb24640 1 --2- 172.21.15.22:0/3434960709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f440210 0x55754f437c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.791+0000 7fd5dcb24640 1 -- 172.21.15.22:0/3434960709 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55754f442970 con 0x55754f43d230 2024-08-20T01:40:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.791+0000 7fd5dcb24640 1 --2- 172.21.15.22:0/3434960709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f43d230 0x55754f435460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55754f4353d0 tx=0x7fd5c8009830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4923d5fc7add621c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.791+0000 7fd5be7fc640 1 -- 172.21.15.22:0/3434960709 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8039af0 con 0x55754f43d230 2024-08-20T01:40:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.791+0000 7fd5be7fc640 1 -- 172.21.15.22:0/3434960709 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5c8005570 con 0x55754f43d230 2024-08-20T01:40:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.791+0000 7fd5be7fc640 1 -- 172.21.15.22:0/3434960709 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8003ca0 con 0x55754f43d230 2024-08-20T01:40:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.792+0000 7fd5e1c52740 1 -- 172.21.15.22:0/3434960709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f43d230 msgr2=0x55754f435460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.792+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/3434960709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f43d230 0x55754f435460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55754f4353d0 tx=0x7fd5c8009830 comp rx=0 tx=0).stop 2024-08-20T01:40:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.793+0000 7fd5e1c52740 1 -- 172.21.15.22:0/3434960709 shutdown_connections 2024-08-20T01:40:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.793+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/3434960709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f4359a0 0x55754f4381a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.793+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/3434960709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f440210 0x55754f437c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.793+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/3434960709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f43d230 0x55754f435460 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.794+0000 7fd5e1c52740 1 -- 172.21.15.22:0/3434960709 >> 172.21.15.22:0/3434960709 conn(0x55754f427a20 msgr2=0x55754f422780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.794+0000 7fd5e1c52740 1 -- 172.21.15.22:0/3434960709 shutdown_connections 2024-08-20T01:40:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.794+0000 7fd5e1c52740 1 -- 172.21.15.22:0/3434960709 wait complete. 2024-08-20T01:40:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.795+0000 7fd5e1c52740 1 -- start start 2024-08-20T01:40:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.795+0000 7fd5e1c52740 1 Processor -- start 2024-08-20T01:40:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.796+0000 7fd5e1c52740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f4359a0 0x55754f47de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:50.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.796+0000 7fd5e1c52740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f43d230 0x55754f44aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:50.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.796+0000 7fd5dcb24640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f4359a0 0x55754f47de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:50.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.796+0000 7fd5dcb24640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f4359a0 0x55754f47de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55694/0 (socket says 172.21.15.22:55694) 2024-08-20T01:40:50.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.796+0000 7fd5dcb24640 1 -- 172.21.15.22:0/2114001811 learned_addr learned my addr 172.21.15.22:0/2114001811 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:40:50.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.796+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/2114001811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f440210 0x55754f44af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:50.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.797+0000 7fd5d7fff640 1 --2- 172.21.15.22:0/2114001811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f43d230 0x55754f44aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:50.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.797+0000 7fd5e1c52740 1 -- 172.21.15.22:0/2114001811 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d8073d30 con 0x55754f4359a0 2024-08-20T01:40:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.797+0000 7fd5e1c52740 1 -- 172.21.15.22:0/2114001811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d819edf0 con 0x55754f440210 2024-08-20T01:40:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.797+0000 7fd5dd325640 1 --2- 172.21.15.22:0/2114001811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f440210 0x55754f44af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.797+0000 7fd5e1c52740 1 -- 172.21.15.22:0/2114001811 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d8074400 con 0x55754f43d230 2024-08-20T01:40:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.797+0000 7fd5e1c52740 10 client.0 _ll_register_callbacks cb 0x7fd5cc0044c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.798+0000 7fd5dcb24640 1 -- 172.21.15.22:0/2114001811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f43d230 msgr2=0x55754f44aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.798+0000 7fd5dcb24640 1 --2- 172.21.15.22:0/2114001811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f43d230 0x55754f44aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.798+0000 7fd5dcb24640 1 -- 172.21.15.22:0/2114001811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f440210 msgr2=0x55754f44af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:50.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.798+0000 7fd5dcb24640 1 --2- 172.21.15.22:0/2114001811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f440210 0x55754f44af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.798+0000 7fd5dcb24640 1 -- 172.21.15.22:0/2114001811 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55754f44b590 con 0x55754f4359a0 2024-08-20T01:40:50.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.798+0000 7fd5dcb24640 1 --2- 172.21.15.22:0/2114001811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f4359a0 0x55754f47de40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800dc80 tx=0x7fd5c80092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380660dd756a154b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:50.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.798+0000 7fd5b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:40:50.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.798+0000 7fd5b7fff640 1 -- 172.21.15.22:0/2114001811 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8039550 con 0x55754f4359a0 2024-08-20T01:40:50.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.798+0000 7fd5b7fff640 1 -- 172.21.15.22:0/2114001811 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7fd5c8052040 con 0x55754f4359a0 2024-08-20T01:40:50.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.798+0000 7fd5e1c52740 1 -- 172.21.15.22:0/2114001811 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5c8005570 con 0x55754f4359a0 2024-08-20T01:40:50.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.799+0000 7fd5b7fff640 1 -- 172.21.15.22:0/2114001811 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd5c8005050 con 0x55754f4359a0 2024-08-20T01:40:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.799+0000 7fd5e1c52740 10 client.17085 fetch_fsmap learned FSMap version 31 2024-08-20T01:40:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.799+0000 7fd5e1c52740 1 -- 172.21.15.22:0/2114001811 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55754f4cec00 con 0x55754f4359a0 2024-08-20T01:40:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.799+0000 7fd5b7fff640 1 -- 172.21.15.22:0/2114001811 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5c8005570 con 0x55754f4359a0 2024-08-20T01:40:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.799+0000 7fd5b7fff640 1 -- 172.21.15.22:0/2114001811 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fd5c803a7e0 con 0x55754f4359a0 2024-08-20T01:40:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.799+0000 7fd5e1c52740 10 client.17085 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:40:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.799+0000 7fd5e1c52740 10 client.17085 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:40:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.799+0000 7fd5e1c52740 20 client.17085 populate_metadata read hostname 'smithi022' 2024-08-20T01:40:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.799+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/2114001811 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55754f4cf240 0x55754f4d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.799+0000 7fd5e1c52740 4 client.17085 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:40:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.799+0000 7fd5e1c52740 1 -- 172.21.15.22:0/2114001811 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55754f39cd50 con 0x55754f4cf240 2024-08-20T01:40:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.800+0000 7fd5d7fff640 1 --2- 172.21.15.22:0/2114001811 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55754f4cf240 0x55754f4d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.801+0000 7fd5b7fff640 10 client.17085 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.801+0000 7fd5d7fff640 1 --2- 172.21.15.22:0/2114001811 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55754f4cf240 0x55754f4d1660 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c466bf2ad9895bbb server_cookie=167093819806409a in_seq=0 out_seq=0 2024-08-20T01:40:50.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.852+0000 7fd5b7fff640 1 -- 172.21.15.22:0/2114001811 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55754f39cd50 con 0x55754f4cf240 2024-08-20T01:40:50.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.852+0000 7fd5b7fff640 10 client.17085 handle_command_reply: tid=0 2024-08-20T01:40:50.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.852+0000 7fd5e1c52740 1 client.17085 shutdown 2024-08-20T01:40:50.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.852+0000 7fd5e1c52740 1 -- 172.21.15.22:0/2114001811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f4359a0 msgr2=0x55754f47de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:50.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.852+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/2114001811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f4359a0 0x55754f47de40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800dc80 tx=0x7fd5c80092d0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.852+0000 7fd5e1c52740 1 -- 172.21.15.22:0/2114001811 shutdown_connections 2024-08-20T01:40:50.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.852+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/2114001811 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55754f4cf240 0x55754f4d1660 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.852+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/2114001811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55754f440210 0x55754f44af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.852+0000 7fd5b7fff640 0 client.17085 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:40:50.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.852+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/2114001811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55754f43d230 0x55754f44aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.852+0000 7fd5e1c52740 1 --2- 172.21.15.22:0/2114001811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55754f4359a0 0x55754f47de40 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.852+0000 7fd5e1c52740 1 -- 172.21.15.22:0/2114001811 >> 172.21.15.22:0/2114001811 conn(0x55754f427a20 msgr2=0x55754f437c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:50.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.852+0000 7fd5e1c52740 1 -- 172.21.15.22:0/2114001811 shutdown_connections 2024-08-20T01:40:50.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.853+0000 7fd5e1c52740 1 -- 172.21.15.22:0/2114001811 wait complete. 2024-08-20T01:40:50.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.853+0000 7fd5e1c52740 20 client.17085 trim_cache size 0 max 16384 2024-08-20T01:40:50.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:40:50.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:40:50.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:40:50.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:40:50.857 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.853+0000 7fd5ded88640 1 -- 172.21.15.22:0/949624852 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd5c00b3cd0 msgr2=0x7fd5c00b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:50.857 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.853+0000 7fd5ded88640 1 --2- 172.21.15.22:0/949624852 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd5c00b3cd0 0x7fd5c00b6190 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x55754f428f40 tx=0x7fd5cc009f80 comp rx=0 tx=0).stop 2024-08-20T01:40:50.857 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.853+0000 7fd5ded88640 1 -- 172.21.15.22:0/949624852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5d8103070 msgr2=0x7fd5d81978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:50.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.853+0000 7fd5ded88640 1 --2- 172.21.15.22:0/949624852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5d8103070 0x7fd5d81978b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0034040 tx=0x7fd5d0003eb0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.853+0000 7fd5ded88640 1 -- 172.21.15.22:0/949624852 shutdown_connections 2024-08-20T01:40:50.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.853+0000 7fd5ded88640 1 --2- 172.21.15.22:0/949624852 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fd5c00b3cd0 0x7fd5c00b6190 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.853+0000 7fd5ded88640 1 --2- 172.21.15.22:0/949624852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5d8103070 0x7fd5d81978b0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.853+0000 7fd5ded88640 1 --2- 172.21.15.22:0/949624852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d81026b0 0x7fd5d8196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.853+0000 7fd5ded88640 1 --2- 172.21.15.22:0/949624852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5d8101560 0x7fd5d8196630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:50.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.853+0000 7fd5ded88640 1 -- 172.21.15.22:0/949624852 >> 172.21.15.22:0/949624852 conn(0x7fd5d80fce40 msgr2=0x7fd5d81059b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:50.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.854+0000 7fd5ded88640 1 -- 172.21.15.22:0/949624852 shutdown_connections 2024-08-20T01:40:50.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:40:50.854+0000 7fd5ded88640 1 -- 172.21.15.22:0/949624852 wait complete. 2024-08-20T01:40:51.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:50 smithi022 ceph-mon[18709]: pgmap v637: 97 pgs: 97 active+clean; 916 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.4 MiB/s wr, 1.37k op/s 2024-08-20T01:40:51.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:50 smithi134 ceph-mon[22511]: pgmap v637: 97 pgs: 97 active+clean; 916 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.4 MiB/s wr, 1.37k op/s 2024-08-20T01:40:51.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:50 smithi077 ceph-mon[22251]: pgmap v637: 97 pgs: 97 active+clean; 916 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.4 MiB/s wr, 1.37k op/s 2024-08-20T01:40:53.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:52 smithi022 ceph-mon[18709]: pgmap v638: 97 pgs: 97 active+clean; 899 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 686 op/s 2024-08-20T01:40:53.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:52 smithi134 ceph-mon[22511]: pgmap v638: 97 pgs: 97 active+clean; 899 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 686 op/s 2024-08-20T01:40:53.267 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:40:52 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f[52380]: *** Caught signal (Segmentation fault) ** 2024-08-20T01:40:53.267 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:40:52 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f[52380]: in thread 7fa4e0cb8640 thread_name:MR_Finisher 2024-08-20T01:40:53.267 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:40:52 smithi134 podman[56468]: 2024-08-20 01:40:52.929792061 +0000 UTC m=+0.017459016 container died 79057991df98fb8521da6e5f56083cf0376d563d1b8ec5df92fdda8de5193aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True) 2024-08-20T01:40:53.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:52 smithi077 ceph-mon[22251]: pgmap v638: 97 pgs: 97 active+clean; 899 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 686 op/s 2024-08-20T01:40:54.086 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:40:53 smithi134 podman[56468]: 2024-08-20 01:40:53.76813243 +0000 UTC m=+0.855799382 container remove 79057991df98fb8521da6e5f56083cf0376d563d1b8ec5df92fdda8de5193aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-08-20T01:40:54.086 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:40:53 smithi134 systemd[1]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.f.service: Main process exited, code=exited, status=139/n/a 2024-08-20T01:40:54.516 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:40:54 smithi134 systemd[1]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-08-20T01:40:54.517 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:40:54 smithi134 systemd[1]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.f.service: Consumed 49.520s CPU time. 2024-08-20T01:40:55.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:54 smithi022 ceph-mon[18709]: pgmap v639: 97 pgs: 97 active+clean; 866 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 545 op/s 2024-08-20T01:40:55.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:54 smithi134 ceph-mon[22511]: pgmap v639: 97 pgs: 97 active+clean; 866 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 545 op/s 2024-08-20T01:40:55.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:54 smithi077 ceph-mon[22251]: pgmap v639: 97 pgs: 97 active+clean; 866 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 545 op/s 2024-08-20T01:40:57.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:56 smithi022 ceph-mon[18709]: pgmap v640: 97 pgs: 97 active+clean; 856 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 395 op/s 2024-08-20T01:40:57.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:56 smithi134 ceph-mon[22511]: pgmap v640: 97 pgs: 97 active+clean; 856 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 395 op/s 2024-08-20T01:40:57.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:56 smithi077 ceph-mon[22251]: pgmap v640: 97 pgs: 97 active+clean; 856 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 395 op/s 2024-08-20T01:40:59.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:40:58 smithi022 ceph-mon[18709]: pgmap v641: 97 pgs: 97 active+clean; 834 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 480 op/s 2024-08-20T01:40:59.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:40:58 smithi134 ceph-mon[22511]: pgmap v641: 97 pgs: 97 active+clean; 834 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 480 op/s 2024-08-20T01:40:59.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:40:58 smithi077 ceph-mon[22251]: pgmap v641: 97 pgs: 97 active+clean; 834 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 480 op/s 2024-08-20T01:41:01.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:00 smithi022 ceph-mon[18709]: pgmap v642: 97 pgs: 97 active+clean; 823 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 436 op/s 2024-08-20T01:41:01.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:00 smithi134 ceph-mon[22511]: pgmap v642: 97 pgs: 97 active+clean; 823 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 436 op/s 2024-08-20T01:41:01.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:00 smithi077 ceph-mon[22251]: pgmap v642: 97 pgs: 97 active+clean; 823 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 436 op/s 2024-08-20T01:41:03.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:02 smithi022 ceph-mon[18709]: pgmap v643: 97 pgs: 97 active+clean; 816 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 436 op/s 2024-08-20T01:41:03.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:02 smithi134 ceph-mon[22511]: pgmap v643: 97 pgs: 97 active+clean; 816 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 436 op/s 2024-08-20T01:41:03.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:02 smithi077 ceph-mon[22251]: pgmap v643: 97 pgs: 97 active+clean; 816 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 436 op/s 2024-08-20T01:41:03.948 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.943+0000 7efc11892640 1 -- 172.21.15.22:0/1812546520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0c1030b0 msgr2=0x7efc0c109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:03.948 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.943+0000 7efc11892640 1 --2- 172.21.15.22:0/1812546520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0c1030b0 0x7efc0c109a30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7efc04009cd0 tx=0x7efc0402a8e0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.943+0000 7efc11892640 1 -- 172.21.15.22:0/1812546520 shutdown_connections 2024-08-20T01:41:03.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.943+0000 7efc11892640 1 --2- 172.21.15.22:0/1812546520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0c1030b0 0x7efc0c109a30 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.943+0000 7efc11892640 1 --2- 172.21.15.22:0/1812546520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc0c1026f0 0x7efc0c102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.943+0000 7efc11892640 1 --2- 172.21.15.22:0/1812546520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc0c1015a0 0x7efc0c1019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.943+0000 7efc11892640 1 -- 172.21.15.22:0/1812546520 >> 172.21.15.22:0/1812546520 conn(0x7efc0c0fce60 msgr2=0x7efc0c0ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:03.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.943+0000 7efc11892640 1 -- 172.21.15.22:0/1812546520 shutdown_connections 2024-08-20T01:41:03.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.943+0000 7efc11892640 1 -- 172.21.15.22:0/1812546520 wait complete. 2024-08-20T01:41:03.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc11892640 1 Processor -- start 2024-08-20T01:41:03.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc11892640 1 -- start start 2024-08-20T01:41:03.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc11892640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc0c1015a0 0x7efc0c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:03.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc11892640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc0c1026f0 0x7efc0c1990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:03.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc11892640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0c1030b0 0x7efc0c199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:03.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc11892640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c10d1f0 con 0x7efc0c1030b0 2024-08-20T01:41:03.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc11892640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c10d070 con 0x7efc0c1015a0 2024-08-20T01:41:03.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc11892640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c10d370 con 0x7efc0c1026f0 2024-08-20T01:41:03.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc0b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0c1030b0 0x7efc0c199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:03.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc0b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0c1030b0 0x7efc0c199d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48458/0 (socket says 172.21.15.22:48458) 2024-08-20T01:41:03.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc0b7fe640 1 -- 172.21.15.22:0/4185121323 learned_addr learned my addr 172.21.15.22:0/4185121323 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:03.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc0affd640 1 --2- 172.21.15.22:0/4185121323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc0c1015a0 0x7efc0c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:03.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc03fff640 1 --2- 172.21.15.22:0/4185121323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc0c1026f0 0x7efc0c1990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:03.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc0b7fe640 1 -- 172.21.15.22:0/4185121323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc0c1026f0 msgr2=0x7efc0c1990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:03.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc0b7fe640 1 --2- 172.21.15.22:0/4185121323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc0c1026f0 0x7efc0c1990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc0b7fe640 1 -- 172.21.15.22:0/4185121323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc0c1015a0 msgr2=0x7efc0c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:03.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc0b7fe640 1 --2- 172.21.15.22:0/4185121323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc0c1015a0 0x7efc0c198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc0b7fe640 1 -- 172.21.15.22:0/4185121323 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0c19a5c0 con 0x7efc0c1030b0 2024-08-20T01:41:03.951 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc03fff640 1 --2- 172.21.15.22:0/4185121323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc0c1026f0 0x7efc0c1990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:03.951 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.944+0000 7efc0b7fe640 1 --2- 172.21.15.22:0/4185121323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0c1030b0 0x7efc0c199d00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7efc04033040 tx=0x7efc04003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:03.951 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.945+0000 7efc10890640 1 -- 172.21.15.22:0/4185121323 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc04004450 con 0x7efc0c1030b0 2024-08-20T01:41:03.951 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.945+0000 7efc10890640 1 -- 172.21.15.22:0/4185121323 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc04003e10 con 0x7efc0c1030b0 2024-08-20T01:41:03.951 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.945+0000 7efc11892640 1 -- 172.21.15.22:0/4185121323 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc0c19a850 con 0x7efc0c1030b0 2024-08-20T01:41:03.951 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.945+0000 7efc10890640 1 -- 172.21.15.22:0/4185121323 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc04046480 con 0x7efc0c1030b0 2024-08-20T01:41:03.951 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.945+0000 7efc11892640 1 -- 172.21.15.22:0/4185121323 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc0c1a0f80 con 0x7efc0c1030b0 2024-08-20T01:41:03.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.947+0000 7efc1468a740 1 Processor -- start 2024-08-20T01:41:03.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.947+0000 7efc10890640 1 -- 172.21.15.22:0/4185121323 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7efc040045f0 con 0x7efc0c1030b0 2024-08-20T01:41:03.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.947+0000 7efc1468a740 1 -- start start 2024-08-20T01:41:03.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.947+0000 7efc1468a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a7895e8d0 0x563a78960cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:03.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.947+0000 7efc1468a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a78961200 0x563a789635f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:03.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.947+0000 7efc1468a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 0x563a78966100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:03.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.947+0000 7efc1468a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563a788d1360 con 0x563a78963c40 2024-08-20T01:41:03.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.947+0000 7efc1468a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563a788c0860 con 0x563a7895e8d0 2024-08-20T01:41:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.947+0000 7efc1468a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563a788c48a0 con 0x563a78961200 2024-08-20T01:41:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.948+0000 7efc03fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 0x563a78966100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.948+0000 7efc03fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 0x563a78966100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48472/0 (socket says 172.21.15.22:48472) 2024-08-20T01:41:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.948+0000 7efc03fff640 1 -- 172.21.15.22:0/1885019592 learned_addr learned my addr 172.21.15.22:0/1885019592 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.948+0000 7efc03fff640 1 --2- 172.21.15.22:0/1885019592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a7895e8d0 0x563a78960cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.948+0000 7efc0affd640 1 --2- 172.21.15.22:0/1885019592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a78961200 0x563a789635f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.948+0000 7efc03fff640 1 -- 172.21.15.22:0/1885019592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a78961200 msgr2=0x563a789635f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.948+0000 7efc03fff640 1 --2- 172.21.15.22:0/1885019592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a78961200 0x563a789635f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.948+0000 7efc03fff640 1 -- 172.21.15.22:0/1885019592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a7895e8d0 msgr2=0x563a78960cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.948+0000 7efc03fff640 1 --2- 172.21.15.22:0/1885019592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a7895e8d0 0x563a78960cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.948+0000 7efc03fff640 1 -- 172.21.15.22:0/1885019592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a78867e40 con 0x563a78963c40 2024-08-20T01:41:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.948+0000 7efc0affd640 1 --2- 172.21.15.22:0/1885019592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a78961200 0x563a789635f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.948+0000 7efc03fff640 1 --2- 172.21.15.22:0/1885019592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 0x563a78966100 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7efbf4012870 tx=0x7efbf4009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703a6c2d56404904 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.948+0000 7efc10890640 1 --2- 172.21.15.22:0/4185121323 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efbf80b3c50 0x7efbf80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.948+0000 7efc01ffb640 1 -- 172.21.15.22:0/1885019592 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf4012df0 con 0x563a78963c40 2024-08-20T01:41:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.948+0000 7efc01ffb640 1 -- 172.21.15.22:0/1885019592 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efbf4010c80 con 0x563a78963c40 2024-08-20T01:41:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.948+0000 7efc01ffb640 1 -- 172.21.15.22:0/1885019592 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf401ebb0 con 0x563a78963c40 2024-08-20T01:41:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.948+0000 7efc0affd640 1 --2- 172.21.15.22:0/4185121323 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efbf80b3c50 0x7efbf80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.949+0000 7efc10890640 1 -- 172.21.15.22:0/4185121323 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7efc0402e030 con 0x7efc0c1030b0 2024-08-20T01:41:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.949+0000 7efc1468a740 1 -- 172.21.15.22:0/1885019592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 msgr2=0x563a78966100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.949+0000 7efc1468a740 1 --2- 172.21.15.22:0/1885019592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 0x563a78966100 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7efbf4012870 tx=0x7efbf4009790 comp rx=0 tx=0).stop 2024-08-20T01:41:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.949+0000 7efc0affd640 1 --2- 172.21.15.22:0/4185121323 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efbf80b3c50 0x7efbf80b6110 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009db0 tx=0x7efbfc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.949+0000 7efc1468a740 1 -- 172.21.15.22:0/1885019592 shutdown_connections 2024-08-20T01:41:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.949+0000 7efc1468a740 1 --2- 172.21.15.22:0/1885019592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 0x563a78966100 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.949+0000 7efc1468a740 1 --2- 172.21.15.22:0/1885019592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a78961200 0x563a789635f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.949+0000 7efc1468a740 1 --2- 172.21.15.22:0/1885019592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a7895e8d0 0x563a78960cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.949+0000 7efc1468a740 1 -- 172.21.15.22:0/1885019592 >> 172.21.15.22:0/1885019592 conn(0x563a78959a20 msgr2=0x563a7895a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.949+0000 7efc1468a740 1 -- 172.21.15.22:0/1885019592 shutdown_connections 2024-08-20T01:41:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.949+0000 7efc1468a740 1 -- 172.21.15.22:0/1885019592 wait complete. 2024-08-20T01:41:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.949+0000 7efc1468a740 1 -- start start 2024-08-20T01:41:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc1468a740 1 Processor -- start 2024-08-20T01:41:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc1468a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a7895e8d0 0x563a78968150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc1468a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78961200 0x563a789687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc1468a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a78963c40 0x563a78969350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc1468a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563a787f9ab0 con 0x563a78961200 2024-08-20T01:41:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc1468a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563a78847780 con 0x563a7895e8d0 2024-08-20T01:41:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc1468a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563a78966c20 con 0x563a78963c40 2024-08-20T01:41:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc1468a740 10 client.0 _ll_register_callbacks cb 0x563a785cfa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc03fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78961200 0x563a789687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc0affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a7895e8d0 0x563a78968150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:03.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc03fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78961200 0x563a789687f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48486/0 (socket says 172.21.15.22:48486) 2024-08-20T01:41:03.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc0affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a7895e8d0 0x563a78968150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:56854/0 (socket says 172.21.15.22:56854) 2024-08-20T01:41:03.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc03fff640 1 -- 172.21.15.22:0/1767444008 learned_addr learned my addr 172.21.15.22:0/1767444008 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:03.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc0b7fe640 1 --2- 172.21.15.22:0/1767444008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a78963c40 0x563a78969350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:03.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc03fff640 1 -- 172.21.15.22:0/1767444008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a78963c40 msgr2=0x563a78969350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:03.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc03fff640 1 --2- 172.21.15.22:0/1767444008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a78963c40 0x563a78969350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc03fff640 1 -- 172.21.15.22:0/1767444008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a7895e8d0 msgr2=0x563a78968150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:03.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc03fff640 1 --2- 172.21.15.22:0/1767444008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a7895e8d0 0x563a78968150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc03fff640 1 -- 172.21.15.22:0/1767444008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a78623790 con 0x563a78961200 2024-08-20T01:41:03.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.950+0000 7efc0affd640 1 --2- 172.21.15.22:0/1767444008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a7895e8d0 0x563a78968150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:03.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.951+0000 7efc03fff640 1 --2- 172.21.15.22:0/1767444008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78961200 0x563a789687f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7efbf401eea0 tx=0x7efbf401eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf782fb3f92a4b55 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:03.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.951+0000 7efbeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:03.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.951+0000 7efbeaffd640 1 -- 172.21.15.22:0/1767444008 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf4004460 con 0x563a78961200 2024-08-20T01:41:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.951+0000 7efbeaffd640 1 -- 172.21.15.22:0/1767444008 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7efbf4005040 con 0x563a78961200 2024-08-20T01:41:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.951+0000 7efc1468a740 1 -- 172.21.15.22:0/1767444008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563a7886fe00 con 0x563a78961200 2024-08-20T01:41:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.951+0000 7efbeaffd640 1 -- 172.21.15.22:0/1767444008 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7efbf401e3c0 con 0x563a78961200 2024-08-20T01:41:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.951+0000 7efc1468a740 10 client.17097 fetch_fsmap learned FSMap version 31 2024-08-20T01:41:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.951+0000 7efc1468a740 1 -- 172.21.15.22:0/1767444008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563a7869c620 con 0x563a78961200 2024-08-20T01:41:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.951+0000 7efbeaffd640 1 -- 172.21.15.22:0/1767444008 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x563a7886fe00 con 0x563a78961200 2024-08-20T01:41:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.951+0000 7efbeaffd640 1 -- 172.21.15.22:0/1767444008 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7efbf40046c0 con 0x563a78961200 2024-08-20T01:41:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.951+0000 7efc1468a740 10 client.17097 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:41:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.951+0000 7efc1468a740 10 client.17097 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.951+0000 7efc1468a740 20 client.17097 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.951+0000 7efc1468a740 1 --2- 172.21.15.22:0/1767444008 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563a78973800 0x563a78975bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.951+0000 7efc1468a740 4 client.17097 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.951+0000 7efc1468a740 1 -- 172.21.15.22:0/1767444008 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a788d32b0 con 0x563a78973800 2024-08-20T01:41:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.952+0000 7efc0affd640 1 --2- 172.21.15.22:0/1767444008 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563a78973800 0x563a78975bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.952+0000 7efbeaffd640 10 client.17097 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.952+0000 7efc0affd640 1 --2- 172.21.15.22:0/1767444008 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563a78973800 0x563a78975bf0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1aec3b622aacef3e server_cookie=6b6b0310cf820ab2 in_seq=0 out_seq=0 2024-08-20T01:41:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.953+0000 7efbeaffd640 1 -- 172.21.15.22:0/1767444008 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a788d32b0 con 0x563a78973800 2024-08-20T01:41:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.953+0000 7efbeaffd640 10 client.17097 handle_command_reply: tid=0 2024-08-20T01:41:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.953+0000 7efc1468a740 1 client.17097 shutdown 2024-08-20T01:41:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.953+0000 7efc1468a740 1 -- 172.21.15.22:0/1767444008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78961200 msgr2=0x563a789687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.953+0000 7efc1468a740 1 --2- 172.21.15.22:0/1767444008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78961200 0x563a789687f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7efbf401eea0 tx=0x7efbf401eed0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.953+0000 7efc1468a740 1 -- 172.21.15.22:0/1767444008 shutdown_connections 2024-08-20T01:41:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.953+0000 7efc1468a740 1 --2- 172.21.15.22:0/1767444008 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563a78973800 0x563a78975bf0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.953+0000 7efc1468a740 1 --2- 172.21.15.22:0/1767444008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a78963c40 0x563a78969350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.953+0000 7efc1468a740 1 --2- 172.21.15.22:0/1767444008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78961200 0x563a789687f0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.953+0000 7efbeaffd640 0 client.17097 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.953+0000 7efc1468a740 1 --2- 172.21.15.22:0/1767444008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a7895e8d0 0x563a78968150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.953+0000 7efc1468a740 1 -- 172.21.15.22:0/1767444008 >> 172.21.15.22:0/1767444008 conn(0x563a78959a20 msgr2=0x563a78958ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.953+0000 7efc1468a740 1 -- 172.21.15.22:0/1767444008 shutdown_connections 2024-08-20T01:41:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.953+0000 7efc1468a740 1 -- 172.21.15.22:0/1767444008 wait complete. 2024-08-20T01:41:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.953+0000 7efc1468a740 20 client.17097 trim_cache size 0 max 16384 2024-08-20T01:41:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc1468a740 1 Processor -- start 2024-08-20T01:41:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc1468a740 1 -- start start 2024-08-20T01:41:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc1468a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a7895e8d0 0x563a789589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc1468a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a78961200 0x563a78958f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc1468a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 0x563a7895ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc1468a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c1ac620 con 0x563a78963c40 2024-08-20T01:41:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc1468a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c1a9e30 con 0x563a78961200 2024-08-20T01:41:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc1468a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c1a7c80 con 0x563a7895e8d0 2024-08-20T01:41:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc0b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 0x563a7895ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc0b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 0x563a7895ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48496/0 (socket says 172.21.15.22:48496) 2024-08-20T01:41:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc0b7fe640 1 -- 172.21.15.22:0/1701754205 learned_addr learned my addr 172.21.15.22:0/1701754205 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc03fff640 1 --2- 172.21.15.22:0/1701754205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a78961200 0x563a78958f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc0affd640 1 --2- 172.21.15.22:0/1701754205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a7895e8d0 0x563a789589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc0b7fe640 1 -- 172.21.15.22:0/1701754205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a7895e8d0 msgr2=0x563a789589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc0b7fe640 1 --2- 172.21.15.22:0/1701754205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a7895e8d0 0x563a789589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc0b7fe640 1 -- 172.21.15.22:0/1701754205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a78961200 msgr2=0x563a78958f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc0b7fe640 1 --2- 172.21.15.22:0/1701754205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a78961200 0x563a78958f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc0b7fe640 1 -- 172.21.15.22:0/1701754205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a78976250 con 0x563a78963c40 2024-08-20T01:41:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc0affd640 1 --2- 172.21.15.22:0/1701754205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a7895e8d0 0x563a789589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.968+0000 7efc03fff640 1 --2- 172.21.15.22:0/1701754205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a78961200 0x563a78958f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.969+0000 7efc0b7fe640 1 --2- 172.21.15.22:0/1701754205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 0x563a7895ba40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7efc041032a0 tx=0x7efc040ef040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd48337fe94487f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.969+0000 7efc017fa640 1 -- 172.21.15.22:0/1701754205 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc040e5020 con 0x563a78963c40 2024-08-20T01:41:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.969+0000 7efc017fa640 1 -- 172.21.15.22:0/1701754205 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc04036070 con 0x563a78963c40 2024-08-20T01:41:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.969+0000 7efc017fa640 1 -- 172.21.15.22:0/1701754205 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc040d5430 con 0x563a78963c40 2024-08-20T01:41:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.969+0000 7efc1468a740 1 -- 172.21.15.22:0/1701754205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 msgr2=0x563a7895ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.969+0000 7efc1468a740 1 --2- 172.21.15.22:0/1701754205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 0x563a7895ba40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7efc041032a0 tx=0x7efc040ef040 comp rx=0 tx=0).stop 2024-08-20T01:41:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.969+0000 7efc1468a740 1 -- 172.21.15.22:0/1701754205 shutdown_connections 2024-08-20T01:41:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.969+0000 7efc1468a740 1 --2- 172.21.15.22:0/1701754205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 0x563a7895ba40 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.969+0000 7efc1468a740 1 --2- 172.21.15.22:0/1701754205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a78961200 0x563a78958f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.969+0000 7efc1468a740 1 --2- 172.21.15.22:0/1701754205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a7895e8d0 0x563a789589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.969+0000 7efc1468a740 1 -- 172.21.15.22:0/1701754205 >> 172.21.15.22:0/1701754205 conn(0x563a78959a20 msgr2=0x563a789582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.969+0000 7efc1468a740 1 -- 172.21.15.22:0/1701754205 shutdown_connections 2024-08-20T01:41:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.969+0000 7efc1468a740 1 -- 172.21.15.22:0/1701754205 wait complete. 2024-08-20T01:41:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.970+0000 7efc1468a740 1 -- start start 2024-08-20T01:41:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.970+0000 7efc1468a740 1 Processor -- start 2024-08-20T01:41:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.970+0000 7efc1468a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a7895e8d0 0x563a7896f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.970+0000 7efc1468a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a78961200 0x563a7896feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.970+0000 7efc1468a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 0x563a7896e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.970+0000 7efc1468a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c1a82f0 con 0x563a78963c40 2024-08-20T01:41:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.970+0000 7efc1468a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c1a9760 con 0x563a78961200 2024-08-20T01:41:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.970+0000 7efc1468a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c1a89c0 con 0x563a7895e8d0 2024-08-20T01:41:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.970+0000 7efc1468a740 10 client.0 _ll_register_callbacks cb 0x7efbf4009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.970+0000 7efc0b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 0x563a7896e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.970+0000 7efc0b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 0x563a7896e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48512/0 (socket says 172.21.15.22:48512) 2024-08-20T01:41:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.970+0000 7efc0b7fe640 1 -- 172.21.15.22:0/1262185697 learned_addr learned my addr 172.21.15.22:0/1262185697 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.970+0000 7efc03fff640 1 --2- 172.21.15.22:0/1262185697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a78961200 0x563a7896feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.970+0000 7efc0affd640 1 --2- 172.21.15.22:0/1262185697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a7895e8d0 0x563a7896f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:03.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.970+0000 7efc0b7fe640 1 -- 172.21.15.22:0/1262185697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a7895e8d0 msgr2=0x563a7896f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.970+0000 7efc0b7fe640 1 --2- 172.21.15.22:0/1262185697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a7895e8d0 0x563a7896f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.970+0000 7efc0b7fe640 1 -- 172.21.15.22:0/1262185697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a78961200 msgr2=0x563a7896feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.970+0000 7efc0b7fe640 1 --2- 172.21.15.22:0/1262185697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a78961200 0x563a7896feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.970+0000 7efc0b7fe640 1 -- 172.21.15.22:0/1262185697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a7896eeb0 con 0x563a78963c40 2024-08-20T01:41:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.971+0000 7efc0b7fe640 1 --2- 172.21.15.22:0/1262185697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 0x563a7896e680 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7efc040cc310 tx=0x7efc040307d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f23ff876c2a9543 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.971+0000 7efbeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.971+0000 7efbeaffd640 1 -- 172.21.15.22:0/1262185697 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc040ea030 con 0x563a78963c40 2024-08-20T01:41:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.971+0000 7efbeaffd640 1 -- 172.21.15.22:0/1262185697 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8298+0+0 (secure 0 0 0) 0x7efc040c8970 con 0x563a78963c40 2024-08-20T01:41:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.971+0000 7efc1468a740 1 -- 172.21.15.22:0/1262185697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc04036070 con 0x563a78963c40 2024-08-20T01:41:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.971+0000 7efbeaffd640 1 -- 172.21.15.22:0/1262185697 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7efc040e5040 con 0x563a78963c40 2024-08-20T01:41:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.971+0000 7efc1468a740 10 client.17103 fetch_fsmap learned FSMap version 31 2024-08-20T01:41:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.971+0000 7efc1468a740 1 -- 172.21.15.22:0/1262185697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563a7896dd70 con 0x563a78963c40 2024-08-20T01:41:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.971+0000 7efbeaffd640 1 -- 172.21.15.22:0/1262185697 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc04036070 con 0x563a78963c40 2024-08-20T01:41:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.971+0000 7efbeaffd640 1 -- 172.21.15.22:0/1262185697 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7efc0404e070 con 0x563a78963c40 2024-08-20T01:41:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.971+0000 7efc1468a740 10 client.17103 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:41:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.971+0000 7efc1468a740 10 client.17103 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.971+0000 7efc1468a740 20 client.17103 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.971+0000 7efc1468a740 1 --2- 172.21.15.22:0/1262185697 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563a789de9f0 0x563a789e0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.971+0000 7efc1468a740 4 client.17103 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:41:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.971+0000 7efc1468a740 1 -- 172.21.15.22:0/1262185697 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563a788ced50 con 0x563a789de9f0 2024-08-20T01:41:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.971+0000 7efc0affd640 1 --2- 172.21.15.22:0/1262185697 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563a789de9f0 0x563a789e0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.972+0000 7efc0affd640 1 --2- 172.21.15.22:0/1262185697 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563a789de9f0 0x563a789e0e10 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b391878b60705635 server_cookie=d785c56f40b68e4b in_seq=0 out_seq=0 2024-08-20T01:41:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:03.972+0000 7efbeaffd640 10 client.17103 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.203+0000 7efbeaffd640 1 -- 172.21.15.22:0/1262185697 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563a788ced50 con 0x563a789de9f0 2024-08-20T01:41:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.203+0000 7efbeaffd640 10 client.17103 handle_command_reply: tid=0 2024-08-20T01:41:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.203+0000 7efc1468a740 1 client.17103 shutdown 2024-08-20T01:41:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.203+0000 7efc1468a740 1 -- 172.21.15.22:0/1262185697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 msgr2=0x563a7896e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.203+0000 7efc1468a740 1 --2- 172.21.15.22:0/1262185697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 0x563a7896e680 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7efc040cc310 tx=0x7efc040307d0 comp rx=0 tx=0).stop 2024-08-20T01:41:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.203+0000 7efc1468a740 1 -- 172.21.15.22:0/1262185697 shutdown_connections 2024-08-20T01:41:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.203+0000 7efc1468a740 1 --2- 172.21.15.22:0/1262185697 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x563a789de9f0 0x563a789e0e10 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.203+0000 7efc1468a740 1 --2- 172.21.15.22:0/1262185697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a78963c40 0x563a7896e680 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.203+0000 7efc1468a740 1 --2- 172.21.15.22:0/1262185697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a78961200 0x563a7896feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.203+0000 7efc1468a740 1 --2- 172.21.15.22:0/1262185697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a7895e8d0 0x563a7896f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.203+0000 7efbeaffd640 0 client.17103 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.203+0000 7efc1468a740 1 -- 172.21.15.22:0/1262185697 >> 172.21.15.22:0/1262185697 conn(0x563a78959a20 msgr2=0x563a78958ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.203+0000 7efc1468a740 1 -- 172.21.15.22:0/1262185697 shutdown_connections 2024-08-20T01:41:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.203+0000 7efc1468a740 1 -- 172.21.15.22:0/1262185697 wait complete. 2024-08-20T01:41:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.203+0000 7efc1468a740 20 client.17103 trim_cache size 0 max 16384 2024-08-20T01:41:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:41:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:41:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:41:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:41:04.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.204+0000 7efc11892640 1 -- 172.21.15.22:0/4185121323 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efbf80b3c50 msgr2=0x7efbf80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:04.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.204+0000 7efc11892640 1 --2- 172.21.15.22:0/4185121323 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efbf80b3c50 0x7efbf80b6110 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009db0 tx=0x7efbfc005f90 comp rx=0 tx=0).stop 2024-08-20T01:41:04.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.204+0000 7efc11892640 1 -- 172.21.15.22:0/4185121323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0c1030b0 msgr2=0x7efc0c199d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:04.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.204+0000 7efc11892640 1 --2- 172.21.15.22:0/4185121323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0c1030b0 0x7efc0c199d00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7efc04033040 tx=0x7efc04003c20 comp rx=0 tx=0).stop 2024-08-20T01:41:04.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.204+0000 7efc11892640 1 -- 172.21.15.22:0/4185121323 shutdown_connections 2024-08-20T01:41:04.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.204+0000 7efc11892640 1 --2- 172.21.15.22:0/4185121323 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7efbf80b3c50 0x7efbf80b6110 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:04.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.204+0000 7efc11892640 1 --2- 172.21.15.22:0/4185121323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0c1030b0 0x7efc0c199d00 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:04.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.204+0000 7efc11892640 1 --2- 172.21.15.22:0/4185121323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc0c1026f0 0x7efc0c1990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:04.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.204+0000 7efc11892640 1 --2- 172.21.15.22:0/4185121323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc0c1015a0 0x7efc0c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:04.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.204+0000 7efc11892640 1 -- 172.21.15.22:0/4185121323 >> 172.21.15.22:0/4185121323 conn(0x7efc0c0fce60 msgr2=0x7efc0c0fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:04.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.204+0000 7efc11892640 1 -- 172.21.15.22:0/4185121323 shutdown_connections 2024-08-20T01:41:04.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:04.204+0000 7efc11892640 1 -- 172.21.15.22:0/4185121323 wait complete. 2024-08-20T01:41:04.578 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:41:04 smithi134 systemd[1]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 1. 2024-08-20T01:41:04.579 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:41:04 smithi134 systemd[1]: Stopped Ceph mds.f for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:41:04.579 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:41:04 smithi134 systemd[1]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.f.service: Consumed 49.520s CPU time. 2024-08-20T01:41:04.579 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:41:04 smithi134 systemd[1]: Starting Ceph mds.f for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:41:04.579 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:41:04 smithi134 podman[56561]: 2024-08-20 01:41:04.415329298 +0000 UTC m=+0.016681373 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:41:04.579 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:41:04 smithi134 podman[56561]: 2024-08-20 01:41:04.577402015 +0000 UTC m=+0.178754081 container create b6d99713ecc1d8d27d7cae1ba09f16308260607cbc2806a2c3bbac8c37d46a30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-08-20T01:41:05.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:04 smithi022 ceph-mon[18709]: pgmap v644: 97 pgs: 97 active+clean; 779 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 475 op/s 2024-08-20T01:41:05.211 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:04 smithi134 ceph-mon[22511]: pgmap v644: 97 pgs: 97 active+clean; 779 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 475 op/s 2024-08-20T01:41:05.211 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:41:04 smithi134 podman[56561]: 2024-08-20 01:41:04.830712763 +0000 UTC m=+0.432064857 container init b6d99713ecc1d8d27d7cae1ba09f16308260607cbc2806a2c3bbac8c37d46a30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-08-20T01:41:05.212 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:41:04 smithi134 podman[56561]: 2024-08-20 01:41:04.834393922 +0000 UTC m=+0.435745988 container start b6d99713ecc1d8d27d7cae1ba09f16308260607cbc2806a2c3bbac8c37d46a30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-20T01:41:05.212 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:41:05 smithi134 bash[56561]: b6d99713ecc1d8d27d7cae1ba09f16308260607cbc2806a2c3bbac8c37d46a30 2024-08-20T01:41:05.212 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:41:05 smithi134 systemd[1]: Started Ceph mds.f for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:41:05.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:04 smithi077 ceph-mon[22251]: pgmap v644: 97 pgs: 97 active+clean; 779 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 475 op/s 2024-08-20T01:41:05.517 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:41:05 smithi134 ceph-mds[56579]: -- 172.21.15.134:0/204654752 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56539c69fc20 con 0x56539c67d400 2024-08-20T01:41:05.517 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:41:05 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f[56575]: starting mds.f at 2024-08-20T01:41:06.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:05 smithi022 ceph-mon[18709]: daemon mds.f restarted 2024-08-20T01:41:06.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:05 smithi022 ceph-mon[18709]: osdmap e80: 12 total, 12 up, 12 in 2024-08-20T01:41:06.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:05 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.134:6834/671075718,v1:172.21.15.134:6835/671075718] up:boot 2024-08-20T01:41:06.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:05 smithi022 ceph-mon[18709]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:41:06.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:05 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T01:41:06.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:05 smithi134 ceph-mon[22511]: daemon mds.f restarted 2024-08-20T01:41:06.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:05 smithi134 ceph-mon[22511]: osdmap e80: 12 total, 12 up, 12 in 2024-08-20T01:41:06.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:05 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.134:6834/671075718,v1:172.21.15.134:6835/671075718] up:boot 2024-08-20T01:41:06.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:05 smithi134 ceph-mon[22511]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:41:06.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:05 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T01:41:06.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:05 smithi077 ceph-mon[22251]: daemon mds.f restarted 2024-08-20T01:41:06.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:05 smithi077 ceph-mon[22251]: osdmap e80: 12 total, 12 up, 12 in 2024-08-20T01:41:06.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:05 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.134:6834/671075718,v1:172.21.15.134:6835/671075718] up:boot 2024-08-20T01:41:06.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:05 smithi077 ceph-mon[22251]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:41:06.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:05 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T01:41:06.981 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:41:07.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:06 smithi022 ceph-mon[18709]: pgmap v645: 97 pgs: 97 active+clean; 770 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 386 op/s 2024-08-20T01:41:07.248 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:07.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:06 smithi134 ceph-mon[22511]: pgmap v645: 97 pgs: 97 active+clean; 770 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 386 op/s 2024-08-20T01:41:07.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:06 smithi077 ceph-mon[22251]: pgmap v645: 97 pgs: 97 active+clean; 770 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 386 op/s 2024-08-20T01:41:07.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.806+0000 7f7ef6be5640 1 -- 172.21.15.22:0/2177446917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef0103850 msgr2=0x7f7ef0103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:07.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.806+0000 7f7ef6be5640 1 --2- 172.21.15.22:0/2177446917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef0103850 0x7f7ef0103c30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009900 tx=0x7f7ee402a410 comp rx=0 tx=0).stop 2024-08-20T01:41:07.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.806+0000 7f7ef6be5640 1 -- 172.21.15.22:0/2177446917 shutdown_connections 2024-08-20T01:41:07.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.806+0000 7f7ef6be5640 1 --2- 172.21.15.22:0/2177446917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ef010ce00 0x7f7ef010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.806+0000 7f7ef6be5640 1 --2- 172.21.15.22:0/2177446917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef0104250 0x7f7ef010c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.806+0000 7f7ef6be5640 1 --2- 172.21.15.22:0/2177446917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef0103850 0x7f7ef0103c30 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.806+0000 7f7ef6be5640 1 -- 172.21.15.22:0/2177446917 >> 172.21.15.22:0/2177446917 conn(0x7f7ef00fd400 msgr2=0x7f7ef00ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:07.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.806+0000 7f7ef6be5640 1 -- 172.21.15.22:0/2177446917 shutdown_connections 2024-08-20T01:41:07.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.806+0000 7f7ef6be5640 1 -- 172.21.15.22:0/2177446917 wait complete. 2024-08-20T01:41:07.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.807+0000 7f7ef6be5640 1 Processor -- start 2024-08-20T01:41:07.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.807+0000 7f7ef6be5640 1 -- start start 2024-08-20T01:41:07.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.807+0000 7f7ef6be5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef0103850 0x7f7ef01016d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:07.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.807+0000 7f7ef6be5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ef0104250 0x7f7ef0101c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:07.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.807+0000 7f7ef6be5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef010ce00 0x7f7ef0102150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:07.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.807+0000 7f7ef6be5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef0112ab0 con 0x7f7ef0103850 2024-08-20T01:41:07.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.807+0000 7f7ef6be5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef0112930 con 0x7f7ef010ce00 2024-08-20T01:41:07.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.807+0000 7f7ef6be5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef0112c30 con 0x7f7ef0104250 2024-08-20T01:41:07.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.807+0000 7f7ef4981640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef0103850 0x7f7ef01016d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:07.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.807+0000 7f7eeffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ef0104250 0x7f7ef0101c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:07.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.807+0000 7f7ef4981640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef0103850 0x7f7ef01016d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48542/0 (socket says 172.21.15.22:48542) 2024-08-20T01:41:07.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.807+0000 7f7ef4981640 1 -- 172.21.15.22:0/3696453547 learned_addr learned my addr 172.21.15.22:0/3696453547 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:07.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.807+0000 7f7ef5182640 1 --2- 172.21.15.22:0/3696453547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef010ce00 0x7f7ef0102150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:07.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.808+0000 7f7ef4981640 1 -- 172.21.15.22:0/3696453547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ef0104250 msgr2=0x7f7ef0101c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:07.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.808+0000 7f7ef4981640 1 --2- 172.21.15.22:0/3696453547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ef0104250 0x7f7ef0101c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.808+0000 7f7ef4981640 1 -- 172.21.15.22:0/3696453547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef010ce00 msgr2=0x7f7ef0102150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:07.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.808+0000 7f7ef4981640 1 --2- 172.21.15.22:0/3696453547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef010ce00 0x7f7ef0102150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.808+0000 7f7ef4981640 1 -- 172.21.15.22:0/3696453547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef01a7380 con 0x7f7ef0103850 2024-08-20T01:41:07.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.808+0000 7f7ef4981640 1 --2- 172.21.15.22:0/3696453547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef0103850 0x7f7ef01016d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4005ab0 tx=0x7f7ee4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:07.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.808+0000 7f7eedffb640 1 -- 172.21.15.22:0/3696453547 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee403f070 con 0x7f7ef0103850 2024-08-20T01:41:07.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.808+0000 7f7eedffb640 1 -- 172.21.15.22:0/3696453547 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ee4031b60 con 0x7f7ef0103850 2024-08-20T01:41:07.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.808+0000 7f7ef6be5640 1 -- 172.21.15.22:0/3696453547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef01a7610 con 0x7f7ef0103850 2024-08-20T01:41:07.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.808+0000 7f7eedffb640 1 -- 172.21.15.22:0/3696453547 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4035030 con 0x7f7ef0103850 2024-08-20T01:41:07.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.808+0000 7f7ef6be5640 1 -- 172.21.15.22:0/3696453547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef01a7af0 con 0x7f7ef0103850 2024-08-20T01:41:07.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.811+0000 7f7ef8fde740 1 Processor -- start 2024-08-20T01:41:07.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.811+0000 7f7ef8fde740 1 -- start start 2024-08-20T01:41:07.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.811+0000 7f7eedffb640 1 -- 172.21.15.22:0/3696453547 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7ee4042070 con 0x7f7ef0103850 2024-08-20T01:41:07.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.811+0000 7f7ef8fde740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e5830 0x55d5843e5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:07.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.811+0000 7f7ef8fde740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843e6150 0x55d5843f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:07.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.811+0000 7f7ef8fde740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843f20e0 0x55d5843f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:07.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.811+0000 7f7ef8fde740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d58435c8e0 con 0x55d5843f20e0 2024-08-20T01:41:07.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.811+0000 7f7ef8fde740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d58434bde0 con 0x55d5843e5830 2024-08-20T01:41:07.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.811+0000 7f7ef8fde740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d58434fe20 con 0x55d5843e6150 2024-08-20T01:41:07.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.811+0000 7f7ef4981640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843e6150 0x55d5843f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:07.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.812+0000 7f7eeffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843f20e0 0x55d5843f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:07.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.812+0000 7f7eeffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843f20e0 0x55d5843f44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48544/0 (socket says 172.21.15.22:48544) 2024-08-20T01:41:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.812+0000 7f7eeffff640 1 -- 172.21.15.22:0/1883646324 learned_addr learned my addr 172.21.15.22:0/1883646324 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.812+0000 7f7ef5182640 1 --2- 172.21.15.22:0/1883646324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e5830 0x55d5843e5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.812+0000 7f7ef5182640 1 -- 172.21.15.22:0/1883646324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843e6150 msgr2=0x55d5843f1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.812+0000 7f7ef5182640 1 --2- 172.21.15.22:0/1883646324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843e6150 0x55d5843f1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.812+0000 7f7ef5182640 1 -- 172.21.15.22:0/1883646324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843f20e0 msgr2=0x55d5843f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.812+0000 7f7ef5182640 1 --2- 172.21.15.22:0/1883646324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843f20e0 0x55d5843f44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.812+0000 7f7ef5182640 1 -- 172.21.15.22:0/1883646324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5840ab650 con 0x55d5843e5830 2024-08-20T01:41:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.812+0000 7f7eeffff640 1 --2- 172.21.15.22:0/1883646324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843f20e0 0x55d5843f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.812+0000 7f7ef5182640 1 --2- 172.21.15.22:0/1883646324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e5830 0x55d5843e5c10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8005fd0 tx=0x7f7ee8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a6fd196dc93376b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.812+0000 7f7edaffd640 1 -- 172.21.15.22:0/1883646324 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8004d20 con 0x55d5843e5830 2024-08-20T01:41:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.812+0000 7f7eedffb640 1 --2- 172.21.15.22:0/3696453547 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f7ee00b3bd0 0x7f7ee00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.812+0000 7f7edaffd640 1 -- 172.21.15.22:0/1883646324 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ee8004030 con 0x55d5843e5830 2024-08-20T01:41:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.813+0000 7f7edaffd640 1 -- 172.21.15.22:0/1883646324 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8005260 con 0x55d5843e5830 2024-08-20T01:41:07.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.813+0000 7f7ef4981640 1 --2- 172.21.15.22:0/3696453547 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f7ee00b3bd0 0x7f7ee00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:07.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.813+0000 7f7eedffb640 1 -- 172.21.15.22:0/3696453547 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8298+0+0 (secure 0 0 0) 0x7f7ee41042f0 con 0x7f7ef0103850 2024-08-20T01:41:07.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.813+0000 7f7ef8fde740 1 -- 172.21.15.22:0/1883646324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e5830 msgr2=0x55d5843e5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.813+0000 7f7ef4981640 1 --2- 172.21.15.22:0/3696453547 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f7ee00b3bd0 0x7f7ee00b6090 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4102120 tx=0x7f7ee4107dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.813+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/1883646324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e5830 0x55d5843e5c10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8005fd0 tx=0x7f7ee8011810 comp rx=0 tx=0).stop 2024-08-20T01:41:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.813+0000 7f7ef8fde740 1 -- 172.21.15.22:0/1883646324 shutdown_connections 2024-08-20T01:41:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.813+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/1883646324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843f20e0 0x55d5843f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.813+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/1883646324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843e6150 0x55d5843f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.813+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/1883646324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e5830 0x55d5843e5c10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.813+0000 7f7ef8fde740 1 -- 172.21.15.22:0/1883646324 >> 172.21.15.22:0/1883646324 conn(0x55d5843e3660 msgr2=0x55d5843e4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.813+0000 7f7ef8fde740 1 -- 172.21.15.22:0/1883646324 shutdown_connections 2024-08-20T01:41:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.813+0000 7f7ef8fde740 1 -- 172.21.15.22:0/1883646324 wait complete. 2024-08-20T01:41:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.814+0000 7f7ef8fde740 1 -- start start 2024-08-20T01:41:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.814+0000 7f7ef8fde740 1 Processor -- start 2024-08-20T01:41:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.814+0000 7f7ef8fde740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843e5830 0x55d5843ef030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:07.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.814+0000 7f7ef8fde740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843e6150 0x55d5843ef570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:07.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.814+0000 7f7ef8fde740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843f20e0 0x55d5843efab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:07.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.814+0000 7f7ef8fde740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d5841ae700 con 0x55d5843e6150 2024-08-20T01:41:07.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.814+0000 7f7ef8fde740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d5842d27c0 con 0x55d5843f20e0 2024-08-20T01:41:07.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.814+0000 7f7ef8fde740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d5843f4d90 con 0x55d5843e5830 2024-08-20T01:41:07.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.814+0000 7f7ef8fde740 10 client.0 _ll_register_callbacks cb 0x55d5843456b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:07.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.814+0000 7f7ef5182640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843e5830 0x55d5843ef030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:07.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.814+0000 7f7eeffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843e6150 0x55d5843ef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:07.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.815+0000 7f7ef5182640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843e5830 0x55d5843ef030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:36372/0 (socket says 172.21.15.22:36372) 2024-08-20T01:41:07.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.815+0000 7f7eeffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843e6150 0x55d5843ef570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48558/0 (socket says 172.21.15.22:48558) 2024-08-20T01:41:07.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.815+0000 7f7ef5182640 1 -- 172.21.15.22:0/458337691 learned_addr learned my addr 172.21.15.22:0/458337691 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:07.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.815+0000 7f7ef5182640 1 --2- 172.21.15.22:0/458337691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843f20e0 0x55d5843efab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:07.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.815+0000 7f7eeffff640 1 -- 172.21.15.22:0/458337691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843e5830 msgr2=0x55d5843ef030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:07.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.815+0000 7f7eeffff640 1 --2- 172.21.15.22:0/458337691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843e5830 0x55d5843ef030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.815+0000 7f7eeffff640 1 -- 172.21.15.22:0/458337691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843f20e0 msgr2=0x55d5843efab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:07.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.815+0000 7f7eeffff640 1 --2- 172.21.15.22:0/458337691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843f20e0 0x55d5843efab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.815+0000 7f7eeffff640 1 -- 172.21.15.22:0/458337691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5843fe120 con 0x55d5843e6150 2024-08-20T01:41:07.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.815+0000 7f7ef5182640 1 --2- 172.21.15.22:0/458337691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843e5830 0x55d5843ef030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:07.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.815+0000 7f7ecffff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:07.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.815+0000 7f7eeffff640 1 --2- 172.21.15.22:0/458337691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843e6150 0x55d5843ef570 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009560 tx=0x7f7edc012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27eb6c7c8291bdbc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:07.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.815+0000 7f7ecffff640 1 -- 172.21.15.22:0/458337691 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc004050 con 0x55d5843e6150 2024-08-20T01:41:07.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.815+0000 7f7ef8fde740 1 -- 172.21.15.22:0/458337691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d5842fb100 con 0x55d5843e6150 2024-08-20T01:41:07.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.815+0000 7f7ecffff640 1 -- 172.21.15.22:0/458337691 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8298+0+0 (secure 0 0 0) 0x7f7edc018030 con 0x55d5843e6150 2024-08-20T01:41:07.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.816+0000 7f7ecffff640 1 -- 172.21.15.22:0/458337691 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7edc004050 con 0x55d5843e6150 2024-08-20T01:41:07.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.816+0000 7f7ef8fde740 10 client.17121 fetch_fsmap learned FSMap version 32 2024-08-20T01:41:07.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.816+0000 7f7ef8fde740 1 -- 172.21.15.22:0/458337691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d584400b80 con 0x55d5843e6150 2024-08-20T01:41:07.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.816+0000 7f7ecffff640 1 -- 172.21.15.22:0/458337691 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d5842fb100 con 0x55d5843e6150 2024-08-20T01:41:07.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.816+0000 7f7ecffff640 1 -- 172.21.15.22:0/458337691 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f7edc0038c0 con 0x55d5843e6150 2024-08-20T01:41:07.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.816+0000 7f7ef8fde740 10 client.17121 fetch_fsmap finished waiting for FSMap version 32 2024-08-20T01:41:07.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.816+0000 7f7ef8fde740 10 client.17121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:07.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.816+0000 7f7ef8fde740 20 client.17121 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:07.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.816+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/458337691 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d584401f90 0x55d584404380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:07.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.816+0000 7f7ef8fde740 4 client.17121 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:07.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.816+0000 7f7ef8fde740 1 -- 172.21.15.22:0/458337691 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d58435e830 con 0x55d584401f90 2024-08-20T01:41:07.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.817+0000 7f7ef5182640 1 --2- 172.21.15.22:0/458337691 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d584401f90 0x55d584404380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:07.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.817+0000 7f7ef5182640 1 --2- 172.21.15.22:0/458337691 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d584401f90 0x55d584404380 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c8285fe884e6326 server_cookie=ca2fbe1be018a7fa in_seq=0 out_seq=0 2024-08-20T01:41:07.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.817+0000 7f7ecffff640 10 client.17121 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:07.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.818+0000 7f7ecffff640 1 -- 172.21.15.22:0/458337691 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d58435e830 con 0x55d584401f90 2024-08-20T01:41:07.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.818+0000 7f7ecffff640 10 client.17121 handle_command_reply: tid=0 2024-08-20T01:41:07.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.818+0000 7f7ef8fde740 1 client.17121 shutdown 2024-08-20T01:41:07.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.818+0000 7f7ef8fde740 1 -- 172.21.15.22:0/458337691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843e6150 msgr2=0x55d5843ef570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.818+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/458337691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843e6150 0x55d5843ef570 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009560 tx=0x7f7edc012b60 comp rx=0 tx=0).stop 2024-08-20T01:41:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.818+0000 7f7ef8fde740 1 -- 172.21.15.22:0/458337691 shutdown_connections 2024-08-20T01:41:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.818+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/458337691 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d584401f90 0x55d584404380 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.818+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/458337691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843f20e0 0x55d5843efab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.818+0000 7f7ecffff640 0 client.17121 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.818+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/458337691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843e6150 0x55d5843ef570 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.818+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/458337691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843e5830 0x55d5843ef030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.818+0000 7f7ef8fde740 1 -- 172.21.15.22:0/458337691 >> 172.21.15.22:0/458337691 conn(0x55d5843e3660 msgr2=0x55d5843e9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.818+0000 7f7ef8fde740 1 -- 172.21.15.22:0/458337691 shutdown_connections 2024-08-20T01:41:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.818+0000 7f7ef8fde740 1 -- 172.21.15.22:0/458337691 wait complete. 2024-08-20T01:41:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.819+0000 7f7ef8fde740 20 client.17121 trim_cache size 0 max 16384 2024-08-20T01:41:07.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.837+0000 7f7ef8fde740 1 Processor -- start 2024-08-20T01:41:07.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.837+0000 7f7ef8fde740 1 -- start start 2024-08-20T01:41:07.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.837+0000 7f7ef8fde740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843e5830 0x55d5843ef530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:07.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.837+0000 7f7ef8fde740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e6150 0x55d5843efa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:07.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.837+0000 7f7ef8fde740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843f20e0 0x55d584409c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:07.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.837+0000 7f7ef8fde740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef01b2f30 con 0x55d5843e5830 2024-08-20T01:41:07.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.837+0000 7f7ef8fde740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef01b0740 con 0x55d5843e6150 2024-08-20T01:41:07.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.837+0000 7f7ef8fde740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef01ae530 con 0x55d5843f20e0 2024-08-20T01:41:07.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.837+0000 7f7ef5182640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843e5830 0x55d5843ef530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:07.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.837+0000 7f7eeffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e6150 0x55d5843efa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.837+0000 7f7ef5182640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843e5830 0x55d5843ef530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48570/0 (socket says 172.21.15.22:48570) 2024-08-20T01:41:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.837+0000 7f7eeffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e6150 0x55d5843efa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:56888/0 (socket says 172.21.15.22:56888) 2024-08-20T01:41:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.837+0000 7f7ef5182640 1 -- 172.21.15.22:0/2661460309 learned_addr learned my addr 172.21.15.22:0/2661460309 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.837+0000 7f7ef5182640 1 --2- 172.21.15.22:0/2661460309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843f20e0 0x55d584409c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.838+0000 7f7eeffff640 1 -- 172.21.15.22:0/2661460309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843f20e0 msgr2=0x55d584409c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.838+0000 7f7eeffff640 1 --2- 172.21.15.22:0/2661460309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843f20e0 0x55d584409c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.838+0000 7f7eeffff640 1 -- 172.21.15.22:0/2661460309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843e5830 msgr2=0x55d5843ef530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.838+0000 7f7eeffff640 1 --2- 172.21.15.22:0/2661460309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843e5830 0x55d5843ef530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.838+0000 7f7eeffff640 1 -- 172.21.15.22:0/2661460309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5843e5f80 con 0x55d5843e6150 2024-08-20T01:41:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.838+0000 7f7eeffff640 1 --2- 172.21.15.22:0/2661460309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e6150 0x55d5843efa70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7edc003c90 tx=0x7f7edc005db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72c329340a8142fe server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.838+0000 7f7eda7fc640 1 -- 172.21.15.22:0/2661460309 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc004050 con 0x55d5843e6150 2024-08-20T01:41:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.838+0000 7f7eda7fc640 1 -- 172.21.15.22:0/2661460309 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7edc003e80 con 0x55d5843e6150 2024-08-20T01:41:07.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.838+0000 7f7eda7fc640 1 -- 172.21.15.22:0/2661460309 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc00f890 con 0x55d5843e6150 2024-08-20T01:41:07.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.839+0000 7f7ef8fde740 1 -- 172.21.15.22:0/2661460309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e6150 msgr2=0x55d5843efa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:07.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.839+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/2661460309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e6150 0x55d5843efa70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7edc003c90 tx=0x7f7edc005db0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.839+0000 7f7ef8fde740 1 -- 172.21.15.22:0/2661460309 shutdown_connections 2024-08-20T01:41:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.839+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/2661460309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843f20e0 0x55d584409c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.839+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/2661460309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e6150 0x55d5843efa70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.839+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/2661460309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843e5830 0x55d5843ef530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.839+0000 7f7ef8fde740 1 -- 172.21.15.22:0/2661460309 >> 172.21.15.22:0/2661460309 conn(0x55d5843e3660 msgr2=0x55d5843f0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.839+0000 7f7ef8fde740 1 -- 172.21.15.22:0/2661460309 shutdown_connections 2024-08-20T01:41:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.839+0000 7f7ef8fde740 1 -- 172.21.15.22:0/2661460309 wait complete. 2024-08-20T01:41:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.839+0000 7f7ef8fde740 1 -- start start 2024-08-20T01:41:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.839+0000 7f7ef8fde740 1 Processor -- start 2024-08-20T01:41:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.840+0000 7f7ef8fde740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e5830 0x55d5843f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.840+0000 7f7ef8fde740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843e6150 0x55d5843f5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.840+0000 7f7ef8fde740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843f20e0 0x55d58446ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.840+0000 7f7ef8fde740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef01aec00 con 0x55d5843e6150 2024-08-20T01:41:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.840+0000 7f7ef8fde740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef01b0070 con 0x55d5843e5830 2024-08-20T01:41:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.840+0000 7f7ef8fde740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef01af2d0 con 0x55d5843f20e0 2024-08-20T01:41:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.840+0000 7f7ef8fde740 10 client.0 _ll_register_callbacks cb 0x7f7edc009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.840+0000 7f7ef5182640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e5830 0x55d5843f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.840+0000 7f7eeffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843e6150 0x55d5843f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.840+0000 7f7ef5182640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e5830 0x55d5843f51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:56890/0 (socket says 172.21.15.22:56890) 2024-08-20T01:41:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.840+0000 7f7ef5182640 1 -- 172.21.15.22:0/1626945978 learned_addr learned my addr 172.21.15.22:0/1626945978 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.840+0000 7f7ef5182640 1 --2- 172.21.15.22:0/1626945978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843f20e0 0x55d58446ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.840+0000 7f7ef5182640 1 -- 172.21.15.22:0/1626945978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843f20e0 msgr2=0x55d58446ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.840+0000 7f7ef5182640 1 --2- 172.21.15.22:0/1626945978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843f20e0 0x55d58446ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.840+0000 7f7ef5182640 1 -- 172.21.15.22:0/1626945978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843e6150 msgr2=0x55d5843f5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.840+0000 7f7ef5182640 1 --2- 172.21.15.22:0/1626945978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843e6150 0x55d5843f5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.840+0000 7f7ef5182640 1 -- 172.21.15.22:0/1626945978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d58446b150 con 0x55d5843e5830 2024-08-20T01:41:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.840+0000 7f7ef5182640 1 --2- 172.21.15.22:0/1626945978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e5830 0x55d5843f51e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8004770 tx=0x7f7ee8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d022bf7df21f347 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.840+0000 7f7ecffff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:41:07.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.841+0000 7f7ecffff640 1 -- 172.21.15.22:0/1626945978 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee801e040 con 0x55d5843e5830 2024-08-20T01:41:07.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.841+0000 7f7ecffff640 1 -- 172.21.15.22:0/1626945978 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8298+0+0 (secure 0 0 0) 0x7f7ee8004f50 con 0x55d5843e5830 2024-08-20T01:41:07.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.841+0000 7f7ef8fde740 1 -- 172.21.15.22:0/1626945978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7edc003e80 con 0x55d5843e5830 2024-08-20T01:41:07.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.841+0000 7f7ecffff640 1 -- 172.21.15.22:0/1626945978 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7ee8040050 con 0x55d5843e5830 2024-08-20T01:41:07.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.841+0000 7f7ef8fde740 10 client.26723 fetch_fsmap learned FSMap version 32 2024-08-20T01:41:07.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.841+0000 7f7ef8fde740 1 -- 172.21.15.22:0/1626945978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d58446c310 con 0x55d5843e5830 2024-08-20T01:41:07.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.841+0000 7f7ecffff640 1 -- 172.21.15.22:0/1626945978 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7edc003e80 con 0x55d5843e5830 2024-08-20T01:41:07.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.841+0000 7f7ecffff640 1 -- 172.21.15.22:0/1626945978 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f7ee8024040 con 0x55d5843e5830 2024-08-20T01:41:07.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.841+0000 7f7ef8fde740 10 client.26723 fetch_fsmap finished waiting for FSMap version 32 2024-08-20T01:41:07.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.841+0000 7f7ef8fde740 10 client.26723 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:07.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.841+0000 7f7ef8fde740 20 client.26723 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:07.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.841+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/1626945978 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d584401f90 0x55d58446e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:07.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.841+0000 7f7ef8fde740 4 client.26723 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:41:07.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.841+0000 7f7ef8fde740 1 -- 172.21.15.22:0/1626945978 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d58435a2d0 con 0x55d584401f90 2024-08-20T01:41:07.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.841+0000 7f7eeffff640 1 --2- 172.21.15.22:0/1626945978 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d584401f90 0x55d58446e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:07.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.842+0000 7f7ecffff640 10 client.26723 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:07.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.842+0000 7f7eeffff640 1 --2- 172.21.15.22:0/1626945978 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d584401f90 0x55d58446e940 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ff871e0e0197dac server_cookie=189345daf7519d2a in_seq=0 out_seq=0 2024-08-20T01:41:07.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.842+0000 7f7ecffff640 1 -- 172.21.15.22:0/1626945978 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d58435a2d0 con 0x55d584401f90 2024-08-20T01:41:07.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.842+0000 7f7ecffff640 10 client.26723 handle_command_reply: tid=0 2024-08-20T01:41:07.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.842+0000 7f7ef8fde740 1 client.26723 shutdown 2024-08-20T01:41:07.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.842+0000 7f7ef8fde740 1 -- 172.21.15.22:0/1626945978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e5830 msgr2=0x55d5843f51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:07.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.842+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/1626945978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e5830 0x55d5843f51e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8004770 tx=0x7f7ee8011810 comp rx=0 tx=0).stop 2024-08-20T01:41:07.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.842+0000 7f7ef8fde740 1 -- 172.21.15.22:0/1626945978 shutdown_connections 2024-08-20T01:41:07.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.842+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/1626945978 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d584401f90 0x55d58446e940 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.842+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/1626945978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d5843f20e0 0x55d58446ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.842+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/1626945978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5843e6150 0x55d5843f5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.842+0000 7f7ecffff640 0 client.26723 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:07.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.842+0000 7f7ef8fde740 1 --2- 172.21.15.22:0/1626945978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5843e5830 0x55d5843f51e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.842+0000 7f7ef8fde740 1 -- 172.21.15.22:0/1626945978 >> 172.21.15.22:0/1626945978 conn(0x55d5843e3660 msgr2=0x55d5843e89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:07.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.843+0000 7f7ef8fde740 1 -- 172.21.15.22:0/1626945978 shutdown_connections 2024-08-20T01:41:07.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.843+0000 7f7ef8fde740 1 -- 172.21.15.22:0/1626945978 wait complete. 2024-08-20T01:41:07.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.843+0000 7f7ef8fde740 20 client.26723 trim_cache size 0 max 16384 2024-08-20T01:41:07.851 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:41:07.851 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-08-20T01:41:07.851 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-08-20T01:41:07.851 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:41:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.843+0000 7f7ef6be5640 1 -- 172.21.15.22:0/3696453547 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f7ee00b3bd0 msgr2=0x7f7ee00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.843+0000 7f7ef6be5640 1 --2- 172.21.15.22:0/3696453547 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f7ee00b3bd0 0x7f7ee00b6090 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4102120 tx=0x7f7ee4107dd0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.843+0000 7f7ef6be5640 1 -- 172.21.15.22:0/3696453547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef0103850 msgr2=0x7f7ef01016d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.843+0000 7f7ef6be5640 1 --2- 172.21.15.22:0/3696453547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef0103850 0x7f7ef01016d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4005ab0 tx=0x7f7ee4003c10 comp rx=0 tx=0).stop 2024-08-20T01:41:07.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.843+0000 7f7ef6be5640 1 -- 172.21.15.22:0/3696453547 shutdown_connections 2024-08-20T01:41:07.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.843+0000 7f7ef6be5640 1 --2- 172.21.15.22:0/3696453547 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f7ee00b3bd0 0x7f7ee00b6090 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.843+0000 7f7ef6be5640 1 --2- 172.21.15.22:0/3696453547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef010ce00 0x7f7ef0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.843+0000 7f7ef6be5640 1 --2- 172.21.15.22:0/3696453547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ef0104250 0x7f7ef0101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.843+0000 7f7ef6be5640 1 --2- 172.21.15.22:0/3696453547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef0103850 0x7f7ef01016d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:07.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.843+0000 7f7ef6be5640 1 -- 172.21.15.22:0/3696453547 >> 172.21.15.22:0/3696453547 conn(0x7f7ef00fd400 msgr2=0x7f7ef00fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:07.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.844+0000 7f7ef6be5640 1 -- 172.21.15.22:0/3696453547 shutdown_connections 2024-08-20T01:41:07.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:07.844+0000 7f7ef6be5640 1 -- 172.21.15.22:0/3696453547 wait complete. 2024-08-20T01:41:08.684 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:41:08.684 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:41:08.958 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:09.080 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:08 smithi022 ceph-mon[18709]: pgmap v647: 97 pgs: 97 active+clean; 748 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 431 op/s 2024-08-20T01:41:09.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:08 smithi134 ceph-mon[22511]: pgmap v647: 97 pgs: 97 active+clean; 748 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 431 op/s 2024-08-20T01:41:09.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:08 smithi077 ceph-mon[22251]: pgmap v647: 97 pgs: 97 active+clean; 748 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 431 op/s 2024-08-20T01:41:09.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.448+0000 7f24295a6640 1 -- 172.21.15.22:0/1102980896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2424101990 msgr2=0x7f2424101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:09.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.448+0000 7f24295a6640 1 --2- 172.21.15.22:0/1102980896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2424101990 0x7f2424101d70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2414009900 tx=0x7f241402a410 comp rx=0 tx=0).stop 2024-08-20T01:41:09.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.448+0000 7f24295a6640 1 -- 172.21.15.22:0/1102980896 shutdown_connections 2024-08-20T01:41:09.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.448+0000 7f24295a6640 1 --2- 172.21.15.22:0/1102980896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2424107d20 0x7f242410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:09.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.448+0000 7f24295a6640 1 --2- 172.21.15.22:0/1102980896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24241073a0 0x7f24241077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:09.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.448+0000 7f24295a6640 1 --2- 172.21.15.22:0/1102980896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2424101990 0x7f2424101d70 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:09.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.448+0000 7f24295a6640 1 -- 172.21.15.22:0/1102980896 >> 172.21.15.22:0/1102980896 conn(0x7f24240fd400 msgr2=0x7f24240ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:09.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.448+0000 7f24295a6640 1 -- 172.21.15.22:0/1102980896 shutdown_connections 2024-08-20T01:41:09.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.448+0000 7f24295a6640 1 -- 172.21.15.22:0/1102980896 wait complete. 2024-08-20T01:41:09.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.449+0000 7f24295a6640 1 Processor -- start 2024-08-20T01:41:09.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.449+0000 7f24295a6640 1 -- start start 2024-08-20T01:41:09.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.449+0000 7f24295a6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2424101990 0x7f2424103250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:09.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.449+0000 7f24295a6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24241073a0 0x7f2424103790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:09.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.449+0000 7f24295a6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2424107d20 0x7f2424103cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:09.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.449+0000 7f24295a6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2424111a30 con 0x7f24241073a0 2024-08-20T01:41:09.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.449+0000 7f24295a6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f24241118b0 con 0x7f2424107d20 2024-08-20T01:41:09.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.449+0000 7f24295a6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2424111bb0 con 0x7f2424101990 2024-08-20T01:41:09.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.449+0000 7f24227fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24241073a0 0x7f2424103790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:09.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.449+0000 7f24227fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24241073a0 0x7f2424103790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48608/0 (socket says 172.21.15.22:48608) 2024-08-20T01:41:09.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.449+0000 7f24227fc640 1 -- 172.21.15.22:0/3786903811 learned_addr learned my addr 172.21.15.22:0/3786903811 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:09.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.449+0000 7f24237fe640 1 --2- 172.21.15.22:0/3786903811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2424107d20 0x7f2424103cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:09.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.449+0000 7f2422ffd640 1 --2- 172.21.15.22:0/3786903811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2424101990 0x7f2424103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:09.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.450+0000 7f24227fc640 1 -- 172.21.15.22:0/3786903811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2424101990 msgr2=0x7f2424103250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:09.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.450+0000 7f24227fc640 1 --2- 172.21.15.22:0/3786903811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2424101990 0x7f2424103250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:09.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.450+0000 7f24227fc640 1 -- 172.21.15.22:0/3786903811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2424107d20 msgr2=0x7f2424103cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:09.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.450+0000 7f24227fc640 1 --2- 172.21.15.22:0/3786903811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2424107d20 0x7f2424103cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:09.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.450+0000 7f24227fc640 1 -- 172.21.15.22:0/3786903811 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24241a73f0 con 0x7f24241073a0 2024-08-20T01:41:09.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.450+0000 7f2422ffd640 1 --2- 172.21.15.22:0/3786903811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2424101990 0x7f2424103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:09.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.450+0000 7f24237fe640 1 --2- 172.21.15.22:0/3786903811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2424107d20 0x7f2424103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:09.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.450+0000 7f24227fc640 1 --2- 172.21.15.22:0/3786903811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24241073a0 0x7f2424103790 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f241800e9f0 tx=0x7f241800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:09.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.450+0000 7f240bfff640 1 -- 172.21.15.22:0/3786903811 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241800cd80 con 0x7f24241073a0 2024-08-20T01:41:09.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.450+0000 7f240bfff640 1 -- 172.21.15.22:0/3786903811 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24180108e0 con 0x7f24241073a0 2024-08-20T01:41:09.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.450+0000 7f24295a6640 1 -- 172.21.15.22:0/3786903811 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24241a76e0 con 0x7f24241073a0 2024-08-20T01:41:09.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.450+0000 7f240bfff640 1 -- 172.21.15.22:0/3786903811 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2418018980 con 0x7f24241073a0 2024-08-20T01:41:09.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.450+0000 7f24295a6640 1 -- 172.21.15.22:0/3786903811 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24241a7c20 con 0x7f24241073a0 2024-08-20T01:41:09.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.451+0000 7f24295a6640 1 -- 172.21.15.22:0/3786903811 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2424101d70 con 0x7f24241073a0 2024-08-20T01:41:09.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.453+0000 7f240bfff640 1 -- 172.21.15.22:0/3786903811 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2418010430 con 0x7f24241073a0 2024-08-20T01:41:09.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.454+0000 7f240bfff640 1 --2- 172.21.15.22:0/3786903811 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f240c0b3bd0 0x7f240c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:09.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.454+0000 7f2422ffd640 1 --2- 172.21.15.22:0/3786903811 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f240c0b3bd0 0x7f240c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:09.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.454+0000 7f240bfff640 1 -- 172.21.15.22:0/3786903811 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8298+0+0 (secure 0 0 0) 0x7f24180e44c0 con 0x7f24241073a0 2024-08-20T01:41:09.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.455+0000 7f2422ffd640 1 --2- 172.21.15.22:0/3786903811 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f240c0b3bd0 0x7f240c0b6090 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2414000c00 tx=0x7f2414005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:09.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.458+0000 7f240bfff640 1 -- 172.21.15.22:0/3786903811 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f24180abad0 con 0x7f24241073a0 2024-08-20T01:41:09.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.731+0000 7f24295a6640 1 -- 172.21.15.22:0/3786903811 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24241a7f50 con 0x7f24241073a0 2024-08-20T01:41:09.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.732+0000 7f240bfff640 1 -- 172.21.15.22:0/3786903811 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11912 (secure 0 0 0) 0x7f24180ab3d0 con 0x7f24241073a0 2024-08-20T01:41:09.735 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:41:09.736 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":32,"btime":"2024-08-20T01:41:05:653486+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:41:05.653460+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26746":{"gid":26746,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/671075718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":671075718},{"type":"v1","addr":"172.21.15.134:6835","nonce":671075718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24565,24575,24586]},"id":1}]} 2024-08-20T01:41:09.736 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 32 2024-08-20T01:41:09.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.736+0000 7f24295a6640 1 -- 172.21.15.22:0/3786903811 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f240c0b3bd0 msgr2=0x7f240c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:09.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.736+0000 7f24295a6640 1 --2- 172.21.15.22:0/3786903811 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f240c0b3bd0 0x7f240c0b6090 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2414000c00 tx=0x7f2414005a20 comp rx=0 tx=0).stop 2024-08-20T01:41:09.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.736+0000 7f24295a6640 1 -- 172.21.15.22:0/3786903811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24241073a0 msgr2=0x7f2424103790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:09.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.736+0000 7f24295a6640 1 --2- 172.21.15.22:0/3786903811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24241073a0 0x7f2424103790 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f241800e9f0 tx=0x7f241800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:41:09.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.737+0000 7f24295a6640 1 -- 172.21.15.22:0/3786903811 shutdown_connections 2024-08-20T01:41:09.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.737+0000 7f24295a6640 1 --2- 172.21.15.22:0/3786903811 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f240c0b3bd0 0x7f240c0b6090 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:09.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.737+0000 7f24295a6640 1 --2- 172.21.15.22:0/3786903811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2424107d20 0x7f2424103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:09.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.737+0000 7f24295a6640 1 --2- 172.21.15.22:0/3786903811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24241073a0 0x7f2424103790 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:09.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.737+0000 7f24295a6640 1 --2- 172.21.15.22:0/3786903811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2424101990 0x7f2424103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:09.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.737+0000 7f24295a6640 1 -- 172.21.15.22:0/3786903811 >> 172.21.15.22:0/3786903811 conn(0x7f24240fd400 msgr2=0x7f242406aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:09.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.737+0000 7f24295a6640 1 -- 172.21.15.22:0/3786903811 shutdown_connections 2024-08-20T01:41:09.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:09.737+0000 7f24295a6640 1 -- 172.21.15.22:0/3786903811 wait complete. 2024-08-20T01:41:10.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:09 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3786903811' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:41:10.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:09 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3786903811' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:41:10.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:09 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3786903811' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:41:10.427 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:41:10.746 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:11.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:10 smithi022 ceph-mon[18709]: pgmap v648: 97 pgs: 97 active+clean; 738 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 414 op/s 2024-08-20T01:41:11.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:10 smithi134 ceph-mon[22511]: pgmap v648: 97 pgs: 97 active+clean; 738 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 414 op/s 2024-08-20T01:41:11.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:10 smithi077 ceph-mon[22251]: pgmap v648: 97 pgs: 97 active+clean; 738 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 414 op/s 2024-08-20T01:41:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.237+0000 7f22fbd69640 1 -- 172.21.15.22:0/4161208955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22f4108e60 msgr2=0x7f22f410f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.237+0000 7f22fbd69640 1 --2- 172.21.15.22:0/4161208955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22f4108e60 0x7f22f410f660 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f22ec009ca0 tx=0x7f22ec02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.237+0000 7f22fbd69640 1 -- 172.21.15.22:0/4161208955 shutdown_connections 2024-08-20T01:41:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.237+0000 7f22fbd69640 1 --2- 172.21.15.22:0/4161208955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22f4108e60 0x7f22f410f660 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.237+0000 7f22fbd69640 1 --2- 172.21.15.22:0/4161208955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22f41084e0 0x7f22f4108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.237+0000 7f22fbd69640 1 --2- 172.21.15.22:0/4161208955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4102ad0 0x7f22f4102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.237+0000 7f22fbd69640 1 -- 172.21.15.22:0/4161208955 >> 172.21.15.22:0/4161208955 conn(0x7f22f40fe540 msgr2=0x7f22f4100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.237+0000 7f22fbd69640 1 -- 172.21.15.22:0/4161208955 shutdown_connections 2024-08-20T01:41:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.237+0000 7f22fbd69640 1 -- 172.21.15.22:0/4161208955 wait complete. 2024-08-20T01:41:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.237+0000 7f22fbd69640 1 Processor -- start 2024-08-20T01:41:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.237+0000 7f22fbd69640 1 -- start start 2024-08-20T01:41:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.238+0000 7f22fbd69640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22f4102ad0 0x7f22f4198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.238+0000 7f22fbd69640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f41084e0 0x7f22f4199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.238+0000 7f22fbd69640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22f4108e60 0x7f22f419e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.238+0000 7f22fbd69640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f22f4112b70 con 0x7f22f4108e60 2024-08-20T01:41:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.238+0000 7f22fbd69640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f22f41129f0 con 0x7f22f41084e0 2024-08-20T01:41:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.238+0000 7f22fbd69640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f22f4112cf0 con 0x7f22f4102ad0 2024-08-20T01:41:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.238+0000 7f22fa306640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22f4108e60 0x7f22f419e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.238+0000 7f22fa306640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22f4108e60 0x7f22f419e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45782/0 (socket says 172.21.15.22:45782) 2024-08-20T01:41:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.238+0000 7f22fa306640 1 -- 172.21.15.22:0/2354433765 learned_addr learned my addr 172.21.15.22:0/2354433765 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.238+0000 7f22f9304640 1 --2- 172.21.15.22:0/2354433765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f41084e0 0x7f22f4199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.238+0000 7f22f9b05640 1 --2- 172.21.15.22:0/2354433765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22f4102ad0 0x7f22f4198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.238+0000 7f22fa306640 1 -- 172.21.15.22:0/2354433765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22f4102ad0 msgr2=0x7f22f4198f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.238+0000 7f22fa306640 1 --2- 172.21.15.22:0/2354433765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22f4102ad0 0x7f22f4198f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.238+0000 7f22fa306640 1 -- 172.21.15.22:0/2354433765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f41084e0 msgr2=0x7f22f4199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.238+0000 7f22fa306640 1 --2- 172.21.15.22:0/2354433765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f41084e0 0x7f22f4199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.238+0000 7f22fa306640 1 -- 172.21.15.22:0/2354433765 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f419eff0 con 0x7f22f4108e60 2024-08-20T01:41:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.238+0000 7f22fa306640 1 --2- 172.21.15.22:0/2354433765 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22f4108e60 0x7f22f419e820 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f22ec009430 tx=0x7f22ec0317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.239+0000 7f22f2ffd640 1 -- 172.21.15.22:0/2354433765 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec003b70 con 0x7f22f4108e60 2024-08-20T01:41:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.239+0000 7f22f2ffd640 1 -- 172.21.15.22:0/2354433765 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22ec003d10 con 0x7f22f4108e60 2024-08-20T01:41:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.239+0000 7f22f2ffd640 1 -- 172.21.15.22:0/2354433765 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec02fa30 con 0x7f22f4108e60 2024-08-20T01:41:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.239+0000 7f22fbd69640 1 -- 172.21.15.22:0/2354433765 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f419f280 con 0x7f22f4108e60 2024-08-20T01:41:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.239+0000 7f22fbd69640 1 -- 172.21.15.22:0/2354433765 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f41a59a0 con 0x7f22f4108e60 2024-08-20T01:41:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.241+0000 7f22fe162740 1 Processor -- start 2024-08-20T01:41:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.241+0000 7f22f2ffd640 1 -- 172.21.15.22:0/2354433765 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f22ec02fbd0 con 0x7f22f4108e60 2024-08-20T01:41:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22fe162740 1 -- start start 2024-08-20T01:41:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22fe162740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 0x55e3c0e7ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:11.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22fe162740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0e8abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:11.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22fe162740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e8b130 0x55e3c0e8d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:11.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22fe162740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e3c0df5930 con 0x55e3c0e7f1a0 2024-08-20T01:41:11.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22fe162740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e3c0de4e30 con 0x55e3c0e8b130 2024-08-20T01:41:11.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22fe162740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e3c0de8e70 con 0x55e3c0e7e880 2024-08-20T01:41:11.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22f9b05640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0e8abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:11.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22f9304640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e8b130 0x55e3c0e8d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:11.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22f9b05640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0e8abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45786/0 (socket says 172.21.15.22:45786) 2024-08-20T01:41:11.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22f9304640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e8b130 0x55e3c0e8d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:39738/0 (socket says 172.21.15.22:39738) 2024-08-20T01:41:11.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22f9b05640 1 -- 172.21.15.22:0/2302991258 learned_addr learned my addr 172.21.15.22:0/2302991258 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:11.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22f9304640 1 --2- 172.21.15.22:0/2302991258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 0x55e3c0e7ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:11.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22f9304640 1 -- 172.21.15.22:0/2302991258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 msgr2=0x55e3c0e7ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22f9304640 1 --2- 172.21.15.22:0/2302991258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 0x55e3c0e7ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22f9304640 1 -- 172.21.15.22:0/2302991258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e7f1a0 msgr2=0x55e3c0e8abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22f9304640 1 --2- 172.21.15.22:0/2302991258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0e8abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22f9304640 1 -- 172.21.15.22:0/2302991258 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3c0b44650 con 0x55e3c0e8b130 2024-08-20T01:41:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22f9b05640 1 --2- 172.21.15.22:0/2302991258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0e8abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.242+0000 7f22f2ffd640 1 --2- 172.21.15.22:0/2354433765 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f22dc0b3bd0 0x7f22dc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.243+0000 7f22f9b05640 1 --2- 172.21.15.22:0/2354433765 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f22dc0b3bd0 0x7f22dc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.243+0000 7f22f9304640 1 --2- 172.21.15.22:0/2302991258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e8b130 0x55e3c0e8d520 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f22e8005d00 tx=0x7f22e8005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaf62c22e3c167ac server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.243+0000 7f22f2ffd640 1 -- 172.21.15.22:0/2354433765 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8298+0+0 (secure 0 0 0) 0x7f22ec104fe0 con 0x7f22f4108e60 2024-08-20T01:41:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.243+0000 7f22dbfff640 1 -- 172.21.15.22:0/2302991258 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8012d20 con 0x55e3c0e8b130 2024-08-20T01:41:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.243+0000 7f22dbfff640 1 -- 172.21.15.22:0/2302991258 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22e8005020 con 0x55e3c0e8b130 2024-08-20T01:41:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.243+0000 7f22dbfff640 1 -- 172.21.15.22:0/2302991258 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8004a00 con 0x55e3c0e8b130 2024-08-20T01:41:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.243+0000 7f22fe162740 1 -- 172.21.15.22:0/2302991258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e8b130 msgr2=0x55e3c0e8d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:11.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.243+0000 7f22fe162740 1 --2- 172.21.15.22:0/2302991258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e8b130 0x55e3c0e8d520 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f22e8005d00 tx=0x7f22e8005c90 comp rx=0 tx=0).stop 2024-08-20T01:41:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.243+0000 7f22f9b05640 1 --2- 172.21.15.22:0/2354433765 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f22dc0b3bd0 0x7f22dc0b6090 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55e3c0e81a00 tx=0x7f22e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.244+0000 7f22fe162740 1 -- 172.21.15.22:0/2302991258 shutdown_connections 2024-08-20T01:41:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.244+0000 7f22fe162740 1 --2- 172.21.15.22:0/2302991258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e8b130 0x55e3c0e8d520 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.244+0000 7f22fe162740 1 --2- 172.21.15.22:0/2302991258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0e8abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.244+0000 7f22fe162740 1 --2- 172.21.15.22:0/2302991258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 0x55e3c0e7ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.244+0000 7f22fe162740 1 -- 172.21.15.22:0/2302991258 >> 172.21.15.22:0/2302991258 conn(0x55e3c0e7c6b0 msgr2=0x55e3c0e7d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.244+0000 7f22fe162740 1 -- 172.21.15.22:0/2302991258 shutdown_connections 2024-08-20T01:41:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.244+0000 7f22fe162740 1 -- 172.21.15.22:0/2302991258 wait complete. 2024-08-20T01:41:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.244+0000 7f22fe162740 1 -- start start 2024-08-20T01:41:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.244+0000 7f22fe162740 1 Processor -- start 2024-08-20T01:41:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.244+0000 7f22fe162740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 0x55e3c0e880e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22fe162740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0e88620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22fe162740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 0x55e3c0e88b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22fe162740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e3c0c47700 con 0x55e3c0e8b130 2024-08-20T01:41:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22fe162740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e3c0d6b810 con 0x55e3c0e7f1a0 2024-08-20T01:41:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22fe162740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e3c0e8dde0 con 0x55e3c0e7e880 2024-08-20T01:41:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22fe162740 10 client.0 _ll_register_callbacks cb 0x55e3c0dde700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22fa306640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 0x55e3c0e88b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22fa306640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 0x55e3c0e88b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45796/0 (socket says 172.21.15.22:45796) 2024-08-20T01:41:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22fa306640 1 -- 172.21.15.22:0/2677093773 learned_addr learned my addr 172.21.15.22:0/2677093773 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22f9304640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0e88620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22f9b05640 1 --2- 172.21.15.22:0/2677093773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 0x55e3c0e880e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22fa306640 1 -- 172.21.15.22:0/2677093773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 msgr2=0x55e3c0e880e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22fa306640 1 --2- 172.21.15.22:0/2677093773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 0x55e3c0e880e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22fa306640 1 -- 172.21.15.22:0/2677093773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e7f1a0 msgr2=0x55e3c0e88620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:11.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22fa306640 1 --2- 172.21.15.22:0/2677093773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0e88620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22fa306640 1 -- 172.21.15.22:0/2677093773 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3c0e971f0 con 0x55e3c0e8b130 2024-08-20T01:41:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22fa306640 1 --2- 172.21.15.22:0/2677093773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 0x55e3c0e88b60 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0cbc90 tx=0x7f22ec0cbb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2baf398b4b52e49 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22d97fa640 1 -- 172.21.15.22:0/2677093773 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec0e6060 con 0x55e3c0e8b130 2024-08-20T01:41:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22d97fa640 1 -- 172.21.15.22:0/2677093773 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8298+0+0 (secure 0 0 0) 0x7f22ec0cc1f0 con 0x55e3c0e8b130 2024-08-20T01:41:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22fe162740 1 -- 172.21.15.22:0/2677093773 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e3c0d94150 con 0x55e3c0e8b130 2024-08-20T01:41:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22d97fa640 1 -- 172.21.15.22:0/2677093773 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f22ec0ed050 con 0x55e3c0e8b130 2024-08-20T01:41:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.245+0000 7f22fe162740 10 client.17145 fetch_fsmap learned FSMap version 32 2024-08-20T01:41:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.246+0000 7f22fe162740 1 -- 172.21.15.22:0/2677093773 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e3c0e99b80 con 0x55e3c0e8b130 2024-08-20T01:41:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.246+0000 7f22d97fa640 1 -- 172.21.15.22:0/2677093773 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e3c0d94150 con 0x55e3c0e8b130 2024-08-20T01:41:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.246+0000 7f22d97fa640 1 -- 172.21.15.22:0/2677093773 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f22ec0d4bb0 con 0x55e3c0e8b130 2024-08-20T01:41:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.246+0000 7f22fe162740 10 client.17145 fetch_fsmap finished waiting for FSMap version 32 2024-08-20T01:41:11.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.246+0000 7f22fe162740 10 client.17145 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:41:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.246+0000 7f22fe162740 20 client.17145 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.246+0000 7f22fe162740 1 --2- 172.21.15.22:0/2677093773 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55e3c0e9b080 0x55e3c0e9d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.246+0000 7f22fe162740 4 client.17145 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.246+0000 7f22fe162740 1 -- 172.21.15.22:0/2677093773 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3c0df7880 con 0x55e3c0e9b080 2024-08-20T01:41:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.246+0000 7f22f9b05640 1 --2- 172.21.15.22:0/2677093773 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55e3c0e9b080 0x55e3c0e9d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.247+0000 7f22d97fa640 10 client.17145 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:41:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.247+0000 7f22f9b05640 1 --2- 172.21.15.22:0/2677093773 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55e3c0e9b080 0x55e3c0e9d4a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2c2630ac4df2c64d server_cookie=c24879633f141764 in_seq=0 out_seq=0 2024-08-20T01:41:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.247+0000 7f22d97fa640 1 -- 172.21.15.22:0/2677093773 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e3c0df7880 con 0x55e3c0e9b080 2024-08-20T01:41:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.247+0000 7f22d97fa640 10 client.17145 handle_command_reply: tid=0 2024-08-20T01:41:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.247+0000 7f22fe162740 1 client.17145 shutdown 2024-08-20T01:41:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.248+0000 7f22fe162740 1 -- 172.21.15.22:0/2677093773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 msgr2=0x55e3c0e88b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.248+0000 7f22fe162740 1 --2- 172.21.15.22:0/2677093773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 0x55e3c0e88b60 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0cbc90 tx=0x7f22ec0cbb60 comp rx=0 tx=0).stop 2024-08-20T01:41:11.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.248+0000 7f22fe162740 1 -- 172.21.15.22:0/2677093773 shutdown_connections 2024-08-20T01:41:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.248+0000 7f22fe162740 1 --2- 172.21.15.22:0/2677093773 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55e3c0e9b080 0x55e3c0e9d4a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.248+0000 7f22fe162740 1 --2- 172.21.15.22:0/2677093773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 0x55e3c0e88b60 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.248+0000 7f22fe162740 1 --2- 172.21.15.22:0/2677093773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0e88620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.248+0000 7f22fe162740 1 --2- 172.21.15.22:0/2677093773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 0x55e3c0e880e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.248+0000 7f22fe162740 1 -- 172.21.15.22:0/2677093773 >> 172.21.15.22:0/2677093773 conn(0x55e3c0e7c6b0 msgr2=0x55e3c0e82250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.248+0000 7f22d97fa640 0 client.17145 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:41:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.248+0000 7f22fe162740 1 -- 172.21.15.22:0/2677093773 shutdown_connections 2024-08-20T01:41:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.248+0000 7f22fe162740 1 -- 172.21.15.22:0/2677093773 wait complete. 2024-08-20T01:41:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.248+0000 7f22fe162740 20 client.17145 trim_cache size 0 max 16384 2024-08-20T01:41:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.261+0000 7f22fe162740 1 Processor -- start 2024-08-20T01:41:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.261+0000 7f22fe162740 1 -- start start 2024-08-20T01:41:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.261+0000 7f22fe162740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 0x55e3c0e771e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.261+0000 7f22fe162740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0ea2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:11.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.261+0000 7f22fe162740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 0x55e3c0ea32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.261+0000 7f22fe162740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f22f41b0b20 con 0x55e3c0e8b130 2024-08-20T01:41:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.261+0000 7f22fe162740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f22f41ae330 con 0x55e3c0e7f1a0 2024-08-20T01:41:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.261+0000 7f22fe162740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f22f41ac180 con 0x55e3c0e7e880 2024-08-20T01:41:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.261+0000 7f22fa306640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 0x55e3c0ea32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.261+0000 7f22f9304640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0ea2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.261+0000 7f22f9304640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0ea2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:39754/0 (socket says 172.21.15.22:39754) 2024-08-20T01:41:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.261+0000 7f22fa306640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 0x55e3c0ea32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45812/0 (socket says 172.21.15.22:45812) 2024-08-20T01:41:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.261+0000 7f22f9304640 1 -- 172.21.15.22:0/2825031137 learned_addr learned my addr 172.21.15.22:0/2825031137 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.261+0000 7f22f9b05640 1 --2- 172.21.15.22:0/2825031137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 0x55e3c0e771e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.262+0000 7f22f9304640 1 -- 172.21.15.22:0/2825031137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 msgr2=0x55e3c0e771e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.262+0000 7f22f9304640 1 --2- 172.21.15.22:0/2825031137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 0x55e3c0e771e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.262+0000 7f22f9304640 1 -- 172.21.15.22:0/2825031137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 msgr2=0x55e3c0ea32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:11.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.262+0000 7f22f9304640 1 --2- 172.21.15.22:0/2825031137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 0x55e3c0ea32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.262+0000 7f22f9304640 1 -- 172.21.15.22:0/2825031137 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3c0e9db20 con 0x55e3c0e7f1a0 2024-08-20T01:41:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.262+0000 7f22f9b05640 1 --2- 172.21.15.22:0/2825031137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 0x55e3c0e771e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.262+0000 7f22fa306640 1 --2- 172.21.15.22:0/2825031137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 0x55e3c0ea32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.262+0000 7f22f9304640 1 --2- 172.21.15.22:0/2825031137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0ea2db0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f22e8005d00 tx=0x7f22e8012f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=704bca2b3e5e2cdc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.262+0000 7f22db7fe640 1 -- 172.21.15.22:0/2825031137 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e80052f0 con 0x55e3c0e7f1a0 2024-08-20T01:41:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.262+0000 7f22db7fe640 1 -- 172.21.15.22:0/2825031137 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22e8005490 con 0x55e3c0e7f1a0 2024-08-20T01:41:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.262+0000 7f22db7fe640 1 -- 172.21.15.22:0/2825031137 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e80035f0 con 0x55e3c0e7f1a0 2024-08-20T01:41:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.263+0000 7f22fe162740 1 -- 172.21.15.22:0/2825031137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e7f1a0 msgr2=0x55e3c0ea2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.263+0000 7f22fe162740 1 --2- 172.21.15.22:0/2825031137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0ea2db0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f22e8005d00 tx=0x7f22e8012f60 comp rx=0 tx=0).stop 2024-08-20T01:41:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.263+0000 7f22fe162740 1 -- 172.21.15.22:0/2825031137 shutdown_connections 2024-08-20T01:41:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.263+0000 7f22fe162740 1 --2- 172.21.15.22:0/2825031137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 0x55e3c0ea32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.263+0000 7f22fe162740 1 --2- 172.21.15.22:0/2825031137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0ea2db0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.263+0000 7f22fe162740 1 --2- 172.21.15.22:0/2825031137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 0x55e3c0e771e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.263+0000 7f22fe162740 1 -- 172.21.15.22:0/2825031137 >> 172.21.15.22:0/2825031137 conn(0x55e3c0e7c6b0 msgr2=0x55e3c0e89f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.263+0000 7f22fe162740 1 -- 172.21.15.22:0/2825031137 shutdown_connections 2024-08-20T01:41:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.263+0000 7f22fe162740 1 -- 172.21.15.22:0/2825031137 wait complete. 2024-08-20T01:41:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.263+0000 7f22fe162740 1 -- start start 2024-08-20T01:41:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.263+0000 7f22fe162740 1 Processor -- start 2024-08-20T01:41:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22fe162740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 0x55e3c0e90a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22fe162740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0e91000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22fe162740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 0x55e3c0efcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22fe162740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f22f41ac7f0 con 0x55e3c0e8b130 2024-08-20T01:41:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22fe162740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f22f41adc60 con 0x55e3c0e7f1a0 2024-08-20T01:41:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22fe162740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f22f41acec0 con 0x55e3c0e7e880 2024-08-20T01:41:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22fe162740 10 client.0 _ll_register_callbacks cb 0x7f22ec009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22fa306640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 0x55e3c0efcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:11.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22f9304640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0e91000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22f9b05640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 0x55e3c0e90a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22f9304640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0e91000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:39768/0 (socket says 172.21.15.22:39768) 2024-08-20T01:41:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22f9304640 1 -- 172.21.15.22:0/418005113 learned_addr learned my addr 172.21.15.22:0/418005113 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22f9304640 1 -- 172.21.15.22:0/418005113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 msgr2=0x55e3c0e90a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22f9304640 1 --2- 172.21.15.22:0/418005113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 0x55e3c0e90a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22f9304640 1 -- 172.21.15.22:0/418005113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 msgr2=0x55e3c0efcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22f9304640 1 --2- 172.21.15.22:0/418005113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 0x55e3c0efcdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22f9304640 1 -- 172.21.15.22:0/418005113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3c0e7d130 con 0x55e3c0e7f1a0 2024-08-20T01:41:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22fa306640 1 --2- 172.21.15.22:0/418005113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 0x55e3c0efcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22f9304640 1 --2- 172.21.15.22:0/418005113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0e91000 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f22e8010f20 tx=0x7f22e8010f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=453d8ed583e3d7d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:41:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.264+0000 7f22d97fa640 1 -- 172.21.15.22:0/418005113 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8034020 con 0x55e3c0e7f1a0 2024-08-20T01:41:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.265+0000 7f22d97fa640 1 -- 172.21.15.22:0/418005113 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8298+0+0 (secure 0 0 0) 0x7f22e800b6e0 con 0x55e3c0e7f1a0 2024-08-20T01:41:11.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.265+0000 7f22fe162740 1 -- 172.21.15.22:0/418005113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22e8005490 con 0x55e3c0e7f1a0 2024-08-20T01:41:11.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.265+0000 7f22d97fa640 1 -- 172.21.15.22:0/418005113 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f22e80052e0 con 0x55e3c0e7f1a0 2024-08-20T01:41:11.537 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:41:11.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.265+0000 7f22fe162740 10 client.26747 fetch_fsmap learned FSMap version 32 2024-08-20T01:41:11.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.265+0000 7f22fe162740 1 -- 172.21.15.22:0/418005113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e3c0f05880 con 0x55e3c0e7f1a0 2024-08-20T01:41:11.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.265+0000 7f22d97fa640 1 -- 172.21.15.22:0/418005113 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22e8005490 con 0x55e3c0e7f1a0 2024-08-20T01:41:11.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.265+0000 7f22d97fa640 1 -- 172.21.15.22:0/418005113 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f22e80038c0 con 0x55e3c0e7f1a0 2024-08-20T01:41:11.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.265+0000 7f22fe162740 10 client.26747 fetch_fsmap finished waiting for FSMap version 32 2024-08-20T01:41:11.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.265+0000 7f22fe162740 10 client.26747 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:41:11.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.265+0000 7f22fe162740 20 client.26747 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:11.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.265+0000 7f22fe162740 1 --2- 172.21.15.22:0/418005113 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55e3c0f05de0 0x55e3c0f08200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:11.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.265+0000 7f22fe162740 4 client.26747 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:41:11.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.265+0000 7f22fe162740 1 -- 172.21.15.22:0/418005113 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e3c0df3320 con 0x55e3c0f05de0 2024-08-20T01:41:11.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.265+0000 7f22f9b05640 1 --2- 172.21.15.22:0/418005113 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55e3c0f05de0 0x55e3c0f08200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:11.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.266+0000 7f22d97fa640 10 client.26747 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:41:11.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.266+0000 7f22f9b05640 1 --2- 172.21.15.22:0/418005113 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55e3c0f05de0 0x55e3c0f08200 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89d7830c205d5e67 server_cookie=fd25ee2795d9255e in_seq=0 out_seq=0 2024-08-20T01:41:11.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.266+0000 7f22d97fa640 1 -- 172.21.15.22:0/418005113 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e3c0df3320 con 0x55e3c0f05de0 2024-08-20T01:41:11.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.266+0000 7f22d97fa640 10 client.26747 handle_command_reply: tid=0 2024-08-20T01:41:11.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.266+0000 7f22fe162740 1 client.26747 shutdown 2024-08-20T01:41:11.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.266+0000 7f22fe162740 1 -- 172.21.15.22:0/418005113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e7f1a0 msgr2=0x55e3c0e91000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:11.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.266+0000 7f22fe162740 1 --2- 172.21.15.22:0/418005113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0e91000 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f22e8010f20 tx=0x7f22e8010f50 comp rx=0 tx=0).stop 2024-08-20T01:41:11.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.266+0000 7f22fe162740 1 -- 172.21.15.22:0/418005113 shutdown_connections 2024-08-20T01:41:11.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.266+0000 7f22fe162740 1 --2- 172.21.15.22:0/418005113 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55e3c0f05de0 0x55e3c0f08200 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.266+0000 7f22fe162740 1 --2- 172.21.15.22:0/418005113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e3c0e8b130 0x55e3c0efcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.266+0000 7f22fe162740 1 --2- 172.21.15.22:0/418005113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3c0e7f1a0 0x55e3c0e91000 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.266+0000 7f22d97fa640 0 client.26747 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:41:11.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.266+0000 7f22fe162740 1 --2- 172.21.15.22:0/418005113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e3c0e7e880 0x55e3c0e90a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.266+0000 7f22fe162740 1 -- 172.21.15.22:0/418005113 >> 172.21.15.22:0/418005113 conn(0x55e3c0e7c6b0 msgr2=0x55e3c0e82250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:11.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.266+0000 7f22fe162740 1 -- 172.21.15.22:0/418005113 shutdown_connections 2024-08-20T01:41:11.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.266+0000 7f22fe162740 1 -- 172.21.15.22:0/418005113 wait complete. 2024-08-20T01:41:11.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.266+0000 7f22fe162740 20 client.26747 trim_cache size 0 max 16384 2024-08-20T01:41:11.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.267+0000 7f22fbd69640 1 -- 172.21.15.22:0/2354433765 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f22dc0b3bd0 msgr2=0x7f22dc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:11.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.267+0000 7f22fbd69640 1 --2- 172.21.15.22:0/2354433765 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f22dc0b3bd0 0x7f22dc0b6090 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55e3c0e81a00 tx=0x7f22e4005f90 comp rx=0 tx=0).stop 2024-08-20T01:41:11.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.267+0000 7f22fbd69640 1 -- 172.21.15.22:0/2354433765 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22f4108e60 msgr2=0x7f22f419e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:11.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.267+0000 7f22fbd69640 1 --2- 172.21.15.22:0/2354433765 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22f4108e60 0x7f22f419e820 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f22ec009430 tx=0x7f22ec0317c0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.267+0000 7f22fbd69640 1 -- 172.21.15.22:0/2354433765 shutdown_connections 2024-08-20T01:41:11.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.267+0000 7f22fbd69640 1 --2- 172.21.15.22:0/2354433765 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f22dc0b3bd0 0x7f22dc0b6090 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.267+0000 7f22fbd69640 1 --2- 172.21.15.22:0/2354433765 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22f4108e60 0x7f22f419e820 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.267+0000 7f22fbd69640 1 --2- 172.21.15.22:0/2354433765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f41084e0 0x7f22f4199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.267+0000 7f22fbd69640 1 --2- 172.21.15.22:0/2354433765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22f4102ad0 0x7f22f4198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:11.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.267+0000 7f22fbd69640 1 -- 172.21.15.22:0/2354433765 >> 172.21.15.22:0/2354433765 conn(0x7f22f40fe540 msgr2=0x7f22f4100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:11.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.267+0000 7f22fbd69640 1 -- 172.21.15.22:0/2354433765 shutdown_connections 2024-08-20T01:41:11.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:11.267+0000 7f22fbd69640 1 -- 172.21.15.22:0/2354433765 wait complete. 2024-08-20T01:41:12.262 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:41:12.588 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:12.969 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:12 smithi022 ceph-mon[18709]: pgmap v649: 97 pgs: 97 active+clean; 729 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 444 op/s 2024-08-20T01:41:13.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.206+0000 7fca1f38b640 1 -- 172.21.15.22:0/747014091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca18102ad0 msgr2=0x7fca18102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:13.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.206+0000 7fca1f38b640 1 --2- 172.21.15.22:0/747014091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca18102ad0 0x7fca18102eb0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fca14009900 tx=0x7fca1402a410 comp rx=0 tx=0).stop 2024-08-20T01:41:13.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.206+0000 7fca1f38b640 1 -- 172.21.15.22:0/747014091 shutdown_connections 2024-08-20T01:41:13.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.206+0000 7fca1f38b640 1 --2- 172.21.15.22:0/747014091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca18108e60 0x7fca1810f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.206+0000 7fca1f38b640 1 --2- 172.21.15.22:0/747014091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca181084e0 0x7fca18108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.206+0000 7fca1f38b640 1 --2- 172.21.15.22:0/747014091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca18102ad0 0x7fca18102eb0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.206+0000 7fca1f38b640 1 -- 172.21.15.22:0/747014091 >> 172.21.15.22:0/747014091 conn(0x7fca180fe540 msgr2=0x7fca18100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:13.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.206+0000 7fca1f38b640 1 -- 172.21.15.22:0/747014091 shutdown_connections 2024-08-20T01:41:13.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.206+0000 7fca1f38b640 1 -- 172.21.15.22:0/747014091 wait complete. 2024-08-20T01:41:13.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.207+0000 7fca1f38b640 1 Processor -- start 2024-08-20T01:41:13.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.207+0000 7fca1f38b640 1 -- start start 2024-08-20T01:41:13.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.207+0000 7fca1f38b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca18102ad0 0x7fca18199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:13.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.207+0000 7fca1f38b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca181084e0 0x7fca18199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:13.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.207+0000 7fca1f38b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca18108e60 0x7fca1819e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:13.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.207+0000 7fca1f38b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fca18112ae0 con 0x7fca18108e60 2024-08-20T01:41:13.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.207+0000 7fca1f38b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fca18112960 con 0x7fca181084e0 2024-08-20T01:41:13.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.207+0000 7fca1f38b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fca18112c60 con 0x7fca18102ad0 2024-08-20T01:41:13.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.207+0000 7fca1c926640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca181084e0 0x7fca18199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:13.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.207+0000 7fca1d928640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca18108e60 0x7fca1819e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:13.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.207+0000 7fca1c926640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca181084e0 0x7fca18199550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:39780/0 (socket says 172.21.15.22:39780) 2024-08-20T01:41:13.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.207+0000 7fca1d127640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca18102ad0 0x7fca18199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:13.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.207+0000 7fca1c926640 1 -- 172.21.15.22:0/4234260238 learned_addr learned my addr 172.21.15.22:0/4234260238 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:13.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.207+0000 7fca1d928640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca18108e60 0x7fca1819e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45842/0 (socket says 172.21.15.22:45842) 2024-08-20T01:41:13.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.208+0000 7fca1c926640 1 -- 172.21.15.22:0/4234260238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca18102ad0 msgr2=0x7fca18199010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:13.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.208+0000 7fca1c926640 1 --2- 172.21.15.22:0/4234260238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca18102ad0 0x7fca18199010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.208+0000 7fca1c926640 1 -- 172.21.15.22:0/4234260238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca18108e60 msgr2=0x7fca1819e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:13.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.208+0000 7fca1c926640 1 --2- 172.21.15.22:0/4234260238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca18108e60 0x7fca1819e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.208+0000 7fca1c926640 1 -- 172.21.15.22:0/4234260238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1819f0c0 con 0x7fca181084e0 2024-08-20T01:41:13.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.208+0000 7fca1c926640 1 --2- 172.21.15.22:0/4234260238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca181084e0 0x7fca18199550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fca0800ea60 tx=0x7fca0800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:13.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.208+0000 7fca0e7fc640 1 -- 172.21.15.22:0/4234260238 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0800cde0 con 0x7fca181084e0 2024-08-20T01:41:13.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.208+0000 7fca0e7fc640 1 -- 172.21.15.22:0/4234260238 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca080035f0 con 0x7fca181084e0 2024-08-20T01:41:13.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.208+0000 7fca1f38b640 1 -- 172.21.15.22:0/4234260238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca1819f3b0 con 0x7fca181084e0 2024-08-20T01:41:13.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.208+0000 7fca0e7fc640 1 -- 172.21.15.22:0/4234260238 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08010690 con 0x7fca181084e0 2024-08-20T01:41:13.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.208+0000 7fca1f38b640 1 -- 172.21.15.22:0/4234260238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca181a5a70 con 0x7fca181084e0 2024-08-20T01:41:13.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.211+0000 7fca21784740 1 Processor -- start 2024-08-20T01:41:13.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.211+0000 7fca0e7fc640 1 -- 172.21.15.22:0/4234260238 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fca080037a0 con 0x7fca181084e0 2024-08-20T01:41:13.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.211+0000 7fca21784740 1 -- start start 2024-08-20T01:41:13.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.211+0000 7fca21784740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499e880 0x56138499ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:13.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.211+0000 7fca21784740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499f1a0 0x5613849aabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:13.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.211+0000 7fca21784740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613849ab130 0x5613849ad520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:13.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.211+0000 7fca21784740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561384915930 con 0x56138499f1a0 2024-08-20T01:41:13.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.211+0000 7fca21784740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561384904e30 con 0x5613849ab130 2024-08-20T01:41:13.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.212+0000 7fca21784740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561384908e70 con 0x56138499e880 2024-08-20T01:41:13.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.212+0000 7fca1d127640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499f1a0 0x5613849aabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:13.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.212+0000 7fca1d127640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499f1a0 0x5613849aabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45848/0 (socket says 172.21.15.22:45848) 2024-08-20T01:41:13.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.212+0000 7fca1d127640 1 -- 172.21.15.22:0/3830570921 learned_addr learned my addr 172.21.15.22:0/3830570921 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:13.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.212+0000 7fca1d928640 1 --2- 172.21.15.22:0/3830570921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499e880 0x56138499ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:13.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.212+0000 7fca1c926640 1 --2- 172.21.15.22:0/3830570921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613849ab130 0x5613849ad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:13.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.212+0000 7fca1d928640 1 -- 172.21.15.22:0/3830570921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613849ab130 msgr2=0x5613849ad520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:13.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.212+0000 7fca1d928640 1 --2- 172.21.15.22:0/3830570921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613849ab130 0x5613849ad520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.212+0000 7fca1d928640 1 -- 172.21.15.22:0/3830570921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499f1a0 msgr2=0x5613849aabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:13.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.212+0000 7fca1d928640 1 --2- 172.21.15.22:0/3830570921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499f1a0 0x5613849aabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.212+0000 7fca1d928640 1 -- 172.21.15.22:0/3830570921 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561384664650 con 0x56138499e880 2024-08-20T01:41:13.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.212+0000 7fca1d127640 1 --2- 172.21.15.22:0/3830570921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499f1a0 0x5613849aabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:13.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.212+0000 7fca1c926640 1 --2- 172.21.15.22:0/3830570921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613849ab130 0x5613849ad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:13.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.212+0000 7fca1d928640 1 --2- 172.21.15.22:0/3830570921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499e880 0x56138499ec60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fca10009f30 tx=0x7fca100118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=701d8a5f865dad3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:13.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.212+0000 7fca0e7fc640 1 --2- 172.21.15.22:0/4234260238 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fca040b3bd0 0x7fca040b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:13.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.212+0000 7fca1d127640 1 --2- 172.21.15.22:0/4234260238 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fca040b3bd0 0x7fca040b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:13.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.212+0000 7fca037fe640 1 -- 172.21.15.22:0/3830570921 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10004d20 con 0x56138499e880 2024-08-20T01:41:13.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.213+0000 7fca037fe640 1 -- 172.21.15.22:0/3830570921 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca10004050 con 0x56138499e880 2024-08-20T01:41:13.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.213+0000 7fca0e7fc640 1 -- 172.21.15.22:0/4234260238 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8298+0+0 (secure 0 0 0) 0x7fca080e3f00 con 0x7fca181084e0 2024-08-20T01:41:13.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.213+0000 7fca037fe640 1 -- 172.21.15.22:0/3830570921 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10005280 con 0x56138499e880 2024-08-20T01:41:13.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.213+0000 7fca21784740 1 -- 172.21.15.22:0/3830570921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499e880 msgr2=0x56138499ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:13.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.213+0000 7fca21784740 1 --2- 172.21.15.22:0/3830570921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499e880 0x56138499ec60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fca10009f30 tx=0x7fca100118d0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.213+0000 7fca1d127640 1 --2- 172.21.15.22:0/4234260238 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fca040b3bd0 0x7fca040b6090 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fca14005c00 tx=0x7fca14005b90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:13.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.213+0000 7fca21784740 1 -- 172.21.15.22:0/3830570921 shutdown_connections 2024-08-20T01:41:13.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.213+0000 7fca21784740 1 --2- 172.21.15.22:0/3830570921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613849ab130 0x5613849ad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.213+0000 7fca21784740 1 --2- 172.21.15.22:0/3830570921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499f1a0 0x5613849aabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.213+0000 7fca21784740 1 --2- 172.21.15.22:0/3830570921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499e880 0x56138499ec60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.213+0000 7fca21784740 1 -- 172.21.15.22:0/3830570921 >> 172.21.15.22:0/3830570921 conn(0x56138499c6b0 msgr2=0x56138499d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:13.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.214+0000 7fca21784740 1 -- 172.21.15.22:0/3830570921 shutdown_connections 2024-08-20T01:41:13.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.214+0000 7fca21784740 1 -- 172.21.15.22:0/3830570921 wait complete. 2024-08-20T01:41:13.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.214+0000 7fca21784740 1 -- start start 2024-08-20T01:41:13.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.214+0000 7fca21784740 1 Processor -- start 2024-08-20T01:41:13.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.214+0000 7fca21784740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56138499e880 0x5613849a80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:13.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.214+0000 7fca21784740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499f1a0 0x5613849a8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:13.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.214+0000 7fca21784740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613849ab130 0x5613849a8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:13.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.214+0000 7fca21784740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561384767700 con 0x5613849ab130 2024-08-20T01:41:13.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.214+0000 7fca21784740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56138488b810 con 0x56138499e880 2024-08-20T01:41:13.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.214+0000 7fca21784740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5613849adde0 con 0x56138499f1a0 2024-08-20T01:41:13.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.214+0000 7fca21784740 10 client.0 _ll_register_callbacks cb 0x5613848fe700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:13.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.215+0000 7fca1d127640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56138499e880 0x5613849a80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:13.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.215+0000 7fca1c926640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499f1a0 0x5613849a8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:13.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.215+0000 7fca1d928640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613849ab130 0x5613849a8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:13.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.215+0000 7fca1d127640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56138499e880 0x5613849a80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:39800/0 (socket says 172.21.15.22:39800) 2024-08-20T01:41:13.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.215+0000 7fca1d127640 1 -- 172.21.15.22:0/3476884139 learned_addr learned my addr 172.21.15.22:0/3476884139 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:13.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.215+0000 7fca1d928640 1 -- 172.21.15.22:0/3476884139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499f1a0 msgr2=0x5613849a8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:13.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.215+0000 7fca1d928640 1 --2- 172.21.15.22:0/3476884139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499f1a0 0x5613849a8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.215+0000 7fca1d928640 1 -- 172.21.15.22:0/3476884139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56138499e880 msgr2=0x5613849a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:13.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.215+0000 7fca1d928640 1 --2- 172.21.15.22:0/3476884139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56138499e880 0x5613849a80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.215+0000 7fca1d928640 1 -- 172.21.15.22:0/3476884139 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613849b71c0 con 0x5613849ab130 2024-08-20T01:41:13.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.215+0000 7fca1d127640 1 --2- 172.21.15.22:0/3476884139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56138499e880 0x5613849a80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:13.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.215+0000 7fca1c926640 1 --2- 172.21.15.22:0/3476884139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499f1a0 0x5613849a8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:13.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.215+0000 7fca1d928640 1 --2- 172.21.15.22:0/3476884139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613849ab130 0x5613849a8b70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fca10000f80 tx=0x7fca10004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575ed285c724ccf4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:13.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.215+0000 7fca00ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:13.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.215+0000 7fca00ff9640 1 -- 172.21.15.22:0/3476884139 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10004a40 con 0x5613849ab130 2024-08-20T01:41:13.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.215+0000 7fca00ff9640 1 -- 172.21.15.22:0/3476884139 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8298+0+0 (secure 0 0 0) 0x7fca10004be0 con 0x5613849ab130 2024-08-20T01:41:13.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.215+0000 7fca21784740 1 -- 172.21.15.22:0/3476884139 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5613848b4150 con 0x5613849ab130 2024-08-20T01:41:13.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.216+0000 7fca00ff9640 1 -- 172.21.15.22:0/3476884139 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fca10004e20 con 0x5613849ab130 2024-08-20T01:41:13.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.216+0000 7fca21784740 10 client.17163 fetch_fsmap learned FSMap version 32 2024-08-20T01:41:13.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.216+0000 7fca21784740 1 -- 172.21.15.22:0/3476884139 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5613849b9b70 con 0x5613849ab130 2024-08-20T01:41:13.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.216+0000 7fca00ff9640 1 -- 172.21.15.22:0/3476884139 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5613848b4150 con 0x5613849ab130 2024-08-20T01:41:13.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.216+0000 7fca00ff9640 1 -- 172.21.15.22:0/3476884139 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7fca10022480 con 0x5613849ab130 2024-08-20T01:41:13.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.216+0000 7fca21784740 10 client.17163 fetch_fsmap finished waiting for FSMap version 32 2024-08-20T01:41:13.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.216+0000 7fca21784740 10 client.17163 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:41:13.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.216+0000 7fca21784740 20 client.17163 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:13.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.216+0000 7fca21784740 1 --2- 172.21.15.22:0/3476884139 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5613849baf70 0x5613849bd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:13.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.216+0000 7fca21784740 4 client.17163 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:13.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.216+0000 7fca21784740 1 -- 172.21.15.22:0/3476884139 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561384917880 con 0x5613849baf70 2024-08-20T01:41:13.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.216+0000 7fca1d127640 1 --2- 172.21.15.22:0/3476884139 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5613849baf70 0x5613849bd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:13.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.217+0000 7fca1d127640 1 --2- 172.21.15.22:0/3476884139 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5613849baf70 0x5613849bd380 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=642dd3fce8bb2b7d server_cookie=a0dd223ba87309e5 in_seq=0 out_seq=0 2024-08-20T01:41:13.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.217+0000 7fca00ff9640 10 client.17163 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:41:13.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.218+0000 7fca00ff9640 1 -- 172.21.15.22:0/3476884139 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561384917880 con 0x5613849baf70 2024-08-20T01:41:13.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.218+0000 7fca00ff9640 10 client.17163 handle_command_reply: tid=0 2024-08-20T01:41:13.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.218+0000 7fca21784740 1 client.17163 shutdown 2024-08-20T01:41:13.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.218+0000 7fca21784740 1 -- 172.21.15.22:0/3476884139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613849ab130 msgr2=0x5613849a8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:13.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.218+0000 7fca21784740 1 --2- 172.21.15.22:0/3476884139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613849ab130 0x5613849a8b70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fca10000f80 tx=0x7fca10004300 comp rx=0 tx=0).stop 2024-08-20T01:41:13.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.218+0000 7fca21784740 1 -- 172.21.15.22:0/3476884139 shutdown_connections 2024-08-20T01:41:13.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.218+0000 7fca21784740 1 --2- 172.21.15.22:0/3476884139 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5613849baf70 0x5613849bd380 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.218+0000 7fca21784740 1 --2- 172.21.15.22:0/3476884139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613849ab130 0x5613849a8b70 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.218+0000 7fca21784740 1 --2- 172.21.15.22:0/3476884139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499f1a0 0x5613849a8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.218+0000 7fca21784740 1 --2- 172.21.15.22:0/3476884139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56138499e880 0x5613849a80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.218+0000 7fca21784740 1 -- 172.21.15.22:0/3476884139 >> 172.21.15.22:0/3476884139 conn(0x56138499c6b0 msgr2=0x5613849a2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.218+0000 7fca00ff9640 0 client.17163 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:41:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.219+0000 7fca21784740 1 -- 172.21.15.22:0/3476884139 shutdown_connections 2024-08-20T01:41:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.219+0000 7fca21784740 1 -- 172.21.15.22:0/3476884139 wait complete. 2024-08-20T01:41:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.219+0000 7fca21784740 20 client.17163 trim_cache size 0 max 16384 2024-08-20T01:41:13.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.232+0000 7fca21784740 1 Processor -- start 2024-08-20T01:41:13.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.232+0000 7fca21784740 1 -- start start 2024-08-20T01:41:13.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.232+0000 7fca21784740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499e880 0x5613849a7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:13.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.232+0000 7fca21784740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499f1a0 0x56138499dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:13.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.232+0000 7fca21784740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613849ab130 0x5613849a28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:13.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.232+0000 7fca21784740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fca181b0c30 con 0x56138499f1a0 2024-08-20T01:41:13.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.232+0000 7fca21784740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fca181ae440 con 0x5613849ab130 2024-08-20T01:41:13.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.232+0000 7fca21784740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fca181ac290 con 0x56138499e880 2024-08-20T01:41:13.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.232+0000 7fca1d127640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499e880 0x5613849a7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:13.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.232+0000 7fca1c926640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499f1a0 0x56138499dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:13.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.232+0000 7fca1d127640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499e880 0x5613849a7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:46676/0 (socket says 172.21.15.22:46676) 2024-08-20T01:41:13.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.232+0000 7fca1d127640 1 -- 172.21.15.22:0/3757700946 learned_addr learned my addr 172.21.15.22:0/3757700946 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:13.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.232+0000 7fca1d928640 1 --2- 172.21.15.22:0/3757700946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613849ab130 0x5613849a28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:13.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.233+0000 7fca1c926640 1 -- 172.21.15.22:0/3757700946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499e880 msgr2=0x5613849a7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:13.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.233+0000 7fca1c926640 1 --2- 172.21.15.22:0/3757700946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499e880 0x5613849a7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.233+0000 7fca1c926640 1 -- 172.21.15.22:0/3757700946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613849ab130 msgr2=0x5613849a28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:13.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.233+0000 7fca1c926640 1 --2- 172.21.15.22:0/3757700946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613849ab130 0x5613849a28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.233+0000 7fca1c926640 1 -- 172.21.15.22:0/3757700946 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138499d390 con 0x56138499f1a0 2024-08-20T01:41:13.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.233+0000 7fca1d928640 1 --2- 172.21.15.22:0/3757700946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613849ab130 0x5613849a28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:13.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.233+0000 7fca1c926640 1 --2- 172.21.15.22:0/3757700946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499f1a0 0x56138499dd70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fca080e1a10 tx=0x7fca0800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5d4754a2778ec8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:13.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.233+0000 7fca02ffd640 1 -- 172.21.15.22:0/3757700946 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca080aa920 con 0x56138499f1a0 2024-08-20T01:41:13.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.233+0000 7fca02ffd640 1 -- 172.21.15.22:0/3757700946 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca080ab510 con 0x56138499f1a0 2024-08-20T01:41:13.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.233+0000 7fca02ffd640 1 -- 172.21.15.22:0/3757700946 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08004000 con 0x56138499f1a0 2024-08-20T01:41:13.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.234+0000 7fca21784740 1 -- 172.21.15.22:0/3757700946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499f1a0 msgr2=0x56138499dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:13.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.234+0000 7fca21784740 1 --2- 172.21.15.22:0/3757700946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499f1a0 0x56138499dd70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fca080e1a10 tx=0x7fca0800ef90 comp rx=0 tx=0).stop 2024-08-20T01:41:13.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.234+0000 7fca21784740 1 -- 172.21.15.22:0/3757700946 shutdown_connections 2024-08-20T01:41:13.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.234+0000 7fca21784740 1 --2- 172.21.15.22:0/3757700946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613849ab130 0x5613849a28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.234+0000 7fca21784740 1 --2- 172.21.15.22:0/3757700946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499f1a0 0x56138499dd70 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.234+0000 7fca21784740 1 --2- 172.21.15.22:0/3757700946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499e880 0x5613849a7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.234+0000 7fca21784740 1 -- 172.21.15.22:0/3757700946 >> 172.21.15.22:0/3757700946 conn(0x56138499c6b0 msgr2=0x5613849a9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:13.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.234+0000 7fca21784740 1 -- 172.21.15.22:0/3757700946 shutdown_connections 2024-08-20T01:41:13.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.234+0000 7fca21784740 1 -- 172.21.15.22:0/3757700946 wait complete. 2024-08-20T01:41:13.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.234+0000 7fca21784740 1 -- start start 2024-08-20T01:41:13.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.234+0000 7fca21784740 1 Processor -- start 2024-08-20T01:41:13.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca21784740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499e880 0x5613849b3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:13.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca21784740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499f1a0 0x5613849b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:13.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca21784740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613849ab130 0x5613849ae030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:13.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca21784740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fca181ac900 con 0x56138499e880 2024-08-20T01:41:13.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca21784740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fca181add70 con 0x5613849ab130 2024-08-20T01:41:13.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca21784740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fca181acfd0 con 0x56138499f1a0 2024-08-20T01:41:13.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca21784740 10 client.0 _ll_register_callbacks cb 0x7fca100093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:13.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca1d127640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499e880 0x5613849b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:13.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca1d127640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499e880 0x5613849b3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45876/0 (socket says 172.21.15.22:45876) 2024-08-20T01:41:13.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca1d127640 1 -- 172.21.15.22:0/908843350 learned_addr learned my addr 172.21.15.22:0/908843350 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:13.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca1c926640 1 --2- 172.21.15.22:0/908843350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499f1a0 0x5613849b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:13.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca1d928640 1 --2- 172.21.15.22:0/908843350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613849ab130 0x5613849ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:13.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca1d127640 1 -- 172.21.15.22:0/908843350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499f1a0 msgr2=0x5613849b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:13.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca1d127640 1 --2- 172.21.15.22:0/908843350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499f1a0 0x5613849b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca1d127640 1 -- 172.21.15.22:0/908843350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613849ab130 msgr2=0x5613849ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:13.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca1d127640 1 --2- 172.21.15.22:0/908843350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613849ab130 0x5613849ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca1d127640 1 -- 172.21.15.22:0/908843350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613849ae570 con 0x56138499e880 2024-08-20T01:41:13.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca1d928640 1 --2- 172.21.15.22:0/908843350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613849ab130 0x5613849ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:13.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca1d127640 1 --2- 172.21.15.22:0/908843350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499e880 0x5613849b3080 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fca140057c0 tx=0x7fca14009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b046b27f21dc51c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:13.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca00ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:13.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.235+0000 7fca00ff9640 1 -- 172.21.15.22:0/908843350 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14035040 con 0x56138499e880 2024-08-20T01:41:13.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.236+0000 7fca00ff9640 1 -- 172.21.15.22:0/908843350 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8298+0+0 (secure 0 0 0) 0x7fca14004240 con 0x56138499e880 2024-08-20T01:41:13.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.236+0000 7fca21784740 1 -- 172.21.15.22:0/908843350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca080ab510 con 0x56138499e880 2024-08-20T01:41:13.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.236+0000 7fca00ff9640 1 -- 172.21.15.22:0/908843350 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fca14004440 con 0x56138499e880 2024-08-20T01:41:13.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.236+0000 7fca21784740 10 client.17169 fetch_fsmap learned FSMap version 32 2024-08-20T01:41:13.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.236+0000 7fca21784740 1 -- 172.21.15.22:0/908843350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561384a244b0 con 0x56138499e880 2024-08-20T01:41:13.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.236+0000 7fca00ff9640 1 -- 172.21.15.22:0/908843350 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca080ab510 con 0x56138499e880 2024-08-20T01:41:13.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.236+0000 7fca00ff9640 1 -- 172.21.15.22:0/908843350 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7fca140535a0 con 0x56138499e880 2024-08-20T01:41:13.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.236+0000 7fca21784740 10 client.17169 fetch_fsmap finished waiting for FSMap version 32 2024-08-20T01:41:13.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.236+0000 7fca21784740 10 client.17169 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:41:13.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.236+0000 7fca21784740 20 client.17169 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:13.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.236+0000 7fca21784740 1 --2- 172.21.15.22:0/908843350 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x561384a24c70 0x561384a27090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:13.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.236+0000 7fca21784740 4 client.17169 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:41:13.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.236+0000 7fca21784740 1 -- 172.21.15.22:0/908843350 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561384913320 con 0x561384a24c70 2024-08-20T01:41:13.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.236+0000 7fca1c926640 1 --2- 172.21.15.22:0/908843350 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x561384a24c70 0x561384a27090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:13.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.237+0000 7fca00ff9640 10 client.17169 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:41:13.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.237+0000 7fca1c926640 1 --2- 172.21.15.22:0/908843350 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x561384a24c70 0x561384a27090 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f7c66cfda9254bb7 server_cookie=85a23e33a6bcaa01 in_seq=0 out_seq=0 2024-08-20T01:41:13.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.237+0000 7fca00ff9640 1 -- 172.21.15.22:0/908843350 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561384913320 con 0x561384a24c70 2024-08-20T01:41:13.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.237+0000 7fca00ff9640 10 client.17169 handle_command_reply: tid=0 2024-08-20T01:41:13.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.237+0000 7fca21784740 1 client.17169 shutdown 2024-08-20T01:41:13.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.237+0000 7fca21784740 1 -- 172.21.15.22:0/908843350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499e880 msgr2=0x5613849b3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:13.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.237+0000 7fca21784740 1 --2- 172.21.15.22:0/908843350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499e880 0x5613849b3080 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fca140057c0 tx=0x7fca14009260 comp rx=0 tx=0).stop 2024-08-20T01:41:13.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.237+0000 7fca21784740 1 -- 172.21.15.22:0/908843350 shutdown_connections 2024-08-20T01:41:13.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.237+0000 7fca21784740 1 --2- 172.21.15.22:0/908843350 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x561384a24c70 0x561384a27090 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.237+0000 7fca21784740 1 --2- 172.21.15.22:0/908843350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5613849ab130 0x5613849ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.237+0000 7fca21784740 1 --2- 172.21.15.22:0/908843350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56138499f1a0 0x5613849b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.237+0000 7fca21784740 1 --2- 172.21.15.22:0/908843350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138499e880 0x5613849b3080 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.237+0000 7fca21784740 1 -- 172.21.15.22:0/908843350 >> 172.21.15.22:0/908843350 conn(0x56138499c6b0 msgr2=0x56138499af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:13.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.237+0000 7fca00ff9640 0 client.17169 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:41:13.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.237+0000 7fca21784740 1 -- 172.21.15.22:0/908843350 shutdown_connections 2024-08-20T01:41:13.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.237+0000 7fca21784740 1 -- 172.21.15.22:0/908843350 wait complete. 2024-08-20T01:41:13.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.238+0000 7fca21784740 20 client.17169 trim_cache size 0 max 16384 2024-08-20T01:41:13.245 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:41:13.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.238+0000 7fca1f38b640 1 -- 172.21.15.22:0/4234260238 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fca040b3bd0 msgr2=0x7fca040b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:13.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.238+0000 7fca1f38b640 1 --2- 172.21.15.22:0/4234260238 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fca040b3bd0 0x7fca040b6090 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fca14005c00 tx=0x7fca14005b90 comp rx=0 tx=0).stop 2024-08-20T01:41:13.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.238+0000 7fca1f38b640 1 -- 172.21.15.22:0/4234260238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca181084e0 msgr2=0x7fca18199550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:13.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.238+0000 7fca1f38b640 1 --2- 172.21.15.22:0/4234260238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca181084e0 0x7fca18199550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fca0800ea60 tx=0x7fca0800ef20 comp rx=0 tx=0).stop 2024-08-20T01:41:13.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.238+0000 7fca1f38b640 1 -- 172.21.15.22:0/4234260238 shutdown_connections 2024-08-20T01:41:13.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.238+0000 7fca1f38b640 1 --2- 172.21.15.22:0/4234260238 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fca040b3bd0 0x7fca040b6090 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.238+0000 7fca1f38b640 1 --2- 172.21.15.22:0/4234260238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca18108e60 0x7fca1819e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.238+0000 7fca1f38b640 1 --2- 172.21.15.22:0/4234260238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca181084e0 0x7fca18199550 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.238+0000 7fca1f38b640 1 --2- 172.21.15.22:0/4234260238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca18102ad0 0x7fca18199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:13.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.238+0000 7fca1f38b640 1 -- 172.21.15.22:0/4234260238 >> 172.21.15.22:0/4234260238 conn(0x7fca180fe540 msgr2=0x7fca18100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:13.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.238+0000 7fca1f38b640 1 -- 172.21.15.22:0/4234260238 shutdown_connections 2024-08-20T01:41:13.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:13.238+0000 7fca1f38b640 1 -- 172.21.15.22:0/4234260238 wait complete. 2024-08-20T01:41:13.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:12 smithi134 ceph-mon[22511]: pgmap v649: 97 pgs: 97 active+clean; 729 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 444 op/s 2024-08-20T01:41:13.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:12 smithi077 ceph-mon[22251]: pgmap v649: 97 pgs: 97 active+clean; 729 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 444 op/s 2024-08-20T01:41:13.917 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:41:14.180 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:14.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.692+0000 7f9fafdef640 1 -- 172.21.15.22:0/1340806835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa810cf60 msgr2=0x7f9fa810f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:14.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.692+0000 7f9fafdef640 1 --2- 172.21.15.22:0/1340806835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa810cf60 0x7f9fa810f350 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009ca0 tx=0x7f9fa002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.693+0000 7f9fafdef640 1 -- 172.21.15.22:0/1340806835 shutdown_connections 2024-08-20T01:41:14.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.693+0000 7f9fafdef640 1 --2- 172.21.15.22:0/1340806835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa810cf60 0x7f9fa810f350 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.693+0000 7f9fafdef640 1 --2- 172.21.15.22:0/1340806835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fa810a630 0x7f9fa810ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.693+0000 7f9fafdef640 1 --2- 172.21.15.22:0/1340806835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa8101520 0x7f9fa8101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.693+0000 7f9fafdef640 1 -- 172.21.15.22:0/1340806835 >> 172.21.15.22:0/1340806835 conn(0x7f9fa8076c80 msgr2=0x7f9fa8077090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:14.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.693+0000 7f9fafdef640 1 -- 172.21.15.22:0/1340806835 shutdown_connections 2024-08-20T01:41:14.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.693+0000 7f9fafdef640 1 -- 172.21.15.22:0/1340806835 wait complete. 2024-08-20T01:41:14.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.693+0000 7f9fafdef640 1 Processor -- start 2024-08-20T01:41:14.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.693+0000 7f9fafdef640 1 -- start start 2024-08-20T01:41:14.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.693+0000 7f9fafdef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fa8101520 0x7f9fa8198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:14.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.693+0000 7f9fafdef640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa810a630 0x7f9fa8199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:14.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.693+0000 7f9fafdef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa810cf60 0x7f9fa819e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:14.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.693+0000 7f9fafdef640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa8112aa0 con 0x7f9fa810a630 2024-08-20T01:41:14.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.693+0000 7f9fafdef640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa8112920 con 0x7f9fa8101520 2024-08-20T01:41:14.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.693+0000 7f9fafdef640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa8112c20 con 0x7f9fa810cf60 2024-08-20T01:41:14.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.694+0000 7f9fad38a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa810a630 0x7f9fa8199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:14.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.694+0000 7f9fad38a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa810a630 0x7f9fa8199490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45908/0 (socket says 172.21.15.22:45908) 2024-08-20T01:41:14.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.694+0000 7f9fad38a640 1 -- 172.21.15.22:0/59798459 learned_addr learned my addr 172.21.15.22:0/59798459 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:14.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.694+0000 7f9fae38c640 1 --2- 172.21.15.22:0/59798459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa810cf60 0x7f9fa819e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:14.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.694+0000 7f9fadb8b640 1 --2- 172.21.15.22:0/59798459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fa8101520 0x7f9fa8198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:14.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.694+0000 7f9fad38a640 1 -- 172.21.15.22:0/59798459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa810cf60 msgr2=0x7f9fa819e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:14.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.694+0000 7f9fad38a640 1 --2- 172.21.15.22:0/59798459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa810cf60 0x7f9fa819e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.694+0000 7f9fad38a640 1 -- 172.21.15.22:0/59798459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fa8101520 msgr2=0x7f9fa8198f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:14.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.694+0000 7f9fad38a640 1 --2- 172.21.15.22:0/59798459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fa8101520 0x7f9fa8198f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.694+0000 7f9fad38a640 1 -- 172.21.15.22:0/59798459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa819f000 con 0x7f9fa810a630 2024-08-20T01:41:14.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.694+0000 7f9fae38c640 1 --2- 172.21.15.22:0/59798459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa810cf60 0x7f9fa819e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:14.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.694+0000 7f9fad38a640 1 --2- 172.21.15.22:0/59798459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa810a630 0x7f9fa8199490 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800e9f0 tx=0x7f9f9800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:14.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.694+0000 7f9f9effd640 1 -- 172.21.15.22:0/59798459 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9800cd80 con 0x7f9fa810a630 2024-08-20T01:41:14.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.694+0000 7f9fafdef640 1 -- 172.21.15.22:0/59798459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa819f2f0 con 0x7f9fa810a630 2024-08-20T01:41:14.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.694+0000 7f9f9effd640 1 -- 172.21.15.22:0/59798459 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f980108e0 con 0x7f9fa810a630 2024-08-20T01:41:14.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.694+0000 7f9f9effd640 1 -- 172.21.15.22:0/59798459 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98018980 con 0x7f9fa810a630 2024-08-20T01:41:14.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.694+0000 7f9fafdef640 1 -- 172.21.15.22:0/59798459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa81a5b80 con 0x7f9fa810a630 2024-08-20T01:41:14.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.697+0000 7f9fb21e8740 1 Processor -- start 2024-08-20T01:41:14.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.697+0000 7f9fb21e8740 1 -- start start 2024-08-20T01:41:14.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.697+0000 7f9f9effd640 1 -- 172.21.15.22:0/59798459 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9f98010430 con 0x7f9fa810a630 2024-08-20T01:41:14.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.697+0000 7f9fb21e8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a7880 0x5589ba0a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:14.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.697+0000 7f9fb21e8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0a81a0 0x5589ba0b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:14.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.697+0000 7f9fb21e8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0b4130 0x5589ba0b6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:14.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.697+0000 7f9fb21e8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5589ba01e930 con 0x5589ba0a7880 2024-08-20T01:41:14.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.697+0000 7f9fb21e8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5589ba00de30 con 0x5589ba0a81a0 2024-08-20T01:41:14.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.697+0000 7f9fb21e8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5589ba011e70 con 0x5589ba0b4130 2024-08-20T01:41:14.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.697+0000 7f9fae38c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a7880 0x5589ba0a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:14.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.697+0000 7f9fae38c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a7880 0x5589ba0a7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45918/0 (socket says 172.21.15.22:45918) 2024-08-20T01:41:14.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.697+0000 7f9fae38c640 1 -- 172.21.15.22:0/481523906 learned_addr learned my addr 172.21.15.22:0/481523906 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:14.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.697+0000 7f9fad38a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0b4130 0x5589ba0b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:14.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.697+0000 7f9fadb8b640 1 --2- 172.21.15.22:0/481523906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0a81a0 0x5589ba0b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:14.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.698+0000 7f9fae38c640 1 -- 172.21.15.22:0/481523906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0b4130 msgr2=0x5589ba0b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:14.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.698+0000 7f9fae38c640 1 --2- 172.21.15.22:0/481523906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0b4130 0x5589ba0b6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.698+0000 7f9fae38c640 1 -- 172.21.15.22:0/481523906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0a81a0 msgr2=0x5589ba0b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:14.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.698+0000 7f9fae38c640 1 --2- 172.21.15.22:0/481523906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0a81a0 0x5589ba0b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.698+0000 7f9fae38c640 1 -- 172.21.15.22:0/481523906 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589b9d6d650 con 0x5589ba0a7880 2024-08-20T01:41:14.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.698+0000 7f9fadb8b640 1 --2- 172.21.15.22:0/481523906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0a81a0 0x5589ba0b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:14.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.698+0000 7f9fae38c640 1 --2- 172.21.15.22:0/481523906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a7880 0x5589ba0a7c60 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00093c0 tx=0x7f9fa00093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad96d54bdcc24b38 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:14.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.698+0000 7f9f9effd640 1 --2- 172.21.15.22:0/59798459 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9f940b3bd0 0x7f9f940b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:14.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.698+0000 7f9f93fff640 1 -- 172.21.15.22:0/481523906 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0031cf0 con 0x5589ba0a7880 2024-08-20T01:41:14.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.698+0000 7f9fadb8b640 1 --2- 172.21.15.22:0/59798459 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9f940b3bd0 0x7f9f940b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:14.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.698+0000 7f9f9effd640 1 -- 172.21.15.22:0/59798459 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8298+0+0 (secure 0 0 0) 0x7f9f980e3ff0 con 0x7f9fa810a630 2024-08-20T01:41:14.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.698+0000 7f9f93fff640 1 -- 172.21.15.22:0/481523906 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fa0040070 con 0x5589ba0a7880 2024-08-20T01:41:14.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.698+0000 7f9f93fff640 1 -- 172.21.15.22:0/481523906 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa00042a0 con 0x5589ba0a7880 2024-08-20T01:41:14.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.699+0000 7f9fb21e8740 1 -- 172.21.15.22:0/481523906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a7880 msgr2=0x5589ba0a7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:14.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.699+0000 7f9fadb8b640 1 --2- 172.21.15.22:0/59798459 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9f940b3bd0 0x7f9f940b6090 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x5589ba0aaa00 tx=0x7f9fa4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:14.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.699+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/481523906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a7880 0x5589ba0a7c60 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00093c0 tx=0x7f9fa00093f0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.699+0000 7f9fb21e8740 1 -- 172.21.15.22:0/481523906 shutdown_connections 2024-08-20T01:41:14.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.699+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/481523906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0b4130 0x5589ba0b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.699+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/481523906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0a81a0 0x5589ba0b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.699+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/481523906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a7880 0x5589ba0a7c60 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.699+0000 7f9fb21e8740 1 -- 172.21.15.22:0/481523906 >> 172.21.15.22:0/481523906 conn(0x5589ba0a56b0 msgr2=0x5589ba0a6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:14.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.699+0000 7f9fb21e8740 1 -- 172.21.15.22:0/481523906 shutdown_connections 2024-08-20T01:41:14.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.699+0000 7f9fb21e8740 1 -- 172.21.15.22:0/481523906 wait complete. 2024-08-20T01:41:14.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.700+0000 7f9fb21e8740 1 -- start start 2024-08-20T01:41:14.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.700+0000 7f9fb21e8740 1 Processor -- start 2024-08-20T01:41:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.700+0000 7f9fb21e8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0a7880 0x5589ba0b1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.700+0000 7f9fb21e8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a81a0 0x5589ba0b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.700+0000 7f9fb21e8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0b4130 0x5589ba0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.700+0000 7f9fb21e8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5589b9e70700 con 0x5589ba0a81a0 2024-08-20T01:41:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.700+0000 7f9fb21e8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5589b9f94810 con 0x5589ba0b4130 2024-08-20T01:41:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.700+0000 7f9fb21e8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5589ba0b6d80 con 0x5589ba0a7880 2024-08-20T01:41:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.700+0000 7f9fb21e8740 10 client.0 _ll_register_callbacks cb 0x5589ba007700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:14.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.700+0000 7f9fadb8b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0a7880 0x5589ba0b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:14.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.700+0000 7f9fad38a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a81a0 0x5589ba0b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:14.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.700+0000 7f9fad38a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a81a0 0x5589ba0b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45932/0 (socket says 172.21.15.22:45932) 2024-08-20T01:41:14.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.700+0000 7f9fad38a640 1 -- 172.21.15.22:0/3969631350 learned_addr learned my addr 172.21.15.22:0/3969631350 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:14.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.700+0000 7f9fadb8b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0a7880 0x5589ba0b1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:46702/0 (socket says 172.21.15.22:46702) 2024-08-20T01:41:14.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.701+0000 7f9fae38c640 1 --2- 172.21.15.22:0/3969631350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0b4130 0x5589ba0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:14.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.701+0000 7f9fad38a640 1 -- 172.21.15.22:0/3969631350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0a7880 msgr2=0x5589ba0b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:14.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.701+0000 7f9fad38a640 1 --2- 172.21.15.22:0/3969631350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0a7880 0x5589ba0b1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.701+0000 7f9fad38a640 1 -- 172.21.15.22:0/3969631350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0b4130 msgr2=0x5589ba0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:14.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.701+0000 7f9fad38a640 1 --2- 172.21.15.22:0/3969631350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0b4130 0x5589ba0b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.701+0000 7f9fad38a640 1 -- 172.21.15.22:0/3969631350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589ba0c01e0 con 0x5589ba0a81a0 2024-08-20T01:41:14.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.701+0000 7f9fadb8b640 1 --2- 172.21.15.22:0/3969631350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0a7880 0x5589ba0b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:14.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.701+0000 7f9fad38a640 1 --2- 172.21.15.22:0/3969631350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a81a0 0x5589ba0b1680 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800c6a0 tx=0x7f9f980e76c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55db181c6eacec67 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:14.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.701+0000 7f9f917fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:14.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.701+0000 7f9f917fa640 1 -- 172.21.15.22:0/3969631350 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98010720 con 0x5589ba0a81a0 2024-08-20T01:41:14.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.701+0000 7f9f917fa640 1 -- 172.21.15.22:0/3969631350 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8298+0+0 (secure 0 0 0) 0x7f9f980e7c80 con 0x5589ba0a81a0 2024-08-20T01:41:14.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.701+0000 7f9fb21e8740 1 -- 172.21.15.22:0/3969631350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5589b9fbd150 con 0x5589ba0a81a0 2024-08-20T01:41:14.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.701+0000 7f9f917fa640 1 -- 172.21.15.22:0/3969631350 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9f980aaa10 con 0x5589ba0a81a0 2024-08-20T01:41:14.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.701+0000 7f9fb21e8740 10 client.17181 fetch_fsmap learned FSMap version 32 2024-08-20T01:41:14.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.701+0000 7f9fb21e8740 1 -- 172.21.15.22:0/3969631350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5589ba0c2bf0 con 0x5589ba0a81a0 2024-08-20T01:41:14.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.701+0000 7f9f917fa640 1 -- 172.21.15.22:0/3969631350 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5589b9fbd150 con 0x5589ba0a81a0 2024-08-20T01:41:14.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.702+0000 7f9f917fa640 1 -- 172.21.15.22:0/3969631350 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f9f980e6110 con 0x5589ba0a81a0 2024-08-20T01:41:14.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.702+0000 7f9fb21e8740 10 client.17181 fetch_fsmap finished waiting for FSMap version 32 2024-08-20T01:41:14.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.702+0000 7f9fb21e8740 10 client.17181 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:14.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.702+0000 7f9fb21e8740 20 client.17181 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:14.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.702+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/3969631350 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5589ba0c40b0 0x5589ba0c6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:14.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.702+0000 7f9fb21e8740 4 client.17181 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:14.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.702+0000 7f9fb21e8740 1 -- 172.21.15.22:0/3969631350 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589ba020880 con 0x5589ba0c40b0 2024-08-20T01:41:14.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.702+0000 7f9fadb8b640 1 --2- 172.21.15.22:0/3969631350 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5589ba0c40b0 0x5589ba0c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:14.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.702+0000 7f9f917fa640 10 client.17181 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:14.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.702+0000 7f9fadb8b640 1 --2- 172.21.15.22:0/3969631350 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5589ba0c40b0 0x5589ba0c6500 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c41be48cf6079168 server_cookie=9a3fe92ccacdd7c6 in_seq=0 out_seq=0 2024-08-20T01:41:14.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.705+0000 7f9f917fa640 1 -- 172.21.15.22:0/3969631350 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5589ba020880 con 0x5589ba0c40b0 2024-08-20T01:41:14.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.705+0000 7f9f917fa640 10 client.17181 handle_command_reply: tid=0 2024-08-20T01:41:14.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.705+0000 7f9fb21e8740 1 client.17181 shutdown 2024-08-20T01:41:14.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.705+0000 7f9fb21e8740 1 -- 172.21.15.22:0/3969631350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a81a0 msgr2=0x5589ba0b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:14.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.705+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/3969631350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a81a0 0x5589ba0b1680 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800c6a0 tx=0x7f9f980e76c0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.705+0000 7f9fb21e8740 1 -- 172.21.15.22:0/3969631350 shutdown_connections 2024-08-20T01:41:14.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.705+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/3969631350 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5589ba0c40b0 0x5589ba0c6500 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.705+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/3969631350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0b4130 0x5589ba0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.705+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/3969631350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a81a0 0x5589ba0b1680 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.705+0000 7f9f917fa640 0 client.17181 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:14.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.705+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/3969631350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0a7880 0x5589ba0b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.705+0000 7f9fb21e8740 1 -- 172.21.15.22:0/3969631350 >> 172.21.15.22:0/3969631350 conn(0x5589ba0a56b0 msgr2=0x5589ba0ab250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:14.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.705+0000 7f9fb21e8740 1 -- 172.21.15.22:0/3969631350 shutdown_connections 2024-08-20T01:41:14.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.705+0000 7f9fb21e8740 1 -- 172.21.15.22:0/3969631350 wait complete. 2024-08-20T01:41:14.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.705+0000 7f9fb21e8740 20 client.17181 trim_cache size 0 max 16384 2024-08-20T01:41:14.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.718+0000 7f9fb21e8740 1 Processor -- start 2024-08-20T01:41:14.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.718+0000 7f9fb21e8740 1 -- start start 2024-08-20T01:41:14.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9fb21e8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a7880 0x5589ba0aba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:14.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9fb21e8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0a81a0 0x5589ba0b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:14.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9fb21e8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0b4130 0x5589ba0cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:14.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9fb21e8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81b0ba0 con 0x5589ba0a7880 2024-08-20T01:41:14.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9fb21e8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81ae3b0 con 0x5589ba0b4130 2024-08-20T01:41:14.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9fb21e8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81ac200 con 0x5589ba0a81a0 2024-08-20T01:41:14.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9fadb8b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a7880 0x5589ba0aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:14.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9fadb8b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a7880 0x5589ba0aba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45942/0 (socket says 172.21.15.22:45942) 2024-08-20T01:41:14.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9fadb8b640 1 -- 172.21.15.22:0/2410699771 learned_addr learned my addr 172.21.15.22:0/2410699771 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:14.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9fad38a640 1 --2- 172.21.15.22:0/2410699771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0a81a0 0x5589ba0b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:14.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9fae38c640 1 --2- 172.21.15.22:0/2410699771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0b4130 0x5589ba0cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:14.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9fadb8b640 1 -- 172.21.15.22:0/2410699771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0a81a0 msgr2=0x5589ba0b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:14.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9fadb8b640 1 --2- 172.21.15.22:0/2410699771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0a81a0 0x5589ba0b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9fadb8b640 1 -- 172.21.15.22:0/2410699771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0b4130 msgr2=0x5589ba0cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:14.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9fadb8b640 1 --2- 172.21.15.22:0/2410699771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0b4130 0x5589ba0cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9fadb8b640 1 -- 172.21.15.22:0/2410699771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589ba0a54e0 con 0x5589ba0a7880 2024-08-20T01:41:14.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9fad38a640 1 --2- 172.21.15.22:0/2410699771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0a81a0 0x5589ba0b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:14.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9fae38c640 1 --2- 172.21.15.22:0/2410699771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0b4130 0x5589ba0cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:14.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9fadb8b640 1 --2- 172.21.15.22:0/2410699771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a7880 0x5589ba0aba40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009fd0 tx=0x7f9fa401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967191a09a5b9fc1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:14.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9f937fe640 1 -- 172.21.15.22:0/2410699771 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa40041d0 con 0x5589ba0a7880 2024-08-20T01:41:14.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9f937fe640 1 -- 172.21.15.22:0/2410699771 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fa4004370 con 0x5589ba0a7880 2024-08-20T01:41:14.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.719+0000 7f9f937fe640 1 -- 172.21.15.22:0/2410699771 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4004e40 con 0x5589ba0a7880 2024-08-20T01:41:14.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.720+0000 7f9fb21e8740 1 -- 172.21.15.22:0/2410699771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a7880 msgr2=0x5589ba0aba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:14.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.720+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/2410699771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a7880 0x5589ba0aba40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009fd0 tx=0x7f9fa401b000 comp rx=0 tx=0).stop 2024-08-20T01:41:14.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.720+0000 7f9fb21e8740 1 -- 172.21.15.22:0/2410699771 shutdown_connections 2024-08-20T01:41:14.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.720+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/2410699771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0b4130 0x5589ba0cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.720+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/2410699771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0a81a0 0x5589ba0b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.720+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/2410699771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a7880 0x5589ba0aba40 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.720+0000 7f9fb21e8740 1 -- 172.21.15.22:0/2410699771 >> 172.21.15.22:0/2410699771 conn(0x5589ba0a56b0 msgr2=0x5589ba0b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:14.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.720+0000 7f9fb21e8740 1 -- 172.21.15.22:0/2410699771 shutdown_connections 2024-08-20T01:41:14.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.720+0000 7f9fb21e8740 1 -- 172.21.15.22:0/2410699771 wait complete. 2024-08-20T01:41:14.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.720+0000 7f9fb21e8740 1 -- start start 2024-08-20T01:41:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.720+0000 7f9fb21e8740 1 Processor -- start 2024-08-20T01:41:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.721+0000 7f9fb21e8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0a7880 0x5589ba0bc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.721+0000 7f9fb21e8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a81a0 0x5589ba0b7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.721+0000 7f9fb21e8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0b4130 0x5589ba0b7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.721+0000 7f9fb21e8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81ac870 con 0x5589ba0a81a0 2024-08-20T01:41:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.721+0000 7f9fb21e8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81adce0 con 0x5589ba0a7880 2024-08-20T01:41:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.721+0000 7f9fb21e8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81acf40 con 0x5589ba0b4130 2024-08-20T01:41:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.721+0000 7f9fb21e8740 10 client.0 _ll_register_callbacks cb 0x7f9f980e77c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.721+0000 7f9fadb8b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0a7880 0x5589ba0bc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.721+0000 7f9fae38c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0b4130 0x5589ba0b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.721+0000 7f9fad38a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a81a0 0x5589ba0b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.721+0000 7f9fadb8b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0a7880 0x5589ba0bc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:39864/0 (socket says 172.21.15.22:39864) 2024-08-20T01:41:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.721+0000 7f9fadb8b640 1 -- 172.21.15.22:0/1965230696 learned_addr learned my addr 172.21.15.22:0/1965230696 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.721+0000 7f9fad38a640 1 -- 172.21.15.22:0/1965230696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0b4130 msgr2=0x5589ba0b7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.721+0000 7f9fad38a640 1 --2- 172.21.15.22:0/1965230696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0b4130 0x5589ba0b7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.721+0000 7f9fad38a640 1 -- 172.21.15.22:0/1965230696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0a7880 msgr2=0x5589ba0bc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:14.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.721+0000 7f9fad38a640 1 --2- 172.21.15.22:0/1965230696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0a7880 0x5589ba0bc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.721+0000 7f9fad38a640 1 -- 172.21.15.22:0/1965230696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589ba0a6130 con 0x5589ba0a81a0 2024-08-20T01:41:14.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.721+0000 7f9fadb8b640 1 --2- 172.21.15.22:0/1965230696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0a7880 0x5589ba0bc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:14.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.722+0000 7f9fad38a640 1 --2- 172.21.15.22:0/1965230696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a81a0 0x5589ba0b7000 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f9f980aabb0 tx=0x7f9f98005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f38571a5ade2c06 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:14.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.722+0000 7f9f917fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:14.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.722+0000 7f9f917fa640 1 -- 172.21.15.22:0/1965230696 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f980a6dc0 con 0x5589ba0a81a0 2024-08-20T01:41:14.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.722+0000 7f9f917fa640 1 -- 172.21.15.22:0/1965230696 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8298+0+0 (secure 0 0 0) 0x7f9f980aa370 con 0x5589ba0a81a0 2024-08-20T01:41:14.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.722+0000 7f9fb21e8740 1 -- 172.21.15.22:0/1965230696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fa4004370 con 0x5589ba0a81a0 2024-08-20T01:41:14.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.722+0000 7f9f917fa640 1 -- 172.21.15.22:0/1965230696 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9f980aa850 con 0x5589ba0a81a0 2024-08-20T01:41:14.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.722+0000 7f9fb21e8740 10 client.17187 fetch_fsmap learned FSMap version 32 2024-08-20T01:41:14.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.722+0000 7f9fb21e8740 1 -- 172.21.15.22:0/1965230696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5589ba12dd90 con 0x5589ba0a81a0 2024-08-20T01:41:14.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.722+0000 7f9f917fa640 1 -- 172.21.15.22:0/1965230696 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fa4004370 con 0x5589ba0a81a0 2024-08-20T01:41:14.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.722+0000 7f9f917fa640 1 -- 172.21.15.22:0/1965230696 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f9f980c7b10 con 0x5589ba0a81a0 2024-08-20T01:41:14.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.722+0000 7f9fb21e8740 10 client.17187 fetch_fsmap finished waiting for FSMap version 32 2024-08-20T01:41:14.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.722+0000 7f9fb21e8740 10 client.17187 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:14.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.722+0000 7f9fb21e8740 20 client.17187 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:14.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.722+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/1965230696 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5589ba12e450 0x5589ba130870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:14.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.722+0000 7f9fb21e8740 4 client.17187 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:41:14.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.722+0000 7f9fb21e8740 1 -- 172.21.15.22:0/1965230696 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5589ba01c320 con 0x5589ba12e450 2024-08-20T01:41:14.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.723+0000 7f9fadb8b640 1 --2- 172.21.15.22:0/1965230696 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5589ba12e450 0x5589ba130870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:14.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.723+0000 7f9fadb8b640 1 --2- 172.21.15.22:0/1965230696 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5589ba12e450 0x5589ba130870 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7988566fe5a61148 server_cookie=da9c7397c063a2ab in_seq=0 out_seq=0 2024-08-20T01:41:14.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.723+0000 7f9f917fa640 10 client.17187 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:14.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.725+0000 7f9f917fa640 1 -- 172.21.15.22:0/1965230696 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5589ba01c320 con 0x5589ba12e450 2024-08-20T01:41:14.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.725+0000 7f9f917fa640 10 client.17187 handle_command_reply: tid=0 2024-08-20T01:41:14.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.725+0000 7f9fb21e8740 1 client.17187 shutdown 2024-08-20T01:41:14.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fb21e8740 1 -- 172.21.15.22:0/1965230696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a81a0 msgr2=0x5589ba0b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:14.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/1965230696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a81a0 0x5589ba0b7000 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f9f980aabb0 tx=0x7f9f98005ab0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fb21e8740 1 -- 172.21.15.22:0/1965230696 shutdown_connections 2024-08-20T01:41:14.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/1965230696 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5589ba12e450 0x5589ba130870 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/1965230696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589ba0b4130 0x5589ba0b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/1965230696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589ba0a81a0 0x5589ba0b7000 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fb21e8740 1 --2- 172.21.15.22:0/1965230696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5589ba0a7880 0x5589ba0bc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9f917fa640 0 client.17187 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:14.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fb21e8740 1 -- 172.21.15.22:0/1965230696 >> 172.21.15.22:0/1965230696 conn(0x5589ba0a56b0 msgr2=0x5589ba0b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:14.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fb21e8740 1 -- 172.21.15.22:0/1965230696 shutdown_connections 2024-08-20T01:41:14.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fb21e8740 1 -- 172.21.15.22:0/1965230696 wait complete. 2024-08-20T01:41:14.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fb21e8740 20 client.17187 trim_cache size 0 max 16384 2024-08-20T01:41:14.731 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:41:14.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fafdef640 1 -- 172.21.15.22:0/59798459 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9f940b3bd0 msgr2=0x7f9f940b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:14.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fafdef640 1 --2- 172.21.15.22:0/59798459 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9f940b3bd0 0x7f9f940b6090 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x5589ba0aaa00 tx=0x7f9fa4005f90 comp rx=0 tx=0).stop 2024-08-20T01:41:14.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fafdef640 1 -- 172.21.15.22:0/59798459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa810a630 msgr2=0x7f9fa8199490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:14.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fafdef640 1 --2- 172.21.15.22:0/59798459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa810a630 0x7f9fa8199490 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800e9f0 tx=0x7f9f9800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fafdef640 1 -- 172.21.15.22:0/59798459 shutdown_connections 2024-08-20T01:41:14.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fafdef640 1 --2- 172.21.15.22:0/59798459 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f9f940b3bd0 0x7f9f940b6090 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fafdef640 1 --2- 172.21.15.22:0/59798459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa810cf60 0x7f9fa819e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fafdef640 1 --2- 172.21.15.22:0/59798459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa810a630 0x7f9fa8199490 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fafdef640 1 --2- 172.21.15.22:0/59798459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fa8101520 0x7f9fa8198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:14.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.726+0000 7f9fafdef640 1 -- 172.21.15.22:0/59798459 >> 172.21.15.22:0/59798459 conn(0x7f9fa8076c80 msgr2=0x7f9fa81002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:14.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.727+0000 7f9fafdef640 1 -- 172.21.15.22:0/59798459 shutdown_connections 2024-08-20T01:41:14.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:14.727+0000 7f9fafdef640 1 -- 172.21.15.22:0/59798459 wait complete. 2024-08-20T01:41:15.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:14 smithi134 ceph-mon[22511]: pgmap v650: 97 pgs: 97 active+clean; 711 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 430 op/s 2024-08-20T01:41:15.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:14 smithi077 ceph-mon[22251]: pgmap v650: 97 pgs: 97 active+clean; 711 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 430 op/s 2024-08-20T01:41:15.355 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:14 smithi022 ceph-mon[18709]: pgmap v650: 97 pgs: 97 active+clean; 711 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 430 op/s 2024-08-20T01:41:16.586 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:41:16.586 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:41:16.848 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:17.246 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:16 smithi022 ceph-mon[18709]: pgmap v651: 97 pgs: 97 active+clean; 707 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 434 op/s 2024-08-20T01:41:17.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:16 smithi134 ceph-mon[22511]: pgmap v651: 97 pgs: 97 active+clean; 707 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 434 op/s 2024-08-20T01:41:17.316 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:16 smithi077 ceph-mon[22251]: pgmap v651: 97 pgs: 97 active+clean; 707 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 434 op/s 2024-08-20T01:41:17.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.316+0000 7f928da77640 1 -- 172.21.15.22:0/2881649285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9288074b00 msgr2=0x7f9288109f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:17.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.316+0000 7f928da77640 1 --2- 172.21.15.22:0/2881649285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9288074b00 0x7f9288109f00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f927c009900 tx=0x7f927c02a3f0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.316+0000 7f928da77640 1 -- 172.21.15.22:0/2881649285 shutdown_connections 2024-08-20T01:41:17.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.316+0000 7f928da77640 1 --2- 172.21.15.22:0/2881649285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f928810a640 0x7f92881133e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.316+0000 7f928da77640 1 --2- 172.21.15.22:0/2881649285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9288074b00 0x7f9288109f00 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.316+0000 7f928da77640 1 --2- 172.21.15.22:0/2881649285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9288074170 0x7f9288074570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.316+0000 7f928da77640 1 -- 172.21.15.22:0/2881649285 >> 172.21.15.22:0/2881649285 conn(0x7f928806f740 msgr2=0x7f9288071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:17.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.316+0000 7f928da77640 1 -- 172.21.15.22:0/2881649285 shutdown_connections 2024-08-20T01:41:17.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.316+0000 7f928da77640 1 -- 172.21.15.22:0/2881649285 wait complete. 2024-08-20T01:41:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.316+0000 7f928da77640 1 Processor -- start 2024-08-20T01:41:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.317+0000 7f928da77640 1 -- start start 2024-08-20T01:41:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.317+0000 7f928da77640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9288074170 0x7f92881a3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.317+0000 7f928da77640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9288074b00 0x7f92881a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.317+0000 7f928da77640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f928810a640 0x7f92881a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.317+0000 7f928da77640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f928810b560 con 0x7f928810a640 2024-08-20T01:41:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.317+0000 7f928da77640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f928810b3e0 con 0x7f9288074170 2024-08-20T01:41:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.317+0000 7f928da77640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f928810b6e0 con 0x7f9288074b00 2024-08-20T01:41:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.317+0000 7f9287fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f928810a640 0x7f92881a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.317+0000 7f9287fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f928810a640 0x7f92881a47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45972/0 (socket says 172.21.15.22:45972) 2024-08-20T01:41:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.317+0000 7f9287fff640 1 -- 172.21.15.22:0/4009432766 learned_addr learned my addr 172.21.15.22:0/4009432766 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.317+0000 7f92877fe640 1 --2- 172.21.15.22:0/4009432766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9288074170 0x7f92881a3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.317+0000 7f9286ffd640 1 --2- 172.21.15.22:0/4009432766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9288074b00 0x7f92881a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.318+0000 7f9287fff640 1 -- 172.21.15.22:0/4009432766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9288074b00 msgr2=0x7f92881a3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.318+0000 7f9287fff640 1 --2- 172.21.15.22:0/4009432766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9288074b00 0x7f92881a3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.318+0000 7f9287fff640 1 -- 172.21.15.22:0/4009432766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9288074170 msgr2=0x7f92881a3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.318+0000 7f9287fff640 1 --2- 172.21.15.22:0/4009432766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9288074170 0x7f92881a3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.318+0000 7f9287fff640 1 -- 172.21.15.22:0/4009432766 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92881a5060 con 0x7f928810a640 2024-08-20T01:41:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.318+0000 7f9287fff640 1 --2- 172.21.15.22:0/4009432766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f928810a640 0x7f92881a47a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f928000eb10 tx=0x7f928000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.318+0000 7f9284ff9640 1 -- 172.21.15.22:0/4009432766 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280004b20 con 0x7f928810a640 2024-08-20T01:41:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.318+0000 7f9284ff9640 1 -- 172.21.15.22:0/4009432766 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9280004cc0 con 0x7f928810a640 2024-08-20T01:41:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.318+0000 7f928da77640 1 -- 172.21.15.22:0/4009432766 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92881a5350 con 0x7f928810a640 2024-08-20T01:41:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.318+0000 7f9284ff9640 1 -- 172.21.15.22:0/4009432766 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280010670 con 0x7f928810a640 2024-08-20T01:41:17.323 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.318+0000 7f928da77640 1 -- 172.21.15.22:0/4009432766 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92881aba20 con 0x7f928810a640 2024-08-20T01:41:17.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.322+0000 7f9284ff9640 1 -- 172.21.15.22:0/4009432766 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9280005020 con 0x7f928810a640 2024-08-20T01:41:17.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.322+0000 7f929086c740 1 Processor -- start 2024-08-20T01:41:17.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.322+0000 7f929086c740 1 -- start start 2024-08-20T01:41:17.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.322+0000 7f929086c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594391898d0 0x55943918bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.322+0000 7f929086c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918c200 0x55943918e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.322+0000 7f929086c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55943918ec40 0x559439191100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.322+0000 7f929086c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5594390fc360 con 0x55943918ec40 2024-08-20T01:41:17.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.322+0000 7f929086c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5594390eb860 con 0x55943918c200 2024-08-20T01:41:17.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.322+0000 7f929086c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5594390ef8a0 con 0x5594391898d0 2024-08-20T01:41:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.323+0000 7f9286ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594391898d0 0x55943918bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.323+0000 7f92877fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918c200 0x55943918e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.323+0000 7f9286ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594391898d0 0x55943918bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:46754/0 (socket says 172.21.15.22:46754) 2024-08-20T01:41:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.323+0000 7f9286ffd640 1 -- 172.21.15.22:0/699047799 learned_addr learned my addr 172.21.15.22:0/699047799 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.323+0000 7f9286ffd640 1 --2- 172.21.15.22:0/699047799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55943918ec40 0x559439191100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.323+0000 7f92877fe640 1 -- 172.21.15.22:0/699047799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594391898d0 msgr2=0x55943918bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.323+0000 7f92877fe640 1 --2- 172.21.15.22:0/699047799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594391898d0 0x55943918bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.323+0000 7f92877fe640 1 -- 172.21.15.22:0/699047799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55943918ec40 msgr2=0x559439191100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.323+0000 7f92877fe640 1 --2- 172.21.15.22:0/699047799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55943918ec40 0x559439191100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.323+0000 7f92877fe640 1 -- 172.21.15.22:0/699047799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559439092e40 con 0x55943918c200 2024-08-20T01:41:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.323+0000 7f9284ff9640 1 --2- 172.21.15.22:0/4009432766 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f92700b3c50 0x7f92700b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.323+0000 7f92877fe640 1 --2- 172.21.15.22:0/699047799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918c200 0x55943918e5f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9278009c20 tx=0x7f9278011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47d3ce12a5ae591f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.324+0000 7f9286ffd640 1 --2- 172.21.15.22:0/4009432766 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f92700b3c50 0x7f92700b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.324+0000 7f9284ff9640 1 -- 172.21.15.22:0/4009432766 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8298+0+0 (secure 0 0 0) 0x7f92800e4100 con 0x7f928810a640 2024-08-20T01:41:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.324+0000 7f926dffb640 1 -- 172.21.15.22:0/699047799 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278004050 con 0x55943918c200 2024-08-20T01:41:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.324+0000 7f926dffb640 1 -- 172.21.15.22:0/699047799 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92780054d0 con 0x55943918c200 2024-08-20T01:41:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.324+0000 7f926dffb640 1 -- 172.21.15.22:0/699047799 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278004d90 con 0x55943918c200 2024-08-20T01:41:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.325+0000 7f929086c740 1 -- 172.21.15.22:0/699047799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918c200 msgr2=0x55943918e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.325+0000 7f929086c740 1 --2- 172.21.15.22:0/699047799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918c200 0x55943918e5f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9278009c20 tx=0x7f9278011810 comp rx=0 tx=0).stop 2024-08-20T01:41:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.325+0000 7f9286ffd640 1 --2- 172.21.15.22:0/4009432766 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f92700b3c50 0x7f92700b6110 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f927c005ec0 tx=0x7f927c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.325+0000 7f929086c740 1 -- 172.21.15.22:0/699047799 shutdown_connections 2024-08-20T01:41:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.325+0000 7f929086c740 1 --2- 172.21.15.22:0/699047799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55943918ec40 0x559439191100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.325+0000 7f929086c740 1 --2- 172.21.15.22:0/699047799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918c200 0x55943918e5f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.325+0000 7f929086c740 1 --2- 172.21.15.22:0/699047799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594391898d0 0x55943918bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.325+0000 7f929086c740 1 -- 172.21.15.22:0/699047799 >> 172.21.15.22:0/699047799 conn(0x559439184a20 msgr2=0x5594391857b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.325+0000 7f929086c740 1 -- 172.21.15.22:0/699047799 shutdown_connections 2024-08-20T01:41:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.325+0000 7f929086c740 1 -- 172.21.15.22:0/699047799 wait complete. 2024-08-20T01:41:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.325+0000 7f929086c740 1 -- start start 2024-08-20T01:41:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.326+0000 7f929086c740 1 Processor -- start 2024-08-20T01:41:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.326+0000 7f929086c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594391898d0 0x5594391930a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.326+0000 7f929086c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55943918c200 0x559439193740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.326+0000 7f929086c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918ec40 0x559439194310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.326+0000 7f92877fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594391898d0 0x5594391930a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.327+0000 7f929086c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559439024ab0 con 0x55943918c200 2024-08-20T01:41:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.327+0000 7f92877fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594391898d0 0x5594391930a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:46756/0 (socket says 172.21.15.22:46756) 2024-08-20T01:41:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.327+0000 7f929086c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559439072780 con 0x55943918ec40 2024-08-20T01:41:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.327+0000 7f929086c740 1 -- 172.21.15.22:0/2649019932 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559439191c20 con 0x5594391898d0 2024-08-20T01:41:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.327+0000 7f92877fe640 1 -- 172.21.15.22:0/2649019932 learned_addr learned my addr 172.21.15.22:0/2649019932 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.327+0000 7f9286ffd640 1 --2- 172.21.15.22:0/2649019932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55943918c200 0x559439193740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.327+0000 7f9287fff640 1 --2- 172.21.15.22:0/2649019932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918ec40 0x559439194310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.327+0000 7f929086c740 10 client.0 _ll_register_callbacks cb 0x559438dfaa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.327+0000 7f9286ffd640 1 -- 172.21.15.22:0/2649019932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594391898d0 msgr2=0x5594391930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.327+0000 7f9286ffd640 1 --2- 172.21.15.22:0/2649019932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594391898d0 0x5594391930a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.327+0000 7f9286ffd640 1 -- 172.21.15.22:0/2649019932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918ec40 msgr2=0x559439194310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.327+0000 7f9286ffd640 1 --2- 172.21.15.22:0/2649019932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918ec40 0x559439194310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.327+0000 7f9286ffd640 1 -- 172.21.15.22:0/2649019932 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559438e4e790 con 0x55943918c200 2024-08-20T01:41:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.327+0000 7f9286ffd640 1 --2- 172.21.15.22:0/2649019932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55943918c200 0x559439193740 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f927c0096c0 tx=0x7f927c02a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7eb7c680ac0fb5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.327+0000 7f9266ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.328+0000 7f9266ffd640 1 -- 172.21.15.22:0/2649019932 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c035040 con 0x55943918c200 2024-08-20T01:41:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.328+0000 7f9266ffd640 1 -- 172.21.15.22:0/2649019932 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8298+0+0 (secure 0 0 0) 0x7f927c0043d0 con 0x55943918c200 2024-08-20T01:41:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.328+0000 7f929086c740 1 -- 172.21.15.22:0/2649019932 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55943909ae00 con 0x55943918c200 2024-08-20T01:41:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.328+0000 7f9266ffd640 1 -- 172.21.15.22:0/2649019932 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f927c0035f0 con 0x55943918c200 2024-08-20T01:41:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.328+0000 7f929086c740 10 client.17199 fetch_fsmap learned FSMap version 32 2024-08-20T01:41:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.328+0000 7f929086c740 1 -- 172.21.15.22:0/2649019932 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559438ec7620 con 0x55943918c200 2024-08-20T01:41:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.328+0000 7f9266ffd640 1 -- 172.21.15.22:0/2649019932 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55943909ae00 con 0x55943918c200 2024-08-20T01:41:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.328+0000 7f9266ffd640 1 -- 172.21.15.22:0/2649019932 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f927c053070 con 0x55943918c200 2024-08-20T01:41:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.329+0000 7f929086c740 10 client.17199 fetch_fsmap finished waiting for FSMap version 32 2024-08-20T01:41:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.329+0000 7f929086c740 10 client.17199 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.329+0000 7f929086c740 20 client.17199 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.329+0000 7f929086c740 1 --2- 172.21.15.22:0/2649019932 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55943919ecb0 0x5594391a1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.329+0000 7f929086c740 4 client.17199 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.329+0000 7f929086c740 1 -- 172.21.15.22:0/2649019932 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594390fe2b0 con 0x55943919ecb0 2024-08-20T01:41:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.329+0000 7f92877fe640 1 --2- 172.21.15.22:0/2649019932 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55943919ecb0 0x5594391a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.332+0000 7f92877fe640 1 --2- 172.21.15.22:0/2649019932 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55943919ecb0 0x5594391a1170 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd2ba2c442eb0da8 server_cookie=56b585ab73e0c59d in_seq=0 out_seq=0 2024-08-20T01:41:17.335 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.332+0000 7f9266ffd640 10 client.17199 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:17.335 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.333+0000 7f9266ffd640 1 -- 172.21.15.22:0/2649019932 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5594390fe2b0 con 0x55943919ecb0 2024-08-20T01:41:17.335 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.333+0000 7f9266ffd640 10 client.17199 handle_command_reply: tid=0 2024-08-20T01:41:17.336 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.333+0000 7f929086c740 1 client.17199 shutdown 2024-08-20T01:41:17.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.334+0000 7f929086c740 1 -- 172.21.15.22:0/2649019932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55943918c200 msgr2=0x559439193740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:17.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.334+0000 7f929086c740 1 --2- 172.21.15.22:0/2649019932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55943918c200 0x559439193740 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f927c0096c0 tx=0x7f927c02a3f0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.334+0000 7f929086c740 1 -- 172.21.15.22:0/2649019932 shutdown_connections 2024-08-20T01:41:17.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.334+0000 7f929086c740 1 --2- 172.21.15.22:0/2649019932 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55943919ecb0 0x5594391a1170 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.334+0000 7f929086c740 1 --2- 172.21.15.22:0/2649019932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918ec40 0x559439194310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.334+0000 7f929086c740 1 --2- 172.21.15.22:0/2649019932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55943918c200 0x559439193740 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.334+0000 7f929086c740 1 --2- 172.21.15.22:0/2649019932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594391898d0 0x5594391930a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.334+0000 7f929086c740 1 -- 172.21.15.22:0/2649019932 >> 172.21.15.22:0/2649019932 conn(0x559439184a20 msgr2=0x559439183ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:17.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.335+0000 7f9266ffd640 0 client.17199 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:17.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.335+0000 7f929086c740 1 -- 172.21.15.22:0/2649019932 shutdown_connections 2024-08-20T01:41:17.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.335+0000 7f929086c740 1 -- 172.21.15.22:0/2649019932 wait complete. 2024-08-20T01:41:17.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.335+0000 7f929086c740 20 client.17199 trim_cache size 0 max 16384 2024-08-20T01:41:17.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.365+0000 7f929086c740 1 Processor -- start 2024-08-20T01:41:17.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.365+0000 7f929086c740 1 -- start start 2024-08-20T01:41:17.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.366+0000 7f929086c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594391898d0 0x55943917f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.366+0000 7f929086c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55943918c200 0x5594391832c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.366+0000 7f929086c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918ec40 0x559439183800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.366+0000 7f929086c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f92881b7260 con 0x55943918c200 2024-08-20T01:41:17.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.366+0000 7f929086c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f92881b4a70 con 0x55943918ec40 2024-08-20T01:41:17.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.366+0000 7f929086c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f92881b28c0 con 0x5594391898d0 2024-08-20T01:41:17.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.366+0000 7f9286ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55943918c200 0x5594391832c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.366+0000 7f92877fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594391898d0 0x55943917f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.366+0000 7f9286ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55943918c200 0x5594391832c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45992/0 (socket says 172.21.15.22:45992) 2024-08-20T01:41:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.366+0000 7f9286ffd640 1 -- 172.21.15.22:0/1377504459 learned_addr learned my addr 172.21.15.22:0/1377504459 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.366+0000 7f9287fff640 1 --2- 172.21.15.22:0/1377504459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918ec40 0x559439183800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.366+0000 7f9286ffd640 1 -- 172.21.15.22:0/1377504459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594391898d0 msgr2=0x55943917f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.366+0000 7f9286ffd640 1 --2- 172.21.15.22:0/1377504459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594391898d0 0x55943917f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.366+0000 7f9286ffd640 1 -- 172.21.15.22:0/1377504459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918ec40 msgr2=0x559439183800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.366+0000 7f9286ffd640 1 --2- 172.21.15.22:0/1377504459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918ec40 0x559439183800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.366+0000 7f9286ffd640 1 -- 172.21.15.22:0/1377504459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55943918c030 con 0x55943918c200 2024-08-20T01:41:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.367+0000 7f9286ffd640 1 --2- 172.21.15.22:0/1377504459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55943918c200 0x5594391832c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f927c000c00 tx=0x7f927c04aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2fe2ab64d8ad16 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.367+0000 7f926d7fa640 1 -- 172.21.15.22:0/1377504459 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c035040 con 0x55943918c200 2024-08-20T01:41:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.367+0000 7f926d7fa640 1 -- 172.21.15.22:0/1377504459 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f927c032ce0 con 0x55943918c200 2024-08-20T01:41:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.367+0000 7f926d7fa640 1 -- 172.21.15.22:0/1377504459 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c04a670 con 0x55943918c200 2024-08-20T01:41:17.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.368+0000 7f929086c740 1 -- 172.21.15.22:0/1377504459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55943918c200 msgr2=0x5594391832c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:17.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.368+0000 7f929086c740 1 --2- 172.21.15.22:0/1377504459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55943918c200 0x5594391832c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f927c000c00 tx=0x7f927c04aa70 comp rx=0 tx=0).stop 2024-08-20T01:41:17.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.368+0000 7f929086c740 1 -- 172.21.15.22:0/1377504459 shutdown_connections 2024-08-20T01:41:17.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.368+0000 7f929086c740 1 --2- 172.21.15.22:0/1377504459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918ec40 0x559439183800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.368+0000 7f929086c740 1 --2- 172.21.15.22:0/1377504459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55943918c200 0x5594391832c0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.368+0000 7f929086c740 1 --2- 172.21.15.22:0/1377504459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594391898d0 0x55943917f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.368+0000 7f929086c740 1 -- 172.21.15.22:0/1377504459 >> 172.21.15.22:0/1377504459 conn(0x559439184a20 msgr2=0x559439185280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:17.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.368+0000 7f929086c740 1 -- 172.21.15.22:0/1377504459 shutdown_connections 2024-08-20T01:41:17.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.368+0000 7f929086c740 1 -- 172.21.15.22:0/1377504459 wait complete. 2024-08-20T01:41:17.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.369+0000 7f929086c740 1 -- start start 2024-08-20T01:41:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.369+0000 7f929086c740 1 Processor -- start 2024-08-20T01:41:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.369+0000 7f929086c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594391898d0 0x55943919a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.369+0000 7f929086c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55943918c200 0x55943919a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.369+0000 7f929086c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918ec40 0x5594392101c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.369+0000 7fb9d4f05640 1 -- 172.21.15.22:0/384870082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9d0108ca0 msgr2=0x7fb9d010f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.369+0000 7fb9d4f05640 1 --2- 172.21.15.22:0/384870082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9d0108ca0 0x7fb9d010f480 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009be0 tx=0x7fb9c802a6c0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.369+0000 7fb9d4f05640 1 -- 172.21.15.22:0/384870082 shutdown_connections 2024-08-20T01:41:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.369+0000 7fb9d4f05640 1 --2- 172.21.15.22:0/384870082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9d0108ca0 0x7fb9d010f480 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.369+0000 7fb9d4f05640 1 --2- 172.21.15.22:0/384870082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9d0108320 0x7fb9d0108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.369+0000 7fb9d4f05640 1 --2- 172.21.15.22:0/384870082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d0100990 0x7fb9d0100d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.369+0000 7fb9d4f05640 1 -- 172.21.15.22:0/384870082 >> 172.21.15.22:0/384870082 conn(0x7fb9d00fc5c0 msgr2=0x7fb9d00fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:17.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.370+0000 7f9287fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918ec40 0x5594392101c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.370+0000 7f9287fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918ec40 0x5594392101c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:39928/0 (socket says 172.21.15.22:39928) 2024-08-20T01:41:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.370+0000 7f9287fff640 1 -- 172.21.15.22:0/3891636844 learned_addr learned my addr 172.21.15.22:0/3891636844 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.370+0000 7f9286ffd640 1 --2- 172.21.15.22:0/3891636844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55943918c200 0x55943919a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.370+0000 7f92877fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594391898d0 0x55943919a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.370+0000 7f929086c740 1 -- 172.21.15.22:0/3891636844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f92881b2f30 con 0x5594391898d0 2024-08-20T01:41:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.370+0000 7f929086c740 1 -- 172.21.15.22:0/3891636844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f92881b43a0 con 0x55943918ec40 2024-08-20T01:41:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.370+0000 7f929086c740 1 -- 172.21.15.22:0/3891636844 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f92881b3600 con 0x55943918c200 2024-08-20T01:41:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.370+0000 7f929086c740 10 client.0 _ll_register_callbacks cb 0x7f927c0315a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.370+0000 7f9287fff640 1 -- 172.21.15.22:0/3891636844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55943918c200 msgr2=0x55943919a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.370+0000 7f9287fff640 1 --2- 172.21.15.22:0/3891636844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55943918c200 0x55943919a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.370+0000 7f9287fff640 1 -- 172.21.15.22:0/3891636844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594391898d0 msgr2=0x55943919a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.371+0000 7f9287fff640 1 --2- 172.21.15.22:0/3891636844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594391898d0 0x55943919a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.371+0000 7f9287fff640 1 -- 172.21.15.22:0/3891636844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559439194680 con 0x55943918ec40 2024-08-20T01:41:17.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.371+0000 7f92877fe640 1 --2- 172.21.15.22:0/3891636844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594391898d0 0x55943919a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:17.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.370+0000 7fb9d4f05640 1 -- 172.21.15.22:0/384870082 shutdown_connections 2024-08-20T01:41:17.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.370+0000 7fb9d4f05640 1 -- 172.21.15.22:0/384870082 wait complete. 2024-08-20T01:41:17.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.371+0000 7fb9d4f05640 1 Processor -- start 2024-08-20T01:41:17.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.371+0000 7f9287fff640 1 --2- 172.21.15.22:0/3891636844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918ec40 0x5594392101c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f92800e1f30 tx=0x7f9280005650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d21a0b3a0f4ef91 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:17.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.371+0000 7fb9d4f05640 1 -- start start 2024-08-20T01:41:17.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.371+0000 7f9266ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:41:17.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.371+0000 7f9266ffd640 1 -- 172.21.15.22:0/3891636844 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92800c9020 con 0x55943918ec40 2024-08-20T01:41:17.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.372+0000 7f9266ffd640 1 -- 172.21.15.22:0/3891636844 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8298+0+0 (secure 0 0 0) 0x7f92800b3e40 con 0x55943918ec40 2024-08-20T01:41:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.372+0000 7fb9d4f05640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9d0100990 0x7fb9d010bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.372+0000 7fb9d4f05640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d0108320 0x7fb9d010c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.372+0000 7fb9d4f05640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9d0108ca0 0x7fb9d01aae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.372+0000 7fb9d4f05640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d0103520 con 0x7fb9d0100990 2024-08-20T01:41:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.372+0000 7fb9cf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9d0100990 0x7fb9d010bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.372+0000 7fb9cf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9d0100990 0x7fb9d010bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46008/0 (socket says 172.21.15.22:46008) 2024-08-20T01:41:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.372+0000 7fb9cf7fe640 1 -- 172.21.15.22:0/2476331288 learned_addr learned my addr 172.21.15.22:0/2476331288 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.372+0000 7fb9cffff640 1 --2- 172.21.15.22:0/2476331288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9d0108ca0 0x7fb9d01aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.372+0000 7fb9d4f05640 1 -- 172.21.15.22:0/2476331288 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d01033a0 con 0x7fb9d0108ca0 2024-08-20T01:41:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.372+0000 7fb9d4f05640 1 -- 172.21.15.22:0/2476331288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d01036a0 con 0x7fb9d0108320 2024-08-20T01:41:17.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.374+0000 7f929086c740 1 -- 172.21.15.22:0/3891636844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f927c032ce0 con 0x55943918ec40 2024-08-20T01:41:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.372+0000 7fb9ceffd640 1 --2- 172.21.15.22:0/2476331288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d0108320 0x7fb9d010c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.373+0000 7fb9ceffd640 1 -- 172.21.15.22:0/2476331288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9d0108ca0 msgr2=0x7fb9d01aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.373+0000 7fb9ceffd640 1 --2- 172.21.15.22:0/2476331288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9d0108ca0 0x7fb9d01aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.373+0000 7fb9ceffd640 1 -- 172.21.15.22:0/2476331288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9d0100990 msgr2=0x7fb9d010bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.373+0000 7fb9ceffd640 1 --2- 172.21.15.22:0/2476331288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9d0100990 0x7fb9d010bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.373+0000 7fb9ceffd640 1 -- 172.21.15.22:0/2476331288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d01ab540 con 0x7fb9d0108320 2024-08-20T01:41:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.374+0000 7fb9ceffd640 1 --2- 172.21.15.22:0/2476331288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d0108320 0x7fb9d010c410 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb9c400e740 tx=0x7fb9c400ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.374+0000 7fb9ccff9640 1 -- 172.21.15.22:0/2476331288 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c400ccc0 con 0x7fb9d0108320 2024-08-20T01:41:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.374+0000 7fb9ccff9640 1 -- 172.21.15.22:0/2476331288 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9c400ce60 con 0x7fb9d0108320 2024-08-20T01:41:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.374+0000 7fb9ccff9640 1 -- 172.21.15.22:0/2476331288 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4018680 con 0x7fb9d0108320 2024-08-20T01:41:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.374+0000 7fb9d4f05640 1 -- 172.21.15.22:0/2476331288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d01ab830 con 0x7fb9d0108320 2024-08-20T01:41:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.375+0000 7fb9d4f05640 1 -- 172.21.15.22:0/2476331288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d01abdc0 con 0x7fb9d0108320 2024-08-20T01:41:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.376+0000 7f9266ffd640 1 -- 172.21.15.22:0/3891636844 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f92800ab710 con 0x55943918ec40 2024-08-20T01:41:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.376+0000 7f929086c740 10 client.26801 fetch_fsmap learned FSMap version 32 2024-08-20T01:41:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.376+0000 7f929086c740 1 -- 172.21.15.22:0/3891636844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559439211af0 con 0x55943918ec40 2024-08-20T01:41:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.378+0000 7f9266ffd640 1 -- 172.21.15.22:0/3891636844 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92800ab010 con 0x55943918ec40 2024-08-20T01:41:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.378+0000 7f9266ffd640 1 -- 172.21.15.22:0/3891636844 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f92800a6980 con 0x55943918ec40 2024-08-20T01:41:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.378+0000 7f929086c740 10 client.26801 fetch_fsmap finished waiting for FSMap version 32 2024-08-20T01:41:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.378+0000 7f929086c740 10 client.26801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.378+0000 7f929086c740 20 client.26801 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.378+0000 7f929086c740 1 --2- 172.21.15.22:0/3891636844 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559439212500 0x559439214920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.378+0000 7f929086c740 4 client.26801 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:41:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.378+0000 7f929086c740 1 -- 172.21.15.22:0/3891636844 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f927c032ce0 con 0x559439212500 2024-08-20T01:41:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.379+0000 7f92877fe640 1 --2- 172.21.15.22:0/3891636844 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559439212500 0x559439214920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.380+0000 7f92877fe640 1 --2- 172.21.15.22:0/3891636844 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559439212500 0x559439214920 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bddd28160d73e9f3 server_cookie=9639f2eb94112036 in_seq=0 out_seq=0 2024-08-20T01:41:17.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.379+0000 7fb9d8560740 1 Processor -- start 2024-08-20T01:41:17.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.380+0000 7fb9d8560740 1 -- start start 2024-08-20T01:41:17.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.380+0000 7fb9ccff9640 1 -- 172.21.15.22:0/2476331288 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb9c40188e0 con 0x7fb9d0108320 2024-08-20T01:41:17.384 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.380+0000 7f9266ffd640 10 client.26801 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:17.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.380+0000 7fb9d8560740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c976fb550 0x562c976fb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.380+0000 7fb9d8560740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c976fbe70 0x562c977078c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.380+0000 7fb9d8560740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c97707e00 0x562c9770a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.380+0000 7fb9cffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c976fb550 0x562c976fb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.380+0000 7fb9cffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c976fb550 0x562c976fb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:46808/0 (socket says 172.21.15.22:46808) 2024-08-20T01:41:17.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.380+0000 7fb9cffff640 1 -- 172.21.15.22:0/3106449550 learned_addr learned my addr 172.21.15.22:0/3106449550 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.380+0000 7fb9d8560740 1 -- 172.21.15.22:0/3106449550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562c97671940 con 0x562c976fbe70 2024-08-20T01:41:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.380+0000 7fb9d8560740 1 -- 172.21.15.22:0/3106449550 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562c97660e40 con 0x562c97707e00 2024-08-20T01:41:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.380+0000 7fb9d8560740 1 -- 172.21.15.22:0/3106449550 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562c97664e80 con 0x562c976fb550 2024-08-20T01:41:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.381+0000 7fb9cf7fe640 1 --2- 172.21.15.22:0/3106449550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c976fbe70 0x562c977078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.381+0000 7fb9ceffd640 1 --2- 172.21.15.22:0/3106449550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c97707e00 0x562c9770a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.381+0000 7fb9cffff640 1 -- 172.21.15.22:0/3106449550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c97707e00 msgr2=0x562c9770a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.381+0000 7fb9cffff640 1 --2- 172.21.15.22:0/3106449550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c97707e00 0x562c9770a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.381+0000 7fb9cffff640 1 -- 172.21.15.22:0/3106449550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c976fbe70 msgr2=0x562c977078c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.381+0000 7fb9cffff640 1 --2- 172.21.15.22:0/3106449550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c976fbe70 0x562c977078c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.381+0000 7fb9cffff640 1 -- 172.21.15.22:0/3106449550 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c975fd520 con 0x562c976fb550 2024-08-20T01:41:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.381+0000 7fb9ceffd640 1 --2- 172.21.15.22:0/3106449550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c97707e00 0x562c9770a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.381+0000 7fb9ccff9640 1 --2- 172.21.15.22:0/2476331288 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb9b80b3d40 0x7fb9b80b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.382+0000 7fb9cf7fe640 1 --2- 172.21.15.22:0/2476331288 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb9b80b3d40 0x7fb9b80b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.382+0000 7fb9ccff9640 1 -- 172.21.15.22:0/2476331288 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8298+0+0 (secure 0 0 0) 0x7fb9c40e3d20 con 0x7fb9d0108320 2024-08-20T01:41:17.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.382+0000 7fb9cffff640 1 --2- 172.21.15.22:0/3106449550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c976fb550 0x562c976fb930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8033000 tx=0x7fb9c8009880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77ddfcf0be9c33dd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.382+0000 7fb9cf7fe640 1 --2- 172.21.15.22:0/2476331288 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb9b80b3d40 0x7fb9b80b6200 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x562c976fe6d0 tx=0x7fb9c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.382+0000 7fb9b5ffb640 1 -- 172.21.15.22:0/3106449550 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8041070 con 0x562c976fb550 2024-08-20T01:41:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.382+0000 7fb9b5ffb640 1 -- 172.21.15.22:0/3106449550 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9c8003e20 con 0x562c976fb550 2024-08-20T01:41:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.382+0000 7fb9b5ffb640 1 -- 172.21.15.22:0/3106449550 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8036040 con 0x562c976fb550 2024-08-20T01:41:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.383+0000 7fb9d8560740 1 -- 172.21.15.22:0/3106449550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c976fb550 msgr2=0x562c976fb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.383+0000 7fb9d8560740 1 --2- 172.21.15.22:0/3106449550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c976fb550 0x562c976fb930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8033000 tx=0x7fb9c8009880 comp rx=0 tx=0).stop 2024-08-20T01:41:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.383+0000 7fb9d8560740 1 -- 172.21.15.22:0/3106449550 shutdown_connections 2024-08-20T01:41:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.383+0000 7fb9d8560740 1 --2- 172.21.15.22:0/3106449550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c97707e00 0x562c9770a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.383+0000 7fb9d8560740 1 --2- 172.21.15.22:0/3106449550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c976fbe70 0x562c977078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.383+0000 7fb9d8560740 1 --2- 172.21.15.22:0/3106449550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c976fb550 0x562c976fb930 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.383+0000 7fb9d8560740 1 -- 172.21.15.22:0/3106449550 >> 172.21.15.22:0/3106449550 conn(0x562c976f9380 msgr2=0x562c976fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.383+0000 7fb9d8560740 1 -- 172.21.15.22:0/3106449550 shutdown_connections 2024-08-20T01:41:17.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.384+0000 7fb9d8560740 1 -- 172.21.15.22:0/3106449550 wait complete. 2024-08-20T01:41:17.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.384+0000 7fb9d8560740 1 -- start start 2024-08-20T01:41:17.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.384+0000 7fb9d8560740 1 Processor -- start 2024-08-20T01:41:17.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.387+0000 7fb9d8560740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c976fb550 0x562c97704d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.387+0000 7fb9d8560740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c976fbe70 0x562c97705260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.387+0000 7fb9cf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c976fb550 0x562c97704d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.387+0000 7fb9cf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c976fb550 0x562c97704d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46026/0 (socket says 172.21.15.22:46026) 2024-08-20T01:41:17.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.387+0000 7fb9d8560740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c97707e00 0x562c977057a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.387+0000 7fb9d8560740 1 -- 172.21.15.22:0/3337861238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562c974c3890 con 0x562c976fb550 2024-08-20T01:41:17.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.387+0000 7fb9d8560740 1 -- 172.21.15.22:0/3337861238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562c975e7700 con 0x562c97707e00 2024-08-20T01:41:17.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.387+0000 7fb9d8560740 1 -- 172.21.15.22:0/3337861238 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562c9770ab40 con 0x562c976fbe70 2024-08-20T01:41:17.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.387+0000 7fb9cf7fe640 1 -- 172.21.15.22:0/3337861238 learned_addr learned my addr 172.21.15.22:0/3337861238 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:17.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.388+0000 7fb9cffff640 1 --2- 172.21.15.22:0/3337861238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c97707e00 0x562c977057a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.388+0000 7fb9ceffd640 1 --2- 172.21.15.22:0/3337861238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c976fbe70 0x562c97705260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.388+0000 7fb9d8560740 10 client.0 _ll_register_callbacks cb 0x562c9765c6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:17.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.388+0000 7fb9cffff640 1 -- 172.21.15.22:0/3337861238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c976fbe70 msgr2=0x562c97705260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:17.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.388+0000 7fb9cffff640 1 --2- 172.21.15.22:0/3337861238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c976fbe70 0x562c97705260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.388+0000 7fb9cffff640 1 -- 172.21.15.22:0/3337861238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c976fb550 msgr2=0x562c97704d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.388+0000 7fb9cffff640 1 --2- 172.21.15.22:0/3337861238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c976fb550 0x562c97704d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.388+0000 7fb9cffff640 1 -- 172.21.15.22:0/3337861238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c973c0930 con 0x562c97707e00 2024-08-20T01:41:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.388+0000 7fb9d8560740 1 -- 172.21.15.22:0/3337861238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9c8003e20 con 0x562c97707e00 2024-08-20T01:41:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.388+0000 7fb9ceffd640 1 --2- 172.21.15.22:0/3337861238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c976fbe70 0x562c97705260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.389+0000 7fb9cffff640 1 --2- 172.21.15.22:0/3337861238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c97707e00 0x562c977057a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb9c802acb0 tx=0x7fb9c8032e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8c8f3d3fedf6623 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.389+0000 7fb9aeffd640 10 client.26810 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:41:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.389+0000 7fb9aeffd640 1 -- 172.21.15.22:0/3337861238 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8058050 con 0x562c97707e00 2024-08-20T01:41:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.389+0000 7fb9aeffd640 1 -- 172.21.15.22:0/3337861238 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8298+0+0 (secure 0 0 0) 0x7fb9c8003970 con 0x562c97707e00 2024-08-20T01:41:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.389+0000 7fb9aeffd640 1 -- 172.21.15.22:0/3337861238 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb9c804d030 con 0x562c97707e00 2024-08-20T01:41:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.389+0000 7fb9d8560740 10 client.26810 fetch_fsmap learned FSMap version 32 2024-08-20T01:41:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.389+0000 7fb9d8560740 1 -- 172.21.15.22:0/3337861238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({fsmap=32}) -- 0x562c977165e0 con 0x562c97707e00 2024-08-20T01:41:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.389+0000 7fb9aeffd640 1 -- 172.21.15.22:0/3337861238 <== mon.2 v2:172.21.15.77:3300/0 4 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7fb9c80303a0 con 0x562c97707e00 2024-08-20T01:41:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.389+0000 7fb9d8560740 10 client.26810 fetch_fsmap finished waiting for FSMap version 32 2024-08-20T01:41:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.389+0000 7fb9d8560740 10 client.26810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.389+0000 7fb9d8560740 20 client.26810 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.389+0000 7fb9d8560740 1 --2- 172.21.15.22:0/3337861238 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562c97717930 0x562c97719d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.389+0000 7fb9d8560740 4 client.26810 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.389+0000 7fb9d8560740 1 -- 172.21.15.22:0/3337861238 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c97673890 con 0x562c97717930 2024-08-20T01:41:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.390+0000 7fb9cf7fe640 1 --2- 172.21.15.22:0/3337861238 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562c97717930 0x562c97719d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.390+0000 7fb9cf7fe640 1 --2- 172.21.15.22:0/3337861238 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562c97717930 0x562c97719d20 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d778cb76190b9f9e server_cookie=80b3887c92bf790c in_seq=0 out_seq=0 2024-08-20T01:41:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.390+0000 7fb9aeffd640 10 client.26810 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:17.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.392+0000 7fb9aeffd640 1 -- 172.21.15.22:0/3337861238 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c97673890 con 0x562c97717930 2024-08-20T01:41:17.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.392+0000 7fb9aeffd640 10 client.26810 handle_command_reply: tid=0 2024-08-20T01:41:17.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.392+0000 7fb9d8560740 1 client.26810 shutdown 2024-08-20T01:41:17.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.392+0000 7fb9d8560740 1 -- 172.21.15.22:0/3337861238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c97707e00 msgr2=0x562c977057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:17.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.392+0000 7fb9d8560740 1 --2- 172.21.15.22:0/3337861238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c97707e00 0x562c977057a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb9c802acb0 tx=0x7fb9c8032e70 comp rx=0 tx=0).stop 2024-08-20T01:41:17.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.392+0000 7fb9d8560740 1 -- 172.21.15.22:0/3337861238 shutdown_connections 2024-08-20T01:41:17.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.392+0000 7fb9d8560740 1 --2- 172.21.15.22:0/3337861238 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562c97717930 0x562c97719d20 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.392+0000 7fb9d8560740 1 --2- 172.21.15.22:0/3337861238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c97707e00 0x562c977057a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.392+0000 7fb9d8560740 1 --2- 172.21.15.22:0/3337861238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c976fbe70 0x562c97705260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.392+0000 7fb9d8560740 1 --2- 172.21.15.22:0/3337861238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c976fb550 0x562c97704d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.392+0000 7fb9aeffd640 0 client.26810 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.392+0000 7fb9d8560740 1 -- 172.21.15.22:0/3337861238 >> 172.21.15.22:0/3337861238 conn(0x562c976f9380 msgr2=0x562c976fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.392+0000 7fb9d8560740 1 -- 172.21.15.22:0/3337861238 shutdown_connections 2024-08-20T01:41:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.392+0000 7fb9d8560740 1 -- 172.21.15.22:0/3337861238 wait complete. 2024-08-20T01:41:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.392+0000 7fb9d8560740 20 client.26810 trim_cache size 0 max 16384 2024-08-20T01:41:17.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.410+0000 7fb9d8560740 1 Processor -- start 2024-08-20T01:41:17.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.410+0000 7fb9d8560740 1 -- start start 2024-08-20T01:41:17.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.410+0000 7fb9d8560740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c976fb550 0x562c976ff710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.410+0000 7fb9d8560740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c976fbe70 0x562c97706a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.410+0000 7fb9d8560740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c97707e00 0x562c9771f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.410+0000 7fb9d8560740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc010ee0 con 0x562c97707e00 2024-08-20T01:41:17.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.410+0000 7fb9d8560740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc00e6f0 con 0x562c976fb550 2024-08-20T01:41:17.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.410+0000 7fb9d8560740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc00c540 con 0x562c976fbe70 2024-08-20T01:41:17.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.410+0000 7fb9cffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c97707e00 0x562c9771f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.410+0000 7fb9ceffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c976fbe70 0x562c97706a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.410+0000 7fb9cffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c97707e00 0x562c9771f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46040/0 (socket says 172.21.15.22:46040) 2024-08-20T01:41:17.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.410+0000 7fb9cffff640 1 -- 172.21.15.22:0/1390861922 learned_addr learned my addr 172.21.15.22:0/1390861922 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:17.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.411+0000 7fb9cf7fe640 1 --2- 172.21.15.22:0/1390861922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c976fb550 0x562c976ff710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.411+0000 7fb9ceffd640 1 -- 172.21.15.22:0/1390861922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c976fb550 msgr2=0x562c976ff710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:17.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.411+0000 7fb9ceffd640 1 --2- 172.21.15.22:0/1390861922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c976fb550 0x562c976ff710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.411+0000 7fb9ceffd640 1 -- 172.21.15.22:0/1390861922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c97707e00 msgr2=0x562c9771f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:17.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.411+0000 7fb9ceffd640 1 --2- 172.21.15.22:0/1390861922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c97707e00 0x562c9771f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.411+0000 7fb9ceffd640 1 -- 172.21.15.22:0/1390861922 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c976f9e00 con 0x562c976fbe70 2024-08-20T01:41:17.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.411+0000 7fb9cffff640 1 --2- 172.21.15.22:0/1390861922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c97707e00 0x562c9771f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:17.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.411+0000 7fb9ceffd640 1 --2- 172.21.15.22:0/1390861922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c976fbe70 0x562c97706a60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40e1830 tx=0x7fb9c40aaac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d52a499041fa805 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:17.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.411+0000 7fb9b57fa640 1 -- 172.21.15.22:0/1390861922 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c40aa740 con 0x562c976fbe70 2024-08-20T01:41:17.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.411+0000 7fb9b57fa640 1 -- 172.21.15.22:0/1390861922 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9c40ab330 con 0x562c976fbe70 2024-08-20T01:41:17.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.411+0000 7fb9b57fa640 1 -- 172.21.15.22:0/1390861922 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4018e30 con 0x562c976fbe70 2024-08-20T01:41:17.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.412+0000 7fb9d8560740 1 -- 172.21.15.22:0/1390861922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c976fbe70 msgr2=0x562c97706a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:17.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.412+0000 7fb9d8560740 1 --2- 172.21.15.22:0/1390861922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c976fbe70 0x562c97706a60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40e1830 tx=0x7fb9c40aaac0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.412+0000 7fb9d8560740 1 -- 172.21.15.22:0/1390861922 shutdown_connections 2024-08-20T01:41:17.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.412+0000 7fb9d8560740 1 --2- 172.21.15.22:0/1390861922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c97707e00 0x562c9771f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.412+0000 7fb9d8560740 1 --2- 172.21.15.22:0/1390861922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c976fbe70 0x562c97706a60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.412+0000 7fb9d8560740 1 --2- 172.21.15.22:0/1390861922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c976fb550 0x562c976ff710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.412+0000 7fb9d8560740 1 -- 172.21.15.22:0/1390861922 >> 172.21.15.22:0/1390861922 conn(0x562c976f9380 msgr2=0x562c97706350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:17.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.412+0000 7fb9d8560740 1 -- 172.21.15.22:0/1390861922 shutdown_connections 2024-08-20T01:41:17.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.412+0000 7fb9d8560740 1 -- 172.21.15.22:0/1390861922 wait complete. 2024-08-20T01:41:17.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.413+0000 7fb9d8560740 1 -- start start 2024-08-20T01:41:17.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.413+0000 7fb9d8560740 1 Processor -- start 2024-08-20T01:41:17.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.413+0000 7fb9d8560740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c976fb550 0x562c9770fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.413+0000 7fb9d8560740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c976fbe70 0x562c977103a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.413+0000 7fb9d8560740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c97707e00 0x562c9770ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.413+0000 7fb9d8560740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc00cbb0 con 0x562c976fbe70 2024-08-20T01:41:17.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.413+0000 7fb9d8560740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc00e020 con 0x562c976fb550 2024-08-20T01:41:17.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.413+0000 7fb9d8560740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc00d280 con 0x562c97707e00 2024-08-20T01:41:17.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.413+0000 7fb9d8560740 10 client.0 _ll_register_callbacks cb 0x7fb9c0009650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:17.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.413+0000 7fb9ceffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c976fbe70 0x562c977103a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.413+0000 7fb9cf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c976fb550 0x562c9770fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.413+0000 7fb9ceffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c976fbe70 0x562c977103a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46048/0 (socket says 172.21.15.22:46048) 2024-08-20T01:41:17.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.413+0000 7fb9ceffd640 1 -- 172.21.15.22:0/933719894 learned_addr learned my addr 172.21.15.22:0/933719894 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:17.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.413+0000 7fb9cf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c976fb550 0x562c9770fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:39978/0 (socket says 172.21.15.22:39978) 2024-08-20T01:41:17.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.413+0000 7fb9cffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c97707e00 0x562c9770ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.414+0000 7fb9ceffd640 1 -- 172.21.15.22:0/933719894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c97707e00 msgr2=0x562c9770ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:17.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.414+0000 7fb9ceffd640 1 --2- 172.21.15.22:0/933719894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c97707e00 0x562c9770ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.414+0000 7fb9ceffd640 1 -- 172.21.15.22:0/933719894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c976fb550 msgr2=0x562c9770fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:17.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.414+0000 7fb9ceffd640 1 --2- 172.21.15.22:0/933719894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c976fb550 0x562c9770fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.414+0000 7fb9ceffd640 1 -- 172.21.15.22:0/933719894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c97702ca0 con 0x562c976fbe70 2024-08-20T01:41:17.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.414+0000 7fb9cf7fe640 1 --2- 172.21.15.22:0/933719894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c976fb550 0x562c9770fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:17.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.414+0000 7fb9cffff640 1 --2- 172.21.15.22:0/933719894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c97707e00 0x562c9770ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:17.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.414+0000 7fb9ceffd640 1 --2- 172.21.15.22:0/933719894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c976fbe70 0x562c977103a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40aa930 tx=0x7fb9c4019e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2ce9266a4afb9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:17.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.414+0000 7fb9aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:17.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.414+0000 7fb9aeffd640 1 -- 172.21.15.22:0/933719894 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c40aa740 con 0x562c976fbe70 2024-08-20T01:41:17.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.414+0000 7fb9aeffd640 1 -- 172.21.15.22:0/933719894 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8298+0+0 (secure 0 0 0) 0x7fb9c40922e0 con 0x562c976fbe70 2024-08-20T01:41:17.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.414+0000 7fb9d8560740 1 -- 172.21.15.22:0/933719894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9c40ab330 con 0x562c976fbe70 2024-08-20T01:41:17.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.414+0000 7fb9aeffd640 1 -- 172.21.15.22:0/933719894 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb9c40aac30 con 0x562c976fbe70 2024-08-20T01:41:17.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.414+0000 7fb9d8560740 10 client.17223 fetch_fsmap learned FSMap version 32 2024-08-20T01:41:17.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.414+0000 7fb9d8560740 1 -- 172.21.15.22:0/933719894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562c977828e0 con 0x562c976fbe70 2024-08-20T01:41:17.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.415+0000 7fb9aeffd640 1 -- 172.21.15.22:0/933719894 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9c40ab330 con 0x562c976fbe70 2024-08-20T01:41:17.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.415+0000 7fb9aeffd640 1 -- 172.21.15.22:0/933719894 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7fb9c40a6730 con 0x562c976fbe70 2024-08-20T01:41:17.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.415+0000 7fb9d8560740 10 client.17223 fetch_fsmap finished waiting for FSMap version 32 2024-08-20T01:41:17.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.415+0000 7fb9d8560740 10 client.17223 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:17.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.415+0000 7fb9d8560740 20 client.17223 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:17.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.415+0000 7fb9d8560740 1 --2- 172.21.15.22:0/933719894 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562c97783010 0x562c97785430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:17.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.415+0000 7fb9d8560740 4 client.17223 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:41:17.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.415+0000 7fb9d8560740 1 -- 172.21.15.22:0/933719894 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562c9766f330 con 0x562c97783010 2024-08-20T01:41:17.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.415+0000 7fb9cf7fe640 1 --2- 172.21.15.22:0/933719894 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562c97783010 0x562c97785430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:17.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.415+0000 7fb9aeffd640 10 client.17223 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:17.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.415+0000 7fb9cf7fe640 1 --2- 172.21.15.22:0/933719894 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562c97783010 0x562c97785430 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc185dc317099744 server_cookie=2ca40957d8336c87 in_seq=0 out_seq=0 2024-08-20T01:41:17.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.453+0000 7fb9aeffd640 1 -- 172.21.15.22:0/933719894 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562c9766f330 con 0x562c97783010 2024-08-20T01:41:17.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.453+0000 7fb9aeffd640 10 client.17223 handle_command_reply: tid=0 2024-08-20T01:41:17.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.453+0000 7fb9d8560740 1 client.17223 shutdown 2024-08-20T01:41:17.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d8560740 1 -- 172.21.15.22:0/933719894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c976fbe70 msgr2=0x562c977103a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:17.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d8560740 1 --2- 172.21.15.22:0/933719894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c976fbe70 0x562c977103a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40aa930 tx=0x7fb9c4019e90 comp rx=0 tx=0).stop 2024-08-20T01:41:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d8560740 1 -- 172.21.15.22:0/933719894 shutdown_connections 2024-08-20T01:41:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d8560740 1 --2- 172.21.15.22:0/933719894 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x562c97783010 0x562c97785430 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d8560740 1 --2- 172.21.15.22:0/933719894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562c97707e00 0x562c9770ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d8560740 1 --2- 172.21.15.22:0/933719894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c976fbe70 0x562c977103a0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d8560740 1 --2- 172.21.15.22:0/933719894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c976fb550 0x562c9770fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d8560740 1 -- 172.21.15.22:0/933719894 >> 172.21.15.22:0/933719894 conn(0x562c976f9380 msgr2=0x562c97706b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9aeffd640 0 client.17223 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d8560740 1 -- 172.21.15.22:0/933719894 shutdown_connections 2024-08-20T01:41:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d8560740 1 -- 172.21.15.22:0/933719894 wait complete. 2024-08-20T01:41:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d8560740 20 client.17223 trim_cache size 0 max 16384 2024-08-20T01:41:17.458 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:41:17.458 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-08-20T01:41:17.458 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "6c7e449c-071e-4fb7-9ff4-553015b09fa4", 2024-08-20T01:41:17.458 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-08-20T01:41:17.458 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:41:17.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d4f05640 1 -- 172.21.15.22:0/2476331288 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb9b80b3d40 msgr2=0x7fb9b80b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:17.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d4f05640 1 --2- 172.21.15.22:0/2476331288 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb9b80b3d40 0x7fb9b80b6200 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x562c976fe6d0 tx=0x7fb9c0005f90 comp rx=0 tx=0).stop 2024-08-20T01:41:17.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d4f05640 1 -- 172.21.15.22:0/2476331288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d0108320 msgr2=0x7fb9d010c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:17.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d4f05640 1 --2- 172.21.15.22:0/2476331288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d0108320 0x7fb9d010c410 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb9c400e740 tx=0x7fb9c400ec00 comp rx=0 tx=0).stop 2024-08-20T01:41:17.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d4f05640 1 -- 172.21.15.22:0/2476331288 shutdown_connections 2024-08-20T01:41:17.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d4f05640 1 --2- 172.21.15.22:0/2476331288 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb9b80b3d40 0x7fb9b80b6200 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d4f05640 1 --2- 172.21.15.22:0/2476331288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9d0108ca0 0x7fb9d01aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d4f05640 1 --2- 172.21.15.22:0/2476331288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d0108320 0x7fb9d010c410 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d4f05640 1 --2- 172.21.15.22:0/2476331288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9d0100990 0x7fb9d010bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.454+0000 7fb9d4f05640 1 -- 172.21.15.22:0/2476331288 >> 172.21.15.22:0/2476331288 conn(0x7fb9d00fc5c0 msgr2=0x7fb9d0103c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:17.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.455+0000 7fb9d4f05640 1 -- 172.21.15.22:0/2476331288 shutdown_connections 2024-08-20T01:41:17.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:17.455+0000 7fb9d4f05640 1 -- 172.21.15.22:0/2476331288 wait complete. 2024-08-20T01:41:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.694+0000 7f9266ffd640 1 -- 172.21.15.22:0/3891636844 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f927c032ce0 con 0x559439212500 2024-08-20T01:41:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.694+0000 7f9266ffd640 10 client.26801 handle_command_reply: tid=0 2024-08-20T01:41:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.694+0000 7f929086c740 1 client.26801 shutdown 2024-08-20T01:41:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.694+0000 7f929086c740 1 -- 172.21.15.22:0/3891636844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918ec40 msgr2=0x5594392101c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.694+0000 7f929086c740 1 --2- 172.21.15.22:0/3891636844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918ec40 0x5594392101c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f92800e1f30 tx=0x7f9280005650 comp rx=0 tx=0).stop 2024-08-20T01:41:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.694+0000 7f929086c740 1 -- 172.21.15.22:0/3891636844 shutdown_connections 2024-08-20T01:41:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.694+0000 7f929086c740 1 --2- 172.21.15.22:0/3891636844 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x559439212500 0x559439214920 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.694+0000 7f929086c740 1 --2- 172.21.15.22:0/3891636844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55943918ec40 0x5594392101c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.694+0000 7f929086c740 1 --2- 172.21.15.22:0/3891636844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55943918c200 0x55943919a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.694+0000 7f929086c740 1 --2- 172.21.15.22:0/3891636844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594391898d0 0x55943919a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.694+0000 7f9266ffd640 0 client.26801 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.694+0000 7f929086c740 1 -- 172.21.15.22:0/3891636844 >> 172.21.15.22:0/3891636844 conn(0x559439184a20 msgr2=0x5594391832c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.694+0000 7f929086c740 1 -- 172.21.15.22:0/3891636844 shutdown_connections 2024-08-20T01:41:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.694+0000 7f929086c740 1 -- 172.21.15.22:0/3891636844 wait complete. 2024-08-20T01:41:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.694+0000 7f929086c740 20 client.26801 trim_cache size 0 max 16384 2024-08-20T01:41:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:41:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:41:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:41:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:41:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.695+0000 7f928da77640 1 -- 172.21.15.22:0/4009432766 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f92700b3c50 msgr2=0x7f92700b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.695+0000 7f928da77640 1 --2- 172.21.15.22:0/4009432766 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f92700b3c50 0x7f92700b6110 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f927c005ec0 tx=0x7f927c0314a0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.695+0000 7f928da77640 1 -- 172.21.15.22:0/4009432766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f928810a640 msgr2=0x7f92881a47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.695+0000 7f928da77640 1 --2- 172.21.15.22:0/4009432766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f928810a640 0x7f92881a47a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f928000eb10 tx=0x7f928000c2d0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.695+0000 7f928da77640 1 -- 172.21.15.22:0/4009432766 shutdown_connections 2024-08-20T01:41:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.695+0000 7f928da77640 1 --2- 172.21.15.22:0/4009432766 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f92700b3c50 0x7f92700b6110 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.695+0000 7f928da77640 1 --2- 172.21.15.22:0/4009432766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f928810a640 0x7f92881a47a0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.695+0000 7f928da77640 1 --2- 172.21.15.22:0/4009432766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9288074b00 0x7f92881a3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.695+0000 7f928da77640 1 --2- 172.21.15.22:0/4009432766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9288074170 0x7f92881a3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:17.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.695+0000 7f928da77640 1 -- 172.21.15.22:0/4009432766 >> 172.21.15.22:0/4009432766 conn(0x7f928806f740 msgr2=0x7f9288071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:17.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.695+0000 7f928da77640 1 -- 172.21.15.22:0/4009432766 shutdown_connections 2024-08-20T01:41:17.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:17.695+0000 7f928da77640 1 -- 172.21.15.22:0/4009432766 wait complete. 2024-08-20T01:41:18.244 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:17 smithi022 ceph-mon[18709]: scrub queued for path: / 2024-08-20T01:41:18.244 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:17 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:18.245 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:17 smithi022 ceph-mon[18709]: scrub summary: active paths [/] 2024-08-20T01:41:18.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:17 smithi134 ceph-mon[22511]: scrub queued for path: / 2024-08-20T01:41:18.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:17 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:18.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:17 smithi134 ceph-mon[22511]: scrub summary: active paths [/] 2024-08-20T01:41:18.267 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:41:17 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f[56575]: ignoring --setuser ceph since I am not root 2024-08-20T01:41:18.267 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:41:17 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f[56575]: ignoring --setgroup ceph since I am not root 2024-08-20T01:41:18.267 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:41:17 smithi134 ceph-mds[56579]: -- 172.21.15.134:0/3748547653 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562a9943b860 con 0x562a99419400 2024-08-20T01:41:18.267 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:41:17 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f[56575]: starting mds.f at 2024-08-20T01:41:18.274 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:41:18.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:17 smithi077 ceph-mon[22251]: scrub queued for path: / 2024-08-20T01:41:18.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:17 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:18.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:17 smithi077 ceph-mon[22251]: scrub summary: active paths [/] 2024-08-20T01:41:18.581 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:18.982 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:18 smithi022 ceph-mon[18709]: pgmap v652: 97 pgs: 97 active+clean; 690 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 475 op/s 2024-08-20T01:41:18.982 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:18 smithi022 ceph-mon[18709]: daemon mds.f restarted 2024-08-20T01:41:19.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.065+0000 7f52bba6f640 1 -- 172.21.15.22:0/665546308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b41017d0 msgr2=0x7f52b4101bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:19.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.065+0000 7f52bba6f640 1 --2- 172.21.15.22:0/665546308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b41017d0 0x7f52b4101bb0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009ca0 tx=0x7f52a402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.065+0000 7f52bba6f640 1 -- 172.21.15.22:0/665546308 shutdown_connections 2024-08-20T01:41:19.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.065+0000 7f52bba6f640 1 --2- 172.21.15.22:0/665546308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52b4106c10 0x7f52b4107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.065+0000 7f52bba6f640 1 --2- 172.21.15.22:0/665546308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52b41020f0 0x7f52b41065c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.065+0000 7f52bba6f640 1 --2- 172.21.15.22:0/665546308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b41017d0 0x7f52b4101bb0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.065+0000 7f52bba6f640 1 -- 172.21.15.22:0/665546308 >> 172.21.15.22:0/665546308 conn(0x7f52b40fd440 msgr2=0x7f52b40ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.065+0000 7f52bba6f640 1 -- 172.21.15.22:0/665546308 shutdown_connections 2024-08-20T01:41:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.065+0000 7f52bba6f640 1 -- 172.21.15.22:0/665546308 wait complete. 2024-08-20T01:41:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.066+0000 7f52bba6f640 1 Processor -- start 2024-08-20T01:41:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.066+0000 7f52bba6f640 1 -- start start 2024-08-20T01:41:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.066+0000 7f52bba6f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b41017d0 0x7f52b419f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.066+0000 7f52bba6f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52b41020f0 0x7f52b419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.066+0000 7f52bba6f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52b4106c10 0x7f52b41a4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.066+0000 7f52bba6f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f52b41190a0 con 0x7f52b41017d0 2024-08-20T01:41:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.066+0000 7f52bba6f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52b4118f20 con 0x7f52b41020f0 2024-08-20T01:41:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.066+0000 7f52bba6f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52b4119220 con 0x7f52b4106c10 2024-08-20T01:41:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.066+0000 7f52b980b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b41017d0 0x7f52b419f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.066+0000 7f52b980b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b41017d0 0x7f52b419f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46062/0 (socket says 172.21.15.22:46062) 2024-08-20T01:41:19.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.066+0000 7f52b980b640 1 -- 172.21.15.22:0/1961898781 learned_addr learned my addr 172.21.15.22:0/1961898781 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:19.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.066+0000 7f52ba00c640 1 --2- 172.21.15.22:0/1961898781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52b4106c10 0x7f52b41a4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:19.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.066+0000 7f52b900a640 1 --2- 172.21.15.22:0/1961898781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52b41020f0 0x7f52b419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:19.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.067+0000 7f52b980b640 1 -- 172.21.15.22:0/1961898781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52b4106c10 msgr2=0x7f52b41a4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:19.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.067+0000 7f52b980b640 1 --2- 172.21.15.22:0/1961898781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52b4106c10 0x7f52b41a4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.067+0000 7f52b980b640 1 -- 172.21.15.22:0/1961898781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52b41020f0 msgr2=0x7f52b419fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:19.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.067+0000 7f52b980b640 1 --2- 172.21.15.22:0/1961898781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52b41020f0 0x7f52b419fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.067+0000 7f52b980b640 1 -- 172.21.15.22:0/1961898781 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b41a56c0 con 0x7f52b41017d0 2024-08-20T01:41:19.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.067+0000 7f52ba00c640 1 --2- 172.21.15.22:0/1961898781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52b4106c10 0x7f52b41a4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:19.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.067+0000 7f52b900a640 1 --2- 172.21.15.22:0/1961898781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52b41020f0 0x7f52b419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:19.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.067+0000 7f52b980b640 1 --2- 172.21.15.22:0/1961898781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b41017d0 0x7f52b419f610 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f52a4033040 tx=0x7f52a40316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:19.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.067+0000 7f52b2ffd640 1 -- 172.21.15.22:0/1961898781 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a4003b70 con 0x7f52b41017d0 2024-08-20T01:41:19.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.067+0000 7f52b2ffd640 1 -- 172.21.15.22:0/1961898781 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52a4003d10 con 0x7f52b41017d0 2024-08-20T01:41:19.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.067+0000 7f52bba6f640 1 -- 172.21.15.22:0/1961898781 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b41a5950 con 0x7f52b41017d0 2024-08-20T01:41:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.067+0000 7f52b2ffd640 1 -- 172.21.15.22:0/1961898781 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a402f9e0 con 0x7f52b41017d0 2024-08-20T01:41:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.067+0000 7f52bba6f640 1 -- 172.21.15.22:0/1961898781 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b41ac070 con 0x7f52b41017d0 2024-08-20T01:41:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.070+0000 7f52b2ffd640 1 -- 172.21.15.22:0/1961898781 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f52a402fb80 con 0x7f52b41017d0 2024-08-20T01:41:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.070+0000 7f52bde68740 1 Processor -- start 2024-08-20T01:41:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.070+0000 7f52bde68740 1 -- start start 2024-08-20T01:41:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.070+0000 7f52bde68740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702a6830 0x55cc702a6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.070+0000 7f52bde68740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a7150 0x55cc702b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.070+0000 7f52bde68740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702b30e0 0x55cc702b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.070+0000 7f52bde68740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cc7021d8e0 con 0x55cc702a7150 2024-08-20T01:41:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.070+0000 7f52bde68740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cc7020cde0 con 0x55cc702b30e0 2024-08-20T01:41:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.070+0000 7f52bde68740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cc70210e20 con 0x55cc702a6830 2024-08-20T01:41:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.071+0000 7f52ba00c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702a6830 0x55cc702a6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:19.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.071+0000 7f52b980b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a7150 0x55cc702b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:19.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.071+0000 7f52ba00c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702a6830 0x55cc702a6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:46858/0 (socket says 172.21.15.22:46858) 2024-08-20T01:41:19.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.071+0000 7f52ba00c640 1 -- 172.21.15.22:0/4132797973 learned_addr learned my addr 172.21.15.22:0/4132797973 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:19.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.071+0000 7f52b900a640 1 --2- 172.21.15.22:0/4132797973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702b30e0 0x55cc702b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:19.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.071+0000 7f52ba00c640 1 -- 172.21.15.22:0/4132797973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702b30e0 msgr2=0x55cc702b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:19.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.071+0000 7f52ba00c640 1 --2- 172.21.15.22:0/4132797973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702b30e0 0x55cc702b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.071+0000 7f52ba00c640 1 -- 172.21.15.22:0/4132797973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a7150 msgr2=0x55cc702b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:19.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.071+0000 7f52ba00c640 1 --2- 172.21.15.22:0/4132797973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a7150 0x55cc702b2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.071+0000 7f52b2ffd640 1 --2- 172.21.15.22:0/1961898781 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f529c0b3bd0 0x7f529c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:19.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.071+0000 7f52ba00c640 1 -- 172.21.15.22:0/4132797973 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc6ff6c650 con 0x55cc702a6830 2024-08-20T01:41:19.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.071+0000 7f52b900a640 1 --2- 172.21.15.22:0/4132797973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702b30e0 0x55cc702b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:19.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.071+0000 7f52b900a640 1 --2- 172.21.15.22:0/1961898781 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f529c0b3bd0 0x7f529c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:19.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.071+0000 7f52ba00c640 1 --2- 172.21.15.22:0/4132797973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702a6830 0x55cc702a6c10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f52ac011570 tx=0x7f52ac011a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d07dcf21255f28e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:19.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.071+0000 7f52b2ffd640 1 -- 172.21.15.22:0/1961898781 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f52a41051d0 con 0x7f52b41017d0 2024-08-20T01:41:19.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.071+0000 7f529bfff640 1 -- 172.21.15.22:0/4132797973 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac01e070 con 0x55cc702a6830 2024-08-20T01:41:19.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.072+0000 7f529bfff640 1 -- 172.21.15.22:0/4132797973 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52ac00fa70 con 0x55cc702a6830 2024-08-20T01:41:19.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.072+0000 7f529bfff640 1 -- 172.21.15.22:0/4132797973 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac019a70 con 0x55cc702a6830 2024-08-20T01:41:19.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.072+0000 7f52bde68740 1 -- 172.21.15.22:0/4132797973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702a6830 msgr2=0x55cc702a6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:19.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.072+0000 7f52b900a640 1 --2- 172.21.15.22:0/1961898781 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f529c0b3bd0 0x7f529c0b6090 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x55cc702a67e0 tx=0x7f52a8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:19.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.072+0000 7f52bde68740 1 --2- 172.21.15.22:0/4132797973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702a6830 0x55cc702a6c10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f52ac011570 tx=0x7f52ac011a30 comp rx=0 tx=0).stop 2024-08-20T01:41:19.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.072+0000 7f52bde68740 1 -- 172.21.15.22:0/4132797973 shutdown_connections 2024-08-20T01:41:19.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.072+0000 7f52bde68740 1 --2- 172.21.15.22:0/4132797973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702b30e0 0x55cc702b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.072+0000 7f52bde68740 1 --2- 172.21.15.22:0/4132797973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a7150 0x55cc702b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.072+0000 7f52bde68740 1 --2- 172.21.15.22:0/4132797973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702a6830 0x55cc702a6c10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.072+0000 7f52bde68740 1 -- 172.21.15.22:0/4132797973 >> 172.21.15.22:0/4132797973 conn(0x55cc702a4660 msgr2=0x55cc702a5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:19.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.073+0000 7f52bde68740 1 -- 172.21.15.22:0/4132797973 shutdown_connections 2024-08-20T01:41:19.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.073+0000 7f52bde68740 1 -- 172.21.15.22:0/4132797973 wait complete. 2024-08-20T01:41:19.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.073+0000 7f52bde68740 1 -- start start 2024-08-20T01:41:19.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.073+0000 7f52bde68740 1 Processor -- start 2024-08-20T01:41:19.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52bde68740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702a6830 0x55cc702b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:19.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52bde68740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a7150 0x55cc702b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:19.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52bde68740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702b30e0 0x55cc702b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:19.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52bde68740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cc7006f700 con 0x55cc702a7150 2024-08-20T01:41:19.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52bde68740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cc701937c0 con 0x55cc702a6830 2024-08-20T01:41:19.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52bde68740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cc702b5d90 con 0x55cc702b30e0 2024-08-20T01:41:19.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52bde68740 10 client.0 _ll_register_callbacks cb 0x55cc702066b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:19.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52b980b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702a6830 0x55cc702b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:19.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52b980b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702a6830 0x55cc702b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:40012/0 (socket says 172.21.15.22:40012) 2024-08-20T01:41:19.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52ba00c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702b30e0 0x55cc702b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:19.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52b980b640 1 -- 172.21.15.22:0/3626733245 learned_addr learned my addr 172.21.15.22:0/3626733245 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:19.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52b900a640 1 --2- 172.21.15.22:0/3626733245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a7150 0x55cc702b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:19.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52b980b640 1 -- 172.21.15.22:0/3626733245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702b30e0 msgr2=0x55cc702b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:19.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52b980b640 1 --2- 172.21.15.22:0/3626733245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702b30e0 0x55cc702b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52b980b640 1 -- 172.21.15.22:0/3626733245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a7150 msgr2=0x55cc702b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:19.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52b980b640 1 --2- 172.21.15.22:0/3626733245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a7150 0x55cc702b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52b980b640 1 -- 172.21.15.22:0/3626733245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc702bf170 con 0x55cc702a6830 2024-08-20T01:41:19.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52b900a640 1 --2- 172.21.15.22:0/3626733245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a7150 0x55cc702b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:19.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52b980b640 1 --2- 172.21.15.22:0/3626733245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702a6830 0x55cc702b0070 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f52a4004af0 tx=0x7f52a41088a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc008d2fa06b2de9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:19.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.074+0000 7f52997fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:41:19.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.075+0000 7f52997fa640 1 -- 172.21.15.22:0/3626733245 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a40cb850 con 0x55cc702a6830 2024-08-20T01:41:19.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.075+0000 7f52bde68740 1 -- 172.21.15.22:0/3626733245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cc701bc100 con 0x55cc702a6830 2024-08-20T01:41:19.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.075+0000 7f52997fa640 1 -- 172.21.15.22:0/3626733245 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f52a40c86d0 con 0x55cc702a6830 2024-08-20T01:41:19.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.075+0000 7f52997fa640 1 -- 172.21.15.22:0/3626733245 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f52a4108e60 con 0x55cc702a6830 2024-08-20T01:41:19.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.075+0000 7f52bde68740 10 client.26834 fetch_fsmap learned FSMap version 34 2024-08-20T01:41:19.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.075+0000 7f52bde68740 1 -- 172.21.15.22:0/3626733245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55cc702c1b20 con 0x55cc702a6830 2024-08-20T01:41:19.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.075+0000 7f52997fa640 1 -- 172.21.15.22:0/3626733245 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55cc701bc100 con 0x55cc702a6830 2024-08-20T01:41:19.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.075+0000 7f52997fa640 1 -- 172.21.15.22:0/3626733245 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f52a40d4d00 con 0x55cc702a6830 2024-08-20T01:41:19.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.075+0000 7f52bde68740 10 client.26834 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:41:19.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.075+0000 7f52bde68740 10 client.26834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:19.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.075+0000 7f52bde68740 20 client.26834 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:19.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.075+0000 7f52bde68740 1 --2- 172.21.15.22:0/3626733245 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55cc702c2f80 0x55cc702c5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:19.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.075+0000 7f52bde68740 4 client.26834 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:19.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.075+0000 7f52bde68740 1 -- 172.21.15.22:0/3626733245 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc7021f830 con 0x55cc702c2f80 2024-08-20T01:41:19.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.075+0000 7f52b900a640 1 --2- 172.21.15.22:0/3626733245 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55cc702c2f80 0x55cc702c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:19.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.076+0000 7f52997fa640 10 client.26834 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:19.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.076+0000 7f52b900a640 1 --2- 172.21.15.22:0/3626733245 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55cc702c2f80 0x55cc702c5400 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91c51281fb7240a5 server_cookie=7dadce3dc4c92115 in_seq=0 out_seq=0 2024-08-20T01:41:19.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.078+0000 7f52997fa640 1 -- 172.21.15.22:0/3626733245 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc7021f830 con 0x55cc702c2f80 2024-08-20T01:41:19.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.078+0000 7f52997fa640 10 client.26834 handle_command_reply: tid=0 2024-08-20T01:41:19.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.078+0000 7f52bde68740 1 client.26834 shutdown 2024-08-20T01:41:19.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.078+0000 7f52bde68740 1 -- 172.21.15.22:0/3626733245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702a6830 msgr2=0x55cc702b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:19.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.078+0000 7f52bde68740 1 --2- 172.21.15.22:0/3626733245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702a6830 0x55cc702b0070 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f52a4004af0 tx=0x7f52a41088a0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.078+0000 7f52bde68740 1 -- 172.21.15.22:0/3626733245 shutdown_connections 2024-08-20T01:41:19.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.078+0000 7f52bde68740 1 --2- 172.21.15.22:0/3626733245 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55cc702c2f80 0x55cc702c5400 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.078+0000 7f52bde68740 1 --2- 172.21.15.22:0/3626733245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702b30e0 0x55cc702b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.078+0000 7f52bde68740 1 --2- 172.21.15.22:0/3626733245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a7150 0x55cc702b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.078+0000 7f52997fa640 0 client.26834 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:19.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.078+0000 7f52bde68740 1 --2- 172.21.15.22:0/3626733245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702a6830 0x55cc702b0070 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.078+0000 7f52bde68740 1 -- 172.21.15.22:0/3626733245 >> 172.21.15.22:0/3626733245 conn(0x55cc702a4660 msgr2=0x55cc702aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:19.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.079+0000 7f52bde68740 1 -- 172.21.15.22:0/3626733245 shutdown_connections 2024-08-20T01:41:19.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.079+0000 7f52bde68740 1 -- 172.21.15.22:0/3626733245 wait complete. 2024-08-20T01:41:19.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.079+0000 7f52bde68740 20 client.26834 trim_cache size 0 max 16384 2024-08-20T01:41:19.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.096+0000 7f52bde68740 1 Processor -- start 2024-08-20T01:41:19.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.096+0000 7f52bde68740 1 -- start start 2024-08-20T01:41:19.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.096+0000 7f52bde68740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a6830 0x55cc702b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:19.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.096+0000 7f52bde68740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702a7150 0x55cc702b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:19.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.096+0000 7f52bde68740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702b30e0 0x55cc702cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:19.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.096+0000 7f52bde68740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f52b41b71d0 con 0x55cc702a6830 2024-08-20T01:41:19.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.096+0000 7f52bde68740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52b41b49e0 con 0x55cc702a7150 2024-08-20T01:41:19.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.096+0000 7f52bde68740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52b41b2830 con 0x55cc702b30e0 2024-08-20T01:41:19.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.097+0000 7f52b980b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a6830 0x55cc702b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:19.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.097+0000 7f52b980b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a6830 0x55cc702b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46086/0 (socket says 172.21.15.22:46086) 2024-08-20T01:41:19.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.097+0000 7f52b980b640 1 -- 172.21.15.22:0/3818254537 learned_addr learned my addr 172.21.15.22:0/3818254537 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:19.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.097+0000 7f52b900a640 1 --2- 172.21.15.22:0/3818254537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702a7150 0x55cc702b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:19.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.097+0000 7f52ba00c640 1 --2- 172.21.15.22:0/3818254537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702b30e0 0x55cc702cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:19.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.097+0000 7f52b980b640 1 -- 172.21.15.22:0/3818254537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702b30e0 msgr2=0x55cc702cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:19.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.097+0000 7f52b980b640 1 --2- 172.21.15.22:0/3818254537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702b30e0 0x55cc702cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.097+0000 7f52b980b640 1 -- 172.21.15.22:0/3818254537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702a7150 msgr2=0x55cc702b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:19.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.097+0000 7f52b980b640 1 --2- 172.21.15.22:0/3818254537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702a7150 0x55cc702b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.097+0000 7f52b980b640 1 -- 172.21.15.22:0/3818254537 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc702a6f80 con 0x55cc702a6830 2024-08-20T01:41:19.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.097+0000 7f52b900a640 1 --2- 172.21.15.22:0/3818254537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702a7150 0x55cc702b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:19.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.097+0000 7f52b980b640 1 --2- 172.21.15.22:0/3818254537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a6830 0x55cc702b0570 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009430 tx=0x7f52a40095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a7b41ac9a74b6d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:19.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.097+0000 7f529b7fe640 1 -- 172.21.15.22:0/3818254537 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a40cb850 con 0x55cc702a6830 2024-08-20T01:41:19.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.097+0000 7f529b7fe640 1 -- 172.21.15.22:0/3818254537 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52a4036060 con 0x55cc702a6830 2024-08-20T01:41:19.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.097+0000 7f529b7fe640 1 -- 172.21.15.22:0/3818254537 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a40cbeb0 con 0x55cc702a6830 2024-08-20T01:41:19.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.098+0000 7f52bde68740 1 -- 172.21.15.22:0/3818254537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a6830 msgr2=0x55cc702b0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:19.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.098+0000 7f52bde68740 1 --2- 172.21.15.22:0/3818254537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a6830 0x55cc702b0570 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009430 tx=0x7f52a40095c0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.098+0000 7f52bde68740 1 -- 172.21.15.22:0/3818254537 shutdown_connections 2024-08-20T01:41:19.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.098+0000 7f52bde68740 1 --2- 172.21.15.22:0/3818254537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702b30e0 0x55cc702cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.098+0000 7f52bde68740 1 --2- 172.21.15.22:0/3818254537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702a7150 0x55cc702b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.098+0000 7f52bde68740 1 --2- 172.21.15.22:0/3818254537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a6830 0x55cc702b0570 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.098+0000 7f52bde68740 1 -- 172.21.15.22:0/3818254537 >> 172.21.15.22:0/3818254537 conn(0x55cc702a4660 msgr2=0x55cc702ae8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:19.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.098+0000 7f52bde68740 1 -- 172.21.15.22:0/3818254537 shutdown_connections 2024-08-20T01:41:19.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.098+0000 7f52bde68740 1 -- 172.21.15.22:0/3818254537 wait complete. 2024-08-20T01:41:19.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.098+0000 7f52bde68740 1 -- start start 2024-08-20T01:41:19.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.099+0000 7f52bde68740 1 Processor -- start 2024-08-20T01:41:19.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.099+0000 7f52bde68740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702a6830 0x55cc702b6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:19.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.099+0000 7f52bde68740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a7150 0x55cc702b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:19.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.099+0000 7f52bde68740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702b30e0 0x55cc7032bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:19.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.099+0000 7f52bde68740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f52b41b2ea0 con 0x55cc702a7150 2024-08-20T01:41:19.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.099+0000 7f52bde68740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52b41b4310 con 0x55cc702b30e0 2024-08-20T01:41:19.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.099+0000 7f52bde68740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52b41b3570 con 0x55cc702a6830 2024-08-20T01:41:19.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.099+0000 7f52bde68740 10 client.0 _ll_register_callbacks cb 0x7f52a41089a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:19.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.099+0000 7f52b900a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a7150 0x55cc702b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:19.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.099+0000 7f52b980b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702a6830 0x55cc702b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:19.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.099+0000 7f52b900a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a7150 0x55cc702b6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46096/0 (socket says 172.21.15.22:46096) 2024-08-20T01:41:19.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.099+0000 7f52b900a640 1 -- 172.21.15.22:0/732021072 learned_addr learned my addr 172.21.15.22:0/732021072 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:19.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.099+0000 7f52ba00c640 1 --2- 172.21.15.22:0/732021072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702b30e0 0x55cc7032bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:19.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.099+0000 7f52b900a640 1 -- 172.21.15.22:0/732021072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702a6830 msgr2=0x55cc702b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:19.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.099+0000 7f52b900a640 1 --2- 172.21.15.22:0/732021072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702a6830 0x55cc702b6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.099+0000 7f52b900a640 1 -- 172.21.15.22:0/732021072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702b30e0 msgr2=0x55cc7032bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:19.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.099+0000 7f52b900a640 1 --2- 172.21.15.22:0/732021072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702b30e0 0x55cc7032bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.100+0000 7f52b900a640 1 -- 172.21.15.22:0/732021072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc7032c290 con 0x55cc702a7150 2024-08-20T01:41:19.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.100+0000 7f52ba00c640 1 --2- 172.21.15.22:0/732021072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702b30e0 0x55cc7032bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:19.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.100+0000 7f52b980b640 1 --2- 172.21.15.22:0/732021072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702a6830 0x55cc702b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:19.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.100+0000 7f52b900a640 1 --2- 172.21.15.22:0/732021072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a7150 0x55cc702b6d40 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f52b4100880 tx=0x7f52a800fa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace26ffc58c55304 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:19.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.100+0000 7f52997fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:19.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.100+0000 7f52997fa640 1 -- 172.21.15.22:0/732021072 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a802a490 con 0x55cc702a7150 2024-08-20T01:41:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.100+0000 7f52bde68740 1 -- 172.21.15.22:0/732021072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52a4036060 con 0x55cc702a7150 2024-08-20T01:41:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.100+0000 7f52997fa640 1 -- 172.21.15.22:0/732021072 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f52a802a630 con 0x55cc702a7150 2024-08-20T01:41:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.100+0000 7f52997fa640 1 -- 172.21.15.22:0/732021072 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f52a802a830 con 0x55cc702a7150 2024-08-20T01:41:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.100+0000 7f52bde68740 10 client.17247 fetch_fsmap learned FSMap version 34 2024-08-20T01:41:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.100+0000 7f52bde68740 1 -- 172.21.15.22:0/732021072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55cc7032d680 con 0x55cc702a7150 2024-08-20T01:41:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.101+0000 7f52997fa640 1 -- 172.21.15.22:0/732021072 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52a4036060 con 0x55cc702a7150 2024-08-20T01:41:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.101+0000 7f52997fa640 1 -- 172.21.15.22:0/732021072 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f52a801fbe0 con 0x55cc702a7150 2024-08-20T01:41:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.101+0000 7f52bde68740 10 client.17247 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:41:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.101+0000 7f52bde68740 10 client.17247 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.101+0000 7f52bde68740 20 client.17247 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.101+0000 7f52bde68740 1 --2- 172.21.15.22:0/732021072 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55cc702c2f80 0x55cc7032fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.101+0000 7f52bde68740 4 client.17247 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:41:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.101+0000 7f52bde68740 1 -- 172.21.15.22:0/732021072 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cc7021b2d0 con 0x55cc702c2f80 2024-08-20T01:41:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.101+0000 7f52b980b640 1 --2- 172.21.15.22:0/732021072 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55cc702c2f80 0x55cc7032fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:19.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.102+0000 7f52997fa640 10 client.17247 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:19.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.102+0000 7f52b980b640 1 --2- 172.21.15.22:0/732021072 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55cc702c2f80 0x55cc7032fe60 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19b80bbc9d3577ab server_cookie=f0007e83a0e5a4d4 in_seq=0 out_seq=0 2024-08-20T01:41:19.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.103+0000 7f52997fa640 1 -- 172.21.15.22:0/732021072 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x55cc7021b2d0 con 0x55cc702c2f80 2024-08-20T01:41:19.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.103+0000 7f52997fa640 10 client.17247 handle_command_reply: tid=0 2024-08-20T01:41:19.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.103+0000 7f52bde68740 1 client.17247 shutdown 2024-08-20T01:41:19.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.104+0000 7f52bde68740 1 -- 172.21.15.22:0/732021072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a7150 msgr2=0x55cc702b6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:19.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.104+0000 7f52bde68740 1 --2- 172.21.15.22:0/732021072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a7150 0x55cc702b6d40 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f52b4100880 tx=0x7f52a800fa50 comp rx=0 tx=0).stop 2024-08-20T01:41:19.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.104+0000 7f52bde68740 1 -- 172.21.15.22:0/732021072 shutdown_connections 2024-08-20T01:41:19.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.104+0000 7f52bde68740 1 --2- 172.21.15.22:0/732021072 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55cc702c2f80 0x55cc7032fe60 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.104+0000 7f52bde68740 1 --2- 172.21.15.22:0/732021072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc702b30e0 0x55cc7032bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.104+0000 7f52bde68740 1 --2- 172.21.15.22:0/732021072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc702a7150 0x55cc702b6d40 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.104+0000 7f52bde68740 1 --2- 172.21.15.22:0/732021072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc702a6830 0x55cc702b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.104+0000 7f52997fa640 0 client.17247 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:19.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.104+0000 7f52bde68740 1 -- 172.21.15.22:0/732021072 >> 172.21.15.22:0/732021072 conn(0x55cc702a4660 msgr2=0x55cc702b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:19.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.104+0000 7f52bde68740 1 -- 172.21.15.22:0/732021072 shutdown_connections 2024-08-20T01:41:19.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.104+0000 7f52bde68740 1 -- 172.21.15.22:0/732021072 wait complete. 2024-08-20T01:41:19.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.104+0000 7f52bde68740 20 client.17247 trim_cache size 0 max 16384 2024-08-20T01:41:19.110 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:41:19.110 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "scrub active (7489 inodes in the stack)", 2024-08-20T01:41:19.110 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-08-20T01:41:19.110 INFO:teuthology.orchestra.run.smithi022.stdout: "6c7e449c-071e-4fb7-9ff4-553015b09fa4": { 2024-08-20T01:41:19.110 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-08-20T01:41:19.110 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "6c7e449c-071e-4fb7-9ff4-553015b09fa4", 2024-08-20T01:41:19.110 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-08-20T01:41:19.110 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:19.110 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:19.111 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:41:19.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.105+0000 7f52bba6f640 1 -- 172.21.15.22:0/1961898781 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f529c0b3bd0 msgr2=0x7f529c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:19.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.105+0000 7f52bba6f640 1 --2- 172.21.15.22:0/1961898781 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f529c0b3bd0 0x7f529c0b6090 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x55cc702a67e0 tx=0x7f52a8005f90 comp rx=0 tx=0).stop 2024-08-20T01:41:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.105+0000 7f52bba6f640 1 -- 172.21.15.22:0/1961898781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b41017d0 msgr2=0x7f52b419f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.105+0000 7f52bba6f640 1 --2- 172.21.15.22:0/1961898781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b41017d0 0x7f52b419f610 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f52a4033040 tx=0x7f52a40316f0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.105+0000 7f52bba6f640 1 -- 172.21.15.22:0/1961898781 shutdown_connections 2024-08-20T01:41:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.105+0000 7f52bba6f640 1 --2- 172.21.15.22:0/1961898781 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f529c0b3bd0 0x7f529c0b6090 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.105+0000 7f52bba6f640 1 --2- 172.21.15.22:0/1961898781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52b4106c10 0x7f52b41a4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.105+0000 7f52bba6f640 1 --2- 172.21.15.22:0/1961898781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52b41020f0 0x7f52b419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.105+0000 7f52bba6f640 1 --2- 172.21.15.22:0/1961898781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b41017d0 0x7f52b419f610 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.105+0000 7f52bba6f640 1 -- 172.21.15.22:0/1961898781 >> 172.21.15.22:0/1961898781 conn(0x7f52b40fd440 msgr2=0x7f52b4104590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.105+0000 7f52bba6f640 1 -- 172.21.15.22:0/1961898781 shutdown_connections 2024-08-20T01:41:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:19.105+0000 7f52bba6f640 1 -- 172.21.15.22:0/1961898781 wait complete. 2024-08-20T01:41:19.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:18 smithi134 ceph-mon[22511]: pgmap v652: 97 pgs: 97 active+clean; 690 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 475 op/s 2024-08-20T01:41:19.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:18 smithi134 ceph-mon[22511]: daemon mds.f restarted 2024-08-20T01:41:19.318 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:18 smithi077 ceph-mon[22251]: pgmap v652: 97 pgs: 97 active+clean; 690 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 475 op/s 2024-08-20T01:41:19.318 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:18 smithi077 ceph-mon[22251]: daemon mds.f restarted 2024-08-20T01:41:19.810 INFO:tasks.cephfs.filesystem:scrub status for tag:6c7e449c-071e-4fb7-9ff4-553015b09fa4 - {'path': '/', 'tag': '6c7e449c-071e-4fb7-9ff4-553015b09fa4', 'options': 'recursive,force'} 2024-08-20T01:41:20.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:19 smithi022 ceph-mon[18709]: osdmap e81: 12 total, 12 up, 12 in 2024-08-20T01:41:20.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:19 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.134:6834/2284188249,v1:172.21.15.134:6835/2284188249] up:boot 2024-08-20T01:41:20.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:19 smithi022 ceph-mon[18709]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-08-20T01:41:20.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:19 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T01:41:20.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:19 smithi022 ceph-mon[18709]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:41:20.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:19 smithi134 ceph-mon[22511]: osdmap e81: 12 total, 12 up, 12 in 2024-08-20T01:41:20.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:19 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.134:6834/2284188249,v1:172.21.15.134:6835/2284188249] up:boot 2024-08-20T01:41:20.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:19 smithi134 ceph-mon[22511]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-08-20T01:41:20.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:19 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T01:41:20.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:19 smithi134 ceph-mon[22511]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:41:20.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:19 smithi077 ceph-mon[22251]: osdmap e81: 12 total, 12 up, 12 in 2024-08-20T01:41:20.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:19 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.134:6834/2284188249,v1:172.21.15.134:6835/2284188249] up:boot 2024-08-20T01:41:20.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:19 smithi077 ceph-mon[22251]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-08-20T01:41:20.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:19 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T01:41:20.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:19 smithi077 ceph-mon[22251]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-20T01:41:21.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:20 smithi134 ceph-mon[22511]: pgmap v654: 97 pgs: 97 active+clean; 679 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 504 op/s 2024-08-20T01:41:21.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:20 smithi077 ceph-mon[22251]: pgmap v654: 97 pgs: 97 active+clean; 679 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 504 op/s 2024-08-20T01:41:21.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:20 smithi022 ceph-mon[18709]: pgmap v654: 97 pgs: 97 active+clean; 679 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 504 op/s 2024-08-20T01:41:23.189 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:22 smithi022 ceph-mon[18709]: pgmap v655: 97 pgs: 97 active+clean; 672 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 657 op/s 2024-08-20T01:41:23.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:22 smithi134 ceph-mon[22511]: pgmap v655: 97 pgs: 97 active+clean; 672 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 657 op/s 2024-08-20T01:41:23.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:22 smithi077 ceph-mon[22251]: pgmap v655: 97 pgs: 97 active+clean; 672 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 657 op/s 2024-08-20T01:41:25.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:24 smithi134 ceph-mon[22511]: pgmap v656: 97 pgs: 97 active+clean; 654 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 931 op/s 2024-08-20T01:41:25.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:24 smithi077 ceph-mon[22251]: pgmap v656: 97 pgs: 97 active+clean; 654 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 931 op/s 2024-08-20T01:41:25.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:24 smithi022 ceph-mon[18709]: pgmap v656: 97 pgs: 97 active+clean; 654 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 931 op/s 2024-08-20T01:41:26.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:25 smithi134 ceph-mon[22511]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:26.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:25 smithi077 ceph-mon[22251]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:26.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:25 smithi022 ceph-mon[18709]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:27.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:26 smithi134 ceph-mon[22511]: pgmap v657: 97 pgs: 97 active+clean; 649 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 1.02k op/s 2024-08-20T01:41:27.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:26 smithi077 ceph-mon[22251]: pgmap v657: 97 pgs: 97 active+clean; 649 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 1.02k op/s 2024-08-20T01:41:27.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:26 smithi022 ceph-mon[18709]: pgmap v657: 97 pgs: 97 active+clean; 649 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 1.02k op/s 2024-08-20T01:41:29.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:28 smithi134 ceph-mon[22511]: pgmap v658: 97 pgs: 97 active+clean; 632 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.5 MiB/s wr, 1.32k op/s 2024-08-20T01:41:29.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:28 smithi134 ceph-mon[22511]: scrub summary: idle 2024-08-20T01:41:29.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:28 smithi077 ceph-mon[22251]: pgmap v658: 97 pgs: 97 active+clean; 632 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.5 MiB/s wr, 1.32k op/s 2024-08-20T01:41:29.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:28 smithi077 ceph-mon[22251]: scrub summary: idle 2024-08-20T01:41:29.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:28 smithi022 ceph-mon[18709]: pgmap v658: 97 pgs: 97 active+clean; 632 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.5 MiB/s wr, 1.32k op/s 2024-08-20T01:41:29.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:28 smithi022 ceph-mon[18709]: scrub summary: idle 2024-08-20T01:41:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.795+0000 7f53c0388640 1 -- 172.21.15.22:0/1462922690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53b81026f0 msgr2=0x7f53b8102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.795+0000 7f53c0388640 1 --2- 172.21.15.22:0/1462922690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53b81026f0 0x7f53b8102b70 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009930 tx=0x7f53ac02a420 comp rx=0 tx=0).stop 2024-08-20T01:41:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.796+0000 7f53c0388640 1 -- 172.21.15.22:0/1462922690 shutdown_connections 2024-08-20T01:41:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.796+0000 7f53c0388640 1 --2- 172.21.15.22:0/1462922690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53b81030b0 0x7f53b8109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.796+0000 7f53c0388640 1 --2- 172.21.15.22:0/1462922690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53b81026f0 0x7f53b8102b70 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.796+0000 7f53c0388640 1 --2- 172.21.15.22:0/1462922690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53b81015a0 0x7f53b81019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.796+0000 7f53c0388640 1 -- 172.21.15.22:0/1462922690 >> 172.21.15.22:0/1462922690 conn(0x7f53b80fce60 msgr2=0x7f53b80ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.796+0000 7f53c0388640 1 -- 172.21.15.22:0/1462922690 shutdown_connections 2024-08-20T01:41:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.796+0000 7f53c0388640 1 -- 172.21.15.22:0/1462922690 wait complete. 2024-08-20T01:41:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.796+0000 7f53c0388640 1 Processor -- start 2024-08-20T01:41:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.796+0000 7f53c0388640 1 -- start start 2024-08-20T01:41:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.796+0000 7f53c0388640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53b81015a0 0x7f53b8197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.796+0000 7f53c0388640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53b81026f0 0x7f53b8198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53c0388640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53b81030b0 0x7f53b8198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53c0388640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f53b810d1f0 con 0x7f53b81026f0 2024-08-20T01:41:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53c0388640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f53b810d070 con 0x7f53b81015a0 2024-08-20T01:41:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53c0388640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f53b810d370 con 0x7f53b81030b0 2024-08-20T01:41:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53bd923640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53b81026f0 0x7f53b8198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53bd923640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53b81026f0 0x7f53b8198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32920/0 (socket says 172.21.15.22:32920) 2024-08-20T01:41:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53bd923640 1 -- 172.21.15.22:0/2603214411 learned_addr learned my addr 172.21.15.22:0/2603214411 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53be124640 1 --2- 172.21.15.22:0/2603214411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53b81015a0 0x7f53b8197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53be925640 1 --2- 172.21.15.22:0/2603214411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53b81030b0 0x7f53b8198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53bd923640 1 -- 172.21.15.22:0/2603214411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53b81030b0 msgr2=0x7f53b8198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53bd923640 1 --2- 172.21.15.22:0/2603214411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53b81030b0 0x7f53b8198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53bd923640 1 -- 172.21.15.22:0/2603214411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53b81015a0 msgr2=0x7f53b8197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53bd923640 1 --2- 172.21.15.22:0/2603214411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53b81015a0 0x7f53b8197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53bd923640 1 -- 172.21.15.22:0/2603214411 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b8199510 con 0x7f53b81026f0 2024-08-20T01:41:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53bd923640 1 --2- 172.21.15.22:0/2603214411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53b81026f0 0x7f53b8198090 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009a50 tx=0x7f53ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53b77fe640 1 -- 172.21.15.22:0/2603214411 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac03f030 con 0x7f53b81026f0 2024-08-20T01:41:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53b77fe640 1 -- 172.21.15.22:0/2603214411 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53ac031910 con 0x7f53b81026f0 2024-08-20T01:41:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53c0388640 1 -- 172.21.15.22:0/2603214411 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b81997a0 con 0x7f53b81026f0 2024-08-20T01:41:30.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53b77fe640 1 -- 172.21.15.22:0/2603214411 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac035070 con 0x7f53b81026f0 2024-08-20T01:41:30.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.797+0000 7f53c0388640 1 -- 172.21.15.22:0/2603214411 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b819fed0 con 0x7f53b81026f0 2024-08-20T01:41:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.800+0000 7f53c3250740 1 Processor -- start 2024-08-20T01:41:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.801+0000 7f53c3250740 1 -- start start 2024-08-20T01:41:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.801+0000 7f53b77fe640 1 -- 172.21.15.22:0/2603214411 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f53ac042030 con 0x7f53b81026f0 2024-08-20T01:41:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.801+0000 7f53c3250740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1aaae0 0x55d91f1aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.801+0000 7f53c3250740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1ad410 0x55d91f1af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.801+0000 7f53c3250740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1afe50 0x55d91f1b2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.801+0000 7f53c3250740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d91f11b360 con 0x55d91f1ad410 2024-08-20T01:41:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.801+0000 7f53c3250740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d91f10a860 con 0x55d91f1aaae0 2024-08-20T01:41:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.801+0000 7f53c3250740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d91f10e8a0 con 0x55d91f1afe50 2024-08-20T01:41:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.801+0000 7f53be124640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1ad410 0x55d91f1af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.801+0000 7f53bd923640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1afe50 0x55d91f1b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.801+0000 7f53be124640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1ad410 0x55d91f1af800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32926/0 (socket says 172.21.15.22:32926) 2024-08-20T01:41:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.801+0000 7f53be124640 1 -- 172.21.15.22:0/977386986 learned_addr learned my addr 172.21.15.22:0/977386986 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.801+0000 7f53be925640 1 --2- 172.21.15.22:0/977386986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1aaae0 0x55d91f1aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.801+0000 7f53be124640 1 -- 172.21.15.22:0/977386986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1afe50 msgr2=0x55d91f1b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.801+0000 7f53be124640 1 --2- 172.21.15.22:0/977386986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1afe50 0x55d91f1b2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.801+0000 7f53be124640 1 -- 172.21.15.22:0/977386986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1aaae0 msgr2=0x55d91f1aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.801+0000 7f53be124640 1 --2- 172.21.15.22:0/977386986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1aaae0 0x55d91f1aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.801+0000 7f53be124640 1 -- 172.21.15.22:0/977386986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d91f0b1e40 con 0x55d91f1ad410 2024-08-20T01:41:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.802+0000 7f53be124640 1 --2- 172.21.15.22:0/977386986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1ad410 0x55d91f1af800 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f53a80114f0 tx=0x7f53a80119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774c802b21b4d00b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.802+0000 7f53b77fe640 1 --2- 172.21.15.22:0/2603214411 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53a00b3bd0 0x7f53a00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.802+0000 7f53b4bfe640 1 -- 172.21.15.22:0/977386986 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a801e070 con 0x55d91f1ad410 2024-08-20T01:41:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.802+0000 7f53b4bfe640 1 -- 172.21.15.22:0/977386986 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53a800fad0 con 0x55d91f1ad410 2024-08-20T01:41:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.802+0000 7f53b4bfe640 1 -- 172.21.15.22:0/977386986 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a8019b10 con 0x55d91f1ad410 2024-08-20T01:41:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.802+0000 7f53be925640 1 --2- 172.21.15.22:0/2603214411 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53a00b3bd0 0x7f53a00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.802+0000 7f53b77fe640 1 -- 172.21.15.22:0/2603214411 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f53ac104030 con 0x7f53b81026f0 2024-08-20T01:41:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.803+0000 7f53c3250740 1 -- 172.21.15.22:0/977386986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1ad410 msgr2=0x55d91f1af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.803+0000 7f53be925640 1 --2- 172.21.15.22:0/2603214411 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53a00b3bd0 0x7f53a00b6090 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f53b81987c0 tx=0x7f53b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.803+0000 7f53c3250740 1 --2- 172.21.15.22:0/977386986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1ad410 0x55d91f1af800 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f53a80114f0 tx=0x7f53a80119b0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.803+0000 7f53c3250740 1 -- 172.21.15.22:0/977386986 shutdown_connections 2024-08-20T01:41:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.803+0000 7f53c3250740 1 --2- 172.21.15.22:0/977386986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1afe50 0x55d91f1b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.803+0000 7f53c3250740 1 --2- 172.21.15.22:0/977386986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1ad410 0x55d91f1af800 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.803+0000 7f53c3250740 1 --2- 172.21.15.22:0/977386986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1aaae0 0x55d91f1aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.803+0000 7f53c3250740 1 -- 172.21.15.22:0/977386986 >> 172.21.15.22:0/977386986 conn(0x55d91f1a3a20 msgr2=0x55d91f1a47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.803+0000 7f53c3250740 1 -- 172.21.15.22:0/977386986 shutdown_connections 2024-08-20T01:41:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.803+0000 7f53c3250740 1 -- 172.21.15.22:0/977386986 wait complete. 2024-08-20T01:41:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.803+0000 7f53c3250740 1 -- start start 2024-08-20T01:41:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.803+0000 7f53c3250740 1 Processor -- start 2024-08-20T01:41:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.803+0000 7f53c3250740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1aaae0 0x55d91f1b4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53c3250740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1ad410 0x55d91f1b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53c3250740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1afe50 0x55d91f1b5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53c3250740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d91f043ab0 con 0x55d91f1afe50 2024-08-20T01:41:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53c3250740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d91f091780 con 0x55d91f1ad410 2024-08-20T01:41:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53c3250740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d91f1b2e30 con 0x55d91f1aaae0 2024-08-20T01:41:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53c3250740 10 client.0 _ll_register_callbacks cb 0x55d91ee19a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53be124640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1aaae0 0x55d91f1b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53be925640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1afe50 0x55d91f1b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53be124640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1aaae0 0x55d91f1b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:60212/0 (socket says 172.21.15.22:60212) 2024-08-20T01:41:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53be124640 1 -- 172.21.15.22:0/3335872974 learned_addr learned my addr 172.21.15.22:0/3335872974 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53bd923640 1 --2- 172.21.15.22:0/3335872974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1ad410 0x55d91f1b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53be925640 1 -- 172.21.15.22:0/3335872974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1aaae0 msgr2=0x55d91f1b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53be925640 1 --2- 172.21.15.22:0/3335872974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1aaae0 0x55d91f1b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53be925640 1 -- 172.21.15.22:0/3335872974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1ad410 msgr2=0x55d91f1b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53be925640 1 --2- 172.21.15.22:0/3335872974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1ad410 0x55d91f1b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53be925640 1 -- 172.21.15.22:0/3335872974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d91ee6d790 con 0x55d91f1afe50 2024-08-20T01:41:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53bd923640 1 --2- 172.21.15.22:0/3335872974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1ad410 0x55d91f1b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53be124640 1 --2- 172.21.15.22:0/3335872974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1aaae0 0x55d91f1b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53be925640 1 --2- 172.21.15.22:0/3335872974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1afe50 0x55d91f1b5530 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f53b00045e0 tx=0x7f53b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54e272026a01a89 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f539dffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f539dffb640 1 -- 172.21.15.22:0/3335872974 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b001e680 con 0x55d91f1afe50 2024-08-20T01:41:30.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f539dffb640 1 -- 172.21.15.22:0/3335872974 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f53b001e820 con 0x55d91f1afe50 2024-08-20T01:41:30.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.804+0000 7f53c3250740 1 -- 172.21.15.22:0/3335872974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d91f0b9e00 con 0x55d91f1afe50 2024-08-20T01:41:30.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.805+0000 7f539dffb640 1 -- 172.21.15.22:0/3335872974 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f53b001ea20 con 0x55d91f1afe50 2024-08-20T01:41:30.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.805+0000 7f53c3250740 10 client.17259 fetch_fsmap learned FSMap version 34 2024-08-20T01:41:30.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.805+0000 7f53c3250740 1 -- 172.21.15.22:0/3335872974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d91eee6620 con 0x55d91f1afe50 2024-08-20T01:41:30.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.805+0000 7f539dffb640 1 -- 172.21.15.22:0/3335872974 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d91f0b9e00 con 0x55d91f1afe50 2024-08-20T01:41:30.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.805+0000 7f539dffb640 1 -- 172.21.15.22:0/3335872974 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f53b0027070 con 0x55d91f1afe50 2024-08-20T01:41:30.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.805+0000 7f53c3250740 10 client.17259 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:41:30.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.805+0000 7f53c3250740 10 client.17259 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:30.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.805+0000 7f53c3250740 20 client.17259 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:30.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.805+0000 7f53c3250740 1 --2- 172.21.15.22:0/3335872974 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d91f1bfc90 0x55d91f1c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:30.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.805+0000 7f53c3250740 4 client.17259 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:30.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.805+0000 7f53c3250740 1 -- 172.21.15.22:0/3335872974 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d91f11d2b0 con 0x55d91f1bfc90 2024-08-20T01:41:30.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.805+0000 7f53be124640 1 --2- 172.21.15.22:0/3335872974 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d91f1bfc90 0x55d91f1c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:30.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.806+0000 7f539dffb640 10 client.17259 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:30.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.806+0000 7f53be124640 1 --2- 172.21.15.22:0/3335872974 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d91f1bfc90 0x55d91f1c2130 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae1b020fa5df46c2 server_cookie=eb711d4ef0b7751 in_seq=0 out_seq=0 2024-08-20T01:41:30.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.807+0000 7f539dffb640 1 -- 172.21.15.22:0/3335872974 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d91f11d2b0 con 0x55d91f1bfc90 2024-08-20T01:41:30.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.807+0000 7f539dffb640 10 client.17259 handle_command_reply: tid=0 2024-08-20T01:41:30.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.807+0000 7f53c3250740 1 client.17259 shutdown 2024-08-20T01:41:30.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.807+0000 7f53c3250740 1 -- 172.21.15.22:0/3335872974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1afe50 msgr2=0x55d91f1b5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:30.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.807+0000 7f53c3250740 1 --2- 172.21.15.22:0/3335872974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1afe50 0x55d91f1b5530 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f53b00045e0 tx=0x7f53b0004730 comp rx=0 tx=0).stop 2024-08-20T01:41:30.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.807+0000 7f53c3250740 1 -- 172.21.15.22:0/3335872974 shutdown_connections 2024-08-20T01:41:30.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.807+0000 7f53c3250740 1 --2- 172.21.15.22:0/3335872974 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d91f1bfc90 0x55d91f1c2130 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.807+0000 7f53c3250740 1 --2- 172.21.15.22:0/3335872974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1afe50 0x55d91f1b5530 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.807+0000 7f539dffb640 0 client.17259 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.807+0000 7f53c3250740 1 --2- 172.21.15.22:0/3335872974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1ad410 0x55d91f1b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.807+0000 7f53c3250740 1 --2- 172.21.15.22:0/3335872974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1aaae0 0x55d91f1b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.807+0000 7f53c3250740 1 -- 172.21.15.22:0/3335872974 >> 172.21.15.22:0/3335872974 conn(0x55d91f1a3a20 msgr2=0x55d91f1a2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.807+0000 7f53c3250740 1 -- 172.21.15.22:0/3335872974 shutdown_connections 2024-08-20T01:41:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.807+0000 7f53c3250740 1 -- 172.21.15.22:0/3335872974 wait complete. 2024-08-20T01:41:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.807+0000 7f53c3250740 20 client.17259 trim_cache size 0 max 16384 2024-08-20T01:41:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.823+0000 7f53c3250740 1 Processor -- start 2024-08-20T01:41:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.823+0000 7f53c3250740 1 -- start start 2024-08-20T01:41:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.823+0000 7f53c3250740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1aaae0 0x55d91f1b3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.823+0000 7f53c3250740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1ad410 0x55d91f1b3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.823+0000 7f53c3250740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1afe50 0x55d91f1a22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.823+0000 7f53c3250740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f53b81aa500 con 0x55d91f1ad410 2024-08-20T01:41:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.823+0000 7f53c3250740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f53b81a7d10 con 0x55d91f1aaae0 2024-08-20T01:41:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.823+0000 7f53c3250740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f53b81a5b60 con 0x55d91f1afe50 2024-08-20T01:41:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.823+0000 7f53bd923640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1ad410 0x55d91f1b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.823+0000 7f53bd923640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1ad410 0x55d91f1b3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32940/0 (socket says 172.21.15.22:32940) 2024-08-20T01:41:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.823+0000 7f53be925640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1afe50 0x55d91f1a22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.823+0000 7f53bd923640 1 -- 172.21.15.22:0/2263786500 learned_addr learned my addr 172.21.15.22:0/2263786500 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.823+0000 7f53be124640 1 --2- 172.21.15.22:0/2263786500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1aaae0 0x55d91f1b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.824+0000 7f53bd923640 1 -- 172.21.15.22:0/2263786500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1afe50 msgr2=0x55d91f1a22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.824+0000 7f53bd923640 1 --2- 172.21.15.22:0/2263786500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1afe50 0x55d91f1a22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.824+0000 7f53bd923640 1 -- 172.21.15.22:0/2263786500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1aaae0 msgr2=0x55d91f1b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.824+0000 7f53bd923640 1 --2- 172.21.15.22:0/2263786500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1aaae0 0x55d91f1b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.824+0000 7f53bd923640 1 -- 172.21.15.22:0/2263786500 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d91f1afb70 con 0x55d91f1ad410 2024-08-20T01:41:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.824+0000 7f53be124640 1 --2- 172.21.15.22:0/2263786500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1aaae0 0x55d91f1b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.824+0000 7f53bd923640 1 --2- 172.21.15.22:0/2263786500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1ad410 0x55d91f1b3770 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f53ac032af0 tx=0x7f53ac005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85f43268ae8e6f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.824+0000 7f539ffff640 1 -- 172.21.15.22:0/2263786500 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac049040 con 0x55d91f1ad410 2024-08-20T01:41:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.824+0000 7f539ffff640 1 -- 172.21.15.22:0/2263786500 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53ac0caaf0 con 0x55d91f1ad410 2024-08-20T01:41:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.824+0000 7f539ffff640 1 -- 172.21.15.22:0/2263786500 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac0cf5e0 con 0x55d91f1ad410 2024-08-20T01:41:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.824+0000 7f53c3250740 1 -- 172.21.15.22:0/2263786500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1ad410 msgr2=0x55d91f1b3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.824+0000 7f53c3250740 1 --2- 172.21.15.22:0/2263786500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1ad410 0x55d91f1b3770 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f53ac032af0 tx=0x7f53ac005b50 comp rx=0 tx=0).stop 2024-08-20T01:41:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53c3250740 1 -- 172.21.15.22:0/2263786500 shutdown_connections 2024-08-20T01:41:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53c3250740 1 --2- 172.21.15.22:0/2263786500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1afe50 0x55d91f1a22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53c3250740 1 --2- 172.21.15.22:0/2263786500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1ad410 0x55d91f1b3770 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53c3250740 1 --2- 172.21.15.22:0/2263786500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1aaae0 0x55d91f1b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53c3250740 1 -- 172.21.15.22:0/2263786500 >> 172.21.15.22:0/2263786500 conn(0x55d91f1a3a20 msgr2=0x55d91f1b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53c3250740 1 -- 172.21.15.22:0/2263786500 shutdown_connections 2024-08-20T01:41:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53c3250740 1 -- 172.21.15.22:0/2263786500 wait complete. 2024-08-20T01:41:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53c3250740 1 -- start start 2024-08-20T01:41:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53c3250740 1 Processor -- start 2024-08-20T01:41:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53c3250740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1aaae0 0x55d91f1a5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53c3250740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1ad410 0x55d91f1a64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53c3250740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1afe50 0x55d91f22a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53c3250740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f53b81a61d0 con 0x55d91f1aaae0 2024-08-20T01:41:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53c3250740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f53b81a7640 con 0x55d91f1ad410 2024-08-20T01:41:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53c3250740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f53b81a68a0 con 0x55d91f1afe50 2024-08-20T01:41:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53be124640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1aaae0 0x55d91f1a5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53c3250740 10 client.0 _ll_register_callbacks cb 0x7f53b0009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53be124640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1aaae0 0x55d91f1a5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32944/0 (socket says 172.21.15.22:32944) 2024-08-20T01:41:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53be124640 1 -- 172.21.15.22:0/910596065 learned_addr learned my addr 172.21.15.22:0/910596065 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.825+0000 7f53be925640 1 --2- 172.21.15.22:0/910596065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1afe50 0x55d91f22a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f53bd923640 1 --2- 172.21.15.22:0/910596065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1ad410 0x55d91f1a64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f53be124640 1 -- 172.21.15.22:0/910596065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1afe50 msgr2=0x55d91f22a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f53be124640 1 --2- 172.21.15.22:0/910596065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1afe50 0x55d91f22a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f53be124640 1 -- 172.21.15.22:0/910596065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1ad410 msgr2=0x55d91f1a64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f53be124640 1 --2- 172.21.15.22:0/910596065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1ad410 0x55d91f1a64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f53be124640 1 -- 172.21.15.22:0/910596065 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d91f22af10 con 0x55d91f1aaae0 2024-08-20T01:41:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f53bd923640 1 --2- 172.21.15.22:0/910596065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1ad410 0x55d91f1a64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f53be124640 1 --2- 172.21.15.22:0/910596065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1aaae0 0x55d91f1a5f60 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009f70 tx=0x7f53a8009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9727583ed3bf3b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f539dffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f539dffb640 1 -- 172.21.15.22:0/910596065 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a8029070 con 0x55d91f1aaae0 2024-08-20T01:41:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f539dffb640 1 -- 172.21.15.22:0/910596065 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f53a8019530 con 0x55d91f1aaae0 2024-08-20T01:41:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f53c3250740 1 -- 172.21.15.22:0/910596065 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53ac0caaf0 con 0x55d91f1aaae0 2024-08-20T01:41:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f539dffb640 1 -- 172.21.15.22:0/910596065 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f53a801e040 con 0x55d91f1aaae0 2024-08-20T01:41:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f53c3250740 10 client.17265 fetch_fsmap learned FSMap version 34 2024-08-20T01:41:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f53c3250740 1 -- 172.21.15.22:0/910596065 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d91f22c280 con 0x55d91f1aaae0 2024-08-20T01:41:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f539dffb640 1 -- 172.21.15.22:0/910596065 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53ac0caaf0 con 0x55d91f1aaae0 2024-08-20T01:41:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f539dffb640 1 -- 172.21.15.22:0/910596065 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f53a8019ca0 con 0x55d91f1aaae0 2024-08-20T01:41:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f53c3250740 10 client.17265 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:41:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f53c3250740 10 client.17265 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f53c3250740 20 client.17265 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f53c3250740 1 --2- 172.21.15.22:0/910596065 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d91f22cb10 0x55d91f22ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f53c3250740 4 client.17265 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:41:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.826+0000 7f53c3250740 1 -- 172.21.15.22:0/910596065 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d91f118d50 con 0x55d91f22cb10 2024-08-20T01:41:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.827+0000 7f53bd923640 1 --2- 172.21.15.22:0/910596065 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d91f22cb10 0x55d91f22ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.827+0000 7f53bd923640 1 --2- 172.21.15.22:0/910596065 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d91f22cb10 0x55d91f22ef30 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8920091b07ee900 server_cookie=53e67af1318a7af8 in_seq=0 out_seq=0 2024-08-20T01:41:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:30.827+0000 7f539dffb640 10 client.17265 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.050+0000 7f539dffb640 1 -- 172.21.15.22:0/910596065 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d91f118d50 con 0x55d91f22cb10 2024-08-20T01:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.050+0000 7f539dffb640 10 client.17265 handle_command_reply: tid=0 2024-08-20T01:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.051+0000 7f53c3250740 1 client.17265 shutdown 2024-08-20T01:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.051+0000 7f53c3250740 1 -- 172.21.15.22:0/910596065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1aaae0 msgr2=0x55d91f1a5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.051+0000 7f53c3250740 1 --2- 172.21.15.22:0/910596065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1aaae0 0x55d91f1a5f60 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009f70 tx=0x7f53a8009290 comp rx=0 tx=0).stop 2024-08-20T01:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.051+0000 7f53c3250740 1 -- 172.21.15.22:0/910596065 shutdown_connections 2024-08-20T01:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.051+0000 7f53c3250740 1 --2- 172.21.15.22:0/910596065 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55d91f22cb10 0x55d91f22ef30 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.051+0000 7f539dffb640 0 client.17265 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.051+0000 7f53c3250740 1 --2- 172.21.15.22:0/910596065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d91f1afe50 0x55d91f22a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.051+0000 7f53c3250740 1 --2- 172.21.15.22:0/910596065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d91f1ad410 0x55d91f1a64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.051+0000 7f53c3250740 1 --2- 172.21.15.22:0/910596065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d91f1aaae0 0x55d91f1a5f60 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.051+0000 7f53c3250740 1 -- 172.21.15.22:0/910596065 >> 172.21.15.22:0/910596065 conn(0x55d91f1a3a20 msgr2=0x55d91f1a7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:31.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.051+0000 7f53c3250740 1 -- 172.21.15.22:0/910596065 shutdown_connections 2024-08-20T01:41:31.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.051+0000 7f53c3250740 1 -- 172.21.15.22:0/910596065 wait complete. 2024-08-20T01:41:31.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.051+0000 7f53c3250740 20 client.17265 trim_cache size 0 max 16384 2024-08-20T01:41:31.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:41:31.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:41:31.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:41:31.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:41:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.052+0000 7f53c0388640 1 -- 172.21.15.22:0/2603214411 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53a00b3bd0 msgr2=0x7f53a00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.052+0000 7f53c0388640 1 --2- 172.21.15.22:0/2603214411 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53a00b3bd0 0x7f53a00b6090 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f53b81987c0 tx=0x7f53b0005f90 comp rx=0 tx=0).stop 2024-08-20T01:41:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.052+0000 7f53c0388640 1 -- 172.21.15.22:0/2603214411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53b81026f0 msgr2=0x7f53b8198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.052+0000 7f53c0388640 1 --2- 172.21.15.22:0/2603214411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53b81026f0 0x7f53b8198090 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009a50 tx=0x7f53ac0042f0 comp rx=0 tx=0).stop 2024-08-20T01:41:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.052+0000 7f53c0388640 1 -- 172.21.15.22:0/2603214411 shutdown_connections 2024-08-20T01:41:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.052+0000 7f53c0388640 1 --2- 172.21.15.22:0/2603214411 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f53a00b3bd0 0x7f53a00b6090 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.052+0000 7f53c0388640 1 --2- 172.21.15.22:0/2603214411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53b81030b0 0x7f53b8198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.052+0000 7f53c0388640 1 --2- 172.21.15.22:0/2603214411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53b81026f0 0x7f53b8198090 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.052+0000 7f53c0388640 1 --2- 172.21.15.22:0/2603214411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53b81015a0 0x7f53b8197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.052+0000 7f53c0388640 1 -- 172.21.15.22:0/2603214411 >> 172.21.15.22:0/2603214411 conn(0x7f53b80fce60 msgr2=0x7f53b8105b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.052+0000 7f53c0388640 1 -- 172.21.15.22:0/2603214411 shutdown_connections 2024-08-20T01:41:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:31.052+0000 7f53c0388640 1 -- 172.21.15.22:0/2603214411 wait complete. 2024-08-20T01:41:31.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:30 smithi134 ceph-mon[22511]: pgmap v659: 97 pgs: 97 active+clean; 621 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.4 MiB/s wr, 1.30k op/s 2024-08-20T01:41:31.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:30 smithi077 ceph-mon[22251]: pgmap v659: 97 pgs: 97 active+clean; 621 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.4 MiB/s wr, 1.30k op/s 2024-08-20T01:41:31.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:30 smithi022 ceph-mon[18709]: pgmap v659: 97 pgs: 97 active+clean; 621 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.4 MiB/s wr, 1.30k op/s 2024-08-20T01:41:33.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:32 smithi134 ceph-mon[22511]: pgmap v660: 97 pgs: 97 active+clean; 610 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.3 MiB/s wr, 1.19k op/s 2024-08-20T01:41:33.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:32 smithi077 ceph-mon[22251]: pgmap v660: 97 pgs: 97 active+clean; 610 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.3 MiB/s wr, 1.19k op/s 2024-08-20T01:41:33.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:32 smithi022 ceph-mon[18709]: pgmap v660: 97 pgs: 97 active+clean; 610 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.3 MiB/s wr, 1.19k op/s 2024-08-20T01:41:35.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:34 smithi134 ceph-mon[22511]: pgmap v661: 97 pgs: 97 active+clean; 591 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 1.09k op/s 2024-08-20T01:41:35.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:34 smithi077 ceph-mon[22251]: pgmap v661: 97 pgs: 97 active+clean; 591 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 1.09k op/s 2024-08-20T01:41:35.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:34 smithi022 ceph-mon[18709]: pgmap v661: 97 pgs: 97 active+clean; 591 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 1.09k op/s 2024-08-20T01:41:37.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:36 smithi134 ceph-mon[22511]: pgmap v662: 97 pgs: 97 active+clean; 583 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 793 op/s 2024-08-20T01:41:37.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:36 smithi077 ceph-mon[22251]: pgmap v662: 97 pgs: 97 active+clean; 583 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 793 op/s 2024-08-20T01:41:37.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:36 smithi022 ceph-mon[18709]: pgmap v662: 97 pgs: 97 active+clean; 583 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 793 op/s 2024-08-20T01:41:39.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:38 smithi134 ceph-mon[22511]: pgmap v663: 97 pgs: 97 active+clean; 566 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 804 op/s 2024-08-20T01:41:39.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:38 smithi077 ceph-mon[22251]: pgmap v663: 97 pgs: 97 active+clean; 566 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 804 op/s 2024-08-20T01:41:39.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:38 smithi022 ceph-mon[18709]: pgmap v663: 97 pgs: 97 active+clean; 566 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 804 op/s 2024-08-20T01:41:41.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:40 smithi134 ceph-mon[22511]: pgmap v664: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 478 op/s 2024-08-20T01:41:41.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:40 smithi077 ceph-mon[22251]: pgmap v664: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 478 op/s 2024-08-20T01:41:41.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:40 smithi022 ceph-mon[18709]: pgmap v664: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 478 op/s 2024-08-20T01:41:43.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:42 smithi134 ceph-mon[22511]: pgmap v665: 97 pgs: 97 active+clean; 542 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 465 op/s 2024-08-20T01:41:43.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:42 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:41:43.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:42 smithi077 ceph-mon[22251]: pgmap v665: 97 pgs: 97 active+clean; 542 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 465 op/s 2024-08-20T01:41:43.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:42 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:41:43.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:42 smithi022 ceph-mon[18709]: pgmap v665: 97 pgs: 97 active+clean; 542 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 465 op/s 2024-08-20T01:41:43.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:42 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:41:44.146 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.142+0000 7f3b1fe85640 1 -- 172.21.15.22:0/908215909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b18101560 msgr2=0x7f3b18101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:44.146 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.142+0000 7f3b1fe85640 1 --2- 172.21.15.22:0/908215909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b18101560 0x7f3b18101960 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3b10009cd0 tx=0x7f3b1002a8e0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.146 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.142+0000 7f3b1fe85640 1 -- 172.21.15.22:0/908215909 shutdown_connections 2024-08-20T01:41:44.146 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.142+0000 7f3b1fe85640 1 --2- 172.21.15.22:0/908215909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b18103070 0x7f3b181099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.142+0000 7f3b1fe85640 1 --2- 172.21.15.22:0/908215909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b181026b0 0x7f3b18102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.142+0000 7f3b1fe85640 1 --2- 172.21.15.22:0/908215909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b18101560 0x7f3b18101960 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.142+0000 7f3b1fe85640 1 -- 172.21.15.22:0/908215909 >> 172.21.15.22:0/908215909 conn(0x7f3b180fce40 msgr2=0x7f3b180ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.142+0000 7f3b1fe85640 1 -- 172.21.15.22:0/908215909 shutdown_connections 2024-08-20T01:41:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.142+0000 7f3b1fe85640 1 -- 172.21.15.22:0/908215909 wait complete. 2024-08-20T01:41:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.142+0000 7f3b1fe85640 1 Processor -- start 2024-08-20T01:41:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.143+0000 7f3b1fe85640 1 -- start start 2024-08-20T01:41:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.143+0000 7f3b1fe85640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b18101560 0x7f3b1806aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.143+0000 7f3b1fe85640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b181026b0 0x7f3b1819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.143+0000 7f3b1fe85640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b18103070 0x7f3b1819fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.143+0000 7f3b1fe85640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1810d1b0 con 0x7f3b18103070 2024-08-20T01:41:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.143+0000 7f3b1fe85640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1810d030 con 0x7f3b181026b0 2024-08-20T01:41:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.143+0000 7f3b1fe85640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1810d330 con 0x7f3b18101560 2024-08-20T01:41:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.143+0000 7f3b1e422640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b18103070 0x7f3b1819fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.143+0000 7f3b1e422640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b18103070 0x7f3b1819fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38564/0 (socket says 172.21.15.22:38564) 2024-08-20T01:41:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.143+0000 7f3b1e422640 1 -- 172.21.15.22:0/3741243102 learned_addr learned my addr 172.21.15.22:0/3741243102 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.143+0000 7f3b1dc21640 1 --2- 172.21.15.22:0/3741243102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b18101560 0x7f3b1806aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.143+0000 7f3b1d420640 1 --2- 172.21.15.22:0/3741243102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b181026b0 0x7f3b1819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.143+0000 7f3b1e422640 1 -- 172.21.15.22:0/3741243102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b18101560 msgr2=0x7f3b1806aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.143+0000 7f3b1e422640 1 --2- 172.21.15.22:0/3741243102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b18101560 0x7f3b1806aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.143+0000 7f3b1e422640 1 -- 172.21.15.22:0/3741243102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b181026b0 msgr2=0x7f3b1819d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.143+0000 7f3b1e422640 1 --2- 172.21.15.22:0/3741243102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b181026b0 0x7f3b1819d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.143+0000 7f3b1e422640 1 -- 172.21.15.22:0/3741243102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b181a0630 con 0x7f3b18103070 2024-08-20T01:41:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.143+0000 7f3b1e422640 1 --2- 172.21.15.22:0/3741243102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b18103070 0x7f3b1819fd70 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800e970 tx=0x7f3b0800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.143+0000 7f3b16ffd640 1 -- 172.21.15.22:0/3741243102 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0800ccc0 con 0x7f3b18103070 2024-08-20T01:41:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.144+0000 7f3b16ffd640 1 -- 172.21.15.22:0/3741243102 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b0800ce60 con 0x7f3b18103070 2024-08-20T01:41:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.144+0000 7f3b1fe85640 1 -- 172.21.15.22:0/3741243102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b18197550 con 0x7f3b18103070 2024-08-20T01:41:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.144+0000 7f3b16ffd640 1 -- 172.21.15.22:0/3741243102 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08010430 con 0x7f3b18103070 2024-08-20T01:41:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.144+0000 7f3b1fe85640 1 -- 172.21.15.22:0/3741243102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b18197a50 con 0x7f3b18103070 2024-08-20T01:41:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.146+0000 7f3b22c75740 1 Processor -- start 2024-08-20T01:41:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.146+0000 7f3b16ffd640 1 -- 172.21.15.22:0/3741243102 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3b08004ff0 con 0x7f3b18103070 2024-08-20T01:41:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b22c75740 1 -- start start 2024-08-20T01:41:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b22c75740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e28d0 0x5597a99e4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b22c75740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e5200 0x5597a99e75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b22c75740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e7c40 0x5597a99ea100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b22c75740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5597a9955360 con 0x5597a99e7c40 2024-08-20T01:41:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b22c75740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5597a9944860 con 0x5597a99e28d0 2024-08-20T01:41:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b22c75740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5597a99488a0 con 0x5597a99e5200 2024-08-20T01:41:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b1d420640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e7c40 0x5597a99ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b1dc21640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e5200 0x5597a99e75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b1d420640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e28d0 0x5597a99e4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b1dc21640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e5200 0x5597a99e75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.22:60120/0 (socket says 172.21.15.22:60120) 2024-08-20T01:41:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b1dc21640 1 -- 172.21.15.22:0/221580836 learned_addr learned my addr 172.21.15.22:0/221580836 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b1dc21640 1 -- 172.21.15.22:0/221580836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e28d0 msgr2=0x5597a99e4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b1dc21640 1 --2- 172.21.15.22:0/221580836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e28d0 0x5597a99e4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b1dc21640 1 -- 172.21.15.22:0/221580836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e7c40 msgr2=0x5597a99ea100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b1dc21640 1 --2- 172.21.15.22:0/221580836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e7c40 0x5597a99ea100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b1dc21640 1 -- 172.21.15.22:0/221580836 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597a98ebe40 con 0x5597a99e5200 2024-08-20T01:41:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b16ffd640 1 --2- 172.21.15.22:0/3741243102 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3b000b3bd0 0x7f3b000b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b1d420640 1 --2- 172.21.15.22:0/221580836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e28d0 0x5597a99e4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b1d420640 1 --2- 172.21.15.22:0/3741243102 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3b000b3bd0 0x7f3b000b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b1dc21640 1 --2- 172.21.15.22:0/221580836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e5200 0x5597a99e75f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3b1002ae00 tx=0x7f3b10005ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6c16ef12fb3237f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.147+0000 7f3b16ffd640 1 -- 172.21.15.22:0/3741243102 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f3b080e4040 con 0x7f3b18103070 2024-08-20T01:41:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.148+0000 7f3afffff640 1 -- 172.21.15.22:0/221580836 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b10049070 con 0x5597a99e5200 2024-08-20T01:41:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.148+0000 7f3afffff640 1 -- 172.21.15.22:0/221580836 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b10036040 con 0x5597a99e5200 2024-08-20T01:41:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.148+0000 7f3afffff640 1 -- 172.21.15.22:0/221580836 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b100042a0 con 0x5597a99e5200 2024-08-20T01:41:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.148+0000 7f3b22c75740 1 -- 172.21.15.22:0/221580836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e5200 msgr2=0x5597a99e75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.148+0000 7f3b1d420640 1 --2- 172.21.15.22:0/3741243102 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3b000b3bd0 0x7f3b000b6090 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c011010 tx=0x7f3b0c011040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.148+0000 7f3b22c75740 1 --2- 172.21.15.22:0/221580836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e5200 0x5597a99e75f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3b1002ae00 tx=0x7f3b10005ef0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.148+0000 7f3b22c75740 1 -- 172.21.15.22:0/221580836 shutdown_connections 2024-08-20T01:41:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.148+0000 7f3b22c75740 1 --2- 172.21.15.22:0/221580836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e7c40 0x5597a99ea100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.148+0000 7f3b22c75740 1 --2- 172.21.15.22:0/221580836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e5200 0x5597a99e75f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.148+0000 7f3b22c75740 1 --2- 172.21.15.22:0/221580836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e28d0 0x5597a99e4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.148+0000 7f3b22c75740 1 -- 172.21.15.22:0/221580836 >> 172.21.15.22:0/221580836 conn(0x5597a99dda20 msgr2=0x5597a99de7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.149+0000 7f3b22c75740 1 -- 172.21.15.22:0/221580836 shutdown_connections 2024-08-20T01:41:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.149+0000 7f3b22c75740 1 -- 172.21.15.22:0/221580836 wait complete. 2024-08-20T01:41:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.149+0000 7f3b22c75740 1 -- start start 2024-08-20T01:41:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.149+0000 7f3b22c75740 1 Processor -- start 2024-08-20T01:41:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.149+0000 7f3b22c75740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e28d0 0x5597a99ec030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.149+0000 7f3b22c75740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e5200 0x5597a99ec6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.149+0000 7f3b22c75740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e7c40 0x5597a99ed2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.149+0000 7f3b22c75740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5597a987dab0 con 0x5597a99e7c40 2024-08-20T01:41:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.149+0000 7f3b22c75740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5597a98cb780 con 0x5597a99e28d0 2024-08-20T01:41:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.149+0000 7f3b22c75740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5597a99eabc0 con 0x5597a99e5200 2024-08-20T01:41:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.149+0000 7f3b22c75740 10 client.0 _ll_register_callbacks cb 0x5597a9653a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.149+0000 7f3b1e422640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e7c40 0x5597a99ed2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.150+0000 7f3b1e422640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e7c40 0x5597a99ed2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38582/0 (socket says 172.21.15.22:38582) 2024-08-20T01:41:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.150+0000 7f3b1e422640 1 -- 172.21.15.22:0/1002475804 learned_addr learned my addr 172.21.15.22:0/1002475804 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.150+0000 7f3b1d420640 1 --2- 172.21.15.22:0/1002475804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e5200 0x5597a99ec6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.150+0000 7f3b1dc21640 1 --2- 172.21.15.22:0/1002475804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e28d0 0x5597a99ec030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.150+0000 7f3b1e422640 1 -- 172.21.15.22:0/1002475804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e5200 msgr2=0x5597a99ec6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.150+0000 7f3b1e422640 1 --2- 172.21.15.22:0/1002475804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e5200 0x5597a99ec6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.150+0000 7f3b1e422640 1 -- 172.21.15.22:0/1002475804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e28d0 msgr2=0x5597a99ec030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.150+0000 7f3b1e422640 1 --2- 172.21.15.22:0/1002475804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e28d0 0x5597a99ec030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.150+0000 7f3b1e422640 1 -- 172.21.15.22:0/1002475804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597a96a7790 con 0x5597a99e7c40 2024-08-20T01:41:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.150+0000 7f3b1e422640 1 --2- 172.21.15.22:0/1002475804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e7c40 0x5597a99ed2a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f3b080a81c0 tx=0x7f3b080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57eed6e0a300a0d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.150+0000 7f3afd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.150+0000 7f3afd7fa640 1 -- 172.21.15.22:0/1002475804 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b080af310 con 0x5597a99e7c40 2024-08-20T01:41:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.150+0000 7f3afd7fa640 1 -- 172.21.15.22:0/1002475804 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f3b080b3b70 con 0x5597a99e7c40 2024-08-20T01:41:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.150+0000 7f3b22c75740 1 -- 172.21.15.22:0/1002475804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5597a98f3e00 con 0x5597a99e7c40 2024-08-20T01:41:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.150+0000 7f3afd7fa640 1 -- 172.21.15.22:0/1002475804 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3b080aaf50 con 0x5597a99e7c40 2024-08-20T01:41:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.150+0000 7f3b22c75740 10 client.17277 fetch_fsmap learned FSMap version 34 2024-08-20T01:41:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.150+0000 7f3b22c75740 1 -- 172.21.15.22:0/1002475804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5597a9720620 con 0x5597a99e7c40 2024-08-20T01:41:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.150+0000 7f3afd7fa640 1 -- 172.21.15.22:0/1002475804 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5597a98f3e00 con 0x5597a99e7c40 2024-08-20T01:41:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.151+0000 7f3afd7fa640 1 -- 172.21.15.22:0/1002475804 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f3b080a68c0 con 0x5597a99e7c40 2024-08-20T01:41:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.151+0000 7f3b22c75740 10 client.17277 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:41:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.151+0000 7f3b22c75740 10 client.17277 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.151+0000 7f3b22c75740 20 client.17277 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.151+0000 7f3b22c75740 1 --2- 172.21.15.22:0/1002475804 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5597a99f7990 0x5597a99f9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.151+0000 7f3b22c75740 4 client.17277 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.151+0000 7f3b22c75740 1 -- 172.21.15.22:0/1002475804 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597a99572b0 con 0x5597a99f7990 2024-08-20T01:41:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.151+0000 7f3b1dc21640 1 --2- 172.21.15.22:0/1002475804 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5597a99f7990 0x5597a99f9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.151+0000 7f3b1dc21640 1 --2- 172.21.15.22:0/1002475804 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5597a99f7990 0x5597a99f9de0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1ea454f6f32cd3b server_cookie=403d07fa4cba84c1 in_seq=0 out_seq=0 2024-08-20T01:41:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.151+0000 7f3afd7fa640 10 client.17277 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.153+0000 7f3afd7fa640 1 -- 172.21.15.22:0/1002475804 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5597a99572b0 con 0x5597a99f7990 2024-08-20T01:41:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.153+0000 7f3afd7fa640 10 client.17277 handle_command_reply: tid=0 2024-08-20T01:41:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.153+0000 7f3b22c75740 1 client.17277 shutdown 2024-08-20T01:41:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.153+0000 7f3b22c75740 1 -- 172.21.15.22:0/1002475804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e7c40 msgr2=0x5597a99ed2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.153+0000 7f3b22c75740 1 --2- 172.21.15.22:0/1002475804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e7c40 0x5597a99ed2a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f3b080a81c0 tx=0x7f3b080046c0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.153+0000 7f3b22c75740 1 -- 172.21.15.22:0/1002475804 shutdown_connections 2024-08-20T01:41:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.153+0000 7f3b22c75740 1 --2- 172.21.15.22:0/1002475804 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5597a99f7990 0x5597a99f9de0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.153+0000 7f3b22c75740 1 --2- 172.21.15.22:0/1002475804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e7c40 0x5597a99ed2a0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.153+0000 7f3afd7fa640 0 client.17277 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.153+0000 7f3b22c75740 1 --2- 172.21.15.22:0/1002475804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e5200 0x5597a99ec6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.153+0000 7f3b22c75740 1 --2- 172.21.15.22:0/1002475804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e28d0 0x5597a99ec030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.153+0000 7f3b22c75740 1 -- 172.21.15.22:0/1002475804 >> 172.21.15.22:0/1002475804 conn(0x5597a99dda20 msgr2=0x5597a99dcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.153+0000 7f3b22c75740 1 -- 172.21.15.22:0/1002475804 shutdown_connections 2024-08-20T01:41:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.153+0000 7f3b22c75740 1 -- 172.21.15.22:0/1002475804 wait complete. 2024-08-20T01:41:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.153+0000 7f3b22c75740 20 client.17277 trim_cache size 0 max 16384 2024-08-20T01:41:44.175 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.168+0000 7f3b22c75740 1 Processor -- start 2024-08-20T01:41:44.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.168+0000 7f3b22c75740 1 -- start start 2024-08-20T01:41:44.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.168+0000 7f3b22c75740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e28d0 0x5597a99eaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:44.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.168+0000 7f3b22c75740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e5200 0x5597a99eb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:44.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.168+0000 7f3b22c75740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e7c40 0x5597a99dc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:44.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.168+0000 7f3b22c75740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3b181aa360 con 0x5597a99e5200 2024-08-20T01:41:44.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.168+0000 7f3b22c75740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3b181a7b70 con 0x5597a99e7c40 2024-08-20T01:41:44.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.168+0000 7f3b22c75740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3b181a59c0 con 0x5597a99e28d0 2024-08-20T01:41:44.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.168+0000 7f3b1d420640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e5200 0x5597a99eb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:44.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.168+0000 7f3b1dc21640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e28d0 0x5597a99eaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:44.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.168+0000 7f3b1d420640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e5200 0x5597a99eb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38590/0 (socket says 172.21.15.22:38590) 2024-08-20T01:41:44.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.168+0000 7f3b1d420640 1 -- 172.21.15.22:0/2402045629 learned_addr learned my addr 172.21.15.22:0/2402045629 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:44.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.168+0000 7f3b1e422640 1 --2- 172.21.15.22:0/2402045629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e7c40 0x5597a99dc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:44.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.168+0000 7f3b1dc21640 1 -- 172.21.15.22:0/2402045629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e7c40 msgr2=0x5597a99dc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:44.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.168+0000 7f3b1dc21640 1 --2- 172.21.15.22:0/2402045629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e7c40 0x5597a99dc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.168+0000 7f3b1dc21640 1 -- 172.21.15.22:0/2402045629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e5200 msgr2=0x5597a99eb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:44.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.168+0000 7f3b1dc21640 1 --2- 172.21.15.22:0/2402045629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e5200 0x5597a99eb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.168+0000 7f3b1dc21640 1 -- 172.21.15.22:0/2402045629 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597a99e7960 con 0x5597a99e28d0 2024-08-20T01:41:44.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.169+0000 7f3b1dc21640 1 --2- 172.21.15.22:0/2402045629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e28d0 0x5597a99eaf90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3b10009ca0 tx=0x7f3b1002a8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f87d533075cfae8b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:44.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.169+0000 7f3aff7fe640 1 -- 172.21.15.22:0/2402045629 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b10049040 con 0x5597a99e28d0 2024-08-20T01:41:44.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.169+0000 7f3aff7fe640 1 -- 172.21.15.22:0/2402045629 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b10036040 con 0x5597a99e28d0 2024-08-20T01:41:44.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.169+0000 7f3aff7fe640 1 -- 172.21.15.22:0/2402045629 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b100307c0 con 0x5597a99e28d0 2024-08-20T01:41:44.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.169+0000 7f3b22c75740 1 -- 172.21.15.22:0/2402045629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e28d0 msgr2=0x5597a99eaf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:44.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.169+0000 7f3b22c75740 1 --2- 172.21.15.22:0/2402045629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e28d0 0x5597a99eaf90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3b10009ca0 tx=0x7f3b1002a8e0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.169+0000 7f3b22c75740 1 -- 172.21.15.22:0/2402045629 shutdown_connections 2024-08-20T01:41:44.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.169+0000 7f3b22c75740 1 --2- 172.21.15.22:0/2402045629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e7c40 0x5597a99dc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.169+0000 7f3b22c75740 1 --2- 172.21.15.22:0/2402045629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e5200 0x5597a99eb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.169+0000 7f3b22c75740 1 --2- 172.21.15.22:0/2402045629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e28d0 0x5597a99eaf90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.169+0000 7f3b22c75740 1 -- 172.21.15.22:0/2402045629 >> 172.21.15.22:0/2402045629 conn(0x5597a99dda20 msgr2=0x5597a99e9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:44.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.169+0000 7f3b22c75740 1 -- 172.21.15.22:0/2402045629 shutdown_connections 2024-08-20T01:41:44.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.169+0000 7f3b22c75740 1 -- 172.21.15.22:0/2402045629 wait complete. 2024-08-20T01:41:44.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.170+0000 7f3b22c75740 1 -- start start 2024-08-20T01:41:44.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.170+0000 7f3b22c75740 1 Processor -- start 2024-08-20T01:41:44.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.170+0000 7f3b22c75740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e28d0 0x5597a99f0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:44.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.170+0000 7f3b22c75740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e5200 0x5597a99f10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:44.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.170+0000 7f3b22c75740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e7c40 0x5597a99f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:44.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.170+0000 7f3b22c75740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3b181a6030 con 0x5597a99e5200 2024-08-20T01:41:44.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.170+0000 7f3b22c75740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3b181a74a0 con 0x5597a99e7c40 2024-08-20T01:41:44.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.170+0000 7f3b22c75740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3b181a6700 con 0x5597a99e28d0 2024-08-20T01:41:44.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.170+0000 7f3b22c75740 10 client.0 _ll_register_callbacks cb 0x7f3b080aa750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:44.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.170+0000 7f3b1d420640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e5200 0x5597a99f10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:44.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.170+0000 7f3b1d420640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e5200 0x5597a99f10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38604/0 (socket says 172.21.15.22:38604) 2024-08-20T01:41:44.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.170+0000 7f3b1d420640 1 -- 172.21.15.22:0/297381380 learned_addr learned my addr 172.21.15.22:0/297381380 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:44.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.170+0000 7f3b1dc21640 1 --2- 172.21.15.22:0/297381380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e28d0 0x5597a99f0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:44.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.170+0000 7f3b1e422640 1 --2- 172.21.15.22:0/297381380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e7c40 0x5597a99f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:44.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.170+0000 7f3b1d420640 1 -- 172.21.15.22:0/297381380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e28d0 msgr2=0x5597a99f0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:44.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.170+0000 7f3b1d420640 1 --2- 172.21.15.22:0/297381380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e28d0 0x5597a99f0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.170+0000 7f3b1d420640 1 -- 172.21.15.22:0/297381380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e7c40 msgr2=0x5597a99f1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:44.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.170+0000 7f3b1d420640 1 --2- 172.21.15.22:0/297381380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e7c40 0x5597a99f1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.171+0000 7f3b1d420640 1 -- 172.21.15.22:0/297381380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597a99eca40 con 0x5597a99e5200 2024-08-20T01:41:44.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.171+0000 7f3b1e422640 1 --2- 172.21.15.22:0/297381380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e7c40 0x5597a99f1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:44.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.171+0000 7f3b1dc21640 1 --2- 172.21.15.22:0/297381380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e28d0 0x5597a99f0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:44.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.171+0000 7f3b1d420640 1 --2- 172.21.15.22:0/297381380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e5200 0x5597a99f10d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c01d9d0 tx=0x7f3b0c00f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517d075408e57477 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:44.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.171+0000 7f3afd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:44.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.171+0000 7f3afd7fa640 1 -- 172.21.15.22:0/297381380 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c003d00 con 0x5597a99e5200 2024-08-20T01:41:44.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.171+0000 7f3afd7fa640 1 -- 172.21.15.22:0/297381380 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f3b0c020480 con 0x5597a99e5200 2024-08-20T01:41:44.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.171+0000 7f3b22c75740 1 -- 172.21.15.22:0/297381380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b10036040 con 0x5597a99e5200 2024-08-20T01:41:44.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.171+0000 7f3afd7fa640 1 -- 172.21.15.22:0/297381380 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3b0c020680 con 0x5597a99e5200 2024-08-20T01:41:44.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.171+0000 7f3b22c75740 10 client.17283 fetch_fsmap learned FSMap version 34 2024-08-20T01:41:44.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.171+0000 7f3b22c75740 1 -- 172.21.15.22:0/297381380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5597a99e5030 con 0x5597a99e5200 2024-08-20T01:41:44.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.171+0000 7f3afd7fa640 1 -- 172.21.15.22:0/297381380 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b10036040 con 0x5597a99e5200 2024-08-20T01:41:44.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.171+0000 7f3afd7fa640 1 -- 172.21.15.22:0/297381380 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f3b0c01e040 con 0x5597a99e5200 2024-08-20T01:41:44.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.171+0000 7f3b22c75740 10 client.17283 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:41:44.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.171+0000 7f3b22c75740 10 client.17283 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:44.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.171+0000 7f3b22c75740 20 client.17283 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:44.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.171+0000 7f3b22c75740 1 --2- 172.21.15.22:0/297381380 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5597a99f3e40 0x5597a9a64720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:44.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.171+0000 7f3b22c75740 4 client.17283 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:41:44.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.171+0000 7f3b22c75740 1 -- 172.21.15.22:0/297381380 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5597a9952d50 con 0x5597a99f3e40 2024-08-20T01:41:44.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.172+0000 7f3b1dc21640 1 --2- 172.21.15.22:0/297381380 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5597a99f3e40 0x5597a9a64720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:44.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.172+0000 7f3afd7fa640 10 client.17283 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:44.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.172+0000 7f3b1dc21640 1 --2- 172.21.15.22:0/297381380 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5597a99f3e40 0x5597a9a64720 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c71b6fa8982cb64 server_cookie=1ac7089896ef2459 in_seq=0 out_seq=0 2024-08-20T01:41:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.450+0000 7f3afd7fa640 1 -- 172.21.15.22:0/297381380 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5597a9952d50 con 0x5597a99f3e40 2024-08-20T01:41:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.450+0000 7f3afd7fa640 10 client.17283 handle_command_reply: tid=0 2024-08-20T01:41:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.450+0000 7f3b22c75740 1 client.17283 shutdown 2024-08-20T01:41:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.450+0000 7f3b22c75740 1 -- 172.21.15.22:0/297381380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e5200 msgr2=0x5597a99f10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.450+0000 7f3b22c75740 1 --2- 172.21.15.22:0/297381380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e5200 0x5597a99f10d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c01d9d0 tx=0x7f3b0c00f7a0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.450+0000 7f3b22c75740 1 -- 172.21.15.22:0/297381380 shutdown_connections 2024-08-20T01:41:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.450+0000 7f3b22c75740 1 --2- 172.21.15.22:0/297381380 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x5597a99f3e40 0x5597a9a64720 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.450+0000 7f3b22c75740 1 --2- 172.21.15.22:0/297381380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597a99e7c40 0x5597a99f1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.450+0000 7f3afd7fa640 0 client.17283 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.450+0000 7f3b22c75740 1 --2- 172.21.15.22:0/297381380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597a99e5200 0x5597a99f10d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.450+0000 7f3b22c75740 1 --2- 172.21.15.22:0/297381380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5597a99e28d0 0x5597a99f0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.450+0000 7f3b22c75740 1 -- 172.21.15.22:0/297381380 >> 172.21.15.22:0/297381380 conn(0x5597a99dda20 msgr2=0x5597a99e19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.450+0000 7f3b22c75740 1 -- 172.21.15.22:0/297381380 shutdown_connections 2024-08-20T01:41:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.450+0000 7f3b22c75740 1 -- 172.21.15.22:0/297381380 wait complete. 2024-08-20T01:41:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.450+0000 7f3b22c75740 20 client.17283 trim_cache size 0 max 16384 2024-08-20T01:41:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-08-20T01:41:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-08-20T01:41:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-08-20T01:41:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-08-20T01:41:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.451+0000 7f3b1fe85640 1 -- 172.21.15.22:0/3741243102 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3b000b3bd0 msgr2=0x7f3b000b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.451+0000 7f3b1fe85640 1 --2- 172.21.15.22:0/3741243102 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3b000b3bd0 0x7f3b000b6090 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c011010 tx=0x7f3b0c011040 comp rx=0 tx=0).stop 2024-08-20T01:41:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.451+0000 7f3b1fe85640 1 -- 172.21.15.22:0/3741243102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b18103070 msgr2=0x7f3b1819fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.451+0000 7f3b1fe85640 1 --2- 172.21.15.22:0/3741243102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b18103070 0x7f3b1819fd70 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800e970 tx=0x7f3b0800ed70 comp rx=0 tx=0).stop 2024-08-20T01:41:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.451+0000 7f3b1fe85640 1 -- 172.21.15.22:0/3741243102 shutdown_connections 2024-08-20T01:41:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.451+0000 7f3b1fe85640 1 --2- 172.21.15.22:0/3741243102 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f3b000b3bd0 0x7f3b000b6090 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.451+0000 7f3b1fe85640 1 --2- 172.21.15.22:0/3741243102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b18103070 0x7f3b1819fd70 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.451+0000 7f3b1fe85640 1 --2- 172.21.15.22:0/3741243102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b181026b0 0x7f3b1819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.451+0000 7f3b1fe85640 1 --2- 172.21.15.22:0/3741243102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b18101560 0x7f3b1806aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.451+0000 7f3b1fe85640 1 -- 172.21.15.22:0/3741243102 >> 172.21.15.22:0/3741243102 conn(0x7f3b180fce40 msgr2=0x7f3b18105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.451+0000 7f3b1fe85640 1 -- 172.21.15.22:0/3741243102 shutdown_connections 2024-08-20T01:41:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-08-20T01:41:44.451+0000 7f3b1fe85640 1 -- 172.21.15.22:0/3741243102 wait complete. 2024-08-20T01:41:44.766 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:44 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:44.767 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:44 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:44.767 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:44 smithi134 ceph-mon[22511]: pgmap v666: 97 pgs: 97 active+clean; 528 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 457 op/s 2024-08-20T01:41:44.767 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:44 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:44.767 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:44 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:44.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:44 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:44.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:44 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:44.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:44 smithi077 ceph-mon[22251]: pgmap v666: 97 pgs: 97 active+clean; 528 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 457 op/s 2024-08-20T01:41:44.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:44 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:44.815 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:44 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:44.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:44 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:44.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:44 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:44.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:44 smithi022 ceph-mon[18709]: pgmap v666: 97 pgs: 97 active+clean; 528 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 457 op/s 2024-08-20T01:41:44.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:44 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:44.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:44 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:46.724 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-08-20T01:41:46.724 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-20T01:41:46.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:46 smithi022 ceph-mon[18709]: pgmap v667: 97 pgs: 97 active+clean; 523 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 372 op/s 2024-08-20T01:41:47.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:46 smithi134 ceph-mon[22511]: pgmap v667: 97 pgs: 97 active+clean; 523 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 372 op/s 2024-08-20T01:41:47.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:46 smithi077 ceph-mon[22251]: pgmap v667: 97 pgs: 97 active+clean; 523 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 372 op/s 2024-08-20T01:41:47.088 DEBUG:teuthology.parallel:result is None 2024-08-20T01:41:47.089 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-20T01:41:47.127 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-20T01:41:47.127 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-08-20T01:41:47.137 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi022.front.sepia.ceph.com 2024-08-20T01:41:47.175 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-08-20T01:41:47.184 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-08-20T01:41:48.867 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:48 smithi077 ceph-mon[22251]: pgmap v668: 97 pgs: 97 active+clean; 488 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 481 op/s 2024-08-20T01:41:48.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:48 smithi022 ceph-mon[18709]: pgmap v668: 97 pgs: 97 active+clean; 488 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 481 op/s 2024-08-20T01:41:49.016 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:48 smithi134 ceph-mon[22511]: pgmap v668: 97 pgs: 97 active+clean; 488 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 481 op/s 2024-08-20T01:41:49.811 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:41:50.084 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:50.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:50.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:50.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:41:50.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:41:50.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:49 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:50.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:50.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:50.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:41:50.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:41:50.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:49 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:50.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:50.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:50.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:41:50.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:41:50.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:49 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' 2024-08-20T01:41:50.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.563+0000 7f7276a52640 1 -- 172.21.15.22:0/1401337519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7270104290 msgr2=0x7f727010c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:50.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.563+0000 7f7276a52640 1 --2- 172.21.15.22:0/1401337519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7270104290 0x7f727010c870 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f7264009900 tx=0x7f726402a410 comp rx=0 tx=0).stop 2024-08-20T01:41:50.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.564+0000 7f7276a52640 1 -- 172.21.15.22:0/1401337519 shutdown_connections 2024-08-20T01:41:50.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.564+0000 7f7276a52640 1 --2- 172.21.15.22:0/1401337519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f727010ce40 0x7f727010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.564+0000 7f7276a52640 1 --2- 172.21.15.22:0/1401337519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7270104290 0x7f727010c870 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.564+0000 7f7276a52640 1 --2- 172.21.15.22:0/1401337519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7270103890 0x7f7270103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.564+0000 7f7276a52640 1 -- 172.21.15.22:0/1401337519 >> 172.21.15.22:0/1401337519 conn(0x7f72700fd400 msgr2=0x7f72700ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:50.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.564+0000 7f7276a52640 1 -- 172.21.15.22:0/1401337519 shutdown_connections 2024-08-20T01:41:50.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.564+0000 7f7276a52640 1 -- 172.21.15.22:0/1401337519 wait complete. 2024-08-20T01:41:50.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.564+0000 7f7276a52640 1 Processor -- start 2024-08-20T01:41:50.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.564+0000 7f7276a52640 1 -- start start 2024-08-20T01:41:50.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.565+0000 7f7276a52640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7270103890 0x7f7270198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.565+0000 7f7276a52640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7270104290 0x7f72701994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.565+0000 7f7276a52640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f727010ce40 0x7f727019e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.565+0000 7f7276a52640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7270112a60 con 0x7f727010ce40 2024-08-20T01:41:50.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.565+0000 7f7276a52640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f72701128e0 con 0x7f7270103890 2024-08-20T01:41:50.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.565+0000 7f7276a52640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7270112be0 con 0x7f7270104290 2024-08-20T01:41:50.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.565+0000 7f7274fef640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f727010ce40 0x7f727019e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.565+0000 7f7274fef640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f727010ce40 0x7f727019e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37220/0 (socket says 172.21.15.22:37220) 2024-08-20T01:41:50.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.565+0000 7f7274fef640 1 -- 172.21.15.22:0/459354626 learned_addr learned my addr 172.21.15.22:0/459354626 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:50.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.565+0000 7f726f7fe640 1 --2- 172.21.15.22:0/459354626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7270104290 0x7f72701994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.565+0000 7f726ffff640 1 --2- 172.21.15.22:0/459354626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7270103890 0x7f7270198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.565+0000 7f7274fef640 1 -- 172.21.15.22:0/459354626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7270104290 msgr2=0x7f72701994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:50.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.565+0000 7f7274fef640 1 --2- 172.21.15.22:0/459354626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7270104290 0x7f72701994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.565+0000 7f7274fef640 1 -- 172.21.15.22:0/459354626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7270103890 msgr2=0x7f7270198f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:50.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.565+0000 7f7274fef640 1 --2- 172.21.15.22:0/459354626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7270103890 0x7f7270198f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.565+0000 7f7274fef640 1 -- 172.21.15.22:0/459354626 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727019f020 con 0x7f727010ce40 2024-08-20T01:41:50.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.565+0000 7f7274fef640 1 --2- 172.21.15.22:0/459354626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f727010ce40 0x7f727019e850 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f726800ccb0 tx=0x7f726800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:50.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.565+0000 7f726d7fa640 1 -- 172.21.15.22:0/459354626 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726800f450 con 0x7f727010ce40 2024-08-20T01:41:50.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.566+0000 7f7276a52640 1 -- 172.21.15.22:0/459354626 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f727019f310 con 0x7f727010ce40 2024-08-20T01:41:50.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.566+0000 7f726d7fa640 1 -- 172.21.15.22:0/459354626 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f726800faa0 con 0x7f727010ce40 2024-08-20T01:41:50.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.566+0000 7f726d7fa640 1 -- 172.21.15.22:0/459354626 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7268018b00 con 0x7f727010ce40 2024-08-20T01:41:50.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.566+0000 7f7276a52640 1 -- 172.21.15.22:0/459354626 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72701a59d0 con 0x7f727010ce40 2024-08-20T01:41:50.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.568+0000 7f726d7fa640 1 -- 172.21.15.22:0/459354626 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f726800fc50 con 0x7f727010ce40 2024-08-20T01:41:50.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.568+0000 7f7278e4b740 1 Processor -- start 2024-08-20T01:41:50.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f7278e4b740 1 -- start start 2024-08-20T01:41:50.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f7278e4b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683f1830 0x5654683f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f7278e4b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f2150 0x5654683fdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f7278e4b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683fe0e0 0x5654684004d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f7278e4b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5654683688e0 con 0x5654683f2150 2024-08-20T01:41:50.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f7278e4b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x565468357de0 con 0x5654683f1830 2024-08-20T01:41:50.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f7278e4b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56546835be20 con 0x5654683fe0e0 2024-08-20T01:41:50.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f726ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f2150 0x5654683fdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f726ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f2150 0x5654683fdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37236/0 (socket says 172.21.15.22:37236) 2024-08-20T01:41:50.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f726ffff640 1 -- 172.21.15.22:0/245307963 learned_addr learned my addr 172.21.15.22:0/245307963 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:50.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f726f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683f1830 0x5654683f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f726f7fe640 1 --2- 172.21.15.22:0/245307963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683fe0e0 0x5654684004d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f726d7fa640 1 --2- 172.21.15.22:0/459354626 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f72580b3bd0 0x7f72580b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f7274fef640 1 --2- 172.21.15.22:0/459354626 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f72580b3bd0 0x7f72580b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f726f7fe640 1 -- 172.21.15.22:0/245307963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683f1830 msgr2=0x5654683f1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:50.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f726f7fe640 1 --2- 172.21.15.22:0/245307963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683f1830 0x5654683f1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f726d7fa640 1 -- 172.21.15.22:0/459354626 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f72680e4370 con 0x7f727010ce40 2024-08-20T01:41:50.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f726f7fe640 1 -- 172.21.15.22:0/245307963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f2150 msgr2=0x5654683fdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:50.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f726f7fe640 1 --2- 172.21.15.22:0/245307963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f2150 0x5654683fdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f726f7fe640 1 -- 172.21.15.22:0/245307963 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654680b7650 con 0x5654683fe0e0 2024-08-20T01:41:50.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.569+0000 7f726ffff640 1 --2- 172.21.15.22:0/245307963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f2150 0x5654683fdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:50.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.570+0000 7f726f7fe640 1 --2- 172.21.15.22:0/245307963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683fe0e0 0x5654684004d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7264009230 tx=0x7f7264005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef10a9e7a1c65ac6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:50.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.570+0000 7f7274fef640 1 --2- 172.21.15.22:0/459354626 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f72580b3bd0 0x7f72580b6090 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f726801b000 tx=0x7f72680789c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:50.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.570+0000 7f72567fc640 1 -- 172.21.15.22:0/245307963 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264035050 con 0x5654683fe0e0 2024-08-20T01:41:50.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.570+0000 7f72567fc640 1 -- 172.21.15.22:0/245307963 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72640054d0 con 0x5654683fe0e0 2024-08-20T01:41:50.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.570+0000 7f72567fc640 1 -- 172.21.15.22:0/245307963 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264004a90 con 0x5654683fe0e0 2024-08-20T01:41:50.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.571+0000 7f7278e4b740 1 -- 172.21.15.22:0/245307963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683fe0e0 msgr2=0x5654684004d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:50.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.571+0000 7f7278e4b740 1 --2- 172.21.15.22:0/245307963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683fe0e0 0x5654684004d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7264009230 tx=0x7f7264005e80 comp rx=0 tx=0).stop 2024-08-20T01:41:50.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.571+0000 7f7278e4b740 1 -- 172.21.15.22:0/245307963 shutdown_connections 2024-08-20T01:41:50.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.571+0000 7f7278e4b740 1 --2- 172.21.15.22:0/245307963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683fe0e0 0x5654684004d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.571+0000 7f7278e4b740 1 --2- 172.21.15.22:0/245307963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f2150 0x5654683fdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.571+0000 7f7278e4b740 1 --2- 172.21.15.22:0/245307963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683f1830 0x5654683f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.571+0000 7f7278e4b740 1 -- 172.21.15.22:0/245307963 >> 172.21.15.22:0/245307963 conn(0x5654683ef660 msgr2=0x5654683f0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:50.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.571+0000 7f7278e4b740 1 -- 172.21.15.22:0/245307963 shutdown_connections 2024-08-20T01:41:50.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.571+0000 7f7278e4b740 1 -- 172.21.15.22:0/245307963 wait complete. 2024-08-20T01:41:50.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.571+0000 7f7278e4b740 1 -- start start 2024-08-20T01:41:50.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.571+0000 7f7278e4b740 1 Processor -- start 2024-08-20T01:41:50.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.572+0000 7f7278e4b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f1830 0x5654683fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.572+0000 7f7278e4b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683f2150 0x5654683fb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.572+0000 7f7278e4b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683fe0e0 0x5654683fbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.572+0000 7f7278e4b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5654681ba700 con 0x5654683f1830 2024-08-20T01:41:50.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.572+0000 7f7278e4b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5654682de7c0 con 0x5654683fe0e0 2024-08-20T01:41:50.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.572+0000 7f7278e4b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x565468400d30 con 0x5654683f2150 2024-08-20T01:41:50.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.572+0000 7f7278e4b740 10 client.0 _ll_register_callbacks cb 0x5654683516b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:50.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.572+0000 7f726f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f1830 0x5654683fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.572+0000 7f726f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f1830 0x5654683fb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37246/0 (socket says 172.21.15.22:37246) 2024-08-20T01:41:50.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.572+0000 7f726f7fe640 1 -- 172.21.15.22:0/3525299883 learned_addr learned my addr 172.21.15.22:0/3525299883 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:50.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.572+0000 7f726ffff640 1 --2- 172.21.15.22:0/3525299883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683f2150 0x5654683fb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.572+0000 7f726f7fe640 1 --2- 172.21.15.22:0/3525299883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683fe0e0 0x5654683fbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.572+0000 7f726f7fe640 1 -- 172.21.15.22:0/3525299883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683f2150 msgr2=0x5654683fb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:50.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.572+0000 7f726f7fe640 1 --2- 172.21.15.22:0/3525299883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683f2150 0x5654683fb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.572+0000 7f726f7fe640 1 -- 172.21.15.22:0/3525299883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683fe0e0 msgr2=0x5654683fbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:50.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.572+0000 7f726f7fe640 1 --2- 172.21.15.22:0/3525299883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683fe0e0 0x5654683fbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.572+0000 7f726f7fe640 1 -- 172.21.15.22:0/3525299883 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56546840a140 con 0x5654683f1830 2024-08-20T01:41:50.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.572+0000 7f726f7fe640 1 --2- 172.21.15.22:0/3525299883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f1830 0x5654683fb0a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7264032fd0 tx=0x7f7264005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119f05b977e5e7d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:50.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.572+0000 7f724f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:50.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.573+0000 7f724f7fe640 1 -- 172.21.15.22:0/3525299883 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264051020 con 0x5654683f1830 2024-08-20T01:41:50.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.573+0000 7f724f7fe640 1 -- 172.21.15.22:0/3525299883 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f726403b660 con 0x5654683f1830 2024-08-20T01:41:50.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.573+0000 7f7278e4b740 1 -- 172.21.15.22:0/3525299883 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x565468307100 con 0x5654683f1830 2024-08-20T01:41:50.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.573+0000 7f724f7fe640 1 -- 172.21.15.22:0/3525299883 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7264035040 con 0x5654683f1830 2024-08-20T01:41:50.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.573+0000 7f7278e4b740 10 client.17295 fetch_fsmap learned FSMap version 34 2024-08-20T01:41:50.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.573+0000 7f7278e4b740 1 -- 172.21.15.22:0/3525299883 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56546840caf0 con 0x5654683f1830 2024-08-20T01:41:50.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.573+0000 7f724f7fe640 1 -- 172.21.15.22:0/3525299883 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x565468307100 con 0x5654683f1830 2024-08-20T01:41:50.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.573+0000 7f724f7fe640 1 -- 172.21.15.22:0/3525299883 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f72640051b0 con 0x5654683f1830 2024-08-20T01:41:50.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.573+0000 7f7278e4b740 10 client.17295 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:41:50.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.573+0000 7f7278e4b740 10 client.17295 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:50.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.573+0000 7f7278e4b740 20 client.17295 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:50.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.573+0000 7f7278e4b740 1 --2- 172.21.15.22:0/3525299883 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56546840de40 0x565468410230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.573+0000 7f7278e4b740 4 client.17295 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:50.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.573+0000 7f7278e4b740 1 -- 172.21.15.22:0/3525299883 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56546836a830 con 0x56546840de40 2024-08-20T01:41:50.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.574+0000 7f726ffff640 1 --2- 172.21.15.22:0/3525299883 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56546840de40 0x565468410230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.574+0000 7f726ffff640 1 --2- 172.21.15.22:0/3525299883 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56546840de40 0x565468410230 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efe40f9e8bee6785 server_cookie=76739f4467edd90c in_seq=0 out_seq=0 2024-08-20T01:41:50.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.574+0000 7f724f7fe640 10 client.17295 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:50.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.575+0000 7f724f7fe640 1 -- 172.21.15.22:0/3525299883 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56546836a830 con 0x56546840de40 2024-08-20T01:41:50.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.575+0000 7f724f7fe640 10 client.17295 handle_command_reply: tid=0 2024-08-20T01:41:50.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.575+0000 7f7278e4b740 1 client.17295 shutdown 2024-08-20T01:41:50.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.575+0000 7f7278e4b740 1 -- 172.21.15.22:0/3525299883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f1830 msgr2=0x5654683fb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:50.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.575+0000 7f7278e4b740 1 --2- 172.21.15.22:0/3525299883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f1830 0x5654683fb0a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7264032fd0 tx=0x7f7264005a20 comp rx=0 tx=0).stop 2024-08-20T01:41:50.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.575+0000 7f7278e4b740 1 -- 172.21.15.22:0/3525299883 shutdown_connections 2024-08-20T01:41:50.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.575+0000 7f7278e4b740 1 --2- 172.21.15.22:0/3525299883 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x56546840de40 0x565468410230 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.575+0000 7f7278e4b740 1 --2- 172.21.15.22:0/3525299883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683fe0e0 0x5654683fbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.575+0000 7f7278e4b740 1 --2- 172.21.15.22:0/3525299883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683f2150 0x5654683fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.575+0000 7f7278e4b740 1 --2- 172.21.15.22:0/3525299883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f1830 0x5654683fb0a0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.575+0000 7f7278e4b740 1 -- 172.21.15.22:0/3525299883 >> 172.21.15.22:0/3525299883 conn(0x5654683ef660 msgr2=0x5654683f5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:50.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.575+0000 7f724f7fe640 0 client.17295 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:50.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.575+0000 7f7278e4b740 1 -- 172.21.15.22:0/3525299883 shutdown_connections 2024-08-20T01:41:50.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.575+0000 7f7278e4b740 1 -- 172.21.15.22:0/3525299883 wait complete. 2024-08-20T01:41:50.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.575+0000 7f7278e4b740 20 client.17295 trim_cache size 0 max 16384 2024-08-20T01:41:50.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.592+0000 7f7278e4b740 1 Processor -- start 2024-08-20T01:41:50.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.592+0000 7f7278e4b740 1 -- start start 2024-08-20T01:41:50.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.593+0000 7f7278e4b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683f1830 0x5654683fa930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.593+0000 7f7278e4b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683f2150 0x565468415890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.593+0000 7f7278e4b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683fe0e0 0x565468415dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.593+0000 7f7278e4b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f72701ae950 con 0x5654683fe0e0 2024-08-20T01:41:50.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.593+0000 7f7278e4b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f72701ac160 con 0x5654683f2150 2024-08-20T01:41:50.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.593+0000 7f7278e4b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f72701a9fb0 con 0x5654683f1830 2024-08-20T01:41:50.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.593+0000 7f726f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683fe0e0 0x565468415dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.593+0000 7f726f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683fe0e0 0x565468415dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37254/0 (socket says 172.21.15.22:37254) 2024-08-20T01:41:50.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.593+0000 7f726f7fe640 1 -- 172.21.15.22:0/4044754016 learned_addr learned my addr 172.21.15.22:0/4044754016 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:50.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.593+0000 7f726ffff640 1 --2- 172.21.15.22:0/4044754016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683f2150 0x565468415890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.593+0000 7f726f7fe640 1 --2- 172.21.15.22:0/4044754016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683f1830 0x5654683fa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.593+0000 7f726f7fe640 1 -- 172.21.15.22:0/4044754016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683f1830 msgr2=0x5654683fa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:50.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.593+0000 7f726f7fe640 1 --2- 172.21.15.22:0/4044754016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683f1830 0x5654683fa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.593+0000 7f726f7fe640 1 -- 172.21.15.22:0/4044754016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683f2150 msgr2=0x565468415890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:50.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.593+0000 7f726f7fe640 1 --2- 172.21.15.22:0/4044754016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683f2150 0x565468415890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.593+0000 7f726f7fe640 1 -- 172.21.15.22:0/4044754016 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654683f1f80 con 0x5654683fe0e0 2024-08-20T01:41:50.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.593+0000 7f726ffff640 1 --2- 172.21.15.22:0/4044754016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683f2150 0x565468415890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:50.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.593+0000 7f726f7fe640 1 --2- 172.21.15.22:0/4044754016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683fe0e0 0x565468415dd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f7264032f80 tx=0x7f7264005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed54981be44e11ac server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:50.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.594+0000 7f7255ffb640 1 -- 172.21.15.22:0/4044754016 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264051040 con 0x5654683fe0e0 2024-08-20T01:41:50.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.594+0000 7f7255ffb640 1 -- 172.21.15.22:0/4044754016 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7264031d20 con 0x5654683fe0e0 2024-08-20T01:41:50.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.594+0000 7f7255ffb640 1 -- 172.21.15.22:0/4044754016 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264032860 con 0x5654683fe0e0 2024-08-20T01:41:50.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.594+0000 7f7278e4b740 1 -- 172.21.15.22:0/4044754016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683fe0e0 msgr2=0x565468415dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:50.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.594+0000 7f7278e4b740 1 --2- 172.21.15.22:0/4044754016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683fe0e0 0x565468415dd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f7264032f80 tx=0x7f7264005e80 comp rx=0 tx=0).stop 2024-08-20T01:41:50.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.594+0000 7f7278e4b740 1 -- 172.21.15.22:0/4044754016 shutdown_connections 2024-08-20T01:41:50.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.594+0000 7f7278e4b740 1 --2- 172.21.15.22:0/4044754016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683fe0e0 0x565468415dd0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.594+0000 7f7278e4b740 1 --2- 172.21.15.22:0/4044754016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683f2150 0x565468415890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.594+0000 7f7278e4b740 1 --2- 172.21.15.22:0/4044754016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683f1830 0x5654683fa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.594+0000 7f7278e4b740 1 -- 172.21.15.22:0/4044754016 >> 172.21.15.22:0/4044754016 conn(0x5654683ef660 msgr2=0x5654683fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:50.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.595+0000 7f7278e4b740 1 -- 172.21.15.22:0/4044754016 shutdown_connections 2024-08-20T01:41:50.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.595+0000 7f7278e4b740 1 -- 172.21.15.22:0/4044754016 wait complete. 2024-08-20T01:41:50.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.595+0000 7f7278e4b740 1 -- start start 2024-08-20T01:41:50.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.595+0000 7f7278e4b740 1 Processor -- start 2024-08-20T01:41:50.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.595+0000 7f7278e4b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683f1830 0x565468406800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.595+0000 7f7278e4b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f2150 0x565468400fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.595+0000 7f7278e4b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683fe0e0 0x565468401680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.595+0000 7f7278e4b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f72701aa620 con 0x5654683f2150 2024-08-20T01:41:50.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.595+0000 7f7278e4b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f72701aba90 con 0x5654683f1830 2024-08-20T01:41:50.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.595+0000 7f7278e4b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f72701aacf0 con 0x5654683fe0e0 2024-08-20T01:41:50.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.595+0000 7f7278e4b740 10 client.0 _ll_register_callbacks cb 0x7f726000a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:50.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.596+0000 7f726ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f2150 0x565468400fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.596+0000 7f726f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683f1830 0x565468406800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.596+0000 7f726ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f2150 0x565468400fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37264/0 (socket says 172.21.15.22:37264) 2024-08-20T01:41:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.596+0000 7f726ffff640 1 -- 172.21.15.22:0/1111956713 learned_addr learned my addr 172.21.15.22:0/1111956713 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.596+0000 7f726f7fe640 1 --2- 172.21.15.22:0/1111956713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683fe0e0 0x565468401680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.596+0000 7f726ffff640 1 -- 172.21.15.22:0/1111956713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683fe0e0 msgr2=0x565468401680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.596+0000 7f726ffff640 1 --2- 172.21.15.22:0/1111956713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683fe0e0 0x565468401680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.596+0000 7f726ffff640 1 -- 172.21.15.22:0/1111956713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683f1830 msgr2=0x565468406800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.596+0000 7f726ffff640 1 --2- 172.21.15.22:0/1111956713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683f1830 0x565468406800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.596+0000 7f726ffff640 1 -- 172.21.15.22:0/1111956713 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565468476850 con 0x5654683f2150 2024-08-20T01:41:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.596+0000 7f726ffff640 1 --2- 172.21.15.22:0/1111956713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f2150 0x565468400fb0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f72600058c0 tx=0x7f72600143a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ca5088a1b2dce5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.596+0000 7f724f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.596+0000 7f724f7fe640 1 -- 172.21.15.22:0/1111956713 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726000a7c0 con 0x5654683f2150 2024-08-20T01:41:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.596+0000 7f724f7fe640 1 -- 172.21.15.22:0/1111956713 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f726000a960 con 0x5654683f2150 2024-08-20T01:41:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.596+0000 7f7278e4b740 1 -- 172.21.15.22:0/1111956713 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7264031d20 con 0x5654683f2150 2024-08-20T01:41:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.597+0000 7f724f7fe640 1 -- 172.21.15.22:0/1111956713 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f726000aba0 con 0x5654683f2150 2024-08-20T01:41:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.597+0000 7f7278e4b740 10 client.17301 fetch_fsmap learned FSMap version 34 2024-08-20T01:41:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.597+0000 7f7278e4b740 1 -- 172.21.15.22:0/1111956713 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x565468477ab0 con 0x5654683f2150 2024-08-20T01:41:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.597+0000 7f724f7fe640 1 -- 172.21.15.22:0/1111956713 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7264031d20 con 0x5654683f2150 2024-08-20T01:41:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.597+0000 7f724f7fe640 1 -- 172.21.15.22:0/1111956713 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f7260033400 con 0x5654683f2150 2024-08-20T01:41:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.597+0000 7f7278e4b740 10 client.17301 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:41:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.597+0000 7f7278e4b740 10 client.17301 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.597+0000 7f7278e4b740 20 client.17301 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.597+0000 7f7278e4b740 1 --2- 172.21.15.22:0/1111956713 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x565468478340 0x56546847a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.597+0000 7f7278e4b740 4 client.17301 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:41:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.597+0000 7f7278e4b740 1 -- 172.21.15.22:0/1111956713 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5654683662d0 con 0x565468478340 2024-08-20T01:41:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.597+0000 7f726f7fe640 1 --2- 172.21.15.22:0/1111956713 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x565468478340 0x56546847a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.598+0000 7f724f7fe640 10 client.17301 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.598+0000 7f726f7fe640 1 --2- 172.21.15.22:0/1111956713 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x565468478340 0x56546847a760 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e557ad2228f42f36 server_cookie=ac4767e156cf2997 in_seq=0 out_seq=0 2024-08-20T01:41:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.598+0000 7f724f7fe640 1 -- 172.21.15.22:0/1111956713 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5654683662d0 con 0x565468478340 2024-08-20T01:41:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.598+0000 7f724f7fe640 10 client.17301 handle_command_reply: tid=0 2024-08-20T01:41:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.598+0000 7f7278e4b740 1 client.17301 shutdown 2024-08-20T01:41:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.598+0000 7f7278e4b740 1 -- 172.21.15.22:0/1111956713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f2150 msgr2=0x565468400fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.598+0000 7f7278e4b740 1 --2- 172.21.15.22:0/1111956713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f2150 0x565468400fb0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f72600058c0 tx=0x7f72600143a0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.598+0000 7f7278e4b740 1 -- 172.21.15.22:0/1111956713 shutdown_connections 2024-08-20T01:41:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.598+0000 7f7278e4b740 1 --2- 172.21.15.22:0/1111956713 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x565468478340 0x56546847a760 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.598+0000 7f7278e4b740 1 --2- 172.21.15.22:0/1111956713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5654683fe0e0 0x565468401680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.598+0000 7f7278e4b740 1 --2- 172.21.15.22:0/1111956713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654683f2150 0x565468400fb0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.598+0000 7f724f7fe640 0 client.17301 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.598+0000 7f7278e4b740 1 --2- 172.21.15.22:0/1111956713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654683f1830 0x565468406800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.598+0000 7f7278e4b740 1 -- 172.21.15.22:0/1111956713 >> 172.21.15.22:0/1111956713 conn(0x5654683ef660 msgr2=0x5654683fb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.598+0000 7f7278e4b740 1 -- 172.21.15.22:0/1111956713 shutdown_connections 2024-08-20T01:41:50.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.598+0000 7f7278e4b740 1 -- 172.21.15.22:0/1111956713 wait complete. 2024-08-20T01:41:50.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.598+0000 7f7278e4b740 20 client.17301 trim_cache size 0 max 16384 2024-08-20T01:41:50.606 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:41:50.606 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-08-20T01:41:50.606 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-08-20T01:41:50.606 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:41:50.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.599+0000 7f7276a52640 1 -- 172.21.15.22:0/459354626 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f72580b3bd0 msgr2=0x7f72580b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:50.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.599+0000 7f7276a52640 1 --2- 172.21.15.22:0/459354626 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f72580b3bd0 0x7f72580b6090 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f726801b000 tx=0x7f72680789c0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.599+0000 7f7276a52640 1 -- 172.21.15.22:0/459354626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f727010ce40 msgr2=0x7f727019e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:50.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.599+0000 7f7276a52640 1 --2- 172.21.15.22:0/459354626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f727010ce40 0x7f727019e850 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f726800ccb0 tx=0x7f726800a620 comp rx=0 tx=0).stop 2024-08-20T01:41:50.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.599+0000 7f7276a52640 1 -- 172.21.15.22:0/459354626 shutdown_connections 2024-08-20T01:41:50.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.599+0000 7f7276a52640 1 --2- 172.21.15.22:0/459354626 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f72580b3bd0 0x7f72580b6090 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.599+0000 7f7276a52640 1 --2- 172.21.15.22:0/459354626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f727010ce40 0x7f727019e850 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.599+0000 7f7276a52640 1 --2- 172.21.15.22:0/459354626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7270104290 0x7f72701994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.599+0000 7f7276a52640 1 --2- 172.21.15.22:0/459354626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7270103890 0x7f7270198f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.599+0000 7f7276a52640 1 -- 172.21.15.22:0/459354626 >> 172.21.15.22:0/459354626 conn(0x7f72700fd400 msgr2=0x7f72700fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:50.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.599+0000 7f7276a52640 1 -- 172.21.15.22:0/459354626 shutdown_connections 2024-08-20T01:41:50.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:50.599+0000 7f7276a52640 1 -- 172.21.15.22:0/459354626 wait complete. 2024-08-20T01:41:51.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:50 smithi022 ceph-mon[18709]: pgmap v669: 97 pgs: 97 active+clean; 479 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 424 op/s 2024-08-20T01:41:51.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:50 smithi134 ceph-mon[22511]: pgmap v669: 97 pgs: 97 active+clean; 479 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 424 op/s 2024-08-20T01:41:51.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:50 smithi077 ceph-mon[22251]: pgmap v669: 97 pgs: 97 active+clean; 479 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 424 op/s 2024-08-20T01:41:51.347 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:41:51.348 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:41:51.610 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:52.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.087+0000 7f91122e3640 1 -- 172.21.15.22:0/2720560391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f910c1084e0 msgr2=0x7f910c108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:52.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.087+0000 7f91122e3640 1 --2- 172.21.15.22:0/2720560391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f910c1084e0 0x7f910c108920 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f9100009900 tx=0x7f910002a410 comp rx=0 tx=0).stop 2024-08-20T01:41:52.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.087+0000 7f91122e3640 1 -- 172.21.15.22:0/2720560391 shutdown_connections 2024-08-20T01:41:52.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.087+0000 7f91122e3640 1 --2- 172.21.15.22:0/2720560391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f910c108e60 0x7f910c10f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:52.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.087+0000 7f91122e3640 1 --2- 172.21.15.22:0/2720560391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f910c1084e0 0x7f910c108920 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:52.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.087+0000 7f91122e3640 1 --2- 172.21.15.22:0/2720560391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c102ad0 0x7f910c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:52.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.087+0000 7f91122e3640 1 -- 172.21.15.22:0/2720560391 >> 172.21.15.22:0/2720560391 conn(0x7f910c0fe540 msgr2=0x7f910c100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:52.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.087+0000 7f91122e3640 1 -- 172.21.15.22:0/2720560391 shutdown_connections 2024-08-20T01:41:52.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.088+0000 7f91122e3640 1 -- 172.21.15.22:0/2720560391 wait complete. 2024-08-20T01:41:52.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.088+0000 7f91122e3640 1 Processor -- start 2024-08-20T01:41:52.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.088+0000 7f91122e3640 1 -- start start 2024-08-20T01:41:52.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.089+0000 7f91122e3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c102ad0 0x7f910c198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:52.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.089+0000 7f91122e3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f910c1084e0 0x7f910c199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:52.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.089+0000 7f91122e3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f910c108e60 0x7f910c19e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:52.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.089+0000 7f91122e3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f910c112ae0 con 0x7f910c1084e0 2024-08-20T01:41:52.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.089+0000 7f91122e3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f910c112960 con 0x7f910c108e60 2024-08-20T01:41:52.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.089+0000 7f91122e3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f910c112c60 con 0x7f910c102ad0 2024-08-20T01:41:52.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.089+0000 7f910b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f910c1084e0 0x7f910c199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:52.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.089+0000 7f910b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f910c1084e0 0x7f910c199510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37284/0 (socket says 172.21.15.22:37284) 2024-08-20T01:41:52.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.089+0000 7f910b7fe640 1 -- 172.21.15.22:0/2721505167 learned_addr learned my addr 172.21.15.22:0/2721505167 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:52.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.089+0000 7f9110880640 1 --2- 172.21.15.22:0/2721505167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f910c108e60 0x7f910c19e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:52.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.089+0000 7f910bfff640 1 --2- 172.21.15.22:0/2721505167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c102ad0 0x7f910c198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:52.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.089+0000 7f910b7fe640 1 -- 172.21.15.22:0/2721505167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c102ad0 msgr2=0x7f910c198fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:52.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.089+0000 7f910b7fe640 1 --2- 172.21.15.22:0/2721505167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c102ad0 0x7f910c198fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:52.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.089+0000 7f910b7fe640 1 -- 172.21.15.22:0/2721505167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f910c108e60 msgr2=0x7f910c19e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:52.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.089+0000 7f910b7fe640 1 --2- 172.21.15.22:0/2721505167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f910c108e60 0x7f910c19e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:52.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.089+0000 7f910b7fe640 1 -- 172.21.15.22:0/2721505167 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910c19f080 con 0x7f910c1084e0 2024-08-20T01:41:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.089+0000 7f910bfff640 1 --2- 172.21.15.22:0/2721505167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c102ad0 0x7f910c198fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.089+0000 7f910b7fe640 1 --2- 172.21.15.22:0/2721505167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f910c1084e0 0x7f910c199510 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9100005940 tx=0x7f91000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.089+0000 7f91097fa640 1 -- 172.21.15.22:0/2721505167 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910003f030 con 0x7f910c1084e0 2024-08-20T01:41:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.090+0000 7f91122e3640 1 -- 172.21.15.22:0/2721505167 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f910c19f310 con 0x7f910c1084e0 2024-08-20T01:41:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.090+0000 7f91097fa640 1 -- 172.21.15.22:0/2721505167 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9100003cb0 con 0x7f910c1084e0 2024-08-20T01:41:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.090+0000 7f91097fa640 1 -- 172.21.15.22:0/2721505167 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9100035070 con 0x7f910c1084e0 2024-08-20T01:41:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.090+0000 7f91122e3640 1 -- 172.21.15.22:0/2721505167 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f910c1a5a30 con 0x7f910c1084e0 2024-08-20T01:41:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.091+0000 7f91122e3640 1 -- 172.21.15.22:0/2721505167 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f910c102eb0 con 0x7f910c1084e0 2024-08-20T01:41:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.093+0000 7f91097fa640 1 -- 172.21.15.22:0/2721505167 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9100042030 con 0x7f910c1084e0 2024-08-20T01:41:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.093+0000 7f91097fa640 1 --2- 172.21.15.22:0/2721505167 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f90f40b3bd0 0x7f90f40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.094+0000 7f910bfff640 1 --2- 172.21.15.22:0/2721505167 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f90f40b3bd0 0x7f90f40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.094+0000 7f91097fa640 1 -- 172.21.15.22:0/2721505167 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f9100104770 con 0x7f910c1084e0 2024-08-20T01:41:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.094+0000 7f910bfff640 1 --2- 172.21.15.22:0/2721505167 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f90f40b3bd0 0x7f90f40b6090 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0058c0 tx=0x7f90fc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.097+0000 7f91097fa640 1 -- 172.21.15.22:0/2721505167 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f91000cbd80 con 0x7f910c1084e0 2024-08-20T01:41:52.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.318+0000 7f91122e3640 1 -- 172.21.15.22:0/2721505167 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f910c10ac40 con 0x7f910c1084e0 2024-08-20T01:41:52.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.319+0000 7f91097fa640 1 -- 172.21.15.22:0/2721505167 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11915 (secure 0 0 0) 0x7f91000cb680 con 0x7f910c1084e0 2024-08-20T01:41:52.321 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:41:52.321 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":34,"btime":"2024-08-20T01:41:18:910532+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:41:18.910513+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26866":{"gid":26866,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/2284188249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2284188249},{"type":"v1","addr":"172.21.15.134:6835","nonce":2284188249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24565,24575,24586]},"id":1}]} 2024-08-20T01:41:52.322 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 34 2024-08-20T01:41:52.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.321+0000 7f91122e3640 1 -- 172.21.15.22:0/2721505167 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f90f40b3bd0 msgr2=0x7f90f40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:52.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.321+0000 7f91122e3640 1 --2- 172.21.15.22:0/2721505167 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f90f40b3bd0 0x7f90f40b6090 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0058c0 tx=0x7f90fc005850 comp rx=0 tx=0).stop 2024-08-20T01:41:52.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.321+0000 7f91122e3640 1 -- 172.21.15.22:0/2721505167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f910c1084e0 msgr2=0x7f910c199510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:52.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.321+0000 7f91122e3640 1 --2- 172.21.15.22:0/2721505167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f910c1084e0 0x7f910c199510 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9100005940 tx=0x7f91000042f0 comp rx=0 tx=0).stop 2024-08-20T01:41:52.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.321+0000 7f91122e3640 1 -- 172.21.15.22:0/2721505167 shutdown_connections 2024-08-20T01:41:52.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.321+0000 7f91122e3640 1 --2- 172.21.15.22:0/2721505167 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f90f40b3bd0 0x7f90f40b6090 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:52.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.321+0000 7f91122e3640 1 --2- 172.21.15.22:0/2721505167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f910c108e60 0x7f910c19e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:52.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.321+0000 7f91122e3640 1 --2- 172.21.15.22:0/2721505167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f910c1084e0 0x7f910c199510 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:52.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.321+0000 7f91122e3640 1 --2- 172.21.15.22:0/2721505167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c102ad0 0x7f910c198fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:52.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.321+0000 7f91122e3640 1 -- 172.21.15.22:0/2721505167 >> 172.21.15.22:0/2721505167 conn(0x7f910c0fe540 msgr2=0x7f910c100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:52.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.321+0000 7f91122e3640 1 -- 172.21.15.22:0/2721505167 shutdown_connections 2024-08-20T01:41:52.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:52.321+0000 7f91122e3640 1 -- 172.21.15.22:0/2721505167 wait complete. 2024-08-20T01:41:53.115 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:41:53.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:53 smithi134 ceph-mon[22511]: pgmap v670: 97 pgs: 97 active+clean; 474 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 406 op/s 2024-08-20T01:41:53.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:53 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2721505167' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:41:53.318 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:53 smithi077 ceph-mon[22251]: pgmap v670: 97 pgs: 97 active+clean; 474 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 406 op/s 2024-08-20T01:41:53.318 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:53 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2721505167' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:41:53.380 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:53.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:53 smithi022 ceph-mon[18709]: pgmap v670: 97 pgs: 97 active+clean; 474 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 406 op/s 2024-08-20T01:41:53.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:53 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2721505167' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:41:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.044+0000 7f1493e0f640 1 -- 172.21.15.22:0/3214333260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c1019d0 msgr2=0x7f148c101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.044+0000 7f1493e0f640 1 --2- 172.21.15.22:0/3214333260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c1019d0 0x7f148c101db0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1488009900 tx=0x7f148802a410 comp rx=0 tx=0).stop 2024-08-20T01:41:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.044+0000 7f1493e0f640 1 -- 172.21.15.22:0/3214333260 shutdown_connections 2024-08-20T01:41:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.044+0000 7f1493e0f640 1 --2- 172.21.15.22:0/3214333260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f148c107d60 0x7f148c10e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.044+0000 7f1493e0f640 1 --2- 172.21.15.22:0/3214333260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f148c1073e0 0x7f148c107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.044+0000 7f1493e0f640 1 --2- 172.21.15.22:0/3214333260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c1019d0 0x7f148c101db0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.044+0000 7f1493e0f640 1 -- 172.21.15.22:0/3214333260 >> 172.21.15.22:0/3214333260 conn(0x7f148c0fd440 msgr2=0x7f148c0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.044+0000 7f1493e0f640 1 -- 172.21.15.22:0/3214333260 shutdown_connections 2024-08-20T01:41:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.044+0000 7f1493e0f640 1 -- 172.21.15.22:0/3214333260 wait complete. 2024-08-20T01:41:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.045+0000 7f1493e0f640 1 Processor -- start 2024-08-20T01:41:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.045+0000 7f1493e0f640 1 -- start start 2024-08-20T01:41:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.045+0000 7f1493e0f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f148c1019d0 0x7f148c0fdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.045+0000 7f1493e0f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c1073e0 0x7f148c0fe080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.045+0000 7f1493e0f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f148c107d60 0x7f148c0fe5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.045+0000 7f1493e0f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f148c111a20 con 0x7f148c1073e0 2024-08-20T01:41:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.045+0000 7f1493e0f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f148c1118a0 con 0x7f148c107d60 2024-08-20T01:41:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.045+0000 7f1493e0f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f148c111ba0 con 0x7f148c1019d0 2024-08-20T01:41:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.045+0000 7f14913aa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c1073e0 0x7f148c0fe080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.045+0000 7f14913aa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c1073e0 0x7f148c0fe080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37310/0 (socket says 172.21.15.22:37310) 2024-08-20T01:41:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.045+0000 7f14913aa640 1 -- 172.21.15.22:0/1164129897 learned_addr learned my addr 172.21.15.22:0/1164129897 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.045+0000 7f14923ac640 1 --2- 172.21.15.22:0/1164129897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f148c107d60 0x7f148c0fe5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.045+0000 7f1491bab640 1 --2- 172.21.15.22:0/1164129897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f148c1019d0 0x7f148c0fdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.045+0000 7f14913aa640 1 -- 172.21.15.22:0/1164129897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f148c1019d0 msgr2=0x7f148c0fdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.045+0000 7f14913aa640 1 --2- 172.21.15.22:0/1164129897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f148c1019d0 0x7f148c0fdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.045+0000 7f14913aa640 1 -- 172.21.15.22:0/1164129897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f148c107d60 msgr2=0x7f148c0fe5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.045+0000 7f14913aa640 1 --2- 172.21.15.22:0/1164129897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f148c107d60 0x7f148c0fe5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.045+0000 7f14913aa640 1 -- 172.21.15.22:0/1164129897 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148c1a7410 con 0x7f148c1073e0 2024-08-20T01:41:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.046+0000 7f14913aa640 1 --2- 172.21.15.22:0/1164129897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c1073e0 0x7f148c0fe080 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f147c00d950 tx=0x7f147c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.046+0000 7f1482ffd640 1 -- 172.21.15.22:0/1164129897 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c017070 con 0x7f148c1073e0 2024-08-20T01:41:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.046+0000 7f1482ffd640 1 -- 172.21.15.22:0/1164129897 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f147c009c30 con 0x7f148c1073e0 2024-08-20T01:41:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.046+0000 7f1493e0f640 1 -- 172.21.15.22:0/1164129897 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f148c1a7700 con 0x7f148c1073e0 2024-08-20T01:41:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.046+0000 7f1482ffd640 1 -- 172.21.15.22:0/1164129897 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c00f620 con 0x7f148c1073e0 2024-08-20T01:41:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.046+0000 7f1493e0f640 1 -- 172.21.15.22:0/1164129897 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f148c1a7cc0 con 0x7f148c1073e0 2024-08-20T01:41:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.048+0000 7f1496208740 1 Processor -- start 2024-08-20T01:41:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.049+0000 7f1482ffd640 1 -- 172.21.15.22:0/1164129897 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f147c010460 con 0x7f148c1073e0 2024-08-20T01:41:54.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.049+0000 7f1496208740 1 -- start start 2024-08-20T01:41:54.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.049+0000 7f1496208740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b75219e730 0x55b75219eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.049+0000 7f1496208740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b75219f050 0x55b7521aaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.049+0000 7f1496208740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7521aafe0 0x55b7521ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.049+0000 7f1496208740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b752115930 con 0x55b7521aafe0 2024-08-20T01:41:54.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.049+0000 7f1496208740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b752104e30 con 0x55b75219f050 2024-08-20T01:41:54.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.049+0000 7f1496208740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b752108e70 con 0x55b75219e730 2024-08-20T01:41:54.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.049+0000 7f14913aa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7521aafe0 0x55b7521ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.049+0000 7f1491bab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b75219f050 0x55b7521aaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.049+0000 7f14923ac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b75219e730 0x55b75219eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.049+0000 7f1491bab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b75219f050 0x55b7521aaaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:48670/0 (socket says 172.21.15.22:48670) 2024-08-20T01:41:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.049+0000 7f14913aa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7521aafe0 0x55b7521ad3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37312/0 (socket says 172.21.15.22:37312) 2024-08-20T01:41:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.049+0000 7f1491bab640 1 -- 172.21.15.22:0/1408908418 learned_addr learned my addr 172.21.15.22:0/1408908418 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.049+0000 7f1491bab640 1 -- 172.21.15.22:0/1408908418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b75219e730 msgr2=0x55b75219eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.049+0000 7f1491bab640 1 --2- 172.21.15.22:0/1408908418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b75219e730 0x55b75219eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.049+0000 7f1491bab640 1 -- 172.21.15.22:0/1408908418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7521aafe0 msgr2=0x55b7521ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.049+0000 7f1491bab640 1 --2- 172.21.15.22:0/1408908418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7521aafe0 0x55b7521ad3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.049+0000 7f1491bab640 1 -- 172.21.15.22:0/1408908418 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b751e64650 con 0x55b75219f050 2024-08-20T01:41:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.050+0000 7f1482ffd640 1 --2- 172.21.15.22:0/1164129897 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f14780b3bd0 0x7f14780b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.050+0000 7f1491bab640 1 --2- 172.21.15.22:0/1408908418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b75219f050 0x55b7521aaaa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f148802a930 tx=0x7f1488032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90fca5bd31d9ffe5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.050+0000 7f14923ac640 1 --2- 172.21.15.22:0/1164129897 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f14780b3bd0 0x7f14780b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.050+0000 7f1482ffd640 1 -- 172.21.15.22:0/1164129897 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f147c0e3870 con 0x7f148c1073e0 2024-08-20T01:41:54.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.050+0000 7f1477fff640 1 -- 172.21.15.22:0/1408908418 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148803f070 con 0x55b75219f050 2024-08-20T01:41:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.050+0000 7f1477fff640 1 -- 172.21.15.22:0/1408908418 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14880316a0 con 0x55b75219f050 2024-08-20T01:41:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.050+0000 7f1477fff640 1 -- 172.21.15.22:0/1408908418 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1488035070 con 0x55b75219f050 2024-08-20T01:41:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.051+0000 7f1496208740 1 -- 172.21.15.22:0/1408908418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b75219f050 msgr2=0x55b7521aaaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.051+0000 7f14923ac640 1 --2- 172.21.15.22:0/1164129897 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f14780b3bd0 0x7f14780b6090 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f148c0ffc00 tx=0x7f148400d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.051+0000 7f1496208740 1 --2- 172.21.15.22:0/1408908418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b75219f050 0x55b7521aaaa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f148802a930 tx=0x7f1488032ce0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.051+0000 7f1496208740 1 -- 172.21.15.22:0/1408908418 shutdown_connections 2024-08-20T01:41:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.051+0000 7f1496208740 1 --2- 172.21.15.22:0/1408908418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7521aafe0 0x55b7521ad3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.051+0000 7f1496208740 1 --2- 172.21.15.22:0/1408908418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b75219f050 0x55b7521aaaa0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.051+0000 7f1496208740 1 --2- 172.21.15.22:0/1408908418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b75219e730 0x55b75219eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.051+0000 7f1496208740 1 -- 172.21.15.22:0/1408908418 >> 172.21.15.22:0/1408908418 conn(0x55b75219c560 msgr2=0x55b75219d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:54.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.051+0000 7f1496208740 1 -- 172.21.15.22:0/1408908418 shutdown_connections 2024-08-20T01:41:54.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.051+0000 7f1496208740 1 -- 172.21.15.22:0/1408908418 wait complete. 2024-08-20T01:41:54.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.051+0000 7f1496208740 1 -- start start 2024-08-20T01:41:54.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.051+0000 7f1496208740 1 Processor -- start 2024-08-20T01:41:54.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f1496208740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b75219e730 0x55b7521a7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f1496208740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219f050 0x55b7521a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f1496208740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b7521aafe0 0x55b7521a8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f1496208740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b751f67700 con 0x55b75219f050 2024-08-20T01:41:54.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f1496208740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b75208b810 con 0x55b7521aafe0 2024-08-20T01:41:54.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f1496208740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b7521adc30 con 0x55b75219e730 2024-08-20T01:41:54.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f1496208740 10 client.0 _ll_register_callbacks cb 0x55b7520fe700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:54.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f14913aa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219f050 0x55b7521a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f14913aa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219f050 0x55b7521a84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37320/0 (socket says 172.21.15.22:37320) 2024-08-20T01:41:54.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f14913aa640 1 -- 172.21.15.22:0/1176198357 learned_addr learned my addr 172.21.15.22:0/1176198357 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:54.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f14923ac640 1 --2- 172.21.15.22:0/1176198357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b7521aafe0 0x55b7521a8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f1491bab640 1 --2- 172.21.15.22:0/1176198357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b75219e730 0x55b7521a7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f14923ac640 1 -- 172.21.15.22:0/1176198357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b75219e730 msgr2=0x55b7521a7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:54.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f14923ac640 1 --2- 172.21.15.22:0/1176198357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b75219e730 0x55b7521a7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f14923ac640 1 -- 172.21.15.22:0/1176198357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219f050 msgr2=0x55b7521a84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:54.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f14923ac640 1 --2- 172.21.15.22:0/1176198357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219f050 0x55b7521a84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f14923ac640 1 -- 172.21.15.22:0/1176198357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7521b7010 con 0x55b7521aafe0 2024-08-20T01:41:54.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f14913aa640 1 --2- 172.21.15.22:0/1176198357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219f050 0x55b7521a84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:54.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f14923ac640 1 --2- 172.21.15.22:0/1176198357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b7521aafe0 0x55b7521a8a00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f148400ac60 tx=0x7f1484004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88668b946713ade2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:54.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.052+0000 7f14757fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-08-20T01:41:54.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.053+0000 7f14757fa640 1 -- 172.21.15.22:0/1176198357 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1484028060 con 0x55b7521aafe0 2024-08-20T01:41:54.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.053+0000 7f1496208740 1 -- 172.21.15.22:0/1176198357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b7520b4150 con 0x55b7521aafe0 2024-08-20T01:41:54.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.053+0000 7f14757fa640 1 -- 172.21.15.22:0/1176198357 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f1484023670 con 0x55b7521aafe0 2024-08-20T01:41:54.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.053+0000 7f14757fa640 1 -- 172.21.15.22:0/1176198357 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1484023870 con 0x55b7521aafe0 2024-08-20T01:41:54.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.053+0000 7f1496208740 10 client.26903 fetch_fsmap learned FSMap version 34 2024-08-20T01:41:54.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.053+0000 7f1496208740 1 -- 172.21.15.22:0/1176198357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b7521b9a20 con 0x55b7521aafe0 2024-08-20T01:41:54.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.053+0000 7f14757fa640 1 -- 172.21.15.22:0/1176198357 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b7520b4150 con 0x55b7521aafe0 2024-08-20T01:41:54.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.053+0000 7f14757fa640 1 -- 172.21.15.22:0/1176198357 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f148402ea20 con 0x55b7521aafe0 2024-08-20T01:41:54.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.053+0000 7f1496208740 10 client.26903 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:41:54.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.053+0000 7f1496208740 10 client.26903 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:41:54.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.053+0000 7f1496208740 20 client.26903 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:54.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.053+0000 7f1496208740 1 --2- 172.21.15.22:0/1176198357 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55b7521baf80 0x55b7521bd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.053+0000 7f1496208740 4 client.26903 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:54.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.053+0000 7f1496208740 1 -- 172.21.15.22:0/1176198357 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b752117880 con 0x55b7521baf80 2024-08-20T01:41:54.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.054+0000 7f1491bab640 1 --2- 172.21.15.22:0/1176198357 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55b7521baf80 0x55b7521bd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.054+0000 7f1491bab640 1 --2- 172.21.15.22:0/1176198357 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55b7521baf80 0x55b7521bd3c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bfaedf7664e90d90 server_cookie=65ea78877175de74 in_seq=0 out_seq=0 2024-08-20T01:41:54.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.054+0000 7f14757fa640 10 client.26903 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:41:54.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.055+0000 7f14757fa640 1 -- 172.21.15.22:0/1176198357 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b752117880 con 0x55b7521baf80 2024-08-20T01:41:54.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.055+0000 7f14757fa640 10 client.26903 handle_command_reply: tid=0 2024-08-20T01:41:54.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.055+0000 7f1496208740 1 client.26903 shutdown 2024-08-20T01:41:54.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.055+0000 7f1496208740 1 -- 172.21.15.22:0/1176198357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b7521aafe0 msgr2=0x55b7521a8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:54.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.055+0000 7f1496208740 1 --2- 172.21.15.22:0/1176198357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b7521aafe0 0x55b7521a8a00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f148400ac60 tx=0x7f1484004a40 comp rx=0 tx=0).stop 2024-08-20T01:41:54.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.055+0000 7f1496208740 1 -- 172.21.15.22:0/1176198357 shutdown_connections 2024-08-20T01:41:54.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.055+0000 7f1496208740 1 --2- 172.21.15.22:0/1176198357 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55b7521baf80 0x55b7521bd3c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.055+0000 7f1496208740 1 --2- 172.21.15.22:0/1176198357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b7521aafe0 0x55b7521a8a00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.055+0000 7f1496208740 1 --2- 172.21.15.22:0/1176198357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219f050 0x55b7521a84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.055+0000 7f1496208740 1 --2- 172.21.15.22:0/1176198357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b75219e730 0x55b7521a7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.055+0000 7f14757fa640 0 client.26903 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:41:54.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.055+0000 7f1496208740 1 -- 172.21.15.22:0/1176198357 >> 172.21.15.22:0/1176198357 conn(0x55b75219c560 msgr2=0x55b7521a2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:54.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.055+0000 7f1496208740 1 -- 172.21.15.22:0/1176198357 shutdown_connections 2024-08-20T01:41:54.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.055+0000 7f1496208740 1 -- 172.21.15.22:0/1176198357 wait complete. 2024-08-20T01:41:54.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.055+0000 7f1496208740 20 client.26903 trim_cache size 0 max 16384 2024-08-20T01:41:54.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.068+0000 7f1496208740 1 Processor -- start 2024-08-20T01:41:54.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.068+0000 7f1496208740 1 -- start start 2024-08-20T01:41:54.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.069+0000 7f1496208740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219e730 0x55b7521a28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.069+0000 7f1496208740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b75219f050 0x55b7521a8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.069+0000 7f1496208740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7521aafe0 0x55b7521a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.069+0000 7f1496208740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f148c1b2dd0 con 0x55b75219e730 2024-08-20T01:41:54.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.069+0000 7f1496208740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f148c1b05e0 con 0x55b75219f050 2024-08-20T01:41:54.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.069+0000 7f1496208740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f148c1ae430 con 0x55b7521aafe0 2024-08-20T01:41:54.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.069+0000 7f1491bab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219e730 0x55b7521a28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.069+0000 7f1491bab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219e730 0x55b7521a28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37326/0 (socket says 172.21.15.22:37326) 2024-08-20T01:41:54.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.069+0000 7f1491bab640 1 -- 172.21.15.22:0/1612005151 learned_addr learned my addr 172.21.15.22:0/1612005151 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:54.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.069+0000 7f14923ac640 1 --2- 172.21.15.22:0/1612005151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7521aafe0 0x55b7521a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.069+0000 7f14913aa640 1 --2- 172.21.15.22:0/1612005151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b75219f050 0x55b7521a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.069+0000 7f1491bab640 1 -- 172.21.15.22:0/1612005151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7521aafe0 msgr2=0x55b7521a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:54.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.069+0000 7f1491bab640 1 --2- 172.21.15.22:0/1612005151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7521aafe0 0x55b7521a89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.069+0000 7f1491bab640 1 -- 172.21.15.22:0/1612005151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b75219f050 msgr2=0x55b7521a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:54.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.069+0000 7f1491bab640 1 --2- 172.21.15.22:0/1612005151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b75219f050 0x55b7521a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.069+0000 7f1491bab640 1 -- 172.21.15.22:0/1612005151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b75219cfe0 con 0x55b75219e730 2024-08-20T01:41:54.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.069+0000 7f14923ac640 1 --2- 172.21.15.22:0/1612005151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7521aafe0 0x55b7521a89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:54.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.069+0000 7f1491bab640 1 --2- 172.21.15.22:0/1612005151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219e730 0x55b7521a28f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f14880052f0 tx=0x7f1488000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c46d6722c55984 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:54.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.069+0000 7f14777fe640 1 -- 172.21.15.22:0/1612005151 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148803f050 con 0x55b75219e730 2024-08-20T01:41:54.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.070+0000 7f14777fe640 1 -- 172.21.15.22:0/1612005151 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1488052030 con 0x55b75219e730 2024-08-20T01:41:54.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.070+0000 7f14777fe640 1 -- 172.21.15.22:0/1612005151 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1488035040 con 0x55b75219e730 2024-08-20T01:41:54.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.070+0000 7f1496208740 1 -- 172.21.15.22:0/1612005151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219e730 msgr2=0x55b7521a28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:54.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.070+0000 7f1496208740 1 --2- 172.21.15.22:0/1612005151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219e730 0x55b7521a28f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f14880052f0 tx=0x7f1488000bc0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.070+0000 7f1496208740 1 -- 172.21.15.22:0/1612005151 shutdown_connections 2024-08-20T01:41:54.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.070+0000 7f1496208740 1 --2- 172.21.15.22:0/1612005151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7521aafe0 0x55b7521a89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.070+0000 7f1496208740 1 --2- 172.21.15.22:0/1612005151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b75219f050 0x55b7521a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.070+0000 7f1496208740 1 --2- 172.21.15.22:0/1612005151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219e730 0x55b7521a28f0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.070+0000 7f1496208740 1 -- 172.21.15.22:0/1612005151 >> 172.21.15.22:0/1612005151 conn(0x55b75219c560 msgr2=0x55b75219b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:54.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.070+0000 7f1496208740 1 -- 172.21.15.22:0/1612005151 shutdown_connections 2024-08-20T01:41:54.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.070+0000 7f1496208740 1 -- 172.21.15.22:0/1612005151 wait complete. 2024-08-20T01:41:54.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.071+0000 7f1496208740 1 -- start start 2024-08-20T01:41:54.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.071+0000 7f1496208740 1 Processor -- start 2024-08-20T01:41:54.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.071+0000 7f1496208740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219e730 0x55b7521adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.071+0000 7f1496208740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b75219f050 0x55b7521ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.071+0000 7f1496208740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7521aafe0 0x55b7521ae930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.071+0000 7f1496208740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f148c1aeaa0 con 0x55b75219e730 2024-08-20T01:41:54.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.071+0000 7f1496208740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f148c1aff10 con 0x55b75219f050 2024-08-20T01:41:54.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.071+0000 7f1496208740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f148c1af170 con 0x55b7521aafe0 2024-08-20T01:41:54.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.071+0000 7f1496208740 10 client.0 _ll_register_callbacks cb 0x7f1484009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:54.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.071+0000 7f1491bab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219e730 0x55b7521adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.071+0000 7f1491bab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219e730 0x55b7521adeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37328/0 (socket says 172.21.15.22:37328) 2024-08-20T01:41:54.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.071+0000 7f1491bab640 1 -- 172.21.15.22:0/2126433045 learned_addr learned my addr 172.21.15.22:0/2126433045 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:54.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.071+0000 7f14913aa640 1 --2- 172.21.15.22:0/2126433045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b75219f050 0x55b7521ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.071+0000 7f14923ac640 1 --2- 172.21.15.22:0/2126433045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7521aafe0 0x55b7521ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.072+0000 7f1491bab640 1 -- 172.21.15.22:0/2126433045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7521aafe0 msgr2=0x55b7521ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:54.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.072+0000 7f1491bab640 1 --2- 172.21.15.22:0/2126433045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7521aafe0 0x55b7521ae930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.072+0000 7f1491bab640 1 -- 172.21.15.22:0/2126433045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b75219f050 msgr2=0x55b7521ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:54.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.072+0000 7f1491bab640 1 --2- 172.21.15.22:0/2126433045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b75219f050 0x55b7521ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.072+0000 7f1491bab640 1 -- 172.21.15.22:0/2126433045 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b752223e10 con 0x55b75219e730 2024-08-20T01:41:54.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.072+0000 7f1491bab640 1 --2- 172.21.15.22:0/2126433045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219e730 0x55b7521adeb0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1488005aa0 tx=0x7f1488032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595720a768e68928 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:54.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.072+0000 7f14757fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:54.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.072+0000 7f14757fa640 1 -- 172.21.15.22:0/2126433045 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148805c070 con 0x55b75219e730 2024-08-20T01:41:54.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.072+0000 7f14757fa640 1 -- 172.21.15.22:0/2126433045 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f1488005600 con 0x55b75219e730 2024-08-20T01:41:54.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.072+0000 7f1496208740 1 -- 172.21.15.22:0/2126433045 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1488052030 con 0x55b75219e730 2024-08-20T01:41:54.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.072+0000 7f14757fa640 1 -- 172.21.15.22:0/2126433045 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1488068050 con 0x55b75219e730 2024-08-20T01:41:54.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.072+0000 7f1496208740 10 client.17325 fetch_fsmap learned FSMap version 34 2024-08-20T01:41:54.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.072+0000 7f1496208740 1 -- 172.21.15.22:0/2126433045 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b752225110 con 0x55b75219e730 2024-08-20T01:41:54.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.072+0000 7f14757fa640 1 -- 172.21.15.22:0/2126433045 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1488052030 con 0x55b75219e730 2024-08-20T01:41:54.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.073+0000 7f14757fa640 1 -- 172.21.15.22:0/2126433045 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f148804b070 con 0x55b75219e730 2024-08-20T01:41:54.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.073+0000 7f1496208740 10 client.17325 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:41:54.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.073+0000 7f1496208740 10 client.17325 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:41:54.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.073+0000 7f1496208740 20 client.17325 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:54.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.073+0000 7f1496208740 1 --2- 172.21.15.22:0/2126433045 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55b7522253e0 0x55b752227800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.073+0000 7f1496208740 4 client.17325 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:41:54.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.073+0000 7f1496208740 1 -- 172.21.15.22:0/2126433045 --> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b752113320 con 0x55b7522253e0 2024-08-20T01:41:54.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.073+0000 7f14913aa640 1 --2- 172.21.15.22:0/2126433045 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55b7522253e0 0x55b752227800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.073+0000 7f14757fa640 10 client.17325 ms_handle_connect on v2:172.21.15.134:6836/2260901499 2024-08-20T01:41:54.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.073+0000 7f14913aa640 1 --2- 172.21.15.22:0/2126433045 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55b7522253e0 0x55b752227800 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ac9dcb7f24c18df6 server_cookie=2464fe393349501b in_seq=0 out_seq=0 2024-08-20T01:41:54.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.074+0000 7f14757fa640 1 -- 172.21.15.22:0/2126433045 <== mds.2 v2:172.21.15.134:6836/2260901499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b752113320 con 0x55b7522253e0 2024-08-20T01:41:54.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.074+0000 7f14757fa640 10 client.17325 handle_command_reply: tid=0 2024-08-20T01:41:54.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.074+0000 7f1496208740 1 client.17325 shutdown 2024-08-20T01:41:54.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.074+0000 7f1496208740 1 -- 172.21.15.22:0/2126433045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219e730 msgr2=0x55b7521adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:54.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.074+0000 7f1496208740 1 --2- 172.21.15.22:0/2126433045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219e730 0x55b7521adeb0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1488005aa0 tx=0x7f1488032ce0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.074+0000 7f1496208740 1 -- 172.21.15.22:0/2126433045 shutdown_connections 2024-08-20T01:41:54.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.074+0000 7f1496208740 1 --2- 172.21.15.22:0/2126433045 >> [v2:172.21.15.134:6836/2260901499,v1:172.21.15.134:6837/2260901499] conn(0x55b7522253e0 0x55b752227800 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.074+0000 7f1496208740 1 --2- 172.21.15.22:0/2126433045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7521aafe0 0x55b7521ae930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.074+0000 7f1496208740 1 --2- 172.21.15.22:0/2126433045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b75219f050 0x55b7521ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.074+0000 7f14757fa640 0 client.17325 ms_handle_reset on v2:172.21.15.134:6836/2260901499 2024-08-20T01:41:54.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.074+0000 7f1496208740 1 --2- 172.21.15.22:0/2126433045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b75219e730 0x55b7521adeb0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.074+0000 7f1496208740 1 -- 172.21.15.22:0/2126433045 >> 172.21.15.22:0/2126433045 conn(0x55b75219c560 msgr2=0x55b7521a95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:54.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.074+0000 7f1496208740 1 -- 172.21.15.22:0/2126433045 shutdown_connections 2024-08-20T01:41:54.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.074+0000 7f1496208740 1 -- 172.21.15.22:0/2126433045 wait complete. 2024-08-20T01:41:54.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.074+0000 7f1496208740 20 client.17325 trim_cache size 0 max 16384 2024-08-20T01:41:54.082 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:41:54.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.075+0000 7f1493e0f640 1 -- 172.21.15.22:0/1164129897 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f14780b3bd0 msgr2=0x7f14780b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:54.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.075+0000 7f1493e0f640 1 --2- 172.21.15.22:0/1164129897 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f14780b3bd0 0x7f14780b6090 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f148c0ffc00 tx=0x7f148400d040 comp rx=0 tx=0).stop 2024-08-20T01:41:54.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.075+0000 7f1493e0f640 1 -- 172.21.15.22:0/1164129897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c1073e0 msgr2=0x7f148c0fe080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:54.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.075+0000 7f1493e0f640 1 --2- 172.21.15.22:0/1164129897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c1073e0 0x7f148c0fe080 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f147c00d950 tx=0x7f147c00de10 comp rx=0 tx=0).stop 2024-08-20T01:41:54.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.075+0000 7f1493e0f640 1 -- 172.21.15.22:0/1164129897 shutdown_connections 2024-08-20T01:41:54.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.075+0000 7f1493e0f640 1 --2- 172.21.15.22:0/1164129897 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f14780b3bd0 0x7f14780b6090 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.075+0000 7f1493e0f640 1 --2- 172.21.15.22:0/1164129897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f148c107d60 0x7f148c0fe5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.075+0000 7f1493e0f640 1 --2- 172.21.15.22:0/1164129897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c1073e0 0x7f148c0fe080 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.075+0000 7f1493e0f640 1 --2- 172.21.15.22:0/1164129897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f148c1019d0 0x7f148c0fdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.075+0000 7f1493e0f640 1 -- 172.21.15.22:0/1164129897 >> 172.21.15.22:0/1164129897 conn(0x7f148c0fd440 msgr2=0x7f148c06b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:54.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.075+0000 7f1493e0f640 1 -- 172.21.15.22:0/1164129897 shutdown_connections 2024-08-20T01:41:54.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:54.075+0000 7f1493e0f640 1 -- 172.21.15.22:0/1164129897 wait complete. 2024-08-20T01:41:54.803 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:41:55.063 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:55.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:55 smithi022 ceph-mon[18709]: pgmap v671: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 762 KiB/s wr, 319 op/s 2024-08-20T01:41:55.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:55 smithi134 ceph-mon[22511]: pgmap v671: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 762 KiB/s wr, 319 op/s 2024-08-20T01:41:55.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:55 smithi077 ceph-mon[22251]: pgmap v671: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 762 KiB/s wr, 319 op/s 2024-08-20T01:41:55.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.543+0000 7fb928563640 1 -- 172.21.15.22:0/3672102680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb920107d60 msgr2=0x7fb92010e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:55.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.543+0000 7fb928563640 1 --2- 172.21.15.22:0/3672102680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb920107d60 0x7fb92010e560 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb918009ca0 tx=0x7fb91802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.543+0000 7fb928563640 1 -- 172.21.15.22:0/3672102680 shutdown_connections 2024-08-20T01:41:55.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.543+0000 7fb928563640 1 --2- 172.21.15.22:0/3672102680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb920107d60 0x7fb92010e560 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.543+0000 7fb928563640 1 --2- 172.21.15.22:0/3672102680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9201073e0 0x7fb920107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.543+0000 7fb928563640 1 --2- 172.21.15.22:0/3672102680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9201019d0 0x7fb920101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.543+0000 7fb928563640 1 -- 172.21.15.22:0/3672102680 >> 172.21.15.22:0/3672102680 conn(0x7fb9200fd440 msgr2=0x7fb9200ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:55.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.543+0000 7fb928563640 1 -- 172.21.15.22:0/3672102680 shutdown_connections 2024-08-20T01:41:55.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.544+0000 7fb928563640 1 -- 172.21.15.22:0/3672102680 wait complete. 2024-08-20T01:41:55.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.544+0000 7fb928563640 1 Processor -- start 2024-08-20T01:41:55.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.544+0000 7fb928563640 1 -- start start 2024-08-20T01:41:55.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.544+0000 7fb928563640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9201019d0 0x7fb92019b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:55.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.544+0000 7fb928563640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9201073e0 0x7fb92019b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:55.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.544+0000 7fb928563640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb920107d60 0x7fb9201a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:55.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.545+0000 7fb928563640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb920111a20 con 0x7fb920107d60 2024-08-20T01:41:55.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.545+0000 7fb928563640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb9201118a0 con 0x7fb9201019d0 2024-08-20T01:41:55.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.545+0000 7fb928563640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb920111ba0 con 0x7fb9201073e0 2024-08-20T01:41:55.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.545+0000 7fb9262ff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9201019d0 0x7fb92019b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:55.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.545+0000 7fb926b00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb920107d60 0x7fb9201a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:55.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.545+0000 7fb9262ff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9201019d0 0x7fb92019b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.22:48732/0 (socket says 172.21.15.22:48732) 2024-08-20T01:41:55.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.545+0000 7fb926b00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb920107d60 0x7fb9201a0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37346/0 (socket says 172.21.15.22:37346) 2024-08-20T01:41:55.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.545+0000 7fb9262ff640 1 -- 172.21.15.22:0/2932190806 learned_addr learned my addr 172.21.15.22:0/2932190806 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:55.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.545+0000 7fb925afe640 1 --2- 172.21.15.22:0/2932190806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9201073e0 0x7fb92019b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:55.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.545+0000 7fb9262ff640 1 -- 172.21.15.22:0/2932190806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9201073e0 msgr2=0x7fb92019b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:55.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.545+0000 7fb9262ff640 1 --2- 172.21.15.22:0/2932190806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9201073e0 0x7fb92019b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.545+0000 7fb9262ff640 1 -- 172.21.15.22:0/2932190806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb920107d60 msgr2=0x7fb9201a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:55.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.545+0000 7fb9262ff640 1 --2- 172.21.15.22:0/2932190806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb920107d60 0x7fb9201a0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.545+0000 7fb9262ff640 1 -- 172.21.15.22:0/2932190806 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9201a11e0 con 0x7fb9201019d0 2024-08-20T01:41:55.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.545+0000 7fb926b00640 1 --2- 172.21.15.22:0/2932190806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb920107d60 0x7fb9201a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:55.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.545+0000 7fb9262ff640 1 --2- 172.21.15.22:0/2932190806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9201019d0 0x7fb92019b130 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00d770 tx=0x7fb91c00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:55.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.545+0000 7fb9137fe640 1 -- 172.21.15.22:0/2932190806 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c017070 con 0x7fb9201019d0 2024-08-20T01:41:55.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.546+0000 7fb928563640 1 -- 172.21.15.22:0/2932190806 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9201a14d0 con 0x7fb9201019d0 2024-08-20T01:41:55.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.546+0000 7fb9137fe640 1 -- 172.21.15.22:0/2932190806 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb91c0054d0 con 0x7fb9201019d0 2024-08-20T01:41:55.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.546+0000 7fb9137fe640 1 -- 172.21.15.22:0/2932190806 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c004c30 con 0x7fb9201019d0 2024-08-20T01:41:55.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.546+0000 7fb928563640 1 -- 172.21.15.22:0/2932190806 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9201a7b90 con 0x7fb9201019d0 2024-08-20T01:41:55.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.548+0000 7fb92a95c740 1 Processor -- start 2024-08-20T01:41:55.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.548+0000 7fb92a95c740 1 -- start start 2024-08-20T01:41:55.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.548+0000 7fb92a95c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb388880 0x5594cb388c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:55.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.548+0000 7fb92a95c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb3891a0 0x5594cb394bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:55.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.548+0000 7fb92a95c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb395130 0x5594cb397520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:55.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.548+0000 7fb92a95c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5594cb2ff930 con 0x5594cb395130 2024-08-20T01:41:55.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.548+0000 7fb92a95c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5594cb2eee30 con 0x5594cb3891a0 2024-08-20T01:41:55.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.548+0000 7fb92a95c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5594cb2f2e70 con 0x5594cb388880 2024-08-20T01:41:55.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.549+0000 7fb925afe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb395130 0x5594cb397520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:55.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.549+0000 7fb925afe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb395130 0x5594cb397520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37348/0 (socket says 172.21.15.22:37348) 2024-08-20T01:41:55.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.549+0000 7fb925afe640 1 -- 172.21.15.22:0/64262459 learned_addr learned my addr 172.21.15.22:0/64262459 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:55.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.549+0000 7fb9137fe640 1 -- 172.21.15.22:0/2932190806 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb91c004e10 con 0x7fb9201019d0 2024-08-20T01:41:55.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.549+0000 7fb926b00640 1 --2- 172.21.15.22:0/64262459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb388880 0x5594cb388c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:55.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.549+0000 7fb925afe640 1 -- 172.21.15.22:0/64262459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb388880 msgr2=0x5594cb388c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:55.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.549+0000 7fb925afe640 1 --2- 172.21.15.22:0/64262459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb388880 0x5594cb388c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.549+0000 7fb925afe640 1 -- 172.21.15.22:0/64262459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb3891a0 msgr2=0x5594cb394bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:55.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.549+0000 7fb925afe640 1 --2- 172.21.15.22:0/64262459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb3891a0 0x5594cb394bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.549+0000 7fb925afe640 1 -- 172.21.15.22:0/64262459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594cb04e650 con 0x5594cb395130 2024-08-20T01:41:55.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.549+0000 7fb925afe640 1 --2- 172.21.15.22:0/64262459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb395130 0x5594cb397520 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb91400bce0 tx=0x7fb9140107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e385e957cb20f54f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:55.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.549+0000 7fb910ff9640 1 -- 172.21.15.22:0/64262459 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914004030 con 0x5594cb395130 2024-08-20T01:41:55.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.549+0000 7fb910ff9640 1 -- 172.21.15.22:0/64262459 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9140041d0 con 0x5594cb395130 2024-08-20T01:41:55.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.549+0000 7fb910ff9640 1 -- 172.21.15.22:0/64262459 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9140117b0 con 0x5594cb395130 2024-08-20T01:41:55.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.550+0000 7fb9137fe640 1 --2- 172.21.15.22:0/2932190806 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb90c0b3bd0 0x7fb90c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:55.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.550+0000 7fb926b00640 1 --2- 172.21.15.22:0/2932190806 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb90c0b3bd0 0x7fb90c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:55.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.550+0000 7fb9137fe640 1 -- 172.21.15.22:0/2932190806 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7fb91c0e36a0 con 0x7fb9201019d0 2024-08-20T01:41:55.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.550+0000 7fb92a95c740 1 -- 172.21.15.22:0/64262459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb395130 msgr2=0x5594cb397520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:55.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.550+0000 7fb92a95c740 1 --2- 172.21.15.22:0/64262459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb395130 0x5594cb397520 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb91400bce0 tx=0x7fb9140107a0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.550+0000 7fb92a95c740 1 -- 172.21.15.22:0/64262459 shutdown_connections 2024-08-20T01:41:55.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.550+0000 7fb92a95c740 1 --2- 172.21.15.22:0/64262459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb395130 0x5594cb397520 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.550+0000 7fb92a95c740 1 --2- 172.21.15.22:0/64262459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb3891a0 0x5594cb394bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.550+0000 7fb92a95c740 1 --2- 172.21.15.22:0/64262459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb388880 0x5594cb388c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.550+0000 7fb92a95c740 1 -- 172.21.15.22:0/64262459 >> 172.21.15.22:0/64262459 conn(0x5594cb3866b0 msgr2=0x5594cb387850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:55.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.550+0000 7fb926b00640 1 --2- 172.21.15.22:0/2932190806 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb90c0b3bd0 0x7fb90c0b6090 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb918009430 tx=0x7fb918032f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:55.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.550+0000 7fb92a95c740 1 -- 172.21.15.22:0/64262459 shutdown_connections 2024-08-20T01:41:55.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.550+0000 7fb92a95c740 1 -- 172.21.15.22:0/64262459 wait complete. 2024-08-20T01:41:55.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.551+0000 7fb92a95c740 1 -- start start 2024-08-20T01:41:55.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.551+0000 7fb92a95c740 1 Processor -- start 2024-08-20T01:41:55.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.551+0000 7fb92a95c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb388880 0x5594cb3921f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:55.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.551+0000 7fb92a95c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb3891a0 0x5594cb392730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:55.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.551+0000 7fb92a95c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb395130 0x5594cb392c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:55.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.551+0000 7fb92a95c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5594cb151700 con 0x5594cb3891a0 2024-08-20T01:41:55.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.551+0000 7fb92a95c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5594cb275810 con 0x5594cb395130 2024-08-20T01:41:55.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.551+0000 7fb92a95c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5594cb397de0 con 0x5594cb388880 2024-08-20T01:41:55.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.551+0000 7fb92a95c740 10 client.0 _ll_register_callbacks cb 0x5594cb2e8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:55.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.551+0000 7fb925afe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb3891a0 0x5594cb392730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:55.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.551+0000 7fb925afe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb3891a0 0x5594cb392730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37352/0 (socket says 172.21.15.22:37352) 2024-08-20T01:41:55.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.551+0000 7fb925afe640 1 -- 172.21.15.22:0/3230047731 learned_addr learned my addr 172.21.15.22:0/3230047731 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:55.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.551+0000 7fb926b00640 1 --2- 172.21.15.22:0/3230047731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb395130 0x5594cb392c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:55.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.551+0000 7fb9262ff640 1 --2- 172.21.15.22:0/3230047731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb388880 0x5594cb3921f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:55.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.551+0000 7fb925afe640 1 -- 172.21.15.22:0/3230047731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb388880 msgr2=0x5594cb3921f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:55.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.551+0000 7fb925afe640 1 --2- 172.21.15.22:0/3230047731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb388880 0x5594cb3921f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.551+0000 7fb925afe640 1 -- 172.21.15.22:0/3230047731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb395130 msgr2=0x5594cb392c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:55.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.551+0000 7fb925afe640 1 --2- 172.21.15.22:0/3230047731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb395130 0x5594cb392c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.551+0000 7fb925afe640 1 -- 172.21.15.22:0/3230047731 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594cb3a12c0 con 0x5594cb3891a0 2024-08-20T01:41:55.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.552+0000 7fb9262ff640 1 --2- 172.21.15.22:0/3230047731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb388880 0x5594cb3921f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:55.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.552+0000 7fb925afe640 1 --2- 172.21.15.22:0/3230047731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb3891a0 0x5594cb392730 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb914011010 tx=0x7fb914004140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f56fcda128b55a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:55.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.552+0000 7fb909ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:55.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.552+0000 7fb909ffb640 1 -- 172.21.15.22:0/3230047731 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914029060 con 0x5594cb3891a0 2024-08-20T01:41:55.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.552+0000 7fb92a95c740 1 -- 172.21.15.22:0/3230047731 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5594cb29e150 con 0x5594cb3891a0 2024-08-20T01:41:55.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.552+0000 7fb909ffb640 1 -- 172.21.15.22:0/3230047731 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7fb91400bdd0 con 0x5594cb3891a0 2024-08-20T01:41:55.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.552+0000 7fb909ffb640 1 -- 172.21.15.22:0/3230047731 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb914005040 con 0x5594cb3891a0 2024-08-20T01:41:55.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.552+0000 7fb92a95c740 10 client.17337 fetch_fsmap learned FSMap version 34 2024-08-20T01:41:55.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.552+0000 7fb92a95c740 1 -- 172.21.15.22:0/3230047731 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5594cb3a3cc0 con 0x5594cb3891a0 2024-08-20T01:41:55.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.552+0000 7fb909ffb640 1 -- 172.21.15.22:0/3230047731 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5594cb29e150 con 0x5594cb3891a0 2024-08-20T01:41:55.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.552+0000 7fb909ffb640 1 -- 172.21.15.22:0/3230047731 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fb9140046c0 con 0x5594cb3891a0 2024-08-20T01:41:55.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.553+0000 7fb92a95c740 10 client.17337 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:41:55.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.553+0000 7fb92a95c740 10 client.17337 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:41:55.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.553+0000 7fb92a95c740 20 client.17337 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:55.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.553+0000 7fb92a95c740 1 --2- 172.21.15.22:0/3230047731 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5594cb3a5070 0x5594cb3a7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:55.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.553+0000 7fb92a95c740 4 client.17337 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:55.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.553+0000 7fb92a95c740 1 -- 172.21.15.22:0/3230047731 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594cb301880 con 0x5594cb3a5070 2024-08-20T01:41:55.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.553+0000 7fb9262ff640 1 --2- 172.21.15.22:0/3230047731 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5594cb3a5070 0x5594cb3a7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:55.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.553+0000 7fb9262ff640 1 --2- 172.21.15.22:0/3230047731 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5594cb3a5070 0x5594cb3a7460 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4347338f61f85ff1 server_cookie=469e21b054f41be8 in_seq=0 out_seq=0 2024-08-20T01:41:55.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.553+0000 7fb909ffb640 10 client.17337 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:41:55.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.554+0000 7fb909ffb640 1 -- 172.21.15.22:0/3230047731 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5594cb301880 con 0x5594cb3a5070 2024-08-20T01:41:55.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.554+0000 7fb909ffb640 10 client.17337 handle_command_reply: tid=0 2024-08-20T01:41:55.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.554+0000 7fb92a95c740 1 client.17337 shutdown 2024-08-20T01:41:55.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.554+0000 7fb92a95c740 1 -- 172.21.15.22:0/3230047731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb3891a0 msgr2=0x5594cb392730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:55.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.554+0000 7fb92a95c740 1 --2- 172.21.15.22:0/3230047731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb3891a0 0x5594cb392730 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb914011010 tx=0x7fb914004140 comp rx=0 tx=0).stop 2024-08-20T01:41:55.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.554+0000 7fb92a95c740 1 -- 172.21.15.22:0/3230047731 shutdown_connections 2024-08-20T01:41:55.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.554+0000 7fb92a95c740 1 --2- 172.21.15.22:0/3230047731 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5594cb3a5070 0x5594cb3a7460 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.555+0000 7fb92a95c740 1 --2- 172.21.15.22:0/3230047731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb395130 0x5594cb392c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.555+0000 7fb909ffb640 0 client.17337 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:41:55.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.555+0000 7fb92a95c740 1 --2- 172.21.15.22:0/3230047731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb3891a0 0x5594cb392730 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.555+0000 7fb92a95c740 1 --2- 172.21.15.22:0/3230047731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb388880 0x5594cb3921f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.555+0000 7fb92a95c740 1 -- 172.21.15.22:0/3230047731 >> 172.21.15.22:0/3230047731 conn(0x5594cb3866b0 msgr2=0x5594cb38c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:55.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.555+0000 7fb92a95c740 1 -- 172.21.15.22:0/3230047731 shutdown_connections 2024-08-20T01:41:55.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.555+0000 7fb92a95c740 1 -- 172.21.15.22:0/3230047731 wait complete. 2024-08-20T01:41:55.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.555+0000 7fb92a95c740 20 client.17337 trim_cache size 0 max 16384 2024-08-20T01:41:55.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.568+0000 7fb92a95c740 1 Processor -- start 2024-08-20T01:41:55.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.568+0000 7fb92a95c740 1 -- start start 2024-08-20T01:41:55.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.568+0000 7fb92a95c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb388880 0x5594cb393f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:55.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.568+0000 7fb92a95c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb3891a0 0x5594cb3acac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:55.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.568+0000 7fb92a95c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb395130 0x5594cb3ad000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:55.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.568+0000 7fb92a95c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb9201b2d00 con 0x5594cb3891a0 2024-08-20T01:41:55.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.568+0000 7fb92a95c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb9201b0510 con 0x5594cb395130 2024-08-20T01:41:55.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.568+0000 7fb92a95c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9201ae360 con 0x5594cb388880 2024-08-20T01:41:55.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.568+0000 7fb925afe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb3891a0 0x5594cb3acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:55.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.568+0000 7fb925afe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb3891a0 0x5594cb3acac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37358/0 (socket says 172.21.15.22:37358) 2024-08-20T01:41:55.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.568+0000 7fb925afe640 1 -- 172.21.15.22:0/902645691 learned_addr learned my addr 172.21.15.22:0/902645691 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:55.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.568+0000 7fb9262ff640 1 --2- 172.21.15.22:0/902645691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb388880 0x5594cb393f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:55.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.569+0000 7fb926b00640 1 --2- 172.21.15.22:0/902645691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb395130 0x5594cb3ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:55.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.569+0000 7fb925afe640 1 -- 172.21.15.22:0/902645691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb388880 msgr2=0x5594cb393f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:55.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.569+0000 7fb925afe640 1 --2- 172.21.15.22:0/902645691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb388880 0x5594cb393f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.569+0000 7fb925afe640 1 -- 172.21.15.22:0/902645691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb395130 msgr2=0x5594cb3ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:55.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.569+0000 7fb925afe640 1 --2- 172.21.15.22:0/902645691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb395130 0x5594cb3ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.569+0000 7fb925afe640 1 -- 172.21.15.22:0/902645691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594cb393430 con 0x5594cb3891a0 2024-08-20T01:41:55.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.569+0000 7fb9262ff640 1 --2- 172.21.15.22:0/902645691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb388880 0x5594cb393f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:55.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.569+0000 7fb925afe640 1 --2- 172.21.15.22:0/902645691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb3891a0 0x5594cb3acac0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fb91400b3d0 tx=0x7fb914003de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2762292c9d72580f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:55.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.569+0000 7fb90bfff640 1 -- 172.21.15.22:0/902645691 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914029050 con 0x5594cb3891a0 2024-08-20T01:41:55.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.569+0000 7fb90bfff640 1 -- 172.21.15.22:0/902645691 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb91400bb00 con 0x5594cb3891a0 2024-08-20T01:41:55.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.569+0000 7fb90bfff640 1 -- 172.21.15.22:0/902645691 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914005610 con 0x5594cb3891a0 2024-08-20T01:41:55.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.570+0000 7fb92a95c740 1 -- 172.21.15.22:0/902645691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb3891a0 msgr2=0x5594cb3acac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:55.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.570+0000 7fb92a95c740 1 --2- 172.21.15.22:0/902645691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb3891a0 0x5594cb3acac0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fb91400b3d0 tx=0x7fb914003de0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.570+0000 7fb92a95c740 1 -- 172.21.15.22:0/902645691 shutdown_connections 2024-08-20T01:41:55.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.570+0000 7fb92a95c740 1 --2- 172.21.15.22:0/902645691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb395130 0x5594cb3ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.570+0000 7fb92a95c740 1 --2- 172.21.15.22:0/902645691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb3891a0 0x5594cb3acac0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.570+0000 7fb92a95c740 1 --2- 172.21.15.22:0/902645691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb388880 0x5594cb393f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.570+0000 7fb92a95c740 1 -- 172.21.15.22:0/902645691 >> 172.21.15.22:0/902645691 conn(0x5594cb3866b0 msgr2=0x5594cb393820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.570+0000 7fb92a95c740 1 -- 172.21.15.22:0/902645691 shutdown_connections 2024-08-20T01:41:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.570+0000 7fb92a95c740 1 -- 172.21.15.22:0/902645691 wait complete. 2024-08-20T01:41:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.570+0000 7fb92a95c740 1 -- start start 2024-08-20T01:41:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.570+0000 7fb92a95c740 1 Processor -- start 2024-08-20T01:41:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb92a95c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb388880 0x5594cb39d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb92a95c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb3891a0 0x5594cb398030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb92a95c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb395130 0x5594cb3987c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb92a95c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb9201ae9d0 con 0x5594cb395130 2024-08-20T01:41:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb92a95c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb9201afe40 con 0x5594cb388880 2024-08-20T01:41:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb92a95c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9201af0a0 con 0x5594cb3891a0 2024-08-20T01:41:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb92a95c740 10 client.0 _ll_register_callbacks cb 0x7fb918009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb926b00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb395130 0x5594cb3987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:55.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb926b00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb395130 0x5594cb3987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37370/0 (socket says 172.21.15.22:37370) 2024-08-20T01:41:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb926b00640 1 -- 172.21.15.22:0/2905855087 learned_addr learned my addr 172.21.15.22:0/2905855087 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb9262ff640 1 --2- 172.21.15.22:0/2905855087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb388880 0x5594cb39d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb925afe640 1 --2- 172.21.15.22:0/2905855087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb3891a0 0x5594cb398030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb926b00640 1 -- 172.21.15.22:0/2905855087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb3891a0 msgr2=0x5594cb398030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb926b00640 1 --2- 172.21.15.22:0/2905855087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb3891a0 0x5594cb398030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb926b00640 1 -- 172.21.15.22:0/2905855087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb388880 msgr2=0x5594cb39d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb926b00640 1 --2- 172.21.15.22:0/2905855087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb388880 0x5594cb39d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb926b00640 1 -- 172.21.15.22:0/2905855087 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594cb40da80 con 0x5594cb395130 2024-08-20T01:41:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb9262ff640 1 --2- 172.21.15.22:0/2905855087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb388880 0x5594cb39d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb925afe640 1 --2- 172.21.15.22:0/2905855087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb3891a0 0x5594cb398030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb926b00640 1 --2- 172.21.15.22:0/2905855087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb395130 0x5594cb3987c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fb918009ca0 tx=0x7fb9180095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524fb51e94ba5158 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb909ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb909ffb640 1 -- 172.21.15.22:0/2905855087 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb918059060 con 0x5594cb395130 2024-08-20T01:41:55.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb909ffb640 1 -- 172.21.15.22:0/2905855087 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7fb918004450 con 0x5594cb395130 2024-08-20T01:41:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.571+0000 7fb92a95c740 1 -- 172.21.15.22:0/2905855087 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb91400bb00 con 0x5594cb395130 2024-08-20T01:41:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.572+0000 7fb909ffb640 1 -- 172.21.15.22:0/2905855087 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb918004650 con 0x5594cb395130 2024-08-20T01:41:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.572+0000 7fb92a95c740 10 client.17343 fetch_fsmap learned FSMap version 34 2024-08-20T01:41:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.572+0000 7fb92a95c740 1 -- 172.21.15.22:0/2905855087 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5594cb40ed30 con 0x5594cb395130 2024-08-20T01:41:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.572+0000 7fb909ffb640 1 -- 172.21.15.22:0/2905855087 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb91400bb00 con 0x5594cb395130 2024-08-20T01:41:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.572+0000 7fb909ffb640 1 -- 172.21.15.22:0/2905855087 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fb918030760 con 0x5594cb395130 2024-08-20T01:41:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.572+0000 7fb92a95c740 10 client.17343 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:41:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.572+0000 7fb92a95c740 10 client.17343 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-20T01:41:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.572+0000 7fb92a95c740 20 client.17343 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.572+0000 7fb92a95c740 1 --2- 172.21.15.22:0/2905855087 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5594cb3a5070 0x5594cb411580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.572+0000 7fb92a95c740 4 client.17343 mds_command: new command op to 24575 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:41:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.572+0000 7fb92a95c740 1 -- 172.21.15.22:0/2905855087 --> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5594cb2fd320 con 0x5594cb3a5070 2024-08-20T01:41:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.572+0000 7fb9262ff640 1 --2- 172.21.15.22:0/2905855087 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5594cb3a5070 0x5594cb411580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:55.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.573+0000 7fb9262ff640 1 --2- 172.21.15.22:0/2905855087 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5594cb3a5070 0x5594cb411580 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=51aaf0e214aea1b2 server_cookie=a6481692f466773f in_seq=0 out_seq=0 2024-08-20T01:41:55.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.573+0000 7fb909ffb640 10 client.17343 ms_handle_connect on v2:172.21.15.77:6838/49188248 2024-08-20T01:41:55.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.573+0000 7fb909ffb640 1 -- 172.21.15.22:0/2905855087 <== mds.1 v2:172.21.15.77:6838/49188248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5594cb2fd320 con 0x5594cb3a5070 2024-08-20T01:41:55.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.573+0000 7fb909ffb640 10 client.17343 handle_command_reply: tid=0 2024-08-20T01:41:55.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.573+0000 7fb92a95c740 1 client.17343 shutdown 2024-08-20T01:41:55.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.573+0000 7fb92a95c740 1 -- 172.21.15.22:0/2905855087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb395130 msgr2=0x5594cb3987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:55.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.573+0000 7fb92a95c740 1 --2- 172.21.15.22:0/2905855087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb395130 0x5594cb3987c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fb918009ca0 tx=0x7fb9180095c0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.573+0000 7fb92a95c740 1 -- 172.21.15.22:0/2905855087 shutdown_connections 2024-08-20T01:41:55.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.573+0000 7fb92a95c740 1 --2- 172.21.15.22:0/2905855087 >> [v2:172.21.15.77:6838/49188248,v1:172.21.15.77:6839/49188248] conn(0x5594cb3a5070 0x5594cb411580 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.573+0000 7fb92a95c740 1 --2- 172.21.15.22:0/2905855087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5594cb395130 0x5594cb3987c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.573+0000 7fb92a95c740 1 --2- 172.21.15.22:0/2905855087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594cb3891a0 0x5594cb398030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.573+0000 7fb909ffb640 0 client.17343 ms_handle_reset on v2:172.21.15.77:6838/49188248 2024-08-20T01:41:55.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.573+0000 7fb92a95c740 1 --2- 172.21.15.22:0/2905855087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5594cb388880 0x5594cb39d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.573+0000 7fb92a95c740 1 -- 172.21.15.22:0/2905855087 >> 172.21.15.22:0/2905855087 conn(0x5594cb3866b0 msgr2=0x5594cb394040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:55.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.573+0000 7fb92a95c740 1 -- 172.21.15.22:0/2905855087 shutdown_connections 2024-08-20T01:41:55.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.573+0000 7fb92a95c740 1 -- 172.21.15.22:0/2905855087 wait complete. 2024-08-20T01:41:55.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.574+0000 7fb92a95c740 20 client.17343 trim_cache size 0 max 16384 2024-08-20T01:41:55.581 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:41:55.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.574+0000 7fb928563640 1 -- 172.21.15.22:0/2932190806 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb90c0b3bd0 msgr2=0x7fb90c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:55.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.574+0000 7fb928563640 1 --2- 172.21.15.22:0/2932190806 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb90c0b3bd0 0x7fb90c0b6090 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb918009430 tx=0x7fb918032f70 comp rx=0 tx=0).stop 2024-08-20T01:41:55.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.574+0000 7fb928563640 1 -- 172.21.15.22:0/2932190806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9201019d0 msgr2=0x7fb92019b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:55.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.574+0000 7fb928563640 1 --2- 172.21.15.22:0/2932190806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9201019d0 0x7fb92019b130 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00d770 tx=0x7fb91c00dc30 comp rx=0 tx=0).stop 2024-08-20T01:41:55.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.574+0000 7fb928563640 1 -- 172.21.15.22:0/2932190806 shutdown_connections 2024-08-20T01:41:55.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.574+0000 7fb928563640 1 --2- 172.21.15.22:0/2932190806 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fb90c0b3bd0 0x7fb90c0b6090 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.574+0000 7fb928563640 1 --2- 172.21.15.22:0/2932190806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb920107d60 0x7fb9201a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.574+0000 7fb928563640 1 --2- 172.21.15.22:0/2932190806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9201073e0 0x7fb92019b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.574+0000 7fb928563640 1 --2- 172.21.15.22:0/2932190806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9201019d0 0x7fb92019b130 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:55.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.574+0000 7fb928563640 1 -- 172.21.15.22:0/2932190806 >> 172.21.15.22:0/2932190806 conn(0x7fb9200fd440 msgr2=0x7fb92006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:55.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.574+0000 7fb928563640 1 -- 172.21.15.22:0/2932190806 shutdown_connections 2024-08-20T01:41:55.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:55.574+0000 7fb928563640 1 -- 172.21.15.22:0/2932190806 wait complete. 2024-08-20T01:41:56.331 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:41:56.594 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.046+0000 7f43f4683640 1 -- 172.21.15.22:0/1294366301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1073e0 msgr2=0x7f43ec107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.046+0000 7f43f4683640 1 --2- 172.21.15.22:0/1294366301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1073e0 0x7f43ec107820 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009900 tx=0x7f43e002a3f0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.046+0000 7f43f4683640 1 -- 172.21.15.22:0/1294366301 shutdown_connections 2024-08-20T01:41:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.046+0000 7f43f4683640 1 --2- 172.21.15.22:0/1294366301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43ec107d60 0x7f43ec10e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.046+0000 7f43f4683640 1 --2- 172.21.15.22:0/1294366301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1073e0 0x7f43ec107820 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.046+0000 7f43f4683640 1 --2- 172.21.15.22:0/1294366301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ec1019d0 0x7f43ec101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.046+0000 7f43f4683640 1 -- 172.21.15.22:0/1294366301 >> 172.21.15.22:0/1294366301 conn(0x7f43ec0fd440 msgr2=0x7f43ec0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.046+0000 7f43f4683640 1 -- 172.21.15.22:0/1294366301 shutdown_connections 2024-08-20T01:41:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.046+0000 7f43f4683640 1 -- 172.21.15.22:0/1294366301 wait complete. 2024-08-20T01:41:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.047+0000 7f43f4683640 1 Processor -- start 2024-08-20T01:41:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.047+0000 7f43f4683640 1 -- start start 2024-08-20T01:41:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.047+0000 7f43f4683640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1019d0 0x7f43ec10f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.047+0000 7f43f4683640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ec1073e0 0x7f43ec10f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.047+0000 7f43f4683640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43ec107d60 0x7f43ec10faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.047+0000 7f43f4683640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec112b10 con 0x7f43ec1019d0 2024-08-20T01:41:57.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.047+0000 7f43f4683640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec112990 con 0x7f43ec1073e0 2024-08-20T01:41:57.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.047+0000 7f43f4683640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec112c90 con 0x7f43ec107d60 2024-08-20T01:41:57.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.047+0000 7f43f241f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1019d0 0x7f43ec10f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.047+0000 7f43f241f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1019d0 0x7f43ec10f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37396/0 (socket says 172.21.15.22:37396) 2024-08-20T01:41:57.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.047+0000 7f43f241f640 1 -- 172.21.15.22:0/225594157 learned_addr learned my addr 172.21.15.22:0/225594157 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:57.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.047+0000 7f43f1c1e640 1 --2- 172.21.15.22:0/225594157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ec1073e0 0x7f43ec10f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.047+0000 7f43f241f640 1 -- 172.21.15.22:0/225594157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43ec107d60 msgr2=0x7f43ec10faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:57.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.047+0000 7f43f2c20640 1 --2- 172.21.15.22:0/225594157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43ec107d60 0x7f43ec10faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.047+0000 7f43f241f640 1 --2- 172.21.15.22:0/225594157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43ec107d60 0x7f43ec10faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.047+0000 7f43f241f640 1 -- 172.21.15.22:0/225594157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ec1073e0 msgr2=0x7f43ec10f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:57.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.047+0000 7f43f241f640 1 --2- 172.21.15.22:0/225594157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ec1073e0 0x7f43ec10f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.047+0000 7f43f241f640 1 -- 172.21.15.22:0/225594157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ec1a7340 con 0x7f43ec1019d0 2024-08-20T01:41:57.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.047+0000 7f43f1c1e640 1 --2- 172.21.15.22:0/225594157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ec1073e0 0x7f43ec10f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:57.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.048+0000 7f43f241f640 1 --2- 172.21.15.22:0/225594157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1019d0 0x7f43ec10f070 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f43e800d950 tx=0x7f43e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:57.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.048+0000 7f43df7fe640 1 -- 172.21.15.22:0/225594157 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e8017030 con 0x7f43ec1019d0 2024-08-20T01:41:57.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.048+0000 7f43f4683640 1 -- 172.21.15.22:0/225594157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43ec1a7630 con 0x7f43ec1019d0 2024-08-20T01:41:57.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.048+0000 7f43df7fe640 1 -- 172.21.15.22:0/225594157 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43e8004020 con 0x7f43ec1019d0 2024-08-20T01:41:57.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.048+0000 7f43df7fe640 1 -- 172.21.15.22:0/225594157 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e80047a0 con 0x7f43ec1019d0 2024-08-20T01:41:57.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.048+0000 7f43f4683640 1 -- 172.21.15.22:0/225594157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43ec1a7b70 con 0x7f43ec1019d0 2024-08-20T01:41:57.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.051+0000 7f43f6a7c740 1 Processor -- start 2024-08-20T01:41:57.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.051+0000 7f43df7fe640 1 -- 172.21.15.22:0/225594157 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f43e8009a30 con 0x7f43ec1019d0 2024-08-20T01:41:57.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.051+0000 7f43f6a7c740 1 -- start start 2024-08-20T01:41:57.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.051+0000 7f43f6a7c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9094d880 0x55bf9094dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.051+0000 7f43f6a7c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094e1a0 0x55bf90959bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.051+0000 7f43f6a7c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9095a130 0x55bf9095c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.051+0000 7f43f6a7c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55bf908c4930 con 0x55bf9094e1a0 2024-08-20T01:41:57.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.051+0000 7f43f6a7c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55bf908b3e30 con 0x55bf9094d880 2024-08-20T01:41:57.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.051+0000 7f43f6a7c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bf908b7e70 con 0x55bf9095a130 2024-08-20T01:41:57.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.051+0000 7f43f241f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094e1a0 0x55bf90959bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.051+0000 7f43f241f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094e1a0 0x55bf90959bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37402/0 (socket says 172.21.15.22:37402) 2024-08-20T01:41:57.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.051+0000 7f43f241f640 1 -- 172.21.15.22:0/2141890663 learned_addr learned my addr 172.21.15.22:0/2141890663 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.051+0000 7f43f2c20640 1 --2- 172.21.15.22:0/2141890663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9094d880 0x55bf9094dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.051+0000 7f43f1c1e640 1 --2- 172.21.15.22:0/2141890663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9095a130 0x55bf9095c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.051+0000 7f43f241f640 1 -- 172.21.15.22:0/2141890663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9095a130 msgr2=0x55bf9095c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.052+0000 7f43f241f640 1 --2- 172.21.15.22:0/2141890663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9095a130 0x55bf9095c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.052+0000 7f43f241f640 1 -- 172.21.15.22:0/2141890663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9094d880 msgr2=0x55bf9094dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.052+0000 7f43f241f640 1 --2- 172.21.15.22:0/2141890663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9094d880 0x55bf9094dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.052+0000 7f43f241f640 1 -- 172.21.15.22:0/2141890663 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf90613650 con 0x55bf9094e1a0 2024-08-20T01:41:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.052+0000 7f43df7fe640 1 --2- 172.21.15.22:0/225594157 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f43d80b3bd0 0x7f43d80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.052+0000 7f43f241f640 1 --2- 172.21.15.22:0/2141890663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094e1a0 0x55bf90959bf0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f43e80e9ab0 tx=0x7f43e80e9f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868c9d55d92a90c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.052+0000 7f43f2c20640 1 --2- 172.21.15.22:0/225594157 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f43d80b3bd0 0x7f43d80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.052+0000 7f43dcff9640 1 -- 172.21.15.22:0/2141890663 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e80a65b0 con 0x55bf9094e1a0 2024-08-20T01:41:57.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.052+0000 7f43df7fe640 1 -- 172.21.15.22:0/225594157 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f43e80e37e0 con 0x7f43ec1019d0 2024-08-20T01:41:57.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.052+0000 7f43dcff9640 1 -- 172.21.15.22:0/2141890663 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43e80aa200 con 0x55bf9094e1a0 2024-08-20T01:41:57.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.052+0000 7f43dcff9640 1 -- 172.21.15.22:0/2141890663 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e80a9e60 con 0x55bf9094e1a0 2024-08-20T01:41:57.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.053+0000 7f43f6a7c740 1 -- 172.21.15.22:0/2141890663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094e1a0 msgr2=0x55bf90959bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:57.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.053+0000 7f43f2c20640 1 --2- 172.21.15.22:0/225594157 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f43d80b3bd0 0x7f43d80b6090 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f43e4005fd0 tx=0x7f43e4008590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:57.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.053+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/2141890663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094e1a0 0x55bf90959bf0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f43e80e9ab0 tx=0x7f43e80e9f70 comp rx=0 tx=0).stop 2024-08-20T01:41:57.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.053+0000 7f43f6a7c740 1 -- 172.21.15.22:0/2141890663 shutdown_connections 2024-08-20T01:41:57.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.053+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/2141890663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9095a130 0x55bf9095c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.053+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/2141890663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094e1a0 0x55bf90959bf0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.053+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/2141890663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9094d880 0x55bf9094dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.053+0000 7f43f6a7c740 1 -- 172.21.15.22:0/2141890663 >> 172.21.15.22:0/2141890663 conn(0x55bf9094b6b0 msgr2=0x55bf9094c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:57.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.053+0000 7f43f6a7c740 1 -- 172.21.15.22:0/2141890663 shutdown_connections 2024-08-20T01:41:57.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.053+0000 7f43f6a7c740 1 -- 172.21.15.22:0/2141890663 wait complete. 2024-08-20T01:41:57.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.053+0000 7f43f6a7c740 1 -- start start 2024-08-20T01:41:57.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.053+0000 7f43f6a7c740 1 Processor -- start 2024-08-20T01:41:57.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43f6a7c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9094d880 0x55bf90959b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43f6a7c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9094e1a0 0x55bf90956fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43f6a7c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9095a130 0x55bf90957770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43f6a7c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55bf90716700 con 0x55bf9095a130 2024-08-20T01:41:57.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43f6a7c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55bf9083a810 con 0x55bf9094e1a0 2024-08-20T01:41:57.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43f6a7c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bf9095ce30 con 0x55bf9094d880 2024-08-20T01:41:57.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43f6a7c740 10 client.0 _ll_register_callbacks cb 0x55bf908ad700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:57.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43f2c20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9095a130 0x55bf90957770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43f2c20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9095a130 0x55bf90957770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37418/0 (socket says 172.21.15.22:37418) 2024-08-20T01:41:57.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43f2c20640 1 -- 172.21.15.22:0/24562253 learned_addr learned my addr 172.21.15.22:0/24562253 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43f241f640 1 --2- 172.21.15.22:0/24562253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9094d880 0x55bf90959b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43f1c1e640 1 --2- 172.21.15.22:0/24562253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9094e1a0 0x55bf90956fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43f2c20640 1 -- 172.21.15.22:0/24562253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9094d880 msgr2=0x55bf90959b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43f2c20640 1 --2- 172.21.15.22:0/24562253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9094d880 0x55bf90959b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43f2c20640 1 -- 172.21.15.22:0/24562253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9094e1a0 msgr2=0x55bf90956fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43f2c20640 1 --2- 172.21.15.22:0/24562253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9094e1a0 0x55bf90956fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43f2c20640 1 -- 172.21.15.22:0/24562253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf90966160 con 0x55bf9095a130 2024-08-20T01:41:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43f1c1e640 1 --2- 172.21.15.22:0/24562253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9094e1a0 0x55bf90956fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43f2c20640 1 --2- 172.21.15.22:0/24562253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9095a130 0x55bf90957770 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f43e4008cd0 tx=0x7f43e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30221074584513d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.054+0000 7f43d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.055+0000 7f43d5ffb640 1 -- 172.21.15.22:0/24562253 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e4019e50 con 0x55bf9095a130 2024-08-20T01:41:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.055+0000 7f43d5ffb640 1 -- 172.21.15.22:0/24562253 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f43e4004b20 con 0x55bf9095a130 2024-08-20T01:41:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.055+0000 7f43f6a7c740 1 -- 172.21.15.22:0/24562253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bf90863150 con 0x55bf9095a130 2024-08-20T01:41:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.055+0000 7f43d5ffb640 1 -- 172.21.15.22:0/24562253 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f43e4004d20 con 0x55bf9095a130 2024-08-20T01:41:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.055+0000 7f43f6a7c740 10 client.17355 fetch_fsmap learned FSMap version 34 2024-08-20T01:41:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.055+0000 7f43f6a7c740 1 -- 172.21.15.22:0/24562253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55bf90968b20 con 0x55bf9095a130 2024-08-20T01:41:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.055+0000 7f43d5ffb640 1 -- 172.21.15.22:0/24562253 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55bf90863150 con 0x55bf9095a130 2024-08-20T01:41:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.055+0000 7f43d5ffb640 1 -- 172.21.15.22:0/24562253 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f43e4017040 con 0x55bf9095a130 2024-08-20T01:41:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.055+0000 7f43f6a7c740 10 client.17355 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:41:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.055+0000 7f43f6a7c740 10 client.17355 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.055+0000 7f43f6a7c740 20 client.17355 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.055+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/24562253 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55bf9096a0d0 0x55bf9096c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.055+0000 7f43f6a7c740 4 client.17355 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.055+0000 7f43f6a7c740 1 -- 172.21.15.22:0/24562253 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf908c6880 con 0x55bf9096a0d0 2024-08-20T01:41:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.056+0000 7f43f241f640 1 --2- 172.21.15.22:0/24562253 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55bf9096a0d0 0x55bf9096c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.056+0000 7f43d5ffb640 10 client.17355 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.056+0000 7f43f241f640 1 --2- 172.21.15.22:0/24562253 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55bf9096a0d0 0x55bf9096c4e0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a564ae7fd4686632 server_cookie=9990882c59788b6d in_seq=0 out_seq=0 2024-08-20T01:41:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.057+0000 7f43d5ffb640 1 -- 172.21.15.22:0/24562253 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bf908c6880 con 0x55bf9096a0d0 2024-08-20T01:41:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.057+0000 7f43d5ffb640 10 client.17355 handle_command_reply: tid=0 2024-08-20T01:41:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.057+0000 7f43f6a7c740 1 client.17355 shutdown 2024-08-20T01:41:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.057+0000 7f43f6a7c740 1 -- 172.21.15.22:0/24562253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9095a130 msgr2=0x55bf90957770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.057+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/24562253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9095a130 0x55bf90957770 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f43e4008cd0 tx=0x7f43e4004a40 comp rx=0 tx=0).stop 2024-08-20T01:41:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.057+0000 7f43f6a7c740 1 -- 172.21.15.22:0/24562253 shutdown_connections 2024-08-20T01:41:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.057+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/24562253 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55bf9096a0d0 0x55bf9096c4e0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.057+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/24562253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9095a130 0x55bf90957770 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.057+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/24562253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9094e1a0 0x55bf90956fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.057+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/24562253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9094d880 0x55bf90959b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.057+0000 7f43f6a7c740 1 -- 172.21.15.22:0/24562253 >> 172.21.15.22:0/24562253 conn(0x55bf9094b6b0 msgr2=0x55bf90951250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.057+0000 7f43d5ffb640 0 client.17355 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.057+0000 7f43f6a7c740 1 -- 172.21.15.22:0/24562253 shutdown_connections 2024-08-20T01:41:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.057+0000 7f43f6a7c740 1 -- 172.21.15.22:0/24562253 wait complete. 2024-08-20T01:41:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.057+0000 7f43f6a7c740 20 client.17355 trim_cache size 0 max 16384 2024-08-20T01:41:57.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f6a7c740 1 Processor -- start 2024-08-20T01:41:57.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f6a7c740 1 -- start start 2024-08-20T01:41:57.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f6a7c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9094d880 0x55bf9094cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f6a7c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094e1a0 0x55bf90956be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f6a7c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9095a130 0x55bf90971df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f6a7c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec1b2df0 con 0x55bf9094e1a0 2024-08-20T01:41:57.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f6a7c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec1b0600 con 0x55bf9095a130 2024-08-20T01:41:57.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f6a7c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec1ae450 con 0x55bf9094d880 2024-08-20T01:41:57.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f1c1e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094e1a0 0x55bf90956be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f1c1e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094e1a0 0x55bf90956be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37432/0 (socket says 172.21.15.22:37432) 2024-08-20T01:41:57.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f1c1e640 1 -- 172.21.15.22:0/2869672962 learned_addr learned my addr 172.21.15.22:0/2869672962 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:57.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f2c20640 1 --2- 172.21.15.22:0/2869672962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9095a130 0x55bf90971df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f241f640 1 --2- 172.21.15.22:0/2869672962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9094d880 0x55bf9094cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f1c1e640 1 -- 172.21.15.22:0/2869672962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9094d880 msgr2=0x55bf9094cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:57.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f1c1e640 1 --2- 172.21.15.22:0/2869672962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9094d880 0x55bf9094cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f1c1e640 1 -- 172.21.15.22:0/2869672962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9095a130 msgr2=0x55bf90971df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:57.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f1c1e640 1 --2- 172.21.15.22:0/2869672962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9095a130 0x55bf90971df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f1c1e640 1 -- 172.21.15.22:0/2869672962 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf9094dfd0 con 0x55bf9094e1a0 2024-08-20T01:41:57.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f241f640 1 --2- 172.21.15.22:0/2869672962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9094d880 0x55bf9094cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:57.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.071+0000 7f43f2c20640 1 --2- 172.21.15.22:0/2869672962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9095a130 0x55bf90971df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:57.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.072+0000 7f43f1c1e640 1 --2- 172.21.15.22:0/2869672962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094e1a0 0x55bf90956be0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009230 tx=0x7f43e0032e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca2482d31db4666 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:57.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.072+0000 7f43d7fff640 1 -- 172.21.15.22:0/2869672962 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e0035070 con 0x55bf9094e1a0 2024-08-20T01:41:57.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.072+0000 7f43d7fff640 1 -- 172.21.15.22:0/2869672962 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43e0031720 con 0x55bf9094e1a0 2024-08-20T01:41:57.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.072+0000 7f43d7fff640 1 -- 172.21.15.22:0/2869672962 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e00046c0 con 0x55bf9094e1a0 2024-08-20T01:41:57.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.072+0000 7f43f6a7c740 1 -- 172.21.15.22:0/2869672962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094e1a0 msgr2=0x55bf90956be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:57.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.072+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/2869672962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094e1a0 0x55bf90956be0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009230 tx=0x7f43e0032e90 comp rx=0 tx=0).stop 2024-08-20T01:41:57.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.072+0000 7f43f6a7c740 1 -- 172.21.15.22:0/2869672962 shutdown_connections 2024-08-20T01:41:57.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.072+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/2869672962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9095a130 0x55bf90971df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.072+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/2869672962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094e1a0 0x55bf90956be0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.072+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/2869672962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9094d880 0x55bf9094cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.072+0000 7f43f6a7c740 1 -- 172.21.15.22:0/2869672962 >> 172.21.15.22:0/2869672962 conn(0x55bf9094b6b0 msgr2=0x55bf909564d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:57.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.073+0000 7f43f6a7c740 1 -- 172.21.15.22:0/2869672962 shutdown_connections 2024-08-20T01:41:57.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.073+0000 7f43f6a7c740 1 -- 172.21.15.22:0/2869672962 wait complete. 2024-08-20T01:41:57.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.073+0000 7f43f6a7c740 1 -- start start 2024-08-20T01:41:57.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.073+0000 7f43f6a7c740 1 Processor -- start 2024-08-20T01:41:57.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.073+0000 7f43f6a7c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094d880 0x55bf9095d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.073+0000 7f43f6a7c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9094e1a0 0x55bf9095d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.073+0000 7f43f6a7c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9095a130 0x55bf909d2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.073+0000 7f43f6a7c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec1aeac0 con 0x55bf9094d880 2024-08-20T01:41:57.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.073+0000 7f43f6a7c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec1aff30 con 0x55bf9094e1a0 2024-08-20T01:41:57.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.073+0000 7f43f6a7c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec1af190 con 0x55bf9095a130 2024-08-20T01:41:57.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.073+0000 7f43f6a7c740 10 client.0 _ll_register_callbacks cb 0x7f43e4008b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:57.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.073+0000 7f43f241f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094d880 0x55bf9095d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.073+0000 7f43f241f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094d880 0x55bf9095d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37446/0 (socket says 172.21.15.22:37446) 2024-08-20T01:41:57.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.073+0000 7f43f241f640 1 -- 172.21.15.22:0/1529664441 learned_addr learned my addr 172.21.15.22:0/1529664441 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:57.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.073+0000 7f43f1c1e640 1 --2- 172.21.15.22:0/1529664441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9094e1a0 0x55bf9095d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.073+0000 7f43f2c20640 1 --2- 172.21.15.22:0/1529664441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9095a130 0x55bf909d2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.074+0000 7f43f241f640 1 -- 172.21.15.22:0/1529664441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9095a130 msgr2=0x55bf909d2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:57.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.074+0000 7f43f241f640 1 --2- 172.21.15.22:0/1529664441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9095a130 0x55bf909d2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.074+0000 7f43f241f640 1 -- 172.21.15.22:0/1529664441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9094e1a0 msgr2=0x55bf9095d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:57.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.074+0000 7f43f241f640 1 --2- 172.21.15.22:0/1529664441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9094e1a0 0x55bf9095d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.074+0000 7f43f241f640 1 -- 172.21.15.22:0/1529664441 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf909d32f0 con 0x55bf9094d880 2024-08-20T01:41:57.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.074+0000 7f43f2c20640 1 --2- 172.21.15.22:0/1529664441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9095a130 0x55bf909d2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:57.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.074+0000 7f43f241f640 1 --2- 172.21.15.22:0/1529664441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094d880 0x55bf9095d4b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f43e80a7960 tx=0x7f43e80a6b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9090334e93f26005 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:57.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.074+0000 7f43d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-08-20T01:41:57.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.074+0000 7f43d5ffb640 1 -- 172.21.15.22:0/1529664441 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e80aa040 con 0x55bf9094d880 2024-08-20T01:41:57.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.074+0000 7f43d5ffb640 1 -- 172.21.15.22:0/1529664441 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f43e80e93a0 con 0x55bf9094d880 2024-08-20T01:41:57.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.074+0000 7f43f6a7c740 1 -- 172.21.15.22:0/1529664441 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43e0031720 con 0x55bf9094d880 2024-08-20T01:41:57.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.074+0000 7f43d5ffb640 1 -- 172.21.15.22:0/1529664441 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f43e80aa4c0 con 0x55bf9094d880 2024-08-20T01:41:57.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.074+0000 7f43f6a7c740 10 client.17361 fetch_fsmap learned FSMap version 34 2024-08-20T01:41:57.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.074+0000 7f43f6a7c740 1 -- 172.21.15.22:0/1529664441 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55bf909d44e0 con 0x55bf9094d880 2024-08-20T01:41:57.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.074+0000 7f43d5ffb640 1 -- 172.21.15.22:0/1529664441 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43e0031720 con 0x55bf9094d880 2024-08-20T01:41:57.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.075+0000 7f43d5ffb640 1 -- 172.21.15.22:0/1529664441 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f43e80cd0b0 con 0x55bf9094d880 2024-08-20T01:41:57.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.075+0000 7f43f6a7c740 10 client.17361 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:41:57.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.075+0000 7f43f6a7c740 10 client.17361 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-20T01:41:57.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.075+0000 7f43f6a7c740 20 client.17361 populate_metadata read hostname 'smithi022' 2024-08-20T01:41:57.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.075+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/1529664441 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55bf909d4870 0x55bf909d6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.075+0000 7f43f6a7c740 4 client.17361 mds_command: new command op to 24586 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:41:57.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.075+0000 7f43f6a7c740 1 -- 172.21.15.22:0/1529664441 --> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bf908c2320 con 0x55bf909d4870 2024-08-20T01:41:57.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.075+0000 7f43f1c1e640 1 --2- 172.21.15.22:0/1529664441 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55bf909d4870 0x55bf909d6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.075+0000 7f43d5ffb640 10 client.17361 ms_handle_connect on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:57.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.075+0000 7f43f1c1e640 1 --2- 172.21.15.22:0/1529664441 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55bf909d4870 0x55bf909d6c90 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2932966c4b996cc6 server_cookie=efbfe62f8046a04a in_seq=0 out_seq=0 2024-08-20T01:41:57.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.075+0000 7f43d5ffb640 1 -- 172.21.15.22:0/1529664441 <== mds.0 v2:172.21.15.134:6838/2873888279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bf908c2320 con 0x55bf909d4870 2024-08-20T01:41:57.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.075+0000 7f43d5ffb640 10 client.17361 handle_command_reply: tid=0 2024-08-20T01:41:57.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.075+0000 7f43f6a7c740 1 client.17361 shutdown 2024-08-20T01:41:57.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.076+0000 7f43f6a7c740 1 -- 172.21.15.22:0/1529664441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094d880 msgr2=0x55bf9095d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:57.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.076+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/1529664441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094d880 0x55bf9095d4b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f43e80a7960 tx=0x7f43e80a6b90 comp rx=0 tx=0).stop 2024-08-20T01:41:57.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.076+0000 7f43f6a7c740 1 -- 172.21.15.22:0/1529664441 shutdown_connections 2024-08-20T01:41:57.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.076+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/1529664441 >> [v2:172.21.15.134:6838/2873888279,v1:172.21.15.134:6839/2873888279] conn(0x55bf909d4870 0x55bf909d6c90 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.076+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/1529664441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bf9095a130 0x55bf909d2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.076+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/1529664441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bf9094e1a0 0x55bf9095d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.076+0000 7f43f6a7c740 1 --2- 172.21.15.22:0/1529664441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bf9094d880 0x55bf9095d4b0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.076+0000 7f43f6a7c740 1 -- 172.21.15.22:0/1529664441 >> 172.21.15.22:0/1529664441 conn(0x55bf9094b6b0 msgr2=0x55bf90956cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:57.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.076+0000 7f43d5ffb640 0 client.17361 ms_handle_reset on v2:172.21.15.134:6838/2873888279 2024-08-20T01:41:57.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.076+0000 7f43f6a7c740 1 -- 172.21.15.22:0/1529664441 shutdown_connections 2024-08-20T01:41:57.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.076+0000 7f43f6a7c740 1 -- 172.21.15.22:0/1529664441 wait complete. 2024-08-20T01:41:57.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.076+0000 7f43f6a7c740 20 client.17361 trim_cache size 0 max 16384 2024-08-20T01:41:57.088 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-08-20T01:41:57.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.076+0000 7f43f4683640 1 -- 172.21.15.22:0/225594157 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f43d80b3bd0 msgr2=0x7f43d80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:57.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.076+0000 7f43f4683640 1 --2- 172.21.15.22:0/225594157 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f43d80b3bd0 0x7f43d80b6090 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f43e4005fd0 tx=0x7f43e4008590 comp rx=0 tx=0).stop 2024-08-20T01:41:57.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.076+0000 7f43f4683640 1 -- 172.21.15.22:0/225594157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1019d0 msgr2=0x7f43ec10f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:57.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.076+0000 7f43f4683640 1 --2- 172.21.15.22:0/225594157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1019d0 0x7f43ec10f070 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f43e800d950 tx=0x7f43e800de10 comp rx=0 tx=0).stop 2024-08-20T01:41:57.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.076+0000 7f43f4683640 1 -- 172.21.15.22:0/225594157 shutdown_connections 2024-08-20T01:41:57.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.077+0000 7f43f4683640 1 --2- 172.21.15.22:0/225594157 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f43d80b3bd0 0x7f43d80b6090 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.077+0000 7f43f4683640 1 --2- 172.21.15.22:0/225594157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43ec107d60 0x7f43ec10faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.077+0000 7f43f4683640 1 --2- 172.21.15.22:0/225594157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ec1073e0 0x7f43ec10f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.077+0000 7f43f4683640 1 --2- 172.21.15.22:0/225594157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1019d0 0x7f43ec10f070 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.077+0000 7f43f4683640 1 -- 172.21.15.22:0/225594157 >> 172.21.15.22:0/225594157 conn(0x7f43ec0fd440 msgr2=0x7f43ec0ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:57.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.077+0000 7f43f4683640 1 -- 172.21.15.22:0/225594157 shutdown_connections 2024-08-20T01:41:57.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.077+0000 7f43f4683640 1 -- 172.21.15.22:0/225594157 wait complete. 2024-08-20T01:41:57.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:57 smithi134 ceph-mon[22511]: pgmap v672: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 764 KiB/s wr, 260 op/s 2024-08-20T01:41:57.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:57 smithi077 ceph-mon[22251]: pgmap v672: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 764 KiB/s wr, 260 op/s 2024-08-20T01:41:57.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:57 smithi022 ceph-mon[18709]: pgmap v672: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 764 KiB/s wr, 260 op/s 2024-08-20T01:41:57.773 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_ef4275410d8483698016fe484b2a3c664080b4c1/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/github.com_ceph_ceph-c_ef4275410d8483698016fe484b2a3c664080b4c1/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/github.com_ceph_ceph-c_ef4275410d8483698016fe484b2a3c664080b4c1/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-08-20T01:41:57.773 INFO:tasks.fwd_scrub:done joining 2024-08-20T01:41:57.774 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-08-20T01:41:57.787 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-20T01:41:57.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.890+0000 7f11faf0b640 1 -- 172.21.15.22:0/2668510080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11f406b6c0 msgr2=0x7f11f41052f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:57.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.890+0000 7f11faf0b640 1 --2- 172.21.15.22:0/2668510080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11f406b6c0 0x7f11f41052f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f11f0009900 tx=0x7f11f002a410 comp rx=0 tx=0).stop 2024-08-20T01:41:57.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.890+0000 7f11faf0b640 1 -- 172.21.15.22:0/2668510080 shutdown_connections 2024-08-20T01:41:57.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.890+0000 7f11faf0b640 1 --2- 172.21.15.22:0/2668510080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f41083a0 0x7f11f410a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.890+0000 7f11faf0b640 1 --2- 172.21.15.22:0/2668510080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11f4105830 0x7f11f4107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.890+0000 7f11faf0b640 1 --2- 172.21.15.22:0/2668510080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11f406b6c0 0x7f11f41052f0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.890+0000 7f11faf0b640 1 -- 172.21.15.22:0/2668510080 >> 172.21.15.22:0/2668510080 conn(0x7f11f40fce20 msgr2=0x7f11f40ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.890+0000 7f11faf0b640 1 -- 172.21.15.22:0/2668510080 shutdown_connections 2024-08-20T01:41:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.890+0000 7f11faf0b640 1 -- 172.21.15.22:0/2668510080 wait complete. 2024-08-20T01:41:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.890+0000 7f11faf0b640 1 Processor -- start 2024-08-20T01:41:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11faf0b640 1 -- start start 2024-08-20T01:41:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11faf0b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11f406b6c0 0x7f11f4198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11faf0b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11f4105830 0x7f11f4199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11faf0b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f41083a0 0x7f11f4199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11faf0b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f11f410e370 con 0x7f11f406b6c0 2024-08-20T01:41:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11faf0b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f11f410e1f0 con 0x7f11f41083a0 2024-08-20T01:41:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11faf0b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f11f410e4f0 con 0x7f11f4105830 2024-08-20T01:41:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11f8ca7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11f406b6c0 0x7f11f4198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11f8ca7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11f406b6c0 0x7f11f4198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37464/0 (socket says 172.21.15.22:37464) 2024-08-20T01:41:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11f8ca7640 1 -- 172.21.15.22:0/3714770837 learned_addr learned my addr 172.21.15.22:0/3714770837 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11f94a8640 1 --2- 172.21.15.22:0/3714770837 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f41083a0 0x7f11f4199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11f8ca7640 1 -- 172.21.15.22:0/3714770837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11f4105830 msgr2=0x7f11f4199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11f8ca7640 1 --2- 172.21.15.22:0/3714770837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11f4105830 0x7f11f4199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11f8ca7640 1 -- 172.21.15.22:0/3714770837 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f41083a0 msgr2=0x7f11f4199d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11f8ca7640 1 --2- 172.21.15.22:0/3714770837 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f41083a0 0x7f11f4199d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11f8ca7640 1 -- 172.21.15.22:0/3714770837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f419a600 con 0x7f11f406b6c0 2024-08-20T01:41:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11f94a8640 1 --2- 172.21.15.22:0/3714770837 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f41083a0 0x7f11f4199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11f8ca7640 1 --2- 172.21.15.22:0/3714770837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11f406b6c0 0x7f11f4198ac0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f11f0005940 tx=0x7f11f0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11e9ffb640 1 -- 172.21.15.22:0/3714770837 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f003f030 con 0x7f11f406b6c0 2024-08-20T01:41:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11e9ffb640 1 -- 172.21.15.22:0/3714770837 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11f0003cb0 con 0x7f11f406b6c0 2024-08-20T01:41:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11e9ffb640 1 -- 172.21.15.22:0/3714770837 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f0035070 con 0x7f11f406b6c0 2024-08-20T01:41:57.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.891+0000 7f11faf0b640 1 -- 172.21.15.22:0/3714770837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f419a890 con 0x7f11f406b6c0 2024-08-20T01:41:57.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.892+0000 7f11faf0b640 1 -- 172.21.15.22:0/3714770837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f41a0fc0 con 0x7f11f406b6c0 2024-08-20T01:41:57.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.893+0000 7f11faf0b640 1 -- 172.21.15.22:0/3714770837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11f40fe910 con 0x7f11f406b6c0 2024-08-20T01:41:57.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.894+0000 7f11e9ffb640 1 -- 172.21.15.22:0/3714770837 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f11f0042030 con 0x7f11f406b6c0 2024-08-20T01:41:57.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.895+0000 7f11e9ffb640 1 --2- 172.21.15.22:0/3714770837 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f11dc0b3bd0 0x7f11dc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:57.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.895+0000 7f11e9ffb640 1 -- 172.21.15.22:0/3714770837 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f11f0104940 con 0x7f11f406b6c0 2024-08-20T01:41:57.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.895+0000 7f11ebfff640 1 --2- 172.21.15.22:0/3714770837 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f11dc0b3bd0 0x7f11dc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:57.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.895+0000 7f11ebfff640 1 --2- 172.21.15.22:0/3714770837 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f11dc0b3bd0 0x7f11dc0b6090 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f11f406bc00 tx=0x7f11e4006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:57.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:57.898+0000 7f11e9ffb640 1 -- 172.21.15.22:0/3714770837 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f11f00cbef0 con 0x7f11f406b6c0 2024-08-20T01:41:58.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.085+0000 7f11faf0b640 1 -- 172.21.15.22:0/3714770837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11f4063a80 con 0x7f11f406b6c0 2024-08-20T01:41:58.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.086+0000 7f11e9ffb640 1 -- 172.21.15.22:0/3714770837 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22747 (secure 0 0 0) 0x7f11f00cb7f0 con 0x7f11f406b6c0 2024-08-20T01:41:58.089 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:41:58.089 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":81,"fsid":"586fd06c-5e92-11ef-bccf-c7b262605968","created":"2024-08-20T01:20:55.065729+0000","modified":"2024-08-20T01:41:17.967010+0000","last_up_change":"2024-08-20T01:28:14.752931+0000","last_in_change":"2024-08-20T01:27:51.812525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:24:31.674035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:29:02.800545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:29:04.951975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b67a59af-5eea-4073-a4b2-604a1b7b8f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6803","nonce":812056903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6805","nonce":812056903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6809","nonce":812056903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6807","nonce":812056903}]},"public_addr":"172.21.15.22:6803/812056903","cluster_addr":"172.21.15.22:6805/812056903","heartbeat_back_addr":"172.21.15.22:6809/812056903","heartbeat_front_addr":"172.21.15.22:6807/812056903","state":["exists","up"]},{"osd":1,"uuid":"9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6801","nonce":823882511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6803","nonce":823882511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6807","nonce":823882511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6805","nonce":823882511}]},"public_addr":"172.21.15.77:6801/823882511","cluster_addr":"172.21.15.77:6803/823882511","heartbeat_back_addr":"172.21.15.77:6807/823882511","heartbeat_front_addr":"172.21.15.77:6805/823882511","state":["exists","up"]},{"osd":2,"uuid":"71e3c019-a3e0-4632-81a8-27ac31279f7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6801","nonce":3873702897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6803","nonce":3873702897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6807","nonce":3873702897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6805","nonce":3873702897}]},"public_addr":"172.21.15.134:6801/3873702897","cluster_addr":"172.21.15.134:6803/3873702897","heartbeat_back_addr":"172.21.15.134:6807/3873702897","heartbeat_front_addr":"172.21.15.134:6805/3873702897","state":["exists","up"]},{"osd":3,"uuid":"a60de748-aa65-477d-864e-6281db1261ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6811","nonce":1775946906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6813","nonce":1775946906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6817","nonce":1775946906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6815","nonce":1775946906}]},"public_addr":"172.21.15.22:6811/1775946906","cluster_addr":"172.21.15.22:6813/1775946906","heartbeat_back_addr":"172.21.15.22:6817/1775946906","heartbeat_front_addr":"172.21.15.22:6815/1775946906","state":["exists","up"]},{"osd":4,"uuid":"07d99671-2ece-471c-ad69-fc9043d917f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6809","nonce":1954209322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6811","nonce":1954209322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6815","nonce":1954209322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6813","nonce":1954209322}]},"public_addr":"172.21.15.77:6809/1954209322","cluster_addr":"172.21.15.77:6811/1954209322","heartbeat_back_addr":"172.21.15.77:6815/1954209322","heartbeat_front_addr":"172.21.15.77:6813/1954209322","state":["exists","up"]},{"osd":5,"uuid":"971cac33-0b98-49b1-b4b2-27354fc0ab90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6809","nonce":2805488123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6811","nonce":2805488123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6815","nonce":2805488123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6813","nonce":2805488123}]},"public_addr":"172.21.15.134:6809/2805488123","cluster_addr":"172.21.15.134:6811/2805488123","heartbeat_back_addr":"172.21.15.134:6815/2805488123","heartbeat_front_addr":"172.21.15.134:6813/2805488123","state":["exists","up"]},{"osd":6,"uuid":"48d90292-8511-47d6-8093-330bd13ae70e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6819","nonce":3804882416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6821","nonce":3804882416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6825","nonce":3804882416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6823","nonce":3804882416}]},"public_addr":"172.21.15.22:6819/3804882416","cluster_addr":"172.21.15.22:6821/3804882416","heartbeat_back_addr":"172.21.15.22:6825/3804882416","heartbeat_front_addr":"172.21.15.22:6823/3804882416","state":["exists","up"]},{"osd":7,"uuid":"e217112d-9f56-4a48-93bf-6eb052ce540a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6817","nonce":700318902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6819","nonce":700318902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6823","nonce":700318902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6821","nonce":700318902}]},"public_addr":"172.21.15.77:6817/700318902","cluster_addr":"172.21.15.77:6819/700318902","heartbeat_back_addr":"172.21.15.77:6823/700318902","heartbeat_front_addr":"172.21.15.77:6821/700318902","state":["exists","up"]},{"osd":8,"uuid":"1786747c-6ff6-4e00-bcf6-a8176215847f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6817","nonce":1635473481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6819","nonce":1635473481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6823","nonce":1635473481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6821","nonce":1635473481}]},"public_addr":"172.21.15.134:6817/1635473481","cluster_addr":"172.21.15.134:6819/1635473481","heartbeat_back_addr":"172.21.15.134:6823/1635473481","heartbeat_front_addr":"172.21.15.134:6821/1635473481","state":["exists","up"]},{"osd":9,"uuid":"708f7390-1b51-4397-a92a-8ff3f4a5bc45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6827","nonce":3899297933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6829","nonce":3899297933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6833","nonce":3899297933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6831","nonce":3899297933}]},"public_addr":"172.21.15.22:6827/3899297933","cluster_addr":"172.21.15.22:6829/3899297933","heartbeat_back_addr":"172.21.15.22:6833/3899297933","heartbeat_front_addr":"172.21.15.22:6831/3899297933","state":["exists","up"]},{"osd":10,"uuid":"d15b0acd-dd08-431d-88aa-756b6420987d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6825","nonce":2765589872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6827","nonce":2765589872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6831","nonce":2765589872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6829","nonce":2765589872}]},"public_addr":"172.21.15.77:6825/2765589872","cluster_addr":"172.21.15.77:6827/2765589872","heartbeat_back_addr":"172.21.15.77:6831/2765589872","heartbeat_front_addr":"172.21.15.77:6829/2765589872","state":["exists","up"]},{"osd":11,"uuid":"d15017fa-3c3d-4096-a35d-275cd54bb9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6825","nonce":964533669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6827","nonce":964533669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6831","nonce":964533669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6829","nonce":964533669}]},"public_addr":"172.21.15.134:6825/964533669","cluster_addr":"172.21.15.134:6827/964533669","heartbeat_back_addr":"172.21.15.134:6831/964533669","heartbeat_front_addr":"172.21.15.134:6829/964533669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:23:40.839725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:05.141389+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:28.340737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:52.028949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:17.029913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:42.092826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:07.831100+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:33.380447+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:58.772655+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:23.017208+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:47.966711+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:28:13.123047+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/416470260":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6800/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/1142422661":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:6800/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/2093308719":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/3772866379":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3424402756":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3864772624":"2024-08-21T01:21:28.981981+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:41:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.088+0000 7f11faf0b640 1 -- 172.21.15.22:0/3714770837 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f11dc0b3bd0 msgr2=0x7f11dc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.088+0000 7f11faf0b640 1 --2- 172.21.15.22:0/3714770837 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f11dc0b3bd0 0x7f11dc0b6090 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f11f406bc00 tx=0x7f11e4006c90 comp rx=0 tx=0).stop 2024-08-20T01:41:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.088+0000 7f11faf0b640 1 -- 172.21.15.22:0/3714770837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11f406b6c0 msgr2=0x7f11f4198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.088+0000 7f11faf0b640 1 --2- 172.21.15.22:0/3714770837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11f406b6c0 0x7f11f4198ac0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f11f0005940 tx=0x7f11f0004430 comp rx=0 tx=0).stop 2024-08-20T01:41:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.089+0000 7f11faf0b640 1 -- 172.21.15.22:0/3714770837 shutdown_connections 2024-08-20T01:41:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.089+0000 7f11faf0b640 1 --2- 172.21.15.22:0/3714770837 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f11dc0b3bd0 0x7f11dc0b6090 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.089+0000 7f11faf0b640 1 --2- 172.21.15.22:0/3714770837 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f41083a0 0x7f11f4199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.089+0000 7f11faf0b640 1 --2- 172.21.15.22:0/3714770837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11f4105830 0x7f11f4199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.089+0000 7f11faf0b640 1 --2- 172.21.15.22:0/3714770837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11f406b6c0 0x7f11f4198ac0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.089+0000 7f11faf0b640 1 -- 172.21.15.22:0/3714770837 >> 172.21.15.22:0/3714770837 conn(0x7f11f40fce20 msgr2=0x7f11f4103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.089+0000 7f11faf0b640 1 -- 172.21.15.22:0/3714770837 shutdown_connections 2024-08-20T01:41:58.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.089+0000 7f11faf0b640 1 -- 172.21.15.22:0/3714770837 wait complete. 2024-08-20T01:41:58.102 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-20T01:24:31.674035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-20T01:29:02.800545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-20T01:29:04.951975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-20T01:41:58.102 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-20T01:41:58.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.207+0000 7f69d8deb640 1 -- 172.21.15.22:0/1925512211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69d41015a0 msgr2=0x7f69d41019a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:58.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.207+0000 7f69d8deb640 1 --2- 172.21.15.22:0/1925512211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69d41015a0 0x7f69d41019a0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f69c4009930 tx=0x7f69c402a420 comp rx=0 tx=0).stop 2024-08-20T01:41:58.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.207+0000 7f69d8deb640 1 -- 172.21.15.22:0/1925512211 shutdown_connections 2024-08-20T01:41:58.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.207+0000 7f69d8deb640 1 --2- 172.21.15.22:0/1925512211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69d41030b0 0x7f69d4109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.207+0000 7f69d8deb640 1 --2- 172.21.15.22:0/1925512211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69d41026f0 0x7f69d4102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.207+0000 7f69d8deb640 1 --2- 172.21.15.22:0/1925512211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69d41015a0 0x7f69d41019a0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.207+0000 7f69d8deb640 1 -- 172.21.15.22:0/1925512211 >> 172.21.15.22:0/1925512211 conn(0x7f69d40fce40 msgr2=0x7f69d40ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:58.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.207+0000 7f69d8deb640 1 -- 172.21.15.22:0/1925512211 shutdown_connections 2024-08-20T01:41:58.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.207+0000 7f69d8deb640 1 -- 172.21.15.22:0/1925512211 wait complete. 2024-08-20T01:41:58.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.208+0000 7f69d8deb640 1 Processor -- start 2024-08-20T01:41:58.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.208+0000 7f69d8deb640 1 -- start start 2024-08-20T01:41:58.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.208+0000 7f69d8deb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69d41015a0 0x7f69d4198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:58.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.208+0000 7f69d8deb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69d41026f0 0x7f69d4199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:58.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.208+0000 7f69d8deb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69d41030b0 0x7f69d4199d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:58.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.208+0000 7f69d8deb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f69d410d240 con 0x7f69d41015a0 2024-08-20T01:41:58.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.208+0000 7f69d8deb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f69d410d0c0 con 0x7f69d41026f0 2024-08-20T01:41:58.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.208+0000 7f69d8deb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f69d410d3c0 con 0x7f69d41030b0 2024-08-20T01:41:58.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.208+0000 7f69d259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69d41015a0 0x7f69d4198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:58.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.208+0000 7f69d259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69d41015a0 0x7f69d4198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37482/0 (socket says 172.21.15.22:37482) 2024-08-20T01:41:58.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.208+0000 7f69d259c640 1 -- 172.21.15.22:0/631120858 learned_addr learned my addr 172.21.15.22:0/631120858 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:58.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.208+0000 7f69d2d9d640 1 --2- 172.21.15.22:0/631120858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69d41030b0 0x7f69d4199d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:58.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.208+0000 7f69c9d9b640 1 --2- 172.21.15.22:0/631120858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69d41026f0 0x7f69d4199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:58.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.208+0000 7f69d259c640 1 -- 172.21.15.22:0/631120858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69d41030b0 msgr2=0x7f69d4199d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:58.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.208+0000 7f69d259c640 1 --2- 172.21.15.22:0/631120858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69d41030b0 0x7f69d4199d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.208+0000 7f69d259c640 1 -- 172.21.15.22:0/631120858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69d41026f0 msgr2=0x7f69d4199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:58.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.208+0000 7f69d259c640 1 --2- 172.21.15.22:0/631120858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69d41026f0 0x7f69d4199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.208+0000 7f69d259c640 1 -- 172.21.15.22:0/631120858 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d419a650 con 0x7f69d41015a0 2024-08-20T01:41:58.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.208+0000 7f69c9d9b640 1 --2- 172.21.15.22:0/631120858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69d41026f0 0x7f69d4199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:58.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.209+0000 7f69d259c640 1 --2- 172.21.15.22:0/631120858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69d41015a0 0x7f69d4198b10 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f69c4031500 tx=0x7f69c4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:58.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.209+0000 7f69cbfff640 1 -- 172.21.15.22:0/631120858 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c403f070 con 0x7f69d41015a0 2024-08-20T01:41:58.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.209+0000 7f69cbfff640 1 -- 172.21.15.22:0/631120858 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69c4031c60 con 0x7f69d41015a0 2024-08-20T01:41:58.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.209+0000 7f69d8deb640 1 -- 172.21.15.22:0/631120858 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69d419a8e0 con 0x7f69d41015a0 2024-08-20T01:41:58.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.209+0000 7f69cbfff640 1 -- 172.21.15.22:0/631120858 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c4035030 con 0x7f69d41015a0 2024-08-20T01:41:58.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.209+0000 7f69d8deb640 1 -- 172.21.15.22:0/631120858 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69d41a1010 con 0x7f69d41015a0 2024-08-20T01:41:58.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.210+0000 7f69d8deb640 1 -- 172.21.15.22:0/631120858 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69d41019a0 con 0x7f69d41015a0 2024-08-20T01:41:58.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.211+0000 7f69cbfff640 1 -- 172.21.15.22:0/631120858 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f69c4042070 con 0x7f69d41015a0 2024-08-20T01:41:58.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.212+0000 7f69cbfff640 1 --2- 172.21.15.22:0/631120858 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f69c00b3bd0 0x7f69c00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:58.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.212+0000 7f69cbfff640 1 -- 172.21.15.22:0/631120858 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f69c4104370 con 0x7f69d41015a0 2024-08-20T01:41:58.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.212+0000 7f69c9d9b640 1 --2- 172.21.15.22:0/631120858 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f69c00b3bd0 0x7f69c00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:58.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.213+0000 7f69c9d9b640 1 --2- 172.21.15.22:0/631120858 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f69c00b3bd0 0x7f69c00b6090 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f69bc009b50 tx=0x7f69bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:58.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.216+0000 7f69cbfff640 1 -- 172.21.15.22:0/631120858 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f69c40cb980 con 0x7f69d41015a0 2024-08-20T01:41:58.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.400+0000 7f69d8deb640 1 -- 172.21.15.22:0/631120858 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f69d41a17e0 con 0x7f69d41015a0 2024-08-20T01:41:58.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.401+0000 7f69cbfff640 1 -- 172.21.15.22:0/631120858 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f69c40cb280 con 0x7f69d41015a0 2024-08-20T01:41:58.403 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-08-20T01:41:58.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.403+0000 7f69d8deb640 1 -- 172.21.15.22:0/631120858 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f69c00b3bd0 msgr2=0x7f69c00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:58.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.403+0000 7f69d8deb640 1 --2- 172.21.15.22:0/631120858 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f69c00b3bd0 0x7f69c00b6090 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f69bc009b50 tx=0x7f69bc005f90 comp rx=0 tx=0).stop 2024-08-20T01:41:58.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.403+0000 7f69d8deb640 1 -- 172.21.15.22:0/631120858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69d41015a0 msgr2=0x7f69d4198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:58.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.403+0000 7f69d8deb640 1 --2- 172.21.15.22:0/631120858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69d41015a0 0x7f69d4198b10 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f69c4031500 tx=0x7f69c4003c10 comp rx=0 tx=0).stop 2024-08-20T01:41:58.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.403+0000 7f69d8deb640 1 -- 172.21.15.22:0/631120858 shutdown_connections 2024-08-20T01:41:58.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.403+0000 7f69d8deb640 1 --2- 172.21.15.22:0/631120858 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f69c00b3bd0 0x7f69c00b6090 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.403+0000 7f69d8deb640 1 --2- 172.21.15.22:0/631120858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69d41030b0 0x7f69d4199d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.403+0000 7f69d8deb640 1 --2- 172.21.15.22:0/631120858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69d41026f0 0x7f69d4199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.403+0000 7f69d8deb640 1 --2- 172.21.15.22:0/631120858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69d41015a0 0x7f69d4198b10 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.403+0000 7f69d8deb640 1 -- 172.21.15.22:0/631120858 >> 172.21.15.22:0/631120858 conn(0x7f69d40fce40 msgr2=0x7f69d40fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:58.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.403+0000 7f69d8deb640 1 -- 172.21.15.22:0/631120858 shutdown_connections 2024-08-20T01:41:58.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.403+0000 7f69d8deb640 1 -- 172.21.15.22:0/631120858 wait complete. 2024-08-20T01:41:58.416 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-20T01:41:58.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.520+0000 7f4259260640 1 -- 172.21.15.22:0/384904544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42541015a0 msgr2=0x7f42541019a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:58.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.520+0000 7f4259260640 1 --2- 172.21.15.22:0/384904544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42541015a0 0x7f42541019a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f4244009cd0 tx=0x7f424402a8e0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.520+0000 7f4259260640 1 -- 172.21.15.22:0/384904544 shutdown_connections 2024-08-20T01:41:58.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.520+0000 7f4259260640 1 --2- 172.21.15.22:0/384904544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42541030b0 0x7f4254109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.520+0000 7f4259260640 1 --2- 172.21.15.22:0/384904544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42541026f0 0x7f4254102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.520+0000 7f4259260640 1 --2- 172.21.15.22:0/384904544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42541015a0 0x7f42541019a0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.520+0000 7f4259260640 1 -- 172.21.15.22:0/384904544 >> 172.21.15.22:0/384904544 conn(0x7f42540fce40 msgr2=0x7f42540ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:58.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.520+0000 7f4259260640 1 -- 172.21.15.22:0/384904544 shutdown_connections 2024-08-20T01:41:58.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.520+0000 7f4259260640 1 -- 172.21.15.22:0/384904544 wait complete. 2024-08-20T01:41:58.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.521+0000 7f4259260640 1 Processor -- start 2024-08-20T01:41:58.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.521+0000 7f4259260640 1 -- start start 2024-08-20T01:41:58.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f4259260640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42541015a0 0x7f4254198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:58.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f4259260640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42541026f0 0x7f42541991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:58.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f4259260640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42541030b0 0x7f4254199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:58.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f4259260640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f425410d290 con 0x7f42541015a0 2024-08-20T01:41:58.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f4259260640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f425410d110 con 0x7f42541030b0 2024-08-20T01:41:58.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f4259260640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f425410d410 con 0x7f42541026f0 2024-08-20T01:41:58.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f4252d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42541015a0 0x7f4254198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:58.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f4252d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42541015a0 0x7f4254198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37504/0 (socket says 172.21.15.22:37504) 2024-08-20T01:41:58.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f4252d9d640 1 -- 172.21.15.22:0/2677049602 learned_addr learned my addr 172.21.15.22:0/2677049602 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:58.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f425259c640 1 --2- 172.21.15.22:0/2677049602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42541026f0 0x7f42541991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:58.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f425359e640 1 --2- 172.21.15.22:0/2677049602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42541030b0 0x7f4254199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:58.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f4252d9d640 1 -- 172.21.15.22:0/2677049602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42541026f0 msgr2=0x7f42541991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:58.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f4252d9d640 1 --2- 172.21.15.22:0/2677049602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42541026f0 0x7f42541991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f4252d9d640 1 -- 172.21.15.22:0/2677049602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42541030b0 msgr2=0x7f4254199e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:58.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f4252d9d640 1 --2- 172.21.15.22:0/2677049602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42541030b0 0x7f4254199e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f4252d9d640 1 -- 172.21.15.22:0/2677049602 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f425419a6d0 con 0x7f42541015a0 2024-08-20T01:41:58.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f425359e640 1 --2- 172.21.15.22:0/2677049602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42541030b0 0x7f4254199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:58.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f4252d9d640 1 --2- 172.21.15.22:0/2677049602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42541015a0 0x7f4254198b90 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4244033040 tx=0x7f4244003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:58.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f424bfff640 1 -- 172.21.15.22:0/2677049602 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4244004240 con 0x7f42541015a0 2024-08-20T01:41:58.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f4259260640 1 -- 172.21.15.22:0/2677049602 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f425419a960 con 0x7f42541015a0 2024-08-20T01:41:58.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f424bfff640 1 -- 172.21.15.22:0/2677049602 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42440305a0 con 0x7f42541015a0 2024-08-20T01:41:58.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f424bfff640 1 -- 172.21.15.22:0/2677049602 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42440466e0 con 0x7f42541015a0 2024-08-20T01:41:58.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.522+0000 7f4259260640 1 -- 172.21.15.22:0/2677049602 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42541a1090 con 0x7f42541015a0 2024-08-20T01:41:58.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.523+0000 7f4259260640 1 -- 172.21.15.22:0/2677049602 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42541a1260 con 0x7f42541015a0 2024-08-20T01:41:58.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.525+0000 7f424bfff640 1 -- 172.21.15.22:0/2677049602 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4244030a50 con 0x7f42541015a0 2024-08-20T01:41:58.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.526+0000 7f424bfff640 1 --2- 172.21.15.22:0/2677049602 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f42400b3bd0 0x7f42400b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:58.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.526+0000 7f425259c640 1 --2- 172.21.15.22:0/2677049602 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f42400b3bd0 0x7f42400b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:58.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.526+0000 7f424bfff640 1 -- 172.21.15.22:0/2677049602 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f424402e030 con 0x7f42541015a0 2024-08-20T01:41:58.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.527+0000 7f425259c640 1 --2- 172.21.15.22:0/2677049602 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f42400b3bd0 0x7f42400b6090 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f423c009990 tx=0x7f423c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:58.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.530+0000 7f424bfff640 1 -- 172.21.15.22:0/2677049602 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f424404b060 con 0x7f42541015a0 2024-08-20T01:41:58.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.715+0000 7f4259260640 1 -- 172.21.15.22:0/2677049602 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f42541a1430 con 0x7f42541015a0 2024-08-20T01:41:58.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.715+0000 7f424bfff640 1 -- 172.21.15.22:0/2677049602 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) ==== 104+0+11 (secure 0 0 0) 0x7f42440cc890 con 0x7f42541015a0 2024-08-20T01:41:58.717 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-08-20T01:41:58.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.717+0000 7f4259260640 1 -- 172.21.15.22:0/2677049602 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f42400b3bd0 msgr2=0x7f42400b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:58.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.717+0000 7f4259260640 1 --2- 172.21.15.22:0/2677049602 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f42400b3bd0 0x7f42400b6090 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f423c009990 tx=0x7f423c009110 comp rx=0 tx=0).stop 2024-08-20T01:41:58.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.717+0000 7f4259260640 1 -- 172.21.15.22:0/2677049602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42541015a0 msgr2=0x7f4254198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:58.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.717+0000 7f4259260640 1 --2- 172.21.15.22:0/2677049602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42541015a0 0x7f4254198b90 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4244033040 tx=0x7f4244003ba0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.717+0000 7f4259260640 1 -- 172.21.15.22:0/2677049602 shutdown_connections 2024-08-20T01:41:58.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.717+0000 7f4259260640 1 --2- 172.21.15.22:0/2677049602 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f42400b3bd0 0x7f42400b6090 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.717+0000 7f4259260640 1 --2- 172.21.15.22:0/2677049602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42541030b0 0x7f4254199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.717+0000 7f4259260640 1 --2- 172.21.15.22:0/2677049602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42541026f0 0x7f42541991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.717+0000 7f4259260640 1 --2- 172.21.15.22:0/2677049602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42541015a0 0x7f4254198b90 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.717+0000 7f4259260640 1 -- 172.21.15.22:0/2677049602 >> 172.21.15.22:0/2677049602 conn(0x7f42540fce40 msgr2=0x7f42540fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:58.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.718+0000 7f4259260640 1 -- 172.21.15.22:0/2677049602 shutdown_connections 2024-08-20T01:41:58.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.718+0000 7f4259260640 1 -- 172.21.15.22:0/2677049602 wait complete. 2024-08-20T01:41:58.731 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-20T01:41:58.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.836+0000 7f7821660640 1 -- 172.21.15.22:0/3592256746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781c1037d0 msgr2=0x7f781c103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:58.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.836+0000 7f7821660640 1 --2- 172.21.15.22:0/3592256746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781c1037d0 0x7f781c103c50 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f7804009930 tx=0x7f780402a420 comp rx=0 tx=0).stop 2024-08-20T01:41:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.836+0000 7f7821660640 1 -- 172.21.15.22:0/3592256746 shutdown_connections 2024-08-20T01:41:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.836+0000 7f7821660640 1 --2- 172.21.15.22:0/3592256746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f781c104190 0x7f781c10ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.836+0000 7f7821660640 1 --2- 172.21.15.22:0/3592256746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781c1037d0 0x7f781c103c50 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.836+0000 7f7821660640 1 --2- 172.21.15.22:0/3592256746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f781c102680 0x7f781c102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.836+0000 7f7821660640 1 -- 172.21.15.22:0/3592256746 >> 172.21.15.22:0/3592256746 conn(0x7f781c0fdf40 msgr2=0x7f781c100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.836+0000 7f7821660640 1 -- 172.21.15.22:0/3592256746 shutdown_connections 2024-08-20T01:41:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.836+0000 7f7821660640 1 -- 172.21.15.22:0/3592256746 wait complete. 2024-08-20T01:41:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.837+0000 7f7821660640 1 Processor -- start 2024-08-20T01:41:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.837+0000 7f7821660640 1 -- start start 2024-08-20T01:41:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.837+0000 7f7821660640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f781c102680 0x7f781c198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.837+0000 7f7821660640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f781c1037d0 0x7f781c1990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.837+0000 7f7821660640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781c104190 0x7f781c199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.837+0000 7f7821660640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f781c10e2f0 con 0x7f781c104190 2024-08-20T01:41:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.837+0000 7f7821660640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f781c10e170 con 0x7f781c102680 2024-08-20T01:41:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.837+0000 7f7821660640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f781c10e470 con 0x7f781c1037d0 2024-08-20T01:41:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.837+0000 7f781b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781c104190 0x7f781c199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.837+0000 7f781b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781c104190 0x7f781c199d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37526/0 (socket says 172.21.15.22:37526) 2024-08-20T01:41:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.837+0000 7f781b7fe640 1 -- 172.21.15.22:0/93086444 learned_addr learned my addr 172.21.15.22:0/93086444 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.837+0000 7f781a7fc640 1 --2- 172.21.15.22:0/93086444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f781c1037d0 0x7f781c1990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.837+0000 7f781affd640 1 --2- 172.21.15.22:0/93086444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f781c102680 0x7f781c198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.837+0000 7f781b7fe640 1 -- 172.21.15.22:0/93086444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f781c1037d0 msgr2=0x7f781c1990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.837+0000 7f781b7fe640 1 --2- 172.21.15.22:0/93086444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f781c1037d0 0x7f781c1990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.837+0000 7f781b7fe640 1 -- 172.21.15.22:0/93086444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f781c102680 msgr2=0x7f781c198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.837+0000 7f781b7fe640 1 --2- 172.21.15.22:0/93086444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f781c102680 0x7f781c198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.837+0000 7f781b7fe640 1 -- 172.21.15.22:0/93086444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f781c19a5e0 con 0x7f781c104190 2024-08-20T01:41:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.837+0000 7f781affd640 1 --2- 172.21.15.22:0/93086444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f781c102680 0x7f781c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:58.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.838+0000 7f781b7fe640 1 --2- 172.21.15.22:0/93086444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781c104190 0x7f781c199d20 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f781400c970 tx=0x7f781400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:58.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.838+0000 7f7813fff640 1 -- 172.21.15.22:0/93086444 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7814007bb0 con 0x7f781c104190 2024-08-20T01:41:58.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.838+0000 7f7813fff640 1 -- 172.21.15.22:0/93086444 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7814007d50 con 0x7f781c104190 2024-08-20T01:41:58.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.838+0000 7f7821660640 1 -- 172.21.15.22:0/93086444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f781c19a8d0 con 0x7f781c104190 2024-08-20T01:41:58.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.838+0000 7f7813fff640 1 -- 172.21.15.22:0/93086444 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7814004e60 con 0x7f781c104190 2024-08-20T01:41:58.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.838+0000 7f7821660640 1 -- 172.21.15.22:0/93086444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f781c1a0fa0 con 0x7f781c104190 2024-08-20T01:41:58.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.839+0000 7f7821660640 1 -- 172.21.15.22:0/93086444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f781c102a80 con 0x7f781c104190 2024-08-20T01:41:58.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.840+0000 7f7813fff640 1 -- 172.21.15.22:0/93086444 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7814005000 con 0x7f781c104190 2024-08-20T01:41:58.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.841+0000 7f7813fff640 1 --2- 172.21.15.22:0/93086444 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f78080b3bd0 0x7f78080b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:58.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.841+0000 7f781affd640 1 --2- 172.21.15.22:0/93086444 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f78080b3bd0 0x7f78080b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:58.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.841+0000 7f7813fff640 1 -- 172.21.15.22:0/93086444 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f78140e3bf0 con 0x7f781c104190 2024-08-20T01:41:58.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.842+0000 7f781affd640 1 --2- 172.21.15.22:0/93086444 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f78080b3bd0 0x7f78080b6090 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f780c005fd0 tx=0x7f780c009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:58.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:58.844+0000 7f7813fff640 1 -- 172.21.15.22:0/93086444 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f7814014030 con 0x7f781c104190 2024-08-20T01:41:59.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.035+0000 7f7821660640 1 -- 172.21.15.22:0/93086444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f781c02e340 con 0x7f781c104190 2024-08-20T01:41:59.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.035+0000 7f7813fff640 1 -- 172.21.15.22:0/93086444 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) ==== 100+0+11 (secure 0 0 0) 0x7f78140ab200 con 0x7f781c104190 2024-08-20T01:41:59.038 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-08-20T01:41:59.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.037+0000 7f7821660640 1 -- 172.21.15.22:0/93086444 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f78080b3bd0 msgr2=0x7f78080b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:59.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.037+0000 7f7821660640 1 --2- 172.21.15.22:0/93086444 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f78080b3bd0 0x7f78080b6090 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f780c005fd0 tx=0x7f780c009520 comp rx=0 tx=0).stop 2024-08-20T01:41:59.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.037+0000 7f7821660640 1 -- 172.21.15.22:0/93086444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781c104190 msgr2=0x7f781c199d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:59.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.037+0000 7f7821660640 1 --2- 172.21.15.22:0/93086444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781c104190 0x7f781c199d20 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f781400c970 tx=0x7f781400ce30 comp rx=0 tx=0).stop 2024-08-20T01:41:59.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.037+0000 7f7821660640 1 -- 172.21.15.22:0/93086444 shutdown_connections 2024-08-20T01:41:59.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.037+0000 7f7821660640 1 --2- 172.21.15.22:0/93086444 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f78080b3bd0 0x7f78080b6090 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:59.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.037+0000 7f7821660640 1 --2- 172.21.15.22:0/93086444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781c104190 0x7f781c199d20 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:59.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.037+0000 7f7821660640 1 --2- 172.21.15.22:0/93086444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f781c1037d0 0x7f781c1990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:59.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.037+0000 7f7821660640 1 --2- 172.21.15.22:0/93086444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f781c102680 0x7f781c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:59.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.037+0000 7f7821660640 1 -- 172.21.15.22:0/93086444 >> 172.21.15.22:0/93086444 conn(0x7f781c0fdf40 msgr2=0x7f781c106bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:59.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.037+0000 7f7821660640 1 -- 172.21.15.22:0/93086444 shutdown_connections 2024-08-20T01:41:59.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.038+0000 7f7821660640 1 -- 172.21.15.22:0/93086444 wait complete. 2024-08-20T01:41:59.051 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-08-20T01:41:59.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.152+0000 7f63e65a0640 1 -- 172.21.15.22:0/3017524731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63e0103fc0 msgr2=0x7f63e010a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:59.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.152+0000 7f63e65a0640 1 --2- 172.21.15.22:0/3017524731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63e0103fc0 0x7f63e010a940 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009cd0 tx=0x7f63d802a8e0 comp rx=0 tx=0).stop 2024-08-20T01:41:59.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.152+0000 7f63e65a0640 1 -- 172.21.15.22:0/3017524731 shutdown_connections 2024-08-20T01:41:59.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.152+0000 7f63e65a0640 1 --2- 172.21.15.22:0/3017524731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63e0103fc0 0x7f63e010a940 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:59.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.152+0000 7f63e65a0640 1 --2- 172.21.15.22:0/3017524731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e0103600 0x7f63e0103a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:59.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.152+0000 7f63e65a0640 1 --2- 172.21.15.22:0/3017524731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63e01024b0 0x7f63e01028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:59.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.152+0000 7f63e65a0640 1 -- 172.21.15.22:0/3017524731 >> 172.21.15.22:0/3017524731 conn(0x7f63e00fdd70 msgr2=0x7f63e0100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:59.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.152+0000 7f63e65a0640 1 -- 172.21.15.22:0/3017524731 shutdown_connections 2024-08-20T01:41:59.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.152+0000 7f63e65a0640 1 -- 172.21.15.22:0/3017524731 wait complete. 2024-08-20T01:41:59.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.153+0000 7f63e65a0640 1 Processor -- start 2024-08-20T01:41:59.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.153+0000 7f63e65a0640 1 -- start start 2024-08-20T01:41:59.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.153+0000 7f63e65a0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63e01024b0 0x7f63e0198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:59.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.153+0000 7f63e65a0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63e0103600 0x7f63e0198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:59.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.153+0000 7f63e65a0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e0103fc0 0x7f63e0199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:59.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.153+0000 7f63e65a0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f63e010e180 con 0x7f63e01024b0 2024-08-20T01:41:59.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.153+0000 7f63e65a0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f63e010e000 con 0x7f63e0103600 2024-08-20T01:41:59.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.153+0000 7f63e65a0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f63e010e300 con 0x7f63e0103fc0 2024-08-20T01:41:59.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.153+0000 7f63e559e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63e01024b0 0x7f63e0198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:59.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.153+0000 7f63e559e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63e01024b0 0x7f63e0198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37542/0 (socket says 172.21.15.22:37542) 2024-08-20T01:41:59.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.153+0000 7f63e559e640 1 -- 172.21.15.22:0/3288811306 learned_addr learned my addr 172.21.15.22:0/3288811306 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:41:59.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.153+0000 7f63e4d9d640 1 --2- 172.21.15.22:0/3288811306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63e0103600 0x7f63e0198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:59.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.153+0000 7f63e559e640 1 -- 172.21.15.22:0/3288811306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e0103fc0 msgr2=0x7f63e0199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:59.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.153+0000 7f63e559e640 1 --2- 172.21.15.22:0/3288811306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e0103fc0 0x7f63e0199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:59.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.153+0000 7f63e559e640 1 -- 172.21.15.22:0/3288811306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63e0103600 msgr2=0x7f63e0198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:59.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.153+0000 7f63e559e640 1 --2- 172.21.15.22:0/3288811306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63e0103600 0x7f63e0198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:59.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.153+0000 7f63e559e640 1 -- 172.21.15.22:0/3288811306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e019a3a0 con 0x7f63e01024b0 2024-08-20T01:41:59.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.153+0000 7f63e4d9d640 1 --2- 172.21.15.22:0/3288811306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63e0103600 0x7f63e0198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:59.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.153+0000 7f63e559e640 1 --2- 172.21.15.22:0/3288811306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63e01024b0 0x7f63e0198860 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00b4a0 tx=0x7f63dc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:59.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.154+0000 7f63d67fc640 1 -- 172.21.15.22:0/3288811306 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc014070 con 0x7f63e01024b0 2024-08-20T01:41:59.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.154+0000 7f63d67fc640 1 -- 172.21.15.22:0/3288811306 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63dc010ac0 con 0x7f63e01024b0 2024-08-20T01:41:59.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.154+0000 7f63e65a0640 1 -- 172.21.15.22:0/3288811306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e019a690 con 0x7f63e01024b0 2024-08-20T01:41:59.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.154+0000 7f63d67fc640 1 -- 172.21.15.22:0/3288811306 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc017c30 con 0x7f63e01024b0 2024-08-20T01:41:59.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.154+0000 7f63e65a0640 1 -- 172.21.15.22:0/3288811306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e01a0d60 con 0x7f63e01024b0 2024-08-20T01:41:59.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.155+0000 7f63e65a0640 1 -- 172.21.15.22:0/3288811306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e0109750 con 0x7f63e01024b0 2024-08-20T01:41:59.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.156+0000 7f63d67fc640 1 -- 172.21.15.22:0/3288811306 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f63dc017070 con 0x7f63e01024b0 2024-08-20T01:41:59.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.157+0000 7f63d67fc640 1 --2- 172.21.15.22:0/3288811306 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f63cc0b3c50 0x7f63cc0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:59.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.157+0000 7f63e4d9d640 1 --2- 172.21.15.22:0/3288811306 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f63cc0b3c50 0x7f63cc0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:59.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.157+0000 7f63d67fc640 1 -- 172.21.15.22:0/3288811306 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f63dc0e3350 con 0x7f63e01024b0 2024-08-20T01:41:59.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.157+0000 7f63e4d9d640 1 --2- 172.21.15.22:0/3288811306 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f63cc0b3c50 0x7f63cc0b6110 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f63d00058c0 tx=0x7f63d0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:59.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.159+0000 7f63d67fc640 1 -- 172.21.15.22:0/3288811306 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f63dc0aa960 con 0x7f63e01024b0 2024-08-20T01:41:59.266 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:59 smithi134 ceph-mon[22511]: pgmap v673: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 764 KiB/s wr, 238 op/s 2024-08-20T01:41:59.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:59 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3714770837' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:41:59.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:59 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/631120858' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T01:41:59.267 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:41:59 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2677049602' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-20T01:41:59.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:59 smithi077 ceph-mon[22251]: pgmap v673: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 764 KiB/s wr, 238 op/s 2024-08-20T01:41:59.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:59 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3714770837' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:41:59.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:59 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/631120858' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T01:41:59.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:41:59 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2677049602' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-20T01:41:59.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:59 smithi022 ceph-mon[18709]: pgmap v673: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 764 KiB/s wr, 238 op/s 2024-08-20T01:41:59.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:59 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3714770837' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:41:59.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:59 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/631120858' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T01:41:59.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:41:59 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2677049602' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-20T01:41:59.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.394+0000 7f63e65a0640 1 -- 172.21.15.22:0/3288811306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f63e002e5b0 con 0x7f63e01024b0 2024-08-20T01:41:59.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.401+0000 7f63d67fc640 1 -- 172.21.15.22:0/3288811306 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+821379 (secure 0 0 0) 0x7f63dc0aa260 con 0x7f63e01024b0 2024-08-20T01:41:59.414 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:41:59.414 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:41:59.414 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 18, 2024-08-20T01:41:59.414 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.414 INFO:teuthology.orchestra.run.smithi022.stdout: "active_gid": 14150, 2024-08-20T01:41:59.414 INFO:teuthology.orchestra.run.smithi022.stdout: "active_name": "x", 2024-08-20T01:41:59.414 INFO:teuthology.orchestra.run.smithi022.stdout: "active_addrs": { 2024-08-20T01:41:59.414 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-08-20T01:41:59.414 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.415 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-08-20T01:41:59.415 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6800", 2024-08-20T01:41:59.415 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2987254321 2024-08-20T01:41:59.415 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.415 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.415 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-08-20T01:41:59.415 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6801", 2024-08-20T01:41:59.415 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2987254321 2024-08-20T01:41:59.415 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.415 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-08-20T01:41:59.415 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.415 INFO:teuthology.orchestra.run.smithi022.stdout: "active_addr": "172.21.15.22:6801/2987254321", 2024-08-20T01:41:59.416 INFO:teuthology.orchestra.run.smithi022.stdout: "active_change": "2024-08-20T01:21:53.209914+0000", 2024-08-20T01:41:59.416 INFO:teuthology.orchestra.run.smithi022.stdout: "active_mgr_features": 4540701547738038271, 2024-08-20T01:41:59.416 INFO:teuthology.orchestra.run.smithi022.stdout: "available": true, 2024-08-20T01:41:59.416 INFO:teuthology.orchestra.run.smithi022.stdout: "standbys": [ 2024-08-20T01:41:59.416 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.416 INFO:teuthology.orchestra.run.smithi022.stdout: "gid": 24118, 2024-08-20T01:41:59.416 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "z", 2024-08-20T01:41:59.416 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_features": 4540701547738038271, 2024-08-20T01:41:59.416 INFO:teuthology.orchestra.run.smithi022.stdout: "available_modules": [ 2024-08-20T01:41:59.416 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.416 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "alerts", 2024-08-20T01:41:59.416 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.416 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.416 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.417 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-08-20T01:41:59.417 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-08-20T01:41:59.417 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.417 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.417 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.417 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-08-20T01:41:59.417 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.417 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.417 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.417 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How frequently to reexamine health status", 2024-08-20T01:41:59.417 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.417 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.417 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.418 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.418 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.418 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.418 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.418 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.418 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.418 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.418 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.418 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.418 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.418 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.418 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.418 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.419 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.419 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.419 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.419 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.419 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.419 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.419 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.419 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.419 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.419 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.419 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.419 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.420 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.420 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.420 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.420 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.420 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.420 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.420 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.420 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.420 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.420 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.420 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.420 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.420 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.421 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.421 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.421 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.421 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.421 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.421 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.421 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.421 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.421 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.421 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.421 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.421 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.421 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.422 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.422 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.422 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.422 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.422 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.422 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.422 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.422 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.422 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.422 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.422 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.422 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.422 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.422 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.423 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.423 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.423 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.423 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.423 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.423 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.423 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_destination": { 2024-08-20T01:41:59.423 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_destination", 2024-08-20T01:41:59.423 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.423 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.423 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.423 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.423 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.424 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.424 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.424 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email address to send alerts to", 2024-08-20T01:41:59.424 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.424 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.424 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.424 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.424 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_from_name": { 2024-08-20T01:41:59.424 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_from_name", 2024-08-20T01:41:59.424 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.424 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.424 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.424 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "Ceph", 2024-08-20T01:41:59.425 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.425 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.425 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.425 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email From: name", 2024-08-20T01:41:59.425 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.425 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.425 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.425 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.425 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_host": { 2024-08-20T01:41:59.425 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_host", 2024-08-20T01:41:59.425 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.425 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.425 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.425 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.426 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.426 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.426 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.426 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP server", 2024-08-20T01:41:59.426 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.426 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.426 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.426 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.426 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_password": { 2024-08-20T01:41:59.427 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_password", 2024-08-20T01:41:59.427 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.427 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.427 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.427 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.427 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.427 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.427 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.427 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Password to authenticate with", 2024-08-20T01:41:59.427 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.427 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.427 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.427 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.428 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_port": { 2024-08-20T01:41:59.428 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_port", 2024-08-20T01:41:59.428 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.428 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.428 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.428 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "465", 2024-08-20T01:41:59.428 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.428 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.428 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.429 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP port", 2024-08-20T01:41:59.429 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.429 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.429 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.429 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.429 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_sender": { 2024-08-20T01:41:59.429 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_sender", 2024-08-20T01:41:59.429 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.429 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.429 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.430 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.430 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.430 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.430 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.430 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP envelope sender", 2024-08-20T01:41:59.430 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.430 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.430 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.430 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.430 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_ssl": { 2024-08-20T01:41:59.431 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_ssl", 2024-08-20T01:41:59.431 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.431 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.431 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.431 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.431 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.431 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.431 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.431 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-20T01:41:59.431 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.431 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.431 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.431 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.432 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_user": { 2024-08-20T01:41:59.432 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_user", 2024-08-20T01:41:59.432 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.432 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.432 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.432 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.432 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.432 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.432 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.432 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "User to authenticate as", 2024-08-20T01:41:59.432 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.432 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.432 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.433 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.433 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.433 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.433 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.433 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.433 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.433 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.433 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.433 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.433 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.433 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.433 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.433 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.434 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.434 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.434 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.434 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.434 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.434 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "balancer", 2024-08-20T01:41:59.434 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.434 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.434 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.434 INFO:teuthology.orchestra.run.smithi022.stdout: "active": { 2024-08-20T01:41:59.434 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "active", 2024-08-20T01:41:59.434 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.435 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.435 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.435 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.435 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.435 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.435 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.435 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically balance PGs across cluster", 2024-08-20T01:41:59.435 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.435 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.435 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.435 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.435 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_time": { 2024-08-20T01:41:59.435 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_time", 2024-08-20T01:41:59.436 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.436 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.436 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.436 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0000", 2024-08-20T01:41:59.436 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.436 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.436 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.436 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "beginning time of day to automatically balance", 2024-08-20T01:41:59.436 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-20T01:41:59.436 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.437 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.437 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.437 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_weekday": { 2024-08-20T01:41:59.437 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_weekday", 2024-08-20T01:41:59.437 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-08-20T01:41:59.437 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.437 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.437 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.437 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-08-20T01:41:59.437 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-08-20T01:41:59.437 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.437 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-20T01:41:59.437 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-20T01:41:59.438 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.438 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.438 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.438 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_max_iterations": { 2024-08-20T01:41:59.438 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_max_iterations", 2024-08-20T01:41:59.438 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-08-20T01:41:59.438 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.438 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.438 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "25", 2024-08-20T01:41:59.438 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-08-20T01:41:59.438 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "250", 2024-08-20T01:41:59.438 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.438 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-20T01:41:59.439 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.439 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.439 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.439 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.439 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_metrics": { 2024-08-20T01:41:59.439 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_metrics", 2024-08-20T01:41:59.439 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.439 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.439 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.439 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "pgs,objects,bytes", 2024-08-20T01:41:59.439 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.439 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.440 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.440 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-20T01:41:59.440 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-20T01:41:59.440 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.440 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.440 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.440 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_step": { 2024-08-20T01:41:59.440 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_step", 2024-08-20T01:41:59.440 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:41:59.440 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.440 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.440 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.5", 2024-08-20T01:41:59.440 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0.001", 2024-08-20T01:41:59.440 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "0.999", 2024-08-20T01:41:59.441 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.441 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "aggressiveness of optimization", 2024-08-20T01:41:59.441 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-20T01:41:59.441 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.441 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.441 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.441 INFO:teuthology.orchestra.run.smithi022.stdout: "end_time": { 2024-08-20T01:41:59.441 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_time", 2024-08-20T01:41:59.441 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.441 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.441 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.441 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2359", 2024-08-20T01:41:59.441 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.442 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.442 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.442 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ending time of day to automatically balance", 2024-08-20T01:41:59.442 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-20T01:41:59.442 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.442 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.442 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.442 INFO:teuthology.orchestra.run.smithi022.stdout: "end_weekday": { 2024-08-20T01:41:59.442 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_weekday", 2024-08-20T01:41:59.442 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-08-20T01:41:59.442 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.442 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.443 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.443 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-08-20T01:41:59.443 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-08-20T01:41:59.443 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.443 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-20T01:41:59.443 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-20T01:41:59.443 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.443 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.443 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.443 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.443 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.443 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.443 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.443 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.444 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.444 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.444 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.444 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.444 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.444 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.444 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.444 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.444 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.444 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.444 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.445 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.445 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.445 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.445 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.445 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.445 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.445 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.445 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.445 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.445 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.445 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.445 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.446 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.446 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.446 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.446 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.446 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.446 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.446 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.446 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.446 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.446 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.446 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.446 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.447 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.449 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.449 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.449 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.449 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.449 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.450 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.450 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.450 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.450 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.450 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.450 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.450 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.450 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.450 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.450 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.450 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.450 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.451 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.451 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.451 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.451 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.451 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.451 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.451 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.451 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.451 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.451 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.451 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.451 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.451 INFO:teuthology.orchestra.run.smithi022.stdout: "min_score": { 2024-08-20T01:41:59.452 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_score", 2024-08-20T01:41:59.452 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:41:59.452 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.452 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.452 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.452 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.452 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.452 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.452 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-20T01:41:59.452 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.452 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.452 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.452 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.452 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-08-20T01:41:59.453 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-08-20T01:41:59.453 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.453 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.453 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.453 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "upmap", 2024-08-20T01:41:59.453 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.453 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.453 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.453 INFO:teuthology.orchestra.run.smithi022.stdout: "crush-compat", 2024-08-20T01:41:59.453 INFO:teuthology.orchestra.run.smithi022.stdout: "none", 2024-08-20T01:41:59.453 INFO:teuthology.orchestra.run.smithi022.stdout: "read", 2024-08-20T01:41:59.453 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap", 2024-08-20T01:41:59.453 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap-read" 2024-08-20T01:41:59.453 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.454 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Balancer mode", 2024-08-20T01:41:59.454 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.454 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.454 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.454 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.454 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_ids": { 2024-08-20T01:41:59.454 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_ids", 2024-08-20T01:41:59.454 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.454 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.454 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.454 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.454 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.454 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.455 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.455 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-20T01:41:59.455 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.455 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.455 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.455 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.455 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-08-20T01:41:59.455 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-08-20T01:41:59.455 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.455 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.455 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.455 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-08-20T01:41:59.455 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.455 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.455 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.456 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-20T01:41:59.456 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.456 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.456 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.456 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.456 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.456 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.456 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.456 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.456 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.456 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.456 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.456 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.457 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.457 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.457 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.457 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.457 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.457 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.457 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_deviation": { 2024-08-20T01:41:59.457 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_deviation", 2024-08-20T01:41:59.457 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.457 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.457 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.457 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-08-20T01:41:59.457 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-08-20T01:41:59.457 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.458 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.458 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-20T01:41:59.458 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-20T01:41:59.458 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.458 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.458 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.458 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_optimizations": { 2024-08-20T01:41:59.458 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_optimizations", 2024-08-20T01:41:59.458 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-08-20T01:41:59.458 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.458 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.458 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:41:59.459 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.459 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.459 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.459 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-20T01:41:59.459 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.459 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.459 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.459 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.459 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.459 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.459 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.459 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm", 2024-08-20T01:41:59.459 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.459 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.460 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.460 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_down_multiplier": { 2024-08-20T01:41:59.460 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_down_multiplier", 2024-08-20T01:41:59.460 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:41:59.460 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.460 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.460 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-08-20T01:41:59.460 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.460 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.460 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.460 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-20T01:41:59.460 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.460 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.461 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.461 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.461 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_refresh_rate": { 2024-08-20T01:41:59.461 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_refresh_rate", 2024-08-20T01:41:59.461 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.461 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.461 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.461 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "20", 2024-08-20T01:41:59.461 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.461 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.461 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.461 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-20T01:41:59.462 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.462 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.462 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.462 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.462 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_starting_port": { 2024-08-20T01:41:59.462 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_starting_port", 2024-08-20T01:41:59.462 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.462 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.462 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.462 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4721", 2024-08-20T01:41:59.462 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.462 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.462 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.463 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-20T01:41:59.463 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.463 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.463 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.463 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.463 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_ptrace": { 2024-08-20T01:41:59.463 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_ptrace", 2024-08-20T01:41:59.463 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.463 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.463 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.463 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.463 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.463 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.464 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.464 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-20T01:41:59.464 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-20T01:41:59.464 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.464 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.464 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.464 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_interval": { 2024-08-20T01:41:59.464 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_interval", 2024-08-20T01:41:59.464 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.464 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.464 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.464 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-08-20T01:41:59.464 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.464 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.465 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.465 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-20T01:41:59.465 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.465 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.465 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.465 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.465 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_memory_target_ratio": { 2024-08-20T01:41:59.465 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_memory_target_ratio", 2024-08-20T01:41:59.465 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:41:59.465 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.465 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.465 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.7", 2024-08-20T01:41:59.465 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.466 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.466 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.466 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-20T01:41:59.466 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.466 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.466 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.466 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.466 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm_log_destination": { 2024-08-20T01:41:59.466 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm_log_destination", 2024-08-20T01:41:59.466 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.466 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.466 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.467 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.467 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.467 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.467 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.467 INFO:teuthology.orchestra.run.smithi022.stdout: "file", 2024-08-20T01:41:59.467 INFO:teuthology.orchestra.run.smithi022.stdout: "file,syslog", 2024-08-20T01:41:59.467 INFO:teuthology.orchestra.run.smithi022.stdout: "syslog" 2024-08-20T01:41:59.467 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.467 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-20T01:41:59.467 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.467 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.467 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.467 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.468 INFO:teuthology.orchestra.run.smithi022.stdout: "cgroups_split": { 2024-08-20T01:41:59.468 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cgroups_split", 2024-08-20T01:41:59.468 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.468 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.468 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.468 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.468 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.468 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.468 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.468 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-20T01:41:59.468 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.468 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.468 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.468 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.469 INFO:teuthology.orchestra.run.smithi022.stdout: "config_checks_enabled": { 2024-08-20T01:41:59.469 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_checks_enabled", 2024-08-20T01:41:59.469 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.469 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.469 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.469 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.469 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.469 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.469 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.469 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-20T01:41:59.469 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.469 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.469 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.469 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.469 INFO:teuthology.orchestra.run.smithi022.stdout: "config_dashboard": { 2024-08-20T01:41:59.470 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_dashboard", 2024-08-20T01:41:59.470 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.470 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.470 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.470 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.470 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.470 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.470 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.470 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-20T01:41:59.470 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.470 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.470 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.471 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.471 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_alertmanager": { 2024-08-20T01:41:59.471 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_alertmanager", 2024-08-20T01:41:59.471 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.471 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.471 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.471 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-20T01:41:59.471 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.471 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.471 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.471 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-08-20T01:41:59.471 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.471 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.471 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.472 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.472 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_base": { 2024-08-20T01:41:59.472 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_base", 2024-08-20T01:41:59.472 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.472 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.472 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.472 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-20T01:41:59.472 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.472 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.472 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.472 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Container image name, without the tag", 2024-08-20T01:41:59.472 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.472 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.472 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.473 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.473 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_elasticsearch": { 2024-08-20T01:41:59.473 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_elasticsearch", 2024-08-20T01:41:59.473 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.473 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.473 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.473 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-20T01:41:59.473 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.473 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.473 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.473 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "elasticsearch container image", 2024-08-20T01:41:59.473 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.474 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.474 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.474 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.474 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_grafana": { 2024-08-20T01:41:59.474 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_grafana", 2024-08-20T01:41:59.474 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.474 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.474 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.474 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-20T01:41:59.474 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.474 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.474 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.475 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-08-20T01:41:59.475 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.475 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.475 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.475 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.475 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_haproxy": { 2024-08-20T01:41:59.475 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_haproxy", 2024-08-20T01:41:59.475 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.475 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.475 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.475 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-20T01:41:59.475 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.475 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.476 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.476 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "HAproxy container image", 2024-08-20T01:41:59.476 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.476 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.476 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.476 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.476 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_agent": { 2024-08-20T01:41:59.476 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_agent", 2024-08-20T01:41:59.476 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.476 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.476 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.476 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-20T01:41:59.476 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.477 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.477 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.477 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger agent container image", 2024-08-20T01:41:59.477 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.477 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.477 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.477 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.477 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_collector": { 2024-08-20T01:41:59.477 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_collector", 2024-08-20T01:41:59.477 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.477 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.477 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.477 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-20T01:41:59.477 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.478 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.478 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.478 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger collector container image", 2024-08-20T01:41:59.478 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.478 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.478 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.478 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.478 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_query": { 2024-08-20T01:41:59.478 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_query", 2024-08-20T01:41:59.478 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.478 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.478 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.479 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-20T01:41:59.479 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.479 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.479 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.479 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger query container image", 2024-08-20T01:41:59.479 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.479 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.479 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.479 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.479 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_keepalived": { 2024-08-20T01:41:59.479 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_keepalived", 2024-08-20T01:41:59.479 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.479 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.480 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.480 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-20T01:41:59.480 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.480 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.480 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.480 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Keepalived container image", 2024-08-20T01:41:59.480 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.480 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.480 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.480 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.480 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_loki": { 2024-08-20T01:41:59.480 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_loki", 2024-08-20T01:41:59.480 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.480 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.481 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.481 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-20T01:41:59.481 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.481 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.481 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.481 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Loki container image", 2024-08-20T01:41:59.481 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.481 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.481 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.481 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.481 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nginx": { 2024-08-20T01:41:59.481 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nginx", 2024-08-20T01:41:59.481 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.482 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.482 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.482 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-20T01:41:59.482 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.482 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.482 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.482 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nginx container image", 2024-08-20T01:41:59.482 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.482 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.482 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.482 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.482 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_node_exporter": { 2024-08-20T01:41:59.482 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_node_exporter", 2024-08-20T01:41:59.483 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.483 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.483 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.483 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-20T01:41:59.483 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.483 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.483 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.483 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-08-20T01:41:59.483 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.483 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.483 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.483 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.483 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nvmeof": { 2024-08-20T01:41:59.484 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nvmeof", 2024-08-20T01:41:59.484 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.484 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.484 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.484 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-20T01:41:59.484 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.484 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.484 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.484 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nvme-of container image", 2024-08-20T01:41:59.484 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.484 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.484 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.484 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.484 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_prometheus": { 2024-08-20T01:41:59.484 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_prometheus", 2024-08-20T01:41:59.485 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.485 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.485 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.485 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-20T01:41:59.485 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.485 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.485 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.485 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-08-20T01:41:59.485 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.485 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.485 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.485 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.485 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_promtail": { 2024-08-20T01:41:59.485 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_promtail", 2024-08-20T01:41:59.486 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.486 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.486 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.486 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-20T01:41:59.486 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.486 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.486 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.486 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Promtail container image", 2024-08-20T01:41:59.486 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.486 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.486 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.487 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.487 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_samba": { 2024-08-20T01:41:59.487 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_samba", 2024-08-20T01:41:59.487 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.487 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.487 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.487 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-20T01:41:59.487 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.487 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.487 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.487 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Samba/SMB container image", 2024-08-20T01:41:59.487 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.487 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.488 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.488 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.488 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_snmp_gateway": { 2024-08-20T01:41:59.488 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_snmp_gateway", 2024-08-20T01:41:59.488 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.488 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.488 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.488 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-20T01:41:59.488 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.488 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.488 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.488 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SNMP Gateway container image", 2024-08-20T01:41:59.488 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.488 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.489 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.489 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.489 INFO:teuthology.orchestra.run.smithi022.stdout: "container_init": { 2024-08-20T01:41:59.489 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_init", 2024-08-20T01:41:59.489 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.489 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.489 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.489 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.489 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.489 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.489 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.489 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Run podman/docker with `--init`", 2024-08-20T01:41:59.489 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.490 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.490 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.490 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.490 INFO:teuthology.orchestra.run.smithi022.stdout: "daemon_cache_timeout": { 2024-08-20T01:41:59.490 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "daemon_cache_timeout", 2024-08-20T01:41:59.490 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.490 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.490 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.490 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-08-20T01:41:59.490 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.490 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.490 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.490 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-20T01:41:59.491 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.491 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.491 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.491 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.491 INFO:teuthology.orchestra.run.smithi022.stdout: "default_cephadm_command_timeout": { 2024-08-20T01:41:59.491 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_cephadm_command_timeout", 2024-08-20T01:41:59.491 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.491 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.491 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.491 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "900", 2024-08-20T01:41:59.491 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.491 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.491 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.492 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-20T01:41:59.492 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.492 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.492 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.492 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.492 INFO:teuthology.orchestra.run.smithi022.stdout: "default_registry": { 2024-08-20T01:41:59.492 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_registry", 2024-08-20T01:41:59.492 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.492 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.492 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.492 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io", 2024-08-20T01:41:59.492 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.492 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.492 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.493 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-20T01:41:59.493 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.493 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.493 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.493 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.493 INFO:teuthology.orchestra.run.smithi022.stdout: "device_cache_timeout": { 2024-08-20T01:41:59.493 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_cache_timeout", 2024-08-20T01:41:59.493 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.493 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.493 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.493 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1800", 2024-08-20T01:41:59.493 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.493 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.494 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.494 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache device inventory", 2024-08-20T01:41:59.494 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.494 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.494 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.494 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.494 INFO:teuthology.orchestra.run.smithi022.stdout: "device_enhanced_scan": { 2024-08-20T01:41:59.494 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_enhanced_scan", 2024-08-20T01:41:59.494 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.494 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.494 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.494 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.495 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.495 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.495 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.495 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-20T01:41:59.495 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.495 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.495 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.495 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.495 INFO:teuthology.orchestra.run.smithi022.stdout: "facts_cache_timeout": { 2024-08-20T01:41:59.495 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "facts_cache_timeout", 2024-08-20T01:41:59.495 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.495 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.495 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.495 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-08-20T01:41:59.496 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.496 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.496 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.496 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache host facts data", 2024-08-20T01:41:59.496 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.496 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.496 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.496 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.496 INFO:teuthology.orchestra.run.smithi022.stdout: "grafana_dashboards_path": { 2024-08-20T01:41:59.496 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "grafana_dashboards_path", 2024-08-20T01:41:59.496 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.496 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.496 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.496 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-20T01:41:59.497 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.497 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.497 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.497 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-20T01:41:59.497 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.497 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.497 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.497 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.497 INFO:teuthology.orchestra.run.smithi022.stdout: "host_check_interval": { 2024-08-20T01:41:59.497 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "host_check_interval", 2024-08-20T01:41:59.497 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.497 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.497 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.497 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-08-20T01:41:59.498 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.498 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.498 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.498 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to perform a host check", 2024-08-20T01:41:59.498 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.498 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.498 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.498 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.498 INFO:teuthology.orchestra.run.smithi022.stdout: "hw_monitoring": { 2024-08-20T01:41:59.498 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hw_monitoring", 2024-08-20T01:41:59.498 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.498 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.498 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.499 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.499 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.499 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.499 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.499 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-20T01:41:59.499 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.499 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.499 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.499 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.499 INFO:teuthology.orchestra.run.smithi022.stdout: "inventory_list_all": { 2024-08-20T01:41:59.499 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "inventory_list_all", 2024-08-20T01:41:59.499 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.500 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.500 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.500 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.500 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.500 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.500 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.500 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-20T01:41:59.500 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.500 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.500 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.500 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.500 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.501 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.501 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.501 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.501 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.501 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.501 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.501 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.501 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.501 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.501 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.501 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.502 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.502 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.502 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.502 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.502 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.502 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.502 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.502 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.502 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.502 INFO:teuthology.orchestra.run.smithi022.stdout: "log_refresh_metadata": { 2024-08-20T01:41:59.502 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_refresh_metadata", 2024-08-20T01:41:59.502 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.502 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.503 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.503 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.503 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.503 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.503 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.503 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-20T01:41:59.503 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.503 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.503 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.503 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.503 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.503 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.503 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.504 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.504 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.504 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.504 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.504 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.504 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.504 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-20T01:41:59.504 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.504 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.504 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.504 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.504 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.504 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.505 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.505 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.505 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.505 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.505 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.505 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.505 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.505 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.505 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.505 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.505 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.505 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.505 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.505 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.506 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.506 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.506 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.506 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.506 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.506 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.506 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.506 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.506 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.506 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.506 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.506 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.506 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.507 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.507 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.507 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.507 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.507 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.507 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.507 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-20T01:41:59.507 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-20T01:41:59.507 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.507 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.507 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.507 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.507 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.507 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.508 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.508 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-20T01:41:59.508 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.508 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.508 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.508 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.508 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-20T01:41:59.508 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-20T01:41:59.508 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.508 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.508 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.508 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "*", 2024-08-20T01:41:59.508 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.508 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.509 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.509 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-20T01:41:59.509 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.509 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.509 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.509 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.509 INFO:teuthology.orchestra.run.smithi022.stdout: "max_count_per_host": { 2024-08-20T01:41:59.509 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_count_per_host", 2024-08-20T01:41:59.509 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.509 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.509 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.509 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:41:59.509 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.509 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.510 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.510 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of daemons per service per host", 2024-08-20T01:41:59.510 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.510 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.510 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.510 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.510 INFO:teuthology.orchestra.run.smithi022.stdout: "max_osd_draining_count": { 2024-08-20T01:41:59.510 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_osd_draining_count", 2024-08-20T01:41:59.510 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.510 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.510 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.510 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:41:59.511 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.511 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.511 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.511 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-20T01:41:59.511 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.511 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.511 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.511 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.511 INFO:teuthology.orchestra.run.smithi022.stdout: "migration_current": { 2024-08-20T01:41:59.511 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "migration_current", 2024-08-20T01:41:59.511 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.511 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.511 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.511 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.511 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.512 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.512 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.512 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "internal - do not modify", 2024-08-20T01:41:59.512 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.512 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.512 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.512 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.512 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-08-20T01:41:59.512 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-08-20T01:41:59.512 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.512 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.512 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.512 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "root", 2024-08-20T01:41:59.512 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.513 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.513 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.513 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm-package", 2024-08-20T01:41:59.513 INFO:teuthology.orchestra.run.smithi022.stdout: "root" 2024-08-20T01:41:59.513 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.513 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "mode for remote execution of cephadm", 2024-08-20T01:41:59.513 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.513 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.513 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.513 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.513 INFO:teuthology.orchestra.run.smithi022.stdout: "oob_default_addr": { 2024-08-20T01:41:59.513 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "oob_default_addr", 2024-08-20T01:41:59.514 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.514 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.514 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.514 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "169.254.1.1", 2024-08-20T01:41:59.514 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.514 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.514 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.514 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-20T01:41:59.514 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.514 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.514 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.514 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.514 INFO:teuthology.orchestra.run.smithi022.stdout: "prometheus_alerts_path": { 2024-08-20T01:41:59.515 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus_alerts_path", 2024-08-20T01:41:59.515 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.515 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.515 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.515 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-20T01:41:59.515 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.515 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.515 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.515 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-20T01:41:59.515 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.515 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.515 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.515 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.516 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_insecure": { 2024-08-20T01:41:59.516 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_insecure", 2024-08-20T01:41:59.516 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.516 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.516 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.516 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.516 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.516 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.516 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.516 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-20T01:41:59.517 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.517 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.517 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.517 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.517 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_password": { 2024-08-20T01:41:59.517 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_password", 2024-08-20T01:41:59.517 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.517 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.517 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.517 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.517 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.517 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.518 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.518 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-20T01:41:59.518 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.518 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.518 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.518 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.518 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_url": { 2024-08-20T01:41:59.518 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_url", 2024-08-20T01:41:59.518 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.518 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.518 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.519 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.519 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.519 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.519 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.519 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-20T01:41:59.519 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.519 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.519 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.519 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.519 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_username": { 2024-08-20T01:41:59.519 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_username", 2024-08-20T01:41:59.519 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.520 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.520 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.520 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.520 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.520 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.520 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.520 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-20T01:41:59.520 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.520 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.520 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.520 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.520 INFO:teuthology.orchestra.run.smithi022.stdout: "secure_monitoring_stack": { 2024-08-20T01:41:59.521 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secure_monitoring_stack", 2024-08-20T01:41:59.521 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.521 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.521 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.521 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.521 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.521 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.521 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.521 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-20T01:41:59.521 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.521 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.521 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.522 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.522 INFO:teuthology.orchestra.run.smithi022.stdout: "service_discovery_port": { 2024-08-20T01:41:59.522 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "service_discovery_port", 2024-08-20T01:41:59.522 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.522 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.522 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.522 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8765", 2024-08-20T01:41:59.522 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.522 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.522 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.523 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "cephadm service discovery port", 2024-08-20T01:41:59.523 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.523 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.523 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.523 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.523 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.523 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.523 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.523 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.523 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.523 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.524 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.524 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.524 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.524 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.524 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.524 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.524 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.524 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.524 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_config_file": { 2024-08-20T01:41:59.524 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_config_file", 2024-08-20T01:41:59.524 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.524 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.525 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.525 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.525 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.525 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.525 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.525 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-20T01:41:59.525 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.525 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.525 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.525 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.525 INFO:teuthology.orchestra.run.smithi022.stdout: "use_agent": { 2024-08-20T01:41:59.525 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_agent", 2024-08-20T01:41:59.525 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.526 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.526 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.526 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.526 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.526 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.526 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.526 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-20T01:41:59.526 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.526 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.527 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.527 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.527 INFO:teuthology.orchestra.run.smithi022.stdout: "use_repo_digest": { 2024-08-20T01:41:59.527 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_repo_digest", 2024-08-20T01:41:59.527 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.527 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.527 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.527 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.527 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.527 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.527 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.528 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-20T01:41:59.528 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.528 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.528 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.528 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.528 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_failed_host_check": { 2024-08-20T01:41:59.528 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_failed_host_check", 2024-08-20T01:41:59.528 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.528 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.529 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.529 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.529 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.529 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.529 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.529 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if the host check fails", 2024-08-20T01:41:59.529 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.529 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.529 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.529 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.529 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_daemons": { 2024-08-20T01:41:59.530 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_daemons", 2024-08-20T01:41:59.530 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.530 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.530 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.530 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.530 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.530 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.530 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.530 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-20T01:41:59.530 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.530 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.531 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.531 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.531 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_hosts": { 2024-08-20T01:41:59.531 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_hosts", 2024-08-20T01:41:59.531 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.531 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.531 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.531 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.531 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.531 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.531 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.531 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-20T01:41:59.532 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.532 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.532 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.532 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.532 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.532 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.532 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.532 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crash", 2024-08-20T01:41:59.532 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.532 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.532 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.532 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.533 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.533 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.533 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.533 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.533 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.533 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.533 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.533 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.533 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.533 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.533 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.534 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.534 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.534 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.534 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.534 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.534 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.534 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.534 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.534 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.534 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.534 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.535 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.535 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.535 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.535 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.535 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.535 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.535 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.535 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.535 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.535 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.535 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.536 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.536 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.536 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.536 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.536 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.536 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.536 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.537 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.537 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.537 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.537 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.537 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.537 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.537 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.537 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.537 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.537 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.537 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.537 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.538 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.538 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.538 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.538 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.538 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.538 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.538 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.538 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.538 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.538 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.538 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.539 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.539 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.539 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.539 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.539 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.539 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.539 INFO:teuthology.orchestra.run.smithi022.stdout: "retain_interval": { 2024-08-20T01:41:59.539 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retain_interval", 2024-08-20T01:41:59.539 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.539 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.539 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.539 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "31536000", 2024-08-20T01:41:59.539 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.540 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.540 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.540 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-20T01:41:59.540 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.540 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.540 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.540 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.540 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.540 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.540 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.540 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.540 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.541 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.541 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.541 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.541 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.541 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.541 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.541 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.541 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.541 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.541 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_recent_interval": { 2024-08-20T01:41:59.541 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_recent_interval", 2024-08-20T01:41:59.542 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.542 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.542 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.542 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1209600", 2024-08-20T01:41:59.542 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.542 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.542 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.542 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-20T01:41:59.542 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.542 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.542 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.542 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.543 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.543 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.543 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.543 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dashboard", 2024-08-20T01:41:59.543 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.543 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.543 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.543 INFO:teuthology.orchestra.run.smithi022.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-20T01:41:59.543 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-20T01:41:59.543 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.543 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.544 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.544 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:41:59.544 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.544 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.544 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.544 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.544 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.544 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.544 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.544 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.544 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_HOST": { 2024-08-20T01:41:59.545 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-20T01:41:59.545 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.545 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.545 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.545 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.545 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.545 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.545 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.545 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.545 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.545 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.545 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.546 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.546 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-20T01:41:59.546 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-20T01:41:59.546 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.546 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.546 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.546 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.546 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.546 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.546 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.546 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.547 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.547 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.547 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.547 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.547 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_ENABLED": { 2024-08-20T01:41:59.547 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_ENABLED", 2024-08-20T01:41:59.547 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.547 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.547 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.547 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.547 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.547 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.548 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.548 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.548 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.548 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.548 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.548 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.548 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-20T01:41:59.548 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-20T01:41:59.548 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.548 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.548 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.548 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.548 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.549 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.549 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.549 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.549 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.549 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.549 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.549 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.549 INFO:teuthology.orchestra.run.smithi022.stdout: "ENABLE_BROWSABLE_API": { 2024-08-20T01:41:59.549 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-20T01:41:59.549 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.549 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.549 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.550 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.550 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.550 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.550 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.550 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.550 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.550 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.550 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.550 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.550 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-20T01:41:59.550 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-20T01:41:59.551 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.551 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.551 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.551 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.551 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.551 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.551 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.551 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.551 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.551 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.551 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.551 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.551 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-20T01:41:59.551 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-20T01:41:59.552 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.552 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.552 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.552 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.552 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.552 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.552 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.552 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.552 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.552 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.552 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.552 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.553 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-20T01:41:59.553 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-20T01:41:59.553 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.553 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.553 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.553 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.553 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.553 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.553 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.553 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.553 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.554 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.554 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.554 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.554 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-20T01:41:59.554 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-20T01:41:59.554 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.554 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.554 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.554 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.554 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.554 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.554 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.555 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.555 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.555 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.555 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.555 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.555 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-20T01:41:59.555 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-20T01:41:59.555 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.555 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.555 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.555 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.555 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.555 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.556 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.556 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.556 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.556 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.556 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.556 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.556 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-20T01:41:59.556 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-20T01:41:59.556 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.556 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.556 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.556 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.556 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.557 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.557 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.557 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.557 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.557 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.557 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.557 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.557 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-20T01:41:59.557 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-20T01:41:59.557 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.557 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.557 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.558 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.558 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.558 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.558 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.558 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.558 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.558 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.558 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.558 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.558 INFO:teuthology.orchestra.run.smithi022.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-20T01:41:59.558 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-20T01:41:59.559 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.559 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.559 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.559 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.559 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.559 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.559 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.559 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.559 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.559 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.559 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.559 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.560 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_PASSWORD": { 2024-08-20T01:41:59.560 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-20T01:41:59.560 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.560 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.560 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.560 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-08-20T01:41:59.560 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.560 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.560 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.560 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.560 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.561 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.561 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.561 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.561 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-20T01:41:59.561 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-20T01:41:59.561 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.561 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.561 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.561 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.561 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.561 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.561 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.562 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.562 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.562 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.562 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.562 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.562 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_URL": { 2024-08-20T01:41:59.562 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_URL", 2024-08-20T01:41:59.562 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.562 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.562 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.562 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.563 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.563 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.563 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.563 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.563 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.563 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.563 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.563 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.563 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_USERNAME": { 2024-08-20T01:41:59.563 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-20T01:41:59.563 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.563 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.564 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.564 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-08-20T01:41:59.564 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.564 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.564 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.564 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.564 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.564 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.564 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.564 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.564 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-20T01:41:59.565 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-20T01:41:59.565 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.565 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.565 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.565 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.565 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.565 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.565 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.565 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.565 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.565 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.565 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.565 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.566 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-20T01:41:59.566 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-20T01:41:59.566 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.566 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.566 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.566 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.566 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.566 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.566 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.566 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.566 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.566 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.566 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.567 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.567 INFO:teuthology.orchestra.run.smithi022.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-20T01:41:59.567 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-20T01:41:59.567 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.567 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.567 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.567 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.567 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.567 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.567 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.567 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.567 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.568 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.568 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.568 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.568 INFO:teuthology.orchestra.run.smithi022.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-20T01:41:59.568 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-20T01:41:59.568 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.568 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.568 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.568 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.568 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.568 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.568 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.569 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.569 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.569 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.569 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.569 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.569 INFO:teuthology.orchestra.run.smithi022.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-20T01:41:59.569 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-20T01:41:59.569 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.569 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.569 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.569 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "[]", 2024-08-20T01:41:59.569 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.570 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.570 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.570 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.570 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.570 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.570 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.570 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.570 INFO:teuthology.orchestra.run.smithi022.stdout: "MULTICLUSTER_CONFIG": { 2024-08-20T01:41:59.570 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-20T01:41:59.570 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.570 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.570 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.571 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "{}", 2024-08-20T01:41:59.571 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.571 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.571 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.571 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.571 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.571 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.571 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.571 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.571 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_HOST": { 2024-08-20T01:41:59.571 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-20T01:41:59.571 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.571 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.572 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.572 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.572 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.572 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.572 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.572 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.572 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.572 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.572 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.572 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.572 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-20T01:41:59.572 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-20T01:41:59.572 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.572 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.573 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.573 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.573 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.573 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.573 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.573 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.573 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.573 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.573 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.573 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.573 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-20T01:41:59.573 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-20T01:41:59.574 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.574 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.574 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.574 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.574 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.574 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.574 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.574 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.574 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.574 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.575 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.575 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.575 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-20T01:41:59.575 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-20T01:41:59.575 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.575 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.575 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.575 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.575 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.575 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.575 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.575 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.576 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.576 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.576 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.576 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.576 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-20T01:41:59.576 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-20T01:41:59.576 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.576 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.576 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.576 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.576 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.576 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.577 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.577 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.577 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.577 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.577 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.577 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.577 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-20T01:41:59.577 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-20T01:41:59.577 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.577 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.577 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.577 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.577 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.578 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.578 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.578 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.578 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.578 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.578 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.578 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.578 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-20T01:41:59.578 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-20T01:41:59.578 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.578 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.578 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.579 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.579 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.579 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.579 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.579 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.579 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.579 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.579 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.579 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.579 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-20T01:41:59.579 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-20T01:41:59.579 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.580 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.580 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.580 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.580 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.580 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.580 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.580 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.580 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.580 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.580 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.580 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.580 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-20T01:41:59.581 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-20T01:41:59.581 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.581 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.581 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.581 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.581 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.581 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.581 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.581 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.581 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.581 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.581 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.582 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.582 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_ENABLED": { 2024-08-20T01:41:59.582 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-20T01:41:59.582 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.582 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.582 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.582 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.582 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.582 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.582 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.582 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.582 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.583 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.583 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.583 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.583 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-20T01:41:59.583 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-20T01:41:59.583 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.583 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.583 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.583 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-20T01:41:59.583 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.584 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.584 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.584 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.584 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.584 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.584 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.584 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.584 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-20T01:41:59.584 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-20T01:41:59.584 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.584 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.584 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.585 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:41:59.585 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.585 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.585 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.585 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.585 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.585 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.585 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.585 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.585 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-20T01:41:59.585 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-20T01:41:59.585 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.586 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.586 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.586 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8", 2024-08-20T01:41:59.586 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.586 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.586 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.586 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.586 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.586 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.586 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.586 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.587 INFO:teuthology.orchestra.run.smithi022.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-20T01:41:59.587 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-20T01:41:59.587 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.587 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.587 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.587 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "45", 2024-08-20T01:41:59.587 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.587 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.587 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.587 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.587 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.587 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.588 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.588 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.588 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ACCESS_KEY": { 2024-08-20T01:41:59.588 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-20T01:41:59.588 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.588 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.588 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.588 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.588 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.588 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.588 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.588 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.589 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.589 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.589 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.589 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.589 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-20T01:41:59.589 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-20T01:41:59.589 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.589 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.589 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.589 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-08-20T01:41:59.589 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.589 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.589 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.590 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.590 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.590 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.590 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.590 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.590 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SECRET_KEY": { 2024-08-20T01:41:59.590 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-20T01:41:59.590 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.590 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.590 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.591 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.591 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.591 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.591 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.591 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.591 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.591 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.591 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.591 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.591 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SSL_VERIFY": { 2024-08-20T01:41:59.591 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-20T01:41:59.591 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.592 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.592 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.592 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.592 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.592 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.592 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.592 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.592 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.592 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.592 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.592 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.592 INFO:teuthology.orchestra.run.smithi022.stdout: "UNSAFE_TLS_v1_2": { 2024-08-20T01:41:59.593 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-20T01:41:59.593 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.593 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.593 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.593 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.593 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.593 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.593 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.593 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.593 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.593 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.593 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.594 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.594 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-20T01:41:59.594 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-20T01:41:59.594 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.594 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.594 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.594 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.594 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.594 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.594 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.594 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.595 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.595 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.595 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.595 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.595 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-20T01:41:59.595 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-20T01:41:59.595 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.595 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.595 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.595 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:41:59.595 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.595 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.596 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.596 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.596 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.596 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.596 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.596 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.596 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-20T01:41:59.596 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-20T01:41:59.596 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.596 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.596 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.596 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-08-20T01:41:59.597 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.597 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.597 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.597 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.597 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.597 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.597 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.597 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.597 INFO:teuthology.orchestra.run.smithi022.stdout: "cross_origin_url": { 2024-08-20T01:41:59.597 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cross_origin_url", 2024-08-20T01:41:59.597 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.597 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.597 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.598 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.598 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.598 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.598 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.598 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.598 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.598 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.598 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.598 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.598 INFO:teuthology.orchestra.run.smithi022.stdout: "crt_file": { 2024-08-20T01:41:59.598 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crt_file", 2024-08-20T01:41:59.599 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.599 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.599 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.599 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.599 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.599 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.599 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.599 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.599 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.599 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.599 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.599 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.600 INFO:teuthology.orchestra.run.smithi022.stdout: "debug": { 2024-08-20T01:41:59.600 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "debug", 2024-08-20T01:41:59.600 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.600 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.600 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.600 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.600 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.600 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.600 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.600 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable/disable debug options", 2024-08-20T01:41:59.600 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.600 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.601 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.601 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.601 INFO:teuthology.orchestra.run.smithi022.stdout: "jwt_token_ttl": { 2024-08-20T01:41:59.601 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "jwt_token_ttl", 2024-08-20T01:41:59.601 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.601 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.601 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.601 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "28800", 2024-08-20T01:41:59.601 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.601 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.601 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.601 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.601 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.602 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.602 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.602 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.602 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-08-20T01:41:59.602 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-08-20T01:41:59.602 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.602 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.602 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.602 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.602 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.602 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.602 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.603 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.603 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.603 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.603 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.603 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.603 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.603 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.603 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.603 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.603 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.604 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.604 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.604 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.604 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.604 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.604 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.604 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.604 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.604 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.604 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.604 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.604 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.604 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.605 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.605 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.605 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.605 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.605 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.605 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.605 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.605 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.605 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.605 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.605 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.605 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.606 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.606 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.606 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.606 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.606 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.606 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.606 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.606 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.606 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.606 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.607 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.607 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.607 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.607 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.607 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.607 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.607 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.607 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.607 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.607 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.607 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.607 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.608 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.608 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.608 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.608 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.608 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.608 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.608 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.608 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.608 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.608 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.608 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.609 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.609 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.609 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.609 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.609 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.609 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.609 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.609 INFO:teuthology.orchestra.run.smithi022.stdout: "motd": { 2024-08-20T01:41:59.609 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "motd", 2024-08-20T01:41:59.609 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.609 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.609 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.610 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.610 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.610 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.610 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.610 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "The message of the day", 2024-08-20T01:41:59.610 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.610 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.610 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.610 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.610 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect_resolve_ip_addr": { 2024-08-20T01:41:59.610 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "redirect_resolve_ip_addr", 2024-08-20T01:41:59.611 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.611 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.611 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.611 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.611 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.611 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.611 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.611 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.611 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.611 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.611 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.611 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.612 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-08-20T01:41:59.612 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-08-20T01:41:59.612 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.612 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.612 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.612 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-08-20T01:41:59.612 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.612 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.612 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.612 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.612 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.613 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.613 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.613 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.613 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-08-20T01:41:59.613 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-08-20T01:41:59.613 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.613 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.613 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.613 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8080", 2024-08-20T01:41:59.613 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.613 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.614 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.614 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.614 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.614 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.614 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.614 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.614 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.614 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.614 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.614 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.614 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.614 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.615 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.615 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.615 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.615 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.615 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.615 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.615 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.615 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.615 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-08-20T01:41:59.615 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-08-20T01:41:59.615 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.616 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.616 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.616 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.616 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.616 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.616 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.616 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.616 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.616 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.616 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.616 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.617 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl_server_port": { 2024-08-20T01:41:59.617 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl_server_port", 2024-08-20T01:41:59.617 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.617 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.617 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.617 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8443", 2024-08-20T01:41:59.617 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.617 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.617 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.617 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.617 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.617 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.617 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.618 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.618 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-08-20T01:41:59.618 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-08-20T01:41:59.618 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.618 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.618 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.618 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "redirect", 2024-08-20T01:41:59.618 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.618 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.618 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.618 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.618 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect" 2024-08-20T01:41:59.619 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.619 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.619 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.619 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.619 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.619 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.619 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-08-20T01:41:59.619 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-08-20T01:41:59.619 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.619 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.619 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.619 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-08-20T01:41:59.620 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-08-20T01:41:59.620 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-08-20T01:41:59.620 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.620 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.620 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.620 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.620 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.620 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.620 INFO:teuthology.orchestra.run.smithi022.stdout: "url_prefix": { 2024-08-20T01:41:59.620 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url_prefix", 2024-08-20T01:41:59.620 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.620 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.621 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.621 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.621 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.621 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.621 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.621 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.621 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.621 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.621 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.621 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.621 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.621 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.622 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.622 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-08-20T01:41:59.622 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.622 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.622 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.622 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_monitoring": { 2024-08-20T01:41:59.622 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_monitoring", 2024-08-20T01:41:59.622 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.622 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.622 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.622 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.622 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.623 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.623 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.623 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "monitor device health metrics", 2024-08-20T01:41:59.623 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.623 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.623 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.623 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.623 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.623 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.623 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.624 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.624 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.624 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.624 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.624 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.624 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.624 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.624 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.624 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.624 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.624 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.624 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.625 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.625 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.625 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.625 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.625 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.625 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.625 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.625 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.625 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.625 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.625 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.625 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.626 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.626 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.626 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.626 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.626 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.627 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.628 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.628 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.628 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.628 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.628 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.628 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.628 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.628 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.628 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.628 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.628 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.628 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.629 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.629 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.629 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.629 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.629 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.629 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.629 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.629 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.629 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.629 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.629 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.629 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.629 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.629 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.630 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.630 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.630 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.630 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.630 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.630 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.630 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.630 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.630 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.630 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.630 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.630 INFO:teuthology.orchestra.run.smithi022.stdout: "mark_out_threshold": { 2024-08-20T01:41:59.630 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mark_out_threshold", 2024-08-20T01:41:59.631 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.631 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.631 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.631 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2419200", 2024-08-20T01:41:59.631 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.631 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.631 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.631 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-20T01:41:59.631 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.631 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.631 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.631 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.631 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": { 2024-08-20T01:41:59.631 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_name", 2024-08-20T01:41:59.631 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.631 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.632 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.632 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "device_health_metrics", 2024-08-20T01:41:59.632 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.632 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.632 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.632 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-20T01:41:59.632 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.632 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.632 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.632 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.632 INFO:teuthology.orchestra.run.smithi022.stdout: "retention_period": { 2024-08-20T01:41:59.632 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retention_period", 2024-08-20T01:41:59.632 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.632 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.632 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.633 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15552000", 2024-08-20T01:41:59.633 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.633 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.633 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.633 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain device health metrics", 2024-08-20T01:41:59.633 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.633 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.633 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.633 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.633 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_frequency": { 2024-08-20T01:41:59.633 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_frequency", 2024-08-20T01:41:59.633 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.633 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.634 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.634 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-08-20T01:41:59.634 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.634 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.634 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.634 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-20T01:41:59.634 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.634 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.634 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.634 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.634 INFO:teuthology.orchestra.run.smithi022.stdout: "self_heal": { 2024-08-20T01:41:59.634 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "self_heal", 2024-08-20T01:41:59.634 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.635 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.635 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.635 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.635 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.635 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.635 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.635 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-20T01:41:59.635 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.635 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.635 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.635 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.635 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-08-20T01:41:59.635 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-08-20T01:41:59.635 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.636 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.636 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.636 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-08-20T01:41:59.636 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.636 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.636 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.636 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and check device health", 2024-08-20T01:41:59.636 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.636 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.636 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.636 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.636 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.636 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.637 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.637 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.637 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.637 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.637 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.637 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.637 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.637 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.637 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.637 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.637 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.637 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.637 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_threshold": { 2024-08-20T01:41:59.637 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_threshold", 2024-08-20T01:41:59.638 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.638 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.638 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.638 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7257600", 2024-08-20T01:41:59.638 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.638 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.638 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.638 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-20T01:41:59.638 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.638 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.638 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.639 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.639 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.639 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.639 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.639 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "diskprediction_local", 2024-08-20T01:41:59.639 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.639 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.639 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.639 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.639 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.639 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.639 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.639 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.640 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.640 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.640 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.640 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.640 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.640 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.640 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.640 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.640 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.640 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.640 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.640 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.640 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.640 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.641 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.641 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.641 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.641 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.641 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.641 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.641 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.641 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.641 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.641 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.641 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.641 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.641 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.642 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.642 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.642 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.642 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.642 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.642 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.642 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.642 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.642 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.642 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.642 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.642 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.642 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.643 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.643 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.643 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.643 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.643 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.643 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.643 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.643 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.643 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.643 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.643 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.643 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.643 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.643 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.644 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.644 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.644 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.644 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.644 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.644 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.644 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.644 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.644 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.644 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.644 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.644 INFO:teuthology.orchestra.run.smithi022.stdout: "predict_interval": { 2024-08-20T01:41:59.644 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predict_interval", 2024-08-20T01:41:59.644 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.645 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.645 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.645 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-08-20T01:41:59.645 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.645 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.645 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.645 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.645 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.645 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.645 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.645 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.645 INFO:teuthology.orchestra.run.smithi022.stdout: "predictor_model": { 2024-08-20T01:41:59.645 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predictor_model", 2024-08-20T01:41:59.645 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.646 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.646 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.646 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "prophetstor", 2024-08-20T01:41:59.646 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.646 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.646 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.646 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.646 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.646 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.646 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.646 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.650 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-08-20T01:41:59.650 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-08-20T01:41:59.650 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.650 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.650 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.650 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-08-20T01:41:59.650 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.650 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.650 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.650 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.650 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.650 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.650 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.651 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.651 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.651 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.651 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.651 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.651 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.651 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.651 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.651 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.651 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.651 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.651 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.651 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.651 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.652 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.652 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.652 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.652 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.652 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "influx", 2024-08-20T01:41:59.652 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": false, 2024-08-20T01:41:59.652 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "influxdb python module not found", 2024-08-20T01:41:59.652 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.652 INFO:teuthology.orchestra.run.smithi022.stdout: "batch_size": { 2024-08-20T01:41:59.652 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "batch_size", 2024-08-20T01:41:59.652 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.652 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.652 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.653 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5000", 2024-08-20T01:41:59.653 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.653 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.653 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.653 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-20T01:41:59.653 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.653 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.653 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.653 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.653 INFO:teuthology.orchestra.run.smithi022.stdout: "database": { 2024-08-20T01:41:59.653 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "database", 2024-08-20T01:41:59.653 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.653 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.653 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.654 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "ceph", 2024-08-20T01:41:59.654 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.654 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.654 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.654 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-20T01:41:59.654 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.654 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.654 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.654 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.654 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": { 2024-08-20T01:41:59.654 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hostname", 2024-08-20T01:41:59.654 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.654 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.655 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.655 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.655 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.655 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.655 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.655 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server hostname", 2024-08-20T01:41:59.655 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.655 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.655 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.655 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.655 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-08-20T01:41:59.655 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-08-20T01:41:59.656 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.656 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.656 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.656 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "30", 2024-08-20T01:41:59.656 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "5", 2024-08-20T01:41:59.656 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.656 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.656 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-20T01:41:59.656 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.656 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.656 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.656 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.656 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.656 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.657 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.657 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.657 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.657 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.657 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.657 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.657 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.657 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.657 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.657 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.657 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.657 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.657 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.657 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.658 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.658 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.658 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.658 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.658 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.658 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.658 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.658 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.658 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.658 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.658 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.658 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.658 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.658 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.659 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.659 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.659 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.659 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.659 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.659 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.659 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.659 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.659 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.659 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.659 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.659 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.659 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.659 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.660 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.660 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.660 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.660 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.660 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.660 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.660 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.660 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.660 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.660 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.660 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.660 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.660 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.660 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.661 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.661 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.661 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.661 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.661 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.661 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.661 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.661 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.661 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.661 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.661 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.661 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.661 INFO:teuthology.orchestra.run.smithi022.stdout: "password": { 2024-08-20T01:41:59.661 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "password", 2024-08-20T01:41:59.662 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.662 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.662 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.662 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.662 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.662 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.662 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.662 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "password of InfluxDB server user", 2024-08-20T01:41:59.662 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.662 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.662 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.662 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.662 INFO:teuthology.orchestra.run.smithi022.stdout: "port": { 2024-08-20T01:41:59.663 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "port", 2024-08-20T01:41:59.663 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.663 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.663 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.663 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8086", 2024-08-20T01:41:59.663 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.663 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.663 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.663 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server port", 2024-08-20T01:41:59.663 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.663 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.663 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.663 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.663 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.664 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.664 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.664 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.664 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.664 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.664 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.664 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.664 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.664 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.664 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.664 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.664 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.664 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.664 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-08-20T01:41:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-08-20T01:41:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "false", 2024-08-20T01:41:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-20T01:41:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: "threads": { 2024-08-20T01:41:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threads", 2024-08-20T01:41:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-08-20T01:41:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-08-20T01:41:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "32", 2024-08-20T01:41:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-20T01:41:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "username": { 2024-08-20T01:41:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "username", 2024-08-20T01:41:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "username of InfluxDB server user", 2024-08-20T01:41:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "verify_ssl": { 2024-08-20T01:41:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "verify_ssl", 2024-08-20T01:41:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "true", 2024-08-20T01:41:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-20T01:41:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "insights", 2024-08-20T01:41:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "iostat", 2024-08-20T01:41:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "k8sevents", 2024-08-20T01:41:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_event_retention_days": { 2024-08-20T01:41:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ceph_event_retention_days", 2024-08-20T01:41:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7", 2024-08-20T01:41:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-20T01:41:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "config_check_secs": { 2024-08-20T01:41:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_check_secs", 2024-08-20T01:41:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:41:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "10", 2024-08-20T01:41:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-20T01:41:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "localpool", 2024-08-20T01:41:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "failure_domain": { 2024-08-20T01:41:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "failure_domain", 2024-08-20T01:41:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "host", 2024-08-20T01:41:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "failure domain for any created local pool", 2024-08-20T01:41:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-20T01:41:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": { 2024-08-20T01:41:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_size", 2024-08-20T01:41:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default min_size for any created local pool", 2024-08-20T01:41:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-20T01:41:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "num_rep": { 2024-08-20T01:41:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "num_rep", 2024-08-20T01:41:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3", 2024-08-20T01:41:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default replica count for any created local pool", 2024-08-20T01:41:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": { 2024-08-20T01:41:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_num", 2024-08-20T01:41:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "128", 2024-08-20T01:41:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default pg_num for any created local pool", 2024-08-20T01:41:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "prefix": { 2024-08-20T01:41:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prefix", 2024-08-20T01:41:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name prefix for any created local pool", 2024-08-20T01:41:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "subtree": { 2024-08-20T01:41:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "subtree", 2024-08-20T01:41:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "rack", 2024-08-20T01:41:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-20T01:41:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-20T01:41:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mds_autoscaler", 2024-08-20T01:41:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirroring", 2024-08-20T01:41:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "nfs", 2024-08-20T01:41:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-08-20T01:41:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "fail_fs": { 2024-08-20T01:41:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "fail_fs", 2024-08-20T01:41:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-20T01:41:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator": { 2024-08-20T01:41:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-08-20T01:41:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-08-20T01:41:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "rook", 2024-08-20T01:41:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "test_orchestrator" 2024-08-20T01:41:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Orchestrator backend", 2024-08-20T01:41:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_perf_query", 2024-08-20T01:41:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_support", 2024-08-20T01:41:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_autoscaler", 2024-08-20T01:41:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-08-20T01:41:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-08-20T01:41:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-08-20T01:41:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "threshold": { 2024-08-20T01:41:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threshold", 2024-08-20T01:41:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:41:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-08-20T01:41:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1.0", 2024-08-20T01:41:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "scaling threshold", 2024-08-20T01:41:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-20T01:41:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "progress", 2024-08-20T01:41:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_pg_recovery_event": { 2024-08-20T01:41:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_pg_recovery_event", 2024-08-20T01:41:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-20T01:41:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-08-20T01:41:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-08-20T01:41:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "max_completed_events": { 2024-08-20T01:41:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_completed_events", 2024-08-20T01:41:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "50", 2024-08-20T01:41:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "number of past completed events to remember", 2024-08-20T01:41:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-08-20T01:41:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-08-20T01:41:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-08-20T01:41:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long the module is going to sleep", 2024-08-20T01:41:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus", 2024-08-20T01:41:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "cache": { 2024-08-20T01:41:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cache", 2024-08-20T01:41:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "exclude_perf_counters": { 2024-08-20T01:41:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "exclude_perf_counters", 2024-08-20T01:41:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-20T01:41:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-20T01:41:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools": { 2024-08-20T01:41:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools", 2024-08-20T01:41:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-20T01:41:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-20T01:41:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "300", 2024-08-20T01:41:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_interval": { 2024-08-20T01:41:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_interval", 2024-08-20T01:41:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:41:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15.0", 2024-08-20T01:41:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-08-20T01:41:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-08-20T01:41:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-08-20T01:41:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-20T01:41:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-08-20T01:41:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-08-20T01:41:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "9283", 2024-08-20T01:41:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-20T01:41:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "stale_cache_strategy": { 2024-08-20T01:41:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stale_cache_strategy", 2024-08-20T01:41:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "log", 2024-08-20T01:41:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-08-20T01:41:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-08-20T01:41:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "default", 2024-08-20T01:41:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "default", 2024-08-20T01:41:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "error" 2024-08-20T01:41:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-08-20T01:41:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-08-20T01:41:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-08-20T01:41:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-08-20T01:41:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-08-20T01:41:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-08-20T01:41:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_snap_create": { 2024-08-20T01:41:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_snap_create", 2024-08-20T01:41:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:41:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "mirror_snapshot_schedule": { 2024-08-20T01:41:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirror_snapshot_schedule", 2024-08-20T01:41:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "trash_purge_schedule": { 2024-08-20T01:41:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "trash_purge_schedule", 2024-08-20T01:41:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "restful", 2024-08-20T01:41:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_auth": { 2024-08-20T01:41:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_auth", 2024-08-20T01:41:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-08-20T01:41:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-08-20T01:41:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-08-20T01:41:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-08-20T01:41:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-08-20T01:41:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-08-20T01:41:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rgw", 2024-08-20T01:41:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "secondary_zone_period_retry_limit": { 2024-08-20T01:41:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-20T01:41:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-08-20T01:41:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-20T01:41:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rook", 2024-08-20T01:41:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "storage_class": { 2024-08-20T01:41:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "storage_class", 2024-08-20T01:41:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "local", 2024-08-20T01:41:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-20T01:41:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "selftest", 2024-08-20T01:41:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "roption1": { 2024-08-20T01:41:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption1", 2024-08-20T01:41:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "roption2": { 2024-08-20T01:41:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption2", 2024-08-20T01:41:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "xyz", 2024-08-20T01:41:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption1": { 2024-08-20T01:41:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption1", 2024-08-20T01:41:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption2": { 2024-08-20T01:41:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption2", 2024-08-20T01:41:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption3": { 2024-08-20T01:41:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption3", 2024-08-20T01:41:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:41:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption4": { 2024-08-20T01:41:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption4", 2024-08-20T01:41:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption5": { 2024-08-20T01:41:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption5", 2024-08-20T01:41:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption6": { 2024-08-20T01:41:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption6", 2024-08-20T01:41:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption7": { 2024-08-20T01:41:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption7", 2024-08-20T01:41:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-08-20T01:41:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "42", 2024-08-20T01:41:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "testkey": { 2024-08-20T01:41:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testkey", 2024-08-20T01:41:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "testlkey": { 2024-08-20T01:41:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testlkey", 2024-08-20T01:41:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "testnewline": { 2024-08-20T01:41:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testnewline", 2024-08-20T01:41:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smb", 2024-08-20T01:41:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "internal_store_backend": { 2024-08-20T01:41:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "internal_store_backend", 2024-08-20T01:41:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-20T01:41:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "update_orchestration": { 2024-08-20T01:41:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "update_orchestration", 2024-08-20T01:41:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-20T01:41:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snap_schedule", 2024-08-20T01:41:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_m_granularity": { 2024-08-20T01:41:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_m_granularity", 2024-08-20T01:41:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow minute scheduled snapshots", 2024-08-20T01:41:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "dump_on_update": { 2024-08-20T01:41:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dump_on_update", 2024-08-20T01:41:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "dump database to debug log on update", 2024-08-20T01:41:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.853 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stats", 2024-08-20T01:41:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "status", 2024-08-20T01:41:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telegraf", 2024-08-20T01:41:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "address": { 2024-08-20T01:41:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "address", 2024-08-20T01:41:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-20T01:41:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-08-20T01:41:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-08-20T01:41:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15", 2024-08-20T01:41:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telemetry", 2024-08-20T01:41:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_basic": { 2024-08-20T01:41:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_basic", 2024-08-20T01:41:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-20T01:41:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_crash": { 2024-08-20T01:41:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_crash", 2024-08-20T01:41:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-20T01:41:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_device": { 2024-08-20T01:41:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_device", 2024-08-20T01:41:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-20T01:41:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_ident": { 2024-08-20T01:41:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_ident", 2024-08-20T01:41:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-20T01:41:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_perf": { 2024-08-20T01:41:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_perf", 2024-08-20T01:41:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-20T01:41:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "contact": { 2024-08-20T01:41:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "contact", 2024-08-20T01:41:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "description": { 2024-08-20T01:41:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "description", 2024-08-20T01:41:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "device_url": { 2024-08-20T01:41:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_url", 2024-08-20T01:41:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-20T01:41:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-08-20T01:41:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-08-20T01:41:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-08-20T01:41:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-08-20T01:41:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "24", 2024-08-20T01:41:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "8", 2024-08-20T01:41:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "last_opt_revision": { 2024-08-20T01:41:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "last_opt_revision", 2024-08-20T01:41:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1", 2024-08-20T01:41:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard": { 2024-08-20T01:41:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard", 2024-08-20T01:41:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard_description": { 2024-08-20T01:41:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard_description", 2024-08-20T01:41:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "organization": { 2024-08-20T01:41:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "organization", 2024-08-20T01:41:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "proxy": { 2024-08-20T01:41:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "proxy", 2024-08-20T01:41:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "url": { 2024-08-20T01:41:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url", 2024-08-20T01:41:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-20T01:41:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "test_orchestrator", 2024-08-20T01:41:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-08-20T01:41:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_clones": { 2024-08-20T01:41:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_clones", 2024-08-20T01:41:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4", 2024-08-20T01:41:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-20T01:41:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "periodic_async_work": { 2024-08-20T01:41:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "periodic_async_work", 2024-08-20T01:41:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Periodically check for async work", 2024-08-20T01:41:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_delay": { 2024-08-20T01:41:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_delay", 2024-08-20T01:41:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-20T01:41:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_no_wait": { 2024-08-20T01:41:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_no_wait", 2024-08-20T01:41:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-20T01:41:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix", 2024-08-20T01:41:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "discovery_interval": { 2024-08-20T01:41:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "discovery_interval", 2024-08-20T01:41:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-08-20T01:41:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "100", 2024-08-20T01:41:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "identifier": { 2024-08-20T01:41:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "identifier", 2024-08-20T01:41:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-08-20T01:41:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-08-20T01:41:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-08-20T01:41:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_host": { 2024-08-20T01:41:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_host", 2024-08-20T01:41:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_port": { 2024-08-20T01:41:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_port", 2024-08-20T01:41:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10051", 2024-08-20T01:41:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_sender": { 2024-08-20T01:41:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_sender", 2024-08-20T01:41:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-20T01:41:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-08-20T01:41:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: "gid": 24140, 2024-08-20T01:41:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "y", 2024-08-20T01:41:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_features": 4540701547738038271, 2024-08-20T01:41:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: "available_modules": [ 2024-08-20T01:41:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "alerts", 2024-08-20T01:41:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-08-20T01:41:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-08-20T01:41:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-08-20T01:41:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How frequently to reexamine health status", 2024-08-20T01:41:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_destination": { 2024-08-20T01:41:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_destination", 2024-08-20T01:41:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email address to send alerts to", 2024-08-20T01:41:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_from_name": { 2024-08-20T01:41:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_from_name", 2024-08-20T01:41:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "Ceph", 2024-08-20T01:41:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email From: name", 2024-08-20T01:41:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_host": { 2024-08-20T01:41:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_host", 2024-08-20T01:41:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP server", 2024-08-20T01:41:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_password": { 2024-08-20T01:41:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_password", 2024-08-20T01:41:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Password to authenticate with", 2024-08-20T01:41:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_port": { 2024-08-20T01:41:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_port", 2024-08-20T01:41:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "465", 2024-08-20T01:41:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP port", 2024-08-20T01:41:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_sender": { 2024-08-20T01:41:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_sender", 2024-08-20T01:41:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP envelope sender", 2024-08-20T01:41:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_ssl": { 2024-08-20T01:41:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_ssl", 2024-08-20T01:41:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-20T01:41:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_user": { 2024-08-20T01:41:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_user", 2024-08-20T01:41:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "User to authenticate as", 2024-08-20T01:41:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "balancer", 2024-08-20T01:41:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "active": { 2024-08-20T01:41:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "active", 2024-08-20T01:41:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically balance PGs across cluster", 2024-08-20T01:41:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_time": { 2024-08-20T01:41:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_time", 2024-08-20T01:41:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0000", 2024-08-20T01:41:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "beginning time of day to automatically balance", 2024-08-20T01:41:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-20T01:41:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_weekday": { 2024-08-20T01:41:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_weekday", 2024-08-20T01:41:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-08-20T01:41:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-08-20T01:41:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-08-20T01:41:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-20T01:41:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-20T01:41:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_max_iterations": { 2024-08-20T01:41:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_max_iterations", 2024-08-20T01:41:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-08-20T01:41:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "25", 2024-08-20T01:41:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-08-20T01:41:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "250", 2024-08-20T01:41:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-20T01:41:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_metrics": { 2024-08-20T01:41:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_metrics", 2024-08-20T01:41:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "pgs,objects,bytes", 2024-08-20T01:41:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-20T01:41:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-20T01:41:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_step": { 2024-08-20T01:41:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_step", 2024-08-20T01:41:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:41:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.5", 2024-08-20T01:41:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0.001", 2024-08-20T01:41:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "0.999", 2024-08-20T01:41:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "aggressiveness of optimization", 2024-08-20T01:41:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-20T01:41:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "end_time": { 2024-08-20T01:41:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_time", 2024-08-20T01:41:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2359", 2024-08-20T01:41:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ending time of day to automatically balance", 2024-08-20T01:41:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-20T01:41:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "end_weekday": { 2024-08-20T01:41:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_weekday", 2024-08-20T01:41:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-08-20T01:41:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-08-20T01:41:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-08-20T01:41:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-20T01:41:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-20T01:41:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:41:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:41:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:41:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:41:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:41:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:41:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:41:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:41:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:41:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:41:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:41:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:41:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:41:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:41:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:41:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "min_score": { 2024-08-20T01:41:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_score", 2024-08-20T01:41:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:41:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-20T01:41:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-08-20T01:41:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-08-20T01:41:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "upmap", 2024-08-20T01:41:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "crush-compat", 2024-08-20T01:41:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "none", 2024-08-20T01:41:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "read", 2024-08-20T01:41:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap", 2024-08-20T01:41:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap-read" 2024-08-20T01:41:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Balancer mode", 2024-08-20T01:41:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_ids": { 2024-08-20T01:41:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_ids", 2024-08-20T01:41:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-20T01:41:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-08-20T01:41:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-08-20T01:41:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-08-20T01:41:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-20T01:41:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:41:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:41:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:41:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:41:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:41:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_deviation": { 2024-08-20T01:41:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_deviation", 2024-08-20T01:41:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.967 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.967 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-08-20T01:41:59.967 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-08-20T01:41:59.967 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.967 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.967 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-20T01:41:59.967 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-20T01:41:59.967 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.967 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.967 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.967 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_optimizations": { 2024-08-20T01:41:59.967 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_optimizations", 2024-08-20T01:41:59.967 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-08-20T01:41:59.967 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:41:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-20T01:41:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:41:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:41:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm", 2024-08-20T01:41:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:41:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:41:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:41:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_down_multiplier": { 2024-08-20T01:41:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_down_multiplier", 2024-08-20T01:41:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:41:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-08-20T01:41:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-20T01:41:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_refresh_rate": { 2024-08-20T01:41:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_refresh_rate", 2024-08-20T01:41:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "20", 2024-08-20T01:41:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-20T01:41:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_starting_port": { 2024-08-20T01:41:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_starting_port", 2024-08-20T01:41:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4721", 2024-08-20T01:41:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-20T01:41:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_ptrace": { 2024-08-20T01:41:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_ptrace", 2024-08-20T01:41:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-20T01:41:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-20T01:41:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_interval": { 2024-08-20T01:41:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_interval", 2024-08-20T01:41:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-08-20T01:41:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-20T01:41:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_memory_target_ratio": { 2024-08-20T01:41:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_memory_target_ratio", 2024-08-20T01:41:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:41:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.7", 2024-08-20T01:41:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-20T01:41:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm_log_destination": { 2024-08-20T01:41:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm_log_destination", 2024-08-20T01:41:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:41:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:41:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "file", 2024-08-20T01:41:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "file,syslog", 2024-08-20T01:41:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "syslog" 2024-08-20T01:41:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:41:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-20T01:41:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "cgroups_split": { 2024-08-20T01:41:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cgroups_split", 2024-08-20T01:41:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-20T01:41:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "config_checks_enabled": { 2024-08-20T01:41:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_checks_enabled", 2024-08-20T01:41:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:41:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-20T01:41:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "config_dashboard": { 2024-08-20T01:41:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_dashboard", 2024-08-20T01:41:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-20T01:41:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_alertmanager": { 2024-08-20T01:41:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_alertmanager", 2024-08-20T01:41:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-20T01:41:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-08-20T01:41:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_base": { 2024-08-20T01:41:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_base", 2024-08-20T01:41:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:41:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-20T01:41:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Container image name, without the tag", 2024-08-20T01:41:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_elasticsearch": { 2024-08-20T01:41:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_elasticsearch", 2024-08-20T01:41:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-20T01:41:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "elasticsearch container image", 2024-08-20T01:41:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_grafana": { 2024-08-20T01:41:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_grafana", 2024-08-20T01:41:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-20T01:41:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-08-20T01:41:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_haproxy": { 2024-08-20T01:41:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_haproxy", 2024-08-20T01:41:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-20T01:41:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "HAproxy container image", 2024-08-20T01:41:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_agent": { 2024-08-20T01:41:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_agent", 2024-08-20T01:41:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-20T01:41:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger agent container image", 2024-08-20T01:41:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_collector": { 2024-08-20T01:41:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_collector", 2024-08-20T01:41:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-20T01:41:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger collector container image", 2024-08-20T01:41:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_query": { 2024-08-20T01:41:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_query", 2024-08-20T01:41:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-20T01:41:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger query container image", 2024-08-20T01:41:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_keepalived": { 2024-08-20T01:41:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_keepalived", 2024-08-20T01:41:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-20T01:41:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Keepalived container image", 2024-08-20T01:41:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_loki": { 2024-08-20T01:41:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_loki", 2024-08-20T01:41:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-20T01:41:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Loki container image", 2024-08-20T01:41:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nginx": { 2024-08-20T01:41:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nginx", 2024-08-20T01:41:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-20T01:41:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nginx container image", 2024-08-20T01:41:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_node_exporter": { 2024-08-20T01:41:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_node_exporter", 2024-08-20T01:41:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-20T01:41:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-08-20T01:41:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nvmeof": { 2024-08-20T01:41:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nvmeof", 2024-08-20T01:41:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-20T01:41:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nvme-of container image", 2024-08-20T01:41:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_prometheus": { 2024-08-20T01:41:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_prometheus", 2024-08-20T01:41:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-20T01:41:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-08-20T01:41:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_promtail": { 2024-08-20T01:41:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_promtail", 2024-08-20T01:41:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-20T01:41:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Promtail container image", 2024-08-20T01:41:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_samba": { 2024-08-20T01:41:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_samba", 2024-08-20T01:41:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-20T01:41:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Samba/SMB container image", 2024-08-20T01:41:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_snmp_gateway": { 2024-08-20T01:41:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_snmp_gateway", 2024-08-20T01:41:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:41:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-20T01:41:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SNMP Gateway container image", 2024-08-20T01:41:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "container_init": { 2024-08-20T01:41:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_init", 2024-08-20T01:41:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:41:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:41:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Run podman/docker with `--init`", 2024-08-20T01:41:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "daemon_cache_timeout": { 2024-08-20T01:41:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "daemon_cache_timeout", 2024-08-20T01:41:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:41:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-08-20T01:41:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-20T01:41:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:41:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:41:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:41:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "default_cephadm_command_timeout": { 2024-08-20T01:41:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_cephadm_command_timeout", 2024-08-20T01:41:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:41:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:41:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:41:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "900", 2024-08-20T01:41:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:41:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:41:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:41:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-20T01:41:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:41:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "default_registry": { 2024-08-20T01:42:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_registry", 2024-08-20T01:42:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io", 2024-08-20T01:42:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-20T01:42:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "device_cache_timeout": { 2024-08-20T01:42:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_cache_timeout", 2024-08-20T01:42:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1800", 2024-08-20T01:42:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache device inventory", 2024-08-20T01:42:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "device_enhanced_scan": { 2024-08-20T01:42:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_enhanced_scan", 2024-08-20T01:42:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-20T01:42:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "facts_cache_timeout": { 2024-08-20T01:42:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "facts_cache_timeout", 2024-08-20T01:42:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-08-20T01:42:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache host facts data", 2024-08-20T01:42:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "grafana_dashboards_path": { 2024-08-20T01:42:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "grafana_dashboards_path", 2024-08-20T01:42:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-20T01:42:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-20T01:42:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "host_check_interval": { 2024-08-20T01:42:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "host_check_interval", 2024-08-20T01:42:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-08-20T01:42:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to perform a host check", 2024-08-20T01:42:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "hw_monitoring": { 2024-08-20T01:42:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hw_monitoring", 2024-08-20T01:42:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-20T01:42:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "inventory_list_all": { 2024-08-20T01:42:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "inventory_list_all", 2024-08-20T01:42:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-20T01:42:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "log_refresh_metadata": { 2024-08-20T01:42:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_refresh_metadata", 2024-08-20T01:42:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-20T01:42:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-20T01:42:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-20T01:42:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-20T01:42:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-20T01:42:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-20T01:42:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-20T01:42:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "*", 2024-08-20T01:42:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-20T01:42:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "max_count_per_host": { 2024-08-20T01:42:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_count_per_host", 2024-08-20T01:42:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:42:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of daemons per service per host", 2024-08-20T01:42:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "max_osd_draining_count": { 2024-08-20T01:42:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_osd_draining_count", 2024-08-20T01:42:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:42:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-20T01:42:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "migration_current": { 2024-08-20T01:42:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "migration_current", 2024-08-20T01:42:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "internal - do not modify", 2024-08-20T01:42:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-08-20T01:42:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-08-20T01:42:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "root", 2024-08-20T01:42:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm-package", 2024-08-20T01:42:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "root" 2024-08-20T01:42:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "mode for remote execution of cephadm", 2024-08-20T01:42:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "oob_default_addr": { 2024-08-20T01:42:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "oob_default_addr", 2024-08-20T01:42:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "169.254.1.1", 2024-08-20T01:42:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-20T01:42:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "prometheus_alerts_path": { 2024-08-20T01:42:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus_alerts_path", 2024-08-20T01:42:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-20T01:42:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-20T01:42:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_insecure": { 2024-08-20T01:42:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_insecure", 2024-08-20T01:42:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-20T01:42:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_password": { 2024-08-20T01:42:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_password", 2024-08-20T01:42:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-20T01:42:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_url": { 2024-08-20T01:42:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_url", 2024-08-20T01:42:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-20T01:42:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_username": { 2024-08-20T01:42:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_username", 2024-08-20T01:42:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-20T01:42:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "secure_monitoring_stack": { 2024-08-20T01:42:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secure_monitoring_stack", 2024-08-20T01:42:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-20T01:42:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "service_discovery_port": { 2024-08-20T01:42:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "service_discovery_port", 2024-08-20T01:42:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8765", 2024-08-20T01:42:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "cephadm service discovery port", 2024-08-20T01:42:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_config_file": { 2024-08-20T01:42:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_config_file", 2024-08-20T01:42:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-20T01:42:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "use_agent": { 2024-08-20T01:42:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_agent", 2024-08-20T01:42:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-20T01:42:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "use_repo_digest": { 2024-08-20T01:42:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_repo_digest", 2024-08-20T01:42:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-20T01:42:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_failed_host_check": { 2024-08-20T01:42:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_failed_host_check", 2024-08-20T01:42:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if the host check fails", 2024-08-20T01:42:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_daemons": { 2024-08-20T01:42:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_daemons", 2024-08-20T01:42:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-20T01:42:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_hosts": { 2024-08-20T01:42:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_hosts", 2024-08-20T01:42:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-20T01:42:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crash", 2024-08-20T01:42:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "retain_interval": { 2024-08-20T01:42:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retain_interval", 2024-08-20T01:42:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "31536000", 2024-08-20T01:42:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-20T01:42:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_recent_interval": { 2024-08-20T01:42:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_recent_interval", 2024-08-20T01:42:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1209600", 2024-08-20T01:42:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-20T01:42:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dashboard", 2024-08-20T01:42:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-20T01:42:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-20T01:42:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:42:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_HOST": { 2024-08-20T01:42:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-20T01:42:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-20T01:42:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-20T01:42:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_ENABLED": { 2024-08-20T01:42:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_ENABLED", 2024-08-20T01:42:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-20T01:42:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-20T01:42:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "ENABLE_BROWSABLE_API": { 2024-08-20T01:42:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-20T01:42:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-20T01:42:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-20T01:42:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-20T01:42:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-20T01:42:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-20T01:42:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-20T01:42:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-20T01:42:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-20T01:42:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-20T01:42:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-20T01:42:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-20T01:42:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-20T01:42:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-20T01:42:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-20T01:42:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-20T01:42:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-20T01:42:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_PASSWORD": { 2024-08-20T01:42:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-20T01:42:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-08-20T01:42:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-20T01:42:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-20T01:42:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_URL": { 2024-08-20T01:42:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_URL", 2024-08-20T01:42:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_USERNAME": { 2024-08-20T01:42:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-20T01:42:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-08-20T01:42:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-20T01:42:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-20T01:42:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-20T01:42:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-20T01:42:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-20T01:42:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-20T01:42:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-20T01:42:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-20T01:42:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-20T01:42:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-20T01:42:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "[]", 2024-08-20T01:42:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "MULTICLUSTER_CONFIG": { 2024-08-20T01:42:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-20T01:42:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "{}", 2024-08-20T01:42:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_HOST": { 2024-08-20T01:42:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-20T01:42:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-20T01:42:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-20T01:42:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-20T01:42:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-20T01:42:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-20T01:42:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-20T01:42:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-20T01:42:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-20T01:42:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-20T01:42:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-20T01:42:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-20T01:42:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-20T01:42:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-20T01:42:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-20T01:42:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-20T01:42:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-20T01:42:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_ENABLED": { 2024-08-20T01:42:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-20T01:42:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-20T01:42:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-20T01:42:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-20T01:42:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-20T01:42:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-20T01:42:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:42:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-20T01:42:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-20T01:42:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8", 2024-08-20T01:42:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-20T01:42:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-20T01:42:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "45", 2024-08-20T01:42:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ACCESS_KEY": { 2024-08-20T01:42:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-20T01:42:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-20T01:42:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-20T01:42:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-08-20T01:42:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SECRET_KEY": { 2024-08-20T01:42:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-20T01:42:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SSL_VERIFY": { 2024-08-20T01:42:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-20T01:42:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "UNSAFE_TLS_v1_2": { 2024-08-20T01:42:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-20T01:42:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-20T01:42:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-20T01:42:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-20T01:42:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-20T01:42:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:42:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-20T01:42:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-20T01:42:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-08-20T01:42:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "cross_origin_url": { 2024-08-20T01:42:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cross_origin_url", 2024-08-20T01:42:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "crt_file": { 2024-08-20T01:42:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crt_file", 2024-08-20T01:42:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "debug": { 2024-08-20T01:42:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "debug", 2024-08-20T01:42:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable/disable debug options", 2024-08-20T01:42:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "jwt_token_ttl": { 2024-08-20T01:42:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "jwt_token_ttl", 2024-08-20T01:42:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "28800", 2024-08-20T01:42:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-08-20T01:42:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-08-20T01:42:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "motd": { 2024-08-20T01:42:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "motd", 2024-08-20T01:42:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "The message of the day", 2024-08-20T01:42:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect_resolve_ip_addr": { 2024-08-20T01:42:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "redirect_resolve_ip_addr", 2024-08-20T01:42:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-08-20T01:42:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-08-20T01:42:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-08-20T01:42:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-08-20T01:42:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-08-20T01:42:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8080", 2024-08-20T01:42:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-08-20T01:42:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-08-20T01:42:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl_server_port": { 2024-08-20T01:42:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl_server_port", 2024-08-20T01:42:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8443", 2024-08-20T01:42:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-08-20T01:42:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-08-20T01:42:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "redirect", 2024-08-20T01:42:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect" 2024-08-20T01:42:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-08-20T01:42:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-08-20T01:42:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-08-20T01:42:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-08-20T01:42:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-08-20T01:42:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "url_prefix": { 2024-08-20T01:42:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url_prefix", 2024-08-20T01:42:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-08-20T01:42:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_monitoring": { 2024-08-20T01:42:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_monitoring", 2024-08-20T01:42:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "monitor device health metrics", 2024-08-20T01:42:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "mark_out_threshold": { 2024-08-20T01:42:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mark_out_threshold", 2024-08-20T01:42:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2419200", 2024-08-20T01:42:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-20T01:42:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": { 2024-08-20T01:42:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_name", 2024-08-20T01:42:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "device_health_metrics", 2024-08-20T01:42:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-20T01:42:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "retention_period": { 2024-08-20T01:42:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retention_period", 2024-08-20T01:42:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15552000", 2024-08-20T01:42:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain device health metrics", 2024-08-20T01:42:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_frequency": { 2024-08-20T01:42:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_frequency", 2024-08-20T01:42:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-08-20T01:42:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-20T01:42:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "self_heal": { 2024-08-20T01:42:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "self_heal", 2024-08-20T01:42:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-20T01:42:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-08-20T01:42:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-08-20T01:42:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-08-20T01:42:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and check device health", 2024-08-20T01:42:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_threshold": { 2024-08-20T01:42:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_threshold", 2024-08-20T01:42:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7257600", 2024-08-20T01:42:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-20T01:42:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "diskprediction_local", 2024-08-20T01:42:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "predict_interval": { 2024-08-20T01:42:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predict_interval", 2024-08-20T01:42:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-08-20T01:42:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "predictor_model": { 2024-08-20T01:42:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predictor_model", 2024-08-20T01:42:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "prophetstor", 2024-08-20T01:42:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-08-20T01:42:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-08-20T01:42:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-08-20T01:42:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "influx", 2024-08-20T01:42:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": false, 2024-08-20T01:42:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "influxdb python module not found", 2024-08-20T01:42:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "batch_size": { 2024-08-20T01:42:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "batch_size", 2024-08-20T01:42:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5000", 2024-08-20T01:42:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-20T01:42:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "database": { 2024-08-20T01:42:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "database", 2024-08-20T01:42:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "ceph", 2024-08-20T01:42:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-20T01:42:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": { 2024-08-20T01:42:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hostname", 2024-08-20T01:42:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server hostname", 2024-08-20T01:42:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-08-20T01:42:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-08-20T01:42:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "30", 2024-08-20T01:42:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "5", 2024-08-20T01:42:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-20T01:42:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "password": { 2024-08-20T01:42:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "password", 2024-08-20T01:42:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "password of InfluxDB server user", 2024-08-20T01:42:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "port": { 2024-08-20T01:42:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "port", 2024-08-20T01:42:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8086", 2024-08-20T01:42:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server port", 2024-08-20T01:42:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-08-20T01:42:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-08-20T01:42:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "false", 2024-08-20T01:42:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-20T01:42:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "threads": { 2024-08-20T01:42:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threads", 2024-08-20T01:42:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-08-20T01:42:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-08-20T01:42:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "32", 2024-08-20T01:42:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-20T01:42:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "username": { 2024-08-20T01:42:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "username", 2024-08-20T01:42:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "username of InfluxDB server user", 2024-08-20T01:42:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "verify_ssl": { 2024-08-20T01:42:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "verify_ssl", 2024-08-20T01:42:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "true", 2024-08-20T01:42:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-20T01:42:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "insights", 2024-08-20T01:42:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "iostat", 2024-08-20T01:42:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "k8sevents", 2024-08-20T01:42:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_event_retention_days": { 2024-08-20T01:42:00.170 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ceph_event_retention_days", 2024-08-20T01:42:00.170 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.170 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.170 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.170 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7", 2024-08-20T01:42:00.170 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.170 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.170 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.170 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-20T01:42:00.170 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.170 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.170 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.170 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.170 INFO:teuthology.orchestra.run.smithi022.stdout: "config_check_secs": { 2024-08-20T01:42:00.171 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_check_secs", 2024-08-20T01:42:00.171 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.171 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.171 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.171 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:42:00.171 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "10", 2024-08-20T01:42:00.171 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.171 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.171 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-20T01:42:00.171 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.171 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.171 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.171 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.171 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.171 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.171 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.172 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.172 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.172 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.172 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.172 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.172 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.172 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.172 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.172 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.172 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.172 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.172 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.172 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.172 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.172 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "localpool", 2024-08-20T01:42:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "failure_domain": { 2024-08-20T01:42:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "failure_domain", 2024-08-20T01:42:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "host", 2024-08-20T01:42:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "failure domain for any created local pool", 2024-08-20T01:42:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-20T01:42:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": { 2024-08-20T01:42:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_size", 2024-08-20T01:42:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default min_size for any created local pool", 2024-08-20T01:42:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-20T01:42:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "num_rep": { 2024-08-20T01:42:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "num_rep", 2024-08-20T01:42:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3", 2024-08-20T01:42:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default replica count for any created local pool", 2024-08-20T01:42:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": { 2024-08-20T01:42:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_num", 2024-08-20T01:42:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "128", 2024-08-20T01:42:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default pg_num for any created local pool", 2024-08-20T01:42:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "prefix": { 2024-08-20T01:42:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prefix", 2024-08-20T01:42:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name prefix for any created local pool", 2024-08-20T01:42:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "subtree": { 2024-08-20T01:42:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "subtree", 2024-08-20T01:42:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "rack", 2024-08-20T01:42:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-20T01:42:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-20T01:42:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mds_autoscaler", 2024-08-20T01:42:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirroring", 2024-08-20T01:42:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "nfs", 2024-08-20T01:42:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-08-20T01:42:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "fail_fs": { 2024-08-20T01:42:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "fail_fs", 2024-08-20T01:42:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-20T01:42:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator": { 2024-08-20T01:42:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-08-20T01:42:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-08-20T01:42:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "rook", 2024-08-20T01:42:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "test_orchestrator" 2024-08-20T01:42:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Orchestrator backend", 2024-08-20T01:42:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_perf_query", 2024-08-20T01:42:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_support", 2024-08-20T01:42:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_autoscaler", 2024-08-20T01:42:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-08-20T01:42:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-08-20T01:42:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-08-20T01:42:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "threshold": { 2024-08-20T01:42:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threshold", 2024-08-20T01:42:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:42:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-08-20T01:42:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1.0", 2024-08-20T01:42:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "scaling threshold", 2024-08-20T01:42:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-20T01:42:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "progress", 2024-08-20T01:42:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_pg_recovery_event": { 2024-08-20T01:42:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_pg_recovery_event", 2024-08-20T01:42:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-20T01:42:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-08-20T01:42:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-08-20T01:42:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "max_completed_events": { 2024-08-20T01:42:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_completed_events", 2024-08-20T01:42:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "50", 2024-08-20T01:42:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "number of past completed events to remember", 2024-08-20T01:42:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-08-20T01:42:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-08-20T01:42:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-08-20T01:42:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long the module is going to sleep", 2024-08-20T01:42:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus", 2024-08-20T01:42:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "cache": { 2024-08-20T01:42:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cache", 2024-08-20T01:42:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "exclude_perf_counters": { 2024-08-20T01:42:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "exclude_perf_counters", 2024-08-20T01:42:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-20T01:42:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-20T01:42:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools": { 2024-08-20T01:42:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools", 2024-08-20T01:42:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-20T01:42:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-20T01:42:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "300", 2024-08-20T01:42:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_interval": { 2024-08-20T01:42:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_interval", 2024-08-20T01:42:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:42:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15.0", 2024-08-20T01:42:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-08-20T01:42:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-08-20T01:42:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-08-20T01:42:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-20T01:42:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-08-20T01:42:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-08-20T01:42:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "9283", 2024-08-20T01:42:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-20T01:42:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "stale_cache_strategy": { 2024-08-20T01:42:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stale_cache_strategy", 2024-08-20T01:42:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "log", 2024-08-20T01:42:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-08-20T01:42:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-08-20T01:42:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "default", 2024-08-20T01:42:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "default", 2024-08-20T01:42:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "error" 2024-08-20T01:42:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-08-20T01:42:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-08-20T01:42:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-08-20T01:42:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-08-20T01:42:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-08-20T01:42:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-08-20T01:42:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_snap_create": { 2024-08-20T01:42:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_snap_create", 2024-08-20T01:42:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:42:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "mirror_snapshot_schedule": { 2024-08-20T01:42:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirror_snapshot_schedule", 2024-08-20T01:42:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "trash_purge_schedule": { 2024-08-20T01:42:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "trash_purge_schedule", 2024-08-20T01:42:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "restful", 2024-08-20T01:42:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_auth": { 2024-08-20T01:42:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_auth", 2024-08-20T01:42:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-08-20T01:42:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-08-20T01:42:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-08-20T01:42:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-08-20T01:42:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-08-20T01:42:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-08-20T01:42:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rgw", 2024-08-20T01:42:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "secondary_zone_period_retry_limit": { 2024-08-20T01:42:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-20T01:42:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-08-20T01:42:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-20T01:42:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rook", 2024-08-20T01:42:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "storage_class": { 2024-08-20T01:42:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "storage_class", 2024-08-20T01:42:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "local", 2024-08-20T01:42:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-20T01:42:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "selftest", 2024-08-20T01:42:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "roption1": { 2024-08-20T01:42:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption1", 2024-08-20T01:42:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "roption2": { 2024-08-20T01:42:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption2", 2024-08-20T01:42:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "xyz", 2024-08-20T01:42:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption1": { 2024-08-20T01:42:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption1", 2024-08-20T01:42:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption2": { 2024-08-20T01:42:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption2", 2024-08-20T01:42:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption3": { 2024-08-20T01:42:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption3", 2024-08-20T01:42:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:42:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption4": { 2024-08-20T01:42:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption4", 2024-08-20T01:42:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption5": { 2024-08-20T01:42:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption5", 2024-08-20T01:42:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption6": { 2024-08-20T01:42:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption6", 2024-08-20T01:42:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption7": { 2024-08-20T01:42:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption7", 2024-08-20T01:42:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-08-20T01:42:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "42", 2024-08-20T01:42:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "testkey": { 2024-08-20T01:42:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testkey", 2024-08-20T01:42:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "testlkey": { 2024-08-20T01:42:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testlkey", 2024-08-20T01:42:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "testnewline": { 2024-08-20T01:42:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testnewline", 2024-08-20T01:42:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smb", 2024-08-20T01:42:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "internal_store_backend": { 2024-08-20T01:42:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "internal_store_backend", 2024-08-20T01:42:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-20T01:42:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "update_orchestration": { 2024-08-20T01:42:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "update_orchestration", 2024-08-20T01:42:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-20T01:42:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snap_schedule", 2024-08-20T01:42:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_m_granularity": { 2024-08-20T01:42:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_m_granularity", 2024-08-20T01:42:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow minute scheduled snapshots", 2024-08-20T01:42:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "dump_on_update": { 2024-08-20T01:42:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dump_on_update", 2024-08-20T01:42:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "dump database to debug log on update", 2024-08-20T01:42:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stats", 2024-08-20T01:42:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "status", 2024-08-20T01:42:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telegraf", 2024-08-20T01:42:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "address": { 2024-08-20T01:42:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "address", 2024-08-20T01:42:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-20T01:42:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-08-20T01:42:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-08-20T01:42:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15", 2024-08-20T01:42:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telemetry", 2024-08-20T01:42:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_basic": { 2024-08-20T01:42:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_basic", 2024-08-20T01:42:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-20T01:42:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_crash": { 2024-08-20T01:42:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_crash", 2024-08-20T01:42:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-20T01:42:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_device": { 2024-08-20T01:42:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_device", 2024-08-20T01:42:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-20T01:42:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_ident": { 2024-08-20T01:42:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_ident", 2024-08-20T01:42:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-20T01:42:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_perf": { 2024-08-20T01:42:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_perf", 2024-08-20T01:42:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-20T01:42:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "contact": { 2024-08-20T01:42:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "contact", 2024-08-20T01:42:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "description": { 2024-08-20T01:42:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "description", 2024-08-20T01:42:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "device_url": { 2024-08-20T01:42:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_url", 2024-08-20T01:42:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-20T01:42:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-08-20T01:42:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-08-20T01:42:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-08-20T01:42:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-08-20T01:42:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "24", 2024-08-20T01:42:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "8", 2024-08-20T01:42:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "last_opt_revision": { 2024-08-20T01:42:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "last_opt_revision", 2024-08-20T01:42:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1", 2024-08-20T01:42:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.374 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard": { 2024-08-20T01:42:00.374 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard", 2024-08-20T01:42:00.374 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.374 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.374 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.374 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.374 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.374 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.374 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.374 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.374 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.374 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.374 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.375 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.375 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard_description": { 2024-08-20T01:42:00.375 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard_description", 2024-08-20T01:42:00.375 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.375 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.375 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.375 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.375 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.375 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.375 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.375 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.375 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.375 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.375 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "organization": { 2024-08-20T01:42:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "organization", 2024-08-20T01:42:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "proxy": { 2024-08-20T01:42:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "proxy", 2024-08-20T01:42:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "url": { 2024-08-20T01:42:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url", 2024-08-20T01:42:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-20T01:42:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "test_orchestrator", 2024-08-20T01:42:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-08-20T01:42:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_clones": { 2024-08-20T01:42:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_clones", 2024-08-20T01:42:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4", 2024-08-20T01:42:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-20T01:42:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "periodic_async_work": { 2024-08-20T01:42:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "periodic_async_work", 2024-08-20T01:42:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Periodically check for async work", 2024-08-20T01:42:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_delay": { 2024-08-20T01:42:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_delay", 2024-08-20T01:42:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-20T01:42:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_no_wait": { 2024-08-20T01:42:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_no_wait", 2024-08-20T01:42:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-20T01:42:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix", 2024-08-20T01:42:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "discovery_interval": { 2024-08-20T01:42:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "discovery_interval", 2024-08-20T01:42:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-08-20T01:42:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "100", 2024-08-20T01:42:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "identifier": { 2024-08-20T01:42:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "identifier", 2024-08-20T01:42:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-08-20T01:42:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-08-20T01:42:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-08-20T01:42:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_host": { 2024-08-20T01:42:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_host", 2024-08-20T01:42:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_port": { 2024-08-20T01:42:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_port", 2024-08-20T01:42:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10051", 2024-08-20T01:42:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_sender": { 2024-08-20T01:42:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_sender", 2024-08-20T01:42:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-20T01:42:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-08-20T01:42:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: "modules": [ 2024-08-20T01:42:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-08-20T01:42:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "dashboard", 2024-08-20T01:42:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "iostat", 2024-08-20T01:42:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "nfs", 2024-08-20T01:42:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "restful" 2024-08-20T01:42:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "available_modules": [ 2024-08-20T01:42:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "alerts", 2024-08-20T01:42:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-08-20T01:42:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-08-20T01:42:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-08-20T01:42:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How frequently to reexamine health status", 2024-08-20T01:42:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_destination": { 2024-08-20T01:42:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_destination", 2024-08-20T01:42:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email address to send alerts to", 2024-08-20T01:42:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_from_name": { 2024-08-20T01:42:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_from_name", 2024-08-20T01:42:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "Ceph", 2024-08-20T01:42:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email From: name", 2024-08-20T01:42:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_host": { 2024-08-20T01:42:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_host", 2024-08-20T01:42:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP server", 2024-08-20T01:42:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_password": { 2024-08-20T01:42:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_password", 2024-08-20T01:42:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Password to authenticate with", 2024-08-20T01:42:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_port": { 2024-08-20T01:42:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_port", 2024-08-20T01:42:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "465", 2024-08-20T01:42:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP port", 2024-08-20T01:42:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_sender": { 2024-08-20T01:42:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_sender", 2024-08-20T01:42:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP envelope sender", 2024-08-20T01:42:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_ssl": { 2024-08-20T01:42:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_ssl", 2024-08-20T01:42:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-20T01:42:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_user": { 2024-08-20T01:42:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_user", 2024-08-20T01:42:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "User to authenticate as", 2024-08-20T01:42:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "balancer", 2024-08-20T01:42:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "active": { 2024-08-20T01:42:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "active", 2024-08-20T01:42:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically balance PGs across cluster", 2024-08-20T01:42:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_time": { 2024-08-20T01:42:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_time", 2024-08-20T01:42:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0000", 2024-08-20T01:42:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "beginning time of day to automatically balance", 2024-08-20T01:42:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-20T01:42:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_weekday": { 2024-08-20T01:42:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_weekday", 2024-08-20T01:42:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-08-20T01:42:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-08-20T01:42:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-08-20T01:42:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-20T01:42:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-20T01:42:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_max_iterations": { 2024-08-20T01:42:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_max_iterations", 2024-08-20T01:42:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-08-20T01:42:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "25", 2024-08-20T01:42:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-08-20T01:42:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "250", 2024-08-20T01:42:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-20T01:42:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_metrics": { 2024-08-20T01:42:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_metrics", 2024-08-20T01:42:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "pgs,objects,bytes", 2024-08-20T01:42:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-20T01:42:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-20T01:42:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_step": { 2024-08-20T01:42:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_step", 2024-08-20T01:42:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:42:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.5", 2024-08-20T01:42:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0.001", 2024-08-20T01:42:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "0.999", 2024-08-20T01:42:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "aggressiveness of optimization", 2024-08-20T01:42:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-20T01:42:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "end_time": { 2024-08-20T01:42:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_time", 2024-08-20T01:42:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2359", 2024-08-20T01:42:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ending time of day to automatically balance", 2024-08-20T01:42:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-20T01:42:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "end_weekday": { 2024-08-20T01:42:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_weekday", 2024-08-20T01:42:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-08-20T01:42:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-08-20T01:42:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-08-20T01:42:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-20T01:42:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-20T01:42:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "min_score": { 2024-08-20T01:42:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_score", 2024-08-20T01:42:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:42:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-20T01:42:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-08-20T01:42:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-08-20T01:42:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "upmap", 2024-08-20T01:42:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "crush-compat", 2024-08-20T01:42:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "none", 2024-08-20T01:42:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "read", 2024-08-20T01:42:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap", 2024-08-20T01:42:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap-read" 2024-08-20T01:42:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Balancer mode", 2024-08-20T01:42:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_ids": { 2024-08-20T01:42:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_ids", 2024-08-20T01:42:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-20T01:42:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-08-20T01:42:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-08-20T01:42:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-08-20T01:42:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-20T01:42:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_deviation": { 2024-08-20T01:42:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_deviation", 2024-08-20T01:42:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-08-20T01:42:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-08-20T01:42:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-20T01:42:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-20T01:42:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_optimizations": { 2024-08-20T01:42:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_optimizations", 2024-08-20T01:42:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-08-20T01:42:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:42:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-20T01:42:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm", 2024-08-20T01:42:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_down_multiplier": { 2024-08-20T01:42:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_down_multiplier", 2024-08-20T01:42:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:42:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-08-20T01:42:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-20T01:42:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_refresh_rate": { 2024-08-20T01:42:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_refresh_rate", 2024-08-20T01:42:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "20", 2024-08-20T01:42:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-20T01:42:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_starting_port": { 2024-08-20T01:42:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_starting_port", 2024-08-20T01:42:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4721", 2024-08-20T01:42:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-20T01:42:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_ptrace": { 2024-08-20T01:42:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_ptrace", 2024-08-20T01:42:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-20T01:42:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-20T01:42:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_interval": { 2024-08-20T01:42:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_interval", 2024-08-20T01:42:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-08-20T01:42:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-20T01:42:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_memory_target_ratio": { 2024-08-20T01:42:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_memory_target_ratio", 2024-08-20T01:42:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:42:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.7", 2024-08-20T01:42:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-20T01:42:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm_log_destination": { 2024-08-20T01:42:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm_log_destination", 2024-08-20T01:42:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "file", 2024-08-20T01:42:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "file,syslog", 2024-08-20T01:42:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "syslog" 2024-08-20T01:42:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-20T01:42:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "cgroups_split": { 2024-08-20T01:42:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cgroups_split", 2024-08-20T01:42:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-20T01:42:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "config_checks_enabled": { 2024-08-20T01:42:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_checks_enabled", 2024-08-20T01:42:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-20T01:42:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "config_dashboard": { 2024-08-20T01:42:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_dashboard", 2024-08-20T01:42:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-20T01:42:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_alertmanager": { 2024-08-20T01:42:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_alertmanager", 2024-08-20T01:42:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-20T01:42:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-08-20T01:42:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_base": { 2024-08-20T01:42:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_base", 2024-08-20T01:42:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-20T01:42:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Container image name, without the tag", 2024-08-20T01:42:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_elasticsearch": { 2024-08-20T01:42:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_elasticsearch", 2024-08-20T01:42:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-20T01:42:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "elasticsearch container image", 2024-08-20T01:42:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_grafana": { 2024-08-20T01:42:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_grafana", 2024-08-20T01:42:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-20T01:42:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-08-20T01:42:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_haproxy": { 2024-08-20T01:42:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_haproxy", 2024-08-20T01:42:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-20T01:42:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "HAproxy container image", 2024-08-20T01:42:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_agent": { 2024-08-20T01:42:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_agent", 2024-08-20T01:42:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-20T01:42:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger agent container image", 2024-08-20T01:42:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_collector": { 2024-08-20T01:42:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_collector", 2024-08-20T01:42:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-20T01:42:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger collector container image", 2024-08-20T01:42:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_query": { 2024-08-20T01:42:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_query", 2024-08-20T01:42:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-20T01:42:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger query container image", 2024-08-20T01:42:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_keepalived": { 2024-08-20T01:42:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_keepalived", 2024-08-20T01:42:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-20T01:42:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Keepalived container image", 2024-08-20T01:42:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_loki": { 2024-08-20T01:42:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_loki", 2024-08-20T01:42:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-20T01:42:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Loki container image", 2024-08-20T01:42:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.473 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.473 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nginx": { 2024-08-20T01:42:00.473 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nginx", 2024-08-20T01:42:00.473 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-20T01:42:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nginx container image", 2024-08-20T01:42:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_node_exporter": { 2024-08-20T01:42:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_node_exporter", 2024-08-20T01:42:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-20T01:42:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-08-20T01:42:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nvmeof": { 2024-08-20T01:42:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nvmeof", 2024-08-20T01:42:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-20T01:42:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nvme-of container image", 2024-08-20T01:42:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_prometheus": { 2024-08-20T01:42:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_prometheus", 2024-08-20T01:42:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-20T01:42:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-08-20T01:42:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_promtail": { 2024-08-20T01:42:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_promtail", 2024-08-20T01:42:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-20T01:42:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Promtail container image", 2024-08-20T01:42:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_samba": { 2024-08-20T01:42:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_samba", 2024-08-20T01:42:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-20T01:42:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Samba/SMB container image", 2024-08-20T01:42:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_snmp_gateway": { 2024-08-20T01:42:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_snmp_gateway", 2024-08-20T01:42:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-20T01:42:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SNMP Gateway container image", 2024-08-20T01:42:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "container_init": { 2024-08-20T01:42:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_init", 2024-08-20T01:42:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Run podman/docker with `--init`", 2024-08-20T01:42:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "daemon_cache_timeout": { 2024-08-20T01:42:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "daemon_cache_timeout", 2024-08-20T01:42:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-08-20T01:42:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-20T01:42:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "default_cephadm_command_timeout": { 2024-08-20T01:42:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_cephadm_command_timeout", 2024-08-20T01:42:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "900", 2024-08-20T01:42:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-20T01:42:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "default_registry": { 2024-08-20T01:42:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_registry", 2024-08-20T01:42:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io", 2024-08-20T01:42:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-20T01:42:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "device_cache_timeout": { 2024-08-20T01:42:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_cache_timeout", 2024-08-20T01:42:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1800", 2024-08-20T01:42:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache device inventory", 2024-08-20T01:42:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "device_enhanced_scan": { 2024-08-20T01:42:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_enhanced_scan", 2024-08-20T01:42:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-20T01:42:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "facts_cache_timeout": { 2024-08-20T01:42:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "facts_cache_timeout", 2024-08-20T01:42:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-08-20T01:42:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache host facts data", 2024-08-20T01:42:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "grafana_dashboards_path": { 2024-08-20T01:42:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "grafana_dashboards_path", 2024-08-20T01:42:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-20T01:42:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-20T01:42:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "host_check_interval": { 2024-08-20T01:42:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "host_check_interval", 2024-08-20T01:42:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-08-20T01:42:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to perform a host check", 2024-08-20T01:42:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "hw_monitoring": { 2024-08-20T01:42:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hw_monitoring", 2024-08-20T01:42:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-20T01:42:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "inventory_list_all": { 2024-08-20T01:42:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "inventory_list_all", 2024-08-20T01:42:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-20T01:42:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "log_refresh_metadata": { 2024-08-20T01:42:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_refresh_metadata", 2024-08-20T01:42:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-20T01:42:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-20T01:42:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-20T01:42:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-20T01:42:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-20T01:42:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-20T01:42:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-20T01:42:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "*", 2024-08-20T01:42:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-20T01:42:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "max_count_per_host": { 2024-08-20T01:42:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_count_per_host", 2024-08-20T01:42:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:42:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of daemons per service per host", 2024-08-20T01:42:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "max_osd_draining_count": { 2024-08-20T01:42:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_osd_draining_count", 2024-08-20T01:42:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:42:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-20T01:42:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "migration_current": { 2024-08-20T01:42:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "migration_current", 2024-08-20T01:42:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "internal - do not modify", 2024-08-20T01:42:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-08-20T01:42:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-08-20T01:42:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "root", 2024-08-20T01:42:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm-package", 2024-08-20T01:42:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "root" 2024-08-20T01:42:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "mode for remote execution of cephadm", 2024-08-20T01:42:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "oob_default_addr": { 2024-08-20T01:42:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "oob_default_addr", 2024-08-20T01:42:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "169.254.1.1", 2024-08-20T01:42:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-20T01:42:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "prometheus_alerts_path": { 2024-08-20T01:42:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus_alerts_path", 2024-08-20T01:42:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-20T01:42:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-20T01:42:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_insecure": { 2024-08-20T01:42:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_insecure", 2024-08-20T01:42:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-20T01:42:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_password": { 2024-08-20T01:42:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_password", 2024-08-20T01:42:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-20T01:42:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_url": { 2024-08-20T01:42:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_url", 2024-08-20T01:42:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-20T01:42:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_username": { 2024-08-20T01:42:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_username", 2024-08-20T01:42:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-20T01:42:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "secure_monitoring_stack": { 2024-08-20T01:42:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secure_monitoring_stack", 2024-08-20T01:42:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-20T01:42:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "service_discovery_port": { 2024-08-20T01:42:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "service_discovery_port", 2024-08-20T01:42:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8765", 2024-08-20T01:42:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "cephadm service discovery port", 2024-08-20T01:42:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_config_file": { 2024-08-20T01:42:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_config_file", 2024-08-20T01:42:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-20T01:42:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "use_agent": { 2024-08-20T01:42:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_agent", 2024-08-20T01:42:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-20T01:42:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "use_repo_digest": { 2024-08-20T01:42:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_repo_digest", 2024-08-20T01:42:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-20T01:42:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_failed_host_check": { 2024-08-20T01:42:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_failed_host_check", 2024-08-20T01:42:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if the host check fails", 2024-08-20T01:42:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_daemons": { 2024-08-20T01:42:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_daemons", 2024-08-20T01:42:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-20T01:42:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_hosts": { 2024-08-20T01:42:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_hosts", 2024-08-20T01:42:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-20T01:42:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crash", 2024-08-20T01:42:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "retain_interval": { 2024-08-20T01:42:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retain_interval", 2024-08-20T01:42:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "31536000", 2024-08-20T01:42:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-20T01:42:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_recent_interval": { 2024-08-20T01:42:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_recent_interval", 2024-08-20T01:42:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1209600", 2024-08-20T01:42:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-20T01:42:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dashboard", 2024-08-20T01:42:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-20T01:42:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-20T01:42:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:42:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_HOST": { 2024-08-20T01:42:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-20T01:42:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-20T01:42:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-20T01:42:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_ENABLED": { 2024-08-20T01:42:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_ENABLED", 2024-08-20T01:42:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-20T01:42:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-20T01:42:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "ENABLE_BROWSABLE_API": { 2024-08-20T01:42:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-20T01:42:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-20T01:42:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-20T01:42:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-20T01:42:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-20T01:42:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-20T01:42:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-20T01:42:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-20T01:42:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-20T01:42:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-20T01:42:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-20T01:42:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-20T01:42:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-20T01:42:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-20T01:42:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-20T01:42:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-20T01:42:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-20T01:42:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_PASSWORD": { 2024-08-20T01:42:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-20T01:42:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-08-20T01:42:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-20T01:42:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-20T01:42:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_URL": { 2024-08-20T01:42:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_URL", 2024-08-20T01:42:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_USERNAME": { 2024-08-20T01:42:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-20T01:42:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-08-20T01:42:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-20T01:42:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-20T01:42:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-20T01:42:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-20T01:42:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-20T01:42:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-20T01:42:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-20T01:42:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-20T01:42:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-20T01:42:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-20T01:42:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "[]", 2024-08-20T01:42:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "MULTICLUSTER_CONFIG": { 2024-08-20T01:42:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-20T01:42:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "{}", 2024-08-20T01:42:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_HOST": { 2024-08-20T01:42:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-20T01:42:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-20T01:42:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-20T01:42:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-20T01:42:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-20T01:42:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-20T01:42:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-20T01:42:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-20T01:42:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-20T01:42:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-20T01:42:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-20T01:42:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-20T01:42:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-20T01:42:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-20T01:42:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-20T01:42:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-20T01:42:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-20T01:42:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_ENABLED": { 2024-08-20T01:42:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-20T01:42:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-20T01:42:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-20T01:42:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-20T01:42:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-20T01:42:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-20T01:42:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:42:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-20T01:42:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-20T01:42:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8", 2024-08-20T01:42:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-20T01:42:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-20T01:42:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "45", 2024-08-20T01:42:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ACCESS_KEY": { 2024-08-20T01:42:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-20T01:42:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-20T01:42:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-20T01:42:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-08-20T01:42:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SECRET_KEY": { 2024-08-20T01:42:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-20T01:42:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SSL_VERIFY": { 2024-08-20T01:42:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-20T01:42:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "UNSAFE_TLS_v1_2": { 2024-08-20T01:42:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-20T01:42:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-20T01:42:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-20T01:42:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-20T01:42:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-20T01:42:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:42:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-20T01:42:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-20T01:42:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-08-20T01:42:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "cross_origin_url": { 2024-08-20T01:42:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cross_origin_url", 2024-08-20T01:42:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "crt_file": { 2024-08-20T01:42:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crt_file", 2024-08-20T01:42:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "debug": { 2024-08-20T01:42:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "debug", 2024-08-20T01:42:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable/disable debug options", 2024-08-20T01:42:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "jwt_token_ttl": { 2024-08-20T01:42:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "jwt_token_ttl", 2024-08-20T01:42:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "28800", 2024-08-20T01:42:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-08-20T01:42:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-08-20T01:42:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "motd": { 2024-08-20T01:42:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "motd", 2024-08-20T01:42:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "The message of the day", 2024-08-20T01:42:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect_resolve_ip_addr": { 2024-08-20T01:42:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "redirect_resolve_ip_addr", 2024-08-20T01:42:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-08-20T01:42:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-08-20T01:42:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-08-20T01:42:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-08-20T01:42:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-08-20T01:42:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8080", 2024-08-20T01:42:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-08-20T01:42:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-08-20T01:42:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl_server_port": { 2024-08-20T01:42:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl_server_port", 2024-08-20T01:42:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8443", 2024-08-20T01:42:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-08-20T01:42:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-08-20T01:42:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "redirect", 2024-08-20T01:42:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect" 2024-08-20T01:42:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-08-20T01:42:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-08-20T01:42:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-08-20T01:42:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-08-20T01:42:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-08-20T01:42:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "url_prefix": { 2024-08-20T01:42:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url_prefix", 2024-08-20T01:42:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-08-20T01:42:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_monitoring": { 2024-08-20T01:42:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_monitoring", 2024-08-20T01:42:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "monitor device health metrics", 2024-08-20T01:42:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "mark_out_threshold": { 2024-08-20T01:42:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mark_out_threshold", 2024-08-20T01:42:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2419200", 2024-08-20T01:42:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-20T01:42:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": { 2024-08-20T01:42:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_name", 2024-08-20T01:42:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "device_health_metrics", 2024-08-20T01:42:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-20T01:42:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "retention_period": { 2024-08-20T01:42:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retention_period", 2024-08-20T01:42:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15552000", 2024-08-20T01:42:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain device health metrics", 2024-08-20T01:42:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_frequency": { 2024-08-20T01:42:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_frequency", 2024-08-20T01:42:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-08-20T01:42:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-20T01:42:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "self_heal": { 2024-08-20T01:42:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "self_heal", 2024-08-20T01:42:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-20T01:42:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-08-20T01:42:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-08-20T01:42:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-08-20T01:42:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and check device health", 2024-08-20T01:42:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_threshold": { 2024-08-20T01:42:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_threshold", 2024-08-20T01:42:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7257600", 2024-08-20T01:42:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-20T01:42:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "diskprediction_local", 2024-08-20T01:42:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "predict_interval": { 2024-08-20T01:42:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predict_interval", 2024-08-20T01:42:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-08-20T01:42:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "predictor_model": { 2024-08-20T01:42:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predictor_model", 2024-08-20T01:42:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "prophetstor", 2024-08-20T01:42:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-08-20T01:42:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-08-20T01:42:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-08-20T01:42:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "influx", 2024-08-20T01:42:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": false, 2024-08-20T01:42:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "influxdb python module not found", 2024-08-20T01:42:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "batch_size": { 2024-08-20T01:42:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "batch_size", 2024-08-20T01:42:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5000", 2024-08-20T01:42:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-20T01:42:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "database": { 2024-08-20T01:42:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "database", 2024-08-20T01:42:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "ceph", 2024-08-20T01:42:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-20T01:42:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": { 2024-08-20T01:42:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hostname", 2024-08-20T01:42:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server hostname", 2024-08-20T01:42:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-08-20T01:42:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-08-20T01:42:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "30", 2024-08-20T01:42:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "5", 2024-08-20T01:42:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-20T01:42:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "password": { 2024-08-20T01:42:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "password", 2024-08-20T01:42:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "password of InfluxDB server user", 2024-08-20T01:42:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "port": { 2024-08-20T01:42:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "port", 2024-08-20T01:42:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8086", 2024-08-20T01:42:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server port", 2024-08-20T01:42:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-08-20T01:42:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-08-20T01:42:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "false", 2024-08-20T01:42:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-20T01:42:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "threads": { 2024-08-20T01:42:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threads", 2024-08-20T01:42:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-08-20T01:42:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-08-20T01:42:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "32", 2024-08-20T01:42:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-20T01:42:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "username": { 2024-08-20T01:42:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "username", 2024-08-20T01:42:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "username of InfluxDB server user", 2024-08-20T01:42:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "verify_ssl": { 2024-08-20T01:42:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "verify_ssl", 2024-08-20T01:42:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "true", 2024-08-20T01:42:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-20T01:42:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "insights", 2024-08-20T01:42:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "iostat", 2024-08-20T01:42:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "k8sevents", 2024-08-20T01:42:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_event_retention_days": { 2024-08-20T01:42:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ceph_event_retention_days", 2024-08-20T01:42:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7", 2024-08-20T01:42:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-20T01:42:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "config_check_secs": { 2024-08-20T01:42:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_check_secs", 2024-08-20T01:42:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:42:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "10", 2024-08-20T01:42:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-20T01:42:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "localpool", 2024-08-20T01:42:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "failure_domain": { 2024-08-20T01:42:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "failure_domain", 2024-08-20T01:42:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "host", 2024-08-20T01:42:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "failure domain for any created local pool", 2024-08-20T01:42:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-20T01:42:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": { 2024-08-20T01:42:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_size", 2024-08-20T01:42:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default min_size for any created local pool", 2024-08-20T01:42:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-20T01:42:00.677 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.677 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.677 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "num_rep": { 2024-08-20T01:42:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "num_rep", 2024-08-20T01:42:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3", 2024-08-20T01:42:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default replica count for any created local pool", 2024-08-20T01:42:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": { 2024-08-20T01:42:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_num", 2024-08-20T01:42:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "128", 2024-08-20T01:42:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default pg_num for any created local pool", 2024-08-20T01:42:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "prefix": { 2024-08-20T01:42:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prefix", 2024-08-20T01:42:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name prefix for any created local pool", 2024-08-20T01:42:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "subtree": { 2024-08-20T01:42:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "subtree", 2024-08-20T01:42:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "rack", 2024-08-20T01:42:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-20T01:42:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-20T01:42:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mds_autoscaler", 2024-08-20T01:42:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirroring", 2024-08-20T01:42:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "nfs", 2024-08-20T01:42:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-08-20T01:42:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "fail_fs": { 2024-08-20T01:42:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "fail_fs", 2024-08-20T01:42:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-20T01:42:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator": { 2024-08-20T01:42:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-08-20T01:42:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-08-20T01:42:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "rook", 2024-08-20T01:42:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "test_orchestrator" 2024-08-20T01:42:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Orchestrator backend", 2024-08-20T01:42:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_perf_query", 2024-08-20T01:42:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_support", 2024-08-20T01:42:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_autoscaler", 2024-08-20T01:42:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-08-20T01:42:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-08-20T01:42:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-08-20T01:42:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "threshold": { 2024-08-20T01:42:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threshold", 2024-08-20T01:42:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:42:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-08-20T01:42:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1.0", 2024-08-20T01:42:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "scaling threshold", 2024-08-20T01:42:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-20T01:42:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "progress", 2024-08-20T01:42:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_pg_recovery_event": { 2024-08-20T01:42:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_pg_recovery_event", 2024-08-20T01:42:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-20T01:42:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-08-20T01:42:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-08-20T01:42:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "max_completed_events": { 2024-08-20T01:42:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_completed_events", 2024-08-20T01:42:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "50", 2024-08-20T01:42:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "number of past completed events to remember", 2024-08-20T01:42:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-08-20T01:42:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-08-20T01:42:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-08-20T01:42:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long the module is going to sleep", 2024-08-20T01:42:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus", 2024-08-20T01:42:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "cache": { 2024-08-20T01:42:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cache", 2024-08-20T01:42:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "exclude_perf_counters": { 2024-08-20T01:42:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "exclude_perf_counters", 2024-08-20T01:42:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-20T01:42:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-20T01:42:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools": { 2024-08-20T01:42:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools", 2024-08-20T01:42:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-20T01:42:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-20T01:42:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "300", 2024-08-20T01:42:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_interval": { 2024-08-20T01:42:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_interval", 2024-08-20T01:42:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:42:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15.0", 2024-08-20T01:42:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-08-20T01:42:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-08-20T01:42:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-08-20T01:42:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-20T01:42:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-08-20T01:42:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-08-20T01:42:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "9283", 2024-08-20T01:42:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-20T01:42:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "stale_cache_strategy": { 2024-08-20T01:42:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stale_cache_strategy", 2024-08-20T01:42:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "log", 2024-08-20T01:42:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-08-20T01:42:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-08-20T01:42:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "default", 2024-08-20T01:42:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "default", 2024-08-20T01:42:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "error" 2024-08-20T01:42:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-08-20T01:42:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-08-20T01:42:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-08-20T01:42:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-08-20T01:42:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-08-20T01:42:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-08-20T01:42:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_snap_create": { 2024-08-20T01:42:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_snap_create", 2024-08-20T01:42:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-08-20T01:42:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "mirror_snapshot_schedule": { 2024-08-20T01:42:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirror_snapshot_schedule", 2024-08-20T01:42:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "trash_purge_schedule": { 2024-08-20T01:42:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "trash_purge_schedule", 2024-08-20T01:42:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "restful", 2024-08-20T01:42:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_auth": { 2024-08-20T01:42:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_auth", 2024-08-20T01:42:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-08-20T01:42:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-08-20T01:42:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-08-20T01:42:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-08-20T01:42:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-08-20T01:42:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-08-20T01:42:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.781 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.781 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.781 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.781 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rgw", 2024-08-20T01:42:00.781 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.781 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.781 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.781 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.781 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.781 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.781 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.781 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.781 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.781 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.782 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.782 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.782 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.782 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.782 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.782 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.782 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.782 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.782 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.782 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.782 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.782 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.782 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.782 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.783 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.783 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.783 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.783 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.783 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.783 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.783 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.783 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.783 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.783 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.783 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.783 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "secondary_zone_period_retry_limit": { 2024-08-20T01:42:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-20T01:42:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-08-20T01:42:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-20T01:42:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rook", 2024-08-20T01:42:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "storage_class": { 2024-08-20T01:42:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "storage_class", 2024-08-20T01:42:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "local", 2024-08-20T01:42:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-20T01:42:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "selftest", 2024-08-20T01:42:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "roption1": { 2024-08-20T01:42:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption1", 2024-08-20T01:42:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "roption2": { 2024-08-20T01:42:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption2", 2024-08-20T01:42:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "xyz", 2024-08-20T01:42:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption1": { 2024-08-20T01:42:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption1", 2024-08-20T01:42:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption2": { 2024-08-20T01:42:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption2", 2024-08-20T01:42:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption3": { 2024-08-20T01:42:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption3", 2024-08-20T01:42:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-08-20T01:42:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption4": { 2024-08-20T01:42:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption4", 2024-08-20T01:42:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption5": { 2024-08-20T01:42:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption5", 2024-08-20T01:42:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption6": { 2024-08-20T01:42:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption6", 2024-08-20T01:42:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption7": { 2024-08-20T01:42:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption7", 2024-08-20T01:42:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-08-20T01:42:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "42", 2024-08-20T01:42:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "testkey": { 2024-08-20T01:42:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testkey", 2024-08-20T01:42:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "testlkey": { 2024-08-20T01:42:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testlkey", 2024-08-20T01:42:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "testnewline": { 2024-08-20T01:42:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testnewline", 2024-08-20T01:42:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smb", 2024-08-20T01:42:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "internal_store_backend": { 2024-08-20T01:42:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "internal_store_backend", 2024-08-20T01:42:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-20T01:42:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "update_orchestration": { 2024-08-20T01:42:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "update_orchestration", 2024-08-20T01:42:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-20T01:42:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snap_schedule", 2024-08-20T01:42:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_m_granularity": { 2024-08-20T01:42:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_m_granularity", 2024-08-20T01:42:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow minute scheduled snapshots", 2024-08-20T01:42:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "dump_on_update": { 2024-08-20T01:42:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dump_on_update", 2024-08-20T01:42:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "dump database to debug log on update", 2024-08-20T01:42:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stats", 2024-08-20T01:42:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "status", 2024-08-20T01:42:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telegraf", 2024-08-20T01:42:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "address": { 2024-08-20T01:42:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "address", 2024-08-20T01:42:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-20T01:42:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-08-20T01:42:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-08-20T01:42:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15", 2024-08-20T01:42:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telemetry", 2024-08-20T01:42:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_basic": { 2024-08-20T01:42:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_basic", 2024-08-20T01:42:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-20T01:42:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_crash": { 2024-08-20T01:42:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_crash", 2024-08-20T01:42:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-20T01:42:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_device": { 2024-08-20T01:42:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_device", 2024-08-20T01:42:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-20T01:42:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_ident": { 2024-08-20T01:42:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_ident", 2024-08-20T01:42:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-20T01:42:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_perf": { 2024-08-20T01:42:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_perf", 2024-08-20T01:42:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-20T01:42:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "contact": { 2024-08-20T01:42:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "contact", 2024-08-20T01:42:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "description": { 2024-08-20T01:42:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "description", 2024-08-20T01:42:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "device_url": { 2024-08-20T01:42:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_url", 2024-08-20T01:42:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-20T01:42:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-08-20T01:42:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-08-20T01:42:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-08-20T01:42:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-08-20T01:42:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "24", 2024-08-20T01:42:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "8", 2024-08-20T01:42:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "last_opt_revision": { 2024-08-20T01:42:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "last_opt_revision", 2024-08-20T01:42:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1", 2024-08-20T01:42:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard": { 2024-08-20T01:42:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard", 2024-08-20T01:42:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard_description": { 2024-08-20T01:42:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard_description", 2024-08-20T01:42:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "organization": { 2024-08-20T01:42:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "organization", 2024-08-20T01:42:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "proxy": { 2024-08-20T01:42:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "proxy", 2024-08-20T01:42:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "url": { 2024-08-20T01:42:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url", 2024-08-20T01:42:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-20T01:42:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "test_orchestrator", 2024-08-20T01:42:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-08-20T01:42:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.880 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.881 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.881 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.881 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_clones": { 2024-08-20T01:42:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_clones", 2024-08-20T01:42:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4", 2024-08-20T01:42:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-20T01:42:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "periodic_async_work": { 2024-08-20T01:42:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "periodic_async_work", 2024-08-20T01:42:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Periodically check for async work", 2024-08-20T01:42:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_delay": { 2024-08-20T01:42:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_delay", 2024-08-20T01:42:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-20T01:42:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_no_wait": { 2024-08-20T01:42:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_no_wait", 2024-08-20T01:42:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-08-20T01:42:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-20T01:42:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix", 2024-08-20T01:42:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-08-20T01:42:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-08-20T01:42:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-08-20T01:42:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "discovery_interval": { 2024-08-20T01:42:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "discovery_interval", 2024-08-20T01:42:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-08-20T01:42:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "100", 2024-08-20T01:42:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "identifier": { 2024-08-20T01:42:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "identifier", 2024-08-20T01:42:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-08-20T01:42:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-08-20T01:42:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-08-20T01:42:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-08-20T01:42:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-08-20T01:42:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-08-20T01:42:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-08-20T01:42:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-08-20T01:42:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-08-20T01:42:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-08-20T01:42:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-08-20T01:42:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-08-20T01:42:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-08-20T01:42:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-08-20T01:42:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-08-20T01:42:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-08-20T01:42:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-08-20T01:42:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-08-20T01:42:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-08-20T01:42:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-08-20T01:42:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-08-20T01:42:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-08-20T01:42:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-08-20T01:42:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:42:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-08-20T01:42:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-08-20T01:42:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-08-20T01:42:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_host": { 2024-08-20T01:42:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_host", 2024-08-20T01:42:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-08-20T01:42:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_port": { 2024-08-20T01:42:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_port", 2024-08-20T01:42:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-08-20T01:42:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10051", 2024-08-20T01:42:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_sender": { 2024-08-20T01:42:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_sender", 2024-08-20T01:42:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-08-20T01:42:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-08-20T01:42:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-08-20T01:42:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-20T01:42:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-08-20T01:42:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-08-20T01:42:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-08-20T01:42:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-08-20T01:42:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-08-20T01:42:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-08-20T01:42:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-08-20T01:42:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "services": { 2024-08-20T01:42:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "dashboard": "https://172.21.15.22:8443/" 2024-08-20T01:42:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "always_on_modules": { 2024-08-20T01:42:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "octopus": [ 2024-08-20T01:42:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-08-20T01:42:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-08-20T01:42:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-08-20T01:42:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-08-20T01:42:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-08-20T01:42:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-08-20T01:42:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-08-20T01:42:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-08-20T01:42:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-08-20T01:42:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-08-20T01:42:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "pacific": [ 2024-08-20T01:42:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-08-20T01:42:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-08-20T01:42:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-08-20T01:42:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-08-20T01:42:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-08-20T01:42:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-08-20T01:42:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-08-20T01:42:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-08-20T01:42:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-08-20T01:42:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-08-20T01:42:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "quincy": [ 2024-08-20T01:42:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-08-20T01:42:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-08-20T01:42:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-08-20T01:42:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-08-20T01:42:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-08-20T01:42:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-08-20T01:42:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-08-20T01:42:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-08-20T01:42:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-08-20T01:42:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-08-20T01:42:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "reef": [ 2024-08-20T01:42:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-08-20T01:42:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-08-20T01:42:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-08-20T01:42:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-08-20T01:42:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-08-20T01:42:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-08-20T01:42:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-08-20T01:42:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-08-20T01:42:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-08-20T01:42:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-08-20T01:42:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-08-20T01:42:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "squid": [ 2024-08-20T01:42:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-08-20T01:42:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-08-20T01:42:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-08-20T01:42:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-08-20T01:42:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-08-20T01:42:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-08-20T01:42:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-08-20T01:42:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-08-20T01:42:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-08-20T01:42:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-08-20T01:42:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-08-20T01:42:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "last_failure_osd_epoch": 3, 2024-08-20T01:42:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "active_clients": [ 2024-08-20T01:42:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-08-20T01:42:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-08-20T01:42:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-08-20T01:42:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-08-20T01:42:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3887821393 2024-08-20T01:42:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-08-20T01:42:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "libcephsqlite", 2024-08-20T01:42:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-08-20T01:42:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-08-20T01:42:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-08-20T01:42:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1566715011 2024-08-20T01:42:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-08-20T01:42:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-08-20T01:42:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-08-20T01:42:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-08-20T01:42:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-08-20T01:42:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2754516966 2024-08-20T01:42:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-08-20T01:42:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-08-20T01:42:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-08-20T01:42:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-08-20T01:42:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-08-20T01:42:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-08-20T01:42:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2253999249 2024-08-20T01:42:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-08-20T01:42:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-08-20T01:42:00.911 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:42:00.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.407+0000 7f63e65a0640 1 -- 172.21.15.22:0/3288811306 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f63cc0b3c50 msgr2=0x7f63cc0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:00.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.407+0000 7f63e65a0640 1 --2- 172.21.15.22:0/3288811306 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f63cc0b3c50 0x7f63cc0b6110 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f63d00058c0 tx=0x7f63d0005850 comp rx=0 tx=0).stop 2024-08-20T01:42:00.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.407+0000 7f63e65a0640 1 -- 172.21.15.22:0/3288811306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63e01024b0 msgr2=0x7f63e0198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:00.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.407+0000 7f63e65a0640 1 --2- 172.21.15.22:0/3288811306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63e01024b0 0x7f63e0198860 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00b4a0 tx=0x7f63dc00b960 comp rx=0 tx=0).stop 2024-08-20T01:42:00.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.407+0000 7f63e65a0640 1 -- 172.21.15.22:0/3288811306 shutdown_connections 2024-08-20T01:42:00.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.407+0000 7f63e65a0640 1 --2- 172.21.15.22:0/3288811306 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f63cc0b3c50 0x7f63cc0b6110 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:00.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.407+0000 7f63e65a0640 1 --2- 172.21.15.22:0/3288811306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e0103fc0 0x7f63e0199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:00.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.407+0000 7f63e65a0640 1 --2- 172.21.15.22:0/3288811306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63e0103600 0x7f63e0198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:00.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.407+0000 7f63e65a0640 1 --2- 172.21.15.22:0/3288811306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63e01024b0 0x7f63e0198860 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:00.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.407+0000 7f63e65a0640 1 -- 172.21.15.22:0/3288811306 >> 172.21.15.22:0/3288811306 conn(0x7f63e00fdd70 msgr2=0x7f63e0106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:00.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.407+0000 7f63e65a0640 1 -- 172.21.15.22:0/3288811306 shutdown_connections 2024-08-20T01:42:00.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:41:59.407+0000 7f63e65a0640 1 -- 172.21.15.22:0/3288811306 wait complete. 2024-08-20T01:42:00.988 DEBUG:tasks.check_counter:Getting stats from a 2024-08-20T01:42:01.008 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph daemon mds.a perf dump 2024-08-20T01:42:01.009 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:00 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/93086444' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-20T01:42:01.009 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:00 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3288811306' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-20T01:42:01.011 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:00 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/93086444' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-20T01:42:01.011 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:00 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3288811306' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-20T01:42:01.011 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:00 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/93086444' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-20T01:42:01.011 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:00 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3288811306' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-20T01:42:01.267 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:01 smithi077 ceph-mon[22251]: pgmap v674: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 116 KiB/s wr, 100 op/s 2024-08-20T01:42:01.283 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:01.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:01 smithi022 ceph-mon[18709]: pgmap v674: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 116 KiB/s wr, 100 op/s 2024-08-20T01:42:01.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:01 smithi134 ceph-mon[22511]: pgmap v674: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 116 KiB/s wr, 100 op/s 2024-08-20T01:42:01.798 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:42:01.798 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:42:01.798 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 4, 2024-08-20T01:42:01.798 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 4, 2024-08-20T01:42:01.798 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 2992, 2024-08-20T01:42:01.798 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 448, 2024-08-20T01:42:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-08-20T01:42:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 0, 2024-08-20T01:42:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.003524224, 2024-08-20T01:42:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.000032635, 2024-08-20T01:42:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.002228873, 2024-08-20T01:42:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:42:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 3, 2024-08-20T01:42:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.004057583, 2024-08-20T01:42:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.001352527 2024-08-20T01:42:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-08-20T01:42:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-08-20T01:42:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-08-20T01:42:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-20T01:42:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 448 2024-08-20T01:42:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:42:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 1, 2024-08-20T01:42:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 161, 2024-08-20T01:42:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 160, 2024-08-20T01:42:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 108192, 2024-08-20T01:42:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 3, 2024-08-20T01:42:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 2, 2024-08-20T01:42:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.014708943, 2024-08-20T01:42:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.011749688, 2024-08-20T01:42:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.001234784, 2024-08-20T01:42:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:42:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 159, 2024-08-20T01:42:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.009366186, 2024-08-20T01:42:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000058906 2024-08-20T01:42:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-08-20T01:42:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-08-20T01:42:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-08-20T01:42:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-20T01:42:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 108192 2024-08-20T01:42:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:42:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 216, 2024-08-20T01:42:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 213, 2024-08-20T01:42:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 517120, 2024-08-20T01:42:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 130624, 2024-08-20T01:42:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 2, 2024-08-20T01:42:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 1, 2024-08-20T01:42:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.036137923, 2024-08-20T01:42:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.017518608, 2024-08-20T01:42:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.022248906, 2024-08-20T01:42:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:42:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 212, 2024-08-20T01:42:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.010886387, 2024-08-20T01:42:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000051350 2024-08-20T01:42:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-08-20T01:42:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-08-20T01:42:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-08-20T01:42:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 517120, 2024-08-20T01:42:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 130624 2024-08-20T01:42:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-08-20T01:42:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 0, 2024-08-20T01:42:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-08-20T01:42:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-08-20T01:42:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:42:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-08-20T01:42:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:42:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:42:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:42:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:42:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:42:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:42:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:42:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:42:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:42:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:42:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:42:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:42:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:42:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-08-20T01:42:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:42:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-08-20T01:42:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:42:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:42:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:42:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:42:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:42:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:42:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:42:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-08-20T01:42:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:42:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:42:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:42:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-08-20T01:42:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-08-20T01:42:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-08-20T01:42:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:42:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:42:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:42:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:42:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 149024, 2024-08-20T01:42:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 31, 2024-08-20T01:42:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-08-20T01:42:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-08-20T01:42:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-08-20T01:42:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-08-20T01:42:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:42:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-08-20T01:42:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:42:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-08-20T01:42:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 0, 2024-08-20T01:42:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 0, 2024-08-20T01:42:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:42:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:42:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-08-20T01:42:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-08-20T01:42:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 928, 2024-08-20T01:42:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2, 2024-08-20T01:42:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-08-20T01:42:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-08-20T01:42:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-08-20T01:42:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-08-20T01:42:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:42:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-08-20T01:42:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-08-20T01:42:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-08-20T01:42:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 217, 2024-08-20T01:42:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 486580, 2024-08-20T01:42:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 217, 2024-08-20T01:42:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-08-20T01:42:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-08-20T01:42:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 217, 2024-08-20T01:42:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 486580, 2024-08-20T01:42:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-08-20T01:42:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-08-20T01:42:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-08-20T01:42:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-08-20T01:42:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:01.811 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:01.811 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:42:02.569 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-08-20T01:42:02.569 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-08-20T01:42:02.569 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-08-20T01:42:02.569 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-08-20T01:42:02.569 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-08-20T01:42:02.570 DEBUG:tasks.check_counter:Getting stats from d 2024-08-20T01:42:02.570 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph daemon mds.d perf dump 2024-08-20T01:42:02.829 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:03.202 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:03 smithi022 ceph-mon[18709]: pgmap v675: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 46 op/s 2024-08-20T01:42:03.308 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:42:03.308 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:42:03.308 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 0, 2024-08-20T01:42:03.308 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 2, 2024-08-20T01:42:03.308 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 0, 2024-08-20T01:42:03.308 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 0, 2024-08-20T01:42:03.308 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-08-20T01:42:03.308 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 0, 2024-08-20T01:42:03.308 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.001247155, 2024-08-20T01:42:03.308 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.000000000, 2024-08-20T01:42:03.309 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.000214662, 2024-08-20T01:42:03.309 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:42:03.309 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:03.309 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-08-20T01:42:03.309 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-08-20T01:42:03.309 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-08-20T01:42:03.309 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:03.309 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:03.309 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-08-20T01:42:03.309 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-08-20T01:42:03.309 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-08-20T01:42:03.309 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:03.309 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T01:42:03.309 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T01:42:03.309 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:03.310 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:42:03.310 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 1, 2024-08-20T01:42:03.310 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 165, 2024-08-20T01:42:03.310 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 160, 2024-08-20T01:42:03.310 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 108896, 2024-08-20T01:42:03.310 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 3, 2024-08-20T01:42:03.310 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 2, 2024-08-20T01:42:03.310 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.015383915, 2024-08-20T01:42:03.310 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.011988218, 2024-08-20T01:42:03.310 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.001483122, 2024-08-20T01:42:03.310 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:42:03.310 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:03.310 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 163, 2024-08-20T01:42:03.310 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.008821641, 2024-08-20T01:42:03.311 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000054120 2024-08-20T01:42:03.311 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:03.311 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:03.311 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-08-20T01:42:03.311 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-08-20T01:42:03.311 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-08-20T01:42:03.311 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:03.311 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-20T01:42:03.311 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 108896 2024-08-20T01:42:03.311 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:03.311 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:42:03.311 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 225, 2024-08-20T01:42:03.311 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 220, 2024-08-20T01:42:03.311 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 521472, 2024-08-20T01:42:03.311 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 134272, 2024-08-20T01:42:03.312 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 2, 2024-08-20T01:42:03.312 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 1, 2024-08-20T01:42:03.312 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.036990715, 2024-08-20T01:42:03.312 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.017675379, 2024-08-20T01:42:03.312 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.023417456, 2024-08-20T01:42:03.312 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:42:03.312 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:03.312 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 220, 2024-08-20T01:42:03.312 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.018995611, 2024-08-20T01:42:03.312 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000086343 2024-08-20T01:42:03.312 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:03.312 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:03.312 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-08-20T01:42:03.312 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-08-20T01:42:03.312 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-08-20T01:42:03.313 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:03.313 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 521472, 2024-08-20T01:42:03.313 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 134272 2024-08-20T01:42:03.313 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:03.313 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-08-20T01:42:03.313 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 0, 2024-08-20T01:42:03.313 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-08-20T01:42:03.313 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:03.313 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-08-20T01:42:03.313 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:42:03.313 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-08-20T01:42:03.313 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:42:03.313 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:42:03.313 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:42:03.314 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:42:03.314 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:42:03.314 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:42:03.314 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:42:03.314 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:42:03.314 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:42:03.314 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:42:03.314 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:42:03.314 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:42:03.314 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:42:03.314 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-08-20T01:42:03.314 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:42:03.314 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-08-20T01:42:03.315 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:42:03.315 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:42:03.315 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:42:03.315 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:42:03.315 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:42:03.315 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:42:03.315 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:42:03.315 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-08-20T01:42:03.315 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:42:03.315 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:42:03.315 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:42:03.315 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-08-20T01:42:03.315 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-08-20T01:42:03.315 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-08-20T01:42:03.316 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:42:03.316 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:42:03.316 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:42:03.316 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:42:03.316 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 149007, 2024-08-20T01:42:03.316 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 30, 2024-08-20T01:42:03.316 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-08-20T01:42:03.316 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-08-20T01:42:03.316 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-08-20T01:42:03.316 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-08-20T01:42:03.316 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:42:03.316 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-08-20T01:42:03.316 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:42:03.316 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-08-20T01:42:03.316 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 0, 2024-08-20T01:42:03.317 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 0, 2024-08-20T01:42:03.317 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:42:03.317 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:42:03.317 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-08-20T01:42:03.317 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-08-20T01:42:03.317 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 928, 2024-08-20T01:42:03.317 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2, 2024-08-20T01:42:03.317 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-08-20T01:42:03.317 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-08-20T01:42:03.317 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-08-20T01:42:03.317 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-08-20T01:42:03.317 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:03.317 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:42:03.317 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-08-20T01:42:03.317 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-08-20T01:42:03.318 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-08-20T01:42:03.318 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 222, 2024-08-20T01:42:03.318 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 487230, 2024-08-20T01:42:03.318 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:03.318 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 222, 2024-08-20T01:42:03.318 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-08-20T01:42:03.318 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-08-20T01:42:03.318 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 222, 2024-08-20T01:42:03.318 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 487230, 2024-08-20T01:42:03.318 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-08-20T01:42:03.318 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-08-20T01:42:03.318 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-08-20T01:42:03.318 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-08-20T01:42:03.318 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:03.318 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:03.319 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:42:03.319 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:03 smithi077 ceph-mon[22251]: pgmap v675: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 46 op/s 2024-08-20T01:42:03.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:03 smithi134 ceph-mon[22511]: pgmap v675: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 46 op/s 2024-08-20T01:42:04.040 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-08-20T01:42:04.040 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-08-20T01:42:04.040 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-08-20T01:42:04.040 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-08-20T01:42:04.040 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-08-20T01:42:04.040 DEBUG:tasks.check_counter:Getting stats from g 2024-08-20T01:42:04.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph daemon mds.g perf dump 2024-08-20T01:42:04.306 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:04.784 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:42:04.784 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:42:04.784 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 0, 2024-08-20T01:42:04.784 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 2, 2024-08-20T01:42:04.784 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 0, 2024-08-20T01:42:04.784 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 0, 2024-08-20T01:42:04.784 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-08-20T01:42:04.784 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 0, 2024-08-20T01:42:04.784 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.001308842, 2024-08-20T01:42:04.784 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.000000000, 2024-08-20T01:42:04.784 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.000200312, 2024-08-20T01:42:04.785 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:42:04.785 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:04.785 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-08-20T01:42:04.785 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-08-20T01:42:04.785 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-08-20T01:42:04.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:04.785 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:04.785 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-08-20T01:42:04.785 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-08-20T01:42:04.785 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-08-20T01:42:04.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:04.785 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T01:42:04.785 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T01:42:04.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:04.786 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:42:04.786 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 217, 2024-08-20T01:42:04.786 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 214, 2024-08-20T01:42:04.786 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 517392, 2024-08-20T01:42:04.786 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 131264, 2024-08-20T01:42:04.786 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 2, 2024-08-20T01:42:04.786 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 1, 2024-08-20T01:42:04.786 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.036099935, 2024-08-20T01:42:04.786 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.017832574, 2024-08-20T01:42:04.786 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.022149125, 2024-08-20T01:42:04.786 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:42:04.786 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:04.786 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 213, 2024-08-20T01:42:04.787 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.010319032, 2024-08-20T01:42:04.787 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000048446 2024-08-20T01:42:04.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:04.787 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:04.787 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-08-20T01:42:04.787 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-08-20T01:42:04.787 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-08-20T01:42:04.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:04.787 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 517392, 2024-08-20T01:42:04.787 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 131264 2024-08-20T01:42:04.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:04.787 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:42:04.787 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 5, 2024-08-20T01:42:04.787 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 164, 2024-08-20T01:42:04.788 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 3152, 2024-08-20T01:42:04.788 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 108816, 2024-08-20T01:42:04.788 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 3, 2024-08-20T01:42:04.788 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 2, 2024-08-20T01:42:04.788 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.017567860, 2024-08-20T01:42:04.788 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.012074201, 2024-08-20T01:42:04.788 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.003838086, 2024-08-20T01:42:04.788 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:42:04.788 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:04.788 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 163, 2024-08-20T01:42:04.788 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.010797881, 2024-08-20T01:42:04.788 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000066244 2024-08-20T01:42:04.788 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:04.788 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:04.789 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-08-20T01:42:04.789 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-08-20T01:42:04.789 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-08-20T01:42:04.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:04.789 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-08-20T01:42:04.789 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 108816 2024-08-20T01:42:04.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:04.789 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-08-20T01:42:04.789 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 0, 2024-08-20T01:42:04.789 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-08-20T01:42:04.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:04.789 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-08-20T01:42:04.789 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:42:04.789 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-08-20T01:42:04.790 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:42:04.790 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:42:04.790 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:42:04.790 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:42:04.790 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:42:04.790 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:42:04.790 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:42:04.790 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:42:04.790 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:42:04.790 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:42:04.790 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:42:04.790 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:42:04.790 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:42:04.790 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-08-20T01:42:04.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:42:04.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-08-20T01:42:04.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:42:04.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:42:04.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:42:04.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:42:04.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:42:04.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:42:04.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:42:04.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-08-20T01:42:04.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:42:04.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:42:04.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:42:04.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-08-20T01:42:04.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-08-20T01:42:04.792 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-08-20T01:42:04.792 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:42:04.792 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:42:04.792 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:42:04.792 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:42:04.792 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 148984, 2024-08-20T01:42:04.792 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 30, 2024-08-20T01:42:04.792 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-08-20T01:42:04.792 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-08-20T01:42:04.792 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-08-20T01:42:04.792 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-08-20T01:42:04.792 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:42:04.792 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-08-20T01:42:04.792 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:42:04.792 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-08-20T01:42:04.793 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 0, 2024-08-20T01:42:04.793 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 0, 2024-08-20T01:42:04.793 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:42:04.793 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:42:04.793 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-08-20T01:42:04.793 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-08-20T01:42:04.793 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 928, 2024-08-20T01:42:04.793 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2, 2024-08-20T01:42:04.793 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-08-20T01:42:04.793 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-08-20T01:42:04.793 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-08-20T01:42:04.793 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-08-20T01:42:04.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:04.793 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:42:04.793 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-08-20T01:42:04.794 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-08-20T01:42:04.794 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-08-20T01:42:04.794 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 218, 2024-08-20T01:42:04.794 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 486710, 2024-08-20T01:42:04.794 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:04.794 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 218, 2024-08-20T01:42:04.794 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-08-20T01:42:04.794 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-08-20T01:42:04.794 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 218, 2024-08-20T01:42:04.794 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 486710, 2024-08-20T01:42:04.794 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-08-20T01:42:04.794 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-08-20T01:42:04.794 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-08-20T01:42:04.794 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-08-20T01:42:04.794 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:04.795 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:04.795 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:42:05.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:05 smithi077 ceph-mon[22251]: pgmap v676: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-08-20T01:42:05.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:05 smithi022 ceph-mon[18709]: pgmap v676: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-08-20T01:42:05.465 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-08-20T01:42:05.465 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-08-20T01:42:05.465 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-08-20T01:42:05.465 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-08-20T01:42:05.465 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-08-20T01:42:05.465 DEBUG:tasks.check_counter:Getting stats from j 2024-08-20T01:42:05.465 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph daemon mds.j perf dump 2024-08-20T01:42:05.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:05 smithi134 ceph-mon[22511]: pgmap v676: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-08-20T01:42:05.723 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:06.228 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-08-20T01:42:06.229 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:42:06.229 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 0, 2024-08-20T01:42:06.229 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 2, 2024-08-20T01:42:06.229 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 0, 2024-08-20T01:42:06.229 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 0, 2024-08-20T01:42:06.229 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-08-20T01:42:06.229 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 0, 2024-08-20T01:42:06.229 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.001364619, 2024-08-20T01:42:06.229 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.000000000, 2024-08-20T01:42:06.229 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.000224347, 2024-08-20T01:42:06.229 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:42:06.230 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:06.230 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-08-20T01:42:06.230 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-08-20T01:42:06.230 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-08-20T01:42:06.230 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:06.230 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:06.230 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-08-20T01:42:06.230 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-08-20T01:42:06.230 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-08-20T01:42:06.230 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:06.230 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T01:42:06.231 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T01:42:06.231 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:06.231 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:42:06.231 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 1, 2024-08-20T01:42:06.231 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 166, 2024-08-20T01:42:06.231 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 160, 2024-08-20T01:42:06.231 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 109072, 2024-08-20T01:42:06.231 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 3, 2024-08-20T01:42:06.231 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 2, 2024-08-20T01:42:06.231 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.015122692, 2024-08-20T01:42:06.231 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.012079589, 2024-08-20T01:42:06.231 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.001362426, 2024-08-20T01:42:06.231 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:42:06.232 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:06.232 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 164, 2024-08-20T01:42:06.232 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.009214901, 2024-08-20T01:42:06.232 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000056188 2024-08-20T01:42:06.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:06.232 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:06.232 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-08-20T01:42:06.232 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-08-20T01:42:06.232 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-08-20T01:42:06.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:06.232 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-20T01:42:06.232 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 109072 2024-08-20T01:42:06.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:06.232 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:42:06.232 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 226, 2024-08-20T01:42:06.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 221, 2024-08-20T01:42:06.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 521744, 2024-08-20T01:42:06.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 134912, 2024-08-20T01:42:06.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 2, 2024-08-20T01:42:06.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 1, 2024-08-20T01:42:06.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.037726832, 2024-08-20T01:42:06.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.018302110, 2024-08-20T01:42:06.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.023553741, 2024-08-20T01:42:06.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:42:06.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:06.233 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 221, 2024-08-20T01:42:06.233 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.019467900, 2024-08-20T01:42:06.233 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000088090 2024-08-20T01:42:06.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:06.234 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:06.234 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-08-20T01:42:06.234 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-08-20T01:42:06.234 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-08-20T01:42:06.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:06.234 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 521744, 2024-08-20T01:42:06.234 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 134912 2024-08-20T01:42:06.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:06.234 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-08-20T01:42:06.234 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 0, 2024-08-20T01:42:06.234 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-08-20T01:42:06.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:06.235 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-08-20T01:42:06.235 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:42:06.235 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-08-20T01:42:06.235 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:42:06.235 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:42:06.235 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:42:06.235 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:42:06.235 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:42:06.235 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:42:06.235 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:42:06.235 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:42:06.235 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:42:06.235 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:42:06.235 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:42:06.236 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:42:06.236 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:42:06.236 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-08-20T01:42:06.236 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:42:06.236 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-08-20T01:42:06.236 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:42:06.236 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:42:06.236 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:42:06.236 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:42:06.236 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:42:06.236 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:42:06.236 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:42:06.236 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-08-20T01:42:06.236 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:42:06.236 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:42:06.237 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:42:06.237 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-08-20T01:42:06.237 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-08-20T01:42:06.237 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-08-20T01:42:06.237 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:42:06.237 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:42:06.237 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:42:06.237 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:42:06.237 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 148967, 2024-08-20T01:42:06.237 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 29, 2024-08-20T01:42:06.237 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-08-20T01:42:06.237 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-08-20T01:42:06.237 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-08-20T01:42:06.237 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-08-20T01:42:06.237 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:42:06.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-08-20T01:42:06.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:42:06.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-08-20T01:42:06.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 0, 2024-08-20T01:42:06.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 0, 2024-08-20T01:42:06.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:42:06.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:42:06.238 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-08-20T01:42:06.238 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-08-20T01:42:06.238 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 928, 2024-08-20T01:42:06.238 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2, 2024-08-20T01:42:06.238 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-08-20T01:42:06.238 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-08-20T01:42:06.238 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-08-20T01:42:06.239 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-08-20T01:42:06.239 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-08-20T01:42:06.239 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:42:06.239 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-08-20T01:42:06.239 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-08-20T01:42:06.239 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-08-20T01:42:06.239 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 223, 2024-08-20T01:42:06.239 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 487360, 2024-08-20T01:42:06.239 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:06.239 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 223, 2024-08-20T01:42:06.239 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-08-20T01:42:06.239 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-08-20T01:42:06.239 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 223, 2024-08-20T01:42:06.239 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 487360, 2024-08-20T01:42:06.239 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-08-20T01:42:06.240 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-08-20T01:42:06.240 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-08-20T01:42:06.240 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-08-20T01:42:06.240 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:06.240 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-08-20T01:42:06.240 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-08-20T01:42:06.874 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-08-20T01:42:06.874 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-08-20T01:42:06.874 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-08-20T01:42:06.874 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-08-20T01:42:06.875 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-08-20T01:42:06.875 DEBUG:tasks.check_counter:Getting stats from b 2024-08-20T01:42:06.875 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph daemon mds.b perf dump 2024-08-20T01:42:07.137 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:07 smithi022 ceph-mon[18709]: pgmap v677: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2024-08-20T01:42:07.192 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:42:07.313 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:07 smithi077 ceph-mon[22251]: pgmap v677: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2024-08-20T01:42:07.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:07 smithi134 ceph-mon[22511]: pgmap v677: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2024-08-20T01:42:07.804 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-08-20T01:42:07.804 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:42:07.804 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 432199, 2024-08-20T01:42:07.804 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 670521, 2024-08-20T01:42:07.804 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 142390843, 2024-08-20T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 405666602, 2024-08-20T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 37, 2024-08-20T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 6, 2024-08-20T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 24.152508215, 2024-08-20T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 14.889834202, 2024-08-20T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 31.801979379, 2024-08-20T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 1.297812787, 2024-08-20T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 670517, 2024-08-20T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 52.398782849, 2024-08-20T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000078146 2024-08-20T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:07.806 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 505578, 2024-08-20T01:42:07.806 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.124737711, 2024-08-20T01:42:07.806 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000246 2024-08-20T01:42:07.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.806 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 605408, 2024-08-20T01:42:07.806 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 226224 2024-08-20T01:42:07.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.806 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:42:07.806 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 132724, 2024-08-20T01:42:07.806 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 138461, 2024-08-20T01:42:07.806 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 111424901, 2024-08-20T01:42:07.806 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 170161034, 2024-08-20T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 8, 2024-08-20T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 5, 2024-08-20T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 8.913200735, 2024-08-20T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 4.502628656, 2024-08-20T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 3.100484762, 2024-08-20T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 1.513770939, 2024-08-20T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 138461, 2024-08-20T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 17.508911302, 2024-08-20T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000126453 2024-08-20T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 115946, 2024-08-20T01:42:07.808 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.017523882, 2024-08-20T01:42:07.808 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000151 2024-08-20T01:42:07.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.808 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-20T01:42:07.808 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 370048 2024-08-20T01:42:07.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.808 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:42:07.808 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 144168, 2024-08-20T01:42:07.808 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 124930, 2024-08-20T01:42:07.808 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 66231817, 2024-08-20T01:42:07.808 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 311326345, 2024-08-20T01:42:07.808 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 12, 2024-08-20T01:42:07.808 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 5, 2024-08-20T01:42:07.808 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 8.804564428, 2024-08-20T01:42:07.809 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 4.542310630, 2024-08-20T01:42:07.809 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 3.325633688, 2024-08-20T01:42:07.809 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 1.336204463, 2024-08-20T01:42:07.809 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:07.809 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 124930, 2024-08-20T01:42:07.809 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 9.891941239, 2024-08-20T01:42:07.809 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000079179 2024-08-20T01:42:07.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.809 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:07.809 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 147067, 2024-08-20T01:42:07.809 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.019080699, 2024-08-20T01:42:07.809 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000129 2024-08-20T01:42:07.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.809 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T01:42:07.810 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T01:42:07.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.810 INFO:teuthology.orchestra.run.smithi077.stdout: "cct": { 2024-08-20T01:42:07.810 INFO:teuthology.orchestra.run.smithi077.stdout: "total_workers": 1, 2024-08-20T01:42:07.810 INFO:teuthology.orchestra.run.smithi077.stdout: "unhealthy_workers": 0 2024-08-20T01:42:07.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.810 INFO:teuthology.orchestra.run.smithi077.stdout: "finisher-MDSRank": { 2024-08-20T01:42:07.810 INFO:teuthology.orchestra.run.smithi077.stdout: "queue_len": 0, 2024-08-20T01:42:07.810 INFO:teuthology.orchestra.run.smithi077.stdout: "complete_latency": { 2024-08-20T01:42:07.810 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 107483, 2024-08-20T01:42:07.810 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 136.015153495, 2024-08-20T01:42:07.810 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.001265457 2024-08-20T01:42:07.810 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:07.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.811 INFO:teuthology.orchestra.run.smithi077.stdout: "finisher-PurgeQueue": { 2024-08-20T01:42:07.811 INFO:teuthology.orchestra.run.smithi077.stdout: "queue_len": 0, 2024-08-20T01:42:07.811 INFO:teuthology.orchestra.run.smithi077.stdout: "complete_latency": { 2024-08-20T01:42:07.811 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 51475, 2024-08-20T01:42:07.811 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 11.750677740, 2024-08-20T01:42:07.811 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000228279 2024-08-20T01:42:07.811 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:07.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.811 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-08-20T01:42:07.811 INFO:teuthology.orchestra.run.smithi077.stdout: "request": 213601, 2024-08-20T01:42:07.811 INFO:teuthology.orchestra.run.smithi077.stdout: "reply": 208206, 2024-08-20T01:42:07.811 INFO:teuthology.orchestra.run.smithi077.stdout: "reply_latency": { 2024-08-20T01:42:07.811 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 208206, 2024-08-20T01:42:07.812 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 4315.189989238, 2024-08-20T01:42:07.812 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.020725579 2024-08-20T01:42:07.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.812 INFO:teuthology.orchestra.run.smithi077.stdout: "slow_reply": 0, 2024-08-20T01:42:07.812 INFO:teuthology.orchestra.run.smithi077.stdout: "forward": 5393, 2024-08-20T01:42:07.812 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_fetch_complete": 309, 2024-08-20T01:42:07.812 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_fetch_keys": 0, 2024-08-20T01:42:07.812 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_commit": 1654, 2024-08-20T01:42:07.812 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_split": 154, 2024-08-20T01:42:07.812 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_merge": 2, 2024-08-20T01:42:07.812 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes": 60, 2024-08-20T01:42:07.812 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_top": 30, 2024-08-20T01:42:07.812 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_bottom": 19, 2024-08-20T01:42:07.813 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_pin_tail": 11, 2024-08-20T01:42:07.813 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_pinned": 14, 2024-08-20T01:42:07.813 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_expired": 132950, 2024-08-20T01:42:07.813 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_with_caps": 0, 2024-08-20T01:42:07.813 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": 0, 2024-08-20T01:42:07.813 INFO:teuthology.orchestra.run.smithi077.stdout: "subtrees": 3, 2024-08-20T01:42:07.813 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse": 369832, 2024-08-20T01:42:07.813 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_hit": 322374, 2024-08-20T01:42:07.813 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_forward": 4938, 2024-08-20T01:42:07.813 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_discover": 2795, 2024-08-20T01:42:07.813 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_dir_fetch": 0, 2024-08-20T01:42:07.813 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_remote_ino": 0, 2024-08-20T01:42:07.813 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_lock": 979, 2024-08-20T01:42:07.814 INFO:teuthology.orchestra.run.smithi077.stdout: "load_cent": 0, 2024-08-20T01:42:07.814 INFO:teuthology.orchestra.run.smithi077.stdout: "q": 0, 2024-08-20T01:42:07.814 INFO:teuthology.orchestra.run.smithi077.stdout: "exported": 230, 2024-08-20T01:42:07.814 INFO:teuthology.orchestra.run.smithi077.stdout: "exported_inodes": 109602, 2024-08-20T01:42:07.814 INFO:teuthology.orchestra.run.smithi077.stdout: "imported": 646, 2024-08-20T01:42:07.814 INFO:teuthology.orchestra.run.smithi077.stdout: "imported_inodes": 97657, 2024-08-20T01:42:07.814 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_dir_fetch": 0, 2024-08-20T01:42:07.814 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_backtrace_fetch": 149937, 2024-08-20T01:42:07.814 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_peer_discover": 0, 2024-08-20T01:42:07.814 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rfiles": 175, 2024-08-20T01:42:07.814 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rbytes": 4564915, 2024-08-20T01:42:07.814 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rsnaps": 0, 2024-08-20T01:42:07.815 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_backtrace_fetch": 149937, 2024-08-20T01:42:07.815 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_set_tag": 0, 2024-08-20T01:42:07.815 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T01:42:07.815 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_inotable_repaired": 0, 2024-08-20T01:42:07.815 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dir_inodes": 1059, 2024-08-20T01:42:07.815 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T01:42:07.815 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dirfrag_rstats": 1059, 2024-08-20T01:42:07.815 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_file_inodes": 148878, 2024-08-20T01:42:07.815 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_inode_file_caps": 514, 2024-08-20T01:42:07.815 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_revoke": 39107, 2024-08-20T01:42:07.815 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_grant": 74933, 2024-08-20T01:42:07.815 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T01:42:07.815 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T01:42:07.815 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T01:42:07.816 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_caps": 87939, 2024-08-20T01:42:07.816 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_caps_dirty": 35164, 2024-08-20T01:42:07.816 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_cap_release": 1823, 2024-08-20T01:42:07.816 INFO:teuthology.orchestra.run.smithi077.stdout: "process_request_cap_release": 72946 2024-08-20T01:42:07.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.816 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache": { 2024-08-20T01:42:07.816 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_update": 2824, 2024-08-20T01:42:07.816 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_update_receipt": 8225, 2024-08-20T01:42:07.816 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_try_discover": 4574, 2024-08-20T01:42:07.816 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_send_discover": 7661, 2024-08-20T01:42:07.816 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_handle_discover": 4318, 2024-08-20T01:42:07.816 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays": 1, 2024-08-20T01:42:07.816 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays_delayed": 0, 2024-08-20T01:42:07.816 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays_enqueuing": 0, 2024-08-20T01:42:07.816 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_created": 30455, 2024-08-20T01:42:07.817 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_enqueued": 30454, 2024-08-20T01:42:07.817 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_reintegrated": 0, 2024-08-20T01:42:07.817 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_migrated": 0, 2024-08-20T01:42:07.817 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_processing": 0, 2024-08-20T01:42:07.817 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_enqueued": 0, 2024-08-20T01:42:07.817 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_prioritized": 0, 2024-08-20T01:42:07.817 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_started": 0, 2024-08-20T01:42:07.817 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_completed": 0, 2024-08-20T01:42:07.817 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_quiesce_path": 0, 2024-08-20T01:42:07.817 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_quiesce_inode": 0, 2024-08-20T01:42:07.817 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T01:42:07.817 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_exportdir": 231, 2024-08-20T01:42:07.817 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_flush": 0, 2024-08-20T01:42:07.817 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_fragmentdir": 157, 2024-08-20T01:42:07.818 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_fragstats": 0, 2024-08-20T01:42:07.818 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_inodestats": 0 2024-08-20T01:42:07.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.818 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log": { 2024-08-20T01:42:07.818 INFO:teuthology.orchestra.run.smithi077.stdout: "evlrg": 7, 2024-08-20T01:42:07.818 INFO:teuthology.orchestra.run.smithi077.stdout: "evadd": 189858, 2024-08-20T01:42:07.818 INFO:teuthology.orchestra.run.smithi077.stdout: "evex": 95390, 2024-08-20T01:42:07.818 INFO:teuthology.orchestra.run.smithi077.stdout: "evtrm": 86031, 2024-08-20T01:42:07.818 INFO:teuthology.orchestra.run.smithi077.stdout: "ev": 103827, 2024-08-20T01:42:07.818 INFO:teuthology.orchestra.run.smithi077.stdout: "evexg": 0, 2024-08-20T01:42:07.818 INFO:teuthology.orchestra.run.smithi077.stdout: "evexd": 9359, 2024-08-20T01:42:07.818 INFO:teuthology.orchestra.run.smithi077.stdout: "segadd": 244, 2024-08-20T01:42:07.818 INFO:teuthology.orchestra.run.smithi077.stdout: "segex": 116, 2024-08-20T01:42:07.818 INFO:teuthology.orchestra.run.smithi077.stdout: "segtrm": 106, 2024-08-20T01:42:07.818 INFO:teuthology.orchestra.run.smithi077.stdout: "seg": 138, 2024-08-20T01:42:07.819 INFO:teuthology.orchestra.run.smithi077.stdout: "segmjr": 9, 2024-08-20T01:42:07.819 INFO:teuthology.orchestra.run.smithi077.stdout: "segexg": 0, 2024-08-20T01:42:07.819 INFO:teuthology.orchestra.run.smithi077.stdout: "segexd": 10, 2024-08-20T01:42:07.819 INFO:teuthology.orchestra.run.smithi077.stdout: "expos": 207200968, 2024-08-20T01:42:07.819 INFO:teuthology.orchestra.run.smithi077.stdout: "wrpos": 451077646, 2024-08-20T01:42:07.819 INFO:teuthology.orchestra.run.smithi077.stdout: "rdpos": 0, 2024-08-20T01:42:07.819 INFO:teuthology.orchestra.run.smithi077.stdout: "jlat": { 2024-08-20T01:42:07.819 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 4155, 2024-08-20T01:42:07.819 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 252.732152187, 2024-08-20T01:42:07.819 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.060826029 2024-08-20T01:42:07.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.819 INFO:teuthology.orchestra.run.smithi077.stdout: "replayed": 0 2024-08-20T01:42:07.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.819 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_mem": { 2024-08-20T01:42:07.820 INFO:teuthology.orchestra.run.smithi077.stdout: "ino": 27, 2024-08-20T01:42:07.820 INFO:teuthology.orchestra.run.smithi077.stdout: "ino+": 104857, 2024-08-20T01:42:07.820 INFO:teuthology.orchestra.run.smithi077.stdout: "ino-": 104830, 2024-08-20T01:42:07.820 INFO:teuthology.orchestra.run.smithi077.stdout: "dir": 32, 2024-08-20T01:42:07.820 INFO:teuthology.orchestra.run.smithi077.stdout: "dir+": 7944, 2024-08-20T01:42:07.820 INFO:teuthology.orchestra.run.smithi077.stdout: "dir-": 7912, 2024-08-20T01:42:07.820 INFO:teuthology.orchestra.run.smithi077.stdout: "dn": 60, 2024-08-20T01:42:07.820 INFO:teuthology.orchestra.run.smithi077.stdout: "dn+": 188564, 2024-08-20T01:42:07.820 INFO:teuthology.orchestra.run.smithi077.stdout: "dn-": 188504, 2024-08-20T01:42:07.820 INFO:teuthology.orchestra.run.smithi077.stdout: "cap": 0, 2024-08-20T01:42:07.820 INFO:teuthology.orchestra.run.smithi077.stdout: "cap+": 85367, 2024-08-20T01:42:07.820 INFO:teuthology.orchestra.run.smithi077.stdout: "cap-": 85367, 2024-08-20T01:42:07.820 INFO:teuthology.orchestra.run.smithi077.stdout: "rss": 123780, 2024-08-20T01:42:07.820 INFO:teuthology.orchestra.run.smithi077.stdout: "heap": 531623936 2024-08-20T01:42:07.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.821 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_server": { 2024-08-20T01:42:07.821 INFO:teuthology.orchestra.run.smithi077.stdout: "dispatch_client_request": 242006, 2024-08-20T01:42:07.821 INFO:teuthology.orchestra.run.smithi077.stdout: "dispatch_server_request": 7353, 2024-08-20T01:42:07.821 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_request": 213601, 2024-08-20T01:42:07.821 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_session": 354, 2024-08-20T01:42:07.821 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_peer_request": 17835, 2024-08-20T01:42:07.821 INFO:teuthology.orchestra.run.smithi077.stdout: "req_create_latency": { 2024-08-20T01:42:07.821 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 32213, 2024-08-20T01:42:07.821 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 200.046720579, 2024-08-20T01:42:07.821 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.006210123 2024-08-20T01:42:07.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.821 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getattr_latency": { 2024-08-20T01:42:07.821 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 9213, 2024-08-20T01:42:07.821 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 293.253523376, 2024-08-20T01:42:07.821 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.031830405 2024-08-20T01:42:07.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.822 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getfilelock_latency": { 2024-08-20T01:42:07.822 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.822 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.822 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.822 INFO:teuthology.orchestra.run.smithi077.stdout: "req_link_latency": { 2024-08-20T01:42:07.822 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.822 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.822 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.822 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookup_latency": { 2024-08-20T01:42:07.822 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 100993, 2024-08-20T01:42:07.822 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 3339.570945182, 2024-08-20T01:42:07.823 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.033067350 2024-08-20T01:42:07.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.823 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookuphash_latency": { 2024-08-20T01:42:07.823 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.823 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.823 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.823 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupino_latency": { 2024-08-20T01:42:07.823 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.823 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.823 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.823 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupname_latency": { 2024-08-20T01:42:07.823 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.824 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.824 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.824 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupparent_latency": { 2024-08-20T01:42:07.824 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.824 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.824 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.825 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupsnap_latency": { 2024-08-20T01:42:07.825 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.825 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.825 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.825 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lssnap_latency": { 2024-08-20T01:42:07.825 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.825 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.825 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.825 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mkdir_latency": { 2024-08-20T01:42:07.826 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 158, 2024-08-20T01:42:07.826 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 10.653970371, 2024-08-20T01:42:07.826 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.067430192 2024-08-20T01:42:07.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.826 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mknod_latency": { 2024-08-20T01:42:07.826 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.826 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.826 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.827 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mksnap_latency": { 2024-08-20T01:42:07.827 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.827 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.827 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.827 INFO:teuthology.orchestra.run.smithi077.stdout: "req_open_latency": { 2024-08-20T01:42:07.827 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 9134, 2024-08-20T01:42:07.827 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 78.615411114, 2024-08-20T01:42:07.827 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.008606898 2024-08-20T01:42:07.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.827 INFO:teuthology.orchestra.run.smithi077.stdout: "req_readdir_latency": { 2024-08-20T01:42:07.827 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 1067, 2024-08-20T01:42:07.827 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 1.468988892, 2024-08-20T01:42:07.827 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.001376746 2024-08-20T01:42:07.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.828 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rename_latency": { 2024-08-20T01:42:07.828 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 32230, 2024-08-20T01:42:07.828 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 343.150050340, 2024-08-20T01:42:07.828 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.010646914 2024-08-20T01:42:07.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.828 INFO:teuthology.orchestra.run.smithi077.stdout: "req_renamesnap_latency": { 2024-08-20T01:42:07.828 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.828 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.828 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.828 INFO:teuthology.orchestra.run.smithi077.stdout: "req_snapdiff_latency": { 2024-08-20T01:42:07.828 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.828 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.829 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.829 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmdir_latency": { 2024-08-20T01:42:07.829 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 168, 2024-08-20T01:42:07.829 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 17.773153735, 2024-08-20T01:42:07.829 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.105792581 2024-08-20T01:42:07.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.829 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmsnap_latency": { 2024-08-20T01:42:07.829 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.829 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.829 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.829 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmxattr_latency": { 2024-08-20T01:42:07.829 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.830 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.830 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.830 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setattr_latency": { 2024-08-20T01:42:07.830 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.830 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.830 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.830 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setdirlayout_latency": { 2024-08-20T01:42:07.830 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.830 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.830 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.831 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setfilelock_latency": { 2024-08-20T01:42:07.831 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.831 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.831 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.834 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setlayout_latency": { 2024-08-20T01:42:07.834 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.834 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.834 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.834 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setxattr_latency": { 2024-08-20T01:42:07.834 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.834 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.834 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.834 INFO:teuthology.orchestra.run.smithi077.stdout: "req_symlink_latency": { 2024-08-20T01:42:07.834 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.834 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.835 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.835 INFO:teuthology.orchestra.run.smithi077.stdout: "req_unlink_latency": { 2024-08-20T01:42:07.835 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 23030, 2024-08-20T01:42:07.835 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 30.657225649, 2024-08-20T01:42:07.835 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.001331186 2024-08-20T01:42:07.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.835 INFO:teuthology.orchestra.run.smithi077.stdout: "cap_revoke_eviction": 0, 2024-08-20T01:42:07.835 INFO:teuthology.orchestra.run.smithi077.stdout: "cap_acquisition_throttle": 0, 2024-08-20T01:42:07.835 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getvxattr_latency": { 2024-08-20T01:42:07.835 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.835 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.835 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.836 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:07.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.836 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_sessions": { 2024-08-20T01:42:07.836 INFO:teuthology.orchestra.run.smithi077.stdout: "session_count": 1, 2024-08-20T01:42:07.836 INFO:teuthology.orchestra.run.smithi077.stdout: "session_add": 2, 2024-08-20T01:42:07.836 INFO:teuthology.orchestra.run.smithi077.stdout: "session_remove": 1, 2024-08-20T01:42:07.836 INFO:teuthology.orchestra.run.smithi077.stdout: "sessions_open": 1, 2024-08-20T01:42:07.836 INFO:teuthology.orchestra.run.smithi077.stdout: "sessions_stale": 0, 2024-08-20T01:42:07.836 INFO:teuthology.orchestra.run.smithi077.stdout: "total_load": 27446, 2024-08-20T01:42:07.836 INFO:teuthology.orchestra.run.smithi077.stdout: "average_load": 27446, 2024-08-20T01:42:07.836 INFO:teuthology.orchestra.run.smithi077.stdout: "avg_session_uptime": 608, 2024-08-20T01:42:07.836 INFO:teuthology.orchestra.run.smithi077.stdout: "mdthresh_evicted": 0 2024-08-20T01:42:07.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.837 INFO:teuthology.orchestra.run.smithi077.stdout: "mempool": { 2024-08-20T01:42:07.837 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:42:07.837 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_items": 0, 2024-08-20T01:42:07.837 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:42:07.837 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:42:07.837 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:42:07.837 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:42:07.837 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:42:07.837 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:42:07.837 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:42:07.837 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:42:07.837 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:42:07.837 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:42:07.837 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:42:07.837 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:42:07.838 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:42:07.838 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_items": 0, 2024-08-20T01:42:07.838 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:42:07.838 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_items": 0, 2024-08-20T01:42:07.838 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:42:07.838 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:42:07.838 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:42:07.838 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:42:07.838 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:42:07.838 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:42:07.838 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:42:07.838 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_items": 0, 2024-08-20T01:42:07.838 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:42:07.838 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:42:07.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:42:07.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_items": 0, 2024-08-20T01:42:07.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_bytes": 0, 2024-08-20T01:42:07.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_items": 0, 2024-08-20T01:42:07.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:42:07.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:42:07.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:42:07.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:42:07.839 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_bytes": 287147, 2024-08-20T01:42:07.839 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_items": 116, 2024-08-20T01:42:07.839 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_bytes": 528, 2024-08-20T01:42:07.839 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_items": 6, 2024-08-20T01:42:07.839 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bytes": 0, 2024-08-20T01:42:07.840 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_items": 0, 2024-08-20T01:42:07.840 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:42:07.840 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_items": 0, 2024-08-20T01:42:07.840 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:42:07.840 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_items": 0, 2024-08-20T01:42:07.840 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_bytes": 7784, 2024-08-20T01:42:07.840 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_items": 160, 2024-08-20T01:42:07.840 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:42:07.840 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:42:07.840 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_bytes": 0, 2024-08-20T01:42:07.840 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_items": 0, 2024-08-20T01:42:07.840 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_bytes": 147992, 2024-08-20T01:42:07.840 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_items": 998, 2024-08-20T01:42:07.840 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_bytes": 0, 2024-08-20T01:42:07.841 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_items": 0, 2024-08-20T01:42:07.841 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_bytes": 0, 2024-08-20T01:42:07.841 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_items": 0 2024-08-20T01:42:07.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.841 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter": { 2024-08-20T01:42:07.841 INFO:teuthology.orchestra.run.smithi077.stdout: "op_active": 0, 2024-08-20T01:42:07.841 INFO:teuthology.orchestra.run.smithi077.stdout: "op_laggy": 0, 2024-08-20T01:42:07.841 INFO:teuthology.orchestra.run.smithi077.stdout: "op_send": 197023, 2024-08-20T01:42:07.841 INFO:teuthology.orchestra.run.smithi077.stdout: "op_send_bytes": 486244627, 2024-08-20T01:42:07.841 INFO:teuthology.orchestra.run.smithi077.stdout: "op_resend": 33, 2024-08-20T01:42:07.841 INFO:teuthology.orchestra.run.smithi077.stdout: "op_reply": 197023, 2024-08-20T01:42:07.841 INFO:teuthology.orchestra.run.smithi077.stdout: "op_latency": { 2024-08-20T01:42:07.841 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 197023, 2024-08-20T01:42:07.841 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 1381.437224604, 2024-08-20T01:42:07.841 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.007011553 2024-08-20T01:42:07.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.842 INFO:teuthology.orchestra.run.smithi077.stdout: "op_inflight": 0, 2024-08-20T01:42:07.842 INFO:teuthology.orchestra.run.smithi077.stdout: "oplen_avg": { 2024-08-20T01:42:07.842 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 197023, 2024-08-20T01:42:07.842 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 212498 2024-08-20T01:42:07.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.842 INFO:teuthology.orchestra.run.smithi077.stdout: "op": 197023, 2024-08-20T01:42:07.842 INFO:teuthology.orchestra.run.smithi077.stdout: "op_r": 151596, 2024-08-20T01:42:07.842 INFO:teuthology.orchestra.run.smithi077.stdout: "op_w": 45427, 2024-08-20T01:42:07.842 INFO:teuthology.orchestra.run.smithi077.stdout: "op_rmw": 0, 2024-08-20T01:42:07.843 INFO:teuthology.orchestra.run.smithi077.stdout: "op_pg": 0, 2024-08-20T01:42:07.843 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_stat": 268, 2024-08-20T01:42:07.843 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_create": 6072, 2024-08-20T01:42:07.843 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_read": 827, 2024-08-20T01:42:07.843 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_write": 4985, 2024-08-20T01:42:07.843 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_writefull": 426, 2024-08-20T01:42:07.843 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_writesame": 0, 2024-08-20T01:42:07.843 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_append": 0, 2024-08-20T01:42:07.843 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_zero": 0, 2024-08-20T01:42:07.843 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_truncate": 154, 2024-08-20T01:42:07.843 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_delete": 31740, 2024-08-20T01:42:07.843 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_mapext": 0, 2024-08-20T01:42:07.843 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_sparse_read": 0, 2024-08-20T01:42:07.844 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_clonerange": 0, 2024-08-20T01:42:07.844 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_getxattr": 149950, 2024-08-20T01:42:07.844 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_setxattr": 12144, 2024-08-20T01:42:07.844 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_cmpxattr": 0, 2024-08-20T01:42:07.844 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_rmxattr": 0, 2024-08-20T01:42:07.844 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_resetxattrs": 0, 2024-08-20T01:42:07.844 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_call": 0, 2024-08-20T01:42:07.844 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_watch": 0, 2024-08-20T01:42:07.844 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_notify": 0, 2024-08-20T01:42:07.844 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T01:42:07.844 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_pgls": 0, 2024-08-20T01:42:07.844 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_pgls_filter": 0, 2024-08-20T01:42:07.844 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_other": 0, 2024-08-20T01:42:07.844 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_active": 0, 2024-08-20T01:42:07.845 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_send": 0, 2024-08-20T01:42:07.845 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_resend": 0, 2024-08-20T01:42:07.845 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_ping": 0, 2024-08-20T01:42:07.845 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_active": 0, 2024-08-20T01:42:07.845 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_send": 0, 2024-08-20T01:42:07.845 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_resend": 0, 2024-08-20T01:42:07.845 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_active": 0, 2024-08-20T01:42:07.845 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_send": 0, 2024-08-20T01:42:07.845 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_resend": 0, 2024-08-20T01:42:07.845 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_active": 0, 2024-08-20T01:42:07.845 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_send": 0, 2024-08-20T01:42:07.845 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_resend": 0, 2024-08-20T01:42:07.845 INFO:teuthology.orchestra.run.smithi077.stdout: "command_active": 0, 2024-08-20T01:42:07.845 INFO:teuthology.orchestra.run.smithi077.stdout: "command_send": 0, 2024-08-20T01:42:07.845 INFO:teuthology.orchestra.run.smithi077.stdout: "command_resend": 0, 2024-08-20T01:42:07.846 INFO:teuthology.orchestra.run.smithi077.stdout: "map_epoch": 81, 2024-08-20T01:42:07.846 INFO:teuthology.orchestra.run.smithi077.stdout: "map_full": 0, 2024-08-20T01:42:07.846 INFO:teuthology.orchestra.run.smithi077.stdout: "map_inc": 6, 2024-08-20T01:42:07.846 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_sessions": 12, 2024-08-20T01:42:07.846 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_session_open": 12, 2024-08-20T01:42:07.846 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_session_close": 0, 2024-08-20T01:42:07.846 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_laggy": 0, 2024-08-20T01:42:07.846 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_wr": 4058, 2024-08-20T01:42:07.846 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_rd": 1141, 2024-08-20T01:42:07.846 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_del": 733 2024-08-20T01:42:07.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.846 INFO:teuthology.orchestra.run.smithi077.stdout: "oft": { 2024-08-20T01:42:07.847 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_objs": 1, 2024-08-20T01:42:07.847 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_kv_pairs": 0, 2024-08-20T01:42:07.847 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_updates": 0, 2024-08-20T01:42:07.847 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_removes": 0 2024-08-20T01:42:07.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.847 INFO:teuthology.orchestra.run.smithi077.stdout: "purge_queue": { 2024-08-20T01:42:07.847 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_ops": 0, 2024-08-20T01:42:07.847 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_ops_high_water": 18, 2024-08-20T01:42:07.847 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing": 0, 2024-08-20T01:42:07.847 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_high_water": 10, 2024-08-20T01:42:07.847 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executed_ops": 31558, 2024-08-20T01:42:07.847 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executed": 30454, 2024-08-20T01:42:07.847 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_item_in_journal": 0 2024-08-20T01:42:07.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.848 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:42:07.848 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-08-20T01:42:07.848 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 104857600, 2024-08-20T01:42:07.848 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-08-20T01:42:07.848 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 709087, 2024-08-20T01:42:07.848 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 262108997, 2024-08-20T01:42:07.848 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:07.848 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 709087, 2024-08-20T01:42:07.848 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-08-20T01:42:07.848 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-08-20T01:42:07.848 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 709087, 2024-08-20T01:42:07.848 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 262108997, 2024-08-20T01:42:07.848 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-08-20T01:42:07.848 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.848 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.849 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.849 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:07.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.849 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-objecter_bytes": { 2024-08-20T01:42:07.849 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-08-20T01:42:07.849 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 104857600, 2024-08-20T01:42:07.849 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-08-20T01:42:07.849 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-08-20T01:42:07.849 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-08-20T01:42:07.849 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:07.849 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-08-20T01:42:07.849 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 197023, 2024-08-20T01:42:07.849 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 489298399, 2024-08-20T01:42:07.849 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 197023, 2024-08-20T01:42:07.849 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 489298399, 2024-08-20T01:42:07.850 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-08-20T01:42:07.850 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.850 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.850 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.850 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:07.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.850 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-objecter_ops": { 2024-08-20T01:42:07.850 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-08-20T01:42:07.850 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 1024, 2024-08-20T01:42:07.850 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-08-20T01:42:07.850 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-08-20T01:42:07.850 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-08-20T01:42:07.850 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:07.850 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-08-20T01:42:07.851 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 197023, 2024-08-20T01:42:07.851 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 197023, 2024-08-20T01:42:07.851 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 197023, 2024-08-20T01:42:07.851 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 197023, 2024-08-20T01:42:07.851 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-08-20T01:42:07.851 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.851 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.851 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.851 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:07.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.851 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-write_buf_throttle": { 2024-08-20T01:42:07.851 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-08-20T01:42:07.851 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 3758096384, 2024-08-20T01:42:07.851 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-08-20T01:42:07.851 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 30454, 2024-08-20T01:42:07.852 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 3076958, 2024-08-20T01:42:07.852 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:07.852 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 30454, 2024-08-20T01:42:07.852 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-08-20T01:42:07.852 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-08-20T01:42:07.852 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 829, 2024-08-20T01:42:07.852 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 3076958, 2024-08-20T01:42:07.852 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-08-20T01:42:07.852 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.852 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.852 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.852 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:07.852 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.852 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-write_buf_throttle-0x55fb026f46e0": { 2024-08-20T01:42:07.852 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-08-20T01:42:07.853 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 3758096384, 2024-08-20T01:42:07.853 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-08-20T01:42:07.853 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 189858, 2024-08-20T01:42:07.853 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 446883342, 2024-08-20T01:42:07.853 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:07.853 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 189858, 2024-08-20T01:42:07.853 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-08-20T01:42:07.853 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-08-20T01:42:07.853 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 4155, 2024-08-20T01:42:07.853 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 446883342, 2024-08-20T01:42:07.853 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-08-20T01:42:07.853 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:07.853 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:07.853 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:07.854 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:07.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:07.854 INFO:teuthology.orchestra.run.smithi077.stdout: "trackedop": { 2024-08-20T01:42:07.854 INFO:teuthology.orchestra.run.smithi077.stdout: "slow_ops_count": 0 2024-08-20T01:42:07.854 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:07.854 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-08-20T01:42:08.822 INFO:tasks.check_counter:Daemon mds.b mds.exported=230 2024-08-20T01:42:08.822 INFO:tasks.check_counter:Daemon mds.b mds.imported=646 2024-08-20T01:42:08.823 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=2824 2024-08-20T01:42:08.823 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=8225 2024-08-20T01:42:08.823 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=154 2024-08-20T01:42:08.823 DEBUG:tasks.check_counter:Getting stats from e 2024-08-20T01:42:08.823 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph daemon mds.e perf dump 2024-08-20T01:42:09.065 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:09 smithi077 ceph-mon[22251]: pgmap v678: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-20T01:42:09.071 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:42:09.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:09 smithi022 ceph-mon[18709]: pgmap v678: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-20T01:42:09.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:09 smithi134 ceph-mon[22511]: pgmap v678: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-20T01:42:09.603 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-08-20T01:42:09.603 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:42:09.603 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 754, 2024-08-20T01:42:09.603 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 756, 2024-08-20T01:42:09.603 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 133189726, 2024-08-20T01:42:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 239836, 2024-08-20T01:42:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 8, 2024-08-20T01:42:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 4, 2024-08-20T01:42:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.135895648, 2024-08-20T01:42:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.028435456, 2024-08-20T01:42:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.086347642, 2024-08-20T01:42:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.015115625, 2024-08-20T01:42:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 754, 2024-08-20T01:42:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.025713000, 2024-08-20T01:42:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000034102 2024-08-20T01:42:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T01:42:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T01:42:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:42:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 826, 2024-08-20T01:42:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 989, 2024-08-20T01:42:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 151287265, 2024-08-20T01:42:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 630459, 2024-08-20T01:42:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 6, 2024-08-20T01:42:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 5, 2024-08-20T01:42:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.167168211, 2024-08-20T01:42:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.035178897, 2024-08-20T01:42:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.107407239, 2024-08-20T01:42:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.017786451, 2024-08-20T01:42:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 988, 2024-08-20T01:42:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.037612490, 2024-08-20T01:42:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000038069 2024-08-20T01:42:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-08-20T01:42:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 369376 2024-08-20T01:42:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:42:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 1499, 2024-08-20T01:42:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 1485, 2024-08-20T01:42:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 105820697, 2024-08-20T01:42:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 535442, 2024-08-20T01:42:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 5, 2024-08-20T01:42:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 4, 2024-08-20T01:42:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.206181294, 2024-08-20T01:42:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.068690843, 2024-08-20T01:42:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.101950142, 2024-08-20T01:42:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.032439516, 2024-08-20T01:42:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 1484, 2024-08-20T01:42:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.061338252, 2024-08-20T01:42:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000041333 2024-08-20T01:42:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 582000, 2024-08-20T01:42:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 136352 2024-08-20T01:42:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "cct": { 2024-08-20T01:42:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "total_workers": 1, 2024-08-20T01:42:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "unhealthy_workers": 0 2024-08-20T01:42:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "finisher-MDSRank": { 2024-08-20T01:42:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "queue_len": 0, 2024-08-20T01:42:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "complete_latency": { 2024-08-20T01:42:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 4596, 2024-08-20T01:42:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.120121961, 2024-08-20T01:42:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000026136 2024-08-20T01:42:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "finisher-PurgeQueue": { 2024-08-20T01:42:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "queue_len": 0, 2024-08-20T01:42:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "complete_latency": { 2024-08-20T01:42:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-08-20T01:42:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "request": 0, 2024-08-20T01:42:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "reply": 0, 2024-08-20T01:42:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "reply_latency": { 2024-08-20T01:42:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "slow_reply": 0, 2024-08-20T01:42:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "forward": 0, 2024-08-20T01:42:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_fetch_complete": 0, 2024-08-20T01:42:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_fetch_keys": 0, 2024-08-20T01:42:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_commit": 0, 2024-08-20T01:42:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_split": 0, 2024-08-20T01:42:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_merge": 0, 2024-08-20T01:42:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes": 30391, 2024-08-20T01:42:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_top": 3940, 2024-08-20T01:42:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_bottom": 26451, 2024-08-20T01:42:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_pin_tail": 0, 2024-08-20T01:42:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_pinned": 24762, 2024-08-20T01:42:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_expired": 0, 2024-08-20T01:42:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_with_caps": 0, 2024-08-20T01:42:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": 0, 2024-08-20T01:42:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "subtrees": 1, 2024-08-20T01:42:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse": 0, 2024-08-20T01:42:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_hit": 0, 2024-08-20T01:42:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_forward": 0, 2024-08-20T01:42:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_discover": 0, 2024-08-20T01:42:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_dir_fetch": 0, 2024-08-20T01:42:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_remote_ino": 0, 2024-08-20T01:42:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_lock": 0, 2024-08-20T01:42:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "load_cent": 0, 2024-08-20T01:42:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "q": 0, 2024-08-20T01:42:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "exported": 0, 2024-08-20T01:42:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "exported_inodes": 0, 2024-08-20T01:42:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "imported": 0, 2024-08-20T01:42:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "imported_inodes": 0, 2024-08-20T01:42:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_dir_fetch": 0, 2024-08-20T01:42:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_backtrace_fetch": 0, 2024-08-20T01:42:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_peer_discover": 0, 2024-08-20T01:42:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rfiles": 0, 2024-08-20T01:42:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rbytes": 0, 2024-08-20T01:42:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rsnaps": 0, 2024-08-20T01:42:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_backtrace_fetch": 0, 2024-08-20T01:42:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_set_tag": 0, 2024-08-20T01:42:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T01:42:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_inotable_repaired": 0, 2024-08-20T01:42:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dir_inodes": 0, 2024-08-20T01:42:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T01:42:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dirfrag_rstats": 0, 2024-08-20T01:42:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_file_inodes": 0, 2024-08-20T01:42:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_inode_file_caps": 0, 2024-08-20T01:42:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_revoke": 0, 2024-08-20T01:42:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_grant": 0, 2024-08-20T01:42:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T01:42:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T01:42:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T01:42:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_caps": 0, 2024-08-20T01:42:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_caps_dirty": 0, 2024-08-20T01:42:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_cap_release": 0, 2024-08-20T01:42:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "process_request_cap_release": 0 2024-08-20T01:42:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache": { 2024-08-20T01:42:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_update": 0, 2024-08-20T01:42:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_update_receipt": 0, 2024-08-20T01:42:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_try_discover": 0, 2024-08-20T01:42:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_send_discover": 0, 2024-08-20T01:42:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_handle_discover": 0, 2024-08-20T01:42:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays": 0, 2024-08-20T01:42:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays_delayed": 0, 2024-08-20T01:42:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays_enqueuing": 0, 2024-08-20T01:42:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_created": 0, 2024-08-20T01:42:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_enqueued": 0, 2024-08-20T01:42:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_reintegrated": 0, 2024-08-20T01:42:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_migrated": 0, 2024-08-20T01:42:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_processing": 0, 2024-08-20T01:42:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_enqueued": 0, 2024-08-20T01:42:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_prioritized": 0, 2024-08-20T01:42:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_started": 0, 2024-08-20T01:42:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_completed": 0, 2024-08-20T01:42:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_quiesce_path": 0, 2024-08-20T01:42:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_quiesce_inode": 0, 2024-08-20T01:42:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T01:42:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_exportdir": 0, 2024-08-20T01:42:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_flush": 0, 2024-08-20T01:42:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_fragmentdir": 0, 2024-08-20T01:42:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_fragstats": 0, 2024-08-20T01:42:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_inodestats": 0 2024-08-20T01:42:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log": { 2024-08-20T01:42:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "evlrg": 0, 2024-08-20T01:42:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "evadd": 0, 2024-08-20T01:42:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "evex": 0, 2024-08-20T01:42:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "evtrm": 0, 2024-08-20T01:42:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "ev": 175629, 2024-08-20T01:42:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "evexg": 0, 2024-08-20T01:42:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "evexd": 0, 2024-08-20T01:42:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "segadd": 0, 2024-08-20T01:42:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "segex": 0, 2024-08-20T01:42:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "segtrm": 0, 2024-08-20T01:42:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "seg": 132, 2024-08-20T01:42:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "segmjr": 16, 2024-08-20T01:42:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "segexg": 0, 2024-08-20T01:42:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "segexd": 0, 2024-08-20T01:42:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "expos": 156663083, 2024-08-20T01:42:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "wrpos": 393035303, 2024-08-20T01:42:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "rdpos": 393034165, 2024-08-20T01:42:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "jlat": { 2024-08-20T01:42:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "replayed": 175629 2024-08-20T01:42:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_mem": { 2024-08-20T01:42:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "ino": 13, 2024-08-20T01:42:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "ino+": 81915, 2024-08-20T01:42:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "ino-": 81902, 2024-08-20T01:42:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "dir": 11, 2024-08-20T01:42:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "dir+": 3403, 2024-08-20T01:42:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "dir-": 3392, 2024-08-20T01:42:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "dn": 30391, 2024-08-20T01:42:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "dn+": 155971, 2024-08-20T01:42:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "dn-": 125580, 2024-08-20T01:42:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "cap": 0, 2024-08-20T01:42:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "cap+": 0, 2024-08-20T01:42:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "cap-": 0, 2024-08-20T01:42:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "rss": 93896, 2024-08-20T01:42:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "heap": 462557184 2024-08-20T01:42:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_server": { 2024-08-20T01:42:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "dispatch_client_request": 0, 2024-08-20T01:42:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "dispatch_server_request": 0, 2024-08-20T01:42:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_request": 0, 2024-08-20T01:42:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_session": 0, 2024-08-20T01:42:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_peer_request": 0, 2024-08-20T01:42:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "req_create_latency": { 2024-08-20T01:42:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getattr_latency": { 2024-08-20T01:42:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getfilelock_latency": { 2024-08-20T01:42:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "req_link_latency": { 2024-08-20T01:42:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookup_latency": { 2024-08-20T01:42:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookuphash_latency": { 2024-08-20T01:42:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupino_latency": { 2024-08-20T01:42:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupname_latency": { 2024-08-20T01:42:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupparent_latency": { 2024-08-20T01:42:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupsnap_latency": { 2024-08-20T01:42:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lssnap_latency": { 2024-08-20T01:42:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mkdir_latency": { 2024-08-20T01:42:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mknod_latency": { 2024-08-20T01:42:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mksnap_latency": { 2024-08-20T01:42:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "req_open_latency": { 2024-08-20T01:42:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "req_readdir_latency": { 2024-08-20T01:42:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rename_latency": { 2024-08-20T01:42:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "req_renamesnap_latency": { 2024-08-20T01:42:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "req_snapdiff_latency": { 2024-08-20T01:42:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmdir_latency": { 2024-08-20T01:42:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmsnap_latency": { 2024-08-20T01:42:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmxattr_latency": { 2024-08-20T01:42:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setattr_latency": { 2024-08-20T01:42:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setdirlayout_latency": { 2024-08-20T01:42:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setfilelock_latency": { 2024-08-20T01:42:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setlayout_latency": { 2024-08-20T01:42:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setxattr_latency": { 2024-08-20T01:42:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "req_symlink_latency": { 2024-08-20T01:42:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "req_unlink_latency": { 2024-08-20T01:42:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "cap_revoke_eviction": 0, 2024-08-20T01:42:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "cap_acquisition_throttle": 0, 2024-08-20T01:42:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getvxattr_latency": { 2024-08-20T01:42:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_sessions": { 2024-08-20T01:42:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "session_count": 1, 2024-08-20T01:42:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "session_add": 1, 2024-08-20T01:42:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "session_remove": 0, 2024-08-20T01:42:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "sessions_open": 1, 2024-08-20T01:42:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "sessions_stale": 0, 2024-08-20T01:42:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "total_load": 0, 2024-08-20T01:42:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "average_load": 0, 2024-08-20T01:42:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "avg_session_uptime": 1675, 2024-08-20T01:42:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "mdthresh_evicted": 0 2024-08-20T01:42:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "mempool": { 2024-08-20T01:42:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:42:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_items": 0, 2024-08-20T01:42:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:42:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:42:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:42:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:42:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:42:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:42:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:42:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:42:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:42:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:42:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:42:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:42:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:42:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_items": 0, 2024-08-20T01:42:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:42:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_items": 0, 2024-08-20T01:42:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:42:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:42:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:42:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:42:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:42:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:42:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:42:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_items": 0, 2024-08-20T01:42:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:42:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:42:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:42:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_items": 0, 2024-08-20T01:42:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_bytes": 0, 2024-08-20T01:42:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_items": 0, 2024-08-20T01:42:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:42:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:42:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:42:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:42:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_bytes": 232113, 2024-08-20T01:42:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_items": 76, 2024-08-20T01:42:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_bytes": 0, 2024-08-20T01:42:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_items": 0, 2024-08-20T01:42:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bytes": 0, 2024-08-20T01:42:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_items": 0, 2024-08-20T01:42:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:42:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_items": 0, 2024-08-20T01:42:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:42:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_items": 0, 2024-08-20T01:42:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_bytes": 7784, 2024-08-20T01:42:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_items": 160, 2024-08-20T01:42:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:42:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:42:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_bytes": 0, 2024-08-20T01:42:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_items": 0, 2024-08-20T01:42:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_bytes": 20709472, 2024-08-20T01:42:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_items": 121692, 2024-08-20T01:42:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_bytes": 0, 2024-08-20T01:42:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_items": 0, 2024-08-20T01:42:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_bytes": 0, 2024-08-20T01:42:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_items": 0 2024-08-20T01:42:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter": { 2024-08-20T01:42:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "op_active": 0, 2024-08-20T01:42:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "op_laggy": 0, 2024-08-20T01:42:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "op_send": 2830, 2024-08-20T01:42:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "op_send_bytes": 21, 2024-08-20T01:42:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "op_resend": 3, 2024-08-20T01:42:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "op_reply": 2830, 2024-08-20T01:42:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "op_latency": { 2024-08-20T01:42:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 2830, 2024-08-20T01:42:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 31.915282734, 2024-08-20T01:42:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.011277485 2024-08-20T01:42:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "op_inflight": 0, 2024-08-20T01:42:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "oplen_avg": { 2024-08-20T01:42:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 2830, 2024-08-20T01:42:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 2831 2024-08-20T01:42:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "op": 2830, 2024-08-20T01:42:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "op_r": 2830, 2024-08-20T01:42:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "op_w": 0, 2024-08-20T01:42:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "op_rmw": 0, 2024-08-20T01:42:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "op_pg": 0, 2024-08-20T01:42:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_stat": 1646, 2024-08-20T01:42:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_create": 0, 2024-08-20T01:42:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_read": 1182, 2024-08-20T01:42:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_write": 0, 2024-08-20T01:42:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_writefull": 0, 2024-08-20T01:42:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_writesame": 0, 2024-08-20T01:42:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_append": 0, 2024-08-20T01:42:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_zero": 0, 2024-08-20T01:42:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_truncate": 0, 2024-08-20T01:42:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_delete": 0, 2024-08-20T01:42:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_mapext": 0, 2024-08-20T01:42:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_sparse_read": 0, 2024-08-20T01:42:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_clonerange": 0, 2024-08-20T01:42:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_getxattr": 1, 2024-08-20T01:42:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_setxattr": 0, 2024-08-20T01:42:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_cmpxattr": 0, 2024-08-20T01:42:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_rmxattr": 0, 2024-08-20T01:42:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_resetxattrs": 0, 2024-08-20T01:42:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_call": 0, 2024-08-20T01:42:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_watch": 0, 2024-08-20T01:42:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_notify": 0, 2024-08-20T01:42:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T01:42:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_pgls": 0, 2024-08-20T01:42:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_pgls_filter": 0, 2024-08-20T01:42:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_other": 0, 2024-08-20T01:42:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_active": 0, 2024-08-20T01:42:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_send": 0, 2024-08-20T01:42:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_resend": 0, 2024-08-20T01:42:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_ping": 0, 2024-08-20T01:42:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_active": 0, 2024-08-20T01:42:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_send": 0, 2024-08-20T01:42:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_resend": 0, 2024-08-20T01:42:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_active": 0, 2024-08-20T01:42:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_send": 0, 2024-08-20T01:42:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_resend": 0, 2024-08-20T01:42:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_active": 0, 2024-08-20T01:42:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_send": 0, 2024-08-20T01:42:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_resend": 0, 2024-08-20T01:42:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "command_active": 0, 2024-08-20T01:42:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "command_send": 0, 2024-08-20T01:42:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "command_resend": 0, 2024-08-20T01:42:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "map_epoch": 81, 2024-08-20T01:42:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "map_full": 0, 2024-08-20T01:42:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "map_inc": 6, 2024-08-20T01:42:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_sessions": 10, 2024-08-20T01:42:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_session_open": 10, 2024-08-20T01:42:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_session_close": 0, 2024-08-20T01:42:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_laggy": 0, 2024-08-20T01:42:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_wr": 0, 2024-08-20T01:42:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_rd": 2, 2024-08-20T01:42:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_del": 0 2024-08-20T01:42:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "oft": { 2024-08-20T01:42:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_objs": 0, 2024-08-20T01:42:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_kv_pairs": 0, 2024-08-20T01:42:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_updates": 0, 2024-08-20T01:42:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_removes": 0 2024-08-20T01:42:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "purge_queue": { 2024-08-20T01:42:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_ops": 0, 2024-08-20T01:42:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_ops_high_water": 0, 2024-08-20T01:42:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing": 0, 2024-08-20T01:42:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_high_water": 0, 2024-08-20T01:42:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executed_ops": 0, 2024-08-20T01:42:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executed": 0, 2024-08-20T01:42:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_item_in_journal": 0 2024-08-20T01:42:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:42:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-08-20T01:42:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 104857600, 2024-08-20T01:42:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-08-20T01:42:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 3075, 2024-08-20T01:42:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 390005441, 2024-08-20T01:42:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 3075, 2024-08-20T01:42:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-08-20T01:42:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-08-20T01:42:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 3075, 2024-08-20T01:42:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 390005441, 2024-08-20T01:42:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-08-20T01:42:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-objecter_bytes": { 2024-08-20T01:42:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-08-20T01:42:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 104857600, 2024-08-20T01:42:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-08-20T01:42:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-08-20T01:42:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-08-20T01:42:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-08-20T01:42:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 2830, 2024-08-20T01:42:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 388929986, 2024-08-20T01:42:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 2830, 2024-08-20T01:42:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 388929986, 2024-08-20T01:42:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-08-20T01:42:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-objecter_ops": { 2024-08-20T01:42:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-08-20T01:42:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 1024, 2024-08-20T01:42:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-08-20T01:42:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-08-20T01:42:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-08-20T01:42:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-08-20T01:42:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 2830, 2024-08-20T01:42:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 2830, 2024-08-20T01:42:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 2830, 2024-08-20T01:42:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 2830, 2024-08-20T01:42:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-08-20T01:42:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-write_buf_throttle": { 2024-08-20T01:42:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-08-20T01:42:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 3758096384, 2024-08-20T01:42:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-08-20T01:42:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-08-20T01:42:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-08-20T01:42:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-08-20T01:42:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-08-20T01:42:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-08-20T01:42:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 0, 2024-08-20T01:42:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 0, 2024-08-20T01:42:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-08-20T01:42:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-write_buf_throttle-0x55ebbc688960": { 2024-08-20T01:42:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-08-20T01:42:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 3758096384, 2024-08-20T01:42:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-08-20T01:42:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-08-20T01:42:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-08-20T01:42:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-08-20T01:42:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-08-20T01:42:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-08-20T01:42:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 0, 2024-08-20T01:42:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 0, 2024-08-20T01:42:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-08-20T01:42:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "trackedop": { 2024-08-20T01:42:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "slow_ops_count": 0 2024-08-20T01:42:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:09.649 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-08-20T01:42:10.470 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-08-20T01:42:10.470 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-08-20T01:42:10.470 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-08-20T01:42:10.470 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-08-20T01:42:10.470 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-08-20T01:42:10.471 DEBUG:tasks.check_counter:Getting stats from h 2024-08-20T01:42:10.471 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph daemon mds.h perf dump 2024-08-20T01:42:10.721 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:42:11.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:11 smithi077 ceph-mon[22251]: pgmap v679: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-20T01:42:11.256 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-08-20T01:42:11.256 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:42:11.256 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 1718, 2024-08-20T01:42:11.256 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 1720, 2024-08-20T01:42:11.256 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 172478532, 2024-08-20T01:42:11.256 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 546331, 2024-08-20T01:42:11.256 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 8, 2024-08-20T01:42:11.256 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 4, 2024-08-20T01:42:11.256 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.247300235, 2024-08-20T01:42:11.256 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.066033883, 2024-08-20T01:42:11.256 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.131361599, 2024-08-20T01:42:11.256 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.038363876, 2024-08-20T01:42:11.257 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:11.257 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 1718, 2024-08-20T01:42:11.257 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.057399890, 2024-08-20T01:42:11.257 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000033410 2024-08-20T01:42:11.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.257 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:11.257 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.257 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.257 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.257 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T01:42:11.257 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T01:42:11.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.257 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:42:11.258 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 598, 2024-08-20T01:42:11.258 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 760, 2024-08-20T01:42:11.258 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 107303901, 2024-08-20T01:42:11.258 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 557836, 2024-08-20T01:42:11.258 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 6, 2024-08-20T01:42:11.258 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 5, 2024-08-20T01:42:11.258 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.114596148, 2024-08-20T01:42:11.258 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.026778849, 2024-08-20T01:42:11.258 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.071275654, 2024-08-20T01:42:11.258 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.012131261, 2024-08-20T01:42:11.258 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:11.258 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 759, 2024-08-20T01:42:11.258 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.027847197, 2024-08-20T01:42:11.259 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000036689 2024-08-20T01:42:11.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.259 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:11.259 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.259 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.259 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.259 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-08-20T01:42:11.259 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 369200 2024-08-20T01:42:11.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.259 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:42:11.259 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 906, 2024-08-20T01:42:11.259 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 892, 2024-08-20T01:42:11.259 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 168530049, 2024-08-20T01:42:11.260 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 346224, 2024-08-20T01:42:11.260 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 5, 2024-08-20T01:42:11.260 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 4, 2024-08-20T01:42:11.260 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.172690613, 2024-08-20T01:42:11.260 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.037353946, 2024-08-20T01:42:11.260 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.122193277, 2024-08-20T01:42:11.260 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.014235533, 2024-08-20T01:42:11.260 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:11.260 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 891, 2024-08-20T01:42:11.260 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.031692373, 2024-08-20T01:42:11.260 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000035569 2024-08-20T01:42:11.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.260 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:11.260 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.261 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.261 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.261 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 581456, 2024-08-20T01:42:11.261 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 135072 2024-08-20T01:42:11.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.261 INFO:teuthology.orchestra.run.smithi077.stdout: "cct": { 2024-08-20T01:42:11.261 INFO:teuthology.orchestra.run.smithi077.stdout: "total_workers": 1, 2024-08-20T01:42:11.261 INFO:teuthology.orchestra.run.smithi077.stdout: "unhealthy_workers": 0 2024-08-20T01:42:11.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.261 INFO:teuthology.orchestra.run.smithi077.stdout: "finisher-MDSRank": { 2024-08-20T01:42:11.261 INFO:teuthology.orchestra.run.smithi077.stdout: "queue_len": 0, 2024-08-20T01:42:11.261 INFO:teuthology.orchestra.run.smithi077.stdout: "complete_latency": { 2024-08-20T01:42:11.261 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 4776, 2024-08-20T01:42:11.261 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.130440637, 2024-08-20T01:42:11.262 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000027311 2024-08-20T01:42:11.262 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:11.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.262 INFO:teuthology.orchestra.run.smithi077.stdout: "finisher-PurgeQueue": { 2024-08-20T01:42:11.262 INFO:teuthology.orchestra.run.smithi077.stdout: "queue_len": 0, 2024-08-20T01:42:11.262 INFO:teuthology.orchestra.run.smithi077.stdout: "complete_latency": { 2024-08-20T01:42:11.262 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.262 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.262 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.262 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:11.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.262 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-08-20T01:42:11.263 INFO:teuthology.orchestra.run.smithi077.stdout: "request": 0, 2024-08-20T01:42:11.263 INFO:teuthology.orchestra.run.smithi077.stdout: "reply": 0, 2024-08-20T01:42:11.263 INFO:teuthology.orchestra.run.smithi077.stdout: "reply_latency": { 2024-08-20T01:42:11.263 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.263 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.263 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.263 INFO:teuthology.orchestra.run.smithi077.stdout: "slow_reply": 0, 2024-08-20T01:42:11.263 INFO:teuthology.orchestra.run.smithi077.stdout: "forward": 0, 2024-08-20T01:42:11.263 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_fetch_complete": 0, 2024-08-20T01:42:11.263 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_fetch_keys": 0, 2024-08-20T01:42:11.263 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_commit": 0, 2024-08-20T01:42:11.263 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_split": 0, 2024-08-20T01:42:11.263 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_merge": 0, 2024-08-20T01:42:11.263 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes": 30771, 2024-08-20T01:42:11.264 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_top": 3747, 2024-08-20T01:42:11.264 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_bottom": 27024, 2024-08-20T01:42:11.264 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_pin_tail": 0, 2024-08-20T01:42:11.264 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_pinned": 25418, 2024-08-20T01:42:11.264 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_expired": 0, 2024-08-20T01:42:11.264 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_with_caps": 0, 2024-08-20T01:42:11.264 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": 0, 2024-08-20T01:42:11.264 INFO:teuthology.orchestra.run.smithi077.stdout: "subtrees": 1, 2024-08-20T01:42:11.265 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse": 0, 2024-08-20T01:42:11.265 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_hit": 0, 2024-08-20T01:42:11.265 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_forward": 0, 2024-08-20T01:42:11.265 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_discover": 0, 2024-08-20T01:42:11.265 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_dir_fetch": 0, 2024-08-20T01:42:11.265 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_remote_ino": 0, 2024-08-20T01:42:11.265 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_lock": 0, 2024-08-20T01:42:11.265 INFO:teuthology.orchestra.run.smithi077.stdout: "load_cent": 0, 2024-08-20T01:42:11.265 INFO:teuthology.orchestra.run.smithi077.stdout: "q": 0, 2024-08-20T01:42:11.265 INFO:teuthology.orchestra.run.smithi077.stdout: "exported": 0, 2024-08-20T01:42:11.265 INFO:teuthology.orchestra.run.smithi077.stdout: "exported_inodes": 0, 2024-08-20T01:42:11.265 INFO:teuthology.orchestra.run.smithi077.stdout: "imported": 0, 2024-08-20T01:42:11.265 INFO:teuthology.orchestra.run.smithi077.stdout: "imported_inodes": 0, 2024-08-20T01:42:11.266 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_dir_fetch": 0, 2024-08-20T01:42:11.266 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_backtrace_fetch": 0, 2024-08-20T01:42:11.266 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_peer_discover": 0, 2024-08-20T01:42:11.266 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rfiles": 0, 2024-08-20T01:42:11.266 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rbytes": 0, 2024-08-20T01:42:11.266 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rsnaps": 0, 2024-08-20T01:42:11.266 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_backtrace_fetch": 0, 2024-08-20T01:42:11.266 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_set_tag": 0, 2024-08-20T01:42:11.266 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T01:42:11.266 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_inotable_repaired": 0, 2024-08-20T01:42:11.266 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dir_inodes": 0, 2024-08-20T01:42:11.266 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T01:42:11.266 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dirfrag_rstats": 0, 2024-08-20T01:42:11.266 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_file_inodes": 0, 2024-08-20T01:42:11.267 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_inode_file_caps": 0, 2024-08-20T01:42:11.267 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_revoke": 0, 2024-08-20T01:42:11.267 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_grant": 0, 2024-08-20T01:42:11.267 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T01:42:11.267 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T01:42:11.267 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T01:42:11.267 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_caps": 0, 2024-08-20T01:42:11.267 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_caps_dirty": 0, 2024-08-20T01:42:11.267 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_cap_release": 0, 2024-08-20T01:42:11.267 INFO:teuthology.orchestra.run.smithi077.stdout: "process_request_cap_release": 0 2024-08-20T01:42:11.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.267 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache": { 2024-08-20T01:42:11.267 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_update": 0, 2024-08-20T01:42:11.267 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_update_receipt": 0, 2024-08-20T01:42:11.268 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_try_discover": 0, 2024-08-20T01:42:11.268 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_send_discover": 0, 2024-08-20T01:42:11.268 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_handle_discover": 0, 2024-08-20T01:42:11.268 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays": 0, 2024-08-20T01:42:11.268 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays_delayed": 0, 2024-08-20T01:42:11.268 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays_enqueuing": 0, 2024-08-20T01:42:11.268 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_created": 0, 2024-08-20T01:42:11.268 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_enqueued": 0, 2024-08-20T01:42:11.268 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_reintegrated": 0, 2024-08-20T01:42:11.268 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_migrated": 0, 2024-08-20T01:42:11.268 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_processing": 0, 2024-08-20T01:42:11.268 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_enqueued": 0, 2024-08-20T01:42:11.268 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_prioritized": 0, 2024-08-20T01:42:11.268 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_started": 0, 2024-08-20T01:42:11.268 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_completed": 0, 2024-08-20T01:42:11.269 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_quiesce_path": 0, 2024-08-20T01:42:11.269 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_quiesce_inode": 0, 2024-08-20T01:42:11.269 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T01:42:11.269 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_exportdir": 0, 2024-08-20T01:42:11.269 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_flush": 0, 2024-08-20T01:42:11.269 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_fragmentdir": 0, 2024-08-20T01:42:11.269 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_fragstats": 0, 2024-08-20T01:42:11.269 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_inodestats": 0 2024-08-20T01:42:11.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.269 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log": { 2024-08-20T01:42:11.269 INFO:teuthology.orchestra.run.smithi077.stdout: "evlrg": 0, 2024-08-20T01:42:11.269 INFO:teuthology.orchestra.run.smithi077.stdout: "evadd": 0, 2024-08-20T01:42:11.269 INFO:teuthology.orchestra.run.smithi077.stdout: "evex": 0, 2024-08-20T01:42:11.269 INFO:teuthology.orchestra.run.smithi077.stdout: "evtrm": 0, 2024-08-20T01:42:11.269 INFO:teuthology.orchestra.run.smithi077.stdout: "ev": 189858, 2024-08-20T01:42:11.270 INFO:teuthology.orchestra.run.smithi077.stdout: "evexg": 0, 2024-08-20T01:42:11.270 INFO:teuthology.orchestra.run.smithi077.stdout: "evexd": 0, 2024-08-20T01:42:11.270 INFO:teuthology.orchestra.run.smithi077.stdout: "segadd": 0, 2024-08-20T01:42:11.270 INFO:teuthology.orchestra.run.smithi077.stdout: "segex": 0, 2024-08-20T01:42:11.270 INFO:teuthology.orchestra.run.smithi077.stdout: "segtrm": 0, 2024-08-20T01:42:11.270 INFO:teuthology.orchestra.run.smithi077.stdout: "seg": 138, 2024-08-20T01:42:11.270 INFO:teuthology.orchestra.run.smithi077.stdout: "segmjr": 17, 2024-08-20T01:42:11.270 INFO:teuthology.orchestra.run.smithi077.stdout: "segexg": 0, 2024-08-20T01:42:11.270 INFO:teuthology.orchestra.run.smithi077.stdout: "segexd": 0, 2024-08-20T01:42:11.270 INFO:teuthology.orchestra.run.smithi077.stdout: "expos": 207200968, 2024-08-20T01:42:11.270 INFO:teuthology.orchestra.run.smithi077.stdout: "wrpos": 451077646, 2024-08-20T01:42:11.270 INFO:teuthology.orchestra.run.smithi077.stdout: "rdpos": 451069045, 2024-08-20T01:42:11.270 INFO:teuthology.orchestra.run.smithi077.stdout: "jlat": { 2024-08-20T01:42:11.270 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.271 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.271 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.271 INFO:teuthology.orchestra.run.smithi077.stdout: "replayed": 189858 2024-08-20T01:42:11.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.271 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_mem": { 2024-08-20T01:42:11.271 INFO:teuthology.orchestra.run.smithi077.stdout: "ino": 14, 2024-08-20T01:42:11.271 INFO:teuthology.orchestra.run.smithi077.stdout: "ino+": 102185, 2024-08-20T01:42:11.271 INFO:teuthology.orchestra.run.smithi077.stdout: "ino-": 102171, 2024-08-20T01:42:11.271 INFO:teuthology.orchestra.run.smithi077.stdout: "dir": 19, 2024-08-20T01:42:11.271 INFO:teuthology.orchestra.run.smithi077.stdout: "dir+": 4701, 2024-08-20T01:42:11.271 INFO:teuthology.orchestra.run.smithi077.stdout: "dir-": 4682, 2024-08-20T01:42:11.271 INFO:teuthology.orchestra.run.smithi077.stdout: "dn": 30771, 2024-08-20T01:42:11.271 INFO:teuthology.orchestra.run.smithi077.stdout: "dn+": 179025, 2024-08-20T01:42:11.271 INFO:teuthology.orchestra.run.smithi077.stdout: "dn-": 148254, 2024-08-20T01:42:11.271 INFO:teuthology.orchestra.run.smithi077.stdout: "cap": 0, 2024-08-20T01:42:11.272 INFO:teuthology.orchestra.run.smithi077.stdout: "cap+": 0, 2024-08-20T01:42:11.272 INFO:teuthology.orchestra.run.smithi077.stdout: "cap-": 0, 2024-08-20T01:42:11.272 INFO:teuthology.orchestra.run.smithi077.stdout: "rss": 105844, 2024-08-20T01:42:11.272 INFO:teuthology.orchestra.run.smithi077.stdout: "heap": 428830720 2024-08-20T01:42:11.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.272 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_server": { 2024-08-20T01:42:11.272 INFO:teuthology.orchestra.run.smithi077.stdout: "dispatch_client_request": 0, 2024-08-20T01:42:11.272 INFO:teuthology.orchestra.run.smithi077.stdout: "dispatch_server_request": 0, 2024-08-20T01:42:11.272 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_request": 0, 2024-08-20T01:42:11.272 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_session": 0, 2024-08-20T01:42:11.272 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_peer_request": 0, 2024-08-20T01:42:11.272 INFO:teuthology.orchestra.run.smithi077.stdout: "req_create_latency": { 2024-08-20T01:42:11.272 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.273 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.273 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.273 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getattr_latency": { 2024-08-20T01:42:11.273 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.273 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.273 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.273 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getfilelock_latency": { 2024-08-20T01:42:11.273 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.273 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.273 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.273 INFO:teuthology.orchestra.run.smithi077.stdout: "req_link_latency": { 2024-08-20T01:42:11.274 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.274 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.274 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.274 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookup_latency": { 2024-08-20T01:42:11.274 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.274 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.274 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.274 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookuphash_latency": { 2024-08-20T01:42:11.274 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.274 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.274 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.275 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupino_latency": { 2024-08-20T01:42:11.275 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.275 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.275 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.275 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupname_latency": { 2024-08-20T01:42:11.275 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.275 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.275 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.275 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupparent_latency": { 2024-08-20T01:42:11.275 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.275 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.275 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.276 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupsnap_latency": { 2024-08-20T01:42:11.276 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.276 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.276 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.276 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lssnap_latency": { 2024-08-20T01:42:11.276 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.276 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.276 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.276 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mkdir_latency": { 2024-08-20T01:42:11.276 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.276 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.276 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.277 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mknod_latency": { 2024-08-20T01:42:11.277 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.277 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.277 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.277 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mksnap_latency": { 2024-08-20T01:42:11.277 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.277 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.277 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.277 INFO:teuthology.orchestra.run.smithi077.stdout: "req_open_latency": { 2024-08-20T01:42:11.277 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.277 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.277 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.278 INFO:teuthology.orchestra.run.smithi077.stdout: "req_readdir_latency": { 2024-08-20T01:42:11.278 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.278 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.278 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.278 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rename_latency": { 2024-08-20T01:42:11.278 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.278 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.278 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.278 INFO:teuthology.orchestra.run.smithi077.stdout: "req_renamesnap_latency": { 2024-08-20T01:42:11.278 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.278 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.278 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.279 INFO:teuthology.orchestra.run.smithi077.stdout: "req_snapdiff_latency": { 2024-08-20T01:42:11.279 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.279 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.279 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.279 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmdir_latency": { 2024-08-20T01:42:11.279 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.279 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.279 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.279 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmsnap_latency": { 2024-08-20T01:42:11.279 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.279 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.279 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.280 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmxattr_latency": { 2024-08-20T01:42:11.280 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.280 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.280 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.280 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setattr_latency": { 2024-08-20T01:42:11.280 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.280 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.280 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.280 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setdirlayout_latency": { 2024-08-20T01:42:11.280 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.281 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.281 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.281 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setfilelock_latency": { 2024-08-20T01:42:11.281 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.281 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.281 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.281 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setlayout_latency": { 2024-08-20T01:42:11.281 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.281 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.281 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.281 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setxattr_latency": { 2024-08-20T01:42:11.281 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.282 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.282 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.282 INFO:teuthology.orchestra.run.smithi077.stdout: "req_symlink_latency": { 2024-08-20T01:42:11.282 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.282 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.282 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.283 INFO:teuthology.orchestra.run.smithi077.stdout: "req_unlink_latency": { 2024-08-20T01:42:11.283 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.283 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.283 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.283 INFO:teuthology.orchestra.run.smithi077.stdout: "cap_revoke_eviction": 0, 2024-08-20T01:42:11.283 INFO:teuthology.orchestra.run.smithi077.stdout: "cap_acquisition_throttle": 0, 2024-08-20T01:42:11.283 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getvxattr_latency": { 2024-08-20T01:42:11.283 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.283 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.283 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.283 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:11.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.283 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_sessions": { 2024-08-20T01:42:11.283 INFO:teuthology.orchestra.run.smithi077.stdout: "session_count": 1, 2024-08-20T01:42:11.284 INFO:teuthology.orchestra.run.smithi077.stdout: "session_add": 2, 2024-08-20T01:42:11.284 INFO:teuthology.orchestra.run.smithi077.stdout: "session_remove": 1, 2024-08-20T01:42:11.284 INFO:teuthology.orchestra.run.smithi077.stdout: "sessions_open": 1, 2024-08-20T01:42:11.284 INFO:teuthology.orchestra.run.smithi077.stdout: "sessions_stale": 0, 2024-08-20T01:42:11.284 INFO:teuthology.orchestra.run.smithi077.stdout: "total_load": 0, 2024-08-20T01:42:11.284 INFO:teuthology.orchestra.run.smithi077.stdout: "average_load": 0, 2024-08-20T01:42:11.284 INFO:teuthology.orchestra.run.smithi077.stdout: "avg_session_uptime": 1678, 2024-08-20T01:42:11.284 INFO:teuthology.orchestra.run.smithi077.stdout: "mdthresh_evicted": 0 2024-08-20T01:42:11.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.284 INFO:teuthology.orchestra.run.smithi077.stdout: "mempool": { 2024-08-20T01:42:11.285 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:42:11.285 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_items": 0, 2024-08-20T01:42:11.285 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:42:11.285 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:42:11.285 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:42:11.285 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:42:11.285 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:42:11.285 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:42:11.285 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:42:11.285 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:42:11.285 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:42:11.285 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:42:11.285 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:42:11.286 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:42:11.286 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:42:11.286 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_items": 0, 2024-08-20T01:42:11.286 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:42:11.286 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_items": 0, 2024-08-20T01:42:11.286 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:42:11.286 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:42:11.286 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:42:11.286 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:42:11.286 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:42:11.286 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:42:11.286 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:42:11.286 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_items": 0, 2024-08-20T01:42:11.287 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:42:11.287 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:42:11.287 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:42:11.287 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_items": 0, 2024-08-20T01:42:11.287 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_bytes": 0, 2024-08-20T01:42:11.287 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_items": 0, 2024-08-20T01:42:11.287 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:42:11.287 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:42:11.287 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:42:11.287 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:42:11.287 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_bytes": 230621, 2024-08-20T01:42:11.287 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_items": 74, 2024-08-20T01:42:11.287 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_bytes": 0, 2024-08-20T01:42:11.287 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_items": 0, 2024-08-20T01:42:11.287 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bytes": 0, 2024-08-20T01:42:11.288 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_items": 0, 2024-08-20T01:42:11.288 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:42:11.288 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_items": 0, 2024-08-20T01:42:11.288 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:42:11.288 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_items": 0, 2024-08-20T01:42:11.288 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_bytes": 7784, 2024-08-20T01:42:11.288 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_items": 160, 2024-08-20T01:42:11.288 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:42:11.288 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:42:11.288 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_bytes": 0, 2024-08-20T01:42:11.288 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_items": 0, 2024-08-20T01:42:11.288 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_bytes": 20979995, 2024-08-20T01:42:11.288 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_items": 124946, 2024-08-20T01:42:11.288 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_bytes": 0, 2024-08-20T01:42:11.288 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_items": 0, 2024-08-20T01:42:11.289 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_bytes": 0, 2024-08-20T01:42:11.289 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_items": 0 2024-08-20T01:42:11.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.289 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter": { 2024-08-20T01:42:11.289 INFO:teuthology.orchestra.run.smithi077.stdout: "op_active": 0, 2024-08-20T01:42:11.289 INFO:teuthology.orchestra.run.smithi077.stdout: "op_laggy": 0, 2024-08-20T01:42:11.289 INFO:teuthology.orchestra.run.smithi077.stdout: "op_send": 2975, 2024-08-20T01:42:11.289 INFO:teuthology.orchestra.run.smithi077.stdout: "op_send_bytes": 21, 2024-08-20T01:42:11.289 INFO:teuthology.orchestra.run.smithi077.stdout: "op_resend": 3, 2024-08-20T01:42:11.289 INFO:teuthology.orchestra.run.smithi077.stdout: "op_reply": 2975, 2024-08-20T01:42:11.289 INFO:teuthology.orchestra.run.smithi077.stdout: "op_latency": { 2024-08-20T01:42:11.289 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 2975, 2024-08-20T01:42:11.289 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 23.651469593, 2024-08-20T01:42:11.289 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.007950073 2024-08-20T01:42:11.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.290 INFO:teuthology.orchestra.run.smithi077.stdout: "op_inflight": 0, 2024-08-20T01:42:11.290 INFO:teuthology.orchestra.run.smithi077.stdout: "oplen_avg": { 2024-08-20T01:42:11.290 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 2975, 2024-08-20T01:42:11.290 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 2976 2024-08-20T01:42:11.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.290 INFO:teuthology.orchestra.run.smithi077.stdout: "op": 2975, 2024-08-20T01:42:11.290 INFO:teuthology.orchestra.run.smithi077.stdout: "op_r": 2975, 2024-08-20T01:42:11.290 INFO:teuthology.orchestra.run.smithi077.stdout: "op_w": 0, 2024-08-20T01:42:11.290 INFO:teuthology.orchestra.run.smithi077.stdout: "op_rmw": 0, 2024-08-20T01:42:11.290 INFO:teuthology.orchestra.run.smithi077.stdout: "op_pg": 0, 2024-08-20T01:42:11.290 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_stat": 1769, 2024-08-20T01:42:11.290 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_create": 0, 2024-08-20T01:42:11.290 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_read": 1204, 2024-08-20T01:42:11.291 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_write": 0, 2024-08-20T01:42:11.291 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_writefull": 0, 2024-08-20T01:42:11.291 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_writesame": 0, 2024-08-20T01:42:11.291 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_append": 0, 2024-08-20T01:42:11.291 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_zero": 0, 2024-08-20T01:42:11.291 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_truncate": 0, 2024-08-20T01:42:11.291 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_delete": 0, 2024-08-20T01:42:11.291 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_mapext": 0, 2024-08-20T01:42:11.291 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_sparse_read": 0, 2024-08-20T01:42:11.291 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_clonerange": 0, 2024-08-20T01:42:11.291 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_getxattr": 1, 2024-08-20T01:42:11.291 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_setxattr": 0, 2024-08-20T01:42:11.291 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_cmpxattr": 0, 2024-08-20T01:42:11.291 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_rmxattr": 0, 2024-08-20T01:42:11.291 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_resetxattrs": 0, 2024-08-20T01:42:11.292 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_call": 0, 2024-08-20T01:42:11.292 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_watch": 0, 2024-08-20T01:42:11.292 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_notify": 0, 2024-08-20T01:42:11.292 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T01:42:11.292 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_pgls": 0, 2024-08-20T01:42:11.292 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_pgls_filter": 0, 2024-08-20T01:42:11.292 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_other": 0, 2024-08-20T01:42:11.292 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_active": 0, 2024-08-20T01:42:11.292 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_send": 0, 2024-08-20T01:42:11.292 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_resend": 0, 2024-08-20T01:42:11.292 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_ping": 0, 2024-08-20T01:42:11.292 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_active": 0, 2024-08-20T01:42:11.292 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_send": 0, 2024-08-20T01:42:11.292 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_resend": 0, 2024-08-20T01:42:11.292 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_active": 0, 2024-08-20T01:42:11.292 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_send": 0, 2024-08-20T01:42:11.293 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_resend": 0, 2024-08-20T01:42:11.293 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_active": 0, 2024-08-20T01:42:11.293 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_send": 0, 2024-08-20T01:42:11.293 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_resend": 0, 2024-08-20T01:42:11.293 INFO:teuthology.orchestra.run.smithi077.stdout: "command_active": 0, 2024-08-20T01:42:11.293 INFO:teuthology.orchestra.run.smithi077.stdout: "command_send": 0, 2024-08-20T01:42:11.293 INFO:teuthology.orchestra.run.smithi077.stdout: "command_resend": 0, 2024-08-20T01:42:11.293 INFO:teuthology.orchestra.run.smithi077.stdout: "map_epoch": 81, 2024-08-20T01:42:11.293 INFO:teuthology.orchestra.run.smithi077.stdout: "map_full": 0, 2024-08-20T01:42:11.293 INFO:teuthology.orchestra.run.smithi077.stdout: "map_inc": 6, 2024-08-20T01:42:11.293 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_sessions": 10, 2024-08-20T01:42:11.293 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_session_open": 10, 2024-08-20T01:42:11.293 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_session_close": 0, 2024-08-20T01:42:11.293 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_laggy": 0, 2024-08-20T01:42:11.294 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_wr": 0, 2024-08-20T01:42:11.294 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_rd": 2, 2024-08-20T01:42:11.294 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_del": 0 2024-08-20T01:42:11.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.294 INFO:teuthology.orchestra.run.smithi077.stdout: "oft": { 2024-08-20T01:42:11.294 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_objs": 0, 2024-08-20T01:42:11.294 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_kv_pairs": 0, 2024-08-20T01:42:11.294 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_updates": 0, 2024-08-20T01:42:11.294 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_removes": 0 2024-08-20T01:42:11.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.294 INFO:teuthology.orchestra.run.smithi077.stdout: "purge_queue": { 2024-08-20T01:42:11.294 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_ops": 0, 2024-08-20T01:42:11.294 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_ops_high_water": 0, 2024-08-20T01:42:11.295 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing": 0, 2024-08-20T01:42:11.295 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_high_water": 0, 2024-08-20T01:42:11.295 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executed_ops": 0, 2024-08-20T01:42:11.295 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executed": 0, 2024-08-20T01:42:11.295 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_item_in_journal": 0 2024-08-20T01:42:11.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.295 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:42:11.295 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-08-20T01:42:11.295 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 104857600, 2024-08-20T01:42:11.295 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-08-20T01:42:11.295 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 3218, 2024-08-20T01:42:11.295 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 448007469, 2024-08-20T01:42:11.295 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:11.295 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 3218, 2024-08-20T01:42:11.295 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-08-20T01:42:11.296 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-08-20T01:42:11.296 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 3218, 2024-08-20T01:42:11.296 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 448007469, 2024-08-20T01:42:11.296 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-08-20T01:42:11.296 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.296 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.296 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.296 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:11.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.296 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-objecter_bytes": { 2024-08-20T01:42:11.296 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-08-20T01:42:11.296 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 104857600, 2024-08-20T01:42:11.296 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-08-20T01:42:11.296 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-08-20T01:42:11.297 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-08-20T01:42:11.297 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:11.297 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-08-20T01:42:11.297 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 2975, 2024-08-20T01:42:11.297 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 446906736, 2024-08-20T01:42:11.297 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 2975, 2024-08-20T01:42:11.297 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 446906736, 2024-08-20T01:42:11.297 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-08-20T01:42:11.297 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.297 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.297 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.297 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:11.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.298 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-objecter_ops": { 2024-08-20T01:42:11.298 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-08-20T01:42:11.298 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 1024, 2024-08-20T01:42:11.298 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-08-20T01:42:11.298 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-08-20T01:42:11.298 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-08-20T01:42:11.298 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:11.298 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-08-20T01:42:11.298 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 2975, 2024-08-20T01:42:11.298 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 2975, 2024-08-20T01:42:11.298 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 2975, 2024-08-20T01:42:11.298 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 2975, 2024-08-20T01:42:11.298 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-08-20T01:42:11.298 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.298 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.299 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.299 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:11.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.299 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-write_buf_throttle": { 2024-08-20T01:42:11.299 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-08-20T01:42:11.299 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 3758096384, 2024-08-20T01:42:11.299 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-08-20T01:42:11.299 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-08-20T01:42:11.299 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-08-20T01:42:11.299 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:11.299 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-08-20T01:42:11.299 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-08-20T01:42:11.299 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-08-20T01:42:11.299 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 0, 2024-08-20T01:42:11.300 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 0, 2024-08-20T01:42:11.300 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-08-20T01:42:11.300 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.300 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.300 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.300 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:11.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.300 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-write_buf_throttle-0x560fdfe36960": { 2024-08-20T01:42:11.300 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-08-20T01:42:11.300 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 3758096384, 2024-08-20T01:42:11.300 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-08-20T01:42:11.300 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-08-20T01:42:11.300 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-08-20T01:42:11.300 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:11.300 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-08-20T01:42:11.300 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-08-20T01:42:11.301 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-08-20T01:42:11.301 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 0, 2024-08-20T01:42:11.301 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 0, 2024-08-20T01:42:11.301 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-08-20T01:42:11.301 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:11.301 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:11.301 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:11.301 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:11.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:11.301 INFO:teuthology.orchestra.run.smithi077.stdout: "trackedop": { 2024-08-20T01:42:11.301 INFO:teuthology.orchestra.run.smithi077.stdout: "slow_ops_count": 0 2024-08-20T01:42:11.301 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:11.301 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-08-20T01:42:11.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:11 smithi022 ceph-mon[18709]: pgmap v679: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-20T01:42:11.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:11 smithi134 ceph-mon[22511]: pgmap v679: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-20T01:42:12.093 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-08-20T01:42:12.093 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-08-20T01:42:12.093 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-08-20T01:42:12.093 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-08-20T01:42:12.093 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-08-20T01:42:12.093 DEBUG:tasks.check_counter:Getting stats from k 2024-08-20T01:42:12.093 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph daemon mds.k perf dump 2024-08-20T01:42:12.340 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:42:12.833 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-08-20T01:42:12.833 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:42:12.833 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 229, 2024-08-20T01:42:12.833 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 224, 2024-08-20T01:42:12.833 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 522560, 2024-08-20T01:42:12.833 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 136832, 2024-08-20T01:42:12.833 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 4, 2024-08-20T01:42:12.833 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 0, 2024-08-20T01:42:12.833 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.033971400, 2024-08-20T01:42:12.833 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.016174440, 2024-08-20T01:42:12.834 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.022465630, 2024-08-20T01:42:12.834 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:42:12.834 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:12.834 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 224, 2024-08-20T01:42:12.834 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.014149208, 2024-08-20T01:42:12.834 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000063166 2024-08-20T01:42:12.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:12.834 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:12.834 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:12.834 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:12.834 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:12.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:12.834 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 522560, 2024-08-20T01:42:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 136832 2024-08-20T01:42:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:42:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 1, 2024-08-20T01:42:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 168, 2024-08-20T01:42:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 160, 2024-08-20T01:42:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 109424, 2024-08-20T01:42:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 3, 2024-08-20T01:42:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 2, 2024-08-20T01:42:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.011709249, 2024-08-20T01:42:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.009055332, 2024-08-20T01:42:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.001108566, 2024-08-20T01:42:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:42:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 166, 2024-08-20T01:42:12.836 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.009548676, 2024-08-20T01:42:12.836 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000057522 2024-08-20T01:42:12.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:12.836 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:12.836 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:12.836 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:12.836 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:12.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:12.836 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-20T01:42:12.836 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 109424 2024-08-20T01:42:12.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:12.836 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:42:12.836 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 0, 2024-08-20T01:42:12.836 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 2, 2024-08-20T01:42:12.837 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 0, 2024-08-20T01:42:12.837 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 0, 2024-08-20T01:42:12.837 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 2, 2024-08-20T01:42:12.837 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 1, 2024-08-20T01:42:12.837 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.000493673, 2024-08-20T01:42:12.837 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.000000000, 2024-08-20T01:42:12.837 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.000412416, 2024-08-20T01:42:12.837 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:42:12.837 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:12.837 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:12.837 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:12.837 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:12.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:12.837 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:12.837 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:12.838 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:12.838 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:12.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:12.838 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T01:42:12.838 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T01:42:12.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:12.838 INFO:teuthology.orchestra.run.smithi077.stdout: "cct": { 2024-08-20T01:42:12.838 INFO:teuthology.orchestra.run.smithi077.stdout: "total_workers": 0, 2024-08-20T01:42:12.838 INFO:teuthology.orchestra.run.smithi077.stdout: "unhealthy_workers": 0 2024-08-20T01:42:12.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:12.838 INFO:teuthology.orchestra.run.smithi077.stdout: "mempool": { 2024-08-20T01:42:12.838 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:42:12.838 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_items": 0, 2024-08-20T01:42:12.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:42:12.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:42:12.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:42:12.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:42:12.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:42:12.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:42:12.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:42:12.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:42:12.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:42:12.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:42:12.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:42:12.839 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:42:12.840 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:42:12.840 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_items": 0, 2024-08-20T01:42:12.840 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:42:12.840 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_items": 0, 2024-08-20T01:42:12.840 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:42:12.840 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:42:12.840 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:42:12.840 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:42:12.840 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:42:12.840 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:42:12.840 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:42:12.840 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_items": 0, 2024-08-20T01:42:12.841 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:42:12.841 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:42:12.841 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:42:12.841 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_items": 0, 2024-08-20T01:42:12.841 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_bytes": 0, 2024-08-20T01:42:12.841 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_items": 0, 2024-08-20T01:42:12.841 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:42:12.841 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:42:12.841 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:42:12.841 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:42:12.842 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_bytes": 148984, 2024-08-20T01:42:12.842 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_items": 30, 2024-08-20T01:42:12.842 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_bytes": 0, 2024-08-20T01:42:12.842 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_items": 0, 2024-08-20T01:42:12.842 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bytes": 0, 2024-08-20T01:42:12.842 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_items": 0, 2024-08-20T01:42:12.842 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:42:12.842 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_items": 0, 2024-08-20T01:42:12.842 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:42:12.842 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_items": 0, 2024-08-20T01:42:12.842 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_bytes": 0, 2024-08-20T01:42:12.842 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_items": 0, 2024-08-20T01:42:12.842 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:42:12.843 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:42:12.843 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_bytes": 0, 2024-08-20T01:42:12.843 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_items": 0, 2024-08-20T01:42:12.843 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_bytes": 928, 2024-08-20T01:42:12.843 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_items": 2, 2024-08-20T01:42:12.843 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_bytes": 0, 2024-08-20T01:42:12.843 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_items": 0, 2024-08-20T01:42:12.843 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_bytes": 0, 2024-08-20T01:42:12.843 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_items": 0 2024-08-20T01:42:12.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-08-20T01:42:12.843 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:42:12.843 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-08-20T01:42:12.843 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 104857600, 2024-08-20T01:42:12.843 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-08-20T01:42:12.843 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 226, 2024-08-20T01:42:12.844 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 487750, 2024-08-20T01:42:12.844 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:12.844 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 226, 2024-08-20T01:42:12.844 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-08-20T01:42:12.844 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-08-20T01:42:12.844 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 226, 2024-08-20T01:42:12.844 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 487750, 2024-08-20T01:42:12.844 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-08-20T01:42:12.844 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-08-20T01:42:12.844 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-08-20T01:42:12.844 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-08-20T01:42:12.844 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:12.844 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-08-20T01:42:12.844 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-08-20T01:42:13.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:13 smithi077 ceph-mon[22251]: pgmap v680: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-20T01:42:13.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:13 smithi022 ceph-mon[18709]: pgmap v680: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-20T01:42:13.493 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-08-20T01:42:13.493 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-08-20T01:42:13.493 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-08-20T01:42:13.493 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-08-20T01:42:13.493 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-08-20T01:42:13.493 DEBUG:tasks.check_counter:Getting stats from c 2024-08-20T01:42:13.493 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph daemon mds.c perf dump 2024-08-20T01:42:13.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:13 smithi134 ceph-mon[22511]: pgmap v680: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-20T01:42:13.807 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:42:14.425 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-08-20T01:42:14.425 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:42:14.425 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 123943, 2024-08-20T01:42:14.425 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 150195, 2024-08-20T01:42:14.425 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 61479459, 2024-08-20T01:42:14.425 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 173432790, 2024-08-20T01:42:14.425 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 30, 2024-08-20T01:42:14.425 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 7, 2024-08-20T01:42:14.426 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 10.038128961, 2024-08-20T01:42:14.426 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 5.653299877, 2024-08-20T01:42:14.426 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 4.051920773, 2024-08-20T01:42:14.426 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.855451768, 2024-08-20T01:42:14.426 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:14.426 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 150196, 2024-08-20T01:42:14.426 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 8.382119541, 2024-08-20T01:42:14.426 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000055807 2024-08-20T01:42:14.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.426 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:14.426 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 195051, 2024-08-20T01:42:14.426 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.033943575, 2024-08-20T01:42:14.427 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000174 2024-08-20T01:42:14.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.427 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 596320, 2024-08-20T01:42:14.427 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 204800 2024-08-20T01:42:14.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.427 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:42:14.427 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 141940, 2024-08-20T01:42:14.427 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 161343, 2024-08-20T01:42:14.427 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 90268910, 2024-08-20T01:42:14.427 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 207344226, 2024-08-20T01:42:14.427 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 8, 2024-08-20T01:42:14.427 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 6, 2024-08-20T01:42:14.427 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 11.396178777, 2024-08-20T01:42:14.428 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 5.853395124, 2024-08-20T01:42:14.428 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 3.671613631, 2024-08-20T01:42:14.428 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 2.030858557, 2024-08-20T01:42:14.428 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:14.428 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 161341, 2024-08-20T01:42:14.428 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 12.409752911, 2024-08-20T01:42:14.428 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000076916 2024-08-20T01:42:14.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.428 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:14.428 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 145045, 2024-08-20T01:42:14.428 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.027401891, 2024-08-20T01:42:14.428 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000188 2024-08-20T01:42:14.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.428 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-20T01:42:14.429 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 372512 2024-08-20T01:42:14.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.429 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:42:14.429 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 388273, 2024-08-20T01:42:14.429 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 600708, 2024-08-20T01:42:14.429 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 138792836, 2024-08-20T01:42:14.429 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 442416437, 2024-08-20T01:42:14.429 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 18, 2024-08-20T01:42:14.429 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 7, 2024-08-20T01:42:14.429 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 26.362014220, 2024-08-20T01:42:14.429 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 15.465649140, 2024-08-20T01:42:14.429 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 106.672961456, 2024-08-20T01:42:14.429 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 2.835794667, 2024-08-20T01:42:14.430 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:14.430 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 600705, 2024-08-20T01:42:14.430 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 66.429427434, 2024-08-20T01:42:14.430 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000110585 2024-08-20T01:42:14.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.430 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:14.430 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 415284, 2024-08-20T01:42:14.430 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.127262125, 2024-08-20T01:42:14.430 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000306 2024-08-20T01:42:14.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.430 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-20T01:42:14.430 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 448 2024-08-20T01:42:14.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.431 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-08-20T01:42:14.431 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 1, 2024-08-20T01:42:14.431 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-08-20T01:42:14.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.431 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-MDSRank": { 2024-08-20T01:42:14.431 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-08-20T01:42:14.431 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-08-20T01:42:14.431 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 97551, 2024-08-20T01:42:14.431 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 158.422099428, 2024-08-20T01:42:14.431 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001623992 2024-08-20T01:42:14.431 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:14.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.431 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-PurgeQueue": { 2024-08-20T01:42:14.431 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-08-20T01:42:14.432 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-08-20T01:42:14.432 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 51394, 2024-08-20T01:42:14.432 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 15.347499376, 2024-08-20T01:42:14.432 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000298624 2024-08-20T01:42:14.432 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:14.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.432 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-08-20T01:42:14.432 INFO:teuthology.orchestra.run.smithi134.stdout: "request": 149387, 2024-08-20T01:42:14.432 INFO:teuthology.orchestra.run.smithi134.stdout: "reply": 143667, 2024-08-20T01:42:14.432 INFO:teuthology.orchestra.run.smithi134.stdout: "reply_latency": { 2024-08-20T01:42:14.432 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 143667, 2024-08-20T01:42:14.432 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 3111.459538036, 2024-08-20T01:42:14.432 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.021657440 2024-08-20T01:42:14.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.433 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_reply": 0, 2024-08-20T01:42:14.433 INFO:teuthology.orchestra.run.smithi134.stdout: "forward": 5720, 2024-08-20T01:42:14.433 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_complete": 318, 2024-08-20T01:42:14.433 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_keys": 0, 2024-08-20T01:42:14.433 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_commit": 1182, 2024-08-20T01:42:14.433 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_split": 107, 2024-08-20T01:42:14.433 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_merge": 4, 2024-08-20T01:42:14.433 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes": 341, 2024-08-20T01:42:14.433 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_top": 228, 2024-08-20T01:42:14.433 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_bottom": 103, 2024-08-20T01:42:14.433 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pin_tail": 10, 2024-08-20T01:42:14.433 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pinned": 13, 2024-08-20T01:42:14.434 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_expired": 103915, 2024-08-20T01:42:14.434 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_with_caps": 0, 2024-08-20T01:42:14.434 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": 0, 2024-08-20T01:42:14.434 INFO:teuthology.orchestra.run.smithi134.stdout: "subtrees": 4, 2024-08-20T01:42:14.434 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse": 258957, 2024-08-20T01:42:14.434 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_hit": 219465, 2024-08-20T01:42:14.434 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_forward": 5391, 2024-08-20T01:42:14.434 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_discover": 1565, 2024-08-20T01:42:14.434 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_dir_fetch": 15, 2024-08-20T01:42:14.434 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_remote_ino": 0, 2024-08-20T01:42:14.434 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_lock": 1800, 2024-08-20T01:42:14.434 INFO:teuthology.orchestra.run.smithi134.stdout: "load_cent": 0, 2024-08-20T01:42:14.434 INFO:teuthology.orchestra.run.smithi134.stdout: "q": 0, 2024-08-20T01:42:14.435 INFO:teuthology.orchestra.run.smithi134.stdout: "exported": 267, 2024-08-20T01:42:14.435 INFO:teuthology.orchestra.run.smithi134.stdout: "exported_inodes": 78715, 2024-08-20T01:42:14.435 INFO:teuthology.orchestra.run.smithi134.stdout: "imported": 595, 2024-08-20T01:42:14.435 INFO:teuthology.orchestra.run.smithi134.stdout: "imported_inodes": 88371, 2024-08-20T01:42:14.435 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_dir_fetch": 0, 2024-08-20T01:42:14.435 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_backtrace_fetch": 157489, 2024-08-20T01:42:14.435 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_peer_discover": 0, 2024-08-20T01:42:14.435 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rfiles": 175, 2024-08-20T01:42:14.435 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rbytes": 4564915, 2024-08-20T01:42:14.435 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rsnaps": 0, 2024-08-20T01:42:14.435 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_fetch": 157489, 2024-08-20T01:42:14.435 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_set_tag": 0, 2024-08-20T01:42:14.435 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T01:42:14.436 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_inotable_repaired": 0, 2024-08-20T01:42:14.436 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_inodes": 832, 2024-08-20T01:42:14.436 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T01:42:14.436 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dirfrag_rstats": 832, 2024-08-20T01:42:14.436 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_file_inodes": 156657, 2024-08-20T01:42:14.436 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_inode_file_caps": 3077, 2024-08-20T01:42:14.436 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_revoke": 32780, 2024-08-20T01:42:14.436 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_grant": 67480, 2024-08-20T01:42:14.436 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_trunc": 2, 2024-08-20T01:42:14.436 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T01:42:14.436 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T01:42:14.436 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps": 72188, 2024-08-20T01:42:14.436 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps_dirty": 28894, 2024-08-20T01:42:14.437 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_cap_release": 2847, 2024-08-20T01:42:14.437 INFO:teuthology.orchestra.run.smithi134.stdout: "process_request_cap_release": 71106 2024-08-20T01:42:14.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.437 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache": { 2024-08-20T01:42:14.437 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update": 2384, 2024-08-20T01:42:14.437 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update_receipt": 7309, 2024-08-20T01:42:14.437 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_try_discover": 4145, 2024-08-20T01:42:14.437 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_send_discover": 5539, 2024-08-20T01:42:14.437 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_handle_discover": 5787, 2024-08-20T01:42:14.437 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays": 0, 2024-08-20T01:42:14.437 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_delayed": 0, 2024-08-20T01:42:14.437 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_enqueuing": 0, 2024-08-20T01:42:14.437 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_created": 30381, 2024-08-20T01:42:14.437 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_enqueued": 30381, 2024-08-20T01:42:14.438 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_reintegrated": 0, 2024-08-20T01:42:14.438 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_migrated": 0, 2024-08-20T01:42:14.438 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_processing": 0, 2024-08-20T01:42:14.438 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_enqueued": 0, 2024-08-20T01:42:14.438 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_prioritized": 0, 2024-08-20T01:42:14.438 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_started": 0, 2024-08-20T01:42:14.438 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_completed": 0, 2024-08-20T01:42:14.438 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_path": 0, 2024-08-20T01:42:14.438 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_inode": 0, 2024-08-20T01:42:14.438 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T01:42:14.438 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_exportdir": 267, 2024-08-20T01:42:14.438 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_flush": 0, 2024-08-20T01:42:14.439 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragmentdir": 111, 2024-08-20T01:42:14.439 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragstats": 0, 2024-08-20T01:42:14.439 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_inodestats": 0 2024-08-20T01:42:14.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.439 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log": { 2024-08-20T01:42:14.439 INFO:teuthology.orchestra.run.smithi134.stdout: "evlrg": 7, 2024-08-20T01:42:14.439 INFO:teuthology.orchestra.run.smithi134.stdout: "evadd": 175629, 2024-08-20T01:42:14.439 INFO:teuthology.orchestra.run.smithi134.stdout: "evex": 76797, 2024-08-20T01:42:14.439 INFO:teuthology.orchestra.run.smithi134.stdout: "evtrm": 73741, 2024-08-20T01:42:14.439 INFO:teuthology.orchestra.run.smithi134.stdout: "ev": 101888, 2024-08-20T01:42:14.439 INFO:teuthology.orchestra.run.smithi134.stdout: "evexg": 0, 2024-08-20T01:42:14.439 INFO:teuthology.orchestra.run.smithi134.stdout: "evexd": 3056, 2024-08-20T01:42:14.439 INFO:teuthology.orchestra.run.smithi134.stdout: "segadd": 227, 2024-08-20T01:42:14.439 INFO:teuthology.orchestra.run.smithi134.stdout: "segex": 99, 2024-08-20T01:42:14.440 INFO:teuthology.orchestra.run.smithi134.stdout: "segtrm": 95, 2024-08-20T01:42:14.440 INFO:teuthology.orchestra.run.smithi134.stdout: "seg": 132, 2024-08-20T01:42:14.440 INFO:teuthology.orchestra.run.smithi134.stdout: "segmjr": 9, 2024-08-20T01:42:14.440 INFO:teuthology.orchestra.run.smithi134.stdout: "segexg": 0, 2024-08-20T01:42:14.440 INFO:teuthology.orchestra.run.smithi134.stdout: "segexd": 4, 2024-08-20T01:42:14.440 INFO:teuthology.orchestra.run.smithi134.stdout: "expos": 156663083, 2024-08-20T01:42:14.440 INFO:teuthology.orchestra.run.smithi134.stdout: "wrpos": 393035303, 2024-08-20T01:42:14.440 INFO:teuthology.orchestra.run.smithi134.stdout: "rdpos": 0, 2024-08-20T01:42:14.440 INFO:teuthology.orchestra.run.smithi134.stdout: "jlat": { 2024-08-20T01:42:14.440 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 6942, 2024-08-20T01:42:14.440 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 350.543644418, 2024-08-20T01:42:14.440 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.050496059 2024-08-20T01:42:14.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.441 INFO:teuthology.orchestra.run.smithi134.stdout: "replayed": 0 2024-08-20T01:42:14.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.441 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mem": { 2024-08-20T01:42:14.441 INFO:teuthology.orchestra.run.smithi134.stdout: "ino": 39, 2024-08-20T01:42:14.441 INFO:teuthology.orchestra.run.smithi134.stdout: "ino+": 83674, 2024-08-20T01:42:14.441 INFO:teuthology.orchestra.run.smithi134.stdout: "ino-": 83635, 2024-08-20T01:42:14.441 INFO:teuthology.orchestra.run.smithi134.stdout: "dir": 38, 2024-08-20T01:42:14.441 INFO:teuthology.orchestra.run.smithi134.stdout: "dir+": 6254, 2024-08-20T01:42:14.441 INFO:teuthology.orchestra.run.smithi134.stdout: "dir-": 6216, 2024-08-20T01:42:14.441 INFO:teuthology.orchestra.run.smithi134.stdout: "dn": 341, 2024-08-20T01:42:14.441 INFO:teuthology.orchestra.run.smithi134.stdout: "dn+": 161848, 2024-08-20T01:42:14.441 INFO:teuthology.orchestra.run.smithi134.stdout: "dn-": 161507, 2024-08-20T01:42:14.441 INFO:teuthology.orchestra.run.smithi134.stdout: "cap": 0, 2024-08-20T01:42:14.441 INFO:teuthology.orchestra.run.smithi134.stdout: "cap+": 82662, 2024-08-20T01:42:14.442 INFO:teuthology.orchestra.run.smithi134.stdout: "cap-": 82662, 2024-08-20T01:42:14.442 INFO:teuthology.orchestra.run.smithi134.stdout: "rss": 142232, 2024-08-20T01:42:14.442 INFO:teuthology.orchestra.run.smithi134.stdout: "heap": 592965632 2024-08-20T01:42:14.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.442 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_server": { 2024-08-20T01:42:14.442 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_client_request": 185059, 2024-08-20T01:42:14.442 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_server_request": 14050, 2024-08-20T01:42:14.442 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_request": 149387, 2024-08-20T01:42:14.442 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_session": 529, 2024-08-20T01:42:14.442 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_peer_request": 27782, 2024-08-20T01:42:14.442 INFO:teuthology.orchestra.run.smithi134.stdout: "req_create_latency": { 2024-08-20T01:42:14.442 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 26219, 2024-08-20T01:42:14.442 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 186.512640126, 2024-08-20T01:42:14.443 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.007113644 2024-08-20T01:42:14.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.443 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getattr_latency": { 2024-08-20T01:42:14.443 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 267, 2024-08-20T01:42:14.443 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 78.377878750, 2024-08-20T01:42:14.443 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.293550107 2024-08-20T01:42:14.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.443 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getfilelock_latency": { 2024-08-20T01:42:14.443 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.443 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.443 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.443 INFO:teuthology.orchestra.run.smithi134.stdout: "req_link_latency": { 2024-08-20T01:42:14.444 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.444 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.444 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.444 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookup_latency": { 2024-08-20T01:42:14.444 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 58951, 2024-08-20T01:42:14.444 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 2140.635887132, 2024-08-20T01:42:14.444 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.036312121 2024-08-20T01:42:14.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.444 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookuphash_latency": { 2024-08-20T01:42:14.444 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.444 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.444 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.445 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupino_latency": { 2024-08-20T01:42:14.445 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.445 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.445 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.445 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupname_latency": { 2024-08-20T01:42:14.445 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.445 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.445 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.445 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupparent_latency": { 2024-08-20T01:42:14.445 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.445 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.446 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.446 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupsnap_latency": { 2024-08-20T01:42:14.446 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.446 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.447 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.447 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lssnap_latency": { 2024-08-20T01:42:14.447 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.447 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.447 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.447 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mkdir_latency": { 2024-08-20T01:42:14.447 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 104, 2024-08-20T01:42:14.447 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 4.064200403, 2024-08-20T01:42:14.447 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.039078850 2024-08-20T01:42:14.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.447 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mknod_latency": { 2024-08-20T01:42:14.448 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.448 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.448 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.448 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mksnap_latency": { 2024-08-20T01:42:14.448 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.448 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.448 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.448 INFO:teuthology.orchestra.run.smithi134.stdout: "req_open_latency": { 2024-08-20T01:42:14.448 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 8729, 2024-08-20T01:42:14.448 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 86.168490583, 2024-08-20T01:42:14.448 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.009871519 2024-08-20T01:42:14.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.449 INFO:teuthology.orchestra.run.smithi134.stdout: "req_readdir_latency": { 2024-08-20T01:42:14.449 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 922, 2024-08-20T01:42:14.449 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 2.123544469, 2024-08-20T01:42:14.449 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.002303193 2024-08-20T01:42:14.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.449 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rename_latency": { 2024-08-20T01:42:14.449 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 26172, 2024-08-20T01:42:14.449 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 544.460900296, 2024-08-20T01:42:14.449 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.020803182 2024-08-20T01:42:14.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.449 INFO:teuthology.orchestra.run.smithi134.stdout: "req_renamesnap_latency": { 2024-08-20T01:42:14.449 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.449 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.449 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.450 INFO:teuthology.orchestra.run.smithi134.stdout: "req_snapdiff_latency": { 2024-08-20T01:42:14.450 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.450 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.450 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.450 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmdir_latency": { 2024-08-20T01:42:14.450 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 127, 2024-08-20T01:42:14.450 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 20.333428741, 2024-08-20T01:42:14.450 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.160105738 2024-08-20T01:42:14.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.450 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmsnap_latency": { 2024-08-20T01:42:14.450 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.451 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.451 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.451 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmxattr_latency": { 2024-08-20T01:42:14.451 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.451 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.451 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.451 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setattr_latency": { 2024-08-20T01:42:14.451 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 2, 2024-08-20T01:42:14.451 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.018922412, 2024-08-20T01:42:14.451 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.009461206 2024-08-20T01:42:14.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.451 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setdirlayout_latency": { 2024-08-20T01:42:14.452 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.452 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.452 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.452 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setfilelock_latency": { 2024-08-20T01:42:14.452 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.452 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.452 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.452 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setlayout_latency": { 2024-08-20T01:42:14.452 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.452 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.452 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.453 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setxattr_latency": { 2024-08-20T01:42:14.453 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.453 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.453 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.453 INFO:teuthology.orchestra.run.smithi134.stdout: "req_symlink_latency": { 2024-08-20T01:42:14.453 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.453 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.453 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.453 INFO:teuthology.orchestra.run.smithi134.stdout: "req_unlink_latency": { 2024-08-20T01:42:14.453 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 22174, 2024-08-20T01:42:14.453 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 48.763645124, 2024-08-20T01:42:14.454 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.002199136 2024-08-20T01:42:14.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.454 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_revoke_eviction": 0, 2024-08-20T01:42:14.454 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_acquisition_throttle": 0, 2024-08-20T01:42:14.454 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getvxattr_latency": { 2024-08-20T01:42:14.454 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.454 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.454 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.454 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:14.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.454 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessions": { 2024-08-20T01:42:14.454 INFO:teuthology.orchestra.run.smithi134.stdout: "session_count": 1, 2024-08-20T01:42:14.454 INFO:teuthology.orchestra.run.smithi134.stdout: "session_add": 1, 2024-08-20T01:42:14.455 INFO:teuthology.orchestra.run.smithi134.stdout: "session_remove": 0, 2024-08-20T01:42:14.455 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_open": 1, 2024-08-20T01:42:14.455 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_stale": 0, 2024-08-20T01:42:14.455 INFO:teuthology.orchestra.run.smithi134.stdout: "total_load": 11668, 2024-08-20T01:42:14.455 INFO:teuthology.orchestra.run.smithi134.stdout: "average_load": 11668, 2024-08-20T01:42:14.455 INFO:teuthology.orchestra.run.smithi134.stdout: "avg_session_uptime": 682, 2024-08-20T01:42:14.455 INFO:teuthology.orchestra.run.smithi134.stdout: "mdthresh_evicted": 0 2024-08-20T01:42:14.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.455 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-08-20T01:42:14.455 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:42:14.455 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-08-20T01:42:14.455 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:42:14.455 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:42:14.456 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:42:14.456 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:42:14.456 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:42:14.456 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:42:14.456 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:42:14.456 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:42:14.456 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:42:14.456 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:42:14.456 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:42:14.456 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:42:14.456 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:42:14.456 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-08-20T01:42:14.456 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:42:14.456 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-08-20T01:42:14.457 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:42:14.457 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:42:14.457 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:42:14.457 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:42:14.457 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:42:14.457 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:42:14.457 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:42:14.457 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-08-20T01:42:14.457 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:42:14.457 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:42:14.457 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:42:14.457 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-08-20T01:42:14.457 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-08-20T01:42:14.458 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-08-20T01:42:14.458 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:42:14.458 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:42:14.458 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:42:14.458 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:42:14.458 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 303023, 2024-08-20T01:42:14.458 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 121, 2024-08-20T01:42:14.458 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 88, 2024-08-20T01:42:14.458 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 1, 2024-08-20T01:42:14.458 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-08-20T01:42:14.458 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-08-20T01:42:14.458 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:42:14.458 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-08-20T01:42:14.459 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:42:14.459 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-08-20T01:42:14.459 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 7784, 2024-08-20T01:42:14.459 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 160, 2024-08-20T01:42:14.459 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:42:14.459 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:42:14.459 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-08-20T01:42:14.459 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-08-20T01:42:14.459 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 385861, 2024-08-20T01:42:14.459 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 4041, 2024-08-20T01:42:14.459 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-08-20T01:42:14.459 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-08-20T01:42:14.459 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-08-20T01:42:14.459 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-08-20T01:42:14.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.460 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter": { 2024-08-20T01:42:14.460 INFO:teuthology.orchestra.run.smithi134.stdout: "op_active": 0, 2024-08-20T01:42:14.460 INFO:teuthology.orchestra.run.smithi134.stdout: "op_laggy": 0, 2024-08-20T01:42:14.460 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send": 205442, 2024-08-20T01:42:14.460 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send_bytes": 421124365, 2024-08-20T01:42:14.460 INFO:teuthology.orchestra.run.smithi134.stdout: "op_resend": 28, 2024-08-20T01:42:14.460 INFO:teuthology.orchestra.run.smithi134.stdout: "op_reply": 205442, 2024-08-20T01:42:14.460 INFO:teuthology.orchestra.run.smithi134.stdout: "op_latency": { 2024-08-20T01:42:14.460 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 205442, 2024-08-20T01:42:14.460 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 1553.301958754, 2024-08-20T01:42:14.460 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.007560780 2024-08-20T01:42:14.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.460 INFO:teuthology.orchestra.run.smithi134.stdout: "op_inflight": 0, 2024-08-20T01:42:14.461 INFO:teuthology.orchestra.run.smithi134.stdout: "oplen_avg": { 2024-08-20T01:42:14.461 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 205442, 2024-08-20T01:42:14.461 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 216668 2024-08-20T01:42:14.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.461 INFO:teuthology.orchestra.run.smithi134.stdout: "op": 205442, 2024-08-20T01:42:14.461 INFO:teuthology.orchestra.run.smithi134.stdout: "op_r": 159514, 2024-08-20T01:42:14.461 INFO:teuthology.orchestra.run.smithi134.stdout: "op_w": 45928, 2024-08-20T01:42:14.461 INFO:teuthology.orchestra.run.smithi134.stdout: "op_rmw": 0, 2024-08-20T01:42:14.461 INFO:teuthology.orchestra.run.smithi134.stdout: "op_pg": 0, 2024-08-20T01:42:14.461 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_stat": 216, 2024-08-20T01:42:14.461 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_create": 4201, 2024-08-20T01:42:14.461 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_read": 1141, 2024-08-20T01:42:14.461 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_write": 8084, 2024-08-20T01:42:14.462 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writefull": 553, 2024-08-20T01:42:14.462 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writesame": 0, 2024-08-20T01:42:14.462 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_append": 0, 2024-08-20T01:42:14.462 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_zero": 0, 2024-08-20T01:42:14.462 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_truncate": 107, 2024-08-20T01:42:14.462 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_delete": 31361, 2024-08-20T01:42:14.462 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_mapext": 0, 2024-08-20T01:42:14.462 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_sparse_read": 0, 2024-08-20T01:42:14.462 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_clonerange": 0, 2024-08-20T01:42:14.462 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_getxattr": 157499, 2024-08-20T01:42:14.462 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_setxattr": 8402, 2024-08-20T01:42:14.462 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_cmpxattr": 0, 2024-08-20T01:42:14.462 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_rmxattr": 0, 2024-08-20T01:42:14.463 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_resetxattrs": 0, 2024-08-20T01:42:14.463 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_call": 0, 2024-08-20T01:42:14.463 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_watch": 0, 2024-08-20T01:42:14.463 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_notify": 0, 2024-08-20T01:42:14.463 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T01:42:14.463 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls": 0, 2024-08-20T01:42:14.463 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls_filter": 0, 2024-08-20T01:42:14.463 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_other": 2, 2024-08-20T01:42:14.463 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_active": 0, 2024-08-20T01:42:14.463 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_send": 0, 2024-08-20T01:42:14.463 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_resend": 0, 2024-08-20T01:42:14.463 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_ping": 0, 2024-08-20T01:42:14.463 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_active": 0, 2024-08-20T01:42:14.464 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_send": 0, 2024-08-20T01:42:14.464 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_resend": 0, 2024-08-20T01:42:14.464 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_active": 0, 2024-08-20T01:42:14.464 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_send": 0, 2024-08-20T01:42:14.464 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_resend": 0, 2024-08-20T01:42:14.464 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_active": 0, 2024-08-20T01:42:14.464 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_send": 0, 2024-08-20T01:42:14.464 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_resend": 0, 2024-08-20T01:42:14.464 INFO:teuthology.orchestra.run.smithi134.stdout: "command_active": 0, 2024-08-20T01:42:14.464 INFO:teuthology.orchestra.run.smithi134.stdout: "command_send": 0, 2024-08-20T01:42:14.464 INFO:teuthology.orchestra.run.smithi134.stdout: "command_resend": 0, 2024-08-20T01:42:14.464 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 81, 2024-08-20T01:42:14.464 INFO:teuthology.orchestra.run.smithi134.stdout: "map_full": 0, 2024-08-20T01:42:14.464 INFO:teuthology.orchestra.run.smithi134.stdout: "map_inc": 6, 2024-08-20T01:42:14.465 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_sessions": 12, 2024-08-20T01:42:14.465 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_open": 12, 2024-08-20T01:42:14.465 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_close": 0, 2024-08-20T01:42:14.465 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_laggy": 0, 2024-08-20T01:42:14.465 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_wr": 3203, 2024-08-20T01:42:14.465 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_rd": 1202, 2024-08-20T01:42:14.465 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_del": 697 2024-08-20T01:42:14.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.465 INFO:teuthology.orchestra.run.smithi134.stdout: "oft": { 2024-08-20T01:42:14.465 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_objs": 1, 2024-08-20T01:42:14.465 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_kv_pairs": 0, 2024-08-20T01:42:14.465 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_updates": 0, 2024-08-20T01:42:14.465 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_removes": 0 2024-08-20T01:42:14.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.466 INFO:teuthology.orchestra.run.smithi134.stdout: "purge_queue": { 2024-08-20T01:42:14.466 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops": 0, 2024-08-20T01:42:14.466 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops_high_water": 18, 2024-08-20T01:42:14.466 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing": 0, 2024-08-20T01:42:14.466 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_high_water": 10, 2024-08-20T01:42:14.466 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed_ops": 31189, 2024-08-20T01:42:14.466 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed": 30381, 2024-08-20T01:42:14.466 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_item_in_journal": 0 2024-08-20T01:42:14.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.466 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:42:14.466 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-08-20T01:42:14.466 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-08-20T01:42:14.467 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-08-20T01:42:14.467 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 654152, 2024-08-20T01:42:14.467 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 236355630, 2024-08-20T01:42:14.467 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:14.467 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 654152, 2024-08-20T01:42:14.467 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-08-20T01:42:14.467 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-08-20T01:42:14.467 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 654152, 2024-08-20T01:42:14.467 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 236355630, 2024-08-20T01:42:14.467 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-08-20T01:42:14.467 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.467 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.467 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:14.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.468 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_bytes": { 2024-08-20T01:42:14.468 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-08-20T01:42:14.468 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-08-20T01:42:14.468 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-08-20T01:42:14.468 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-08-20T01:42:14.468 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-08-20T01:42:14.468 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:14.468 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-08-20T01:42:14.468 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 205442, 2024-08-20T01:42:14.468 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 424168835, 2024-08-20T01:42:14.468 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 205442, 2024-08-20T01:42:14.468 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 424168835, 2024-08-20T01:42:14.468 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-08-20T01:42:14.468 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.469 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.469 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.469 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:14.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.469 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_ops": { 2024-08-20T01:42:14.469 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-08-20T01:42:14.469 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 1024, 2024-08-20T01:42:14.469 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-08-20T01:42:14.469 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-08-20T01:42:14.469 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-08-20T01:42:14.469 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:14.469 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-08-20T01:42:14.469 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 205442, 2024-08-20T01:42:14.470 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 205442, 2024-08-20T01:42:14.470 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 205442, 2024-08-20T01:42:14.470 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 205442, 2024-08-20T01:42:14.470 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-08-20T01:42:14.470 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.470 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.470 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.470 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:14.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.470 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle": { 2024-08-20T01:42:14.470 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-08-20T01:42:14.470 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-08-20T01:42:14.470 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-08-20T01:42:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 30381, 2024-08-20T01:42:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 3069289, 2024-08-20T01:42:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 30381, 2024-08-20T01:42:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-08-20T01:42:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-08-20T01:42:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 1141, 2024-08-20T01:42:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 3069289, 2024-08-20T01:42:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-08-20T01:42:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle-0x558aaf2166e0": { 2024-08-20T01:42:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-08-20T01:42:14.472 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-08-20T01:42:14.472 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-08-20T01:42:14.472 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 175629, 2024-08-20T01:42:14.472 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 388840999, 2024-08-20T01:42:14.472 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:14.472 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 175629, 2024-08-20T01:42:14.472 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-08-20T01:42:14.472 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-08-20T01:42:14.472 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 6942, 2024-08-20T01:42:14.472 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 388840999, 2024-08-20T01:42:14.472 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-08-20T01:42:14.472 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:14.472 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:14.472 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:14.472 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:14.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:14.473 INFO:teuthology.orchestra.run.smithi134.stdout: "trackedop": { 2024-08-20T01:42:14.473 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_ops_count": 0 2024-08-20T01:42:14.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:14.473 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-08-20T01:42:15.237 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:15 smithi134 ceph-mon[22511]: pgmap v681: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-20T01:42:15.269 INFO:tasks.check_counter:Daemon mds.c mds.exported=267 2024-08-20T01:42:15.269 INFO:tasks.check_counter:Daemon mds.c mds.imported=595 2024-08-20T01:42:15.269 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=2384 2024-08-20T01:42:15.269 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=7309 2024-08-20T01:42:15.270 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=107 2024-08-20T01:42:15.270 DEBUG:tasks.check_counter:Getting stats from f 2024-08-20T01:42:15.270 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph daemon mds.f perf dump 2024-08-20T01:42:15.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:15 smithi077 ceph-mon[22251]: pgmap v681: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-20T01:42:15.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:15 smithi022 ceph-mon[18709]: pgmap v681: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-20T01:42:15.567 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:42:16.089 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-08-20T01:42:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:42:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 125, 2024-08-20T01:42:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 125, 2024-08-20T01:42:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 16817725, 2024-08-20T01:42:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 38936, 2024-08-20T01:42:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 7, 2024-08-20T01:42:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 3, 2024-08-20T01:42:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.023668944, 2024-08-20T01:42:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.005128488, 2024-08-20T01:42:16.089 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.013915994, 2024-08-20T01:42:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.002939267, 2024-08-20T01:42:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 124, 2024-08-20T01:42:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.013772219, 2024-08-20T01:42:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000111066 2024-08-20T01:42:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-20T01:42:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 448 2024-08-20T01:42:16.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:42:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 118, 2024-08-20T01:42:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 117, 2024-08-20T01:42:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 12828693, 2024-08-20T01:42:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 40885, 2024-08-20T01:42:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 4, 2024-08-20T01:42:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 3, 2024-08-20T01:42:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.017728022, 2024-08-20T01:42:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.004668235, 2024-08-20T01:42:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.012056997, 2024-08-20T01:42:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.001824077, 2024-08-20T01:42:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:16.091 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 116, 2024-08-20T01:42:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.006463533, 2024-08-20T01:42:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000055720 2024-08-20T01:42:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 173040, 2024-08-20T01:42:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 12208 2024-08-20T01:42:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:42:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 44, 2024-08-20T01:42:16.092 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 58, 2024-08-20T01:42:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 12597389, 2024-08-20T01:42:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 123332, 2024-08-20T01:42:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 5, 2024-08-20T01:42:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 4, 2024-08-20T01:42:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.010563521, 2024-08-20T01:42:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.002005459, 2024-08-20T01:42:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.007371926, 2024-08-20T01:42:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000803769, 2024-08-20T01:42:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 56, 2024-08-20T01:42:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.004527261, 2024-08-20T01:42:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000080843 2024-08-20T01:42:16.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-20T01:42:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 109648 2024-08-20T01:42:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-08-20T01:42:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 1, 2024-08-20T01:42:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-08-20T01:42:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-MDSRank": { 2024-08-20T01:42:16.094 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-08-20T01:42:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-08-20T01:42:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 388, 2024-08-20T01:42:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.027639707, 2024-08-20T01:42:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000071236 2024-08-20T01:42:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-PurgeQueue": { 2024-08-20T01:42:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-08-20T01:42:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-08-20T01:42:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:16.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-08-20T01:42:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "request": 0, 2024-08-20T01:42:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "reply": 0, 2024-08-20T01:42:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "reply_latency": { 2024-08-20T01:42:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_reply": 0, 2024-08-20T01:42:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "forward": 0, 2024-08-20T01:42:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_complete": 0, 2024-08-20T01:42:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_keys": 0, 2024-08-20T01:42:16.096 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_commit": 0, 2024-08-20T01:42:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_split": 0, 2024-08-20T01:42:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_merge": 0, 2024-08-20T01:42:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes": 9894, 2024-08-20T01:42:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_top": 6137, 2024-08-20T01:42:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_bottom": 3757, 2024-08-20T01:42:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pin_tail": 0, 2024-08-20T01:42:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pinned": 1126, 2024-08-20T01:42:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_expired": 0, 2024-08-20T01:42:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_with_caps": 0, 2024-08-20T01:42:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": 0, 2024-08-20T01:42:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "subtrees": 2, 2024-08-20T01:42:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse": 0, 2024-08-20T01:42:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_hit": 0, 2024-08-20T01:42:16.097 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_forward": 0, 2024-08-20T01:42:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_discover": 0, 2024-08-20T01:42:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_dir_fetch": 0, 2024-08-20T01:42:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_remote_ino": 0, 2024-08-20T01:42:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_lock": 0, 2024-08-20T01:42:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "load_cent": 0, 2024-08-20T01:42:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "q": 0, 2024-08-20T01:42:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "exported": 0, 2024-08-20T01:42:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "exported_inodes": 0, 2024-08-20T01:42:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "imported": 0, 2024-08-20T01:42:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "imported_inodes": 0, 2024-08-20T01:42:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_dir_fetch": 0, 2024-08-20T01:42:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_backtrace_fetch": 0, 2024-08-20T01:42:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_peer_discover": 0, 2024-08-20T01:42:16.098 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rfiles": 4, 2024-08-20T01:42:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rbytes": 234, 2024-08-20T01:42:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rsnaps": 0, 2024-08-20T01:42:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_fetch": 0, 2024-08-20T01:42:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_set_tag": 0, 2024-08-20T01:42:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T01:42:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_inotable_repaired": 0, 2024-08-20T01:42:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_inodes": 0, 2024-08-20T01:42:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T01:42:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dirfrag_rstats": 0, 2024-08-20T01:42:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_file_inodes": 0, 2024-08-20T01:42:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_inode_file_caps": 0, 2024-08-20T01:42:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_revoke": 0, 2024-08-20T01:42:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_grant": 0, 2024-08-20T01:42:16.099 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T01:42:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T01:42:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T01:42:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps": 0, 2024-08-20T01:42:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps_dirty": 0, 2024-08-20T01:42:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_cap_release": 0, 2024-08-20T01:42:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "process_request_cap_release": 0 2024-08-20T01:42:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache": { 2024-08-20T01:42:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update": 0, 2024-08-20T01:42:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update_receipt": 0, 2024-08-20T01:42:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_try_discover": 0, 2024-08-20T01:42:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_send_discover": 0, 2024-08-20T01:42:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_handle_discover": 0, 2024-08-20T01:42:16.100 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays": 0, 2024-08-20T01:42:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_delayed": 0, 2024-08-20T01:42:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_enqueuing": 0, 2024-08-20T01:42:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_created": 0, 2024-08-20T01:42:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_enqueued": 0, 2024-08-20T01:42:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_reintegrated": 0, 2024-08-20T01:42:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_migrated": 0, 2024-08-20T01:42:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_processing": 0, 2024-08-20T01:42:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_enqueued": 0, 2024-08-20T01:42:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_prioritized": 0, 2024-08-20T01:42:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_started": 0, 2024-08-20T01:42:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_completed": 0, 2024-08-20T01:42:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_path": 0, 2024-08-20T01:42:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_inode": 0, 2024-08-20T01:42:16.101 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T01:42:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_exportdir": 0, 2024-08-20T01:42:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_flush": 0, 2024-08-20T01:42:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragmentdir": 0, 2024-08-20T01:42:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragstats": 0, 2024-08-20T01:42:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_inodestats": 0 2024-08-20T01:42:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log": { 2024-08-20T01:42:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "evlrg": 0, 2024-08-20T01:42:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "evadd": 0, 2024-08-20T01:42:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "evex": 0, 2024-08-20T01:42:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "evtrm": 0, 2024-08-20T01:42:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "ev": 22359, 2024-08-20T01:42:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "evexg": 0, 2024-08-20T01:42:16.102 INFO:teuthology.orchestra.run.smithi134.stdout: "evexd": 0, 2024-08-20T01:42:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "segadd": 0, 2024-08-20T01:42:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "segex": 0, 2024-08-20T01:42:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "segtrm": 0, 2024-08-20T01:42:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "seg": 3, 2024-08-20T01:42:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "segmjr": 3, 2024-08-20T01:42:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "segexg": 0, 2024-08-20T01:42:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "segexd": 0, 2024-08-20T01:42:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "expos": 593517921, 2024-08-20T01:42:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "wrpos": 596954535, 2024-08-20T01:42:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "rdpos": 596951113, 2024-08-20T01:42:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "jlat": { 2024-08-20T01:42:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.103 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "replayed": 22359 2024-08-20T01:42:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mem": { 2024-08-20T01:42:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "ino": 20, 2024-08-20T01:42:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "ino+": 9536, 2024-08-20T01:42:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "ino-": 9516, 2024-08-20T01:42:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "dir": 19, 2024-08-20T01:42:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "dir+": 451, 2024-08-20T01:42:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "dir-": 432, 2024-08-20T01:42:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "dn": 9894, 2024-08-20T01:42:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "dn+": 19763, 2024-08-20T01:42:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "dn-": 9869, 2024-08-20T01:42:16.104 INFO:teuthology.orchestra.run.smithi134.stdout: "cap": 0, 2024-08-20T01:42:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "cap+": 0, 2024-08-20T01:42:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "cap-": 0, 2024-08-20T01:42:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "rss": 58872, 2024-08-20T01:42:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "heap": 265580544 2024-08-20T01:42:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_server": { 2024-08-20T01:42:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_client_request": 0, 2024-08-20T01:42:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_server_request": 0, 2024-08-20T01:42:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_request": 0, 2024-08-20T01:42:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_session": 0, 2024-08-20T01:42:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_peer_request": 0, 2024-08-20T01:42:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "req_create_latency": { 2024-08-20T01:42:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getattr_latency": { 2024-08-20T01:42:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getfilelock_latency": { 2024-08-20T01:42:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.106 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "req_link_latency": { 2024-08-20T01:42:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookup_latency": { 2024-08-20T01:42:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookuphash_latency": { 2024-08-20T01:42:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.107 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupino_latency": { 2024-08-20T01:42:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupname_latency": { 2024-08-20T01:42:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupparent_latency": { 2024-08-20T01:42:16.108 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupsnap_latency": { 2024-08-20T01:42:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lssnap_latency": { 2024-08-20T01:42:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.109 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mkdir_latency": { 2024-08-20T01:42:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mknod_latency": { 2024-08-20T01:42:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mksnap_latency": { 2024-08-20T01:42:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "req_open_latency": { 2024-08-20T01:42:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "req_readdir_latency": { 2024-08-20T01:42:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rename_latency": { 2024-08-20T01:42:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.111 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: "req_renamesnap_latency": { 2024-08-20T01:42:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: "req_snapdiff_latency": { 2024-08-20T01:42:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmdir_latency": { 2024-08-20T01:42:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.112 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmsnap_latency": { 2024-08-20T01:42:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmxattr_latency": { 2024-08-20T01:42:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setattr_latency": { 2024-08-20T01:42:16.113 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setdirlayout_latency": { 2024-08-20T01:42:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setfilelock_latency": { 2024-08-20T01:42:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.114 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setlayout_latency": { 2024-08-20T01:42:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setxattr_latency": { 2024-08-20T01:42:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: "req_symlink_latency": { 2024-08-20T01:42:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "req_unlink_latency": { 2024-08-20T01:42:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_revoke_eviction": 0, 2024-08-20T01:42:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_acquisition_throttle": 0, 2024-08-20T01:42:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getvxattr_latency": { 2024-08-20T01:42:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.116 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessions": { 2024-08-20T01:42:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "session_count": 1, 2024-08-20T01:42:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "session_add": 1, 2024-08-20T01:42:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "session_remove": 0, 2024-08-20T01:42:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_open": 0, 2024-08-20T01:42:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_stale": 0, 2024-08-20T01:42:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "total_load": 0, 2024-08-20T01:42:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "average_load": 0, 2024-08-20T01:42:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "avg_session_uptime": 1680, 2024-08-20T01:42:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "mdthresh_evicted": 0 2024-08-20T01:42:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-08-20T01:42:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:42:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-08-20T01:42:16.117 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:42:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:42:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:42:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:42:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:42:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:42:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:42:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:42:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:42:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:42:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:42:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:42:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:42:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-08-20T01:42:16.118 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:42:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-08-20T01:42:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:42:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:42:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:42:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:42:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:42:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:42:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:42:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-08-20T01:42:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:42:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:42:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:42:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-08-20T01:42:16.119 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-08-20T01:42:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-08-20T01:42:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:42:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:42:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:42:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:42:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 204727, 2024-08-20T01:42:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 57, 2024-08-20T01:42:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-08-20T01:42:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-08-20T01:42:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-08-20T01:42:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-08-20T01:42:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:42:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-08-20T01:42:16.120 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:42:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-08-20T01:42:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 7784, 2024-08-20T01:42:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 160, 2024-08-20T01:42:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:42:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:42:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-08-20T01:42:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-08-20T01:42:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 6795441, 2024-08-20T01:42:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 39784, 2024-08-20T01:42:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-08-20T01:42:16.121 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-08-20T01:42:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-08-20T01:42:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-08-20T01:42:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter": { 2024-08-20T01:42:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "op_active": 0, 2024-08-20T01:42:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "op_laggy": 0, 2024-08-20T01:42:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send": 254, 2024-08-20T01:42:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send_bytes": 26, 2024-08-20T01:42:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "op_resend": 4, 2024-08-20T01:42:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "op_reply": 254, 2024-08-20T01:42:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "op_latency": { 2024-08-20T01:42:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 254, 2024-08-20T01:42:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.184996172, 2024-08-20T01:42:16.122 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000728331 2024-08-20T01:42:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "op_inflight": 0, 2024-08-20T01:42:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "oplen_avg": { 2024-08-20T01:42:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 254, 2024-08-20T01:42:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 255 2024-08-20T01:42:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "op": 254, 2024-08-20T01:42:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "op_r": 254, 2024-08-20T01:42:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "op_w": 0, 2024-08-20T01:42:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "op_rmw": 0, 2024-08-20T01:42:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "op_pg": 0, 2024-08-20T01:42:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_stat": 150, 2024-08-20T01:42:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_create": 0, 2024-08-20T01:42:16.123 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_read": 101, 2024-08-20T01:42:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_write": 0, 2024-08-20T01:42:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writefull": 0, 2024-08-20T01:42:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writesame": 0, 2024-08-20T01:42:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_append": 0, 2024-08-20T01:42:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_zero": 0, 2024-08-20T01:42:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_truncate": 0, 2024-08-20T01:42:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_delete": 0, 2024-08-20T01:42:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_mapext": 0, 2024-08-20T01:42:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_sparse_read": 0, 2024-08-20T01:42:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_clonerange": 0, 2024-08-20T01:42:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_getxattr": 2, 2024-08-20T01:42:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_setxattr": 0, 2024-08-20T01:42:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_cmpxattr": 0, 2024-08-20T01:42:16.124 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_rmxattr": 0, 2024-08-20T01:42:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_resetxattrs": 0, 2024-08-20T01:42:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_call": 0, 2024-08-20T01:42:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_watch": 0, 2024-08-20T01:42:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_notify": 0, 2024-08-20T01:42:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T01:42:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls": 0, 2024-08-20T01:42:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls_filter": 0, 2024-08-20T01:42:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_other": 0, 2024-08-20T01:42:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_active": 0, 2024-08-20T01:42:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_send": 0, 2024-08-20T01:42:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_resend": 0, 2024-08-20T01:42:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_ping": 0, 2024-08-20T01:42:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_active": 0, 2024-08-20T01:42:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_send": 0, 2024-08-20T01:42:16.125 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_resend": 0, 2024-08-20T01:42:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_active": 0, 2024-08-20T01:42:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_send": 0, 2024-08-20T01:42:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_resend": 0, 2024-08-20T01:42:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_active": 0, 2024-08-20T01:42:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_send": 0, 2024-08-20T01:42:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_resend": 0, 2024-08-20T01:42:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "command_active": 0, 2024-08-20T01:42:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "command_send": 0, 2024-08-20T01:42:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "command_resend": 0, 2024-08-20T01:42:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 0, 2024-08-20T01:42:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "map_full": 0, 2024-08-20T01:42:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "map_inc": 0, 2024-08-20T01:42:16.126 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_sessions": 7, 2024-08-20T01:42:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_open": 7, 2024-08-20T01:42:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_close": 0, 2024-08-20T01:42:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_laggy": 0, 2024-08-20T01:42:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_wr": 0, 2024-08-20T01:42:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_rd": 2, 2024-08-20T01:42:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_del": 0 2024-08-20T01:42:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "oft": { 2024-08-20T01:42:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_objs": 0, 2024-08-20T01:42:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_kv_pairs": 0, 2024-08-20T01:42:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_updates": 0, 2024-08-20T01:42:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_removes": 0 2024-08-20T01:42:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.127 INFO:teuthology.orchestra.run.smithi134.stdout: "purge_queue": { 2024-08-20T01:42:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops": 0, 2024-08-20T01:42:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops_high_water": 0, 2024-08-20T01:42:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing": 0, 2024-08-20T01:42:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_high_water": 0, 2024-08-20T01:42:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed_ops": 0, 2024-08-20T01:42:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed": 0, 2024-08-20T01:42:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_item_in_journal": 0 2024-08-20T01:42:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:42:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-08-20T01:42:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-08-20T01:42:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-08-20T01:42:16.128 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 283, 2024-08-20T01:42:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 42213926, 2024-08-20T01:42:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 283, 2024-08-20T01:42:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-08-20T01:42:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-08-20T01:42:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 283, 2024-08-20T01:42:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 42213926, 2024-08-20T01:42:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-08-20T01:42:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:16.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.130 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_bytes": { 2024-08-20T01:42:16.130 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-08-20T01:42:16.130 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-08-20T01:42:16.130 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-08-20T01:42:16.130 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-08-20T01:42:16.130 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-08-20T01:42:16.130 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:16.130 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-08-20T01:42:16.130 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 254, 2024-08-20T01:42:16.130 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 41992461, 2024-08-20T01:42:16.130 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 254, 2024-08-20T01:42:16.130 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 41992461, 2024-08-20T01:42:16.130 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-08-20T01:42:16.130 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.131 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.131 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.131 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:16.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.131 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_ops": { 2024-08-20T01:42:16.131 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-08-20T01:42:16.131 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 1024, 2024-08-20T01:42:16.131 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-08-20T01:42:16.131 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-08-20T01:42:16.131 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-08-20T01:42:16.131 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:16.131 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-08-20T01:42:16.131 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 254, 2024-08-20T01:42:16.131 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 254, 2024-08-20T01:42:16.132 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 254, 2024-08-20T01:42:16.132 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 254, 2024-08-20T01:42:16.132 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-08-20T01:42:16.132 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.132 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.132 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.132 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:16.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.132 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle": { 2024-08-20T01:42:16.132 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-08-20T01:42:16.132 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-08-20T01:42:16.132 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-08-20T01:42:16.132 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-08-20T01:42:16.132 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-08-20T01:42:16.133 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:16.133 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-08-20T01:42:16.133 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-08-20T01:42:16.133 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-08-20T01:42:16.133 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 0, 2024-08-20T01:42:16.133 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 0, 2024-08-20T01:42:16.133 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-08-20T01:42:16.133 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.133 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.133 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.133 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:16.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.133 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle-0x562a9a3f23c0": { 2024-08-20T01:42:16.133 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-08-20T01:42:16.134 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-08-20T01:42:16.134 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-08-20T01:42:16.134 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-08-20T01:42:16.134 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-08-20T01:42:16.134 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:16.134 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-08-20T01:42:16.134 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-08-20T01:42:16.134 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-08-20T01:42:16.134 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 0, 2024-08-20T01:42:16.134 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 0, 2024-08-20T01:42:16.134 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-08-20T01:42:16.134 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:16.134 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:16.134 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:16.135 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:16.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:16.135 INFO:teuthology.orchestra.run.smithi134.stdout: "trackedop": { 2024-08-20T01:42:16.135 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_ops_count": 0 2024-08-20T01:42:16.135 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:16.135 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-08-20T01:42:16.833 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-08-20T01:42:16.834 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-08-20T01:42:16.834 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-08-20T01:42:16.834 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-08-20T01:42:16.834 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-08-20T01:42:16.834 DEBUG:tasks.check_counter:Getting stats from i 2024-08-20T01:42:16.834 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph daemon mds.i perf dump 2024-08-20T01:42:17.086 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:42:17.203 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:17 smithi134 ceph-mon[22511]: pgmap v682: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 6 op/s 2024-08-20T01:42:17.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:17 smithi077 ceph-mon[22251]: pgmap v682: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 6 op/s 2024-08-20T01:42:17.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:17 smithi022 ceph-mon[18709]: pgmap v682: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 6 op/s 2024-08-20T01:42:17.582 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-08-20T01:42:17.582 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:42:17.583 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 219327, 2024-08-20T01:42:17.583 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 193037, 2024-08-20T01:42:17.583 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 141318624, 2024-08-20T01:42:17.583 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 292790365, 2024-08-20T01:42:17.583 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 10, 2024-08-20T01:42:17.583 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 5, 2024-08-20T01:42:17.583 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 17.268611698, 2024-08-20T01:42:17.583 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 9.180809709, 2024-08-20T01:42:17.583 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 5.702753323, 2024-08-20T01:42:17.583 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 3.084874319, 2024-08-20T01:42:17.583 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:17.583 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 193036, 2024-08-20T01:42:17.584 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 58.064597113, 2024-08-20T01:42:17.584 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000300796 2024-08-20T01:42:17.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.584 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:17.584 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 198509, 2024-08-20T01:42:17.584 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.028995512, 2024-08-20T01:42:17.584 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000146 2024-08-20T01:42:17.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.584 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 607744, 2024-08-20T01:42:17.584 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 161840 2024-08-20T01:42:17.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.584 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:42:17.584 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 126338, 2024-08-20T01:42:17.584 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 126422, 2024-08-20T01:42:17.585 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 70440825, 2024-08-20T01:42:17.585 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 367302708, 2024-08-20T01:42:17.585 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 199, 2024-08-20T01:42:17.585 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 9, 2024-08-20T01:42:17.585 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 11.913401527, 2024-08-20T01:42:17.585 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 5.365868933, 2024-08-20T01:42:17.585 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 1.843995320, 2024-08-20T01:42:17.585 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 4.105698710, 2024-08-20T01:42:17.585 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:17.585 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 126420, 2024-08-20T01:42:17.585 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 76.373854803, 2024-08-20T01:42:17.585 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000604127 2024-08-20T01:42:17.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.585 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:17.585 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 393, 2024-08-20T01:42:17.586 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000050457, 2024-08-20T01:42:17.586 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000128 2024-08-20T01:42:17.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.586 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 60512, 2024-08-20T01:42:17.586 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 411120 2024-08-20T01:42:17.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.586 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:42:17.586 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 485403, 2024-08-20T01:42:17.586 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 783677, 2024-08-20T01:42:17.586 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 202992659, 2024-08-20T01:42:17.586 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 558795645, 2024-08-20T01:42:17.586 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 12, 2024-08-20T01:42:17.586 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 6, 2024-08-20T01:42:17.587 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 33.804993629, 2024-08-20T01:42:17.587 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 19.706505535, 2024-08-20T01:42:17.587 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 166.517807929, 2024-08-20T01:42:17.587 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 3.078884716, 2024-08-20T01:42:17.587 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:17.587 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 783676, 2024-08-20T01:42:17.587 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 138.901148491, 2024-08-20T01:42:17.587 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000177243 2024-08-20T01:42:17.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.587 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:17.587 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 661295, 2024-08-20T01:42:17.587 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.177627652, 2024-08-20T01:42:17.587 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000268 2024-08-20T01:42:17.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.588 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-20T01:42:17.588 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 448 2024-08-20T01:42:17.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.588 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-08-20T01:42:17.588 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 1, 2024-08-20T01:42:17.588 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-08-20T01:42:17.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.588 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-MDSRank": { 2024-08-20T01:42:17.588 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-08-20T01:42:17.588 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-08-20T01:42:17.588 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 129609, 2024-08-20T01:42:17.588 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 225.672112301, 2024-08-20T01:42:17.589 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001741176 2024-08-20T01:42:17.589 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:17.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.589 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-PurgeQueue": { 2024-08-20T01:42:17.589 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-08-20T01:42:17.589 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-08-20T01:42:17.589 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 69026, 2024-08-20T01:42:17.589 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 19.668402691, 2024-08-20T01:42:17.589 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000284941 2024-08-20T01:42:17.589 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:17.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.589 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-08-20T01:42:17.589 INFO:teuthology.orchestra.run.smithi134.stdout: "request": 214208, 2024-08-20T01:42:17.589 INFO:teuthology.orchestra.run.smithi134.stdout: "reply": 201255, 2024-08-20T01:42:17.589 INFO:teuthology.orchestra.run.smithi134.stdout: "reply_latency": { 2024-08-20T01:42:17.590 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 201255, 2024-08-20T01:42:17.590 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 2890.713306903, 2024-08-20T01:42:17.590 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.014363435 2024-08-20T01:42:17.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.590 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_reply": 0, 2024-08-20T01:42:17.590 INFO:teuthology.orchestra.run.smithi134.stdout: "forward": 12930, 2024-08-20T01:42:17.590 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_complete": 387, 2024-08-20T01:42:17.590 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_keys": 4, 2024-08-20T01:42:17.590 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_commit": 10618, 2024-08-20T01:42:17.590 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_split": 182, 2024-08-20T01:42:17.590 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_merge": 6, 2024-08-20T01:42:17.590 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes": 424, 2024-08-20T01:42:17.590 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_top": 11, 2024-08-20T01:42:17.590 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_bottom": 402, 2024-08-20T01:42:17.591 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pin_tail": 11, 2024-08-20T01:42:17.591 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pinned": 408, 2024-08-20T01:42:17.591 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_expired": 157225, 2024-08-20T01:42:17.591 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_with_caps": 3, 2024-08-20T01:42:17.591 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": 3, 2024-08-20T01:42:17.591 INFO:teuthology.orchestra.run.smithi134.stdout: "subtrees": 3, 2024-08-20T01:42:17.591 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse": 332829, 2024-08-20T01:42:17.591 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_hit": 299206, 2024-08-20T01:42:17.591 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_forward": 12839, 2024-08-20T01:42:17.591 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_discover": 1822, 2024-08-20T01:42:17.591 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_dir_fetch": 1, 2024-08-20T01:42:17.591 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_remote_ino": 0, 2024-08-20T01:42:17.591 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_lock": 1013, 2024-08-20T01:42:17.591 INFO:teuthology.orchestra.run.smithi134.stdout: "load_cent": 199, 2024-08-20T01:42:17.591 INFO:teuthology.orchestra.run.smithi134.stdout: "q": 0, 2024-08-20T01:42:17.592 INFO:teuthology.orchestra.run.smithi134.stdout: "exported": 945, 2024-08-20T01:42:17.592 INFO:teuthology.orchestra.run.smithi134.stdout: "exported_inodes": 114246, 2024-08-20T01:42:17.592 INFO:teuthology.orchestra.run.smithi134.stdout: "imported": 201, 2024-08-20T01:42:17.592 INFO:teuthology.orchestra.run.smithi134.stdout: "imported_inodes": 116535, 2024-08-20T01:42:17.592 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_dir_fetch": 0, 2024-08-20T01:42:17.592 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_backtrace_fetch": 171080, 2024-08-20T01:42:17.592 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_peer_discover": 0, 2024-08-20T01:42:17.592 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rfiles": 4, 2024-08-20T01:42:17.592 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rbytes": 234, 2024-08-20T01:42:17.592 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rsnaps": 0, 2024-08-20T01:42:17.592 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_fetch": 171080, 2024-08-20T01:42:17.592 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_set_tag": 0, 2024-08-20T01:42:17.592 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T01:42:17.592 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_inotable_repaired": 0, 2024-08-20T01:42:17.592 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_inodes": 1501, 2024-08-20T01:42:17.593 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_base_inodes": 13, 2024-08-20T01:42:17.593 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dirfrag_rstats": 1488, 2024-08-20T01:42:17.593 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_file_inodes": 169579, 2024-08-20T01:42:17.593 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_inode_file_caps": 331, 2024-08-20T01:42:17.593 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_revoke": 36797, 2024-08-20T01:42:17.593 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_grant": 96481, 2024-08-20T01:42:17.593 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_trunc": 5, 2024-08-20T01:42:17.593 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T01:42:17.593 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T01:42:17.593 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps": 95758, 2024-08-20T01:42:17.593 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps_dirty": 41797, 2024-08-20T01:42:17.593 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_cap_release": 2310, 2024-08-20T01:42:17.593 INFO:teuthology.orchestra.run.smithi134.stdout: "process_request_cap_release": 92164 2024-08-20T01:42:17.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.594 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache": { 2024-08-20T01:42:17.594 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update": 3182, 2024-08-20T01:42:17.594 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update_receipt": 3610, 2024-08-20T01:42:17.594 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_try_discover": 2035, 2024-08-20T01:42:17.594 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_send_discover": 3669, 2024-08-20T01:42:17.594 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_handle_discover": 7477, 2024-08-20T01:42:17.594 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays": 3, 2024-08-20T01:42:17.594 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_delayed": 0, 2024-08-20T01:42:17.594 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_enqueuing": 0, 2024-08-20T01:42:17.594 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_created": 42892, 2024-08-20T01:42:17.594 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_enqueued": 42889, 2024-08-20T01:42:17.594 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_reintegrated": 0, 2024-08-20T01:42:17.594 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_migrated": 0, 2024-08-20T01:42:17.595 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_processing": 0, 2024-08-20T01:42:17.595 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_enqueued": 0, 2024-08-20T01:42:17.595 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_prioritized": 0, 2024-08-20T01:42:17.595 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_started": 0, 2024-08-20T01:42:17.595 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_completed": 0, 2024-08-20T01:42:17.595 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_path": 0, 2024-08-20T01:42:17.595 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_inode": 0, 2024-08-20T01:42:17.595 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_enqueue_scrub": 13, 2024-08-20T01:42:17.595 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_exportdir": 945, 2024-08-20T01:42:17.595 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_flush": 0, 2024-08-20T01:42:17.595 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragmentdir": 189, 2024-08-20T01:42:17.595 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragstats": 0, 2024-08-20T01:42:17.595 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_inodestats": 0 2024-08-20T01:42:17.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.595 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log": { 2024-08-20T01:42:17.596 INFO:teuthology.orchestra.run.smithi134.stdout: "evlrg": 7, 2024-08-20T01:42:17.596 INFO:teuthology.orchestra.run.smithi134.stdout: "evadd": 247220, 2024-08-20T01:42:17.596 INFO:teuthology.orchestra.run.smithi134.stdout: "evex": 245082, 2024-08-20T01:42:17.596 INFO:teuthology.orchestra.run.smithi134.stdout: "evtrm": 245082, 2024-08-20T01:42:17.596 INFO:teuthology.orchestra.run.smithi134.stdout: "ev": 2138, 2024-08-20T01:42:17.596 INFO:teuthology.orchestra.run.smithi134.stdout: "evexg": 0, 2024-08-20T01:42:17.596 INFO:teuthology.orchestra.run.smithi134.stdout: "evexd": 10156, 2024-08-20T01:42:17.596 INFO:teuthology.orchestra.run.smithi134.stdout: "segadd": 340, 2024-08-20T01:42:17.596 INFO:teuthology.orchestra.run.smithi134.stdout: "segex": 337, 2024-08-20T01:42:17.596 INFO:teuthology.orchestra.run.smithi134.stdout: "segtrm": 337, 2024-08-20T01:42:17.596 INFO:teuthology.orchestra.run.smithi134.stdout: "seg": 3, 2024-08-20T01:42:17.596 INFO:teuthology.orchestra.run.smithi134.stdout: "segmjr": 1, 2024-08-20T01:42:17.596 INFO:teuthology.orchestra.run.smithi134.stdout: "segexg": 0, 2024-08-20T01:42:17.597 INFO:teuthology.orchestra.run.smithi134.stdout: "segexd": 15, 2024-08-20T01:42:17.597 INFO:teuthology.orchestra.run.smithi134.stdout: "expos": 593517921, 2024-08-20T01:42:17.597 INFO:teuthology.orchestra.run.smithi134.stdout: "wrpos": 596954535, 2024-08-20T01:42:17.597 INFO:teuthology.orchestra.run.smithi134.stdout: "rdpos": 0, 2024-08-20T01:42:17.597 INFO:teuthology.orchestra.run.smithi134.stdout: "jlat": { 2024-08-20T01:42:17.597 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 6872, 2024-08-20T01:42:17.597 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 797.884563280, 2024-08-20T01:42:17.597 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.116106601 2024-08-20T01:42:17.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.597 INFO:teuthology.orchestra.run.smithi134.stdout: "replayed": 0 2024-08-20T01:42:17.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.597 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mem": { 2024-08-20T01:42:17.597 INFO:teuthology.orchestra.run.smithi134.stdout: "ino": 35, 2024-08-20T01:42:17.597 INFO:teuthology.orchestra.run.smithi134.stdout: "ino+": 123730, 2024-08-20T01:42:17.597 INFO:teuthology.orchestra.run.smithi134.stdout: "ino-": 123695, 2024-08-20T01:42:17.598 INFO:teuthology.orchestra.run.smithi134.stdout: "dir": 32, 2024-08-20T01:42:17.598 INFO:teuthology.orchestra.run.smithi134.stdout: "dir+": 6364, 2024-08-20T01:42:17.598 INFO:teuthology.orchestra.run.smithi134.stdout: "dir-": 6332, 2024-08-20T01:42:17.598 INFO:teuthology.orchestra.run.smithi134.stdout: "dn": 424, 2024-08-20T01:42:17.598 INFO:teuthology.orchestra.run.smithi134.stdout: "dn+": 253534, 2024-08-20T01:42:17.598 INFO:teuthology.orchestra.run.smithi134.stdout: "dn-": 253110, 2024-08-20T01:42:17.598 INFO:teuthology.orchestra.run.smithi134.stdout: "cap": 3, 2024-08-20T01:42:17.598 INFO:teuthology.orchestra.run.smithi134.stdout: "cap+": 106772, 2024-08-20T01:42:17.598 INFO:teuthology.orchestra.run.smithi134.stdout: "cap-": 106769, 2024-08-20T01:42:17.598 INFO:teuthology.orchestra.run.smithi134.stdout: "rss": 150724, 2024-08-20T01:42:17.598 INFO:teuthology.orchestra.run.smithi134.stdout: "heap": 677486592 2024-08-20T01:42:17.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.598 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_server": { 2024-08-20T01:42:17.598 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_client_request": 240444, 2024-08-20T01:42:17.598 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_server_request": 6658, 2024-08-20T01:42:17.598 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_request": 214208, 2024-08-20T01:42:17.599 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_session": 1205, 2024-08-20T01:42:17.599 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_peer_request": 13682, 2024-08-20T01:42:17.599 INFO:teuthology.orchestra.run.smithi134.stdout: "req_create_latency": { 2024-08-20T01:42:17.599 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 44750, 2024-08-20T01:42:17.599 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 267.934151906, 2024-08-20T01:42:17.599 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.005987355 2024-08-20T01:42:17.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.599 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getattr_latency": { 2024-08-20T01:42:17.599 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 9092, 2024-08-20T01:42:17.599 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 565.209345780, 2024-08-20T01:42:17.599 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.062165568 2024-08-20T01:42:17.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.599 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getfilelock_latency": { 2024-08-20T01:42:17.599 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.600 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.600 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.600 INFO:teuthology.orchestra.run.smithi134.stdout: "req_link_latency": { 2024-08-20T01:42:17.600 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.600 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.600 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.600 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookup_latency": { 2024-08-20T01:42:17.600 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 53557, 2024-08-20T01:42:17.600 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 1409.122171694, 2024-08-20T01:42:17.600 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.026310700 2024-08-20T01:42:17.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.600 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookuphash_latency": { 2024-08-20T01:42:17.601 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.601 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.601 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.601 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupino_latency": { 2024-08-20T01:42:17.601 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 2, 2024-08-20T01:42:17.601 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000285097, 2024-08-20T01:42:17.601 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000142548 2024-08-20T01:42:17.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.601 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupname_latency": { 2024-08-20T01:42:17.601 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.601 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.601 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.602 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupparent_latency": { 2024-08-20T01:42:17.602 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.602 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.602 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.603 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupsnap_latency": { 2024-08-20T01:42:17.603 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.603 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.603 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.603 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lssnap_latency": { 2024-08-20T01:42:17.603 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.603 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.603 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.603 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mkdir_latency": { 2024-08-20T01:42:17.603 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 291, 2024-08-20T01:42:17.604 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 2.598950261, 2024-08-20T01:42:17.604 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.008931100 2024-08-20T01:42:17.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.604 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mknod_latency": { 2024-08-20T01:42:17.604 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.604 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.604 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.604 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mksnap_latency": { 2024-08-20T01:42:17.604 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.604 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.604 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.605 INFO:teuthology.orchestra.run.smithi134.stdout: "req_open_latency": { 2024-08-20T01:42:17.605 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 11658, 2024-08-20T01:42:17.605 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 100.685994340, 2024-08-20T01:42:17.605 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.008636643 2024-08-20T01:42:17.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.605 INFO:teuthology.orchestra.run.smithi134.stdout: "req_readdir_latency": { 2024-08-20T01:42:17.605 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1672, 2024-08-20T01:42:17.605 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 3.307923911, 2024-08-20T01:42:17.605 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001978423 2024-08-20T01:42:17.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.605 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rename_latency": { 2024-08-20T01:42:17.605 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 44402, 2024-08-20T01:42:17.605 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 460.789220973, 2024-08-20T01:42:17.606 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.010377668 2024-08-20T01:42:17.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.606 INFO:teuthology.orchestra.run.smithi134.stdout: "req_renamesnap_latency": { 2024-08-20T01:42:17.606 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.606 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.606 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.606 INFO:teuthology.orchestra.run.smithi134.stdout: "req_snapdiff_latency": { 2024-08-20T01:42:17.606 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.606 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.606 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.607 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmdir_latency": { 2024-08-20T01:42:17.607 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 252, 2024-08-20T01:42:17.607 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 30.485184709, 2024-08-20T01:42:17.607 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.120972955 2024-08-20T01:42:17.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.607 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmsnap_latency": { 2024-08-20T01:42:17.607 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.607 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.607 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.607 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmxattr_latency": { 2024-08-20T01:42:17.607 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setattr_latency": { 2024-08-20T01:42:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 6, 2024-08-20T01:42:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.028309166, 2024-08-20T01:42:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.004718194 2024-08-20T01:42:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setdirlayout_latency": { 2024-08-20T01:42:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setfilelock_latency": { 2024-08-20T01:42:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.609 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.609 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.609 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setlayout_latency": { 2024-08-20T01:42:17.609 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.609 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.609 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.609 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setxattr_latency": { 2024-08-20T01:42:17.609 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 7, 2024-08-20T01:42:17.609 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.020114152, 2024-08-20T01:42:17.609 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.002873450 2024-08-20T01:42:17.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.609 INFO:teuthology.orchestra.run.smithi134.stdout: "req_symlink_latency": { 2024-08-20T01:42:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 3, 2024-08-20T01:42:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.001784867, 2024-08-20T01:42:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000594955 2024-08-20T01:42:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: "req_unlink_latency": { 2024-08-20T01:42:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 35563, 2024-08-20T01:42:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 50.529870047, 2024-08-20T01:42:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001420855 2024-08-20T01:42:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_revoke_eviction": 0, 2024-08-20T01:42:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_acquisition_throttle": 0, 2024-08-20T01:42:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getvxattr_latency": { 2024-08-20T01:42:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.611 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.611 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:17.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.611 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessions": { 2024-08-20T01:42:17.611 INFO:teuthology.orchestra.run.smithi134.stdout: "session_count": 1, 2024-08-20T01:42:17.611 INFO:teuthology.orchestra.run.smithi134.stdout: "session_add": 2, 2024-08-20T01:42:17.611 INFO:teuthology.orchestra.run.smithi134.stdout: "session_remove": 1, 2024-08-20T01:42:17.611 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_open": 1, 2024-08-20T01:42:17.611 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_stale": 0, 2024-08-20T01:42:17.611 INFO:teuthology.orchestra.run.smithi134.stdout: "total_load": 29467, 2024-08-20T01:42:17.611 INFO:teuthology.orchestra.run.smithi134.stdout: "average_load": 29467, 2024-08-20T01:42:17.611 INFO:teuthology.orchestra.run.smithi134.stdout: "avg_session_uptime": 682, 2024-08-20T01:42:17.611 INFO:teuthology.orchestra.run.smithi134.stdout: "mdthresh_evicted": 0 2024-08-20T01:42:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-08-20T01:42:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 240, 2024-08-20T01:42:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 240, 2024-08-20T01:42:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:42:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:42:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:42:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:42:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:42:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:42:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:42:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:42:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:42:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:42:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:42:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:42:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:42:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-08-20T01:42:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:42:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-08-20T01:42:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:42:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:42:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:42:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:42:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:42:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:42:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:42:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-08-20T01:42:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:42:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:42:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:42:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-08-20T01:42:17.614 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-08-20T01:42:17.614 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-08-20T01:42:17.614 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:42:17.614 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:42:17.614 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:42:17.614 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:42:17.614 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 306780, 2024-08-20T01:42:17.614 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 127, 2024-08-20T01:42:17.614 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 440, 2024-08-20T01:42:17.614 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 5, 2024-08-20T01:42:17.614 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-08-20T01:42:17.614 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-08-20T01:42:17.614 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:42:17.614 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-08-20T01:42:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:42:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-08-20T01:42:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 7784, 2024-08-20T01:42:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 160, 2024-08-20T01:42:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:42:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:42:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-08-20T01:42:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-08-20T01:42:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 427862, 2024-08-20T01:42:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 4385, 2024-08-20T01:42:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-08-20T01:42:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-08-20T01:42:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-08-20T01:42:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-08-20T01:42:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter": { 2024-08-20T01:42:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: "op_active": 0, 2024-08-20T01:42:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: "op_laggy": 0, 2024-08-20T01:42:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send": 306830, 2024-08-20T01:42:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send_bytes": 726756486, 2024-08-20T01:42:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: "op_resend": 32, 2024-08-20T01:42:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: "op_reply": 306830, 2024-08-20T01:42:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: "op_latency": { 2024-08-20T01:42:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 306830, 2024-08-20T01:42:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 58747.929498550, 2024-08-20T01:42:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.191467358 2024-08-20T01:42:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: "op_inflight": 0, 2024-08-20T01:42:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: "oplen_avg": { 2024-08-20T01:42:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 306830, 2024-08-20T01:42:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 467387 2024-08-20T01:42:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: "op": 306830, 2024-08-20T01:42:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: "op_r": 173201, 2024-08-20T01:42:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: "op_w": 133629, 2024-08-20T01:42:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: "op_rmw": 0, 2024-08-20T01:42:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: "op_pg": 0, 2024-08-20T01:42:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_stat": 8850, 2024-08-20T01:42:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_create": 68293, 2024-08-20T01:42:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_read": 1106, 2024-08-20T01:42:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_write": 7969, 2024-08-20T01:42:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writefull": 715, 2024-08-20T01:42:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writesame": 0, 2024-08-20T01:42:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_append": 0, 2024-08-20T01:42:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_zero": 0, 2024-08-20T01:42:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_truncate": 182, 2024-08-20T01:42:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_delete": 45263, 2024-08-20T01:42:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_mapext": 0, 2024-08-20T01:42:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_sparse_read": 0, 2024-08-20T01:42:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_clonerange": 0, 2024-08-20T01:42:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_getxattr": 171126, 2024-08-20T01:42:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_setxattr": 136586, 2024-08-20T01:42:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_cmpxattr": 0, 2024-08-20T01:42:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_rmxattr": 0, 2024-08-20T01:42:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_resetxattrs": 0, 2024-08-20T01:42:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_call": 0, 2024-08-20T01:42:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_watch": 0, 2024-08-20T01:42:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_notify": 0, 2024-08-20T01:42:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T01:42:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls": 0, 2024-08-20T01:42:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls_filter": 0, 2024-08-20T01:42:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_other": 5, 2024-08-20T01:42:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_active": 0, 2024-08-20T01:42:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_send": 0, 2024-08-20T01:42:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_resend": 0, 2024-08-20T01:42:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_ping": 0, 2024-08-20T01:42:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_active": 0, 2024-08-20T01:42:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_send": 0, 2024-08-20T01:42:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_resend": 0, 2024-08-20T01:42:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_active": 0, 2024-08-20T01:42:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_send": 0, 2024-08-20T01:42:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_resend": 0, 2024-08-20T01:42:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_active": 0, 2024-08-20T01:42:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_send": 0, 2024-08-20T01:42:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_resend": 0, 2024-08-20T01:42:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: "command_active": 0, 2024-08-20T01:42:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: "command_send": 0, 2024-08-20T01:42:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: "command_resend": 0, 2024-08-20T01:42:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 81, 2024-08-20T01:42:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: "map_full": 0, 2024-08-20T01:42:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: "map_inc": 6, 2024-08-20T01:42:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_sessions": 12, 2024-08-20T01:42:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_open": 12, 2024-08-20T01:42:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_close": 0, 2024-08-20T01:42:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_laggy": 0, 2024-08-20T01:42:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_wr": 21114, 2024-08-20T01:42:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_rd": 1393, 2024-08-20T01:42:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_del": 4785 2024-08-20T01:42:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: "oft": { 2024-08-20T01:42:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_objs": 1, 2024-08-20T01:42:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_kv_pairs": 0, 2024-08-20T01:42:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_updates": 0, 2024-08-20T01:42:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_removes": 0 2024-08-20T01:42:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: "purge_queue": { 2024-08-20T01:42:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops": 0, 2024-08-20T01:42:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops_high_water": 18, 2024-08-20T01:42:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing": 0, 2024-08-20T01:42:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_high_water": 10, 2024-08-20T01:42:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed_ops": 44437, 2024-08-20T01:42:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed": 42889, 2024-08-20T01:42:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_item_in_journal": 0 2024-08-20T01:42:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:42:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-08-20T01:42:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-08-20T01:42:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-08-20T01:42:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 831064, 2024-08-20T01:42:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 345462771, 2024-08-20T01:42:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 831064, 2024-08-20T01:42:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-08-20T01:42:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-08-20T01:42:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 831064, 2024-08-20T01:42:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 345462771, 2024-08-20T01:42:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-08-20T01:42:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_bytes": { 2024-08-20T01:42:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-08-20T01:42:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-08-20T01:42:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-08-20T01:42:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-08-20T01:42:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-08-20T01:42:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-08-20T01:42:17.624 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 306830, 2024-08-20T01:42:17.624 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 731062328, 2024-08-20T01:42:17.624 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 306830, 2024-08-20T01:42:17.624 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 731062328, 2024-08-20T01:42:17.624 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-08-20T01:42:17.624 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.624 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.624 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.624 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:17.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.624 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_ops": { 2024-08-20T01:42:17.624 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-08-20T01:42:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 1024, 2024-08-20T01:42:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-08-20T01:42:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-08-20T01:42:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-08-20T01:42:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-08-20T01:42:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 306830, 2024-08-20T01:42:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 306830, 2024-08-20T01:42:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 306830, 2024-08-20T01:42:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 306830, 2024-08-20T01:42:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-08-20T01:42:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:17.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.626 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle": { 2024-08-20T01:42:17.626 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-08-20T01:42:17.626 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-08-20T01:42:17.626 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-08-20T01:42:17.626 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 42889, 2024-08-20T01:42:17.626 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 4333357, 2024-08-20T01:42:17.626 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:17.626 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 42889, 2024-08-20T01:42:17.626 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-08-20T01:42:17.626 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-08-20T01:42:17.626 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 1094, 2024-08-20T01:42:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 4333357, 2024-08-20T01:42:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-08-20T01:42:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle-0x5649219306e0": { 2024-08-20T01:42:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-08-20T01:42:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-08-20T01:42:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-08-20T01:42:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 247220, 2024-08-20T01:42:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 592760231, 2024-08-20T01:42:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 247220, 2024-08-20T01:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-08-20T01:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-08-20T01:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 6872, 2024-08-20T01:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 592760231, 2024-08-20T01:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-08-20T01:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: "trackedop": { 2024-08-20T01:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_ops_count": 0 2024-08-20T01:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-08-20T01:42:18.373 INFO:tasks.check_counter:Daemon mds.i mds.exported=945 2024-08-20T01:42:18.373 INFO:tasks.check_counter:Daemon mds.i mds.imported=201 2024-08-20T01:42:18.373 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=3182 2024-08-20T01:42:18.373 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=3610 2024-08-20T01:42:18.373 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=182 2024-08-20T01:42:18.373 DEBUG:tasks.check_counter:Getting stats from l 2024-08-20T01:42:18.374 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph daemon mds.l perf dump 2024-08-20T01:42:18.635 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:42:19.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:19 smithi077 ceph-mon[22251]: pgmap v683: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-20T01:42:19.341 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:19 smithi134 ceph-mon[22511]: pgmap v683: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-20T01:42:19.343 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-08-20T01:42:19.343 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:42:19.343 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 231, 2024-08-20T01:42:19.343 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 226, 2024-08-20T01:42:19.343 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 523104, 2024-08-20T01:42:19.343 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 138112, 2024-08-20T01:42:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 4, 2024-08-20T01:42:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 0, 2024-08-20T01:42:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.034242760, 2024-08-20T01:42:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.015589847, 2024-08-20T01:42:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.023190159, 2024-08-20T01:42:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:42:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 226, 2024-08-20T01:42:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.015678900, 2024-08-20T01:42:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000069375 2024-08-20T01:42:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:19.344 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 523104, 2024-08-20T01:42:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 138112 2024-08-20T01:42:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:42:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 1, 2024-08-20T01:42:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 170, 2024-08-20T01:42:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 160, 2024-08-20T01:42:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 109776, 2024-08-20T01:42:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 3, 2024-08-20T01:42:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 2, 2024-08-20T01:42:19.345 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.010103360, 2024-08-20T01:42:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.008223384, 2024-08-20T01:42:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.000462277, 2024-08-20T01:42:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:42:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 168, 2024-08-20T01:42:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.008659913, 2024-08-20T01:42:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000051547 2024-08-20T01:42:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:19.346 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-20T01:42:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 109776 2024-08-20T01:42:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:42:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 0, 2024-08-20T01:42:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 2, 2024-08-20T01:42:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 0, 2024-08-20T01:42:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 0, 2024-08-20T01:42:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 2, 2024-08-20T01:42:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 1, 2024-08-20T01:42:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.000203373, 2024-08-20T01:42:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.000000000, 2024-08-20T01:42:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.000127877, 2024-08-20T01:42:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:42:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:42:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:42:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T01:42:19.348 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T01:42:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-08-20T01:42:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 0, 2024-08-20T01:42:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-08-20T01:42:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-08-20T01:42:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:42:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-08-20T01:42:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:42:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:42:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:42:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:42:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:42:19.349 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:42:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:42:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:42:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:42:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:42:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:42:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:42:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:42:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-08-20T01:42:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:42:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-08-20T01:42:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:42:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:42:19.350 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:42:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:42:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:42:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:42:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:42:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-08-20T01:42:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:42:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:42:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:42:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-08-20T01:42:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-08-20T01:42:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-08-20T01:42:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:42:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:42:19.351 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:42:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:42:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 148923, 2024-08-20T01:42:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 29, 2024-08-20T01:42:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-08-20T01:42:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-08-20T01:42:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-08-20T01:42:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-08-20T01:42:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:42:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-08-20T01:42:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:42:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-08-20T01:42:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 0, 2024-08-20T01:42:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 0, 2024-08-20T01:42:19.352 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:42:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:42:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-08-20T01:42:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-08-20T01:42:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 928, 2024-08-20T01:42:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 2, 2024-08-20T01:42:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-08-20T01:42:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-08-20T01:42:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-08-20T01:42:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-08-20T01:42:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-08-20T01:42:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:42:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-08-20T01:42:19.353 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-08-20T01:42:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-08-20T01:42:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 228, 2024-08-20T01:42:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 488010, 2024-08-20T01:42:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-08-20T01:42:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 228, 2024-08-20T01:42:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-08-20T01:42:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-08-20T01:42:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 228, 2024-08-20T01:42:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 488010, 2024-08-20T01:42:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-08-20T01:42:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-08-20T01:42:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-08-20T01:42:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-08-20T01:42:19.354 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:19.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-08-20T01:42:19.355 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-08-20T01:42:19.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:19 smithi022 ceph-mon[18709]: pgmap v683: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-20T01:42:20.109 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-08-20T01:42:20.109 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-08-20T01:42:20.110 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-08-20T01:42:20.110 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-08-20T01:42:20.110 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-08-20T01:42:20.110 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-20T01:42:20.121 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-20T01:42:20.121 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-08-20T01:42:20.121 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-20T01:42:20.143 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-08-20T01:42:20.143 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-20T01:42:20.203 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd blocklist ls 2024-08-20T01:42:20.511 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:20.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.973+0000 7faecf59e640 1 -- 172.21.15.22:0/1843766801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faed0101800 msgr2=0x7faed0101be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:20.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.973+0000 7faecf59e640 1 --2- 172.21.15.22:0/1843766801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faed0101800 0x7faed0101be0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7faec0009900 tx=0x7faec002a410 comp rx=0 tx=0).stop 2024-08-20T01:42:20.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.974+0000 7faecf59e640 1 -- 172.21.15.22:0/1843766801 shutdown_connections 2024-08-20T01:42:20.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.974+0000 7faecf59e640 1 --2- 172.21.15.22:0/1843766801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faed0107b90 0x7faed010e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:20.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.974+0000 7faecf59e640 1 --2- 172.21.15.22:0/1843766801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faed0107210 0x7faed0107650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:20.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.974+0000 7faecf59e640 1 --2- 172.21.15.22:0/1843766801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faed0101800 0x7faed0101be0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:20.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.974+0000 7faecf59e640 1 -- 172.21.15.22:0/1843766801 >> 172.21.15.22:0/1843766801 conn(0x7faed00fd2d0 msgr2=0x7faed00ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:20.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.974+0000 7faecf59e640 1 -- 172.21.15.22:0/1843766801 shutdown_connections 2024-08-20T01:42:20.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.974+0000 7faecf59e640 1 -- 172.21.15.22:0/1843766801 wait complete. 2024-08-20T01:42:20.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.974+0000 7faecf59e640 1 Processor -- start 2024-08-20T01:42:20.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.975+0000 7faecf59e640 1 -- start start 2024-08-20T01:42:20.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.975+0000 7faecf59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faed0101800 0x7faed00fd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:20.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.975+0000 7faecf59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faed0107210 0x7faed00fdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:20.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.975+0000 7faecf59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faed0107b90 0x7faed00fe250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:20.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.975+0000 7faecf59e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faed0111810 con 0x7faed0101800 2024-08-20T01:42:20.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.975+0000 7faecf59e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faed0111690 con 0x7faed0107b90 2024-08-20T01:42:20.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.975+0000 7faecf59e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faed0111990 con 0x7faed0107210 2024-08-20T01:42:20.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.975+0000 7faece59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faed0101800 0x7faed00fd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:20.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.975+0000 7faece59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faed0101800 0x7faed00fd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40932/0 (socket says 172.21.15.22:40932) 2024-08-20T01:42:20.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.975+0000 7faece59c640 1 -- 172.21.15.22:0/452904455 learned_addr learned my addr 172.21.15.22:0/452904455 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:42:20.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.975+0000 7faeced9d640 1 --2- 172.21.15.22:0/452904455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faed0107b90 0x7faed00fe250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:20.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.975+0000 7faecdd9b640 1 --2- 172.21.15.22:0/452904455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faed0107210 0x7faed00fdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:20.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.975+0000 7faece59c640 1 -- 172.21.15.22:0/452904455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faed0107210 msgr2=0x7faed00fdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:20.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.975+0000 7faece59c640 1 --2- 172.21.15.22:0/452904455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faed0107210 0x7faed00fdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:20.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.975+0000 7faece59c640 1 -- 172.21.15.22:0/452904455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faed0107b90 msgr2=0x7faed00fe250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:20.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.975+0000 7faece59c640 1 --2- 172.21.15.22:0/452904455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faed0107b90 0x7faed00fe250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:20.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.975+0000 7faece59c640 1 -- 172.21.15.22:0/452904455 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed01a70f0 con 0x7faed0101800 2024-08-20T01:42:20.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.976+0000 7faece59c640 1 --2- 172.21.15.22:0/452904455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faed0101800 0x7faed00fd7d0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7faec0005940 tx=0x7faec00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:20.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.976+0000 7faec77fe640 1 -- 172.21.15.22:0/452904455 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec003f030 con 0x7faed0101800 2024-08-20T01:42:20.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.976+0000 7faec77fe640 1 -- 172.21.15.22:0/452904455 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faec0003cb0 con 0x7faed0101800 2024-08-20T01:42:20.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.976+0000 7faecf59e640 1 -- 172.21.15.22:0/452904455 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed01a7380 con 0x7faed0101800 2024-08-20T01:42:20.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.976+0000 7faec77fe640 1 -- 172.21.15.22:0/452904455 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0035070 con 0x7faed0101800 2024-08-20T01:42:20.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.976+0000 7faecf59e640 1 -- 172.21.15.22:0/452904455 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed01a7860 con 0x7faed0101800 2024-08-20T01:42:20.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.977+0000 7faecf59e640 1 -- 172.21.15.22:0/452904455 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faed0101be0 con 0x7faed0101800 2024-08-20T01:42:20.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.979+0000 7faec77fe640 1 -- 172.21.15.22:0/452904455 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7faec0042030 con 0x7faed0101800 2024-08-20T01:42:20.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.980+0000 7faec77fe640 1 --2- 172.21.15.22:0/452904455 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faebc0b3c70 0x7faebc0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:20.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.980+0000 7faec77fe640 1 -- 172.21.15.22:0/452904455 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7faec0104700 con 0x7faed0101800 2024-08-20T01:42:20.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.981+0000 7faecdd9b640 1 --2- 172.21.15.22:0/452904455 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faebc0b3c70 0x7faebc0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:20.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.981+0000 7faecdd9b640 1 --2- 172.21.15.22:0/452904455 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faebc0b3c70 0x7faebc0b6130 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7faed00ff2c0 tx=0x7faeb800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:20.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:20.983+0000 7faec77fe640 1 -- 172.21.15.22:0/452904455 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7faec00cb6c0 con 0x7faed0101800 2024-08-20T01:42:21.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:21 smithi022 ceph-mon[18709]: pgmap v684: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-20T01:42:21.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:21.181+0000 7faecf59e640 1 -- 172.21.15.22:0/452904455 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faed00fead0 con 0x7faed0101800 2024-08-20T01:42:21.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:21.182+0000 7faec77fe640 1 -- 172.21.15.22:0/452904455 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v81) ==== 81+0+589 (secure 0 0 0) 0x7faed00fead0 con 0x7faed0101800 2024-08-20T01:42:21.185 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/416470260 2024-08-21T01:21:53.209795+0000 2024-08-20T01:42:21.185 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6801/760844170 2024-08-21T01:21:53.209795+0000 2024-08-20T01:42:21.185 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6800/760844170 2024-08-21T01:21:53.209795+0000 2024-08-20T01:42:21.185 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/1142422661 2024-08-21T01:21:53.209795+0000 2024-08-20T01:42:21.185 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6801/1099138788 2024-08-21T01:21:28.981981+0000 2024-08-20T01:42:21.185 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6800/1099138788 2024-08-21T01:21:28.981981+0000 2024-08-20T01:42:21.185 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/2093308719 2024-08-21T01:21:53.209795+0000 2024-08-20T01:42:21.185 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/3772866379 2024-08-21T01:21:28.981981+0000 2024-08-20T01:42:21.185 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/3424402756 2024-08-21T01:21:28.981981+0000 2024-08-20T01:42:21.185 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/3864772624 2024-08-21T01:21:28.981981+0000 2024-08-20T01:42:21.186 INFO:teuthology.orchestra.run.smithi022.stderr:listed 10 entries 2024-08-20T01:42:21.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:21.184+0000 7faecf59e640 1 -- 172.21.15.22:0/452904455 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faebc0b3c70 msgr2=0x7faebc0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:21.184+0000 7faecf59e640 1 --2- 172.21.15.22:0/452904455 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faebc0b3c70 0x7faebc0b6130 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7faed00ff2c0 tx=0x7faeb800b410 comp rx=0 tx=0).stop 2024-08-20T01:42:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:21.184+0000 7faecf59e640 1 -- 172.21.15.22:0/452904455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faed0101800 msgr2=0x7faed00fd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:21.184+0000 7faecf59e640 1 --2- 172.21.15.22:0/452904455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faed0101800 0x7faed00fd7d0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7faec0005940 tx=0x7faec00042f0 comp rx=0 tx=0).stop 2024-08-20T01:42:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:21.185+0000 7faecf59e640 1 -- 172.21.15.22:0/452904455 shutdown_connections 2024-08-20T01:42:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:21.185+0000 7faecf59e640 1 --2- 172.21.15.22:0/452904455 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7faebc0b3c70 0x7faebc0b6130 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:21.185+0000 7faecf59e640 1 --2- 172.21.15.22:0/452904455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faed0107b90 0x7faed00fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:21.185+0000 7faecf59e640 1 --2- 172.21.15.22:0/452904455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faed0107210 0x7faed00fdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:21.185+0000 7faecf59e640 1 --2- 172.21.15.22:0/452904455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faed0101800 0x7faed00fd7d0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:21.185+0000 7faecf59e640 1 -- 172.21.15.22:0/452904455 >> 172.21.15.22:0/452904455 conn(0x7faed00fd2d0 msgr2=0x7faed006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:21.185+0000 7faecf59e640 1 -- 172.21.15.22:0/452904455 shutdown_connections 2024-08-20T01:42:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:21.185+0000 7faecf59e640 1 -- 172.21.15.22:0/452904455 wait complete. 2024-08-20T01:42:21.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:21 smithi077 ceph-mon[22251]: pgmap v684: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-20T01:42:21.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:21 smithi134 ceph-mon[22511]: pgmap v684: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-20T01:42:21.901 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-20T01:42:21.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:42:21.901 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-20T01:42:21.963 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2024-08-20T01:42:21.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:42:21.963 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-20T01:42:22.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:42:22.012 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-08-20T01:42:22.069 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-20T01:42:22.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:42:22.069 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-20T01:42:22.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:42:22.141 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2024-08-20T01:42:22.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:22 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/452904455' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-20T01:42:22.242 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-08-20T01:42:22.251 INFO:tasks.cephadm:Teardown begin 2024-08-20T01:42:22.251 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-20T01:42:22.252 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:42:22.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:22 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/452904455' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-20T01:42:22.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:22 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/452904455' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-20T01:42:22.657 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:23.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.126+0000 7f0d4b0a2640 1 -- 172.21.15.22:0/1357779189 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d44107d20 msgr2=0x7f0d4410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:23.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.126+0000 7f0d4b0a2640 1 --2- 172.21.15.22:0/1357779189 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d44107d20 0x7f0d4410e520 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009ca0 tx=0x7f0d3c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:42:23.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.127+0000 7f0d4b0a2640 1 -- 172.21.15.22:0/1357779189 shutdown_connections 2024-08-20T01:42:23.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.127+0000 7f0d4b0a2640 1 --2- 172.21.15.22:0/1357779189 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d44107d20 0x7f0d4410e520 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:23.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.127+0000 7f0d4b0a2640 1 --2- 172.21.15.22:0/1357779189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d441073a0 0x7f0d441077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:23.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.127+0000 7f0d4b0a2640 1 --2- 172.21.15.22:0/1357779189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d44101990 0x7f0d44101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.127+0000 7f0d4b0a2640 1 -- 172.21.15.22:0/1357779189 >> 172.21.15.22:0/1357779189 conn(0x7f0d440fd400 msgr2=0x7f0d440ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.127+0000 7f0d4b0a2640 1 -- 172.21.15.22:0/1357779189 shutdown_connections 2024-08-20T01:42:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.127+0000 7f0d4b0a2640 1 -- 172.21.15.22:0/1357779189 wait complete. 2024-08-20T01:42:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.127+0000 7f0d4b0a2640 1 Processor -- start 2024-08-20T01:42:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.127+0000 7f0d4b0a2640 1 -- start start 2024-08-20T01:42:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d4b0a2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d44101990 0x7f0d440fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d4b0a2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d441073a0 0x7f0d440fde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d4b0a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d44107d20 0x7f0d440fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d4b0a2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0d441119e0 con 0x7f0d44101990 2024-08-20T01:42:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d4b0a2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0d44111860 con 0x7f0d44107d20 2024-08-20T01:42:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d4b0a2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d44111b60 con 0x7f0d441073a0 2024-08-20T01:42:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d48e3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d44101990 0x7f0d440fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:23.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d48e3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d44101990 0x7f0d440fd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40944/0 (socket says 172.21.15.22:40944) 2024-08-20T01:42:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d48e3e640 1 -- 172.21.15.22:0/134959204 learned_addr learned my addr 172.21.15.22:0/134959204 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:42:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d4963f640 1 --2- 172.21.15.22:0/134959204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d44107d20 0x7f0d440fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d43fff640 1 --2- 172.21.15.22:0/134959204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d441073a0 0x7f0d440fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d48e3e640 1 -- 172.21.15.22:0/134959204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d441073a0 msgr2=0x7f0d440fde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d48e3e640 1 --2- 172.21.15.22:0/134959204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d441073a0 0x7f0d440fde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d48e3e640 1 -- 172.21.15.22:0/134959204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d44107d20 msgr2=0x7f0d440fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d48e3e640 1 --2- 172.21.15.22:0/134959204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d44107d20 0x7f0d440fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d48e3e640 1 -- 172.21.15.22:0/134959204 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d441a7320 con 0x7f0d44101990 2024-08-20T01:42:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d48e3e640 1 --2- 172.21.15.22:0/134959204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d44101990 0x7f0d440fd900 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f0d3800d950 tx=0x7f0d3800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d41ffb640 1 -- 172.21.15.22:0/134959204 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d38017030 con 0x7f0d44101990 2024-08-20T01:42:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d41ffb640 1 -- 172.21.15.22:0/134959204 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d38004020 con 0x7f0d44101990 2024-08-20T01:42:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d4b0a2640 1 -- 172.21.15.22:0/134959204 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d441a7610 con 0x7f0d44101990 2024-08-20T01:42:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.128+0000 7f0d41ffb640 1 -- 172.21.15.22:0/134959204 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d380047a0 con 0x7f0d44101990 2024-08-20T01:42:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.129+0000 7f0d4b0a2640 1 -- 172.21.15.22:0/134959204 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d441a7b50 con 0x7f0d44101990 2024-08-20T01:42:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.130+0000 7f0d4b0a2640 1 -- 172.21.15.22:0/134959204 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d44101d70 con 0x7f0d44101990 2024-08-20T01:42:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.131+0000 7f0d41ffb640 1 -- 172.21.15.22:0/134959204 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0d38009a30 con 0x7f0d44101990 2024-08-20T01:42:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.132+0000 7f0d41ffb640 1 --2- 172.21.15.22:0/134959204 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0d340b3bd0 0x7f0d340b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.132+0000 7f0d43fff640 1 --2- 172.21.15.22:0/134959204 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0d340b3bd0 0x7f0d340b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.132+0000 7f0d41ffb640 1 -- 172.21.15.22:0/134959204 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f0d380e3780 con 0x7f0d44101990 2024-08-20T01:42:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.132+0000 7f0d43fff640 1 --2- 172.21.15.22:0/134959204 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0d340b3bd0 0x7f0d340b6090 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0d30005d90 tx=0x7f0d30005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.136+0000 7f0d41ffb640 1 -- 172.21.15.22:0/134959204 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f0d380aad30 con 0x7f0d44101990 2024-08-20T01:42:23.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:23 smithi077 ceph-mon[22251]: pgmap v685: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-20T01:42:23.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.357+0000 7f0d4b0a2640 1 -- 172.21.15.22:0/134959204 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d4402e340 con 0x7f0d44101990 2024-08-20T01:42:23.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:23 smithi022 ceph-mon[18709]: pgmap v685: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-20T01:42:23.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.358+0000 7f0d41ffb640 1 -- 172.21.15.22:0/134959204 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11915 (secure 0 0 0) 0x7f0d380aa630 con 0x7f0d44101990 2024-08-20T01:42:23.361 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:42:23.361 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":34,"btime":"2024-08-20T01:41:18:910532+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:41:18.910513+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26866":{"gid":26866,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/2284188249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2284188249},{"type":"v1","addr":"172.21.15.134:6835","nonce":2284188249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24565,24575,24586]},"id":1}]} 2024-08-20T01:42:23.361 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 34 2024-08-20T01:42:23.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.360+0000 7f0d4b0a2640 1 -- 172.21.15.22:0/134959204 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0d340b3bd0 msgr2=0x7f0d340b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:23.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.360+0000 7f0d4b0a2640 1 --2- 172.21.15.22:0/134959204 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0d340b3bd0 0x7f0d340b6090 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0d30005d90 tx=0x7f0d30005d20 comp rx=0 tx=0).stop 2024-08-20T01:42:23.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.360+0000 7f0d4b0a2640 1 -- 172.21.15.22:0/134959204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d44101990 msgr2=0x7f0d440fd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:23.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.360+0000 7f0d4b0a2640 1 --2- 172.21.15.22:0/134959204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d44101990 0x7f0d440fd900 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f0d3800d950 tx=0x7f0d3800de10 comp rx=0 tx=0).stop 2024-08-20T01:42:23.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.360+0000 7f0d4b0a2640 1 -- 172.21.15.22:0/134959204 shutdown_connections 2024-08-20T01:42:23.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.360+0000 7f0d4b0a2640 1 --2- 172.21.15.22:0/134959204 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f0d340b3bd0 0x7f0d340b6090 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:23.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.360+0000 7f0d4b0a2640 1 --2- 172.21.15.22:0/134959204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d44107d20 0x7f0d440fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:23.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.360+0000 7f0d4b0a2640 1 --2- 172.21.15.22:0/134959204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d441073a0 0x7f0d440fde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:23.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.360+0000 7f0d4b0a2640 1 --2- 172.21.15.22:0/134959204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d44101990 0x7f0d440fd900 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:23.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.360+0000 7f0d4b0a2640 1 -- 172.21.15.22:0/134959204 >> 172.21.15.22:0/134959204 conn(0x7f0d440fd400 msgr2=0x7f0d4406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:23.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.360+0000 7f0d4b0a2640 1 -- 172.21.15.22:0/134959204 shutdown_connections 2024-08-20T01:42:23.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:23.360+0000 7f0d4b0a2640 1 -- 172.21.15.22:0/134959204 wait complete. 2024-08-20T01:42:23.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:23 smithi134 ceph-mon[22511]: pgmap v685: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-20T01:42:23.980 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:42:24.240 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:24.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:24 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/134959204' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:42:24.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:24 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/134959204' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:42:24.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:24 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/134959204' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:42:24.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.724+0000 7f89ebabc640 1 -- 172.21.15.22:0/3869197810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89e410f120 msgr2=0x7f89e4111510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:24.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.724+0000 7f89ebabc640 1 --2- 172.21.15.22:0/3869197810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89e410f120 0x7f89e4111510 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009ca0 tx=0x7f89dc02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:42:24.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.725+0000 7f89ebabc640 1 -- 172.21.15.22:0/3869197810 shutdown_connections 2024-08-20T01:42:24.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.725+0000 7f89ebabc640 1 --2- 172.21.15.22:0/3869197810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89e410f120 0x7f89e4111510 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:24.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.725+0000 7f89ebabc640 1 --2- 172.21.15.22:0/3869197810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e4101e90 0x7f89e410ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:24.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.725+0000 7f89ebabc640 1 --2- 172.21.15.22:0/3869197810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e4101570 0x7f89e4101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:24.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.725+0000 7f89ebabc640 1 -- 172.21.15.22:0/3869197810 >> 172.21.15.22:0/3869197810 conn(0x7f89e40fd440 msgr2=0x7f89e40ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:24.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.725+0000 7f89ebabc640 1 -- 172.21.15.22:0/3869197810 shutdown_connections 2024-08-20T01:42:24.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.725+0000 7f89ebabc640 1 -- 172.21.15.22:0/3869197810 wait complete. 2024-08-20T01:42:24.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.725+0000 7f89ebabc640 1 Processor -- start 2024-08-20T01:42:24.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.725+0000 7f89ebabc640 1 -- start start 2024-08-20T01:42:24.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.725+0000 7f89ebabc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89e4101570 0x7f89e419b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:24.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.725+0000 7f89ebabc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e4101e90 0x7f89e419b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:24.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.725+0000 7f89ebabc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e410f120 0x7f89e41a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:24.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.725+0000 7f89ebabc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f89e4114ca0 con 0x7f89e4101570 2024-08-20T01:42:24.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.725+0000 7f89ebabc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f89e4114b20 con 0x7f89e4101e90 2024-08-20T01:42:24.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.725+0000 7f89ebabc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f89e4114e20 con 0x7f89e410f120 2024-08-20T01:42:24.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.726+0000 7f89e9858640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89e4101570 0x7f89e419b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:24.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.726+0000 7f89e9858640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89e4101570 0x7f89e419b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40964/0 (socket says 172.21.15.22:40964) 2024-08-20T01:42:24.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.726+0000 7f89e9858640 1 -- 172.21.15.22:0/1180489834 learned_addr learned my addr 172.21.15.22:0/1180489834 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:42:24.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.726+0000 7f89e9057640 1 --2- 172.21.15.22:0/1180489834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e4101e90 0x7f89e419b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:24.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.726+0000 7f89ea059640 1 --2- 172.21.15.22:0/1180489834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e410f120 0x7f89e41a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:24.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.726+0000 7f89e9858640 1 -- 172.21.15.22:0/1180489834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e410f120 msgr2=0x7f89e41a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:24.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.726+0000 7f89e9858640 1 --2- 172.21.15.22:0/1180489834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e410f120 0x7f89e41a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:24.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.726+0000 7f89e9858640 1 -- 172.21.15.22:0/1180489834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e4101e90 msgr2=0x7f89e419b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:24.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.726+0000 7f89e9858640 1 --2- 172.21.15.22:0/1180489834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e4101e90 0x7f89e419b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:24.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.726+0000 7f89e9858640 1 -- 172.21.15.22:0/1180489834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e41a1280 con 0x7f89e4101570 2024-08-20T01:42:24.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.726+0000 7f89e9858640 1 --2- 172.21.15.22:0/1180489834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89e4101570 0x7f89e419b1d0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f89e000d950 tx=0x7f89e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:24.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.726+0000 7f89daffd640 1 -- 172.21.15.22:0/1180489834 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0017070 con 0x7f89e4101570 2024-08-20T01:42:24.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.726+0000 7f89daffd640 1 -- 172.21.15.22:0/1180489834 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89e0009c30 con 0x7f89e4101570 2024-08-20T01:42:24.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.726+0000 7f89ebabc640 1 -- 172.21.15.22:0/1180489834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e41a1570 con 0x7f89e4101570 2024-08-20T01:42:24.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.726+0000 7f89daffd640 1 -- 172.21.15.22:0/1180489834 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e000f620 con 0x7f89e4101570 2024-08-20T01:42:24.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.727+0000 7f89ebabc640 1 -- 172.21.15.22:0/1180489834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e41a7c30 con 0x7f89e4101570 2024-08-20T01:42:24.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.728+0000 7f89ebabc640 1 -- 172.21.15.22:0/1180489834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e4101950 con 0x7f89e4101570 2024-08-20T01:42:24.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.730+0000 7f89daffd640 1 -- 172.21.15.22:0/1180489834 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f89e0010460 con 0x7f89e4101570 2024-08-20T01:42:24.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.730+0000 7f89daffd640 1 --2- 172.21.15.22:0/1180489834 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f89d00b3bd0 0x7f89d00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:24.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.731+0000 7f89e9057640 1 --2- 172.21.15.22:0/1180489834 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f89d00b3bd0 0x7f89d00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:24.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.731+0000 7f89daffd640 1 -- 172.21.15.22:0/1180489834 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f89e00e37b0 con 0x7f89e4101570 2024-08-20T01:42:24.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.731+0000 7f89e9057640 1 --2- 172.21.15.22:0/1180489834 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f89d00b3bd0 0x7f89d00b6090 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f89e410f8f0 tx=0x7f89d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:24.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.733+0000 7f89daffd640 1 -- 172.21.15.22:0/1180489834 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f89e0009de0 con 0x7f89e4101570 2024-08-20T01:42:24.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.957+0000 7f89ebabc640 1 -- 172.21.15.22:0/1180489834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89e41a7ff0 con 0x7f89e4101570 2024-08-20T01:42:24.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.957+0000 7f89daffd640 1 -- 172.21.15.22:0/1180489834 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11915 (secure 0 0 0) 0x7f89e00aa770 con 0x7f89e4101570 2024-08-20T01:42:24.960 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:42:24.961 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":34,"btime":"2024-08-20T01:41:18:910532+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14664,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2832768009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2832768009},{"type":"v1","addr":"172.21.15.22:6835","nonce":2832768009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/2398926267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":2398926267},{"type":"v1","addr":"172.21.15.22:6837","nonce":2398926267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14721,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1257333272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1257333272},{"type":"v1","addr":"172.21.15.22:6839","nonce":1257333272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/3674086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":3674086354},{"type":"v1","addr":"172.21.15.22:6841","nonce":3674086354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2545210984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2545210984},{"type":"v1","addr":"172.21.15.77:6833","nonce":2545210984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3278477669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3278477669},{"type":"v1","addr":"172.21.15.134:6833","nonce":3278477669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:29:07.003058+0000","modified":"2024-08-20T01:41:18.910513+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24586,"mds_1":24575,"mds_2":24565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/1109505305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1109505305},{"type":"v1","addr":"172.21.15.77:6835","nonce":1109505305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/259148624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":259148624},{"type":"v1","addr":"172.21.15.77:6837","nonce":259148624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.134:6837/2260901499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2260901499},{"type":"v1","addr":"172.21.15.134:6837","nonce":2260901499}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6839/49188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":49188248},{"type":"v1","addr":"172.21.15.77:6839","nonce":49188248}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2873888279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2873888279},{"type":"v1","addr":"172.21.15.134:6839","nonce":2873888279}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26866":{"gid":26866,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/2284188249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2284188249},{"type":"v1","addr":"172.21.15.134:6835","nonce":2284188249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24586,"qdb_cluster":[24565,24575,24586]},"id":1}]} 2024-08-20T01:42:24.961 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 34 2024-08-20T01:42:24.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.960+0000 7f89ebabc640 1 -- 172.21.15.22:0/1180489834 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f89d00b3bd0 msgr2=0x7f89d00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:24.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.960+0000 7f89ebabc640 1 --2- 172.21.15.22:0/1180489834 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f89d00b3bd0 0x7f89d00b6090 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f89e410f8f0 tx=0x7f89d4005f90 comp rx=0 tx=0).stop 2024-08-20T01:42:24.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.960+0000 7f89ebabc640 1 -- 172.21.15.22:0/1180489834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89e4101570 msgr2=0x7f89e419b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:24.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.960+0000 7f89ebabc640 1 --2- 172.21.15.22:0/1180489834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89e4101570 0x7f89e419b1d0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f89e000d950 tx=0x7f89e000de10 comp rx=0 tx=0).stop 2024-08-20T01:42:24.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.960+0000 7f89ebabc640 1 -- 172.21.15.22:0/1180489834 shutdown_connections 2024-08-20T01:42:24.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.960+0000 7f89ebabc640 1 --2- 172.21.15.22:0/1180489834 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f89d00b3bd0 0x7f89d00b6090 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:24.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.960+0000 7f89ebabc640 1 --2- 172.21.15.22:0/1180489834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e410f120 0x7f89e41a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:24.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.960+0000 7f89ebabc640 1 --2- 172.21.15.22:0/1180489834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e4101e90 0x7f89e419b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:24.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.960+0000 7f89ebabc640 1 --2- 172.21.15.22:0/1180489834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89e4101570 0x7f89e419b1d0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:24.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.960+0000 7f89ebabc640 1 -- 172.21.15.22:0/1180489834 >> 172.21.15.22:0/1180489834 conn(0x7f89e40fd440 msgr2=0x7f89e40ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:24.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.960+0000 7f89ebabc640 1 -- 172.21.15.22:0/1180489834 shutdown_connections 2024-08-20T01:42:24.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:24.960+0000 7f89ebabc640 1 -- 172.21.15.22:0/1180489834 wait complete. 2024-08-20T01:42:25.275 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:25 smithi022 ceph-mon[18709]: pgmap v686: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-20T01:42:25.275 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:25 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/1180489834' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:42:25.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:25 smithi077 ceph-mon[22251]: pgmap v686: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-20T01:42:25.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:25 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/1180489834' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:42:25.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:25 smithi134 ceph-mon[22511]: pgmap v686: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-20T01:42:25.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:25 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/1180489834' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:42:25.607 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:42:25.868 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:26.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.327+0000 7fe7862e2640 1 -- 172.21.15.22:0/2158817279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7801084e0 msgr2=0x7fe780108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:26.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.327+0000 7fe7862e2640 1 --2- 172.21.15.22:0/2158817279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7801084e0 0x7fe780108920 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe774009900 tx=0x7fe77402a410 comp rx=0 tx=0).stop 2024-08-20T01:42:26.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.327+0000 7fe7862e2640 1 -- 172.21.15.22:0/2158817279 shutdown_connections 2024-08-20T01:42:26.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.327+0000 7fe7862e2640 1 --2- 172.21.15.22:0/2158817279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe780108e60 0x7fe78010f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.327+0000 7fe7862e2640 1 --2- 172.21.15.22:0/2158817279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7801084e0 0x7fe780108920 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.327+0000 7fe7862e2640 1 --2- 172.21.15.22:0/2158817279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe780102ad0 0x7fe780102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.327+0000 7fe7862e2640 1 -- 172.21.15.22:0/2158817279 >> 172.21.15.22:0/2158817279 conn(0x7fe7800fe540 msgr2=0x7fe780100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:26.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.327+0000 7fe7862e2640 1 -- 172.21.15.22:0/2158817279 shutdown_connections 2024-08-20T01:42:26.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.327+0000 7fe7862e2640 1 -- 172.21.15.22:0/2158817279 wait complete. 2024-08-20T01:42:26.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.328+0000 7fe7862e2640 1 Processor -- start 2024-08-20T01:42:26.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.328+0000 7fe7862e2640 1 -- start start 2024-08-20T01:42:26.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.328+0000 7fe7862e2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe780102ad0 0x7fe780198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.328+0000 7fe7862e2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7801084e0 0x7fe780199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.328+0000 7fe7862e2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe780108e60 0x7fe78019e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.328+0000 7fe7862e2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe780112ab0 con 0x7fe780108e60 2024-08-20T01:42:26.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.328+0000 7fe7862e2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe780112930 con 0x7fe780102ad0 2024-08-20T01:42:26.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.328+0000 7fe7862e2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe780112c30 con 0x7fe7801084e0 2024-08-20T01:42:26.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.328+0000 7fe78487f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe780108e60 0x7fe78019e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.328+0000 7fe78487f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe780108e60 0x7fe78019e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40982/0 (socket says 172.21.15.22:40982) 2024-08-20T01:42:26.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.328+0000 7fe78487f640 1 -- 172.21.15.22:0/269225748 learned_addr learned my addr 172.21.15.22:0/269225748 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:42:26.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.328+0000 7fe77ffff640 1 --2- 172.21.15.22:0/269225748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe780102ad0 0x7fe780198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.328+0000 7fe77f7fe640 1 --2- 172.21.15.22:0/269225748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7801084e0 0x7fe780199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.328+0000 7fe78487f640 1 -- 172.21.15.22:0/269225748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7801084e0 msgr2=0x7fe780199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:26.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.328+0000 7fe78487f640 1 --2- 172.21.15.22:0/269225748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7801084e0 0x7fe780199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.329+0000 7fe78487f640 1 -- 172.21.15.22:0/269225748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe780102ad0 msgr2=0x7fe780198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:26.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.329+0000 7fe78487f640 1 --2- 172.21.15.22:0/269225748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe780102ad0 0x7fe780198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.329+0000 7fe78487f640 1 -- 172.21.15.22:0/269225748 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78019ef90 con 0x7fe780108e60 2024-08-20T01:42:26.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.329+0000 7fe78487f640 1 --2- 172.21.15.22:0/269225748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe780108e60 0x7fe78019e7c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe77800eaa0 tx=0x7fe77800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:26.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.329+0000 7fe77d7fa640 1 -- 172.21.15.22:0/269225748 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe778004d20 con 0x7fe780108e60 2024-08-20T01:42:26.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.329+0000 7fe7862e2640 1 -- 172.21.15.22:0/269225748 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe78019f280 con 0x7fe780108e60 2024-08-20T01:42:26.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.329+0000 7fe77d7fa640 1 -- 172.21.15.22:0/269225748 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe778005020 con 0x7fe780108e60 2024-08-20T01:42:26.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.329+0000 7fe77d7fa640 1 -- 172.21.15.22:0/269225748 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7780116b0 con 0x7fe780108e60 2024-08-20T01:42:26.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.329+0000 7fe7862e2640 1 -- 172.21.15.22:0/269225748 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7801a5940 con 0x7fe780108e60 2024-08-20T01:42:26.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.330+0000 7fe7862e2640 1 -- 172.21.15.22:0/269225748 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe780102eb0 con 0x7fe780108e60 2024-08-20T01:42:26.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.332+0000 7fe77d7fa640 1 -- 172.21.15.22:0/269225748 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe7780051d0 con 0x7fe780108e60 2024-08-20T01:42:26.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.332+0000 7fe77d7fa640 1 --2- 172.21.15.22:0/269225748 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe7680b3bd0 0x7fe7680b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.332+0000 7fe77ffff640 1 --2- 172.21.15.22:0/269225748 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe7680b3bd0 0x7fe7680b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.332+0000 7fe77d7fa640 1 -- 172.21.15.22:0/269225748 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7fe7780e4260 con 0x7fe780108e60 2024-08-20T01:42:26.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.333+0000 7fe77ffff640 1 --2- 172.21.15.22:0/269225748 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe7680b3bd0 0x7fe7680b6090 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe77000abe0 tx=0x7fe77000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:26.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.335+0000 7fe77d7fa640 1 -- 172.21.15.22:0/269225748 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe778016030 con 0x7fe780108e60 2024-08-20T01:42:26.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.522+0000 7fe7862e2640 1 -- 172.21.15.22:0/269225748 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7801a5c60 con 0x7fe780108e60 2024-08-20T01:42:26.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.523+0000 7fe77d7fa640 1 -- 172.21.15.22:0/269225748 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22747 (secure 0 0 0) 0x7fe7780ab810 con 0x7fe780108e60 2024-08-20T01:42:26.527 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-08-20T01:42:26.527 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":81,"fsid":"586fd06c-5e92-11ef-bccf-c7b262605968","created":"2024-08-20T01:20:55.065729+0000","modified":"2024-08-20T01:41:17.967010+0000","last_up_change":"2024-08-20T01:28:14.752931+0000","last_in_change":"2024-08-20T01:27:51.812525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:24:31.674035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:29:02.800545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:29:04.951975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b67a59af-5eea-4073-a4b2-604a1b7b8f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6803","nonce":812056903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6805","nonce":812056903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6809","nonce":812056903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":812056903},{"type":"v1","addr":"172.21.15.22:6807","nonce":812056903}]},"public_addr":"172.21.15.22:6803/812056903","cluster_addr":"172.21.15.22:6805/812056903","heartbeat_back_addr":"172.21.15.22:6809/812056903","heartbeat_front_addr":"172.21.15.22:6807/812056903","state":["exists","up"]},{"osd":1,"uuid":"9f82ba53-b8d7-4e49-bd4a-3d74d8dbf59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6801","nonce":823882511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6803","nonce":823882511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6807","nonce":823882511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":823882511},{"type":"v1","addr":"172.21.15.77:6805","nonce":823882511}]},"public_addr":"172.21.15.77:6801/823882511","cluster_addr":"172.21.15.77:6803/823882511","heartbeat_back_addr":"172.21.15.77:6807/823882511","heartbeat_front_addr":"172.21.15.77:6805/823882511","state":["exists","up"]},{"osd":2,"uuid":"71e3c019-a3e0-4632-81a8-27ac31279f7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6801","nonce":3873702897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6803","nonce":3873702897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6807","nonce":3873702897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3873702897},{"type":"v1","addr":"172.21.15.134:6805","nonce":3873702897}]},"public_addr":"172.21.15.134:6801/3873702897","cluster_addr":"172.21.15.134:6803/3873702897","heartbeat_back_addr":"172.21.15.134:6807/3873702897","heartbeat_front_addr":"172.21.15.134:6805/3873702897","state":["exists","up"]},{"osd":3,"uuid":"a60de748-aa65-477d-864e-6281db1261ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6811","nonce":1775946906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6813","nonce":1775946906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6817","nonce":1775946906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":1775946906},{"type":"v1","addr":"172.21.15.22:6815","nonce":1775946906}]},"public_addr":"172.21.15.22:6811/1775946906","cluster_addr":"172.21.15.22:6813/1775946906","heartbeat_back_addr":"172.21.15.22:6817/1775946906","heartbeat_front_addr":"172.21.15.22:6815/1775946906","state":["exists","up"]},{"osd":4,"uuid":"07d99671-2ece-471c-ad69-fc9043d917f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6809","nonce":1954209322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6811","nonce":1954209322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6815","nonce":1954209322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1954209322},{"type":"v1","addr":"172.21.15.77:6813","nonce":1954209322}]},"public_addr":"172.21.15.77:6809/1954209322","cluster_addr":"172.21.15.77:6811/1954209322","heartbeat_back_addr":"172.21.15.77:6815/1954209322","heartbeat_front_addr":"172.21.15.77:6813/1954209322","state":["exists","up"]},{"osd":5,"uuid":"971cac33-0b98-49b1-b4b2-27354fc0ab90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6809","nonce":2805488123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6811","nonce":2805488123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6815","nonce":2805488123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2805488123},{"type":"v1","addr":"172.21.15.134:6813","nonce":2805488123}]},"public_addr":"172.21.15.134:6809/2805488123","cluster_addr":"172.21.15.134:6811/2805488123","heartbeat_back_addr":"172.21.15.134:6815/2805488123","heartbeat_front_addr":"172.21.15.134:6813/2805488123","state":["exists","up"]},{"osd":6,"uuid":"48d90292-8511-47d6-8093-330bd13ae70e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6819","nonce":3804882416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6821","nonce":3804882416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6825","nonce":3804882416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3804882416},{"type":"v1","addr":"172.21.15.22:6823","nonce":3804882416}]},"public_addr":"172.21.15.22:6819/3804882416","cluster_addr":"172.21.15.22:6821/3804882416","heartbeat_back_addr":"172.21.15.22:6825/3804882416","heartbeat_front_addr":"172.21.15.22:6823/3804882416","state":["exists","up"]},{"osd":7,"uuid":"e217112d-9f56-4a48-93bf-6eb052ce540a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6817","nonce":700318902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6819","nonce":700318902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6823","nonce":700318902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":700318902},{"type":"v1","addr":"172.21.15.77:6821","nonce":700318902}]},"public_addr":"172.21.15.77:6817/700318902","cluster_addr":"172.21.15.77:6819/700318902","heartbeat_back_addr":"172.21.15.77:6823/700318902","heartbeat_front_addr":"172.21.15.77:6821/700318902","state":["exists","up"]},{"osd":8,"uuid":"1786747c-6ff6-4e00-bcf6-a8176215847f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6817","nonce":1635473481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6819","nonce":1635473481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6823","nonce":1635473481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1635473481},{"type":"v1","addr":"172.21.15.134:6821","nonce":1635473481}]},"public_addr":"172.21.15.134:6817/1635473481","cluster_addr":"172.21.15.134:6819/1635473481","heartbeat_back_addr":"172.21.15.134:6823/1635473481","heartbeat_front_addr":"172.21.15.134:6821/1635473481","state":["exists","up"]},{"osd":9,"uuid":"708f7390-1b51-4397-a92a-8ff3f4a5bc45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6827","nonce":3899297933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6829","nonce":3899297933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6833","nonce":3899297933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3899297933},{"type":"v1","addr":"172.21.15.22:6831","nonce":3899297933}]},"public_addr":"172.21.15.22:6827/3899297933","cluster_addr":"172.21.15.22:6829/3899297933","heartbeat_back_addr":"172.21.15.22:6833/3899297933","heartbeat_front_addr":"172.21.15.22:6831/3899297933","state":["exists","up"]},{"osd":10,"uuid":"d15b0acd-dd08-431d-88aa-756b6420987d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6825","nonce":2765589872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6827","nonce":2765589872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6831","nonce":2765589872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2765589872},{"type":"v1","addr":"172.21.15.77:6829","nonce":2765589872}]},"public_addr":"172.21.15.77:6825/2765589872","cluster_addr":"172.21.15.77:6827/2765589872","heartbeat_back_addr":"172.21.15.77:6831/2765589872","heartbeat_front_addr":"172.21.15.77:6829/2765589872","state":["exists","up"]},{"osd":11,"uuid":"d15017fa-3c3d-4096-a35d-275cd54bb9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6825","nonce":964533669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6827","nonce":964533669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6831","nonce":964533669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":964533669},{"type":"v1","addr":"172.21.15.134:6829","nonce":964533669}]},"public_addr":"172.21.15.134:6825/964533669","cluster_addr":"172.21.15.134:6827/964533669","heartbeat_back_addr":"172.21.15.134:6831/964533669","heartbeat_front_addr":"172.21.15.134:6829/964533669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:23:40.839725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:05.141389+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:28.340737+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:24:52.028949+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:17.029913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:25:42.092826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:07.831100+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:33.380447+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:26:58.772655+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:23.017208+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:27:47.966711+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:28:13.123047+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/416470260":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6800/760844170":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/1142422661":"2024-08-21T01:21:53.209795+0000","172.21.15.22:6801/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:6800/1099138788":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/2093308719":"2024-08-21T01:21:53.209795+0000","172.21.15.22:0/3772866379":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3424402756":"2024-08-21T01:21:28.981981+0000","172.21.15.22:0/3864772624":"2024-08-21T01:21:28.981981+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:42:26.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.526+0000 7fe7862e2640 1 -- 172.21.15.22:0/269225748 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe7680b3bd0 msgr2=0x7fe7680b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:26.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.526+0000 7fe7862e2640 1 --2- 172.21.15.22:0/269225748 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe7680b3bd0 0x7fe7680b6090 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe77000abe0 tx=0x7fe77000a2d0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.526+0000 7fe7862e2640 1 -- 172.21.15.22:0/269225748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe780108e60 msgr2=0x7fe78019e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:26.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.526+0000 7fe7862e2640 1 --2- 172.21.15.22:0/269225748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe780108e60 0x7fe78019e7c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe77800eaa0 tx=0x7fe77800eea0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.526+0000 7fe7862e2640 1 -- 172.21.15.22:0/269225748 shutdown_connections 2024-08-20T01:42:26.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.526+0000 7fe7862e2640 1 --2- 172.21.15.22:0/269225748 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fe7680b3bd0 0x7fe7680b6090 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.526+0000 7fe7862e2640 1 --2- 172.21.15.22:0/269225748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe780108e60 0x7fe78019e7c0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.526+0000 7fe7862e2640 1 --2- 172.21.15.22:0/269225748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7801084e0 0x7fe780199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.526+0000 7fe7862e2640 1 --2- 172.21.15.22:0/269225748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe780102ad0 0x7fe780198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.526+0000 7fe7862e2640 1 -- 172.21.15.22:0/269225748 >> 172.21.15.22:0/269225748 conn(0x7fe7800fe540 msgr2=0x7fe780100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:26.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.526+0000 7fe7862e2640 1 -- 172.21.15.22:0/269225748 shutdown_connections 2024-08-20T01:42:26.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:26.526+0000 7fe7862e2640 1 -- 172.21.15.22:0/269225748 wait complete. 2024-08-20T01:42:27.195 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:27 smithi022 ceph-mon[18709]: pgmap v687: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 6 op/s 2024-08-20T01:42:27.195 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:27 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/269225748' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:42:27.224 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs fail cephfs 2024-08-20T01:42:27.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:27 smithi077 ceph-mon[22251]: pgmap v687: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 6 op/s 2024-08-20T01:42:27.315 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:27 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/269225748' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:42:27.482 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:27.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:27 smithi134 ceph-mon[22511]: pgmap v687: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 6 op/s 2024-08-20T01:42:27.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:27 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/269225748' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:42:27.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.913+0000 7f85e0a39640 1 -- 172.21.15.22:0/885133803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85dc108e60 msgr2=0x7f85dc10f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:27.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.913+0000 7f85e0a39640 1 --2- 172.21.15.22:0/885133803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85dc108e60 0x7f85dc10f660 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009ca0 tx=0x7f85d402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.913+0000 7f85e0a39640 1 -- 172.21.15.22:0/885133803 shutdown_connections 2024-08-20T01:42:27.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.913+0000 7f85e0a39640 1 --2- 172.21.15.22:0/885133803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85dc108e60 0x7f85dc10f660 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.913+0000 7f85e0a39640 1 --2- 172.21.15.22:0/885133803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85dc1084e0 0x7f85dc108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.913+0000 7f85e0a39640 1 --2- 172.21.15.22:0/885133803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85dc102ad0 0x7f85dc102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.913+0000 7f85e0a39640 1 -- 172.21.15.22:0/885133803 >> 172.21.15.22:0/885133803 conn(0x7f85dc0fe540 msgr2=0x7f85dc100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:27.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.913+0000 7f85e0a39640 1 -- 172.21.15.22:0/885133803 shutdown_connections 2024-08-20T01:42:27.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.913+0000 7f85e0a39640 1 -- 172.21.15.22:0/885133803 wait complete. 2024-08-20T01:42:27.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.914+0000 7f85e0a39640 1 Processor -- start 2024-08-20T01:42:27.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.914+0000 7f85e0a39640 1 -- start start 2024-08-20T01:42:27.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.914+0000 7f85e0a39640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85dc102ad0 0x7f85dc198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.914+0000 7f85e0a39640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85dc1084e0 0x7f85dc199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.914+0000 7f85e0a39640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85dc108e60 0x7f85dc19e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.914+0000 7f85e0a39640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc112b20 con 0x7f85dc1084e0 2024-08-20T01:42:27.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.914+0000 7f85e0a39640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc1129a0 con 0x7f85dc102ad0 2024-08-20T01:42:27.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.914+0000 7f85e0a39640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc112ca0 con 0x7f85dc108e60 2024-08-20T01:42:27.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.914+0000 7f85d3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85dc1084e0 0x7f85dc199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.914+0000 7f85d3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85dc1084e0 0x7f85dc199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41012/0 (socket says 172.21.15.22:41012) 2024-08-20T01:42:27.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.914+0000 7f85d3fff640 1 -- 172.21.15.22:0/2933753672 learned_addr learned my addr 172.21.15.22:0/2933753672 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:42:27.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.914+0000 7f85dad9d640 1 --2- 172.21.15.22:0/2933753672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85dc108e60 0x7f85dc19e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.914+0000 7f85da59c640 1 --2- 172.21.15.22:0/2933753672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85dc102ad0 0x7f85dc198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.914+0000 7f85d3fff640 1 -- 172.21.15.22:0/2933753672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85dc108e60 msgr2=0x7f85dc19e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:27.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.914+0000 7f85d3fff640 1 --2- 172.21.15.22:0/2933753672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85dc108e60 0x7f85dc19e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.914+0000 7f85d3fff640 1 -- 172.21.15.22:0/2933753672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85dc102ad0 msgr2=0x7f85dc198ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:27.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.914+0000 7f85d3fff640 1 --2- 172.21.15.22:0/2933753672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85dc102ad0 0x7f85dc198ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.914+0000 7f85d3fff640 1 -- 172.21.15.22:0/2933753672 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85dc19ef80 con 0x7f85dc1084e0 2024-08-20T01:42:27.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.915+0000 7f85d3fff640 1 --2- 172.21.15.22:0/2933753672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85dc1084e0 0x7f85dc199410 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f85c400c920 tx=0x7f85c400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:27.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.915+0000 7f85d37fe640 1 -- 172.21.15.22:0/2933753672 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c4007c70 con 0x7f85dc1084e0 2024-08-20T01:42:27.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.915+0000 7f85e0a39640 1 -- 172.21.15.22:0/2933753672 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85dc19f270 con 0x7f85dc1084e0 2024-08-20T01:42:27.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.915+0000 7f85d37fe640 1 -- 172.21.15.22:0/2933753672 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85c4007e10 con 0x7f85dc1084e0 2024-08-20T01:42:27.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.915+0000 7f85d37fe640 1 -- 172.21.15.22:0/2933753672 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c4018820 con 0x7f85dc1084e0 2024-08-20T01:42:27.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.915+0000 7f85e0a39640 1 -- 172.21.15.22:0/2933753672 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85dc1a5930 con 0x7f85dc1084e0 2024-08-20T01:42:27.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.916+0000 7f85e0a39640 1 -- 172.21.15.22:0/2933753672 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85dc102eb0 con 0x7f85dc1084e0 2024-08-20T01:42:27.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.917+0000 7f85d37fe640 1 -- 172.21.15.22:0/2933753672 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f85c400f450 con 0x7f85dc1084e0 2024-08-20T01:42:27.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.918+0000 7f85d37fe640 1 --2- 172.21.15.22:0/2933753672 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f85c80b3bd0 0x7f85c80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.918+0000 7f85da59c640 1 --2- 172.21.15.22:0/2933753672 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f85c80b3bd0 0x7f85c80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.918+0000 7f85d37fe640 1 -- 172.21.15.22:0/2933753672 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8298+0+0 (secure 0 0 0) 0x7f85c40e4010 con 0x7f85dc1084e0 2024-08-20T01:42:27.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.919+0000 7f85da59c640 1 --2- 172.21.15.22:0/2933753672 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f85c80b3bd0 0x7f85c80b6090 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f85cc005fd0 tx=0x7f85cc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:27.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:27.921+0000 7f85d37fe640 1 -- 172.21.15.22:0/2933753672 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f85c4014030 con 0x7f85dc1084e0 2024-08-20T01:42:28.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:28.144+0000 7f85e0a39640 1 -- 172.21.15.22:0/2933753672 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f85dc1a5c80 con 0x7f85dc1084e0 2024-08-20T01:42:28.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:28.146+0000 7f85d37fe640 1 -- 172.21.15.22:0/2933753672 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) ==== 161+0+0 (secure 0 0 0) 0x7f85c40ab6b0 con 0x7f85dc1084e0 2024-08-20T01:42:28.149 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-20T01:42:28.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:28.149+0000 7f85e0a39640 1 -- 172.21.15.22:0/2933753672 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f85c80b3bd0 msgr2=0x7f85c80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:28.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:28.149+0000 7f85e0a39640 1 --2- 172.21.15.22:0/2933753672 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f85c80b3bd0 0x7f85c80b6090 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f85cc005fd0 tx=0x7f85cc005850 comp rx=0 tx=0).stop 2024-08-20T01:42:28.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:28.149+0000 7f85e0a39640 1 -- 172.21.15.22:0/2933753672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85dc1084e0 msgr2=0x7f85dc199410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:28.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:28.149+0000 7f85e0a39640 1 --2- 172.21.15.22:0/2933753672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85dc1084e0 0x7f85dc199410 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f85c400c920 tx=0x7f85c400cde0 comp rx=0 tx=0).stop 2024-08-20T01:42:28.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:28.149+0000 7f85e0a39640 1 -- 172.21.15.22:0/2933753672 shutdown_connections 2024-08-20T01:42:28.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:28.149+0000 7f85e0a39640 1 --2- 172.21.15.22:0/2933753672 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f85c80b3bd0 0x7f85c80b6090 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:28.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:28.149+0000 7f85e0a39640 1 --2- 172.21.15.22:0/2933753672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85dc108e60 0x7f85dc19e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:28.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:28.149+0000 7f85e0a39640 1 --2- 172.21.15.22:0/2933753672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85dc1084e0 0x7f85dc199410 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:28.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:28.149+0000 7f85e0a39640 1 --2- 172.21.15.22:0/2933753672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85dc102ad0 0x7f85dc198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:28.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:28.149+0000 7f85e0a39640 1 -- 172.21.15.22:0/2933753672 >> 172.21.15.22:0/2933753672 conn(0x7f85dc0fe540 msgr2=0x7f85dc100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:28.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:28.150+0000 7f85e0a39640 1 -- 172.21.15.22:0/2933753672 shutdown_connections 2024-08-20T01:42:28.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:28.150+0000 7f85e0a39640 1 -- 172.21.15.22:0/2933753672 wait complete. 2024-08-20T01:42:28.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:28 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-a[18705]: 2024-08-20T01:42:28.145+0000 7f74ed0d8640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-20T01:42:28.449 INFO:journalctl@ceph.mds.c.smithi134.stdout:Aug 20 01:42:28 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-c[52689]: ignoring --setuser ceph since I am not root 2024-08-20T01:42:28.449 INFO:journalctl@ceph.mds.c.smithi134.stdout:Aug 20 01:42:28 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-c[52689]: ignoring --setgroup ceph since I am not root 2024-08-20T01:42:28.450 INFO:journalctl@ceph.mds.c.smithi134.stdout:Aug 20 01:42:28 smithi134 ceph-mds[52695]: -- 172.21.15.134:0/1304970461 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ba79521c20 con 0x55ba794ff000 2024-08-20T01:42:28.450 INFO:journalctl@ceph.mds.c.smithi134.stdout:Aug 20 01:42:28 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-c[52689]: starting mds.c at 2024-08-20T01:42:28.450 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:42:28 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f[56575]: ignoring --setuser ceph since I am not root 2024-08-20T01:42:28.450 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:42:28 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f[56575]: ignoring --setgroup ceph since I am not root 2024-08-20T01:42:28.450 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:42:28 smithi134 ceph-mds[56579]: -- 172.21.15.134:0/3708564378 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555ec593d860 con 0x555ec591a800 2024-08-20T01:42:28.450 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:42:28 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f[56575]: starting mds.f at 2024-08-20T01:42:28.450 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:42:28 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i[52992]: ignoring --setuser ceph since I am not root 2024-08-20T01:42:28.451 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:42:28 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i[52992]: ignoring --setgroup ceph since I am not root 2024-08-20T01:42:28.451 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:42:28 smithi134 ceph-mds[52996]: -- 172.21.15.134:0/200825615 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5623579c1860 con 0x56235799f000 2024-08-20T01:42:28.451 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:42:28 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i[52992]: starting mds.i at 2024-08-20T01:42:28.565 INFO:journalctl@ceph.mds.h.smithi077.stdout:Aug 20 01:42:28 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-h[51570]: ignoring --setuser ceph since I am not root 2024-08-20T01:42:28.565 INFO:journalctl@ceph.mds.h.smithi077.stdout:Aug 20 01:42:28 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-h[51570]: ignoring --setgroup ceph since I am not root 2024-08-20T01:42:28.565 INFO:journalctl@ceph.mds.h.smithi077.stdout:Aug 20 01:42:28 smithi077 ceph-mds[51574]: -- 172.21.15.77:0/100938994 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557ae1f29860 con 0x557ae1f07000 2024-08-20T01:42:28.565 INFO:journalctl@ceph.mds.h.smithi077.stdout:Aug 20 01:42:28 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-h[51570]: starting mds.h at 2024-08-20T01:42:28.566 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:42:28 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-b[51871]: ignoring --setuser ceph since I am not root 2024-08-20T01:42:28.566 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:42:28 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-b[51871]: ignoring --setgroup ceph since I am not root 2024-08-20T01:42:28.566 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:42:28 smithi077 ceph-mds[51875]: -- 172.21.15.77:0/1646164884 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558637743860 con 0x558637720800 2024-08-20T01:42:28.566 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:42:28 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-b[51871]: starting mds.b at 2024-08-20T01:42:28.566 INFO:journalctl@ceph.mds.e.smithi077.stdout:Aug 20 01:42:28 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-e[51266]: ignoring --setuser ceph since I am not root 2024-08-20T01:42:28.566 INFO:journalctl@ceph.mds.e.smithi077.stdout:Aug 20 01:42:28 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-e[51266]: ignoring --setgroup ceph since I am not root 2024-08-20T01:42:28.566 INFO:journalctl@ceph.mds.e.smithi077.stdout:Aug 20 01:42:28 smithi077 ceph-mds[51270]: -- 172.21.15.77:0/2533093590 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ee57bdb860 con 0x55ee57bb9000 2024-08-20T01:42:28.566 INFO:journalctl@ceph.mds.e.smithi077.stdout:Aug 20 01:42:28 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-e[51266]: starting mds.e at 2024-08-20T01:42:28.828 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-08-20T01:42:29.090 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:29.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:29 smithi022 ceph-mon[18709]: pgmap v688: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-20T01:42:29.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:29 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2933753672' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-20T01:42:29.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:29 smithi022 ceph-mon[18709]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-20T01:42:29.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:29 smithi022 ceph-mon[18709]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-20T01:42:29.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:29 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2933753672' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-20T01:42:29.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:29 smithi022 ceph-mon[18709]: osdmap e82: 12 total, 12 up, 12 in 2024-08-20T01:42:29.334 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:29 smithi022 ceph-mon[18709]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-20T01:42:29.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:29 smithi134 ceph-mon[22511]: pgmap v688: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-20T01:42:29.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:29 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2933753672' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-20T01:42:29.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:29 smithi134 ceph-mon[22511]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-20T01:42:29.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:29 smithi134 ceph-mon[22511]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-20T01:42:29.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:29 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2933753672' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-20T01:42:29.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:29 smithi134 ceph-mon[22511]: osdmap e82: 12 total, 12 up, 12 in 2024-08-20T01:42:29.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:29 smithi134 ceph-mon[22511]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-20T01:42:29.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:29 smithi077 ceph-mon[22251]: pgmap v688: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-20T01:42:29.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:29 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2933753672' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-20T01:42:29.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:29 smithi077 ceph-mon[22251]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-20T01:42:29.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:29 smithi077 ceph-mon[22251]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-20T01:42:29.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:29 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2933753672' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-20T01:42:29.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:29 smithi077 ceph-mon[22251]: osdmap e82: 12 total, 12 up, 12 in 2024-08-20T01:42:29.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:29 smithi077 ceph-mon[22251]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-20T01:42:29.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.557+0000 7f03aea6f640 1 -- 172.21.15.22:0/1826229399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a8107d20 msgr2=0x7f03a810e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:29.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.557+0000 7f03aea6f640 1 --2- 172.21.15.22:0/1826229399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a8107d20 0x7f03a810e520 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009ca0 tx=0x7f03a002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.557+0000 7f03aea6f640 1 -- 172.21.15.22:0/1826229399 shutdown_connections 2024-08-20T01:42:29.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.557+0000 7f03aea6f640 1 --2- 172.21.15.22:0/1826229399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a8107d20 0x7f03a810e520 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.557+0000 7f03aea6f640 1 --2- 172.21.15.22:0/1826229399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03a81073a0 0x7f03a81077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.557+0000 7f03aea6f640 1 --2- 172.21.15.22:0/1826229399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03a8101990 0x7f03a8101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.557+0000 7f03aea6f640 1 -- 172.21.15.22:0/1826229399 >> 172.21.15.22:0/1826229399 conn(0x7f03a80fd400 msgr2=0x7f03a80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:29.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.557+0000 7f03aea6f640 1 -- 172.21.15.22:0/1826229399 shutdown_connections 2024-08-20T01:42:29.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.557+0000 7f03aea6f640 1 -- 172.21.15.22:0/1826229399 wait complete. 2024-08-20T01:42:29.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.558+0000 7f03aea6f640 1 Processor -- start 2024-08-20T01:42:29.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.558+0000 7f03aea6f640 1 -- start start 2024-08-20T01:42:29.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.558+0000 7f03aea6f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03a8101990 0x7f03a8196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.558+0000 7f03aea6f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a81073a0 0x7f03a81972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.558+0000 7f03aea6f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03a8107d20 0x7f03a819c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.558+0000 7f03aea6f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f03a81108e0 con 0x7f03a81073a0 2024-08-20T01:42:29.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.558+0000 7f03aea6f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f03a8110760 con 0x7f03a8107d20 2024-08-20T01:42:29.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.558+0000 7f03aea6f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f03a8110a60 con 0x7f03a8101990 2024-08-20T01:42:29.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.558+0000 7f03a7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a81073a0 0x7f03a81972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.558+0000 7f03a7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a81073a0 0x7f03a81972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41026/0 (socket says 172.21.15.22:41026) 2024-08-20T01:42:29.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.558+0000 7f03a7fff640 1 -- 172.21.15.22:0/213367668 learned_addr learned my addr 172.21.15.22:0/213367668 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:42:29.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.558+0000 7f03ad00c640 1 --2- 172.21.15.22:0/213367668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03a8107d20 0x7f03a819c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.558+0000 7f03ac80b640 1 --2- 172.21.15.22:0/213367668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03a8101990 0x7f03a8196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.559+0000 7f03a7fff640 1 -- 172.21.15.22:0/213367668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03a8101990 msgr2=0x7f03a8196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:29.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.559+0000 7f03a7fff640 1 --2- 172.21.15.22:0/213367668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03a8101990 0x7f03a8196db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.559+0000 7f03a7fff640 1 -- 172.21.15.22:0/213367668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03a8107d20 msgr2=0x7f03a819c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:29.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.559+0000 7f03a7fff640 1 --2- 172.21.15.22:0/213367668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03a8107d20 0x7f03a819c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.559+0000 7f03a7fff640 1 -- 172.21.15.22:0/213367668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a819ce60 con 0x7f03a81073a0 2024-08-20T01:42:29.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.559+0000 7f03a7fff640 1 --2- 172.21.15.22:0/213367668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a81073a0 0x7f03a81972f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f039400e9f0 tx=0x7f039400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:29.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.559+0000 7f03a5ffb640 1 -- 172.21.15.22:0/213367668 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039400cd80 con 0x7f03a81073a0 2024-08-20T01:42:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.559+0000 7f03a5ffb640 1 -- 172.21.15.22:0/213367668 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03940108e0 con 0x7f03a81073a0 2024-08-20T01:42:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.559+0000 7f03aea6f640 1 -- 172.21.15.22:0/213367668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a819d150 con 0x7f03a81073a0 2024-08-20T01:42:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.559+0000 7f03a5ffb640 1 -- 172.21.15.22:0/213367668 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0394018980 con 0x7f03a81073a0 2024-08-20T01:42:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.559+0000 7f03aea6f640 1 -- 172.21.15.22:0/213367668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a81a3810 con 0x7f03a81073a0 2024-08-20T01:42:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.560+0000 7f03aea6f640 1 -- 172.21.15.22:0/213367668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a8101d70 con 0x7f03a81073a0 2024-08-20T01:42:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.562+0000 7f03a5ffb640 1 -- 172.21.15.22:0/213367668 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0394010430 con 0x7f03a81073a0 2024-08-20T01:42:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.563+0000 7f03a5ffb640 1 --2- 172.21.15.22:0/213367668 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f03980b3bd0 0x7f03980b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.563+0000 7f03ac80b640 1 --2- 172.21.15.22:0/213367668 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f03980b3bd0 0x7f03980b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.564+0000 7f03a5ffb640 1 -- 172.21.15.22:0/213367668 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8556+0+0 (secure 0 0 0) 0x7f03940e4480 con 0x7f03a81073a0 2024-08-20T01:42:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.564+0000 7f03ac80b640 1 --2- 172.21.15.22:0/213367668 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f03980b3bd0 0x7f03980b6090 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f039c005d00 tx=0x7f039c00b580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.566+0000 7f03a5ffb640 1 -- 172.21.15.22:0/213367668 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f03940ab340 con 0x7f03a81073a0 2024-08-20T01:42:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:29.788+0000 7f03aea6f640 1 -- 172.21.15.22:0/213367668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f03a802e340 con 0x7f03a81073a0 2024-08-20T01:42:30.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:30.153+0000 7f03a5ffb640 1 -- 172.21.15.22:0/213367668 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) ==== 104+0+0 (secure 0 0 0) 0x7f03940af890 con 0x7f03a81073a0 2024-08-20T01:42:30.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:30.156+0000 7f03aea6f640 1 -- 172.21.15.22:0/213367668 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f03980b3bd0 msgr2=0x7f03980b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:30.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:30.156+0000 7f03aea6f640 1 --2- 172.21.15.22:0/213367668 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f03980b3bd0 0x7f03980b6090 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f039c005d00 tx=0x7f039c00b580 comp rx=0 tx=0).stop 2024-08-20T01:42:30.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:30.156+0000 7f03aea6f640 1 -- 172.21.15.22:0/213367668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a81073a0 msgr2=0x7f03a81972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:30.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:30.156+0000 7f03aea6f640 1 --2- 172.21.15.22:0/213367668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a81073a0 0x7f03a81972f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f039400e9f0 tx=0x7f039400eeb0 comp rx=0 tx=0).stop 2024-08-20T01:42:30.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:30.156+0000 7f03aea6f640 1 -- 172.21.15.22:0/213367668 shutdown_connections 2024-08-20T01:42:30.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:30.156+0000 7f03aea6f640 1 --2- 172.21.15.22:0/213367668 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f03980b3bd0 0x7f03980b6090 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:30.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:30.156+0000 7f03aea6f640 1 --2- 172.21.15.22:0/213367668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03a8107d20 0x7f03a819c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:30.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:30.156+0000 7f03aea6f640 1 --2- 172.21.15.22:0/213367668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a81073a0 0x7f03a81972f0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:30.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:30.156+0000 7f03aea6f640 1 --2- 172.21.15.22:0/213367668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03a8101990 0x7f03a8196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:30.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:30.156+0000 7f03aea6f640 1 -- 172.21.15.22:0/213367668 >> 172.21.15.22:0/213367668 conn(0x7f03a80fd400 msgr2=0x7f03a80fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:30.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:30.156+0000 7f03aea6f640 1 -- 172.21.15.22:0/213367668 shutdown_connections 2024-08-20T01:42:30.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:30.156+0000 7f03aea6f640 1 -- 172.21.15.22:0/213367668 wait complete. 2024-08-20T01:42:30.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:30 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.134:6834/3071923274,v1:172.21.15.134:6835/3071923274] up:boot 2024-08-20T01:42:30.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:30 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.134:6836/3095197623,v1:172.21.15.134:6838/3095197623] up:boot 2024-08-20T01:42:30.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:30 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.134:6837/177925087,v1:172.21.15.134:6839/177925087] up:boot 2024-08-20T01:42:30.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:30 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.77:6834/2158041284,v1:172.21.15.77:6835/2158041284] up:boot 2024-08-20T01:42:30.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:30 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.77:6836/1478524168,v1:172.21.15.77:6838/1478524168] up:boot 2024-08-20T01:42:30.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:30 smithi134 ceph-mon[22511]: mds.? [v2:172.21.15.77:6837/2851444270,v1:172.21.15.77:6839/2851444270] up:boot 2024-08-20T01:42:30.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:30 smithi134 ceph-mon[22511]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-20T01:42:30.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:30 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T01:42:30.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:30 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-20T01:42:30.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:30 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-20T01:42:30.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:30 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-20T01:42:30.518 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:30 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-20T01:42:30.518 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:30 smithi134 ceph-mon[22511]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-20T01:42:30.518 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:30 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/213367668' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-20T01:42:30.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:30 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.134:6834/3071923274,v1:172.21.15.134:6835/3071923274] up:boot 2024-08-20T01:42:30.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:30 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.134:6836/3095197623,v1:172.21.15.134:6838/3095197623] up:boot 2024-08-20T01:42:30.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:30 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.134:6837/177925087,v1:172.21.15.134:6839/177925087] up:boot 2024-08-20T01:42:30.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:30 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.77:6834/2158041284,v1:172.21.15.77:6835/2158041284] up:boot 2024-08-20T01:42:30.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:30 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.77:6836/1478524168,v1:172.21.15.77:6838/1478524168] up:boot 2024-08-20T01:42:30.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:30 smithi022 ceph-mon[18709]: mds.? [v2:172.21.15.77:6837/2851444270,v1:172.21.15.77:6839/2851444270] up:boot 2024-08-20T01:42:30.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:30 smithi022 ceph-mon[18709]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-20T01:42:30.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:30 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T01:42:30.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:30 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-20T01:42:30.527 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:30 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-20T01:42:30.527 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:30 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-20T01:42:30.527 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:30 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-20T01:42:30.527 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:30 smithi022 ceph-mon[18709]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-20T01:42:30.527 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:30 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/213367668' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-20T01:42:30.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:30 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.134:6834/3071923274,v1:172.21.15.134:6835/3071923274] up:boot 2024-08-20T01:42:30.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:30 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.134:6836/3095197623,v1:172.21.15.134:6838/3095197623] up:boot 2024-08-20T01:42:30.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:30 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.134:6837/177925087,v1:172.21.15.134:6839/177925087] up:boot 2024-08-20T01:42:30.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:30 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.77:6834/2158041284,v1:172.21.15.77:6835/2158041284] up:boot 2024-08-20T01:42:30.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:30 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.77:6836/1478524168,v1:172.21.15.77:6838/1478524168] up:boot 2024-08-20T01:42:30.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:30 smithi077 ceph-mon[22251]: mds.? [v2:172.21.15.77:6837/2851444270,v1:172.21.15.77:6839/2851444270] up:boot 2024-08-20T01:42:30.566 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:30 smithi077 ceph-mon[22251]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-20T01:42:30.566 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:30 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T01:42:30.566 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:30 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-20T01:42:30.566 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:30 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-20T01:42:30.566 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:30 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-20T01:42:30.566 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:30 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-20T01:42:30.566 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:30 smithi077 ceph-mon[22251]: from='mgr.14150 172.21.15.22:0/3702264116' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-20T01:42:30.566 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:30 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/213367668' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-20T01:42:30.997 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-20T01:42:31.263 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:31.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:31 smithi022 ceph-mon[18709]: pgmap v690: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 921 B/s wr, 7 op/s 2024-08-20T01:42:31.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:31 smithi022 ceph-mon[18709]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-20T01:42:31.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:31 smithi022 ceph-mon[18709]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-20T01:42:31.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:31 smithi022 ceph-mon[18709]: Cluster is now healthy 2024-08-20T01:42:31.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:31 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/213367668' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-20T01:42:31.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:31 smithi022 ceph-mon[18709]: fsmap 12 up:standby 2024-08-20T01:42:31.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:31 smithi134 ceph-mon[22511]: pgmap v690: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 921 B/s wr, 7 op/s 2024-08-20T01:42:31.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:31 smithi134 ceph-mon[22511]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-20T01:42:31.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:31 smithi134 ceph-mon[22511]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-20T01:42:31.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:31 smithi134 ceph-mon[22511]: Cluster is now healthy 2024-08-20T01:42:31.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:31 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/213367668' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-20T01:42:31.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:31 smithi134 ceph-mon[22511]: fsmap 12 up:standby 2024-08-20T01:42:31.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:31 smithi077 ceph-mon[22251]: pgmap v690: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 921 B/s wr, 7 op/s 2024-08-20T01:42:31.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:31 smithi077 ceph-mon[22251]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-20T01:42:31.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:31 smithi077 ceph-mon[22251]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-20T01:42:31.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:31 smithi077 ceph-mon[22251]: Cluster is now healthy 2024-08-20T01:42:31.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:31 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/213367668' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-20T01:42:31.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:31 smithi077 ceph-mon[22251]: fsmap 12 up:standby 2024-08-20T01:42:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.740+0000 7fd00ba91640 1 -- 172.21.15.22:0/2631743294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd004102a90 msgr2=0x7fd004102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:31.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.740+0000 7fd00ba91640 1 --2- 172.21.15.22:0/2631743294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd004102a90 0x7fd004102e70 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fd000009900 tx=0x7fd00002a410 comp rx=0 tx=0).stop 2024-08-20T01:42:31.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.740+0000 7fd00ba91640 1 -- 172.21.15.22:0/2631743294 shutdown_connections 2024-08-20T01:42:31.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.740+0000 7fd00ba91640 1 --2- 172.21.15.22:0/2631743294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd004108e20 0x7fd00410f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.740+0000 7fd00ba91640 1 --2- 172.21.15.22:0/2631743294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0041084a0 0x7fd0041088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.740+0000 7fd00ba91640 1 --2- 172.21.15.22:0/2631743294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd004102a90 0x7fd004102e70 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.740+0000 7fd00ba91640 1 -- 172.21.15.22:0/2631743294 >> 172.21.15.22:0/2631743294 conn(0x7fd0040fe540 msgr2=0x7fd004100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:31.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.740+0000 7fd00ba91640 1 -- 172.21.15.22:0/2631743294 shutdown_connections 2024-08-20T01:42:31.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.740+0000 7fd00ba91640 1 -- 172.21.15.22:0/2631743294 wait complete. 2024-08-20T01:42:31.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.741+0000 7fd00ba91640 1 Processor -- start 2024-08-20T01:42:31.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.741+0000 7fd00ba91640 1 -- start start 2024-08-20T01:42:31.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.741+0000 7fd00ba91640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd004102a90 0x7fd0041990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.741+0000 7fd00ba91640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0041084a0 0x7fd0041995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.741+0000 7fd00ba91640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd004108e20 0x7fd00419e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.741+0000 7fd00ba91640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd004112ae0 con 0x7fd0041084a0 2024-08-20T01:42:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.741+0000 7fd00ba91640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd004112960 con 0x7fd004102a90 2024-08-20T01:42:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.741+0000 7fd00ba91640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd004112c60 con 0x7fd004108e20 2024-08-20T01:42:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.742+0000 7fd00902c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0041084a0 0x7fd0041995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.742+0000 7fd00902c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0041084a0 0x7fd0041995f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39730/0 (socket says 172.21.15.22:39730) 2024-08-20T01:42:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.742+0000 7fd00902c640 1 -- 172.21.15.22:0/2188314930 learned_addr learned my addr 172.21.15.22:0/2188314930 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:42:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.742+0000 7fd00a02e640 1 --2- 172.21.15.22:0/2188314930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd004108e20 0x7fd00419e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.742+0000 7fd00982d640 1 --2- 172.21.15.22:0/2188314930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd004102a90 0x7fd0041990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.742+0000 7fd00902c640 1 -- 172.21.15.22:0/2188314930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd004108e20 msgr2=0x7fd00419e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.742+0000 7fd00902c640 1 --2- 172.21.15.22:0/2188314930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd004108e20 0x7fd00419e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.742+0000 7fd00902c640 1 -- 172.21.15.22:0/2188314930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd004102a90 msgr2=0x7fd0041990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.742+0000 7fd00902c640 1 --2- 172.21.15.22:0/2188314930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd004102a90 0x7fd0041990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.742+0000 7fd00902c640 1 -- 172.21.15.22:0/2188314930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00419f160 con 0x7fd0041084a0 2024-08-20T01:42:31.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.742+0000 7fd00902c640 1 --2- 172.21.15.22:0/2188314930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0041084a0 0x7fd0041995f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fcff400b4a0 tx=0x7fcff400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:31.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.742+0000 7fcffaffd640 1 -- 172.21.15.22:0/2188314930 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff4014070 con 0x7fd0041084a0 2024-08-20T01:42:31.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.742+0000 7fcffaffd640 1 -- 172.21.15.22:0/2188314930 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcff4010ac0 con 0x7fd0041084a0 2024-08-20T01:42:31.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.742+0000 7fd00ba91640 1 -- 172.21.15.22:0/2188314930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd00419f450 con 0x7fd0041084a0 2024-08-20T01:42:31.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.742+0000 7fcffaffd640 1 -- 172.21.15.22:0/2188314930 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff4017c30 con 0x7fd0041084a0 2024-08-20T01:42:31.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.742+0000 7fd00ba91640 1 -- 172.21.15.22:0/2188314930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0041a5b10 con 0x7fd0041084a0 2024-08-20T01:42:31.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.743+0000 7fd00ba91640 1 -- 172.21.15.22:0/2188314930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd004102e70 con 0x7fd0041084a0 2024-08-20T01:42:31.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.746+0000 7fcffaffd640 1 -- 172.21.15.22:0/2188314930 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcff4017070 con 0x7fd0041084a0 2024-08-20T01:42:31.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.747+0000 7fcffaffd640 1 --2- 172.21.15.22:0/2188314930 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcff00b3bd0 0x7fcff00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.747+0000 7fd00982d640 1 --2- 172.21.15.22:0/2188314930 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcff00b3bd0 0x7fcff00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.747+0000 7fcffaffd640 1 -- 172.21.15.22:0/2188314930 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8556+0+0 (secure 0 0 0) 0x7fcff40e3480 con 0x7fd0041084a0 2024-08-20T01:42:31.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.747+0000 7fd00982d640 1 --2- 172.21.15.22:0/2188314930 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcff00b3bd0 0x7fcff00b6090 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd000031440 tx=0x7fd0000095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:31.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.750+0000 7fcffaffd640 1 -- 172.21.15.22:0/2188314930 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fcff40aa930 con 0x7fd0041084a0 2024-08-20T01:42:31.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:31.935+0000 7fd00ba91640 1 -- 172.21.15.22:0/2188314930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd00410ac60 con 0x7fd0041084a0 2024-08-20T01:42:32.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:32.161+0000 7fcffaffd640 1 -- 172.21.15.22:0/2188314930 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v83) ==== 181+0+0 (secure 0 0 0) 0x7fcff40aa230 con 0x7fd0041084a0 2024-08-20T01:42:32.164 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2024-08-20T01:42:32.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:32.164+0000 7fd00ba91640 1 -- 172.21.15.22:0/2188314930 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcff00b3bd0 msgr2=0x7fcff00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:32.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:32.164+0000 7fd00ba91640 1 --2- 172.21.15.22:0/2188314930 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcff00b3bd0 0x7fcff00b6090 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd000031440 tx=0x7fd0000095f0 comp rx=0 tx=0).stop 2024-08-20T01:42:32.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:32.164+0000 7fd00ba91640 1 -- 172.21.15.22:0/2188314930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0041084a0 msgr2=0x7fd0041995f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:32.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:32.164+0000 7fd00ba91640 1 --2- 172.21.15.22:0/2188314930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0041084a0 0x7fd0041995f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fcff400b4a0 tx=0x7fcff400b960 comp rx=0 tx=0).stop 2024-08-20T01:42:32.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:32.164+0000 7fd00ba91640 1 -- 172.21.15.22:0/2188314930 shutdown_connections 2024-08-20T01:42:32.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:32.164+0000 7fd00ba91640 1 --2- 172.21.15.22:0/2188314930 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7fcff00b3bd0 0x7fcff00b6090 secure :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd000031440 tx=0x7fd0000095f0 comp rx=0 tx=0).stop 2024-08-20T01:42:32.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:32.164+0000 7fd00ba91640 1 --2- 172.21.15.22:0/2188314930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd004108e20 0x7fd00419e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:32.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:32.164+0000 7fd00ba91640 1 --2- 172.21.15.22:0/2188314930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0041084a0 0x7fd0041995f0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:32.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:32.164+0000 7fd00ba91640 1 --2- 172.21.15.22:0/2188314930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd004102a90 0x7fd0041990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:32.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:32.164+0000 7fd00ba91640 1 -- 172.21.15.22:0/2188314930 >> 172.21.15.22:0/2188314930 conn(0x7fd0040fe540 msgr2=0x7fd004100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:32.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:32.165+0000 7fd00ba91640 1 -- 172.21.15.22:0/2188314930 shutdown_connections 2024-08-20T01:42:32.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:32.165+0000 7fd00ba91640 1 -- 172.21.15.22:0/2188314930 wait complete. 2024-08-20T01:42:32.304 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:32 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2188314930' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T01:42:32.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:32 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2188314930' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T01:42:32.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:32 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2188314930' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T01:42:33.016 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-20T01:42:33.288 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:33.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:33 smithi022 ceph-mon[18709]: pgmap v691: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 919 B/s wr, 5 op/s 2024-08-20T01:42:33.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:33 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/2188314930' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T01:42:33.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:33 smithi022 ceph-mon[18709]: osdmap e83: 12 total, 12 up, 12 in 2024-08-20T01:42:33.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:33 smithi134 ceph-mon[22511]: pgmap v691: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 919 B/s wr, 5 op/s 2024-08-20T01:42:33.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:33 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/2188314930' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T01:42:33.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:33 smithi134 ceph-mon[22511]: osdmap e83: 12 total, 12 up, 12 in 2024-08-20T01:42:33.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:33 smithi077 ceph-mon[22251]: pgmap v691: 97 pgs: 97 active+clean; 473 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 919 B/s wr, 5 op/s 2024-08-20T01:42:33.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:33 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/2188314930' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T01:42:33.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:33 smithi077 ceph-mon[22251]: osdmap e83: 12 total, 12 up, 12 in 2024-08-20T01:42:33.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.802+0000 7f842c152640 1 -- 172.21.15.22:0/1069421752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f842410f120 msgr2=0x7f8424111510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:33.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.802+0000 7f842c152640 1 --2- 172.21.15.22:0/1069421752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f842410f120 0x7f8424111510 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f841c009ca0 tx=0x7f841c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.802+0000 7f842c152640 1 -- 172.21.15.22:0/1069421752 shutdown_connections 2024-08-20T01:42:33.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.802+0000 7f842c152640 1 --2- 172.21.15.22:0/1069421752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f842410f120 0x7f8424111510 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.802+0000 7f842c152640 1 --2- 172.21.15.22:0/1069421752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8424101e90 0x7f842410ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.802+0000 7f842c152640 1 --2- 172.21.15.22:0/1069421752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8424101570 0x7f8424101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.802+0000 7f842c152640 1 -- 172.21.15.22:0/1069421752 >> 172.21.15.22:0/1069421752 conn(0x7f84240fd440 msgr2=0x7f84240ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:33.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.802+0000 7f842c152640 1 -- 172.21.15.22:0/1069421752 shutdown_connections 2024-08-20T01:42:33.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.802+0000 7f842c152640 1 -- 172.21.15.22:0/1069421752 wait complete. 2024-08-20T01:42:33.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.803+0000 7f842c152640 1 Processor -- start 2024-08-20T01:42:33.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.803+0000 7f842c152640 1 -- start start 2024-08-20T01:42:33.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.803+0000 7f842c152640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8424101570 0x7f842419b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.803+0000 7f842c152640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8424101e90 0x7f842419b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.803+0000 7f842c152640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f842410f120 0x7f84241a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.803+0000 7f842c152640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8424114d30 con 0x7f842410f120 2024-08-20T01:42:33.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.803+0000 7f842c152640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8424114bb0 con 0x7f8424101e90 2024-08-20T01:42:33.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.803+0000 7f842c152640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8424114eb0 con 0x7f8424101570 2024-08-20T01:42:33.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.803+0000 7f842a6ef640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f842410f120 0x7f84241a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.803+0000 7f842a6ef640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f842410f120 0x7f84241a0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39754/0 (socket says 172.21.15.22:39754) 2024-08-20T01:42:33.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.803+0000 7f842a6ef640 1 -- 172.21.15.22:0/3563679818 learned_addr learned my addr 172.21.15.22:0/3563679818 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-08-20T01:42:33.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.803+0000 7f84296ed640 1 --2- 172.21.15.22:0/3563679818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8424101e90 0x7f842419b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.803+0000 7f8429eee640 1 --2- 172.21.15.22:0/3563679818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8424101570 0x7f842419b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.804+0000 7f842a6ef640 1 -- 172.21.15.22:0/3563679818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8424101570 msgr2=0x7f842419b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:33.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.804+0000 7f842a6ef640 1 --2- 172.21.15.22:0/3563679818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8424101570 0x7f842419b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.804+0000 7f842a6ef640 1 -- 172.21.15.22:0/3563679818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8424101e90 msgr2=0x7f842419b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:33.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.804+0000 7f842a6ef640 1 --2- 172.21.15.22:0/3563679818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8424101e90 0x7f842419b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.804+0000 7f842a6ef640 1 -- 172.21.15.22:0/3563679818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84241a1250 con 0x7f842410f120 2024-08-20T01:42:33.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.804+0000 7f842a6ef640 1 --2- 172.21.15.22:0/3563679818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f842410f120 0x7f84241a0a80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f841c02ade0 tx=0x7f841c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:33.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.804+0000 7f841affd640 1 -- 172.21.15.22:0/3563679818 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c003cf0 con 0x7f842410f120 2024-08-20T01:42:33.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.804+0000 7f842c152640 1 -- 172.21.15.22:0/3563679818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84241a14e0 con 0x7f842410f120 2024-08-20T01:42:33.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.804+0000 7f841affd640 1 -- 172.21.15.22:0/3563679818 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f841c0044f0 con 0x7f842410f120 2024-08-20T01:42:33.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.804+0000 7f841affd640 1 -- 172.21.15.22:0/3563679818 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c02fc60 con 0x7f842410f120 2024-08-20T01:42:33.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.804+0000 7f842c152640 1 -- 172.21.15.22:0/3563679818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84241a7c00 con 0x7f842410f120 2024-08-20T01:42:33.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.805+0000 7f842c152640 1 -- 172.21.15.22:0/3563679818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8424101950 con 0x7f842410f120 2024-08-20T01:42:33.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.807+0000 7f841affd640 1 -- 172.21.15.22:0/3563679818 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f841c004040 con 0x7f842410f120 2024-08-20T01:42:33.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.808+0000 7f841affd640 1 --2- 172.21.15.22:0/3563679818 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f84100b3bd0 0x7f84100b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.808+0000 7f8429eee640 1 --2- 172.21.15.22:0/3563679818 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f84100b3bd0 0x7f84100b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.808+0000 7f841affd640 1 -- 172.21.15.22:0/3563679818 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8031+0+0 (secure 0 0 0) 0x7f841c1053a0 con 0x7f842410f120 2024-08-20T01:42:33.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.809+0000 7f8429eee640 1 --2- 172.21.15.22:0/3563679818 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f84100b3bd0 0x7f84100b6090 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8420005e10 tx=0x7f8420005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:33.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.811+0000 7f841affd640 1 -- 172.21.15.22:0/3563679818 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f841c0ccb00 con 0x7f842410f120 2024-08-20T01:42:33.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:33.995+0000 7f842c152640 1 -- 172.21.15.22:0/3563679818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f84241a7f30 con 0x7f842410f120 2024-08-20T01:42:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:34.168+0000 7f841affd640 1 -- 172.21.15.22:0/3563679818 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v84) ==== 169+0+0 (secure 0 0 0) 0x7f841c0cc400 con 0x7f842410f120 2024-08-20T01:42:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2024-08-20T01:42:34.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:34.172+0000 7f842c152640 1 -- 172.21.15.22:0/3563679818 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f84100b3bd0 msgr2=0x7f84100b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:34.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:34.172+0000 7f842c152640 1 --2- 172.21.15.22:0/3563679818 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f84100b3bd0 0x7f84100b6090 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8420005e10 tx=0x7f8420005da0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:34.172+0000 7f842c152640 1 -- 172.21.15.22:0/3563679818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f842410f120 msgr2=0x7f84241a0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:34.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:34.172+0000 7f842c152640 1 --2- 172.21.15.22:0/3563679818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f842410f120 0x7f84241a0a80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f841c02ade0 tx=0x7f841c0319f0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:34.173+0000 7f842c152640 1 -- 172.21.15.22:0/3563679818 shutdown_connections 2024-08-20T01:42:34.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:34.173+0000 7f842c152640 1 --2- 172.21.15.22:0/3563679818 >> [v2:172.21.15.22:6800/2987254321,v1:172.21.15.22:6801/2987254321] conn(0x7f84100b3bd0 0x7f84100b6090 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:34.173+0000 7f842c152640 1 --2- 172.21.15.22:0/3563679818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f842410f120 0x7f84241a0a80 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:34.173+0000 7f842c152640 1 --2- 172.21.15.22:0/3563679818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8424101e90 0x7f842419b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:34.173+0000 7f842c152640 1 --2- 172.21.15.22:0/3563679818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8424101570 0x7f842419b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:34.173+0000 7f842c152640 1 -- 172.21.15.22:0/3563679818 >> 172.21.15.22:0/3563679818 conn(0x7f84240fd440 msgr2=0x7f842410fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:34.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:34.175+0000 7f842c152640 1 -- 172.21.15.22:0/3563679818 shutdown_connections 2024-08-20T01:42:34.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-08-20T01:42:34.176+0000 7f842c152640 1 -- 172.21.15.22:0/3563679818 wait complete. 2024-08-20T01:42:34.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:34 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3563679818' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T01:42:34.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:34 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3563679818' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T01:42:34.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:34 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3563679818' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T01:42:35.030 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-20T01:42:35.057 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-20T01:42:35.106 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-20T01:42:35.181 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-08-20T01:42:35.182 DEBUG:teuthology.orchestra.run.smithi022:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-20T01:42:35.197 DEBUG:teuthology.orchestra.run.smithi077:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-20T01:42:35.212 DEBUG:teuthology.orchestra.run.smithi134:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-20T01:42:35.234 INFO:tasks.cephadm:Stopping all daemons... 2024-08-20T01:42:35.235 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-08-20T01:42:35.235 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mon.a 2024-08-20T01:42:35.260 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:35 smithi022 ceph-mon[18709]: pgmap v693: 65 pgs: 65 active+clean; 577 KiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:42:35.260 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:35 smithi022 ceph-mon[18709]: from='client.? 172.21.15.22:0/3563679818' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T01:42:35.260 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:35 smithi022 ceph-mon[18709]: osdmap e84: 12 total, 12 up, 12 in 2024-08-20T01:42:35.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:35 smithi134 ceph-mon[22511]: pgmap v693: 65 pgs: 65 active+clean; 577 KiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:42:35.516 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:35 smithi134 ceph-mon[22511]: from='client.? 172.21.15.22:0/3563679818' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T01:42:35.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:35 smithi134 ceph-mon[22511]: osdmap e84: 12 total, 12 up, 12 in 2024-08-20T01:42:35.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:35 smithi022 systemd[1]: Stopping Ceph mon.a for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:42:35.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:35 smithi077 ceph-mon[22251]: pgmap v693: 65 pgs: 65 active+clean; 577 KiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:42:35.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:35 smithi077 ceph-mon[22251]: from='client.? 172.21.15.22:0/3563679818' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T01:42:35.565 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:35 smithi077 ceph-mon[22251]: osdmap e84: 12 total, 12 up, 12 in 2024-08-20T01:42:35.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:35 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-a[18705]: 2024-08-20T01:42:35.558+0000 7f74f28e3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:42:35.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:35 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-a[18705]: 2024-08-20T01:42:35.558+0000 7f74f28e3640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-08-20T01:42:35.887 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:35 smithi022 podman[93381]: 2024-08-20 01:42:35.702007277 +0000 UTC m=+0.271082048 container died 932e0d46c08c5d2aca2b6a5170f889ff3a99242fac979419a1abe6294e8eb3fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True) 2024-08-20T01:42:36.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:36 smithi022 podman[93381]: 2024-08-20 01:42:36.185320137 +0000 UTC m=+0.754394948 container cleanup 932e0d46c08c5d2aca2b6a5170f889ff3a99242fac979419a1abe6294e8eb3fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-08-20T01:42:36.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Aug 20 01:42:36 smithi022 bash[93381]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-a 2024-08-20T01:42:36.639 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mon.a.service' 2024-08-20T01:42:36.728 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:42:36.728 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-08-20T01:42:36.728 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-08-20T01:42:36.729 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mon.b 2024-08-20T01:42:37.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:36 smithi077 systemd[1]: Stopping Ceph mon.b for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:42:37.390 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:37 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-b[22247]: 2024-08-20T01:42:37.122+0000 7f18a3eaa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:42:37.390 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:37 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-b[22247]: 2024-08-20T01:42:37.122+0000 7f18a3eaa640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-08-20T01:42:37.700 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:37 smithi077 podman[56735]: 2024-08-20 01:42:37.389069199 +0000 UTC m=+0.404175649 container died 6fa4dc818e4be9623f12a750e3647c2ede07c4e1c39a998dd5ad577aa62f36b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-b, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-20T01:42:38.027 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:37 smithi077 podman[56735]: 2024-08-20 01:42:37.798439658 +0000 UTC m=+0.813546103 container cleanup 6fa4dc818e4be9623f12a750e3647c2ede07c4e1c39a998dd5ad577aa62f36b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-b, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, org.label-schema.schema-version=1.0) 2024-08-20T01:42:38.027 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:37 smithi077 bash[56735]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-b 2024-08-20T01:42:38.254 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mon.b.service' 2024-08-20T01:42:38.278 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:38 smithi077 podman[56750]: 2024-08-20 01:42:38.025407682 +0000 UTC m=+0.618559367 container remove 6fa4dc818e4be9623f12a750e3647c2ede07c4e1c39a998dd5ad577aa62f36b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-b, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-20T01:42:38.278 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:38 smithi077 systemd[1]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mon.b.service: Deactivated successfully. 2024-08-20T01:42:38.279 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:38 smithi077 systemd[1]: Stopped Ceph mon.b for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:42:38.279 INFO:journalctl@ceph.mon.b.smithi077.stdout:Aug 20 01:42:38 smithi077 systemd[1]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mon.b.service: Consumed 11.307s CPU time. 2024-08-20T01:42:38.305 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:42:38.305 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-08-20T01:42:38.306 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-08-20T01:42:38.306 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mon.c 2024-08-20T01:42:38.693 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:38 smithi134 systemd[1]: Stopping Ceph mon.c for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:42:39.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:38 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-c[22493]: 2024-08-20T01:42:38.689+0000 7f5655689640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:42:39.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:38 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-c[22493]: 2024-08-20T01:42:38.689+0000 7f5655689640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-08-20T01:42:39.017 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:38 smithi134 podman[57676]: 2024-08-20 01:42:38.936186794 +0000 UTC m=+0.394017943 container died a037ee0751428103f4ac58d8dfd64e679c774dded5d6092686ae0cebe064b11a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD) 2024-08-20T01:42:39.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:39 smithi134 podman[57676]: 2024-08-20 01:42:39.357581898 +0000 UTC m=+0.815413053 container cleanup a037ee0751428103f4ac58d8dfd64e679c774dded5d6092686ae0cebe064b11a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-c, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:42:39.517 INFO:journalctl@ceph.mon.c.smithi134.stdout:Aug 20 01:42:39 smithi134 bash[57676]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mon-c 2024-08-20T01:42:39.857 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mon.c.service' 2024-08-20T01:42:39.906 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:42:39.906 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-08-20T01:42:39.906 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-08-20T01:42:39.907 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mgr.x 2024-08-20T01:42:40.235 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:42:39 smithi022 systemd[1]: Stopping Ceph mgr.x for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:42:40.561 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:42:40 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x[18939]: 2024-08-20T01:42:40.232+0000 7f6a8facf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:42:40.561 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:42:40 smithi022 podman[93589]: 2024-08-20 01:42:40.264129829 +0000 UTC m=+0.153442854 container died f47d219dda4d6b6b96b466da745c28b90fde7bce6e5de96d0594c0ba8af092f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-20T01:42:40.887 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:42:40 smithi022 podman[93589]: 2024-08-20 01:42:40.750988536 +0000 UTC m=+0.640301558 container cleanup f47d219dda4d6b6b96b466da745c28b90fde7bce6e5de96d0594c0ba8af092f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:42:40.887 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Aug 20 01:42:40 smithi022 bash[93589]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-x 2024-08-20T01:42:41.183 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mgr.x.service' 2024-08-20T01:42:41.219 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:42:41.219 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-08-20T01:42:41.219 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-08-20T01:42:41.220 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mgr.y 2024-08-20T01:42:41.559 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Aug 20 01:42:41 smithi077 systemd[1]: Stopping Ceph mgr.y for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:42:41.815 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Aug 20 01:42:41 smithi077 podman[56862]: 2024-08-20 01:42:41.558009691 +0000 UTC m=+0.143490383 container died 566078ee7cb639ed975d078d21b3bd46a0bfcb86bc9fba78c0143fcd99a24947 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-y, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-20T01:42:42.207 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Aug 20 01:42:41 smithi077 podman[56862]: 2024-08-20 01:42:41.954381245 +0000 UTC m=+0.539861929 container cleanup 566078ee7cb639ed975d078d21b3bd46a0bfcb86bc9fba78c0143fcd99a24947 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-y, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.36.0) 2024-08-20T01:42:42.207 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Aug 20 01:42:41 smithi077 bash[56862]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-y 2024-08-20T01:42:42.328 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mgr.y.service' 2024-08-20T01:42:42.364 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:42:42.364 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-08-20T01:42:42.364 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-08-20T01:42:42.364 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mgr.z 2024-08-20T01:42:42.710 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Aug 20 01:42:42 smithi134 systemd[1]: Stopping Ceph mgr.z for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:42:43.016 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Aug 20 01:42:42 smithi134 podman[57803]: 2024-08-20 01:42:42.708823615 +0000 UTC m=+0.144627329 container died 125dd5d7faf052106d7b878e3a00777c8363fcd15cee085acdaee05ddfc76248 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-20T01:42:43.391 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Aug 20 01:42:43 smithi134 podman[57803]: 2024-08-20 01:42:43.122246818 +0000 UTC m=+0.558050537 container cleanup 125dd5d7faf052106d7b878e3a00777c8363fcd15cee085acdaee05ddfc76248 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:42:43.392 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Aug 20 01:42:43 smithi134 bash[57803]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mgr-z 2024-08-20T01:42:43.522 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mgr.z.service' 2024-08-20T01:42:43.556 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:42:43.556 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-08-20T01:42:43.556 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-08-20T01:42:43.557 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.0 2024-08-20T01:42:43.875 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:42:43 smithi022 systemd[1]: Stopping Ceph osd.0 for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:42:44.137 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:42:43 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-0[34650]: 2024-08-20T01:42:43.872+0000 7f36efc0f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:42:44.137 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:42:43 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-0[34650]: 2024-08-20T01:42:43.872+0000 7f36efc0f640 -1 osd.0 84 *** Got signal Terminated *** 2024-08-20T01:42:44.137 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:42:43 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-0[34650]: 2024-08-20T01:42:43.872+0000 7f36efc0f640 -1 osd.0 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:42:49.542 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:42:49 smithi022 podman[93711]: 2024-08-20 01:42:49.259394641 +0000 UTC m=+5.511534390 container died 0ae11be4b131cfb1c7024ead2ea6fa751f0c2859ba2e506a7ce8319b6ec5e65c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-20T01:42:49.887 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:42:49 smithi022 podman[93711]: 2024-08-20 01:42:49.732590607 +0000 UTC m=+5.984730353 container cleanup 0ae11be4b131cfb1c7024ead2ea6fa751f0c2859ba2e506a7ce8319b6ec5e65c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True) 2024-08-20T01:42:49.887 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:42:49 smithi022 bash[93711]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-0 2024-08-20T01:42:50.367 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:42:50 smithi022 podman[93728]: 2024-08-20 01:42:50.001118066 +0000 UTC m=+0.742589648 container remove 0ae11be4b131cfb1c7024ead2ea6fa751f0c2859ba2e506a7ce8319b6ec5e65c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-08-20T01:42:50.637 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:42:50 smithi022 podman[93819]: 2024-08-20 01:42:50.268575823 +0000 UTC m=+0.017038536 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:42:50.637 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:42:50 smithi022 podman[93819]: 2024-08-20 01:42:50.393944498 +0000 UTC m=+0.142407193 container create 216dc1816adfdf6ca66c33437edd433e3e9c79412dcc221f0a1955c0c8576f1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-20T01:42:51.138 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:42:50 smithi022 podman[93819]: 2024-08-20 01:42:50.656098909 +0000 UTC m=+0.404561613 container init 216dc1816adfdf6ca66c33437edd433e3e9c79412dcc221f0a1955c0c8576f1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.36.0) 2024-08-20T01:42:51.138 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:42:50 smithi022 podman[93819]: 2024-08-20 01:42:50.65953784 +0000 UTC m=+0.408000537 container start 216dc1816adfdf6ca66c33437edd433e3e9c79412dcc221f0a1955c0c8576f1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-08-20T01:42:51.138 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:42:50 smithi022 podman[93819]: 2024-08-20 01:42:50.763813213 +0000 UTC m=+0.512275920 container attach 216dc1816adfdf6ca66c33437edd433e3e9c79412dcc221f0a1955c0c8576f1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T01:42:51.138 INFO:journalctl@ceph.osd.0.smithi022.stdout:Aug 20 01:42:50 smithi022 podman[93819]: 2024-08-20 01:42:50.851793794 +0000 UTC m=+0.600256498 container died 216dc1816adfdf6ca66c33437edd433e3e9c79412dcc221f0a1955c0c8576f1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-0-deactivate, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-20T01:42:51.473 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.0.service' 2024-08-20T01:42:51.517 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:42:51.517 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-08-20T01:42:51.517 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-08-20T01:42:51.517 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.1 2024-08-20T01:42:51.815 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:42:51 smithi077 systemd[1]: Stopping Ceph osd.1 for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:42:52.315 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:42:51 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-1[26658]: 2024-08-20T01:42:51.825+0000 7f8574e36640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:42:52.315 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:42:51 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-1[26658]: 2024-08-20T01:42:51.825+0000 7f8574e36640 -1 osd.1 84 *** Got signal Terminated *** 2024-08-20T01:42:52.315 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:42:51 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-1[26658]: 2024-08-20T01:42:51.825+0000 7f8574e36640 -1 osd.1 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:42:57.565 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:42:57 smithi077 podman[56997]: 2024-08-20 01:42:57.300967521 +0000 UTC m=+5.593160910 container died a53b422e485f5951efa8349b298d14862562b3e2ef9de9d5bfaf5bfe46b93783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, ceph=True, org.label-schema.license=GPLv2) 2024-08-20T01:42:57.938 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:42:57 smithi077 podman[56997]: 2024-08-20 01:42:57.743227349 +0000 UTC m=+6.035420731 container cleanup a53b422e485f5951efa8349b298d14862562b3e2ef9de9d5bfaf5bfe46b93783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-20T01:42:57.938 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:42:57 smithi077 bash[56997]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-1 2024-08-20T01:42:58.315 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:42:57 smithi077 podman[57013]: 2024-08-20 01:42:57.9362723 +0000 UTC m=+0.636133074 container remove a53b422e485f5951efa8349b298d14862562b3e2ef9de9d5bfaf5bfe46b93783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-08-20T01:42:58.641 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:42:58 smithi077 podman[57104]: 2024-08-20 01:42:58.256430955 +0000 UTC m=+0.015667671 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:42:58.641 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:42:58 smithi077 podman[57104]: 2024-08-20 01:42:58.378958752 +0000 UTC m=+0.138195503 container create 38255b7229f5b6378ffd650b1bb5364d20b6904b45158a7c9d0aecea881fa79a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-20T01:42:58.954 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:42:58 smithi077 podman[57104]: 2024-08-20 01:42:58.640082551 +0000 UTC m=+0.399319265 container init 38255b7229f5b6378ffd650b1bb5364d20b6904b45158a7c9d0aecea881fa79a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-1-deactivate, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-08-20T01:42:58.954 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:42:58 smithi077 podman[57104]: 2024-08-20 01:42:58.643734615 +0000 UTC m=+0.402971321 container start 38255b7229f5b6378ffd650b1bb5364d20b6904b45158a7c9d0aecea881fa79a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-08-20T01:42:58.954 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:42:58 smithi077 podman[57104]: 2024-08-20 01:42:58.765338722 +0000 UTC m=+0.524575490 container attach 38255b7229f5b6378ffd650b1bb5364d20b6904b45158a7c9d0aecea881fa79a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-08-20T01:42:59.244 INFO:journalctl@ceph.osd.1.smithi077.stdout:Aug 20 01:42:58 smithi077 podman[57104]: 2024-08-20 01:42:58.952596396 +0000 UTC m=+0.711833123 container died 38255b7229f5b6378ffd650b1bb5364d20b6904b45158a7c9d0aecea881fa79a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-1-deactivate, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0) 2024-08-20T01:42:59.557 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.1.service' 2024-08-20T01:42:59.597 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:42:59.597 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-08-20T01:42:59.598 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-08-20T01:42:59.598 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.2 2024-08-20T01:42:59.920 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:42:59 smithi134 systemd[1]: Stopping Ceph osd.2 for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:43:00.266 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:42:59 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-2[27459]: 2024-08-20T01:42:59.918+0000 7fe9b8b35640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:43:00.267 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:42:59 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-2[27459]: 2024-08-20T01:42:59.918+0000 7fe9b8b35640 -1 osd.2 84 *** Got signal Terminated *** 2024-08-20T01:43:00.267 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:42:59 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-2[27459]: 2024-08-20T01:42:59.918+0000 7fe9b8b35640 -1 osd.2 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:43:05.646 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:43:05 smithi134 podman[57941]: 2024-08-20 01:43:05.333144874 +0000 UTC m=+5.537901081 container died 6cf75d1a9987a99fa541dc436b38455d6b6796079871ebbfac4e702e177c05fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-20T01:43:06.017 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:43:05 smithi134 podman[57941]: 2024-08-20 01:43:05.743673743 +0000 UTC m=+5.948429928 container cleanup 6cf75d1a9987a99fa541dc436b38455d6b6796079871ebbfac4e702e177c05fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, ceph=True) 2024-08-20T01:43:06.017 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:43:05 smithi134 bash[57941]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-2 2024-08-20T01:43:06.332 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:43:06 smithi134 podman[57956]: 2024-08-20 01:43:06.020006716 +0000 UTC m=+0.683711979 container remove 6cf75d1a9987a99fa541dc436b38455d6b6796079871ebbfac4e702e177c05fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:43:06.584 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:43:06 smithi134 podman[58042]: 2024-08-20 01:43:06.233263953 +0000 UTC m=+0.016016384 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:43:06.584 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:43:06 smithi134 podman[58042]: 2024-08-20 01:43:06.346024578 +0000 UTC m=+0.128777035 container create 02c00c9984aab64c8fdd5175a3bafb5ead1284c81832e74222b94d55b5f4dcf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:43:06.995 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:43:06 smithi134 podman[58042]: 2024-08-20 01:43:06.582291639 +0000 UTC m=+0.365044058 container init 02c00c9984aab64c8fdd5175a3bafb5ead1284c81832e74222b94d55b5f4dcf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-08-20T01:43:06.995 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:43:06 smithi134 podman[58042]: 2024-08-20 01:43:06.585809742 +0000 UTC m=+0.368562158 container start 02c00c9984aab64c8fdd5175a3bafb5ead1284c81832e74222b94d55b5f4dcf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-20T01:43:06.995 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:43:06 smithi134 podman[58042]: 2024-08-20 01:43:06.69933044 +0000 UTC m=+0.482082964 container attach 02c00c9984aab64c8fdd5175a3bafb5ead1284c81832e74222b94d55b5f4dcf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-08-20T01:43:07.266 INFO:journalctl@ceph.osd.2.smithi134.stdout:Aug 20 01:43:06 smithi134 podman[58042]: 2024-08-20 01:43:06.993701203 +0000 UTC m=+0.776453626 container died 02c00c9984aab64c8fdd5175a3bafb5ead1284c81832e74222b94d55b5f4dcf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:43:07.665 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.2.service' 2024-08-20T01:43:07.703 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:43:07.704 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-08-20T01:43:07.704 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-08-20T01:43:07.704 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.3 2024-08-20T01:43:08.032 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:43:07 smithi022 systemd[1]: Stopping Ceph osd.3 for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:43:08.387 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:43:08 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-3[41101]: 2024-08-20T01:43:08.029+0000 7fa4f6399640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:43:08.387 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:43:08 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-3[41101]: 2024-08-20T01:43:08.029+0000 7fa4f6399640 -1 osd.3 84 *** Got signal Terminated *** 2024-08-20T01:43:08.387 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:43:08 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-3[41101]: 2024-08-20T01:43:08.029+0000 7fa4f6399640 -1 osd.3 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:43:10.701 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:10 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:10.424+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:11.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:10 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:10.698+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:45.116816+0000 front 2024-08-20T01:42:45.116746+0000 (oldest deadline 2024-08-20T01:43:09.816908+0000) 2024-08-20T01:43:11.137 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:43:10 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-3[41101]: 2024-08-20T01:43:10.774+0000 7fa4ee9a6640 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.794142+0000 front 2024-08-20T01:42:48.794171+0000 (oldest deadline 2024-08-20T01:43:09.894360+0000) 2024-08-20T01:43:11.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:11 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:11.424+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:11.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:11 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:11.204+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:11.637 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:11 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:11.248+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:12.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:11 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:11.737+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:45.116816+0000 front 2024-08-20T01:42:45.116746+0000 (oldest deadline 2024-08-20T01:43:09.816908+0000) 2024-08-20T01:43:12.137 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:43:11 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-3[41101]: 2024-08-20T01:43:11.733+0000 7fa4ee9a6640 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.794142+0000 front 2024-08-20T01:42:48.794171+0000 (oldest deadline 2024-08-20T01:43:09.894360+0000) 2024-08-20T01:43:12.137 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:11 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:11.832+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:12.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:12 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:12.460+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:12.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:12 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:12.233+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:12.637 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:12 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:12.204+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:13.016 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:12 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:12.713+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:45.116816+0000 front 2024-08-20T01:42:45.116746+0000 (oldest deadline 2024-08-20T01:43:09.816908+0000) 2024-08-20T01:43:13.137 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:43:12 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-3[41101]: 2024-08-20T01:43:12.736+0000 7fa4ee9a6640 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.794142+0000 front 2024-08-20T01:42:48.794171+0000 (oldest deadline 2024-08-20T01:43:09.894360+0000) 2024-08-20T01:43:13.137 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:12 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:12.865+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:13.637 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:13 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:13.188+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:13.637 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:43:13 smithi022 podman[93935]: 2024-08-20 01:43:13.404572417 +0000 UTC m=+5.494776595 container died 05b68dd4593083a86546638bfa031bebae86e4c0cbbd11fdf4f4b3cec1212cd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-3, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-20T01:43:13.692 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:13 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:13.422+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:13.693 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:13 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:13.265+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:13.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:13 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:13.478+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:14.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:13 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:13.689+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:45.116816+0000 front 2024-08-20T01:42:45.116746+0000 (oldest deadline 2024-08-20T01:43:09.816908+0000) 2024-08-20T01:43:14.137 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:13 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:13.894+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:14.138 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:43:13 smithi022 podman[93935]: 2024-08-20 01:43:13.90548273 +0000 UTC m=+5.995686966 container cleanup 05b68dd4593083a86546638bfa031bebae86e4c0cbbd11fdf4f4b3cec1212cd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:43:14.138 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:43:13 smithi022 bash[93935]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-3 2024-08-20T01:43:14.495 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:43:14 smithi022 podman[93951]: 2024-08-20 01:43:14.174267478 +0000 UTC m=+0.771729687 container remove 05b68dd4593083a86546638bfa031bebae86e4c0cbbd11fdf4f4b3cec1212cd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-20T01:43:14.495 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:14 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:14.192+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:14.516 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:14 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:14.232+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:14.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:14 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:14.449+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:14.763 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:43:14 smithi022 podman[94038]: 2024-08-20 01:43:14.39608804 +0000 UTC m=+0.016464451 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:43:14.763 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:43:14 smithi022 podman[94038]: 2024-08-20 01:43:14.516974989 +0000 UTC m=+0.137351433 container create 751dddb58fc38412403015207dcf4501280b9bbd3688bac47e09f093436dbac3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-20T01:43:14.763 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:43:14 smithi022 podman[94038]: 2024-08-20 01:43:14.76130344 +0000 UTC m=+0.381679842 container init 751dddb58fc38412403015207dcf4501280b9bbd3688bac47e09f093436dbac3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-3-deactivate, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:43:14.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:14 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:14.504+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:15.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:14 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:14.647+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:45.116816+0000 front 2024-08-20T01:42:45.116746+0000 (oldest deadline 2024-08-20T01:43:09.816908+0000) 2024-08-20T01:43:15.137 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:14 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:14.904+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:15.138 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:43:14 smithi022 podman[94038]: 2024-08-20 01:43:14.765057548 +0000 UTC m=+0.385433951 container start 751dddb58fc38412403015207dcf4501280b9bbd3688bac47e09f093436dbac3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-08-20T01:43:15.138 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:43:14 smithi022 podman[94038]: 2024-08-20 01:43:14.853122013 +0000 UTC m=+0.473498422 container attach 751dddb58fc38412403015207dcf4501280b9bbd3688bac47e09f093436dbac3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:43:15.138 INFO:journalctl@ceph.osd.3.smithi022.stdout:Aug 20 01:43:14 smithi022 podman[94038]: 2024-08-20 01:43:14.968276458 +0000 UTC m=+0.588652863 container died 751dddb58fc38412403015207dcf4501280b9bbd3688bac47e09f093436dbac3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:43:15.472 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:15 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:15.190+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:15.558 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:15 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:15.162+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:15.580 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.3.service' 2024-08-20T01:43:15.623 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:43:15.623 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-08-20T01:43:15.623 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-08-20T01:43:15.623 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.4 2024-08-20T01:43:15.767 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:15 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:15.646+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:45.116816+0000 front 2024-08-20T01:42:45.116746+0000 (oldest deadline 2024-08-20T01:43:09.816908+0000) 2024-08-20T01:43:15.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:15 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:15.470+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:15.815 INFO:journalctl@ceph.osd.4.smithi077.stdout:Aug 20 01:43:15 smithi077 systemd[1]: Stopping Ceph osd.4 for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:43:15.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:15 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:15.498+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:16.124 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:15 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:15.857+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:16.315 INFO:journalctl@ceph.osd.4.smithi077.stdout:Aug 20 01:43:15 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-4[33243]: 2024-08-20T01:43:15.946+0000 7ff2fe9c8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:43:16.315 INFO:journalctl@ceph.osd.4.smithi077.stdout:Aug 20 01:43:15 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-4[33243]: 2024-08-20T01:43:15.946+0000 7ff2fe9c8640 -1 osd.4 84 *** Got signal Terminated *** 2024-08-20T01:43:16.315 INFO:journalctl@ceph.osd.4.smithi077.stdout:Aug 20 01:43:15 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-4[33243]: 2024-08-20T01:43:15.946+0000 7ff2fe9c8640 -1 osd.4 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:43:16.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:16 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:16.122+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:16.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:16 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:16.459+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:16.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:16 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:16.221+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:16.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:16 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:16.508+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:17.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:16 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:16.654+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:45.116816+0000 front 2024-08-20T01:42:45.116746+0000 (oldest deadline 2024-08-20T01:43:09.816908+0000) 2024-08-20T01:43:17.137 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:16 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:16.868+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:17.138 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:17 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:17.109+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:17.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:17 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:17.251+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:17.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:17 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:17.443+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:17.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:17 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:17.534+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:18.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:17 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:17.664+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:45.116816+0000 front 2024-08-20T01:42:45.116746+0000 (oldest deadline 2024-08-20T01:43:09.816908+0000) 2024-08-20T01:43:18.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:17 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:17.664+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.218781+0000 front 2024-08-20T01:42:56.218642+0000 (oldest deadline 2024-08-20T01:43:17.318804+0000) 2024-08-20T01:43:18.154 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:17 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:17.902+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:18.637 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:18 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:18.151+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:18.691 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:18 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:18.458+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:18.691 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:18 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:18.458+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:18.692 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:18 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:18.289+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:18.692 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:18 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:18.289+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:18.815 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:18 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:18.665+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:18.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:18 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:18.544+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:18.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:18 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:18.544+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:19.016 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:18 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:18.688+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:45.116816+0000 front 2024-08-20T01:42:45.116746+0000 (oldest deadline 2024-08-20T01:43:09.816908+0000) 2024-08-20T01:43:19.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:18 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:18.688+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.218781+0000 front 2024-08-20T01:42:56.218642+0000 (oldest deadline 2024-08-20T01:43:17.318804+0000) 2024-08-20T01:43:19.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:18 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:18.950+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:19.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:18 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:18.950+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.960661+0000 front 2024-08-20T01:42:54.960444+0000 (oldest deadline 2024-08-20T01:43:18.460536+0000) 2024-08-20T01:43:19.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:19 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:19.197+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:19.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:19 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:19.197+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:19.653 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:19 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:19.456+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:19.653 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:19 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:19.456+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:19.653 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:19 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:19.277+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:19.653 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:19 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:19.277+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:19.815 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:19 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:19.655+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:19.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:19 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:19.526+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:19.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:19 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:19.526+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:20.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:19 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:19.650+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:45.116816+0000 front 2024-08-20T01:42:45.116746+0000 (oldest deadline 2024-08-20T01:43:09.816908+0000) 2024-08-20T01:43:20.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:19 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:19.650+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.218781+0000 front 2024-08-20T01:42:56.218642+0000 (oldest deadline 2024-08-20T01:43:17.318804+0000) 2024-08-20T01:43:20.213 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:19 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:19.940+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:20.213 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:19 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:19.940+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.960661+0000 front 2024-08-20T01:42:54.960444+0000 (oldest deadline 2024-08-20T01:43:18.460536+0000) 2024-08-20T01:43:20.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:20 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:20.429+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:20.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:20 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:20.429+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:20.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:20 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:20.227+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:20.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:20 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:20.227+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:20.637 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:20 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:20.211+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:20.637 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:20 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:20.211+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:20.796 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:20 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:20.643+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:45.116816+0000 front 2024-08-20T01:42:45.116746+0000 (oldest deadline 2024-08-20T01:43:09.816908+0000) 2024-08-20T01:43:20.796 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:20 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:20.643+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.218781+0000 front 2024-08-20T01:42:56.218642+0000 (oldest deadline 2024-08-20T01:43:17.318804+0000) 2024-08-20T01:43:20.815 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:20 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:20.681+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:20.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:20 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:20.549+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:20.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:20 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:20.549+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:21.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:20 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:20.960+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:21.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:20 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:20.960+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.960661+0000 front 2024-08-20T01:42:54.960444+0000 (oldest deadline 2024-08-20T01:43:18.460536+0000) 2024-08-20T01:43:21.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:21 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:21.172+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:21.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:21 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:21.172+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:21.516 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:21 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:21.460+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:21.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:21 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:21.460+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:21.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:21 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:21.223+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:21.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:21 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:21.223+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:21.665 INFO:journalctl@ceph.osd.4.smithi077.stdout:Aug 20 01:43:21 smithi077 podman[57209]: 2024-08-20 01:43:21.408974519 +0000 UTC m=+5.588306852 container died 770780a9f2c4051be20fbff57683765dcea0969a2962ef1e787fa8803384bf05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-4, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-20T01:43:21.666 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:21 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:21.576+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:21.666 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:21 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:21.576+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:21.931 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:21 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:21.723+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:21.932 INFO:journalctl@ceph.osd.4.smithi077.stdout:Aug 20 01:43:21 smithi077 podman[57209]: 2024-08-20 01:43:21.848919435 +0000 UTC m=+6.028251780 container cleanup 770780a9f2c4051be20fbff57683765dcea0969a2962ef1e787fa8803384bf05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-4, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:43:21.932 INFO:journalctl@ceph.osd.4.smithi077.stdout:Aug 20 01:43:21 smithi077 bash[57209]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-4 2024-08-20T01:43:22.016 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:21 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:21.635+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:45.116816+0000 front 2024-08-20T01:42:45.116746+0000 (oldest deadline 2024-08-20T01:43:09.816908+0000) 2024-08-20T01:43:22.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:21 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:21.635+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.218781+0000 front 2024-08-20T01:42:56.218642+0000 (oldest deadline 2024-08-20T01:43:17.318804+0000) 2024-08-20T01:43:22.315 INFO:journalctl@ceph.osd.4.smithi077.stdout:Aug 20 01:43:22 smithi077 podman[57226]: 2024-08-20 01:43:22.117091622 +0000 UTC m=+0.665380574 container remove 770780a9f2c4051be20fbff57683765dcea0969a2962ef1e787fa8803384bf05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-4, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:43:22.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:21 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:21.968+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:22.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:21 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:21.968+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.960661+0000 front 2024-08-20T01:42:54.960444+0000 (oldest deadline 2024-08-20T01:43:18.460536+0000) 2024-08-20T01:43:22.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:22 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:22.155+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:22.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:22 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:22.155+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:22.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:22 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:22.261+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:22.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:22 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:22.261+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:22.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:22 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:22.453+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:22.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:22 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:22.453+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:22.739 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:22 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:22.692+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:22.739 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:22 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:22.593+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:22.739 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:22 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:22.593+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:22.739 INFO:journalctl@ceph.osd.4.smithi077.stdout:Aug 20 01:43:22 smithi077 podman[57321]: 2024-08-20 01:43:22.352842923 +0000 UTC m=+0.016652160 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:43:22.740 INFO:journalctl@ceph.osd.4.smithi077.stdout:Aug 20 01:43:22 smithi077 podman[57321]: 2024-08-20 01:43:22.468091408 +0000 UTC m=+0.131900628 container create 579537b32eaffc57dcfad5cb74f2f4b2ffb7904194108024f65046bc5cf29b2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-4-deactivate, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS) 2024-08-20T01:43:22.740 INFO:journalctl@ceph.osd.4.smithi077.stdout:Aug 20 01:43:22 smithi077 podman[57321]: 2024-08-20 01:43:22.662272226 +0000 UTC m=+0.326081465 container init 579537b32eaffc57dcfad5cb74f2f4b2ffb7904194108024f65046bc5cf29b2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-08-20T01:43:22.740 INFO:journalctl@ceph.osd.4.smithi077.stdout:Aug 20 01:43:22 smithi077 podman[57321]: 2024-08-20 01:43:22.665628856 +0000 UTC m=+0.329438086 container start 579537b32eaffc57dcfad5cb74f2f4b2ffb7904194108024f65046bc5cf29b2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-08-20T01:43:22.740 INFO:journalctl@ceph.osd.4.smithi077.stdout:Aug 20 01:43:22 smithi077 podman[57321]: 2024-08-20 01:43:22.737551845 +0000 UTC m=+0.401361086 container attach 579537b32eaffc57dcfad5cb74f2f4b2ffb7904194108024f65046bc5cf29b2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux ) 2024-08-20T01:43:23.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:22 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:22.612+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:45.116816+0000 front 2024-08-20T01:42:45.116746+0000 (oldest deadline 2024-08-20T01:43:09.816908+0000) 2024-08-20T01:43:23.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:22 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:22.612+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.218781+0000 front 2024-08-20T01:42:56.218642+0000 (oldest deadline 2024-08-20T01:43:17.318804+0000) 2024-08-20T01:43:23.065 INFO:journalctl@ceph.osd.4.smithi077.stdout:Aug 20 01:43:22 smithi077 podman[57321]: 2024-08-20 01:43:22.874353112 +0000 UTC m=+0.538162332 container died 579537b32eaffc57dcfad5cb74f2f4b2ffb7904194108024f65046bc5cf29b2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-08-20T01:43:23.289 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:22 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:22.963+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:23.289 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:22 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:22.963+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.960661+0000 front 2024-08-20T01:42:54.960444+0000 (oldest deadline 2024-08-20T01:43:18.460536+0000) 2024-08-20T01:43:23.289 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:23 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:23.138+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:23.289 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:23 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:23.138+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:23.496 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.4.service' 2024-08-20T01:43:23.537 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:43:23.537 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-08-20T01:43:23.537 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-08-20T01:43:23.537 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.5 2024-08-20T01:43:23.567 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:23 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:23.276+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:23.567 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:23 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:23.276+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:23.567 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:23 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:23.470+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:23.567 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:23 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:23.470+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:23.815 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:23 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:23.679+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:23.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:23 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:23.635+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:23.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:23 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:23.635+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:23.867 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:23 smithi134 systemd[1]: Stopping Ceph osd.5 for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:43:23.867 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:23 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:23.639+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:45.116816+0000 front 2024-08-20T01:42:45.116746+0000 (oldest deadline 2024-08-20T01:43:09.816908+0000) 2024-08-20T01:43:23.867 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:23 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:23.639+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.218781+0000 front 2024-08-20T01:42:56.218642+0000 (oldest deadline 2024-08-20T01:43:17.318804+0000) 2024-08-20T01:43:23.867 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:23 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:23.864+0000 7f0c5c1ed640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:43:23.867 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:23 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:23.864+0000 7f0c5c1ed640 -1 osd.5 84 *** Got signal Terminated *** 2024-08-20T01:43:23.867 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:23 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:23.864+0000 7f0c5c1ed640 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:43:24.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:24 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:24.184+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:24.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:24 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:24.184+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:24.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:23 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:23.969+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:24.388 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:23 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:23.969+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.960661+0000 front 2024-08-20T01:42:54.960444+0000 (oldest deadline 2024-08-20T01:43:18.460536+0000) 2024-08-20T01:43:24.516 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:24 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:24.441+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:24.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:24 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:24.441+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:24.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:24 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:24.233+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:24.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:24 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:24.233+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:25.016 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:24 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:24.675+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:45.116816+0000 front 2024-08-20T01:42:45.116746+0000 (oldest deadline 2024-08-20T01:43:09.816908+0000) 2024-08-20T01:43:25.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:24 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:24.675+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.218781+0000 front 2024-08-20T01:42:56.218642+0000 (oldest deadline 2024-08-20T01:43:17.318804+0000) 2024-08-20T01:43:25.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:24 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:24.703+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:25.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:24 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:24.652+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:25.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:24 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:24.652+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:25.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:24 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:24.993+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:25.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:24 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:24.993+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.960661+0000 front 2024-08-20T01:42:54.960444+0000 (oldest deadline 2024-08-20T01:43:18.460536+0000) 2024-08-20T01:43:25.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:25 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:25.144+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:25.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:25 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:25.144+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:25.649 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:25 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:25.271+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:25.649 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:25 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:25.271+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:25.649 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:25 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:25.421+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:25.649 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:25 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:25.421+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:26.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:25 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:25.647+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:45.116816+0000 front 2024-08-20T01:42:45.116746+0000 (oldest deadline 2024-08-20T01:43:09.816908+0000) 2024-08-20T01:43:26.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:25 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:25.647+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.218781+0000 front 2024-08-20T01:42:56.218642+0000 (oldest deadline 2024-08-20T01:43:17.318804+0000) 2024-08-20T01:43:26.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:25 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:25.658+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:26.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:25 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:25.612+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:26.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:25 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:25.612+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:26.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:25 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:25.962+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:26.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:25 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:25.962+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.960661+0000 front 2024-08-20T01:42:54.960444+0000 (oldest deadline 2024-08-20T01:43:18.460536+0000) 2024-08-20T01:43:26.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:26 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:26.105+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:26.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:26 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:26.105+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:26.637 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:26 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:26.442+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:26.637 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:26 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:26.442+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:26.638 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:26 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:26.296+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:26.638 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:26 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:26.296+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:26.638 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:26 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:26.296+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:27.016 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:26 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:26.635+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:45.116816+0000 front 2024-08-20T01:42:45.116746+0000 (oldest deadline 2024-08-20T01:43:09.816908+0000) 2024-08-20T01:43:27.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:26 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:26.635+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.218781+0000 front 2024-08-20T01:42:56.218642+0000 (oldest deadline 2024-08-20T01:43:17.318804+0000) 2024-08-20T01:43:27.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:26 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:26.699+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:27.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:26 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:26.583+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:27.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:26 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:26.583+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:27.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:26 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:26.952+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:27.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:26 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:26.952+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.960661+0000 front 2024-08-20T01:42:54.960444+0000 (oldest deadline 2024-08-20T01:43:18.460536+0000) 2024-08-20T01:43:27.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:27 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:27.061+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:27.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:27 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:27.061+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:27.628 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:27 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:27.474+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:27.628 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:27 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:27.474+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:27.628 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:27 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:27.284+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:27.628 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:27 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:27.284+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:27.629 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:27 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:27.284+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:28.016 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:27 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:27.626+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:45.116816+0000 front 2024-08-20T01:42:45.116746+0000 (oldest deadline 2024-08-20T01:43:09.816908+0000) 2024-08-20T01:43:28.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:27 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:27.626+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.218781+0000 front 2024-08-20T01:42:56.218642+0000 (oldest deadline 2024-08-20T01:43:17.318804+0000) 2024-08-20T01:43:28.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:27 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:27.626+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:02.520699+0000 front 2024-08-20T01:43:02.520670+0000 (oldest deadline 2024-08-20T01:43:27.220842+0000) 2024-08-20T01:43:28.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:27 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:27.718+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:28.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:27 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:27.570+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:28.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:27 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:27.570+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:28.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:27 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:27.570+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:28.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:27 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:27.994+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:28.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:27 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:27.994+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.960661+0000 front 2024-08-20T01:42:54.960444+0000 (oldest deadline 2024-08-20T01:43:18.460536+0000) 2024-08-20T01:43:28.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:28 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:28.098+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:28.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:28 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:28.098+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:28.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:28 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:28.098+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:28.627 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:28 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:28.453+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:28.627 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:28 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:28.453+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:28.627 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:28 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:28.276+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:28.627 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:28 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:28.276+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:28.628 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:28 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:28.276+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:29.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:28 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:28.624+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:45.116816+0000 front 2024-08-20T01:42:45.116746+0000 (oldest deadline 2024-08-20T01:43:09.816908+0000) 2024-08-20T01:43:29.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:28 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:28.624+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.218781+0000 front 2024-08-20T01:42:56.218642+0000 (oldest deadline 2024-08-20T01:43:17.318804+0000) 2024-08-20T01:43:29.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:28 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5[34019]: 2024-08-20T01:43:28.624+0000 7f0c58802640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:02.520699+0000 front 2024-08-20T01:43:02.520670+0000 (oldest deadline 2024-08-20T01:43:27.220842+0000) 2024-08-20T01:43:29.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:28 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:28.768+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:29.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:28 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:28.586+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:29.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:28 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:28.586+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:29.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:28 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:28.586+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:29.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:29 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:29.020+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:29.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:29 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:29.020+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.960661+0000 front 2024-08-20T01:42:54.960444+0000 (oldest deadline 2024-08-20T01:43:18.460536+0000) 2024-08-20T01:43:29.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:29 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:29.072+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:29.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:29 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:29.072+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:29.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:29 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:29.072+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:29.517 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:29 smithi134 podman[58169]: 2024-08-20 01:43:29.218678629 +0000 UTC m=+5.488916561 container died 1dda9a0fa8c038d544bb3095637200e195c361b94ca5ef24837492715a8ceec2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-08-20T01:43:29.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:29 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:29.451+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:29.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:29 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:29.451+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:29.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:29 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:29.451+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:29.518 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:29 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:29.256+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:29.518 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:29 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:29.256+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:29.518 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:29 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:29.256+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:30.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:29 smithi134 podman[58169]: 2024-08-20 01:43:29.798342537 +0000 UTC m=+6.068580464 container cleanup 1dda9a0fa8c038d544bb3095637200e195c361b94ca5ef24837492715a8ceec2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:43:30.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:29 smithi134 bash[58169]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5 2024-08-20T01:43:30.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:29 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:29.743+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:30.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:29 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:29.634+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:30.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:29 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:29.634+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:30.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:29 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:29.634+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:30.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:30 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:30.050+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:30.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:30 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:30.050+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.960661+0000 front 2024-08-20T01:42:54.960444+0000 (oldest deadline 2024-08-20T01:43:18.460536+0000) 2024-08-20T01:43:30.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:30 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:30.050+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:02.363375+0000 front 2024-08-20T01:43:02.363208+0000 (oldest deadline 2024-08-20T01:43:29.363908+0000) 2024-08-20T01:43:30.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:30 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:30.030+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:30.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:30 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:30.030+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:30.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:30 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:30.030+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:30.408 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:30 smithi134 podman[58184]: 2024-08-20 01:43:30.066368698 +0000 UTC m=+0.842071424 container remove 1dda9a0fa8c038d544bb3095637200e195c361b94ca5ef24837492715a8ceec2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-08-20T01:43:30.408 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:30 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:30.228+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:30.409 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:30 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:30.228+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:30.409 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:30 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:30.228+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:30.746 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:30 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:30.406+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:30.746 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:30 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:30.406+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:30.746 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:30 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:30.406+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:30.747 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:30 smithi134 podman[58273]: 2024-08-20 01:43:30.32411074 +0000 UTC m=+0.016126396 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:43:30.747 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:30 smithi134 podman[58273]: 2024-08-20 01:43:30.430551242 +0000 UTC m=+0.122566885 container create 11186cd546c21762d9eeeacce74d1fd9de0a3621a4247568ed8bf20b8b75fbff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5-deactivate, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:43:30.747 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:30 smithi134 podman[58273]: 2024-08-20 01:43:30.653496315 +0000 UTC m=+0.345511965 container init 11186cd546c21762d9eeeacce74d1fd9de0a3621a4247568ed8bf20b8b75fbff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-08-20T01:43:30.747 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:30 smithi134 podman[58273]: 2024-08-20 01:43:30.65683112 +0000 UTC m=+0.348846770 container start 11186cd546c21762d9eeeacce74d1fd9de0a3621a4247568ed8bf20b8b75fbff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-20T01:43:30.747 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:30 smithi134 podman[58273]: 2024-08-20 01:43:30.745008622 +0000 UTC m=+0.437024271 container attach 11186cd546c21762d9eeeacce74d1fd9de0a3621a4247568ed8bf20b8b75fbff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-20T01:43:31.017 INFO:journalctl@ceph.osd.5.smithi134.stdout:Aug 20 01:43:30 smithi134 podman[58273]: 2024-08-20 01:43:30.842296456 +0000 UTC m=+0.534312098 container died 11186cd546c21762d9eeeacce74d1fd9de0a3621a4247568ed8bf20b8b75fbff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-5-deactivate, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-20T01:43:31.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:30 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:30.775+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:31.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:30 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:30.775+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.462570+0000 front 2024-08-20T01:43:04.462787+0000 (oldest deadline 2024-08-20T01:43:29.762624+0000) 2024-08-20T01:43:31.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:30 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:30.615+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:31.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:30 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:30.615+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:31.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:30 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:30.615+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:31.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:31 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:31.021+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:31.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:31 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:31.021+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.960661+0000 front 2024-08-20T01:42:54.960444+0000 (oldest deadline 2024-08-20T01:43:18.460536+0000) 2024-08-20T01:43:31.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:31 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:31.021+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:02.363375+0000 front 2024-08-20T01:43:02.363208+0000 (oldest deadline 2024-08-20T01:43:29.363908+0000) 2024-08-20T01:43:31.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:30 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:30.990+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:31.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:30 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:30.990+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:31.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:30 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:30.990+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:31.458 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:31 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:31.198+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:31.458 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:31 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:31.198+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:31.458 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:31 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:31.198+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:31.484 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.5.service' 2024-08-20T01:43:31.565 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:43:31.565 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-08-20T01:43:31.566 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-08-20T01:43:31.566 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.6 2024-08-20T01:43:31.766 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:31 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:31.454+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:31.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:31 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:31.454+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:31.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:31 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:31.454+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:31.879 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:31 smithi022 systemd[1]: Stopping Ceph osd.6 for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:43:32.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:31 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:31.759+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:32.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:31 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:31.759+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.462570+0000 front 2024-08-20T01:43:04.462787+0000 (oldest deadline 2024-08-20T01:43:29.762624+0000) 2024-08-20T01:43:32.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:31 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:31.608+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:32.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:31 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:31.608+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:32.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:31 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:31.608+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:32.137 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:31 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:31.988+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:32.137 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:31 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:31.988+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:32.137 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:31 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:31.988+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:32.138 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:31 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:31.876+0000 7f7cc2e8e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:43:32.138 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:31 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:31.876+0000 7f7cc2e8e640 -1 osd.6 84 *** Got signal Terminated *** 2024-08-20T01:43:32.138 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:31 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:31.876+0000 7f7cc2e8e640 -1 osd.6 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:43:32.138 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:31 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:31.990+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:32.138 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:31 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:31.990+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.960661+0000 front 2024-08-20T01:42:54.960444+0000 (oldest deadline 2024-08-20T01:43:18.460536+0000) 2024-08-20T01:43:32.138 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:31 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:31.990+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:02.363375+0000 front 2024-08-20T01:43:02.363208+0000 (oldest deadline 2024-08-20T01:43:29.363908+0000) 2024-08-20T01:43:32.430 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:32 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:32.176+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:32.430 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:32 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:32.176+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:32.430 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:32 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:32.176+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:32.736 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:32 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:32.634+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:32.737 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:32 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:32.634+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:32.737 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:32 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:32.634+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:32.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:32 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:32.427+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:32.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:32 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:32.427+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:32.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:32 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:32.427+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:33.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:32 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:32.734+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:33.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:32 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:32.734+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.462570+0000 front 2024-08-20T01:43:04.462787+0000 (oldest deadline 2024-08-20T01:43:29.762624+0000) 2024-08-20T01:43:33.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:33.007+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:33.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:33.007+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:33.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:33.007+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:33.388 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:33.023+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:33.388 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:33.023+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.960661+0000 front 2024-08-20T01:42:54.960444+0000 (oldest deadline 2024-08-20T01:43:18.460536+0000) 2024-08-20T01:43:33.388 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:33 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:33.023+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:02.363375+0000 front 2024-08-20T01:43:02.363208+0000 (oldest deadline 2024-08-20T01:43:29.363908+0000) 2024-08-20T01:43:33.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:33 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:33.151+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:33.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:33 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:33.151+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:33.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:33 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:33.151+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:33.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:33 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:33.392+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:33.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:33 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:33.392+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:33.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:33 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:33.392+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:34.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:33 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:33.685+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:34.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:33 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:33.685+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.462570+0000 front 2024-08-20T01:43:04.462787+0000 (oldest deadline 2024-08-20T01:43:29.762624+0000) 2024-08-20T01:43:34.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:33 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:33.641+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:34.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:33 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:33.641+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:34.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:33 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:33.641+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:34.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:34 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:34.002+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:34.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:34 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:34.002+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:34.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:34 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:34.002+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:34.388 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:34 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:34.035+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:34.388 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:34 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:34.035+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.960661+0000 front 2024-08-20T01:42:54.960444+0000 (oldest deadline 2024-08-20T01:43:18.460536+0000) 2024-08-20T01:43:34.388 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:34 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:34.035+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:02.363375+0000 front 2024-08-20T01:43:02.363208+0000 (oldest deadline 2024-08-20T01:43:29.363908+0000) 2024-08-20T01:43:34.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:34 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:34.402+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:34.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:34 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:34.402+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:34.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:34 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:34.402+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:34.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:34 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:34.159+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:34.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:34 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:34.159+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:34.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:34 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:34.159+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:35.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:34 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:34.718+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:35.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:34 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:34.718+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.462570+0000 front 2024-08-20T01:43:04.462787+0000 (oldest deadline 2024-08-20T01:43:29.762624+0000) 2024-08-20T01:43:35.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:34 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:34.678+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:35.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:34 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:34.678+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:35.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:34 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:34.678+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:35.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:34 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:34.678+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:35.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:34 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:34.995+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:35.388 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:34 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:34.995+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.960661+0000 front 2024-08-20T01:42:54.960444+0000 (oldest deadline 2024-08-20T01:43:18.460536+0000) 2024-08-20T01:43:35.388 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:34 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:34.995+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:02.363375+0000 front 2024-08-20T01:43:02.363208+0000 (oldest deadline 2024-08-20T01:43:29.363908+0000) 2024-08-20T01:43:35.388 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:34 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:34.995+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.364387+0000 front 2024-08-20T01:43:09.364416+0000 (oldest deadline 2024-08-20T01:43:34.664526+0000) 2024-08-20T01:43:35.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:35 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:35.036+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:35.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:35 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:35.036+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:35.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:35 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:35.036+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:35.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:35 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:35.036+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:35.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:35 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:35.198+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:35.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:35 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:35.198+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:35.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:35 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:35.198+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:35.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:35 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:35.432+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:35.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:35 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:35.432+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:35.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:35 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:35.432+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:36.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:35 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:35.753+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:36.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:35 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:35.753+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.462570+0000 front 2024-08-20T01:43:04.462787+0000 (oldest deadline 2024-08-20T01:43:29.762624+0000) 2024-08-20T01:43:36.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:35 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:35.753+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.763271+0000 front 2024-08-20T01:43:09.763179+0000 (oldest deadline 2024-08-20T01:43:35.063128+0000) 2024-08-20T01:43:36.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:35 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:35.667+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:36.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:35 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:35.667+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:36.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:35 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:35.667+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:36.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:35 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:35.667+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:36.387 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:35 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:35.965+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.559294+0000 front 2024-08-20T01:42:48.559337+0000 (oldest deadline 2024-08-20T01:43:10.859423+0000) 2024-08-20T01:43:36.388 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:35 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:35.965+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.960661+0000 front 2024-08-20T01:42:54.960444+0000 (oldest deadline 2024-08-20T01:43:18.460536+0000) 2024-08-20T01:43:36.388 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:35 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:35.965+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:02.363375+0000 front 2024-08-20T01:43:02.363208+0000 (oldest deadline 2024-08-20T01:43:29.363908+0000) 2024-08-20T01:43:36.388 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:35 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6[47697]: 2024-08-20T01:43:35.965+0000 7f7cbf4a3640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.364387+0000 front 2024-08-20T01:43:09.364416+0000 (oldest deadline 2024-08-20T01:43:34.664526+0000) 2024-08-20T01:43:36.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:36 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:36.017+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:36.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:36 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:36.017+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:36.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:36 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:36.017+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:36.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:36 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:36.017+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:36.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:36 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:36.457+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:36.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:36 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:36.457+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:36.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:36 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:36.457+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:36.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:36 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:36.233+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:36.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:36 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:36.233+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:36.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:36 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:36.233+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:37.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:36 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:36.710+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:37.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:36 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:36.710+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.462570+0000 front 2024-08-20T01:43:04.462787+0000 (oldest deadline 2024-08-20T01:43:29.762624+0000) 2024-08-20T01:43:37.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:36 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:36.710+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.763271+0000 front 2024-08-20T01:43:09.763179+0000 (oldest deadline 2024-08-20T01:43:35.063128+0000) 2024-08-20T01:43:37.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:36 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:36.634+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:37.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:36 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:36.634+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:37.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:36 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:36.634+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:37.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:36 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:36.634+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:37.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:36 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:36.982+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:37.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:36 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:36.982+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:37.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:36 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:36.982+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:37.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:36 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:36.982+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:37.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:37 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:37.412+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:37.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:37 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:37.412+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:37.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:37 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:37.412+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:37.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:37 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:37.211+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:37.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:37 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:37.211+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:37.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:37 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:37.211+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:37.687 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:37 smithi022 podman[94152]: 2024-08-20 01:43:37.402616861 +0000 UTC m=+5.637444052 container died b64f1fc285ba880e9d295fb5fbc3e07fffad7a2a1dca0306e08c97be2ecddddb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-08-20T01:43:38.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:37 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:37.758+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:38.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:37 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:37.758+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.462570+0000 front 2024-08-20T01:43:04.462787+0000 (oldest deadline 2024-08-20T01:43:29.762624+0000) 2024-08-20T01:43:38.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:37 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:37.758+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.763271+0000 front 2024-08-20T01:43:09.763179+0000 (oldest deadline 2024-08-20T01:43:35.063128+0000) 2024-08-20T01:43:38.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:37 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:37.607+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:38.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:37 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:37.607+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:38.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:37 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:37.607+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:38.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:37 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:37.607+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:38.281 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:37 smithi022 podman[94152]: 2024-08-20 01:43:37.994057246 +0000 UTC m=+6.228884426 container cleanup b64f1fc285ba880e9d295fb5fbc3e07fffad7a2a1dca0306e08c97be2ecddddb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:43:38.281 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:37 smithi022 bash[94152]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6 2024-08-20T01:43:38.281 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:38 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:38.028+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:38.281 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:38 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:38.028+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:38.281 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:38 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:38.028+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:38.281 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:38 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:38.028+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:38.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:38 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:38.436+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:38.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:38 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:38.436+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:38.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:38 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:38.436+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:38.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:38 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:38.214+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:38.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:38 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:38.214+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:38.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:38 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:38.214+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:38.615 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:38 smithi022 podman[94168]: 2024-08-20 01:43:38.279364047 +0000 UTC m=+0.869701111 container remove b64f1fc285ba880e9d295fb5fbc3e07fffad7a2a1dca0306e08c97be2ecddddb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-20T01:43:38.887 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:38 smithi022 podman[94254]: 2024-08-20 01:43:38.613642606 +0000 UTC m=+0.103761331 container create a92975de4d9502b3c3e3ca88b7dfceb71637f6b8fbf70c387931e43bbf66a20a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-20T01:43:38.887 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:38 smithi022 podman[94254]: 2024-08-20 01:43:38.526041374 +0000 UTC m=+0.016160068 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:43:39.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:38 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:38.747+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:39.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:38 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:38.747+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.462570+0000 front 2024-08-20T01:43:04.462787+0000 (oldest deadline 2024-08-20T01:43:29.762624+0000) 2024-08-20T01:43:39.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:38 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:38.747+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.763271+0000 front 2024-08-20T01:43:09.763179+0000 (oldest deadline 2024-08-20T01:43:35.063128+0000) 2024-08-20T01:43:39.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:38 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:38.637+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:39.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:38 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:38.637+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:39.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:38 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:38.637+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:39.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:38 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:38.637+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:39.179 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:38 smithi022 podman[94254]: 2024-08-20 01:43:38.98326765 +0000 UTC m=+0.473386330 container init a92975de4d9502b3c3e3ca88b7dfceb71637f6b8fbf70c387931e43bbf66a20a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:43:39.179 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:38 smithi022 podman[94254]: 2024-08-20 01:43:38.986803182 +0000 UTC m=+0.476921861 container start a92975de4d9502b3c3e3ca88b7dfceb71637f6b8fbf70c387931e43bbf66a20a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6-deactivate, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-20T01:43:39.179 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:39 smithi022 podman[94254]: 2024-08-20 01:43:39.057978298 +0000 UTC m=+0.548096996 container attach a92975de4d9502b3c3e3ca88b7dfceb71637f6b8fbf70c387931e43bbf66a20a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:43:39.179 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:39 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:39.047+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:39.179 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:39 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:39.047+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:39.179 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:39 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:39.047+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:39.180 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:39 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:39.047+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:39.453 INFO:journalctl@ceph.osd.6.smithi022.stdout:Aug 20 01:43:39 smithi022 podman[94254]: 2024-08-20 01:43:39.177607956 +0000 UTC m=+0.667726651 container died a92975de4d9502b3c3e3ca88b7dfceb71637f6b8fbf70c387931e43bbf66a20a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-6-deactivate, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-20T01:43:39.485 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:39 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:39.232+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:39.485 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:39 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:39.232+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:39.485 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:39 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:39.232+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:39.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:39 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:39.483+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:39.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:39 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:39.483+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:39.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:39 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:39.483+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:39.805 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.6.service' 2024-08-20T01:43:39.845 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:43:39.845 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-08-20T01:43:39.846 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-08-20T01:43:39.846 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.7 2024-08-20T01:43:40.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:39 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:39.707+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:40.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:39 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:39.707+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.462570+0000 front 2024-08-20T01:43:04.462787+0000 (oldest deadline 2024-08-20T01:43:29.762624+0000) 2024-08-20T01:43:40.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:39 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:39.707+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.763271+0000 front 2024-08-20T01:43:09.763179+0000 (oldest deadline 2024-08-20T01:43:35.063128+0000) 2024-08-20T01:43:40.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:39 smithi077 systemd[1]: Stopping Ceph osd.7 for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:43:40.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:39 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:39.652+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:40.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:39 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:39.652+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:40.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:39 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:39.652+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:40.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:39 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:39.652+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:40.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:40 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:40.084+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:40.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:40 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:40.084+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:40.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:40 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:40.084+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:40.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:40 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:40.084+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:40.440 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:40 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:40.186+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:40.440 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:40 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:40.186+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:40.440 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:40 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:40.186+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:40.565 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:40 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:40.152+0000 7f0607be2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:43:40.565 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:40 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:40.152+0000 7f0607be2640 -1 osd.7 84 *** Got signal Terminated *** 2024-08-20T01:43:40.565 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:40 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:40.152+0000 7f0607be2640 -1 osd.7 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:43:40.766 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:40 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:40.438+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:40.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:40 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:40.438+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:40.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:40 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:40.438+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:41.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:40 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:40.756+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:41.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:40 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:40.756+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.462570+0000 front 2024-08-20T01:43:04.462787+0000 (oldest deadline 2024-08-20T01:43:29.762624+0000) 2024-08-20T01:43:41.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:40 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:40.756+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.763271+0000 front 2024-08-20T01:43:09.763179+0000 (oldest deadline 2024-08-20T01:43:35.063128+0000) 2024-08-20T01:43:41.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:40 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:40.613+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:41.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:40 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:40.613+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:41.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:40 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:40.613+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:41.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:40 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:40.613+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:41.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:41 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:41.059+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:41.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:41 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:41.059+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:41.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:41 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:41.059+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:41.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:41 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:41.059+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:41.489 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:41 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:41.147+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:41.489 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:41 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:41.147+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:41.489 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:41 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:41.147+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:41.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:41 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:41.487+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:41.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:41 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:41.487+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:41.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:41 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:41.487+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:42.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:41 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:41.717+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:42.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:41 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:41.717+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.462570+0000 front 2024-08-20T01:43:04.462787+0000 (oldest deadline 2024-08-20T01:43:29.762624+0000) 2024-08-20T01:43:42.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:41 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:41.717+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.763271+0000 front 2024-08-20T01:43:09.763179+0000 (oldest deadline 2024-08-20T01:43:35.063128+0000) 2024-08-20T01:43:42.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:41 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:41.571+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:42.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:41 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:41.571+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:42.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:41 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:41.571+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:42.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:41 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:41.571+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:42.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:41 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:41.571+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:43:42.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:42 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:42.105+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:42.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:42 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:42.105+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:42.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:42 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:42.105+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:42.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:42 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:42.105+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:42.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:42 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:42.144+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:42.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:42 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:42.144+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:42.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:42 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:42.144+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:43.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:42 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:42.515+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:43.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:42 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:42.515+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:43.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:42 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:42.515+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:43.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:42 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:42.515+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.039758+0000 front 2024-08-20T01:43:18.039626+0000 (oldest deadline 2024-08-20T01:43:41.539641+0000) 2024-08-20T01:43:43.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:42 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:42.704+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:43.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:42 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:42.704+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.462570+0000 front 2024-08-20T01:43:04.462787+0000 (oldest deadline 2024-08-20T01:43:29.762624+0000) 2024-08-20T01:43:43.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:42 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:42.704+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.763271+0000 front 2024-08-20T01:43:09.763179+0000 (oldest deadline 2024-08-20T01:43:35.063128+0000) 2024-08-20T01:43:43.067 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:42 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:42.704+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:19.664355+0000 front 2024-08-20T01:43:19.664393+0000 (oldest deadline 2024-08-20T01:43:41.964466+0000) 2024-08-20T01:43:43.067 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:42 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:42.591+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:43.067 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:42 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:42.591+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:43.067 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:42 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:42.591+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:43.067 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:42 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:42.591+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:43.067 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:42 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:42.591+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:43:43.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:43 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:43.073+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:43.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:43 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:43.073+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:43.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:43 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:43.073+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:43.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:43 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:43.073+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:43.516 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:43 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:43.170+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:43.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:43 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:43.170+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:43.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:43 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:43.170+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:43.815 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:43 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:43.693+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:43.815 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:43 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:43.693+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.462570+0000 front 2024-08-20T01:43:04.462787+0000 (oldest deadline 2024-08-20T01:43:29.762624+0000) 2024-08-20T01:43:43.815 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:43 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:43.693+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.763271+0000 front 2024-08-20T01:43:09.763179+0000 (oldest deadline 2024-08-20T01:43:35.063128+0000) 2024-08-20T01:43:43.815 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:43 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:43.693+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:19.664355+0000 front 2024-08-20T01:43:19.664393+0000 (oldest deadline 2024-08-20T01:43:41.964466+0000) 2024-08-20T01:43:43.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:43 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:43.552+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:43.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:43 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:43.552+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:43.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:43 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:43.552+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:43.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:43 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:43.552+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:43.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:43 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:43.552+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:43:44.018 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:43 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:43.517+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:44.018 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:43 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:43.517+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:44.018 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:43 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:43.517+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:44.018 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:43 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:43.517+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.039758+0000 front 2024-08-20T01:43:18.039626+0000 (oldest deadline 2024-08-20T01:43:41.539641+0000) 2024-08-20T01:43:44.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:44 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:44.056+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:44.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:44 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:44.056+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:44.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:44 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:44.056+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:44.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:44 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:44.056+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:44.516 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:44 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:44.187+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:44.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:44 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:44.187+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:44.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:44 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:44.187+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:44.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:44 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:44.187+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:43:45.016 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:44 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:44.543+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:45.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:44 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:44.543+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:45.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:44 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:44.543+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:45.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:44 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:44.543+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.039758+0000 front 2024-08-20T01:43:18.039626+0000 (oldest deadline 2024-08-20T01:43:41.539641+0000) 2024-08-20T01:43:45.065 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:44 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:44.680+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.360897+0000 front 2024-08-20T01:42:56.360948+0000 (oldest deadline 2024-08-20T01:43:18.561522+0000) 2024-08-20T01:43:45.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:44 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:44.680+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.462570+0000 front 2024-08-20T01:43:04.462787+0000 (oldest deadline 2024-08-20T01:43:29.762624+0000) 2024-08-20T01:43:45.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:44 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:44.680+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.763271+0000 front 2024-08-20T01:43:09.763179+0000 (oldest deadline 2024-08-20T01:43:35.063128+0000) 2024-08-20T01:43:45.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:44 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7[39719]: 2024-08-20T01:43:44.680+0000 7f06001ef640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:19.664355+0000 front 2024-08-20T01:43:19.664393+0000 (oldest deadline 2024-08-20T01:43:41.964466+0000) 2024-08-20T01:43:45.067 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:44 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:44.567+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:45.067 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:44 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:44.567+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:45.067 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:44 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:44.568+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:45.067 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:44 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:44.568+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:45.067 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:44 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:44.568+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:43:45.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:45 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:45.036+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:45.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:45 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:45.036+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:45.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:45 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:45.036+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:45.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:45 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:45.036+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:45.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:45 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:45.194+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:45.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:45 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:45.194+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:45.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:45 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:45.194+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:45.518 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:45 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:45.194+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:43:45.815 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:45 smithi077 podman[57428]: 2024-08-20 01:43:45.559649302 +0000 UTC m=+5.525790595 container died ce140e47899b232d0516016e2a4335a1a60be04253e11e02a59aeea30dea7fab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux ) 2024-08-20T01:43:45.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:45 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:45.542+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:45.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:45 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:45.542+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:45.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:45 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:45.542+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:45.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:45 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:45.542+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:45.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:45 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:45.542+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:43:46.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:45 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:45.570+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:46.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:45 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:45.570+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:46.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:45 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:45.570+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:46.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:45 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:45.570+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.039758+0000 front 2024-08-20T01:43:18.039626+0000 (oldest deadline 2024-08-20T01:43:41.539641+0000) 2024-08-20T01:43:46.164 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:45 smithi077 podman[57428]: 2024-08-20 01:43:45.969916198 +0000 UTC m=+5.936057490 container cleanup ce140e47899b232d0516016e2a4335a1a60be04253e11e02a59aeea30dea7fab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-08-20T01:43:46.165 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:45 smithi077 bash[57428]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7 2024-08-20T01:43:46.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:46 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:46.046+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:46.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:46 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:46.046+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:46.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:46 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:46.046+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:46.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:46 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:46.046+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:46.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:46 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:46.165+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:46.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:46 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:46.165+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:46.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:46 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:46.165+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:46.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:46 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:46.165+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:43:46.533 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:46 smithi077 podman[57443]: 2024-08-20 01:43:46.162979633 +0000 UTC m=+0.600447312 container remove ce140e47899b232d0516016e2a4335a1a60be04253e11e02a59aeea30dea7fab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-08-20T01:43:46.793 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:46 smithi077 podman[57533]: 2024-08-20 01:43:46.490351385 +0000 UTC m=+0.015569635 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:43:46.793 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:46 smithi077 podman[57533]: 2024-08-20 01:43:46.588798515 +0000 UTC m=+0.114016754 container create 506bd13c432281ae77e4584a5821daee9f7cf6c131c490981c71cb78e40f81b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7-deactivate, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.build-date=20240731) 2024-08-20T01:43:46.793 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:46 smithi077 podman[57533]: 2024-08-20 01:43:46.791422069 +0000 UTC m=+0.316640308 container init 506bd13c432281ae77e4584a5821daee9f7cf6c131c490981c71cb78e40f81b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:43:46.793 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:46 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:46.530+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:46.793 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:46 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:46.530+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:46.793 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:46 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:46.530+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:46.793 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:46 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:46.530+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:46.794 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:46 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:46.530+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:43:47.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:46 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:46.555+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:47.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:46 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:46.555+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:47.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:46 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:46.555+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:47.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:46 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:46.555+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.039758+0000 front 2024-08-20T01:43:18.039626+0000 (oldest deadline 2024-08-20T01:43:41.539641+0000) 2024-08-20T01:43:47.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:46 smithi077 podman[57533]: 2024-08-20 01:43:46.794800045 +0000 UTC m=+0.320018287 container start 506bd13c432281ae77e4584a5821daee9f7cf6c131c490981c71cb78e40f81b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-20T01:43:47.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:46 smithi077 podman[57533]: 2024-08-20 01:43:46.899760587 +0000 UTC m=+0.424978827 container attach 506bd13c432281ae77e4584a5821daee9f7cf6c131c490981c71cb78e40f81b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-20T01:43:47.066 INFO:journalctl@ceph.osd.7.smithi077.stdout:Aug 20 01:43:46 smithi077 podman[57533]: 2024-08-20 01:43:46.98350335 +0000 UTC m=+0.508721599 container died 506bd13c432281ae77e4584a5821daee9f7cf6c131c490981c71cb78e40f81b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-08-20T01:43:47.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:47 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:47.010+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:47.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:47 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:47.010+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:47.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:47 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:47.010+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:47.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:47 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:47.010+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:47.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:47 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:47.215+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:47.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:47 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:47.215+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:47.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:47 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:47.215+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:47.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:47 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:47.215+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:43:47.675 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.7.service' 2024-08-20T01:43:47.714 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:43:47.714 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-08-20T01:43:47.715 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-08-20T01:43:47.715 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.8 2024-08-20T01:43:47.925 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:47 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:47.578+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:47.925 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:47 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:47.578+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:47.926 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:47 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:47.578+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:47.926 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:47 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:47.578+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:47.926 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:47 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:47.578+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:43:48.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:47 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:47.527+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:48.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:47 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:47.527+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:48.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:47 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:47.527+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:48.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:47 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:47.527+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.039758+0000 front 2024-08-20T01:43:18.039626+0000 (oldest deadline 2024-08-20T01:43:41.539641+0000) 2024-08-20T01:43:48.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:47 smithi134 systemd[1]: Stopping Ceph osd.8 for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:43:48.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:48 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:48.042+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:48.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:48 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:48.042+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:48.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:48 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:48.042+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:48.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:48 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:48.042+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:48.499 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:48 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:48.221+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:48.499 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:48 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:48.221+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:48.499 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:48 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:48.221+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:48.499 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:48 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:48.221+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:43:48.500 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:48 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:48.018+0000 7fed5afe4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:43:48.500 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:48 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:48.018+0000 7fed5afe4640 -1 osd.8 84 *** Got signal Terminated *** 2024-08-20T01:43:48.500 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:48 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:48.018+0000 7fed5afe4640 -1 osd.8 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:43:48.500 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:48 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:48.497+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:48.500 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:48 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:48.497+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:48.500 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:48 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:48.497+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:48.500 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:48 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:48.497+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.039758+0000 front 2024-08-20T01:43:18.039626+0000 (oldest deadline 2024-08-20T01:43:41.539641+0000) 2024-08-20T01:43:48.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:48 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:48.536+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:48.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:48 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:48.536+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:48.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:48 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:48.536+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:48.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:48 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:48.536+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:48.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:48 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:48.536+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:43:49.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:49 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:49.041+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:49.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:49 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:49.041+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:49.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:49 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:49.041+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:49.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:49 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:49.041+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:49.501 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:49 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:49.172+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:49.501 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:49 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:49.172+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:49.501 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:49 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:49.172+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:49.501 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:49 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:49.172+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:43:49.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:49 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:49.499+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:49.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:49 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:49.499+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:49.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:49 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:49.499+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:49.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:49 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:49.499+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.039758+0000 front 2024-08-20T01:43:18.039626+0000 (oldest deadline 2024-08-20T01:43:41.539641+0000) 2024-08-20T01:43:49.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:49 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:49.539+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:49.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:49 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:49.539+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:49.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:49 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:49.539+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:49.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:49 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:49.539+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:49.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:49 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:49.539+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:43:50.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:50 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:50.061+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:50.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:50 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:50.061+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:50.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:50 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:50.061+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:50.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:50 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:50.061+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:50.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:50 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:50.061+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:28.149560+0000 front 2024-08-20T01:43:28.149481+0000 (oldest deadline 2024-08-20T01:43:49.249432+0000) 2024-08-20T01:43:50.506 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:50 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:50.191+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:50.507 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:50 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:50.191+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:50.507 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:50 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:50.191+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:50.507 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:50 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:50.191+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:43:50.507 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:50 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:50.191+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:43:50.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:50 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:50.505+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:50.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:50 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:50.505+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:50.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:50 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:50.505+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:50.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:50 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:50.505+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.039758+0000 front 2024-08-20T01:43:18.039626+0000 (oldest deadline 2024-08-20T01:43:41.539641+0000) 2024-08-20T01:43:50.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:50 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:50.538+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:50.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:50 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:50.538+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:50.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:50 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:50.538+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:50.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:50 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:50.538+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:50.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:50 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:50.538+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:43:50.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:50 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:50.538+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.462081+0000 front 2024-08-20T01:43:24.462182+0000 (oldest deadline 2024-08-20T01:43:50.361966+0000) 2024-08-20T01:43:51.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:51 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:51.033+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:51.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:51 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:51.033+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:51.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:51 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:51.033+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:51.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:51 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:51.033+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:51.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:51 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:51.033+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:28.149560+0000 front 2024-08-20T01:43:28.149481+0000 (oldest deadline 2024-08-20T01:43:49.249432+0000) 2024-08-20T01:43:51.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:51 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:51.226+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:51.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:51 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:51.226+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:51.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:51 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:51.226+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:51.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:51 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:51.226+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:43:51.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:51 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:51.226+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:43:52.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:51 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:51.531+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:52.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:51 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:51.531+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:52.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:51 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:51.531+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:52.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:51 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:51.531+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.039758+0000 front 2024-08-20T01:43:18.039626+0000 (oldest deadline 2024-08-20T01:43:41.539641+0000) 2024-08-20T01:43:52.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:51 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:51.531+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:27.440453+0000 front 2024-08-20T01:43:27.440480+0000 (oldest deadline 2024-08-20T01:43:50.940582+0000) 2024-08-20T01:43:52.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:51 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:51.574+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:52.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:51 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:51.574+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:52.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:51 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:51.574+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:52.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:51 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:51.574+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:52.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:51 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:51.574+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:43:52.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:51 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:51.574+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.462081+0000 front 2024-08-20T01:43:24.462182+0000 (oldest deadline 2024-08-20T01:43:50.361966+0000) 2024-08-20T01:43:52.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:52 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:52.023+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:52.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:52 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:52.023+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:52.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:52 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:52.023+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:52.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:52 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:52.023+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:52.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:52 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:52.023+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:28.149560+0000 front 2024-08-20T01:43:28.149481+0000 (oldest deadline 2024-08-20T01:43:49.249432+0000) 2024-08-20T01:43:52.514 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:52 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:52.187+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:52.514 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:52 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:52.187+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:52.514 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:52 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:52.187+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:52.515 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:52 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:52.187+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:43:52.515 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:52 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:52.187+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:43:52.766 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:52 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:52.512+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:47.933044+0000 front 2024-08-20T01:42:47.932950+0000 (oldest deadline 2024-08-20T01:43:10.233015+0000) 2024-08-20T01:43:52.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:52 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:52.512+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.835066+0000 front 2024-08-20T01:42:54.835045+0000 (oldest deadline 2024-08-20T01:43:18.335028+0000) 2024-08-20T01:43:52.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:52 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:52.512+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:04.136738+0000 front 2024-08-20T01:43:04.136876+0000 (oldest deadline 2024-08-20T01:43:28.836927+0000) 2024-08-20T01:43:52.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:52 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:52.512+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.039758+0000 front 2024-08-20T01:43:18.039626+0000 (oldest deadline 2024-08-20T01:43:41.539641+0000) 2024-08-20T01:43:52.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:52 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8[40927]: 2024-08-20T01:43:52.512+0000 7fed535f1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:27.440453+0000 front 2024-08-20T01:43:27.440480+0000 (oldest deadline 2024-08-20T01:43:50.940582+0000) 2024-08-20T01:43:53.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:52 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:52.618+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:53.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:52 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:52.618+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:53.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:52 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:52.618+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:53.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:52 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:52.618+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:53.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:52 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:52.618+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:43:53.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:52 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:52.618+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.462081+0000 front 2024-08-20T01:43:24.462182+0000 (oldest deadline 2024-08-20T01:43:50.361966+0000) 2024-08-20T01:43:53.289 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:53 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:53.012+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:53.289 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:53 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:53.012+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:53.289 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:53 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:53.012+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:53.289 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:53 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:53.012+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:53.289 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:53 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:53.012+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:28.149560+0000 front 2024-08-20T01:43:28.149481+0000 (oldest deadline 2024-08-20T01:43:49.249432+0000) 2024-08-20T01:43:53.515 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:53 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:53.185+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:53.515 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:53 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:53.185+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:53.516 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:53 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:53.185+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:53.516 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:53 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:53.185+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:43:53.516 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:53 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:53.185+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:43:53.767 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:53 smithi134 podman[58375]: 2024-08-20 01:43:53.514125272 +0000 UTC m=+5.607467755 container died b17439176632dfffb5bfa5bf27cbdc7f74d8083d0f3a1b35abce743d0b004b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-20T01:43:54.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:53 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:53.627+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:54.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:53 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:53.627+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:54.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:53 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:53.627+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:54.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:53 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:53.627+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:54.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:53 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:53.627+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:43:54.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:53 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:53.627+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.462081+0000 front 2024-08-20T01:43:24.462182+0000 (oldest deadline 2024-08-20T01:43:50.361966+0000) 2024-08-20T01:43:54.165 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:53 smithi134 podman[58375]: 2024-08-20 01:43:53.935024949 +0000 UTC m=+6.028367425 container cleanup b17439176632dfffb5bfa5bf27cbdc7f74d8083d0f3a1b35abce743d0b004b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8, io.buildah.version=1.36.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T01:43:54.165 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:53 smithi134 bash[58375]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8 2024-08-20T01:43:54.300 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:54 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:54.044+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:54.300 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:54 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:54.044+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:54.300 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:54 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:54.044+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:54.300 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:54 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:54.044+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:54.301 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:54 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:54.044+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:28.149560+0000 front 2024-08-20T01:43:28.149481+0000 (oldest deadline 2024-08-20T01:43:49.249432+0000) 2024-08-20T01:43:54.517 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:54 smithi134 podman[58401]: 2024-08-20 01:43:54.211372019 +0000 UTC m=+0.688954771 container remove b17439176632dfffb5bfa5bf27cbdc7f74d8083d0f3a1b35abce743d0b004b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-08-20T01:43:54.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:54 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:54.163+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:54.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:54 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:54.163+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:54.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:54 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:54.163+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:54.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:54 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:54.163+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:43:54.518 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:54 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:54.163+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:43:55.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:54 smithi134 podman[58491]: 2024-08-20 01:43:54.604946621 +0000 UTC m=+0.015907170 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:43:55.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:54 smithi134 podman[58491]: 2024-08-20 01:43:54.720543444 +0000 UTC m=+0.131504030 container create c91eaaccc66978f3959f7fe3b39533a1d4b51c0895ccb8e6657efb054548ae59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:43:55.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:54 smithi134 podman[58491]: 2024-08-20 01:43:54.939621493 +0000 UTC m=+0.350582040 container init c91eaaccc66978f3959f7fe3b39533a1d4b51c0895ccb8e6657efb054548ae59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-20T01:43:55.017 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:54 smithi134 podman[58491]: 2024-08-20 01:43:54.942919157 +0000 UTC m=+0.353879702 container start c91eaaccc66978f3959f7fe3b39533a1d4b51c0895ccb8e6657efb054548ae59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:43:55.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:54 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:54.638+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:55.067 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:54 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:54.638+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:55.067 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:54 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:54.638+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:55.067 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:54 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:54.638+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:55.067 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:54 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:54.638+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:43:55.067 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:54 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:54.638+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.462081+0000 front 2024-08-20T01:43:24.462182+0000 (oldest deadline 2024-08-20T01:43:50.361966+0000) 2024-08-20T01:43:55.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:55.036+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:55.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:55.036+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:55.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:55.036+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:55.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:55.036+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:55.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:55 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:55.036+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:28.149560+0000 front 2024-08-20T01:43:28.149481+0000 (oldest deadline 2024-08-20T01:43:49.249432+0000) 2024-08-20T01:43:55.437 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:55 smithi134 podman[58491]: 2024-08-20 01:43:55.032185822 +0000 UTC m=+0.443146381 container attach c91eaaccc66978f3959f7fe3b39533a1d4b51c0895ccb8e6657efb054548ae59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-08-20T01:43:55.437 INFO:journalctl@ceph.osd.8.smithi134.stdout:Aug 20 01:43:55 smithi134 podman[58491]: 2024-08-20 01:43:55.142051061 +0000 UTC m=+0.553011608 container died c91eaaccc66978f3959f7fe3b39533a1d4b51c0895ccb8e6657efb054548ae59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True) 2024-08-20T01:43:55.437 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:55 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:55.152+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:55.437 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:55 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:55.152+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:55.437 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:55 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:55.152+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:55.437 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:55 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:55.152+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:43:55.437 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:55 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:55.152+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:43:55.774 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.8.service' 2024-08-20T01:43:55.813 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:43:55.814 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-08-20T01:43:55.814 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-08-20T01:43:55.814 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.9 2024-08-20T01:43:56.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:55 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:55.606+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:56.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:55 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:55.606+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:56.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:55 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:55.606+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:56.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:55 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:55.606+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:56.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:55 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:55.606+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:43:56.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:55 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:55.606+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.462081+0000 front 2024-08-20T01:43:24.462182+0000 (oldest deadline 2024-08-20T01:43:50.361966+0000) 2024-08-20T01:43:56.125 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:55 smithi022 systemd[1]: Stopping Ceph osd.9 for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:43:56.125 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:56 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:56.013+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:56.125 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:56 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:56.013+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:56.126 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:56 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:56.013+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:56.126 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:56 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:56.013+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:56.126 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:56 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:56.014+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:28.149560+0000 front 2024-08-20T01:43:28.149481+0000 (oldest deadline 2024-08-20T01:43:49.249432+0000) 2024-08-20T01:43:56.126 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:56 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:56.123+0000 7f816aca4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:43:56.126 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:56 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:56.123+0000 7f816aca4640 -1 osd.9 84 *** Got signal Terminated *** 2024-08-20T01:43:56.126 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:56 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:56.123+0000 7f816aca4640 -1 osd.9 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:43:56.516 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:56 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:56.113+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:56.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:56 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:56.113+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:56.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:56 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:56.113+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:56.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:56 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:56.113+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:43:56.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:56 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:56.113+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:43:57.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:56 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:56.645+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:57.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:56 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:56.645+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:57.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:56 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:56.645+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:57.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:56 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:56.645+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:57.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:56 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:56.645+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:43:57.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:56 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:56.645+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.462081+0000 front 2024-08-20T01:43:24.462182+0000 (oldest deadline 2024-08-20T01:43:50.361966+0000) 2024-08-20T01:43:57.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:56 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:56.991+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:57.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:56 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:56.991+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:57.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:56 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:56.991+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:57.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:56 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:56.991+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:57.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:56 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:56.991+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:28.149560+0000 front 2024-08-20T01:43:28.149481+0000 (oldest deadline 2024-08-20T01:43:49.249432+0000) 2024-08-20T01:43:57.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:57 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:57.146+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:57.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:57 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:57.146+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:57.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:57 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:57.146+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:57.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:57 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:57.146+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:43:57.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:57 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:57.146+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:43:58.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:57 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:57.652+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:58.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:57 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:57.652+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:58.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:57 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:57.652+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:58.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:57 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:57.652+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:58.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:57 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:57.652+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:43:58.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:57 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:57.652+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.462081+0000 front 2024-08-20T01:43:24.462182+0000 (oldest deadline 2024-08-20T01:43:50.361966+0000) 2024-08-20T01:43:58.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:58 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:58.036+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:58.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:58 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:58.036+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:58.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:58 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:58.036+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:58.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:58 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:58.036+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:58.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:58 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:58.036+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:28.149560+0000 front 2024-08-20T01:43:28.149481+0000 (oldest deadline 2024-08-20T01:43:49.249432+0000) 2024-08-20T01:43:58.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:58 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:58.176+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:58.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:58 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:58.176+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:58.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:58 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:58.176+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:58.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:58 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:58.176+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:43:58.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:58 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:58.176+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:43:59.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:58 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:58.669+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:43:59.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:58 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:58.669+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:43:59.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:58 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:58.669+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:43:59.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:58 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:58.669+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:43:59.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:58 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:58.669+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:43:59.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:58 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:58.669+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.462081+0000 front 2024-08-20T01:43:24.462182+0000 (oldest deadline 2024-08-20T01:43:50.361966+0000) 2024-08-20T01:43:59.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:59 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:59.083+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:43:59.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:59 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:59.083+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:43:59.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:59 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:59.083+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:43:59.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:59 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:59.083+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:43:59.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:59 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:59.083+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:28.149560+0000 front 2024-08-20T01:43:28.149481+0000 (oldest deadline 2024-08-20T01:43:49.249432+0000) 2024-08-20T01:43:59.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:43:59 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:43:59.083+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:34.450543+0000 front 2024-08-20T01:43:34.450609+0000 (oldest deadline 2024-08-20T01:43:58.451072+0000) 2024-08-20T01:43:59.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:59 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:59.213+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:43:59.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:59 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:59.213+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:43:59.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:59 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:59.213+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:43:59.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:59 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:59.213+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:43:59.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:43:59 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:43:59.213+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:44:00.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:59 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:59.660+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:44:00.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:59 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:59.660+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:44:00.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:59 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:59.660+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:44:00.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:59 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:59.660+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:44:00.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:59 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:59.660+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:44:00.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:59 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:59.660+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.462081+0000 front 2024-08-20T01:43:24.462182+0000 (oldest deadline 2024-08-20T01:43:50.361966+0000) 2024-08-20T01:44:00.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:43:59 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:43:59.660+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:33.763555+0000 front 2024-08-20T01:43:33.763535+0000 (oldest deadline 2024-08-20T01:43:58.964080+0000) 2024-08-20T01:44:00.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:44:00 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:44:00.120+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.542318+0000 front 2024-08-20T01:42:48.542427+0000 (oldest deadline 2024-08-20T01:43:10.242437+0000) 2024-08-20T01:44:00.387 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:44:00 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:44:00.120+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:54.943495+0000 front 2024-08-20T01:42:54.943532+0000 (oldest deadline 2024-08-20T01:43:18.344568+0000) 2024-08-20T01:44:00.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:44:00 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:44:00.120+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.845990+0000 front 2024-08-20T01:43:01.846002+0000 (oldest deadline 2024-08-20T01:43:27.145986+0000) 2024-08-20T01:44:00.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:44:00 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:44:00.120+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:09.446927+0000 front 2024-08-20T01:43:09.446973+0000 (oldest deadline 2024-08-20T01:43:34.747013+0000) 2024-08-20T01:44:00.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:44:00 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:44:00.120+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:28.149560+0000 front 2024-08-20T01:43:28.149481+0000 (oldest deadline 2024-08-20T01:43:49.249432+0000) 2024-08-20T01:44:00.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:44:00 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9[54227]: 2024-08-20T01:44:00.120+0000 7f81672b9640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:34.450543+0000 front 2024-08-20T01:43:34.450609+0000 (oldest deadline 2024-08-20T01:43:58.451072+0000) 2024-08-20T01:44:00.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:00 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:00.189+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:44:00.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:00 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:00.189+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:44:00.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:00 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:00.189+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:44:00.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:00 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:00.189+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:44:00.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:00 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:00.189+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:44:00.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:00 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:00.189+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:36.485124+0000 front 2024-08-20T01:43:36.485034+0000 (oldest deadline 2024-08-20T01:43:59.984865+0000) 2024-08-20T01:44:01.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:00 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:00.681+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:44:01.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:00 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:00.681+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:44:01.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:00 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:00.681+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:44:01.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:00 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:00.681+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:44:01.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:00 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:00.681+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:44:01.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:00 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:00.681+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.462081+0000 front 2024-08-20T01:43:24.462182+0000 (oldest deadline 2024-08-20T01:43:50.361966+0000) 2024-08-20T01:44:01.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:00 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:00.681+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:33.763555+0000 front 2024-08-20T01:43:33.763535+0000 (oldest deadline 2024-08-20T01:43:58.964080+0000) 2024-08-20T01:44:01.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:01 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:01.227+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:44:01.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:01 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:01.227+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:44:01.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:01 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:01.227+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:44:01.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:01 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:01.227+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:44:01.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:01 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:01.227+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:44:01.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:01 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:01.227+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:36.485124+0000 front 2024-08-20T01:43:36.485034+0000 (oldest deadline 2024-08-20T01:43:59.984865+0000) 2024-08-20T01:44:01.842 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:44:01 smithi022 podman[94382]: 2024-08-20 01:44:01.56810242 +0000 UTC m=+5.564860811 container died dcb0989e0a4295419da0504996e4fcb404c1012ea3a4eb558e5ca59939853701 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0) 2024-08-20T01:44:02.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:01 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:01.724+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:44:02.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:01 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:01.724+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:44:02.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:01 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:01.724+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:44:02.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:01 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:01.724+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:44:02.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:01 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:01.724+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:44:02.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:01 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:01.724+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.462081+0000 front 2024-08-20T01:43:24.462182+0000 (oldest deadline 2024-08-20T01:43:50.361966+0000) 2024-08-20T01:44:02.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:01 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:01.724+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:33.763555+0000 front 2024-08-20T01:43:33.763535+0000 (oldest deadline 2024-08-20T01:43:58.964080+0000) 2024-08-20T01:44:02.137 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:44:02 smithi022 podman[94382]: 2024-08-20 01:44:02.015188871 +0000 UTC m=+6.011947298 container cleanup dcb0989e0a4295419da0504996e4fcb404c1012ea3a4eb558e5ca59939853701 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-08-20T01:44:02.137 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:44:02 smithi022 bash[94382]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9 2024-08-20T01:44:02.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:02 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:02.189+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:44:02.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:02 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:02.189+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:44:02.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:02 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:02.189+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:44:02.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:02 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:02.189+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:44:02.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:02 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:02.189+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:44:02.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:02 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:02.189+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:36.485124+0000 front 2024-08-20T01:43:36.485034+0000 (oldest deadline 2024-08-20T01:43:59.984865+0000) 2024-08-20T01:44:02.794 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:44:02 smithi022 podman[94398]: 2024-08-20 01:44:02.392198762 +0000 UTC m=+0.821092677 container remove dcb0989e0a4295419da0504996e4fcb404c1012ea3a4eb558e5ca59939853701 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0) 2024-08-20T01:44:03.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:02 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:02.772+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:44:03.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:02 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:02.772+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:44:03.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:02 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:02.772+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:44:03.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:02 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:02.772+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:44:03.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:02 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:02.772+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:44:03.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:02 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:02.772+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.462081+0000 front 2024-08-20T01:43:24.462182+0000 (oldest deadline 2024-08-20T01:43:50.361966+0000) 2024-08-20T01:44:03.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:02 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:02.772+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:33.763555+0000 front 2024-08-20T01:43:33.763535+0000 (oldest deadline 2024-08-20T01:43:58.964080+0000) 2024-08-20T01:44:03.080 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:44:02 smithi022 podman[94485]: 2024-08-20 01:44:02.793000425 +0000 UTC m=+0.111186766 container create 3fb3cdce2fc03e8f7f90435618e010bcbe593844596e01fd34ef5847f214ca4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:44:03.080 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:44:02 smithi022 podman[94485]: 2024-08-20 01:44:02.697911476 +0000 UTC m=+0.016097825 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:44:03.081 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:44:03 smithi022 podman[94485]: 2024-08-20 01:44:03.012330866 +0000 UTC m=+0.330517205 container init 3fb3cdce2fc03e8f7f90435618e010bcbe593844596e01fd34ef5847f214ca4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9-deactivate, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-08-20T01:44:03.081 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:44:03 smithi022 podman[94485]: 2024-08-20 01:44:03.01572353 +0000 UTC m=+0.333909870 container start 3fb3cdce2fc03e8f7f90435618e010bcbe593844596e01fd34ef5847f214ca4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0) 2024-08-20T01:44:03.081 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:44:03 smithi022 podman[94485]: 2024-08-20 01:44:03.078881384 +0000 UTC m=+0.397067724 container attach 3fb3cdce2fc03e8f7f90435618e010bcbe593844596e01fd34ef5847f214ca4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-20T01:44:03.388 INFO:journalctl@ceph.osd.9.smithi022.stdout:Aug 20 01:44:03 smithi022 podman[94485]: 2024-08-20 01:44:03.204345247 +0000 UTC m=+0.522531598 container died 3fb3cdce2fc03e8f7f90435618e010bcbe593844596e01fd34ef5847f214ca4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-20T01:44:03.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:03 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:03.210+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:44:03.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:03 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:03.210+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:44:03.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:03 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:03.210+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:44:03.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:03 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:03.210+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:44:03.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:03 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:03.210+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:44:03.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:03 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:03.210+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:36.485124+0000 front 2024-08-20T01:43:36.485034+0000 (oldest deadline 2024-08-20T01:43:59.984865+0000) 2024-08-20T01:44:03.844 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.9.service' 2024-08-20T01:44:03.890 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:44:03.890 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-08-20T01:44:03.890 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-08-20T01:44:03.890 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.10 2024-08-20T01:44:04.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:03 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:03.783+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:44:04.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:03 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:03.783+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:44:04.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:03 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:03.783+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:44:04.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:03 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:03.783+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:44:04.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:03 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:03.783+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:44:04.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:03 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:03.783+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.462081+0000 front 2024-08-20T01:43:24.462182+0000 (oldest deadline 2024-08-20T01:43:50.361966+0000) 2024-08-20T01:44:04.067 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:03 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:03.783+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:33.763555+0000 front 2024-08-20T01:43:33.763535+0000 (oldest deadline 2024-08-20T01:43:58.964080+0000) 2024-08-20T01:44:04.067 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:03 smithi077 systemd[1]: Stopping Ceph osd.10 for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:44:04.516 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:04 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:04.232+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:44:04.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:04 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:04.232+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:44:04.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:04 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:04.232+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:44:04.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:04 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:04.232+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:44:04.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:04 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:04.232+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:44:04.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:04 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:04.232+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:36.485124+0000 front 2024-08-20T01:43:36.485034+0000 (oldest deadline 2024-08-20T01:43:59.984865+0000) 2024-08-20T01:44:04.565 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:04 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:04.198+0000 7fa159f23640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:44:04.565 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:04 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:04.198+0000 7fa159f23640 -1 osd.10 84 *** Got signal Terminated *** 2024-08-20T01:44:04.565 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:04 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:04.198+0000 7fa159f23640 -1 osd.10 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:44:05.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:04 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:04.793+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:44:05.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:04 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:04.793+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:44:05.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:04 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:04.793+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:44:05.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:04 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:04.793+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:44:05.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:04 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:04.793+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:44:05.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:04 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:04.793+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.462081+0000 front 2024-08-20T01:43:24.462182+0000 (oldest deadline 2024-08-20T01:43:50.361966+0000) 2024-08-20T01:44:05.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:04 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:04.793+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:33.763555+0000 front 2024-08-20T01:43:33.763535+0000 (oldest deadline 2024-08-20T01:43:58.964080+0000) 2024-08-20T01:44:05.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:05 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:05.271+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:44:05.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:05 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:05.271+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:44:05.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:05 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:05.271+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:44:05.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:05 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:05.271+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:44:05.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:05 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:05.271+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:44:05.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:05 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:05.271+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:36.485124+0000 front 2024-08-20T01:43:36.485034+0000 (oldest deadline 2024-08-20T01:43:59.984865+0000) 2024-08-20T01:44:06.315 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:05 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:05.816+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:44:06.315 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:05 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:05.816+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:44:06.315 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:05 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:05.816+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:44:06.315 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:05 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:05.816+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:44:06.315 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:05 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:05.816+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:44:06.316 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:05 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:05.816+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.462081+0000 front 2024-08-20T01:43:24.462182+0000 (oldest deadline 2024-08-20T01:43:50.361966+0000) 2024-08-20T01:44:06.316 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:05 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:05.817+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:33.763555+0000 front 2024-08-20T01:43:33.763535+0000 (oldest deadline 2024-08-20T01:43:58.964080+0000) 2024-08-20T01:44:06.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:06 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:06.235+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:44:06.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:06 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:06.235+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:44:06.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:06 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:06.235+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:44:06.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:06 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:06.235+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:44:06.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:06 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:06.235+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:44:06.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:06 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:06.235+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:36.485124+0000 front 2024-08-20T01:43:36.485034+0000 (oldest deadline 2024-08-20T01:43:59.984865+0000) 2024-08-20T01:44:06.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:06 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:06.235+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-08-20T01:43:39.985469+0000 front 2024-08-20T01:43:39.985520+0000 (oldest deadline 2024-08-20T01:44:05.885395+0000) 2024-08-20T01:44:07.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:06 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:06.774+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:44:07.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:06 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:06.774+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:44:07.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:06 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:06.774+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:44:07.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:06 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:06.774+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:44:07.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:06 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:06.774+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:44:07.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:06 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:06.774+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.462081+0000 front 2024-08-20T01:43:24.462182+0000 (oldest deadline 2024-08-20T01:43:50.361966+0000) 2024-08-20T01:44:07.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:06 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:06.774+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:33.763555+0000 front 2024-08-20T01:43:33.763535+0000 (oldest deadline 2024-08-20T01:43:58.964080+0000) 2024-08-20T01:44:07.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:07 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:07.234+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:44:07.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:07 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:07.234+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:44:07.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:07 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:07.234+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:44:07.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:07 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:07.234+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:44:07.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:07 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:07.234+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:44:07.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:07 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:07.234+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:36.485124+0000 front 2024-08-20T01:43:36.485034+0000 (oldest deadline 2024-08-20T01:43:59.984865+0000) 2024-08-20T01:44:07.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:07 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:07.234+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-08-20T01:43:39.985469+0000 front 2024-08-20T01:43:39.985520+0000 (oldest deadline 2024-08-20T01:44:05.885395+0000) 2024-08-20T01:44:08.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:07 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:07.750+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:44:08.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:07 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:07.750+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:44:08.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:07 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:07.750+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:44:08.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:07 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:07.750+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:44:08.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:07 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:07.750+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:44:08.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:07 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:07.750+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.462081+0000 front 2024-08-20T01:43:24.462182+0000 (oldest deadline 2024-08-20T01:43:50.361966+0000) 2024-08-20T01:44:08.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:07 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:07.750+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:33.763555+0000 front 2024-08-20T01:43:33.763535+0000 (oldest deadline 2024-08-20T01:43:58.964080+0000) 2024-08-20T01:44:08.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:08 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:08.216+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:44:08.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:08 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:08.216+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:44:08.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:08 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:08.216+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:44:08.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:08 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:08.216+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:44:08.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:08 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:08.216+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:44:08.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:08 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:08.216+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:36.485124+0000 front 2024-08-20T01:43:36.485034+0000 (oldest deadline 2024-08-20T01:43:59.984865+0000) 2024-08-20T01:44:08.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:08 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:08.216+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-08-20T01:43:39.985469+0000 front 2024-08-20T01:43:39.985520+0000 (oldest deadline 2024-08-20T01:44:05.885395+0000) 2024-08-20T01:44:09.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:08 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:08.710+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:48.156989+0000 front 2024-08-20T01:42:48.156965+0000 (oldest deadline 2024-08-20T01:43:13.457014+0000) 2024-08-20T01:44:09.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:08 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:08.710+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:53.457499+0000 front 2024-08-20T01:42:53.457528+0000 (oldest deadline 2024-08-20T01:43:18.157645+0000) 2024-08-20T01:44:09.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:08 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:08.710+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.058729+0000 front 2024-08-20T01:43:01.058835+0000 (oldest deadline 2024-08-20T01:43:26.958807+0000) 2024-08-20T01:44:09.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:08 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:08.710+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-08-20T01:43:12.860196+0000 front 2024-08-20T01:43:12.860068+0000 (oldest deadline 2024-08-20T01:43:33.959964+0000) 2024-08-20T01:44:09.065 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:08 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:08.710+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:18.060823+0000 front 2024-08-20T01:43:18.060837+0000 (oldest deadline 2024-08-20T01:43:41.560976+0000) 2024-08-20T01:44:09.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:08 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:08.710+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.462081+0000 front 2024-08-20T01:43:24.462182+0000 (oldest deadline 2024-08-20T01:43:50.361966+0000) 2024-08-20T01:44:09.066 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:08 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10[46259]: 2024-08-20T01:44:08.710+0000 7fa156538640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:33.763555+0000 front 2024-08-20T01:43:33.763535+0000 (oldest deadline 2024-08-20T01:43:58.964080+0000) 2024-08-20T01:44:09.516 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:09 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:09.167+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:44:09.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:09 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:09.167+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:44:09.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:09 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:09.167+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:44:09.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:09 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:09.167+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:44:09.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:09 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:09.167+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:44:09.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:09 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:09.167+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:36.485124+0000 front 2024-08-20T01:43:36.485034+0000 (oldest deadline 2024-08-20T01:43:59.984865+0000) 2024-08-20T01:44:09.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:09 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:09.167+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-08-20T01:43:39.985469+0000 front 2024-08-20T01:43:39.985520+0000 (oldest deadline 2024-08-20T01:44:05.885395+0000) 2024-08-20T01:44:09.851 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:09 smithi077 podman[57648]: 2024-08-20 01:44:09.580215124 +0000 UTC m=+5.492829772 container died 9f7cbc147492934287ee2c6594b1fa016029eafcc0e7a7a8d5a8f49142efff34 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-20T01:44:10.244 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:09 smithi077 podman[57648]: 2024-08-20 01:44:09.948455217 +0000 UTC m=+5.861069856 container cleanup 9f7cbc147492934287ee2c6594b1fa016029eafcc0e7a7a8d5a8f49142efff34 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-08-20T01:44:10.244 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:09 smithi077 bash[57648]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10 2024-08-20T01:44:10.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:10 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:10.128+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:44:10.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:10 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:10.128+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:44:10.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:10 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:10.128+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:44:10.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:10 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:10.128+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:44:10.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:10 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:10.128+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:44:10.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:10 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:10.128+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:36.485124+0000 front 2024-08-20T01:43:36.485034+0000 (oldest deadline 2024-08-20T01:43:59.984865+0000) 2024-08-20T01:44:10.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:10 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:10.128+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-08-20T01:43:39.985469+0000 front 2024-08-20T01:43:39.985520+0000 (oldest deadline 2024-08-20T01:44:05.885395+0000) 2024-08-20T01:44:10.554 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:10 smithi077 podman[57663]: 2024-08-20 01:44:10.241768577 +0000 UTC m=+0.654571322 container remove 9f7cbc147492934287ee2c6594b1fa016029eafcc0e7a7a8d5a8f49142efff34 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-08-20T01:44:10.815 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:10 smithi077 podman[57751]: 2024-08-20 01:44:10.455502986 +0000 UTC m=+0.015896284 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:44:10.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:10 smithi077 podman[57751]: 2024-08-20 01:44:10.567620772 +0000 UTC m=+0.128014101 container create cc3246d3c18b0d3b8ed7b7eb40c1463803a177399b0a0edfe75066c2ac972623 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-20T01:44:10.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:10 smithi077 podman[57751]: 2024-08-20 01:44:10.786649201 +0000 UTC m=+0.347042484 container init cc3246d3c18b0d3b8ed7b7eb40c1463803a177399b0a0edfe75066c2ac972623 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS) 2024-08-20T01:44:10.816 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:10 smithi077 podman[57751]: 2024-08-20 01:44:10.789989673 +0000 UTC m=+0.350382956 container start cc3246d3c18b0d3b8ed7b7eb40c1463803a177399b0a0edfe75066c2ac972623 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10-deactivate, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-08-20T01:44:11.266 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:10 smithi077 podman[57751]: 2024-08-20 01:44:10.878415836 +0000 UTC m=+0.438809143 container attach cc3246d3c18b0d3b8ed7b7eb40c1463803a177399b0a0edfe75066c2ac972623 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10-deactivate, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-20T01:44:11.266 INFO:journalctl@ceph.osd.10.smithi077.stdout:Aug 20 01:44:10 smithi077 podman[57751]: 2024-08-20 01:44:10.978681511 +0000 UTC m=+0.539074802 container died cc3246d3c18b0d3b8ed7b7eb40c1463803a177399b0a0edfe75066c2ac972623 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-08-20T01:44:11.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:11 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:11.129+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:44:11.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:11 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:11.129+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:44:11.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:11 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:11.129+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:44:11.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:11 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:11.129+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:44:11.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:11 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:11.129+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:44:11.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:11 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:11.129+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:36.485124+0000 front 2024-08-20T01:43:36.485034+0000 (oldest deadline 2024-08-20T01:43:59.984865+0000) 2024-08-20T01:44:11.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:11 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:11.129+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-08-20T01:43:39.985469+0000 front 2024-08-20T01:43:39.985520+0000 (oldest deadline 2024-08-20T01:44:05.885395+0000) 2024-08-20T01:44:11.555 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.10.service' 2024-08-20T01:44:11.594 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:44:11.594 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-08-20T01:44:11.594 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-08-20T01:44:11.594 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.11 2024-08-20T01:44:11.889 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:11 smithi134 systemd[1]: Stopping Ceph osd.11 for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:44:12.269 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:11 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:11.886+0000 7faf31190640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:44:12.270 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:11 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:11.886+0000 7faf31190640 -1 osd.11 84 *** Got signal Terminated *** 2024-08-20T01:44:12.270 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:11 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:11.886+0000 7faf31190640 -1 osd.11 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:44:12.270 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:12 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:12.090+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:44:12.270 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:12 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:12.090+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:44:12.270 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:12 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:12.090+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:44:12.270 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:12 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:12.090+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:44:12.270 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:12 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:12.090+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:44:12.270 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:12 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:12.090+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:36.485124+0000 front 2024-08-20T01:43:36.485034+0000 (oldest deadline 2024-08-20T01:43:59.984865+0000) 2024-08-20T01:44:12.270 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:12 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:12.090+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-08-20T01:43:39.985469+0000 front 2024-08-20T01:43:39.985520+0000 (oldest deadline 2024-08-20T01:44:05.885395+0000) 2024-08-20T01:44:13.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:13 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:13.130+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:44:13.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:13 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:13.130+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:44:13.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:13 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:13.130+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:44:13.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:13 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:13.130+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:44:13.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:13 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:13.130+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:44:13.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:13 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:13.130+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:36.485124+0000 front 2024-08-20T01:43:36.485034+0000 (oldest deadline 2024-08-20T01:43:59.984865+0000) 2024-08-20T01:44:13.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:13 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:13.130+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-08-20T01:43:39.985469+0000 front 2024-08-20T01:43:39.985520+0000 (oldest deadline 2024-08-20T01:44:05.885395+0000) 2024-08-20T01:44:14.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:14 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:14.133+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:44:14.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:14 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:14.133+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:44:14.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:14 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:14.133+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:44:14.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:14 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:14.133+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:44:14.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:14 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:14.133+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:44:14.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:14 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:14.133+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:36.485124+0000 front 2024-08-20T01:43:36.485034+0000 (oldest deadline 2024-08-20T01:43:59.984865+0000) 2024-08-20T01:44:14.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:14 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:14.133+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-08-20T01:43:39.985469+0000 front 2024-08-20T01:43:39.985520+0000 (oldest deadline 2024-08-20T01:44:05.885395+0000) 2024-08-20T01:44:15.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:15 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:15.171+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:44:15.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:15 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:15.171+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:44:15.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:15 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:15.171+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:44:15.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:15 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:15.171+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:44:15.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:15 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:15.171+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:44:15.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:15 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:15.171+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:36.485124+0000 front 2024-08-20T01:43:36.485034+0000 (oldest deadline 2024-08-20T01:43:59.984865+0000) 2024-08-20T01:44:15.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:15 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:15.171+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-08-20T01:43:39.985469+0000 front 2024-08-20T01:43:39.985520+0000 (oldest deadline 2024-08-20T01:44:05.885395+0000) 2024-08-20T01:44:16.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:16 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:16.134+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-08-20T01:42:44.675634+0000 front 2024-08-20T01:42:44.675755+0000 (oldest deadline 2024-08-20T01:43:10.575701+0000) 2024-08-20T01:44:16.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:16 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:16.134+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-08-20T01:42:56.476965+0000 front 2024-08-20T01:42:56.476912+0000 (oldest deadline 2024-08-20T01:43:18.077620+0000) 2024-08-20T01:44:16.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:16 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:16.134+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-08-20T01:43:01.578677+0000 front 2024-08-20T01:43:01.578650+0000 (oldest deadline 2024-08-20T01:43:26.179432+0000) 2024-08-20T01:44:16.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:16 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:16.134+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-08-20T01:43:20.881759+0000 front 2024-08-20T01:43:20.881670+0000 (oldest deadline 2024-08-20T01:43:43.781665+0000) 2024-08-20T01:44:16.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:16 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:16.134+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.134:6812 osd.5 since back 2024-08-20T01:43:24.282401+0000 front 2024-08-20T01:43:24.282449+0000 (oldest deadline 2024-08-20T01:43:49.582558+0000) 2024-08-20T01:44:16.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:16 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:16.134+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-08-20T01:43:36.485124+0000 front 2024-08-20T01:43:36.485034+0000 (oldest deadline 2024-08-20T01:43:59.984865+0000) 2024-08-20T01:44:16.517 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:16 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11[47747]: 2024-08-20T01:44:16.134+0000 7faf2979d640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-08-20T01:43:39.985469+0000 front 2024-08-20T01:43:39.985520+0000 (oldest deadline 2024-08-20T01:44:05.885395+0000) 2024-08-20T01:44:17.755 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:17 smithi134 podman[58593]: 2024-08-20 01:44:17.455644663 +0000 UTC m=+5.673959345 container died a12f05d4c623ccb19428d0b63a475d10bb3dc768ca76848373701d9b806a878b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-08-20T01:44:18.017 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:17 smithi134 podman[58593]: 2024-08-20 01:44:17.870193364 +0000 UTC m=+6.088508033 container cleanup a12f05d4c623ccb19428d0b63a475d10bb3dc768ca76848373701d9b806a878b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-08-20T01:44:18.017 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:17 smithi134 bash[58593]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11 2024-08-20T01:44:18.516 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:18 smithi134 podman[58609]: 2024-08-20 01:44:18.113329573 +0000 UTC m=+0.648857427 container remove a12f05d4c623ccb19428d0b63a475d10bb3dc768ca76848373701d9b806a878b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-08-20T01:44:18.863 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:18 smithi134 podman[58694]: 2024-08-20 01:44:18.440303291 +0000 UTC m=+0.016041156 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:44:18.863 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:18 smithi134 podman[58694]: 2024-08-20 01:44:18.547300821 +0000 UTC m=+0.123038684 container create d2fa97a15827dee121218bdad4ab71b17089bacf4740fb781d6fa85607c5c3c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-08-20T01:44:18.863 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:18 smithi134 podman[58694]: 2024-08-20 01:44:18.783124107 +0000 UTC m=+0.358861959 container init d2fa97a15827dee121218bdad4ab71b17089bacf4740fb781d6fa85607c5c3c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, GIT_CLEAN=True) 2024-08-20T01:44:18.863 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:18 smithi134 podman[58694]: 2024-08-20 01:44:18.786301974 +0000 UTC m=+0.362039827 container start d2fa97a15827dee121218bdad4ab71b17089bacf4740fb781d6fa85607c5c3c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-08-20T01:44:19.265 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:18 smithi134 podman[58694]: 2024-08-20 01:44:18.857922649 +0000 UTC m=+0.433660501 container attach d2fa97a15827dee121218bdad4ab71b17089bacf4740fb781d6fa85607c5c3c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-20T01:44:19.265 INFO:journalctl@ceph.osd.11.smithi134.stdout:Aug 20 01:44:18 smithi134 podman[58694]: 2024-08-20 01:44:18.973784034 +0000 UTC m=+0.549521900 container died d2fa97a15827dee121218bdad4ab71b17089bacf4740fb781d6fa85607c5c3c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:44:19.560 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@osd.11.service' 2024-08-20T01:44:19.597 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:44:19.597 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-08-20T01:44:19.597 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-08-20T01:44:19.597 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.a 2024-08-20T01:44:19.887 INFO:journalctl@ceph.mds.a.smithi022.stdout:Aug 20 01:44:19 smithi022 systemd[1]: Stopping Ceph mds.a for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:44:20.387 INFO:journalctl@ceph.mds.a.smithi022.stdout:Aug 20 01:44:19 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-a[61294]: 2024-08-20T01:44:19.909+0000 7f953aba2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:44:20.387 INFO:journalctl@ceph.mds.a.smithi022.stdout:Aug 20 01:44:19 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-a[61294]: 2024-08-20T01:44:19.909+0000 7f953aba2640 -1 mds.a *** got signal Terminated *** 2024-08-20T01:44:21.778 INFO:journalctl@ceph.mds.a.smithi022.stdout:Aug 20 01:44:21 smithi022 podman[94589]: 2024-08-20 01:44:21.39405718 +0000 UTC m=+1.598431868 container died 4aa136384356226aead9ca71107b657edf021077bf28534a9204c9e2b2d48e0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-a, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-20T01:44:22.120 INFO:journalctl@ceph.mds.a.smithi022.stdout:Aug 20 01:44:21 smithi022 podman[94589]: 2024-08-20 01:44:21.934325489 +0000 UTC m=+2.138700223 container cleanup 4aa136384356226aead9ca71107b657edf021077bf28534a9204c9e2b2d48e0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-08-20T01:44:22.121 INFO:journalctl@ceph.mds.a.smithi022.stdout:Aug 20 01:44:21 smithi022 bash[94589]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-a 2024-08-20T01:44:22.373 INFO:journalctl@ceph.mds.a.smithi022.stdout:Aug 20 01:44:22 smithi022 podman[94601]: 2024-08-20 01:44:22.119107762 +0000 UTC m=+0.717800804 container remove 4aa136384356226aead9ca71107b657edf021077bf28534a9204c9e2b2d48e0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-a, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:44:22.377 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.a.service' 2024-08-20T01:44:22.413 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:44:22.413 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-08-20T01:44:22.413 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-08-20T01:44:22.413 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.d 2024-08-20T01:44:22.637 INFO:journalctl@ceph.mds.d.smithi022.stdout:Aug 20 01:44:22 smithi022 systemd[1]: Stopping Ceph mds.d for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:44:23.137 INFO:journalctl@ceph.mds.d.smithi022.stdout:Aug 20 01:44:22 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-d[60114]: 2024-08-20T01:44:22.729+0000 7f82bf88b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:44:23.137 INFO:journalctl@ceph.mds.d.smithi022.stdout:Aug 20 01:44:22 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-d[60114]: 2024-08-20T01:44:22.729+0000 7f82bf88b640 -1 mds.d *** got signal Terminated *** 2024-08-20T01:44:26.941 INFO:journalctl@ceph.mds.d.smithi022.stdout:Aug 20 01:44:26 smithi022 podman[94708]: 2024-08-20 01:44:26.662726794 +0000 UTC m=+4.028692142 container died e42dcee1c9e6a6e9c3053b33b605506602f2570002d8af7760689f74d4e884da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-d, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-20T01:44:27.283 INFO:journalctl@ceph.mds.d.smithi022.stdout:Aug 20 01:44:27 smithi022 podman[94708]: 2024-08-20 01:44:27.030637464 +0000 UTC m=+4.396602809 container cleanup e42dcee1c9e6a6e9c3053b33b605506602f2570002d8af7760689f74d4e884da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731) 2024-08-20T01:44:27.283 INFO:journalctl@ceph.mds.d.smithi022.stdout:Aug 20 01:44:27 smithi022 bash[94708]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-d 2024-08-20T01:44:27.433 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.d.service' 2024-08-20T01:44:27.468 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:44:27.468 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-08-20T01:44:27.468 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-08-20T01:44:27.468 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.g 2024-08-20T01:44:27.887 INFO:journalctl@ceph.mds.g.smithi022.stdout:Aug 20 01:44:27 smithi022 systemd[1]: Stopping Ceph mds.g for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:44:27.887 INFO:journalctl@ceph.mds.g.smithi022.stdout:Aug 20 01:44:27 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-g[60911]: 2024-08-20T01:44:27.801+0000 7fda7d480640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:44:27.887 INFO:journalctl@ceph.mds.g.smithi022.stdout:Aug 20 01:44:27 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-g[60911]: 2024-08-20T01:44:27.801+0000 7fda7d480640 -1 mds.g *** got signal Terminated *** 2024-08-20T01:44:30.743 INFO:journalctl@ceph.mds.g.smithi022.stdout:Aug 20 01:44:30 smithi022 podman[94844]: 2024-08-20 01:44:30.428775124 +0000 UTC m=+2.729611049 container died b4f278ca1b8646b62d8f493e45e5772006797cdcb8869d85f1cdaac2e854d6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-g, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240731) 2024-08-20T01:44:31.079 INFO:journalctl@ceph.mds.g.smithi022.stdout:Aug 20 01:44:30 smithi022 podman[94844]: 2024-08-20 01:44:30.742366621 +0000 UTC m=+3.043202537 container cleanup b4f278ca1b8646b62d8f493e45e5772006797cdcb8869d85f1cdaac2e854d6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-08-20T01:44:31.079 INFO:journalctl@ceph.mds.g.smithi022.stdout:Aug 20 01:44:30 smithi022 bash[94844]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-g 2024-08-20T01:44:31.230 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.g.service' 2024-08-20T01:44:31.265 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:44:31.265 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-08-20T01:44:31.265 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-08-20T01:44:31.265 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.j 2024-08-20T01:44:31.598 INFO:journalctl@ceph.mds.j.smithi022.stdout:Aug 20 01:44:31 smithi022 systemd[1]: Stopping Ceph mds.j for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:44:31.887 INFO:journalctl@ceph.mds.j.smithi022.stdout:Aug 20 01:44:31 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-j[59712]: 2024-08-20T01:44:31.596+0000 7f50193df640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:44:31.887 INFO:journalctl@ceph.mds.j.smithi022.stdout:Aug 20 01:44:31 smithi022 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-j[59712]: 2024-08-20T01:44:31.596+0000 7f50193df640 -1 mds.j *** got signal Terminated *** 2024-08-20T01:44:35.137 INFO:journalctl@ceph.mds.j.smithi022.stdout:Aug 20 01:44:35 smithi022 podman[94965]: 2024-08-20 01:44:35.126357278 +0000 UTC m=+3.632873505 container died 084e5c2c28ed87da2b943c1cb7e9eb7778c30144eee1648325dd490075ccdc89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-j, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:44:35.732 INFO:journalctl@ceph.mds.j.smithi022.stdout:Aug 20 01:44:35 smithi022 podman[94965]: 2024-08-20 01:44:35.488100707 +0000 UTC m=+3.994616926 container cleanup 084e5c2c28ed87da2b943c1cb7e9eb7778c30144eee1648325dd490075ccdc89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-j, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-08-20T01:44:35.732 INFO:journalctl@ceph.mds.j.smithi022.stdout:Aug 20 01:44:35 smithi022 bash[94965]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-j 2024-08-20T01:44:35.866 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.j.service' 2024-08-20T01:44:35.899 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:44:35.900 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-08-20T01:44:35.900 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-08-20T01:44:35.900 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.b 2024-08-20T01:44:36.285 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:44:35 smithi077 systemd[1]: Stopping Ceph mds.b for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:44:36.565 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:44:36 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-b[51871]: 2024-08-20T01:44:36.283+0000 7f9734417640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:44:36.565 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:44:36 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-b[51871]: 2024-08-20T01:44:36.283+0000 7f9734417640 -1 mds.b *** got signal Terminated *** 2024-08-20T01:44:40.561 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:44:40 smithi077 podman[57855]: 2024-08-20 01:44:40.246373186 +0000 UTC m=+4.156328521 container stop a87d0327515b2e190a00c87f45b92461a0128e3c56fd8ca96866906ba881654a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-20T01:44:40.562 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:44:40 smithi077 podman[57855]: 2024-08-20 01:44:40.272058804 +0000 UTC m=+4.182014137 container died a87d0327515b2e190a00c87f45b92461a0128e3c56fd8ca96866906ba881654a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-20T01:44:40.815 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:44:40 smithi077 podman[57855]: 2024-08-20 01:44:40.658336365 +0000 UTC m=+4.568291697 container cleanup a87d0327515b2e190a00c87f45b92461a0128e3c56fd8ca96866906ba881654a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:44:40.815 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:44:40 smithi077 bash[57855]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-b 2024-08-20T01:44:41.079 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.b.service' 2024-08-20T01:44:41.103 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:44:40 smithi077 podman[57879]: 2024-08-20 01:44:40.851260954 +0000 UTC m=+0.597552068 container remove a87d0327515b2e190a00c87f45b92461a0128e3c56fd8ca96866906ba881654a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.36.0) 2024-08-20T01:44:41.103 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:44:41 smithi077 systemd[1]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.b.service: Deactivated successfully. 2024-08-20T01:44:41.103 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:44:41 smithi077 systemd[1]: Stopped Ceph mds.b for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:44:41.103 INFO:journalctl@ceph.mds.b.smithi077.stdout:Aug 20 01:44:41 smithi077 systemd[1]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.b.service: Consumed 8min 29.606s CPU time. 2024-08-20T01:44:41.115 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:44:41.115 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-08-20T01:44:41.115 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-08-20T01:44:41.115 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.e 2024-08-20T01:44:41.439 INFO:journalctl@ceph.mds.e.smithi077.stdout:Aug 20 01:44:41 smithi077 systemd[1]: Stopping Ceph mds.e for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:44:41.815 INFO:journalctl@ceph.mds.e.smithi077.stdout:Aug 20 01:44:41 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-e[51266]: 2024-08-20T01:44:41.436+0000 7f38c41a6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:44:41.815 INFO:journalctl@ceph.mds.e.smithi077.stdout:Aug 20 01:44:41 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-e[51266]: 2024-08-20T01:44:41.436+0000 7f38c41a6640 -1 mds.e *** got signal Terminated *** 2024-08-20T01:44:44.565 INFO:journalctl@ceph.mds.e.smithi077.stdout:Aug 20 01:44:44 smithi077 podman[57987]: 2024-08-20 01:44:44.245635508 +0000 UTC m=+2.912530164 container died 2c996ac9a7d582e163a4cf27659a97ee57a86e8e154b424be6f17fad4bcda45e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-e, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-08-20T01:44:44.977 INFO:journalctl@ceph.mds.e.smithi077.stdout:Aug 20 01:44:44 smithi077 podman[57987]: 2024-08-20 01:44:44.791451271 +0000 UTC m=+3.458345919 container cleanup 2c996ac9a7d582e163a4cf27659a97ee57a86e8e154b424be6f17fad4bcda45e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0) 2024-08-20T01:44:44.978 INFO:journalctl@ceph.mds.e.smithi077.stdout:Aug 20 01:44:44 smithi077 bash[57987]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-e 2024-08-20T01:44:45.214 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.e.service' 2024-08-20T01:44:45.236 INFO:journalctl@ceph.mds.e.smithi077.stdout:Aug 20 01:44:44 smithi077 podman[57999]: 2024-08-20 01:44:44.97618938 +0000 UTC m=+0.723222046 container remove 2c996ac9a7d582e163a4cf27659a97ee57a86e8e154b424be6f17fad4bcda45e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T01:44:45.236 INFO:journalctl@ceph.mds.e.smithi077.stdout:Aug 20 01:44:45 smithi077 systemd[1]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.e.service: Deactivated successfully. 2024-08-20T01:44:45.236 INFO:journalctl@ceph.mds.e.smithi077.stdout:Aug 20 01:44:45 smithi077 systemd[1]: Stopped Ceph mds.e for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:44:45.236 INFO:journalctl@ceph.mds.e.smithi077.stdout:Aug 20 01:44:45 smithi077 systemd[1]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.e.service: Consumed 33.948s CPU time. 2024-08-20T01:44:45.247 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:44:45.248 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-08-20T01:44:45.248 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-08-20T01:44:45.248 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.h 2024-08-20T01:44:45.565 INFO:journalctl@ceph.mds.h.smithi077.stdout:Aug 20 01:44:45 smithi077 systemd[1]: Stopping Ceph mds.h for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:44:46.065 INFO:journalctl@ceph.mds.h.smithi077.stdout:Aug 20 01:44:45 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-h[51570]: 2024-08-20T01:44:45.578+0000 7f186e2e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:44:46.065 INFO:journalctl@ceph.mds.h.smithi077.stdout:Aug 20 01:44:45 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-h[51570]: 2024-08-20T01:44:45.578+0000 7f186e2e0640 -1 mds.h *** got signal Terminated *** 2024-08-20T01:44:48.506 INFO:journalctl@ceph.mds.h.smithi077.stdout:Aug 20 01:44:48 smithi077 podman[58105]: 2024-08-20 01:44:48.25078641 +0000 UTC m=+2.778439055 container died 9220438b8c1e9d97f2b79151ba09655dd911a984e96d370b0a11c96ec3f929eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-h, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T01:44:48.815 INFO:journalctl@ceph.mds.h.smithi077.stdout:Aug 20 01:44:48 smithi077 podman[58105]: 2024-08-20 01:44:48.60412897 +0000 UTC m=+3.131781610 container cleanup 9220438b8c1e9d97f2b79151ba09655dd911a984e96d370b0a11c96ec3f929eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-08-20T01:44:48.815 INFO:journalctl@ceph.mds.h.smithi077.stdout:Aug 20 01:44:48 smithi077 bash[58105]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-h 2024-08-20T01:44:49.035 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.h.service' 2024-08-20T01:44:49.068 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:44:49.068 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-08-20T01:44:49.068 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-08-20T01:44:49.068 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.k 2024-08-20T01:44:49.315 INFO:journalctl@ceph.mds.k.smithi077.stdout:Aug 20 01:44:49 smithi077 systemd[1]: Stopping Ceph mds.k for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:44:49.815 INFO:journalctl@ceph.mds.k.smithi077.stdout:Aug 20 01:44:49 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-k[50953]: 2024-08-20T01:44:49.383+0000 7f70ec218640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:44:49.815 INFO:journalctl@ceph.mds.k.smithi077.stdout:Aug 20 01:44:49 smithi077 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-k[50953]: 2024-08-20T01:44:49.383+0000 7f70ec218640 -1 mds.k *** got signal Terminated *** 2024-08-20T01:44:52.444 INFO:journalctl@ceph.mds.k.smithi077.stdout:Aug 20 01:44:52 smithi077 podman[58225]: 2024-08-20 01:44:52.116982697 +0000 UTC m=+2.831147394 container died 5bf61e15f6e942b4b90938757af94e8bb83be7f91c7f218f5b9f8565bf5a1aa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:44:52.745 INFO:journalctl@ceph.mds.k.smithi077.stdout:Aug 20 01:44:52 smithi077 podman[58225]: 2024-08-20 01:44:52.542256282 +0000 UTC m=+3.256420978 container cleanup 5bf61e15f6e942b4b90938757af94e8bb83be7f91c7f218f5b9f8565bf5a1aa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-08-20T01:44:52.745 INFO:journalctl@ceph.mds.k.smithi077.stdout:Aug 20 01:44:52 smithi077 bash[58225]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-k 2024-08-20T01:44:52.972 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.k.service' 2024-08-20T01:44:53.003 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:44:53.004 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-08-20T01:44:53.004 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-08-20T01:44:53.004 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.c 2024-08-20T01:44:53.413 INFO:journalctl@ceph.mds.c.smithi134.stdout:Aug 20 01:44:53 smithi134 systemd[1]: Stopping Ceph mds.c for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:44:53.766 INFO:journalctl@ceph.mds.c.smithi134.stdout:Aug 20 01:44:53 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-c[52689]: 2024-08-20T01:44:53.410+0000 7f81899a3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:44:53.767 INFO:journalctl@ceph.mds.c.smithi134.stdout:Aug 20 01:44:53 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-c[52689]: 2024-08-20T01:44:53.410+0000 7f81899a3640 -1 mds.c *** got signal Terminated *** 2024-08-20T01:44:56.579 INFO:journalctl@ceph.mds.c.smithi134.stdout:Aug 20 01:44:56 smithi134 podman[58808]: 2024-08-20 01:44:56.311747873 +0000 UTC m=+3.119704341 container died e98800c94a75d7cffac1cadd3f41f9f57cc840f7f71267b261c31e5ddd4741c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-c, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-20T01:44:56.946 INFO:journalctl@ceph.mds.c.smithi134.stdout:Aug 20 01:44:56 smithi134 podman[58808]: 2024-08-20 01:44:56.660452998 +0000 UTC m=+3.468409454 container cleanup e98800c94a75d7cffac1cadd3f41f9f57cc840f7f71267b261c31e5ddd4741c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:44:56.946 INFO:journalctl@ceph.mds.c.smithi134.stdout:Aug 20 01:44:56 smithi134 bash[58808]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-c 2024-08-20T01:44:57.101 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.c.service' 2024-08-20T01:44:57.136 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:44:57.136 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-08-20T01:44:57.137 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-08-20T01:44:57.137 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.f 2024-08-20T01:44:57.458 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:44:57 smithi134 systemd[1]: Stopping Ceph mds.f for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:44:57.767 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:44:57 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f[56575]: 2024-08-20T01:44:57.455+0000 7f5bf0e07640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:44:57.767 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:44:57 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f[56575]: 2024-08-20T01:44:57.455+0000 7f5bf0e07640 -1 mds.f *** got signal Terminated *** 2024-08-20T01:45:00.517 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:45:00 smithi134 podman[58930]: 2024-08-20 01:45:00.21092125 +0000 UTC m=+2.849207561 container died b6d99713ecc1d8d27d7cae1ba09f16308260607cbc2806a2c3bbac8c37d46a30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.36.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-20T01:45:00.841 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:45:00 smithi134 podman[58930]: 2024-08-20 01:45:00.655591822 +0000 UTC m=+3.293878126 container cleanup b6d99713ecc1d8d27d7cae1ba09f16308260607cbc2806a2c3bbac8c37d46a30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-20T01:45:00.842 INFO:journalctl@ceph.mds.f.smithi134.stdout:Aug 20 01:45:00 smithi134 bash[58930]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-f 2024-08-20T01:45:01.061 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.f.service' 2024-08-20T01:45:01.093 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:45:01.094 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-08-20T01:45:01.094 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-08-20T01:45:01.094 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.i 2024-08-20T01:45:01.403 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:45:01 smithi134 systemd[1]: Stopping Ceph mds.i for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:45:01.767 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:45:01 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i[52992]: 2024-08-20T01:45:01.400+0000 7fe3bc5ae640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:45:01.767 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:45:01 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i[52992]: 2024-08-20T01:45:01.400+0000 7fe3bc5ae640 -1 mds.i *** got signal Terminated *** 2024-08-20T01:45:04.517 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:45:04 smithi134 podman[59048]: 2024-08-20 01:45:04.227315681 +0000 UTC m=+2.917850992 container died 3d48e08222eb3fca17b07c028b11f2a9847a9139532c39010bf3a0d828ef82b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-20T01:45:04.853 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:45:04 smithi134 podman[59048]: 2024-08-20 01:45:04.667645392 +0000 UTC m=+3.358180702 container cleanup 3d48e08222eb3fca17b07c028b11f2a9847a9139532c39010bf3a0d828ef82b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, ceph=True) 2024-08-20T01:45:04.854 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:45:04 smithi134 bash[59048]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i 2024-08-20T01:45:05.084 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.i.service' 2024-08-20T01:45:05.105 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:45:04 smithi134 podman[59062]: 2024-08-20 01:45:04.852188692 +0000 UTC m=+0.619992695 container remove 3d48e08222eb3fca17b07c028b11f2a9847a9139532c39010bf3a0d828ef82b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-i, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-08-20T01:45:05.105 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:45:05 smithi134 systemd[1]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.i.service: Deactivated successfully. 2024-08-20T01:45:05.105 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:45:05 smithi134 systemd[1]: Stopped Ceph mds.i for 586fd06c-5e92-11ef-bccf-c7b262605968. 2024-08-20T01:45:05.105 INFO:journalctl@ceph.mds.i.smithi134.stdout:Aug 20 01:45:05 smithi134 systemd[1]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.i.service: Consumed 11min 20.597s CPU time. 2024-08-20T01:45:05.116 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:45:05.116 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-08-20T01:45:05.116 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-08-20T01:45:05.116 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.l 2024-08-20T01:45:05.431 INFO:journalctl@ceph.mds.l.smithi134.stdout:Aug 20 01:45:05 smithi134 systemd[1]: Stopping Ceph mds.l for 586fd06c-5e92-11ef-bccf-c7b262605968... 2024-08-20T01:45:05.767 INFO:journalctl@ceph.mds.l.smithi134.stdout:Aug 20 01:45:05 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-l[52079]: 2024-08-20T01:45:05.428+0000 7f500db90640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:45:05.767 INFO:journalctl@ceph.mds.l.smithi134.stdout:Aug 20 01:45:05 smithi134 ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-l[52079]: 2024-08-20T01:45:05.429+0000 7f500db90640 -1 mds.l *** got signal Terminated *** 2024-08-20T01:45:09.765 INFO:journalctl@ceph.mds.l.smithi134.stdout:Aug 20 01:45:09 smithi134 podman[59170]: 2024-08-20 01:45:09.445726232 +0000 UTC m=+4.118136555 container died c777c662cbb9382202a65e1d7c7ee8ef6bbb305864bb7bb80b062e4dd6a654c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS) 2024-08-20T01:45:10.015 INFO:journalctl@ceph.mds.l.smithi134.stdout:Aug 20 01:45:09 smithi134 podman[59170]: 2024-08-20 01:45:09.854300706 +0000 UTC m=+4.526711024 container cleanup c777c662cbb9382202a65e1d7c7ee8ef6bbb305864bb7bb80b062e4dd6a654c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:45:10.015 INFO:journalctl@ceph.mds.l.smithi134.stdout:Aug 20 01:45:09 smithi134 bash[59170]: ceph-586fd06c-5e92-11ef-bccf-c7b262605968-mds-l 2024-08-20T01:45:10.217 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-586fd06c-5e92-11ef-bccf-c7b262605968@mds.l.service' 2024-08-20T01:45:10.249 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:45:10.249 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-08-20T01:45:10.249 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 --force --keep-logs 2024-08-20T01:45:10.465 INFO:teuthology.orchestra.run.smithi022.stdout:Deleting cluster with fsid: 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:45:13.053 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 --force --keep-logs 2024-08-20T01:45:13.259 INFO:teuthology.orchestra.run.smithi077.stdout:Deleting cluster with fsid: 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:45:15.925 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 --force --keep-logs 2024-08-20T01:45:16.128 INFO:teuthology.orchestra.run.smithi134.stdout:Deleting cluster with fsid: 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T01:45:18.699 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-20T01:45:18.733 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-20T01:45:18.766 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-20T01:45:18.793 INFO:tasks.cephadm:Archiving crash dumps... 2024-08-20T01:45:18.795 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861327/remote/smithi022/crash 2024-08-20T01:45:18.796 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/crash -- . 2024-08-20T01:45:18.824 INFO:teuthology.orchestra.run.smithi022.stderr:tar: /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/crash: Cannot open: No such file or directory 2024-08-20T01:45:18.824 INFO:teuthology.orchestra.run.smithi022.stderr:tar: Error is not recoverable: exiting now 2024-08-20T01:45:18.826 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861327/remote/smithi077/crash 2024-08-20T01:45:18.827 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/crash -- . 2024-08-20T01:45:18.882 INFO:teuthology.orchestra.run.smithi077.stderr:tar: /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/crash: Cannot open: No such file or directory 2024-08-20T01:45:18.882 INFO:teuthology.orchestra.run.smithi077.stderr:tar: Error is not recoverable: exiting now 2024-08-20T01:45:18.884 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861327/remote/smithi134/crash 2024-08-20T01:45:18.885 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/crash -- . 2024-08-20T01:45:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:tar: /var/lib/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/crash: Cannot open: No such file or directory 2024-08-20T01:45:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:tar: Error is not recoverable: exiting now 2024-08-20T01:45:18.922 INFO:tasks.cephadm:Checking cluster log for badness... 2024-08-20T01:45:18.923 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-20T01:45:18.961 INFO:teuthology.orchestra.run.smithi022.stdout:2024-08-20T01:34:34.811217+0000 mds.i (mds.0) 24 : cluster [WRN] Scrub error on inode 0x100000023d9 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51) see mds.i log and `damage ls` output for details 2024-08-20T01:45:18.962 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-08-20T01:45:18.963 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[SEC\]' /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-20T01:45:19.041 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[ERR\]' /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-20T01:45:19.117 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[WRN\]' /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-20T01:45:19.192 INFO:teuthology.orchestra.run.smithi022.stdout:2024-08-20T01:34:34.811217+0000 mds.i (mds.0) 24 : cluster [WRN] Scrub error on inode 0x100000023d9 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51) see mds.i log and `damage ls` output for details 2024-08-20T01:45:19.193 INFO:tasks.cephadm:Compressing logs... 2024-08-20T01:45:19.193 DEBUG:teuthology.orchestra.run.smithi022:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-20T01:45:19.235 DEBUG:teuthology.orchestra.run.smithi077:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-20T01:45:19.238 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-20T01:45:19.258 INFO:teuthology.orchestra.run.smithi022.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-20T01:45:19.259 INFO:teuthology.orchestra.run.smithi022.stderr:: No such file or directory 2024-08-20T01:45:19.259 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.audit.log 2024-08-20T01:45:19.259 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.6.log 2024-08-20T01:45:19.259 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.g.log 2024-08-20T01:45:19.260 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.d.log 2024-08-20T01:45:19.260 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.0.log 2024-08-20T01:45:19.260 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mgr.x.log 2024-08-20T01:45:19.261 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.3.log 2024-08-20T01:45:19.261 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mon.a.log 2024-08-20T01:45:19.261 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.3.log: 90.2% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.audit.log.gz 2024-08-20T01:45:19.264 INFO:teuthology.orchestra.run.smithi022.stderr: 93.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-20T01:45:19.265 INFO:teuthology.orchestra.run.smithi022.stderr: 95.0% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.g.log.gz 2024-08-20T01:45:19.266 INFO:teuthology.orchestra.run.smithi022.stderr: 95.1% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.d.log.gz 2024-08-20T01:45:19.267 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.a.log 2024-08-20T01:45:19.269 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.j.log 2024-08-20T01:45:19.269 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.9.log 2024-08-20T01:45:19.269 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.cephadm.log 2024-08-20T01:45:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.9.log: 95.1% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.a.log.gz 2024-08-20T01:45:19.275 INFO:teuthology.orchestra.run.smithi022.stderr: 95.1% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.j.log.gz 2024-08-20T01:45:19.276 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-volume.log 2024-08-20T01:45:19.277 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.log 2024-08-20T01:45:19.277 INFO:teuthology.orchestra.run.smithi022.stderr: 82.6% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.cephadm.log.gz 2024-08-20T01:45:19.279 INFO:teuthology.orchestra.run.smithi077.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-20T01:45:19.280 INFO:teuthology.orchestra.run.smithi077.stderr:: No such file or directory 2024-08-20T01:45:19.280 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.4.log 2024-08-20T01:45:19.280 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.audit.log 2024-08-20T01:45:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.1.log 2024-08-20T01:45:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mon.b.log 2024-08-20T01:45:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.h.log 2024-08-20T01:45:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.10.log 2024-08-20T01:45:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.k.log 2024-08-20T01:45:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mgr.y.log 2024-08-20T01:45:19.284 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.cephadm.log 2024-08-20T01:45:19.284 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.e.log 2024-08-20T01:45:19.285 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-volume.log 2024-08-20T01:45:19.285 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.7.log 2024-08-20T01:45:19.285 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.b.log 2024-08-20T01:45:19.285 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.log 2024-08-20T01:45:19.289 INFO:teuthology.orchestra.run.smithi134.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-08-20T01:45:19.289 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-20T01:45:19.289 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.audit.log 2024-08-20T01:45:19.291 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.2.log 2024-08-20T01:45:19.291 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.8.log 2024-08-20T01:45:19.291 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mgr.z.log 2024-08-20T01:45:19.291 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.5.log 2024-08-20T01:45:19.291 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.c.log 2024-08-20T01:45:19.291 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.f.log 2024-08-20T01:45:19.292 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-volume.log: /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.log: 88.1% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.log.gz 2024-08-20T01:45:19.292 INFO:teuthology.orchestra.run.smithi022.stderr: 90.8% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-volume.log.gz 2024-08-20T01:45:19.294 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.11.log 2024-08-20T01:45:19.294 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.i.log 2024-08-20T01:45:19.294 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.cephadm.log 2024-08-20T01:45:19.294 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-volume.log 2024-08-20T01:45:19.294 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.l.log 2024-08-20T01:45:19.294 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mon.c.log 2024-08-20T01:45:19.294 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.log 2024-08-20T01:45:19.297 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.l.log: /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mon.c.log: /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.log: 95.1% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.l.log.gz 2024-08-20T01:45:19.379 INFO:teuthology.orchestra.run.smithi134.stderr: 82.4% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.cephadm.log.gz 2024-08-20T01:45:19.379 INFO:teuthology.orchestra.run.smithi134.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-20T01:45:19.382 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.b.log: /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.log: 82.4% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.cephadm.log.gz 2024-08-20T01:45:19.409 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.log.gz 2024-08-20T01:45:19.411 INFO:teuthology.orchestra.run.smithi134.stderr: 92.7% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mgr.z.log.gz 2024-08-20T01:45:19.474 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.log.gz 2024-08-20T01:45:19.501 INFO:teuthology.orchestra.run.smithi077.stderr: 90.4% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.audit.log.gz 2024-08-20T01:45:19.524 INFO:teuthology.orchestra.run.smithi134.stderr: 90.4% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph.audit.log.gz 2024-08-20T01:45:19.547 INFO:teuthology.orchestra.run.smithi022.stderr: 90.4% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mgr.x.log.gz 2024-08-20T01:45:19.630 INFO:teuthology.orchestra.run.smithi134.stderr: 90.8% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-volume.log.gz 2024-08-20T01:45:19.866 INFO:teuthology.orchestra.run.smithi077.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-20T01:45:19.890 INFO:teuthology.orchestra.run.smithi077.stderr: 92.5% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mgr.y.log.gz 2024-08-20T01:45:19.903 INFO:teuthology.orchestra.run.smithi077.stderr: 90.8% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-volume.log.gz 2024-08-20T01:45:20.124 INFO:teuthology.orchestra.run.smithi022.stderr: 90.3% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mon.a.log.gz 2024-08-20T01:45:20.254 INFO:teuthology.orchestra.run.smithi077.stderr: 95.0% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.k.log.gz 2024-08-20T01:45:25.553 INFO:teuthology.orchestra.run.smithi134.stderr: 91.6% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mon.c.log.gz 2024-08-20T01:45:25.728 INFO:teuthology.orchestra.run.smithi077.stderr: 91.6% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mon.b.log.gz 2024-08-20T01:45:36.319 INFO:teuthology.orchestra.run.smithi022.stderr: 91.9% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.9.log.gz 2024-08-20T01:45:47.023 INFO:teuthology.orchestra.run.smithi022.stderr: 91.9% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.6.log.gz 2024-08-20T01:45:49.123 INFO:teuthology.orchestra.run.smithi022.stderr: 92.1% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.0.log.gz 2024-08-20T01:45:50.953 INFO:teuthology.orchestra.run.smithi022.stderr: 92.2% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.3.log.gz 2024-08-20T01:45:50.955 INFO:teuthology.orchestra.run.smithi022.stderr: 2024-08-20T01:45:50.955 INFO:teuthology.orchestra.run.smithi022.stderr:real 0m31.707s 2024-08-20T01:45:50.955 INFO:teuthology.orchestra.run.smithi022.stderr:user 1m44.292s 2024-08-20T01:45:50.955 INFO:teuthology.orchestra.run.smithi022.stderr:sys 0m3.104s 2024-08-20T01:46:10.666 INFO:teuthology.orchestra.run.smithi077.stderr: 95.2% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.h.log.gz 2024-08-20T01:46:28.037 INFO:teuthology.orchestra.run.smithi077.stderr: 92.0% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.4.log.gz 2024-08-20T01:46:59.859 INFO:teuthology.orchestra.run.smithi077.stderr: 95.2% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.e.log.gz 2024-08-20T01:47:27.106 INFO:teuthology.orchestra.run.smithi077.stderr: 91.8% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.10.log.gz 2024-08-20T01:47:52.028 INFO:teuthology.orchestra.run.smithi077.stderr: 92.1% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.1.log.gz 2024-08-20T01:48:12.199 INFO:teuthology.orchestra.run.smithi077.stderr: 92.2% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.7.log.gz 2024-08-20T01:50:53.327 INFO:teuthology.orchestra.run.smithi077.stderr: 93.5% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.b.log.gz 2024-08-20T01:50:53.329 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-08-20T01:50:53.329 INFO:teuthology.orchestra.run.smithi077.stderr:real 5m34.075s 2024-08-20T01:50:53.329 INFO:teuthology.orchestra.run.smithi077.stderr:user 4m58.841s 2024-08-20T01:50:53.329 INFO:teuthology.orchestra.run.smithi077.stderr:sys 0m11.337s 2024-08-20T01:50:54.499 INFO:teuthology.orchestra.run.smithi134.stderr: 91.9% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.2.log.gz 2024-08-20T01:51:02.105 INFO:teuthology.orchestra.run.smithi134.stderr: 95.1% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.f.log.gz 2024-08-20T01:51:17.995 INFO:teuthology.orchestra.run.smithi134.stderr: 92.3% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.11.log.gz 2024-08-20T01:51:23.369 INFO:teuthology.orchestra.run.smithi134.stderr: 91.9% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.5.log.gz 2024-08-20T01:51:35.772 INFO:teuthology.orchestra.run.smithi134.stderr: 92.0% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-osd.8.log.gz 2024-08-20T02:08:45.126 INFO:teuthology.orchestra.run.smithi134.stderr: 93.4% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.c.log.gz 2024-08-20T02:10:06.238 INFO:teuthology.orchestra.run.smithi134.stderr: 93.4% -- replaced with /var/log/ceph/586fd06c-5e92-11ef-bccf-c7b262605968/ceph-mds.i.log.gz 2024-08-20T02:10:06.279 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-08-20T02:10:06.279 INFO:teuthology.orchestra.run.smithi134.stderr:real 24m47.026s 2024-08-20T02:10:06.279 INFO:teuthology.orchestra.run.smithi134.stderr:user 8m48.574s 2024-08-20T02:10:06.279 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m25.226s 2024-08-20T02:10:06.280 INFO:tasks.cephadm:Archiving logs... 2024-08-20T02:10:06.281 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861327/remote/smithi022/log 2024-08-20T02:10:06.282 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-20T02:10:22.966 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861327/remote/smithi077/log 2024-08-20T02:10:22.967 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-20T02:11:09.377 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861327/remote/smithi134/log 2024-08-20T02:11:09.378 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-20T02:12:31.822 INFO:tasks.cephadm:Removing cluster... 2024-08-20T02:12:31.823 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 --force 2024-08-20T02:12:32.037 INFO:teuthology.orchestra.run.smithi022.stdout:Deleting cluster with fsid: 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T02:12:32.461 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 --force 2024-08-20T02:12:32.664 INFO:teuthology.orchestra.run.smithi077.stdout:Deleting cluster with fsid: 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T02:12:33.235 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 586fd06c-5e92-11ef-bccf-c7b262605968 --force 2024-08-20T02:12:33.756 INFO:teuthology.orchestra.run.smithi134.stdout:Deleting cluster with fsid: 586fd06c-5e92-11ef-bccf-c7b262605968 2024-08-20T02:12:34.551 INFO:tasks.cephadm:Removing cephadm ... 2024-08-20T02:12:34.551 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-20T02:12:34.572 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-20T02:12:34.592 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-20T02:12:34.608 INFO:tasks.cephadm:Teardown complete 2024-08-20T02:12:34.608 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-20T02:12:34.624 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-20T02:12:34.624 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-20T02:12:34.627 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-20T02:12:34.634 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-20T02:12:34.783 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-20T02:12:34.795 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-20T02:12:34.795 DEBUG:teuthology.orchestra.run.smithi022:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-20T02:12:34.798 DEBUG:teuthology.orchestra.run.smithi077:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-20T02:12:34.800 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-20T02:12:34.812 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2024-08-20T02:12:34.815 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-08-20T02:12:34.815 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-08-20T02:12:34.816 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-20T02:12:34.816 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-08-20T02:12:34.816 INFO:teuthology.orchestra.run.smithi022.stdout:^* hv01.front.sepia.ceph.com 3 6 377 20 -436us[ -443us] +/- 53ms 2024-08-20T02:12:34.817 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 +583us[ +576us] +/- 50ms 2024-08-20T02:12:34.817 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 -242us[ -250us] +/- 86ms 2024-08-20T02:12:34.817 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T02:12:34.829 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-20T02:12:34.829 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-08-20T02:12:34.829 INFO:teuthology.orchestra.run.smithi077.stdout:^* hv01.front.sepia.ceph.com 3 6 377 21 -426us[ -378us] +/- 53ms 2024-08-20T02:12:34.829 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 +594us[ +594us] +/- 50ms 2024-08-20T02:12:34.829 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 -212us[ -163us] +/- 86ms 2024-08-20T02:12:34.829 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T02:12:34.887 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-20T02:12:34.887 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-08-20T02:12:34.887 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv01.front.sepia.ceph.com 3 6 377 18 -435us[ -401us] +/- 53ms 2024-08-20T02:12:34.888 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 18 +627us[ +627us] +/- 50ms 2024-08-20T02:12:34.888 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 -220us[ -187us] +/- 86ms 2024-08-20T02:12:34.888 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T02:12:34.905 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-20T02:12:34.917 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-20T02:12:34.918 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-20T02:12:34.929 DEBUG:teuthology.orchestra.run.smithi022:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-20T02:12:35.003 DEBUG:teuthology.orchestra.run.smithi077:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-20T02:12:35.072 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-20T02:12:35.165 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-20T02:12:35.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T02:12:35.198 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-20T02:12:35.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T02:12:35.227 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-20T02:12:35.253 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T02:12:35.253 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-20T02:12:35.266 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-20T02:12:35.280 INFO:teuthology.task.internal:Duration was 3401.342482 seconds 2024-08-20T02:12:35.281 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-20T02:12:35.295 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-20T02:12:35.296 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-20T02:12:35.298 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-20T02:12:35.301 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-20T02:12:35.343 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-20T02:12:35.371 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-20T02:12:35.381 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-20T02:12:35.868 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-20T02:12:35.868 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi022.front.sepia.ceph.com 2024-08-20T02:12:35.869 DEBUG:teuthology.orchestra.run.smithi022:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-20T02:12:35.900 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi077.front.sepia.ceph.com 2024-08-20T02:12:35.900 DEBUG:teuthology.orchestra.run.smithi077:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-20T02:12:35.932 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-08-20T02:12:35.932 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-20T02:12:35.960 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-20T02:12:35.960 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-20T02:12:35.963 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-20T02:12:35.975 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-20T02:12:36.063 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-20T02:12:36.063 DEBUG:teuthology.orchestra.run.smithi022:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-20T02:12:36.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-20T02:12:36.068 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-20T02:12:36.936 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-20T02:12:36.947 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-20T02:12:36.948 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-20T02:12:36.974 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-20T02:12:37.002 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-20T02:12:37.052 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-20T02:12:37.064 DEBUG:teuthology.orchestra.run.smithi022:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-20T02:12:37.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-20T02:12:37.069 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-20T02:12:37.088 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = core 2024-08-20T02:12:37.100 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = core 2024-08-20T02:12:37.116 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-08-20T02:12:37.158 DEBUG:teuthology.orchestra.run.smithi022:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-20T02:12:37.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T02:12:37.174 DEBUG:teuthology.orchestra.run.smithi077:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-20T02:12:37.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T02:12:37.214 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-20T02:12:37.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T02:12:37.231 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-20T02:12:37.244 INFO:teuthology.task.internal:Transferring archived files... 2024-08-20T02:12:37.246 DEBUG:teuthology.misc:Transferring archived files from smithi022:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861327/remote/smithi022 2024-08-20T02:12:37.246 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-20T02:12:37.297 DEBUG:teuthology.misc:Transferring archived files from smithi077:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861327/remote/smithi077 2024-08-20T02:12:37.298 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-20T02:12:37.332 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861327/remote/smithi134 2024-08-20T02:12:37.332 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-20T02:12:37.369 INFO:teuthology.task.internal:Removing archive directory... 2024-08-20T02:12:37.369 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-20T02:12:37.372 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-20T02:12:37.374 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-20T02:12:37.421 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-20T02:12:37.433 INFO:teuthology.task.internal:Not uploading archives. 2024-08-20T02:12:37.433 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-20T02:12:37.445 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-20T02:12:37.446 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-20T02:12:37.448 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-20T02:12:37.450 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-20T02:12:37.461 INFO:teuthology.orchestra.run.smithi022.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 20 02:12 /home/ubuntu/cephtest 2024-08-20T02:12:37.463 INFO:teuthology.orchestra.run.smithi077.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 20 02:12 /home/ubuntu/cephtest 2024-08-20T02:12:37.478 INFO:teuthology.orchestra.run.smithi134.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 20 02:12 /home/ubuntu/cephtest 2024-08-20T02:12:37.479 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-20T02:12:37.491 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-20T02:12:37.538 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/blogbench}} duration: 3401.342482328415 failure_reason: '"2024-08-20T01:34:34.811217+0000 mds.i (mds.0) 24 : cluster [WRN] Scrub error on inode 0x100000023d9 (/volumes/qa/sv_1/3be0a5f5-9967-4951-8ad4-27cd511ce0fd/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51) see mds.i log and `damage ls` output for details" in cluster log' flavor: default owner: scheduled_hyelloji@teuthology success: false 2024-08-20T02:12:37.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-20T02:12:37.643 INFO:teuthology.run:FAIL